Vehicle control method, apparatus, device, storage medium, and product

Abstract

The application discloses a vehicle control method, device, equipment, storage medium and product, and relates to the technical field of intelligent driving. The application tracks the real-time state of a driver by acquiring first face video information of the driver. Once it is preliminarily judged that the driver has abnormal behavior through the first face video information, a confirmation request is immediately initiated to other passengers in the vehicle, so that the accuracy of the judgment on the state of the driver is ensured, and misjudgment is prevented. After the response information of the other passengers is fed back, the vehicle is taken over according to the response information and corresponding control is performed, so that the emergency situation is quickly responded to, and the danger of vehicle out of control is avoided. Through the command of the response passengers, better emergency efficiency is realized.

Description

Technical Field

[0001] This application relates to the field of intelligent driving technology, and in particular to a vehicle control method, device, equipment, storage medium, and product. Background Technology

[0002] Drivers experience fatigue after long periods of driving. Symptoms include drowsiness, frequent yawning, heavy eyes, and blurred vision. For example, during long drives, drivers may unconsciously close their eyes for a few seconds; this brief "nap" can lead to serious traffic accidents.

[0003] In related technologies, vehicles can monitor drivers through driver monitoring systems (DMS) and issue warnings when driver fatigue is detected. However, these technologies rely solely on the poor accuracy of images and videos and lack mandatory intervention measures to control vehicle usage, thus safety remains difficult to guarantee.

[0004] Therefore, improving driving safety is an urgent problem to be solved. Summary of the Invention

[0005] The main objective of this application is to provide a vehicle control method, device, equipment, storage medium, and product, which aims to solve the technical problem of how to improve driving safety.

[0006] To achieve the above objectives, this application proposes a vehicle control method, which includes: Continuously acquire the driver's first facial video information; If the driver is found to be behaving abnormally based on the first facial video information, a confirmation request is sent to the other passengers in the vehicle. If other passengers provide feedback on the confirmation request, and it is determined that the driver has engaged in abnormal behavior, the driver takes over the vehicle and executes controls corresponding to the response information.

[0007] In some embodiments, the step of initiating a confirmation request to other passengers in the vehicle when it is determined, based on the first facial video information, that the driver has exhibited abnormal behavior includes: If the driver is found to be behaving abnormally based on the first facial video information, a voice prompt is sent to the passenger to check the driver's condition, and if the abnormal behavior of the driver is confirmed, a pre-set target behavior is executed.

[0008] In some embodiments, when it is determined from the first facial video information that the driver is exhibiting abnormal behavior, the vehicle control method further includes: Continuously acquire second facial video information of the other passengers; Based on the second facial video information, the real-time emotions of the other passengers are identified; If the real-time emotion is determined to be in a state of strong fluctuation, it is determined that the driver is exhibiting abnormal behavior.

[0009] In some embodiments, taking over the vehicle and performing control corresponding to the response information includes: Obtain control of the vehicle; If the response information contains voice data, identify the sentences in the voice data; When the statement instructs the vehicle to pull over, control the vehicle to perform the pullover operation.

[0010] In some embodiments, after recognizing statements in the voice data when the response information includes voice data, the vehicle control method further includes: When the statement indicates that the destination should be reached, at least one candidate route is determined based on the vehicle's current location and the destination. Based on the road conditions of each candidate route, the corresponding arrival time is estimated; Select the candidate route with the shortest arrival time as the target route, and control the vehicle to travel along the target route.

[0011] In some embodiments, when it is determined from the first facial video information that the driver is exhibiting abnormal behavior, the vehicle control method further includes: In the event that the abnormal behavior is fatigued driving, in response to the vehicle being shut down, the engine shutdown time and the first image information of the driver are acquired. When vehicle startup is detected, the time difference between the startup time and the previously mentioned shutdown time is detected. If the time difference is less than a specified difference, the second image information of the current driver is obtained; If it is determined that the driver's identity is the same in the first image information and the second image information, the vehicle is prohibited from operating.

[0012] Furthermore, to achieve the above objectives, this application also proposes a vehicle control device, which includes: The video acquisition module is used to continuously acquire the driver's first facial video information; The secondary confirmation module is used to initiate a confirmation request to other passengers in the vehicle if the driver is found to have abnormal behavior based on the first facial video information. The vehicle takeover module is used to determine if the driver has engaged in abnormal behavior when other passengers provide feedback on the confirmation request, and to take over the vehicle and execute controls corresponding to the response information.

[0013] In addition, to achieve the above objectives, this application also proposes a vehicle control device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the vehicle control method described above.

[0014] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the vehicle control method described above.

[0015] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the vehicle control method described above.

[0016] One or more technical solutions proposed in this application have at least the following technical effects: By acquiring the driver's first facial video information, the driver's real-time status is tracked. Once an abnormal behavior is initially determined based on the first facial video information, a confirmation request is immediately sent to other passengers in the vehicle, thereby ensuring the accuracy of the driver's status assessment and preventing misjudgment. After other passengers provide feedback, the vehicle is taken over and corresponding controls are executed based on the feedback information, thereby quickly responding to emergencies and avoiding danger caused by loss of vehicle control. By responding to passenger commands, better emergency response efficiency is achieved. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1A schematic flowchart of a vehicle control method provided in an embodiment of this application is shown; Figure 2 A schematic flowchart of a vehicle control method provided in an exemplary embodiment of this application is shown; Figure 3 A schematic diagram of the structure of a vehicle control device provided in an embodiment of this application is shown; Figure 4 A schematic diagram of the structure of a vehicle control device provided in an embodiment of this application is shown.

[0020] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0021] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0022] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0023] The main solution of this application embodiment is: continuously acquiring the driver's first facial video information; if it is determined that the driver has abnormal behavior based on the first facial video information, initiating a confirmation request to other passengers in the vehicle; if other passengers provide response information to the confirmation request, determining that the driver has abnormal behavior, taking over the vehicle and executing control corresponding to the response information.

[0024] Drivers experience fatigue after long periods of driving. Symptoms include drowsiness, frequent yawning, heavy eyes, and blurred vision. For example, during long drives, drivers may unconsciously close their eyes for a few seconds; this brief "nap" can lead to serious traffic accidents.

[0025] In related technologies, vehicles can monitor drivers through driver monitoring systems (DMS) and issue warnings when driver fatigue is detected. However, these technologies rely solely on the poor accuracy of images and videos and lack mandatory intervention measures to control vehicle usage, thus safety remains difficult to guarantee.

[0026] In conclusion, improving driving safety is an urgent problem that needs to be solved.

[0027] Based on this, this application provides a solution that enables the accurate detection and confirmation of abnormal driver behavior and intervenes in vehicle control through forced transfer of authority, thereby ensuring driving safety.

[0028] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or a vehicle control device capable of performing the above functions. The following description uses a vehicle control device as an example to illustrate this embodiment and the subsequent embodiments.

[0029] Reference Figure 1 , Figure 1 A schematic flowchart of a vehicle control method according to an embodiment of this application is shown. The vehicle control method can be applied to a vehicle control device and includes the following steps S110 to S130: Step S110: Continuously acquire the driver's first facial video information.

[0030] While the vehicle is in motion, the driver's position can be continuously filmed via a DMS (Driver Monitoring System). The DMS can include a camera to capture real-time images of the driver's face and actions, and it typically includes infrared capabilities to ensure accurate image / video acquisition under varying lighting conditions.

[0031] In some implementations, the DMS may also include sensors that can collect driver-related physiological signals, such as heart rate and respiration, to provide data support for more comprehensive monitoring of the driver's condition.

[0032] In this embodiment, the driver's first facial video information can be continuously acquired and stored from the moment the vehicle starts. In some implementations, to avoid excessive memory usage, the system can be configured to save only the first facial video information within the most recent specified time period for subsequent evidence retention.

[0033] Step S120: If the driver is found to have abnormal behavior based on the first facial video information, a confirmation request is sent to the other passengers in the vehicle.

[0034] In step S130, if other passengers provide response information to the confirmation request, and it is determined that the driver has engaged in abnormal behavior, the driver takes over the vehicle and executes controls corresponding to the response information.

[0035] As mentioned above, the vehicle control device may also include a processor, which can receive first facial video information and sensing data acquired by the aforementioned sensors, and perform analysis and judgment based on this data.

[0036] In some implementations, the processor can extract a person's image based on the first facial video information. A convolutional neural network model can be pre-trained using a large number of images, enabling the model to extract the corresponding person's image and label it accordingly based on the input first facial video information. As an example, the driver's expression and facial features, such as closed eyes, distorted expressions of pain, etc., can be labeled.

[0037] In this embodiment, abnormal behavior can include a variety of behaviors, such as keeping the eyes closed for a long time, maintaining a distorted and painful expression for a long time, or having no change in expression for a long time.

[0038] Taking prolonged eye closure as an example, it could reflect a brief period of sleep due to driver fatigue, or even that the user has lost consciousness. In the first facial video recording, a timer can be started whenever the user's eyes are detected to be closed. If the user remains in this state for a specified period, it can be assumed that the user is in one of the aforementioned situations, potentially leading to a traffic accident.

[0039] For example, maintaining a distorted and painful facial expression for an extended period could indicate a sudden illness in the user's body, such as acute and severe damage to the heart or other organs, causing significant pain that manifests as a distorted and painful facial expression with tense facial muscles. If the first facial video data detects that the user's expression remains distorted and painful for a specified duration, it can be assumed that the user is in such a state and lacks conscious awareness to control the vehicle.

[0040] It is understood that the above examples are only some possible scenarios, and the actual abnormal behaviors that may occur are not limited to the examples above. The determination and types of abnormal behaviors can be preset, and this embodiment will not elaborate on them here.

[0041] In some implementations, if the driver is found to be behaving abnormally based on the first facial video information, a voice prompt is sent to prompt the passenger to check the driver's condition, and if the abnormal behavior of the driver is confirmed, a pre-set target behavior is executed.

[0042] Understandably, if there are other passengers in the vehicle, they can quickly learn from the voice prompts that the driver has exhibited abnormal behavior and then further verify the information. Specifically, the format of the voice prompts can be pre-set, such as "Please confirm the presence of the driver (A). If the driver exhibits this abnormal behavior, please execute (B)." Here, A can be the type of abnormal behavior the driver might exhibit, such as unconsciousness or sleep. B can be a pre-defined action, such as a passenger answering or pressing a designated confirm / deny button as a response.

[0043] As an example, suppose there is a touchscreen at the passenger's location. When it is initially detected that the driver may be unconscious, a voice prompt is issued via the vehicle's audio system: "Please confirm whether the driver is unconscious. If the driver exhibits this abnormal behavior, please click the confirmation button on the screen." After confirming that the driver is unconscious, the passenger clicks the confirmation button on the touchscreen, triggering the generation of response information. Based on this response information, control of the vehicle is transferred from the driver to the vehicle control equipment.

[0044] As another example, when it is initially detected that the driver may be unconscious, a voice prompt is issued through the vehicle's audio system: "Please confirm whether the driver is unconscious. If the driver exhibits this abnormal behavior, please respond via voice." After confirming that the driver is unconscious, the passenger can trigger the transfer of vehicle control by inputting the response message "Driver unconscious" via voice.

[0045] In some implementations, when the response information includes speech data, sentences within the speech data can also be recognized. The speech data refers to the content input by the user via voice. In some implementations, a speech recognition model can be pre-trained to recognize and output words from the speech data, resulting in logically coherent and complete sentences.

[0046] In this scenario, if the voice command instructs the vehicle to pull over, the system can control the vehicle to perform the pullover. It's understandable that other passengers, whose safety is paramount, should have their commands prioritized in a crisis. For example, if the user's voice input includes "Confirm driver unconscious, pull over immediately," the vehicle control system can take over control, assess the road conditions ahead and behind, and immediately activate the hazard lights and pull over.

[0047] When the statement indicates a destination, a route can be planned and the destination can be reached immediately. Specifically, after identifying the destination, at least one candidate route can be determined based on the vehicle's current location and the destination. It is understandable that there may be multiple routes between the current location and the destination, each serving as a candidate route. Different candidate routes may have different road conditions; for example, some sections may be congested, while others may be under construction or have detours.

[0048] Based on the road conditions of each candidate route, the corresponding arrival time can be estimated. For example, if autonomous driving is carried out at a specified safe speed, such as 40 km / h, it will take a minutes to reach the designated location via candidate route 1, b minutes via candidate route 2, c minutes via candidate route 3, and so on.

[0049] After that, based on the required time, the candidate route with the shortest arrival time can be selected as the target route, and the vehicle can be controlled to travel along the target route to reach the designated location (such as the emergency center of a hospital) as quickly as possible.

[0050] In other possible implementations, all road condition information within a certain area, including the current location and a specified destination, can be obtained first. Based on the road condition information within the area, the corresponding optimal route can be directly generated and the journey can be carried out according to the optimal route.

[0051] In some implementations, second facial video information of other passengers can be continuously acquired; the real-time emotions of other passengers can be identified based on the second facial video information; and if the real-time emotions are determined to be strongly fluctuating, abnormal driver behavior can be determined. It is understood that passenger emotion recognition can serve as an auxiliary determination method.

[0052] In some implementations, after determining that the driver has engaged in abnormal behavior, an emergency distress signal can be sent and uploaded to the monitoring platform, which will then handle the emergency, such as assisting relevant departments in coordinating traffic control or contacting emergency hospitals.

[0053] The above embodiments all assume that there are other passengers besides the driver in the vehicle. However, in some embodiments, if the vehicle only contains the driver and no other passengers, the determination can be made according to a certain weight value.

[0054] For example, the user's relevant content can be identified in the first facial video information, including expressions, eyes, torso, arms, etc., and corresponding weight values ​​can be assigned to each of these elements. When certain elements appear together, and the sum of their weight values ​​falls within a corresponding preset range, it can be considered that the user may be exhibiting abnormal behavior, thereby directly executing a judgment and taking over control of the vehicle.

[0055] In other implementations, after the determination, a prompt message can be issued to the user, for example, via an audio prompt, allowing the user to confirm whether the determination was correct. It is understood that if no response is received from the user within a specified time, it can be confirmed that the driver has engaged in abnormal behavior. Conversely, if the user responds within the specified time that they have not engaged in abnormal behavior, it can be confirmed that the driver has not engaged in abnormal behavior, thereby reducing the occurrence of misjudgments.

[0056] Furthermore, in some cases, some drivers may evade supervision after being detected as driving while fatigued, by turning off the vehicle and then restarting it. Therefore, in this embodiment, in response to the vehicle being controlled to turn off, the engine shutdown time and the driver's first image information are acquired; if the vehicle is detected to start, the time difference between the start time and the previous shutdown time is detected; if the time difference is less than a specified value, the current driver's second image information is acquired; if it is determined that the driver's identity in the first image information and the second image information is the same, vehicle operation is prohibited.

[0057] It is understandable that if a vehicle is turned off and restarted shortly after a period of time, and the driver is still the same person, then that driver must still be in a state of fatigue. In order to avoid danger, the vehicle can be prohibited from starting and running until the specified rest period is reached.

[0058] This embodiment provides a vehicle control method that tracks the driver's real-time status by acquiring the driver's first facial video information. Once it is preliminarily determined through the first facial video information that the driver is behaving abnormally, a confirmation request is immediately sent to other passengers in the vehicle to ensure the accuracy of the driver's status assessment and prevent misjudgment. After other passengers provide feedback, the vehicle is taken over and corresponding controls are executed based on the feedback information, thereby quickly responding to emergencies and preventing the vehicle from going out of control and causing danger. By responding to passengers' commands, better emergency response efficiency is achieved.

[0059] For example, to help understand the implementation flow of the vehicle control method obtained by combining this embodiment with the above embodiments, please refer to... Figure 2 , specifically: S11, DMS captures the driver's facial video stream.

[0060] S12, DMS determines whether the driver exhibits abnormal behavior based on the driver's facial video stream.

[0061] If yes, proceed to step S17; otherwise, proceed to step S13.

[0062] S13. If abnormal driving behavior is observed, the vehicle will remind the driver not to drive while fatigued via voice or other means.

[0063] S14, inquire whether the other passengers or the driver in the vehicle exhibit any abnormal behavior, such as fatigue or illness.

[0064] S15: If the vehicle receives a response from the passenger, and determines that the driver has engaged in abnormal behavior based on the passenger's response, it will automatically pull over or navigate to the nearest hospital, while simultaneously initiating an SOS emergency call and uploading information to the online monitoring platform.

[0065] S16. If the vehicle receives a response from the passenger, it determines that the driver has not engaged in any abnormal behavior based on the passenger's response and continues driving normally along the original route.

[0066] S17 continues on its original route as normal.

[0067] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the vehicle control method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0068] This application also provides a vehicle control device, please refer to... Figure 3 The vehicle control device 100 includes: The video acquisition module 110 is used to continuously acquire the driver's first facial video information; The secondary confirmation module 120 is used to initiate a confirmation request to other passengers in the vehicle when it is determined from the first facial video information that the driver has abnormal behavior. The vehicle takeover module 130 is used to determine, when other passengers provide response information to the confirmation request, that the driver has engaged in abnormal behavior, take over the vehicle, and execute controls corresponding to the response information. The vehicle control device 100 provided in this application, employing the vehicle control method in the above embodiments, can solve the technical problem of how to improve driving safety. Compared with the prior art, the beneficial effects of the vehicle control device 100 provided in this application are the same as those of the vehicle control method provided in the above embodiments, and other technical features in the vehicle control device 100 are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0069] This application provides a vehicle control device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the vehicle control method in Embodiment 1 above.

[0070] The following is for reference. Figure 4 The diagram illustrates a structural schematic suitable for implementing vehicle control devices according to embodiments of this application. Vehicle control devices in embodiments of this application may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 4 The vehicle control device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this application.

[0071] like Figure 4 As shown, the vehicle control device 200 may include a processing unit 210 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 220 or a program loaded from storage device 230 into random access memory (RAM) 240. The RAM 240 also stores various programs and data required for the operation of the vehicle control device. The processing unit 210, ROM 220, and RAM 240 are interconnected via a bus 250. An input / output (I / O) interface 260 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 260: input devices 270 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 280 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 230 including, for example, magnetic tapes, hard disks, etc.; and communication devices 290. Communication device 290 allows the vehicle control equipment to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows a vehicle control equipment with various systems, it should be understood that it is not required to implement or have all of the systems shown. More or fewer systems may be implemented alternatively.

[0072] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 230, or installed from ROM 220. When the computer program is executed by processing device 210, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0073] The vehicle control device provided in this application, employing the vehicle control method described in the above embodiments, can solve the technical problem of how to improve driving safety. Compared with the prior art, the beneficial effects of the vehicle control device provided in this application are the same as those of the vehicle control method provided in the above embodiments, and other technical features of the vehicle control device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0074] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0075] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0076] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the vehicle control method in the above embodiments.

[0077] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0078] The aforementioned computer-readable storage medium may be included in the vehicle control equipment; or it may exist independently and not be installed in the vehicle control equipment.

[0079] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a vehicle control device, enable the vehicle control device to write computer program code for performing the operations of this application in one or more programming languages ​​or a combination thereof. These programming languages ​​include object-oriented programming languages—such as Java, Smalltalk, and C++—and conventional procedural programming languages—such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0080] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0081] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0082] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described vehicle control method, thereby solving the technical problem of how to improve driving safety. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the vehicle control method provided in the above embodiments, and will not be repeated here.

[0083] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the vehicle control method described above.

[0084] The computer program product provided in this application can solve the technical problem of how to improve driving safety. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the vehicle control method provided in the above embodiments, and will not be repeated here.

[0085] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A vehicle control method, characterized in that, The vehicle control method includes: Continuously acquire the driver's first facial video information; If the driver is found to be behaving abnormally based on the first facial video information, a confirmation request is sent to the other passengers in the vehicle. If other passengers provide feedback on the confirmation request, and it is determined that the driver has engaged in abnormal behavior, the driver takes over the vehicle and executes controls corresponding to the response information.

2. The vehicle control method as described in claim 1, characterized in that, The step of initiating a confirmation request to other passengers in the vehicle when it is determined, based on the first facial video information, that the driver has exhibited abnormal behavior includes: If the driver is found to be behaving abnormally based on the first facial video information, a voice prompt is sent to the passenger to check the driver's condition, and if the abnormal behavior of the driver is confirmed, a pre-set target behavior is executed.

3. The vehicle control method as described in claim 2, characterized in that, If the driver is found to be behaving abnormally based on the first facial video information, the vehicle control method further includes: Continuously acquire second facial video information of the other passengers; Based on the second facial video information, the real-time emotions of the other passengers are identified; If the real-time emotion is determined to be in a state of strong fluctuation, it is determined that the driver is exhibiting abnormal behavior.

4. The vehicle control method as described in claim 2, characterized in that, Taking over the vehicle and performing controls corresponding to the response information includes: Obtain control of the vehicle; If the response information contains voice data, identify the sentences in the voice data; When the statement instructs the vehicle to pull over, control the vehicle to perform the pullover operation.

5. The vehicle control method as described in claim 2, characterized in that, When the response information includes voice data, after recognizing the statements in the voice data, the vehicle control method further includes: When the statement indicates that the destination should be reached, at least one candidate route is determined based on the vehicle's current location and the destination. Based on the road conditions of each candidate route, the corresponding arrival time is estimated; Select the candidate route with the shortest arrival time as the target route, and control the vehicle to travel along the target route.

6. The vehicle control method as described in claim 1, characterized in that, If the driver is found to be behaving abnormally based on the first facial video information, the vehicle control method further includes: In the event that the abnormal behavior is fatigued driving, in response to the vehicle being shut down, the engine shutdown time and the first image information of the driver are acquired. When vehicle startup is detected, the time difference between the startup time and the previously mentioned shutdown time is detected. If the time difference is less than a specified difference, the second image information of the current driver is obtained; If it is determined that the driver's identity is the same in the first image information and the second image information, the vehicle is prohibited from operating.

7. A vehicle control device, characterized in that, The vehicle control device includes: The video acquisition module is used to continuously acquire the driver's first facial video information; The secondary confirmation module is used to initiate a confirmation request to other passengers in the vehicle if the driver is found to have abnormal behavior based on the first facial video information. The vehicle takeover module is used to determine if the driver has engaged in abnormal behavior when other passengers provide feedback on the confirmation request, and to take over the vehicle and execute controls corresponding to the response information.

8. A vehicle control device, characterized in that, The vehicle control device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the vehicle control method as described in any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the vehicle control method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the vehicle control method as described in any one of claims 1 to 6.

Images