Vehicle control method and device, storage medium, terminal, and vehicle

Abstract

The application discloses a vehicle control method and device, a storage medium and a terminal, wherein the vehicle-mounted terminal is connected with an intelligent terminal of a driver's family, and the vehicle control method based on the vehicle-mounted terminal comprises the following steps: obtaining a health state of the driver; sending the health state of the driver to the intelligent terminal, so that the intelligent terminal sends a first control instruction to the vehicle according to the health state of the driver; and controlling the vehicle according to the health state of the driver or the first control instruction. Therefore, the emergency response speed can be improved, the intelligent home and the vehicle-mounted terminal can be deeply integrated, and the safety guarantee of the driver is enhanced.

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and in particular to a vehicle control method based on an in-vehicle terminal, a computer-readable storage medium, a vehicle control device based on an in-vehicle terminal, an in-vehicle terminal, a vehicle, a vehicle control method based on a smart terminal, another computer-readable storage medium, a vehicle control device based on a smart terminal, and a smart terminal. Background Technology

[0002] With the rapid development and widespread adoption of intelligent connected vehicles and smart home technologies, people's daily lives are becoming increasingly intelligent and convenient. Intelligent connected vehicles not only enhance driving comfort and safety but also enable real-time interaction with the outside world through their in-vehicle systems. Smart home systems, on the other hand, connect various devices within the home through IoT technology, achieving intelligent management of the home environment. However, while enjoying the convenience brought by these technologies, how to effectively integrate the resources of intelligent connected vehicles and smart homes to further improve the safety and health management of family members and drivers has become an urgent problem to be solved.

[0003] Various monitoring systems for driver status already exist, capable of monitoring drivers' physiological indicators in real time and issuing warnings when abnormalities are detected, thus effectively reducing the risk of traffic accidents. However, most of these systems focus on the driver themselves, neglecting deep connections with family members. Summary of the Invention

[0004] This invention aims to at least partially address one of the technical problems in related technologies. Therefore, the first objective of this invention is to propose a vehicle control method based on an in-vehicle terminal, which can improve emergency response speed and promote the deep integration of smart homes and in-vehicle terminals, thereby enhancing driver safety.

[0005] A second objective of this invention is to provide a computer-readable storage medium.

[0006] The third objective of this invention is to provide a vehicle control device based on an in-vehicle terminal.

[0007] The fourth objective of this invention is to provide an in-vehicle terminal.

[0008] The fifth objective of this invention is to provide a vehicle.

[0009] The sixth objective of this invention is to propose a vehicle control method based on a smart terminal.

[0010] The seventh object of the present invention is to provide another computer-readable storage medium.

[0011] The eighth objective of this invention is to provide a vehicle control device based on a smart terminal.

[0012] The ninth objective of this invention is to provide a smart terminal.

[0013] To achieve the above objectives, a first aspect of the present invention provides a vehicle control method based on an in-vehicle terminal, wherein the in-vehicle terminal is connected to a smart terminal in the driver's home, and the method includes: acquiring the driver's health status; sending the driver's health status to the smart terminal so that the smart terminal can send a first control command to the vehicle based on the driver's health status; and controlling the vehicle based on the driver's health status or the first control command.

[0014] According to an embodiment of the vehicle control method based on an in-vehicle terminal of the present invention, the driver's health status is acquired and sent to a smart terminal, so that the smart terminal can send a first control command to the vehicle based on the driver's health status, thereby controlling the vehicle according to the driver's health status or the first control command. This improves emergency response speed and promotes deep integration of smart homes and in-vehicle terminals, thus enhancing driver safety.

[0015] In addition, the vehicle control method based on an in-vehicle terminal according to the above embodiments of the present invention may further include the following additional technical features:

[0016] According to one embodiment of the present invention, the method further includes: acquiring the user's facial expression information and physiological indicator information; and determining the driver's health status based on the facial expression information and the physiological indicator information.

[0017] According to one embodiment of the present invention, the method further includes: determining the driver's health status as abnormal when the driver's facial expression information is determined to be abnormal and / or the driver's physiological indicators are determined to be abnormal based on the driver's physiological indicator information.

[0018] According to one embodiment of the present invention, after sending the driver's health status to the smart terminal when the driver's health status is in the abnormal state, the method further includes: granting the smart terminal control access to the vehicle's controller.

[0019] According to one embodiment of the present invention, controlling the vehicle based on the driver's health status or the first control command includes: controlling the vehicle to perform emergency rescue measures when the driver's health status is in the abnormal state.

[0020] According to one embodiment of the present invention, the method further includes: acquiring warning information generated by the smart terminal based on the health status of the family members; and generating reminder information based on the warning information to remind the driver to check the health status of the family members.

[0021] According to one embodiment of the present invention, the warning information includes regular warning information and emergency warning information, and the method further includes: when the warning information is emergency warning information, determining the second location information of the smart terminal, so that the driver can drive to the location of the family member according to the second location information.

[0022] To achieve the above objectives, a second aspect of the present invention provides a computer-readable storage medium storing a vehicle control program based on an in-vehicle terminal, wherein when the vehicle control program is executed by a processor, it implements the vehicle control method based on an in-vehicle terminal described in the aforementioned embodiments of the present invention.

[0023] According to embodiments of the present invention, a computer-readable storage medium, through which a processor executes a vehicle control program based on an in-vehicle terminal, can improve emergency response speed and promote the deep integration of smart homes and in-vehicle terminals, thereby enhancing driver safety.

[0024] To achieve the above objectives, a third aspect of the present invention provides a vehicle control device based on an in-vehicle terminal, wherein the in-vehicle terminal is connected to a smart terminal in the driver's home, and the device includes: an acquisition module for acquiring the driver's health status; a transmission module for transmitting the driver's health status to the smart terminal so that the smart terminal can send a first control command to the vehicle based on the driver's health status; and a control module for controlling the vehicle based on the driver's health status or the first control command.

[0025] According to an embodiment of the vehicle control device based on an in-vehicle terminal of the present invention, an acquisition module acquires the driver's health status, and a transmission module transmits the driver's health status to a smart terminal. The smart terminal then sends a first control command to the vehicle based on the driver's health status, thereby enabling the control module to control the vehicle based on either the driver's health status or the first control command. This improves emergency response speed and promotes deeper integration between smart homes and in-vehicle terminals, thus enhancing driver safety.

[0026] To achieve the above objectives, a fourth aspect of the present invention provides an in-vehicle terminal, including the in-vehicle control device based on the in-vehicle terminal described in the foregoing embodiments of the present invention.

[0027] According to the vehicle-mounted terminal of the present invention, by adopting the vehicle-mounted control device based on the vehicle-mounted terminal of the above embodiments of the present invention, emergency response speed can be improved and the deep integration of smart home and vehicle-mounted terminal can be promoted, thereby enhancing the safety of the driver.

[0028] To achieve the above objectives, a fifth aspect of the present invention provides a vehicle including the vehicle-mounted terminal described in the foregoing embodiments of the present invention.

[0029] According to the embodiments of the present invention, by adopting the vehicle-mounted terminal of the above embodiments of the present invention, the emergency response speed can be improved, and the deep integration of smart home and vehicle-mounted terminal can be promoted, thereby enhancing the safety of the driver.

[0030] To achieve the above objectives, a sixth aspect of the present invention provides a vehicle control method based on a smart terminal, wherein the smart terminal is connected to an in-vehicle terminal of a private vehicle, and the method includes: acquiring the driver's health status sent by the in-vehicle terminal; generating a first control command based on the driver's health status; and sending the first control command to the in-vehicle terminal so that the in-vehicle terminal controls the vehicle according to the first control command.

[0031] According to the vehicle control method based on a smart terminal according to an embodiment of the present invention, by acquiring the driver's health status sent by the vehicle terminal and generating a first control command based on the driver's health status, the first control command is sent to the vehicle terminal so that the vehicle terminal controls the vehicle according to the first control command. This can improve emergency response speed and promote the deep integration of smart home and vehicle terminal, thereby enhancing driver safety.

[0032] In addition, the vehicle control method based on a smart terminal according to the above embodiments of the present invention may further include the following additional technical features:

[0033] According to one embodiment of the present invention, the driver's health status includes the driver's facial expression information and physiological indicator information. When the driver's facial expression information is abnormal and / or the driver's physiological indicator information is abnormal, the driver's health status is determined to be abnormal.

[0034] According to one embodiment of the present invention, before generating a first control command based on the driver's health status, the method further includes: determining that the driver's health status is the abnormal state, and obtaining control authority of the vehicle's controller.

[0035] According to one embodiment of the present invention, the method further includes: obtaining the health status of family members; generating early warning information based on the health status of family members; and sending the early warning information to the vehicle terminal, so that the vehicle terminal generates reminder information based on the early warning information to remind the driver to check the health status of the family members and obtain control authority.

[0036] According to one embodiment of the present invention, the method further includes: receiving a second control command sent by the driver based on the health status of the family member; and performing a corresponding operation according to the second control command to improve the health status of the family member.

[0037] According to one embodiment of the present invention, the warning information includes regular warning information and emergency warning information, and the method further includes: when the warning information is emergency warning information, sending the current location information of the smart terminal to the vehicle terminal so that the driver can drive to the location of the family member according to the current location information.

[0038] To achieve the above objectives, a seventh aspect of the present invention provides another computer-readable storage medium storing a vehicle control program based on a smart terminal thereon, wherein when the vehicle control program is executed by a processor, it implements the vehicle control method based on a smart terminal as described in the preceding embodiments of the present invention.

[0039] According to embodiments of the present invention, a computer-readable storage medium, through which a processor executes a vehicle control program based on a smart terminal, can improve emergency response speed and promote the deep integration of smart homes and in-vehicle terminals, thereby enhancing driver safety.

[0040] To achieve the above objectives, an eighth aspect of the present invention provides a vehicle control device based on a smart terminal, characterized in that the smart terminal is connected to an in-vehicle terminal of a private vehicle, and the device includes: an acquisition module for acquiring the driver's health status sent by the in-vehicle terminal; a generation module for generating a first control command based on the driver's health status; and a sending module for sending the first control command to the in-vehicle terminal so that the in-vehicle terminal controls the vehicle according to the first control command.

[0041] According to an embodiment of the present invention, a vehicle control device based on a smart terminal acquires the driver's health status sent by an in-vehicle terminal through an acquisition module, and generates a first control command based on the driver's health status through a generation module. The first control command is then sent to the in-vehicle terminal through a sending module, so that the in-vehicle terminal controls the vehicle according to the first control command. This can improve emergency response speed and promote the deep integration of smart homes and in-vehicle terminals, thereby enhancing driver safety.

[0042] To achieve the above objectives, a ninth aspect of the present invention provides an intelligent terminal, including the vehicle control device based on the intelligent terminal described in the foregoing embodiments of the present invention.

[0043] According to embodiments of the present invention, by employing a vehicle control device based on the intelligent terminal, emergency response speed can be improved, and the deep integration of smart homes and vehicle terminals can be promoted, thereby enhancing driver safety.

[0044] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0045] Figure 1 This is a flowchart illustrating a vehicle control method based on an in-vehicle terminal according to an embodiment of the present invention.

[0046] Figure 2 This is a flowchart illustrating a vehicle control method based on an in-vehicle terminal according to another embodiment of the present invention;

[0047] Figure 3 This is a flowchart illustrating a vehicle control method based on an in-vehicle terminal according to another embodiment of the present invention;

[0048] Figure 4 This is a block diagram of a vehicle control device based on an in-vehicle terminal according to an embodiment of the present invention;

[0049] Figure 5 This is a block diagram of an in-vehicle terminal according to an embodiment of the present invention;

[0050] Figure 6 This is a block diagram of a vehicle according to an embodiment of the present invention;

[0051] Figure 7 This is a flowchart illustrating a vehicle control method based on a smart terminal according to an embodiment of the present invention.

[0052] Figure 8 This is a flowchart illustrating a vehicle control method based on a smart terminal according to an embodiment of the present invention.

[0053] Figure 9 This is a block diagram of a vehicle control device based on a smart terminal according to an embodiment of the present invention;

[0054] Figure 10 This is a block diagram of a smart terminal according to an embodiment of the present invention. Detailed Implementation

[0055] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.

[0056] The following description, with reference to the accompanying drawings, describes a vehicle control method based on an in-vehicle terminal, a computer-readable storage medium, a vehicle control device based on an in-vehicle terminal, an in-vehicle terminal, a vehicle, a vehicle control method based on a smart terminal, another computer-readable storage medium, a vehicle control device based on a smart terminal, and a smart terminal.

[0057] Figure 1 This is a flowchart illustrating a vehicle control method based on an in-vehicle terminal according to an embodiment of the present invention.

[0058] Specifically, in some embodiments of the present invention, the vehicle-mounted terminal is connected to the driver's home smart terminal, such as... Figure 1 As shown, the vehicle control method based on the on-board terminal includes:

[0059] S101, Obtain the driver's health status.

[0060] Specifically, in this embodiment, a camera can be installed inside the vehicle to acquire the driver's facial expressions and body language. A heart rate detection device can be integrated into the steering wheel to acquire the driver's heart rate information. The driver's health status can then be determined based on the facial expressions, body language, and heart rate information. Furthermore, this invention does not specifically limit the method of acquiring the driver's health status information. For example, when the driver is wearing a smartwatch, the smartwatch can acquire the driver's heart rate and blood pressure information, and the driver's health status can be determined based on these data.

[0061] S102, the driver's health status is sent to the smart terminal, so that the smart terminal can send the first control command to the vehicle based on the driver's health status.

[0062] Specifically, in this embodiment, after the in-vehicle terminal obtains the driver's health status, it can send the driver's health status to a smart terminal. This allows family members associated with the smart terminal to view the driver's health status and control the smart terminal based on it, causing the smart terminal to send a first control command to the vehicle. For example, the first control command could control the vehicle's speakers or audio equipment to provide voice prompts, or control the vehicle's central control screen to open for remote video calls; specific limitations are not specified here.

[0063] S103 controls the vehicle based on the driver's health status or the first control command.

[0064] Specifically, in this embodiment, when the driver's health status is abnormal, the vehicle can be controlled to enter the autonomous driving mode. The vehicle can be controlled through the autonomous driving mode. In some complex road sections or emergency avoidance scenarios, the vehicle can be controlled according to the first control command. For example, in emergency avoidance scenarios such as running a red light or forcibly crashing to clear the way, the autonomous driving mode cannot operate and human control is required. At this time, the vehicle control is handed over to a family member. That is, the family member can operate and control the smart terminal according to the driver's health status, so that the smart terminal sends the first control command to the vehicle. Then the vehicle can be controlled according to the first control command, so that the emergency avoidance clause can be met in subsequent legal evaluation.

[0065] Furthermore, in some embodiments of the present invention, such as Figure 2 As shown, the vehicle includes an in-vehicle camera and a heartbeat detector. An onboard terminal is connected to both the in-vehicle camera and the heartbeat detector to obtain the driver's health status, including:

[0066] S201, obtain the user's facial expression information and physiological indicator information.

[0067] Specifically, in this embodiment, an in-vehicle camera can be installed above the dashboard, inside the A-pillar, or near the rearview mirror, etc., to obtain the driver's facial expressions. Physiological indicators can include heart rate, blood pressure, and body temperature, etc. The types of information included in the heart rate indicator are not specifically limited here. A heart rate detector can be installed on the steering wheel or seat to obtain the driver's heart rate information. Alternatively, the user's blood pressure and body temperature can be obtained through a smart bracelet worn by the user. The method of obtaining physiological indicator information is not specifically limited here.

[0068] S202, determine the driver's health status based on facial expression information and physiological indicators.

[0069] Specifically, in this embodiment, after acquiring the driver's facial expression information through the in-vehicle camera and acquiring physiological indicator information through the heartbeat detector and the smart bracelet worn by the user, the driver's health status can be determined based on the facial expression information and heartbeat information. When the driver's facial expression information indicates an abnormality, the driver's health status can be determined to be abnormal. When the driver's physiological indicator information indicates an abnormality, the driver's health status can be determined to be abnormal. When the driver's facial expression information indicates an abnormality and the driver's heartbeat information indicates an abnormality, the driver's health status can be determined to be abnormal.

[0070] It should be noted that when the driver's facial expression information is a preset painful expression, the driver's eyes are out of focus, or the driver's line of sight is not within the safe zone (120° visual cone range in front of the driver), the driver's facial expression information can be used to determine that the driver's facial expression is abnormal. When the driver's heart rate information in the physiological indicators is too fast (greater than 105 beats / minute), too slow (less than 55 beats / minute), irregular heart rhythm, or abnormal heart rate, the driver's physiological indicators can be used to determine that the driver's physiological indicators are abnormal.

[0071] Furthermore, in some embodiments of the present invention, after sending the driver's health status to the smart terminal when the driver's health status is abnormal, the method further includes: granting the smart terminal control permissions of the vehicle's controller.

[0072] Specifically, in this embodiment, when the driver's health status is abnormal, the driver's condition may be insufficient to safely control the vehicle. In this case, the driver's health status can be sent to the smart terminal, granting the smart terminal control access to the vehicle's controller. This allows family members connected to the smart terminal to directly participate in vehicle control and safety management in emergencies. For example, family members can remotely control the vehicle through the smart terminal, such as initiating emergency braking, slowing down, activating hazard lights, and automatically navigating to the nearest hospital or safe area. This improves vehicle driving safety.

[0073] Furthermore, in some embodiments of the present invention, controlling the vehicle based on the driver's health status or a first control command includes: when the driver's health status is in the abnormal state, controlling the vehicle to perform emergency rescue measures.

[0074] Specifically, in this embodiment, emergency rescue measures include controlling the vehicle to navigate to a hospital, controlling the vehicle to call 120 (emergency services), controlling the vehicle to open windows for ventilation, and controlling the vehicle to stop. Here, the present invention does not specifically limit the types of emergency rescue measures. In the measure of controlling the vehicle to navigate to a hospital, the vehicle's current location information can be accurately obtained through the vehicle's GPS positioning system or other positioning technologies (such as positioning based on mobile networks or Wi-Fi). Then, using the built-in map service or calling a third-party map, a search is performed in the vicinity based on the vehicle's current location to find hospitals in the nearby area. In the list of hospitals found, the system sorts them according to their distance from the vehicle's current location and automatically selects the nearest hospital as the target hospital, thereby obtaining the target hospital's first location information. This first location information includes the target hospital's detailed address, latitude and longitude coordinates, etc. The vehicle can then be controlled to autonomously drive to the hospital based on this first location information. This improves the vehicle's driving safety.

[0075] Furthermore, in some embodiments of the present invention, such as Figure 3 As shown, the vehicle control method of the on-board terminal further includes:

[0076] S301, obtains early warning information generated by the smart terminal based on the health status of family members.

[0077] Specifically, in this embodiment, the smart terminal is equipped with a camera and health monitoring devices (such as fitness trackers and blood pressure monitors). When the camera determines that a family member has collapsed and cannot get up, it can be determined that the family member's health status is abnormal. When the health monitoring devices detect that the family member's heart rate is too fast (greater than 105 beats / minute), too slow (less than 55 beats / minute), irregular heart rhythm, or abnormal heart rate intensity, it can be determined that the family member's health status is abnormal. After determining that the family member's health status is abnormal, the smart terminal can generate warning information based on the family member's health status and send the generated warning information to the vehicle terminal.

[0078] S302 generates a reminder message based on the warning information to remind the driver to check the health status of family members.

[0079] Specifically, in this embodiment, after the in-vehicle terminal receives the warning information, it can generate a reminder message based on the warning information. For example, it can issue a voice reminder through the vehicle's built-in voice system, display a prominent pop-up message on the central control screen showing the warning content and related prompts, or it can combine the vibration function of the vehicle's seat or steering wheel to emit a brief but strong vibration as a supplement to the voice and visual reminders. This can remind the driver to check the health status of family members, such as opening the central control screen to view detailed health data of family members. Furthermore, this invention does not specifically limit the method of reminder. This can further promote the deep integration of smart terminals and in-vehicle terminals and enhance the safety of family members and the driver.

[0080] Furthermore, in some embodiments of the present invention, the warning information includes regular warning information and emergency warning information, and the method further includes: when the warning information is emergency warning information, determining the second location information of the smart terminal so that the driver can drive to the location of the family member based on the second location information.

[0081] Specifically, in this embodiment, the warning information includes regular warning information and emergency warning information. When a family member is confirmed to have collapsed by a camera, the warning information generated by the smart terminal based on the family member's health status is an emergency warning. When a family member's heart rate is detected by a health monitoring device as being too fast (greater than 105 beats / minute) or too slow (less than 55 beats / minute), the warning information generated by the smart terminal based on the family member's health status is an emergency warning. When a family member's heart rate is detected by a health monitoring device as having an irregular heart rhythm, the warning information generated by the smart terminal based on the family member's health status is a regular warning. Furthermore, when the warning information is an emergency warning, the smart terminal's second location information can be determined using its GPS positioning function or network positioning technology. After the smart terminal sends the second location information to the vehicle terminal, the driver can use the second location information to drive to the family member's location. The second location information includes detailed address, latitude and longitude coordinates, etc. This can improve the user experience and promote family care.

[0082] In summary, the vehicle control method based on an in-vehicle terminal according to embodiments of the present invention acquires the driver's health status and sends it to a smart terminal, which then sends a first control command to the vehicle based on the driver's health status, thereby controlling the vehicle according to the driver's health status or the first control command. This improves emergency response speed and promotes deep integration of smart homes and in-vehicle terminals, thus enhancing driver safety.

[0083] Based on the vehicle control method proposed in the foregoing embodiments of the present invention, the present invention also proposes a computer-readable storage medium storing a vehicle control program based on an in-vehicle terminal. When the vehicle control program is executed by a processor, it implements the vehicle control method based on an in-vehicle terminal as described in the embodiments of the present invention.

[0084] According to embodiments of the present invention, a computer-readable storage medium, through which a processor executes a vehicle control program based on an in-vehicle terminal, can improve emergency response speed and promote the deep integration of smart homes and in-vehicle terminals, thereby enhancing driver safety.

[0085] Figure 4 This is a block diagram of a vehicle control device based on an in-vehicle terminal according to an embodiment of the present invention.

[0086] Specifically, the in-vehicle terminal connects to the driver's home smart terminal, such as... Figure 4 As shown, the vehicle control device 100 based on the vehicle terminal includes an acquisition module 10, a transmission module 20, and a control module 30.

[0087] The acquisition module 10 is used to acquire the driver's health status; the sending module 20 is used to send the driver's health status to the smart terminal so that the smart terminal can send a first control command to the vehicle based on the driver's health status; and the control module 30 is used to control the vehicle based on the driver's health status or the first control command.

[0088] In some embodiments of the present invention, the acquisition module 10 is further configured to acquire the user's facial expression information and physiological indicator information; and determine the driver's health status based on the facial expression information and the physiological indicator information.

[0089] In some embodiments of the present invention, the acquisition module 10 is further configured to determine that the driver's health status is abnormal when the driver's facial expression information is determined to be abnormal and / or the driver's physiological indicators are determined to be abnormal based on the driver's physiological indicator information.

[0090] In some embodiments of the present invention, when the driver's health status is abnormal, after sending the driver's health status to the smart terminal, the sending module 20 is also used to grant the smart terminal control permissions for the vehicle's controller.

[0091] In some embodiments of the present invention, the control module 30 is specifically used to control the vehicle to perform emergency rescue measures when the driver's health status is abnormal.

[0092] In some embodiments of the present invention, the acquisition module 10 is further configured to acquire warning information generated by the smart terminal based on the health status of family members; and generate reminder information based on the warning information to remind the driver to check the health status of family members.

[0093] In some embodiments of the present invention, the warning information includes regular warning information and emergency warning information. The control module 30 is also used to determine the second location information of the smart terminal when the warning information is emergency warning information, so that the driver can drive to the location of the family member based on the second location information.

[0094] It should be noted that other specific implementations of the vehicle control device based on the vehicle terminal proposed in the embodiments of the present invention can be found in the specific implementations of the vehicle control method based on the vehicle terminal in the foregoing embodiments of the present invention. To reduce redundancy, they will not be repeated here.

[0095] In summary, the vehicle control device based on an in-vehicle terminal according to embodiments of the present invention acquires the driver's health status through an acquisition module and sends the driver's health status to a smart terminal through a transmission module. The smart terminal then sends a first control command to the vehicle based on the driver's health status, thereby enabling the control module to control the vehicle according to the driver's health status or the first control command. This improves emergency response speed and promotes deep integration between smart homes and in-vehicle terminals, thus enhancing driver safety.

[0096] Figure 5 This is a block diagram of an in-vehicle terminal according to an embodiment of the present invention.

[0097] like Figure 5 As shown, the vehicle terminal 1000 includes the vehicle control device 100 based on the vehicle terminal described in the above embodiment of the present invention.

[0098] According to the vehicle-mounted terminal of the present invention, by adopting the vehicle-mounted control device based on the vehicle-mounted terminal of the above embodiments of the present invention, emergency response speed can be improved and the deep integration of smart home and vehicle-mounted terminal can be promoted, thereby enhancing the safety of the driver.

[0099] Figure 6 This is a block diagram of a vehicle according to an embodiment of the present invention.

[0100] like Figure 6 As shown, the vehicle 2000 includes the vehicle-mounted terminal 1000 described in the above embodiment of the present invention.

[0101] According to the embodiments of the present invention, by adopting the vehicle-mounted terminal of the above embodiments of the present invention, the emergency response speed can be improved, and the deep integration of smart home and vehicle-mounted terminal can be promoted, thereby enhancing the safety of the driver.

[0102] Figure 7 This is a flowchart illustrating a vehicle control method based on a smart terminal according to an embodiment of the present invention.

[0103] Specifically, in some embodiments of the present invention, the smart terminal is connected to the in-vehicle terminal of a private vehicle, such as... Figure 7 As shown, the vehicle control method based on intelligent terminals includes:

[0104] S401, Obtain the driver's health status sent by the vehicle terminal.

[0105] Specifically, in this embodiment, an in-vehicle camera can be installed in the vehicle corresponding to the in-vehicle terminal to acquire the driver's facial expression and body language information. A heartbeat detection device can be integrated into the vehicle's steering wheel to acquire the driver's heartbeat information. The in-vehicle terminal can then determine the driver's health status based on the facial expression, body language, and heartbeat information. Furthermore, this invention does not specifically limit the method of acquiring the driver's health status information. For example, when the driver is wearing a smartwatch, the smartwatch can acquire the driver's heartbeat and blood pressure information, and the driver's health status can be determined based on these information. After the in-vehicle terminal acquires the driver's health status, it can be synchronously sent to the smart terminal. The sending method can be Wi-Fi direct connection, mobile data network (such as 4G / 5G), or dedicated communication protocol, etc., and is not specifically limited here.

[0106] S402 generates the first control command based on the driver's health status.

[0107] Specifically, in this embodiment, after the smart terminal obtains the driver's health status, it can analyze the driver's health status through a preset algorithm to generate a first control command.

[0108] S403, send a first control command to the vehicle terminal so that the vehicle terminal can control the vehicle according to the first control command.

[0109] Specifically, in this embodiment, after the smart terminal generates a first control command based on the driver's health status, the smart terminal sends the first control command to the vehicle terminal, so that the vehicle terminal can control the vehicle according to the first control command. For example, the first control command can control the speakers or audio equipment in the vehicle to provide voice prompts, or control the central control screen in the vehicle to open for remote video calls, or adjust the environment, etc., without being specifically limited here.

[0110] Furthermore, in some embodiments of the present invention, the driver's health status includes the driver's facial expression information and physiological indicator information. When the driver's facial expression information is abnormal and / or the driver's physiological indicator information is abnormal, the driver's health status is determined to be abnormal.

[0111] Specifically, in this real-time example, the vehicle includes an in-vehicle camera and a heart rate detector. Physiological indicators can include heart rate information, blood pressure information, and body temperature information, etc. The types of information included in the heart rate indicator information are not specifically limited here. The vehicle terminal is connected to the in-vehicle camera and the heart rate detector respectively. The in-vehicle camera can be installed above the dashboard, inside the A-pillar, or near the rearview mirror, etc., so that the driver's facial expression information can be obtained through the in-vehicle camera. The heart rate detector can be installed on the steering wheel or seat, so that the driver's heart rate information can be obtained through the heart rate detector. In addition, the present invention does not specifically limit the location of the in-vehicle camera or heart rate detector. The user's blood pressure information and body temperature information can also be obtained through a smart bracelet worn by the user. The method of obtaining physiological indicator information is not specifically limited here. After acquiring the driver's facial expressions through the in-vehicle camera and physiological indicators through the heart rate detector and the smart bracelet worn by the user, the driver's health status can be determined based on the facial expressions and heart rate information. If the driver's facial expressions are found to be abnormal, the driver's health status can be determined to be abnormal. If the driver's physiological indicators are found to be abnormal, the driver's health status can be determined to be abnormal. If both the driver's facial expressions and physiological indicators are found to be abnormal, the driver's health status can be determined to be abnormal.

[0112] It should be noted that when the driver's facial expression information is a preset painful expression, the driver's eyes are out of focus, or the driver's line of sight is not within the safe zone (120° visual cone range in front of the driver), the driver's facial expression information can be used to determine that the driver's facial expression is abnormal. When the driver's heart rate information in the physiological indicators is too fast (greater than 105 beats / minute), too slow (less than 55 beats / minute), irregular heart rhythm, or abnormal heart rate, the driver's physiological indicators can be used to determine that the driver's physiological indicators are abnormal.

[0113] Furthermore, in some embodiments of the present invention, before generating the first control command based on the driver's health status, the vehicle control method based on the smart terminal further includes: determining that the driver's health status is abnormal, and obtaining control authority of the vehicle's controller.

[0114] Specifically, in this embodiment, when the driver's health status is abnormal, the driver's condition may be insufficient to safely control the vehicle. In this case, the smart terminal can obtain control permissions for the vehicle's controller from the in-vehicle terminal. Therefore, in emergency situations, family members corresponding to the smart terminal can directly participate in the control and safety management of the vehicle. For example, family members can remotely control the vehicle through the smart terminal, such as initiating emergency braking, slowing down, activating hazard lights, and automatically navigating to the nearest hospital or safe area. This improves vehicle driving safety.

[0115] Furthermore, in some embodiments of the present invention, such as Figure 8 As shown, the vehicle control method based on intelligent terminals also includes:

[0116] S501, obtain the health status of family members.

[0117] Specifically, in this embodiment, the smart terminal is equipped with a camera and health monitoring devices (such as fitness trackers and blood pressure monitors). The camera acquires video information of family members, and the health monitoring devices detect their heart rate and blood pressure. Based on this data, the health status of family members can be determined. Furthermore, this invention does not specifically limit the types of information acquired by the health monitoring devices.

[0118] S502 generates early warning information based on the health status of family members.

[0119] Specifically, in this embodiment, when a family member is confirmed to be lying down by obtaining video information from a camera, it can be determined that the family member's health status is abnormal. Alternatively, when a family member's heart rate is detected by a health monitoring device as being too fast (greater than 105 beats / minute), too slow (less than 55 beats / minute), irregular, or abnormal in intensity, it can be determined that the family member's health status is abnormal. When a family member's blood pressure is detected by a health monitoring device and is determined to be deviating from normal, it can be determined that the family member's health status is abnormal. After determining that a family member's health status is abnormal, the smart terminal can generate warning information based on the family member's health status.

[0120] S503 sends the warning information to the vehicle terminal, so that the vehicle terminal can generate a reminder message based on the warning information, which is used to remind the driver to check the health status of family members and obtain control rights.

[0121] Specifically, in this embodiment, after the smart terminal generates warning information based on the health status of family members, it sends the warning information to the in-vehicle terminal. The in-vehicle terminal then generates a reminder based on the warning information. For example, it can issue a voice reminder through the vehicle's built-in voice system, display a prominent pop-up window on the central control screen showing the warning content and related prompts, or it can combine the vibration function of the vehicle's seat or steering wheel to emit a brief but strong vibration as a supplement to the voice and visual reminders. This allows the reminder information to be used to remind the driver to check the health status of family members and gain control, such as opening the central control screen to view detailed health data of family members. Furthermore, this invention does not specifically limit the method of reminder. This can further promote the deep integration of smart terminals and in-vehicle terminals and enhance the safety of family members and the driver.

[0122] Furthermore, in some embodiments of the present invention, the method further includes: receiving a second control command sent by the driver based on the health status of family members; and performing corresponding operations according to the second control command to improve the health status of family members.

[0123] Specifically, in this embodiment, after the vehicle-mounted terminal obtains control of the smart terminal, the smart terminal includes devices such as cameras, mobile phones, and smart bracelets. This invention does not specifically limit the types of devices included in the smart terminal. The driver can send a second control command to the smart terminal via the vehicle-mounted terminal based on the health status of family members. The smart terminal can then perform corresponding operations based on the second control command. For example, when a family member is at home and the smart terminal is a camera, the camera can rotate according to the second control command to better monitor the family member's health. When a family member is outdoors and the smart terminal is a mobile phone, the mobile phone can activate an audible and visual alarm according to the second control command to alert those nearby so they can provide assistance, thereby improving the family member's health. Furthermore, this invention does not specifically limit the operations performed according to the second command.

[0124] It should be noted that family members can also send help requests to the in-vehicle terminal via smart devices, such as sending help text messages or making phone calls, prompting the driver to check the health status of family members to determine whether it is necessary to call 120 (emergency services), so that the driver can provide timely assistance to family members. Furthermore, this invention does not impose specific limitations on the method by which smart devices send help requests to the in-vehicle terminal.

[0125] Furthermore, in some embodiments of the present invention, the warning information includes regular warning information and emergency warning information. The vehicle control method based on the smart terminal further includes: when the warning information is emergency warning information, sending the current location information of the smart terminal to the vehicle terminal so that the driver can drive to the location of the family member according to the current location information.

[0126] Specifically, in this embodiment, the warning information includes regular warning information and emergency warning information. When a family member is confirmed to have collapsed by a camera, the warning information generated by the smart terminal based on the family member's health status is an emergency warning. When a family member's heart rate is detected by a health monitoring device as being too fast (greater than 105 beats / minute) or too slow (less than 55 beats / minute), the warning information generated by the smart terminal based on the family member's health status is an emergency warning. When a family member's heart rate is detected by a health monitoring device as having an irregular heart rhythm, the warning information generated by the smart terminal based on the family member's health status is a regular warning. Furthermore, when the warning information is an emergency warning, the smart terminal's current location information can be determined using its GPS positioning function or network positioning technology. After the smart terminal sends the current location information to the vehicle terminal, the driver can use the current location information to drive to the family member's location. The current location information includes detailed address, latitude and longitude coordinates, etc. This can improve the user experience and promote family care.

[0127] In summary, the vehicle control method based on a smart terminal according to the embodiments of the present invention obtains the driver's health status sent by the vehicle terminal and generates a first control command based on the driver's health status, thereby sending the first control command to the vehicle terminal so that the vehicle terminal controls the vehicle according to the first control command. This can improve emergency response speed and promote the deep integration of smart homes and vehicle terminals, thereby enhancing driver safety.

[0128] Based on the vehicle control method proposed in the foregoing embodiments of the present invention, the present invention also proposes a computer-readable storage medium storing a vehicle control program based on a smart terminal thereon. When the vehicle control program is executed by a processor, it implements the vehicle control method based on a smart terminal as described in the embodiments of the present invention.

[0129] According to embodiments of the present invention, a computer-readable storage medium, through which a processor executes a vehicle control program based on a smart terminal, can improve emergency response speed and promote the deep integration of smart homes and in-vehicle terminals, thereby enhancing driver safety.

[0130] Figure 9 This is a block diagram of a vehicle control device based on a smart terminal according to an embodiment of the present invention.

[0131] Specifically, the smart terminal connects to the in-vehicle terminal of the private vehicle, such as... Figure 9 As shown, the vehicle control device 3000 based on a smart terminal includes an acquisition module 10, a generation module 40, and a transmission module 20.

[0132] The acquisition module 10 is used to acquire the driver's health status sent by the vehicle terminal; the generation module 40 is used to generate a first control command based on the driver's health status; and the sending module 20 is used to send the first control command to the vehicle terminal so that the vehicle terminal can control the vehicle according to the first control command.

[0133] In some embodiments of the present invention, the driver's health status includes the driver's facial expression information and physiological indicator information. When the driver's facial expression information is abnormal and / or the driver's physiological indicator information is abnormal, the driver's health status is determined to be abnormal.

[0134] In some embodiments of the present invention, the generation module 40 is further configured to determine that the driver's health status is abnormal and to obtain control authority of the vehicle's controller.

[0135] In some embodiments of the present invention, the acquisition module 10 is further configured to acquire the health status of family members; the generation module 40 is further configured to generate warning information based on the health status of family members; and the sending module 20 is further configured to send the warning information to the vehicle terminal, so that the vehicle terminal generates reminder information based on the warning information to remind the driver to check the health status of family members and obtain control permissions.

[0136] In some embodiments of the present invention, the sending module 20 is further configured to receive a second control command sent by the driver based on the health status of family members; and to perform corresponding operations according to the second control command to improve the health status of family members.

[0137] In some embodiments of the present invention, the warning information includes regular warning information and emergency warning information. The sending module 20 is also used to send the current location information of the smart terminal to the vehicle terminal when the warning information is emergency warning information, so that the driver can drive to the location of the family member based on the current location information.

[0138] It should be noted that other specific implementations of the vehicle control device based on a smart terminal proposed in the embodiments of the present invention can be found in the specific implementations of the vehicle control method based on a smart terminal described in the foregoing embodiments of the present invention. To reduce redundancy, they will not be repeated here.

[0139] In summary, the vehicle control device based on a smart terminal according to embodiments of the present invention acquires the driver's health status sent by the vehicle terminal through an acquisition module, and generates a first control command based on the driver's health status through a generation module. The first control command is then sent to the vehicle terminal through a sending module, so that the vehicle terminal controls the vehicle according to the first control command. This improves emergency response speed and promotes the deep integration of smart homes and vehicle terminals, thereby enhancing driver safety.

[0140] Figure 10 This is a block diagram of a smart terminal according to an embodiment of the present invention.

[0141] like Figure 10 As shown, the smart terminal 4000 includes the vehicle control device 3000 based on the smart terminal described in the above embodiment of the present invention.

[0142] According to embodiments of the present invention, by employing a vehicle control device based on the intelligent terminal, emergency response speed can be improved, and the deep integration of smart homes and vehicle terminals can be promoted, thereby enhancing driver safety.

[0143] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0144] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0145] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0146] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0147] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0148] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise explicitly limited. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0149] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.

[0150] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A vehicle control method based on an on-board terminal, characterized in that, The vehicle-mounted terminal is connected to the driver's home smart terminal to promote the integration of smart home and vehicle-mounted terminal. The smart terminal is equipped with a camera and health monitoring devices. The method includes: Obtain the driver's health status; The driver's health status is sent to the smart terminal, so that the family members corresponding to the smart terminal can see the driver's health status and control the smart terminal according to the driver's health status, so that the smart terminal sends a first control command to the vehicle. The vehicle is controlled according to the driver's health status or the first control command; If the driver's health status is abnormal and the vehicle enters autonomous driving mode, and if the vehicle is unable to operate in autonomous driving mode, then control of the vehicle will be transferred to a family member. The system acquires the early warning information generated by the smart terminal based on the health status of the family members. A reminder message is generated based on the warning information to remind the driver to check the health status of the family members.

2. The vehicle control method based on an on-board terminal according to claim 1, characterized in that, The method further includes: Obtain user facial expression and physiological information; The driver's health status is determined based on the facial expression information and the physiological indicator information.

3. The vehicle control method based on an on-board terminal according to claim 2, characterized in that, The method further includes: When it is determined that the driver's facial expression is abnormal based on the driver's facial expression information and / or that the driver's physiological indicators are abnormal based on the driver's physiological indicator information, the driver's health status is determined to be abnormal.

4. The vehicle control method based on an on-board terminal according to claim 3, characterized in that, After sending the driver's health status to the smart terminal when the driver's health status is in the abnormal state, the method further includes: Grant the smart terminal control access to the vehicle's controller.

5. The vehicle control method based on an on-board terminal according to claim 3, characterized in that, Controlling the vehicle based on the driver's health status or the first control command includes: When the driver's health status is in the abnormal state, the vehicle is controlled to perform emergency rescue measures.

6. The vehicle control method based on an on-board terminal according to claim 1, characterized in that, The warning information includes regular warning information and emergency warning information, and the method further includes: When the warning information is an emergency warning information, the second location information of the smart terminal is determined so that the driver can drive to the location of the family member based on the second location information.

7. A computer-readable storage medium, characterized in that, It stores a vehicle control program based on an in-vehicle terminal, which, when executed by a processor, implements the vehicle control method based on an in-vehicle terminal as described in any one of claims 1-6.

8. A vehicle control device based on an on-board terminal, characterized in that, The vehicle-mounted terminal is connected to the driver's home smart terminal to promote the integration of smart home and vehicle-mounted terminal. The smart terminal is equipped with a camera and health monitoring device. The device includes: The acquisition module is used to acquire the driver's health status; The sending module is used to send the driver's health status to the smart terminal, so that the family members corresponding to the smart terminal can see the driver's health status and control the smart terminal according to the driver's health status, so that the smart terminal can send a first control command to the vehicle according to the driver's health status. The control module is used to control the vehicle according to the driver's health status or the first control command; if the vehicle cannot operate the autonomous driving mode after the driver's health status is abnormal and the vehicle enters the autonomous driving mode, the control of the vehicle is handed over to a family member; the module acquires warning information generated by the smart terminal based on the health status of the family member; and generates reminder information based on the warning information to remind the driver to check the health status of the family member.

9. A vehicle-mounted terminal, characterized in that, Includes the vehicle control device based on the vehicle terminal as described in claim 8.

10. A vehicle, characterized in that, Includes the vehicle-mounted terminal as described in claim 9.

11. A vehicle control method based on a smart terminal, characterized in that, The smart terminal is connected to the in-vehicle terminal of a home vehicle to promote the integration of smart homes and the in-vehicle terminal. The method includes: Obtain the driver's health status sent by the vehicle terminal; A first control command is generated based on the driver's health status; The first control command is sent to the vehicle terminal so that the vehicle terminal controls the vehicle according to the first control command. Before generating the first control command according to the driver's health status, the driver's health status is determined to be abnormal and the control authority of the vehicle's controller is obtained. Obtain the health status of family members; Generate early warning information based on the health status of the family members; The warning information is sent to the vehicle terminal, so that the vehicle terminal generates a reminder message based on the warning information, which is used to remind the driver to check the health status of the family members and obtain control rights.

12. The vehicle control method based on a smart terminal according to claim 11, characterized in that, The driver's health status includes the driver's facial expression information and physiological indicator information. If the driver's facial expression information is abnormal and / or the driver's physiological indicator information is abnormal, then the driver's health status is determined to be abnormal.

13. The vehicle control method based on a smart terminal according to claim 11, characterized in that, The method further includes: Receive a second control command sent by the driver based on the health status of the family member; Perform corresponding operations according to the second control command to improve the health status of the family member.

14. The vehicle control method based on a smart terminal according to claim 11, characterized in that, The warning information includes regular warning information and emergency warning information, and the method further includes: When the warning information is an emergency warning information, the current location information of the smart terminal is sent to the vehicle terminal so that the driver can drive to the location of the family member based on the current location information.

15. A computer-readable storage medium, characterized in that, It stores a vehicle control program based on a smart terminal, which, when executed by a processor, implements the vehicle control method based on a smart terminal as described in any one of claims 11-14.

16. A vehicle control device based on a smart terminal, characterized in that, The smart terminal is connected to the in-vehicle terminal of a home vehicle to promote the integration of smart homes and the in-vehicle terminal. The device includes: The acquisition module is used to acquire the driver's health status sent by the vehicle terminal; The generation module is used to generate a first control command based on the driver's health status; The sending module is configured to send the first control command to the vehicle terminal, so that the vehicle terminal controls the vehicle according to the first control command; before generating the first control command based on the driver's health status, determine that the driver's health status is abnormal and obtain control authority from the vehicle's controller; obtain the health status of family members; generate warning information based on the health status of family members; and send the warning information to the vehicle terminal, so that the vehicle terminal generates reminder information based on the warning information to remind the driver to check the health status of family members and obtain control authority.

17. A smart terminal, characterized in that, Includes the vehicle control device based on a smart terminal as described in claim 16.

Images