Vehicle starting control method and device, vehicle-mounted terminal and storage medium

Abstract

The invention provides a vehicle starting control method and device, a vehicle-mounted terminal and a storage medium, and belongs to the technical field of vehicle electronic control. The method comprises the following steps: in response to a remote starting instruction of a vehicle, performing safety verification on the remote starting instruction to obtain a verification result; and under the condition that the verification result is qualified, in response to the fact that a door of the vehicle is detected to be opened, controlling image acquisition equipment of the vehicle to acquire an image of a user who enters the vehicle, and sending the image to a terminal associated with the vehicle, the terminal is used for sending a starting permission instruction to the vehicle under the condition of determining that the vehicle using person is a legal person based on the image; and controlling the vehicle to start in response to a received start permission instruction of the terminal. According to the method, the safety of remote starting of the vehicle is greatly improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle electronic control technology, and in particular to a vehicle startup control method and device, a vehicle-mounted terminal and a storage medium. Background Art

[0002] With the gradual popularization of vehicles and the advancement of technology, consumers' requirements for vehicles are constantly increasing, and at the same time, the number of intelligent functional areas of vehicles is increasing. At present, more and more vehicles are equipped with remote start functions, which can remotely control the start of the vehicle through instructions sent by the terminal. However, in the current process of remote starting of vehicles, people usually only consider how to start the vehicle, but ignore the anti-theft problem of the vehicle itself. If an illegal start command is received, it is very easy to complete the remote start process of the vehicle, and the safety of the remote start of the vehicle cannot be guaranteed. Therefore, there is an urgent need for a safe vehicle remote start control solution. Summary of the invention

[0003] The embodiments of the present application provide a vehicle startup control method, device, vehicle-mounted terminal and storage medium, which can greatly improve the safety of vehicle remote startup. The technical solution is as follows:

[0004] In one aspect, a vehicle startup control method is provided, the method comprising:

[0005] In response to a remote start instruction for a vehicle, performing a safety check on the remote start instruction to obtain a check result;

[0006] If the verification result is qualified, in response to detecting that the door of the vehicle is opened, controlling the image acquisition device of the vehicle to acquire an image of the user entering the vehicle, and sending the image to a terminal associated with the vehicle, the terminal is used to send a start permission instruction to the vehicle if it is determined that the user is a legitimate person based on the image;

[0007] In response to receiving the start-up permission instruction from the terminal, the vehicle is controlled to start.

[0008] In another aspect, a vehicle startup control device is provided, the device comprising:

[0009] A verification module, configured to, in response to a remote start instruction for a vehicle, perform a safety verification on the remote start instruction and obtain a verification result;

[0010] a collection module, configured to, if the verification result is qualified, in response to detecting that the door of the vehicle is opened, control the image collection device of the vehicle to collect an image of a user entering the vehicle, and send the image to a terminal associated with the vehicle, wherein the terminal is configured to send a start permission instruction to the vehicle if it is determined that the user is a legitimate person based on the image;

[0011] The first control module is used to control the vehicle to start in response to receiving a start permission instruction from the terminal.

[0012] In some embodiments, the acquisition module includes:

[0013] A control unit, configured to control the vehicle to enter a disarmed state when the verification result is qualified, wherein the disarmed state is used to indicate that the anti-theft system of the vehicle is in a non-armed mode and the doors of the vehicle are unlocked;

[0014] The acquisition unit is used to control the image acquisition device to acquire an image of a user entering the vehicle when it is detected that the door of the vehicle is opened.

[0015] In some embodiments, the control unit is further used to control the vehicle to switch from the disarmed state to the armed state if no start permission instruction is received from the terminal within a time threshold when the vehicle enters the disarmed state. The armed state is used to indicate that the anti-theft system of the vehicle is in an alert mode and the vehicle is locked.

[0016] In some embodiments, the first control module is used to control the display screen of the vehicle to display a password input interface in response to receiving a start-up permission instruction from the terminal, the password input interface displays prompt information, and the prompt information is used to prompt the vehicle user to enter a password; in response to a password input operation on the password input interface, obtain the password entered on the password input interface; and control the vehicle to start when the password is consistent with a preset password.

[0017] In some embodiments, the terminal is further used to send an alarm instruction to the vehicle when it is determined based on the image that the vehicle user is an illegal person, and the device further includes:

[0018] The second control module is used to control the vehicle to enter a locked state in response to receiving an alarm instruction from the terminal, and the locked state is used to indicate that the vehicle doors, engine and steering wheel are locked; when the vehicle enters the locked state, the vehicle alarm is controlled.

[0019] In some embodiments, the second control module is used to control the speaker of the vehicle to emit an alarm sound; control the warning lights of the vehicle to light up; and send an alarm message to a server connected to a security management agency, wherein the alarm message includes an image of the vehicle user and the location of the vehicle.

[0020] In some embodiments, the apparatus further comprises:

[0021] The third control module is used to control the image acquisition device of the vehicle to capture the image of the vehicle's driving seat when it is detected that the gear position of the vehicle is the parking gear and the vehicle door is open; when it is detected that the vehicle user does not exist in the image of the vehicle's driving seat and the vehicle door is closed, control the vehicle to enter a fortified state, and the fortified state is used to indicate that the vehicle's anti-theft system is in an alert mode and the vehicle is locked.

[0022] In another aspect, a vehicle-mounted terminal is provided, which includes a processor and a memory, the memory is used to store at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the vehicle startup control method in the embodiment of the present application.

[0023] On the other hand, a computer-readable storage medium is provided, which is used to store at least one computer program, and the at least one computer program is loaded and executed by a processor to implement the vehicle startup control method in an embodiment of the present application.

[0024] On the other hand, a computer program product is provided, including a computer program, wherein the computer program is executed by a processor to implement the vehicle startup control method in the embodiment of the present application.

[0025] An embodiment of the present application provides a vehicle startup control method, which can not only perform a security check on the received remote startup command when the vehicle is remotely started, but also control the vehicle's image acquisition device to capture images of vehicle users entering the vehicle after the security check is passed, thereby enabling the on-board terminal to control the vehicle startup when the vehicle-associated terminal determines that the vehicle user is a legitimate person based on the captured image, thereby greatly improving the security of the vehicle's remote startup. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0027] Figure 1is a schematic diagram of an implementation environment of a vehicle startup control method provided according to an embodiment of the present application;

[0028] Figure 2 is a flow chart of a vehicle startup control method provided according to an embodiment of the present application;

[0029] Figure 3 is a flow chart of another vehicle startup control method provided according to an embodiment of the present application;

[0030] Figure 4 is a structural schematic diagram of a vehicle startup control system provided according to an embodiment of the present application;

[0031] Figure 5 is a block diagram of a vehicle startup control device provided according to an embodiment of the present application;

[0032] Figure 6 is a block diagram of another vehicle startup control device provided according to an embodiment of the present application;

[0033] Figure 7 It is a structural schematic diagram of a vehicle-mounted terminal provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0034] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0035] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first", "second", and "nth", nor are there any limitations on quantity and execution order.

[0036] In the present application, the term "at least one" means one or more, and the term "plurality" means two or more.

[0037] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0038] Figure 1 Schematic diagram of an implementation environment of a vehicle startup control method provided according to an embodiment of the present application. Figure 1 The implementation environment includes a vehicle 101 and a mobile terminal 102. The vehicle-mounted terminal in the vehicle 101 and the mobile terminal 102 are connected via a wireless network.

[0039] In some embodiments, according to the purpose of the vehicle, the vehicle 101 can be a car, a bus, a truck, a taxi, etc. According to the power source of the vehicle, the vehicle 101 can be a new energy vehicle, including a pure electric vehicle, a plug-in hybrid vehicle, a fuel cell electric vehicle, etc. In addition to the vehicle-mounted terminal, the vehicle 101 is also equipped with an image acquisition device and an output device. The image acquisition device is used to capture images inside the vehicle 101, and can be a camera. The output device is used to output information, and can be a display screen, a speaker, etc.

[0040] In some embodiments, the mobile terminal 102 is a terminal associated with the vehicle 101. For example, the mobile terminal 102 may be a terminal used by the vehicle owner, such as a smart phone, a tablet computer, a laptop computer, a smart watch, etc., but is not limited thereto. An application may be installed and run on the mobile terminal 102, and the application is used to remotely start the vehicle.

[0041] In the embodiment of the present application, after receiving the remote start command, the vehicle terminal of the vehicle 101 can perform a security check on it to ensure that the remote start command is a legal command from the mobile terminal 102. After the verification is qualified, the vehicle terminal can control the image acquisition device of the vehicle 101 to acquire images and send the acquired images to the mobile terminal 102, so that the owner can judge whether the person using the vehicle 101 is a legal person through the image displayed by the mobile terminal 102. After determining that the person using the vehicle is a legal person, the mobile terminal 102 can send a start permission command to the vehicle terminal of the vehicle 101 so that the vehicle terminal controls the vehicle to start.

[0042] Figure 2 is a flow chart of a vehicle startup control method provided according to an embodiment of the present application, the method is executed by a vehicle-mounted terminal of the vehicle, such as Figure 2 As shown, the vehicle startup control method includes the following steps:

[0043] 201. In response to a remote start instruction for a vehicle, the vehicle-mounted terminal performs a security check on the remote start instruction and obtains a check result.

[0044] In an embodiment of the present application, when a user other than the owner of the vehicle has a need to use the vehicle, the user usually needs to ask the owner for the physical key of the vehicle before starting the vehicle. In order to quickly meet the user's need to use the vehicle without relying on the physical key to start the vehicle, the owner can send a remote start command to the vehicle through the terminal he uses after receiving the request to use the vehicle. After receiving the remote start command, the vehicle's on-board terminal can perform a security check on the remote start command according to a pre-defined algorithm to ensure that the remote start command is a legitimate command from the terminal used by the owner, thereby preventing the on-board terminal from controlling the start of the vehicle based on the remote start command sent by an illegal device.

[0045] Optionally, during the security verification process, the vehicle terminal can perform error correction on the remote start command based on a preset error correction code to prevent the remote start command from being tampered with or errors during the transmission process. The preset error correction code may be a CRC (Cyclic Redundancy Check) code.

[0046] 202. When the verification result is qualified, in response to detecting that the vehicle door is opened, the on-board terminal controls the vehicle's image acquisition device to capture an image of the user entering the vehicle, and sends the image to the terminal associated with the vehicle. The terminal is used to send a start-up permission instruction to the vehicle when it is determined that the user is a legitimate person based on the image.

[0047] In an embodiment of the present application, when the verification result of the remote start command is qualified, it indicates that the remote start command has passed the security verification, so the vehicle-mounted terminal can send an unlock command to the vehicle's body controller so that the body controller controls the vehicle's door to unlock. After the door is unlocked, the vehicle user can enter the vehicle's cab by opening the door. Correspondingly, when it is detected that the vehicle door is open, it can be confirmed that the vehicle user has entered the vehicle, so the vehicle-mounted terminal can control the vehicle's image acquisition device to start, so that the image acquisition device can capture images of the vehicle user in the vehicle. When the vehicle-mounted terminal receives the image of the vehicle user captured by the image acquisition device, it can send the image to the terminal associated with the vehicle, that is, the terminal used by the owner, through a wireless network.

[0048] After receiving the image of the vehicle user, the terminal associated with the vehicle can display the image and prompt information, which is used to prompt whether the vehicle user in the image is a legitimate person. In response to the vehicle owner's confirmation operation on the prompt information, the terminal can determine that the vehicle user is a legitimate person, so the terminal can send a start permission instruction to the vehicle.

[0049] 203. In response to receiving the start permission instruction from the terminal, the vehicle-mounted terminal controls the vehicle to start.

[0050] In an embodiment of the present application, when a start permission instruction is received from a terminal associated with the vehicle, it indicates that the person entering the vehicle is a legal person, so the on-board terminal sends a start instruction to the vehicle's power system to control the start of the vehicle's engine.

[0051] An embodiment of the present application provides a vehicle startup control method, which can not only perform a security check on the received remote startup command when the vehicle is remotely started, but also control the vehicle's image acquisition device to capture images of vehicle users entering the vehicle after the security check is passed, thereby enabling the on-board terminal to control the vehicle startup when the vehicle-associated terminal determines that the vehicle user is a legitimate person based on the captured image, thereby greatly improving the security of the vehicle's remote startup.

[0052] Figure 3 is a flow chart of another vehicle startup control method provided according to an embodiment of the present application, the method is executed by a vehicle-mounted terminal of the vehicle, such as Figure 3 As shown, the vehicle startup control method includes the following steps:

[0053] 301. In response to a remote start instruction for a vehicle, the vehicle-mounted terminal performs a security check on the remote start instruction and obtains a check result.

[0054] In the embodiment of the present application, step 301 is the same as step 201 above, and will not be repeated here.

[0055] 302. When the verification result is qualified, the vehicle terminal controls the vehicle to enter the disarmed state, and the disarmed state is used to indicate that the anti-theft system of the vehicle is in the non-alert mode and the vehicle doors are unlocked.

[0056] In the embodiment of the present application, when the verification result of the remote start command is qualified, it indicates that the remote start command has passed the security verification, so the vehicle terminal can send an unlocking command to the vehicle's body controller to control the vehicle to enter the disarmed state. The unlocking command is used to instruct the body controller to control the vehicle's door unlocking and send a disarming command to the vehicle's anti-theft control unit to put the vehicle's anti-theft system in a non-alert mode. In the non-alert mode, the vehicle will not alarm due to the opening of the door.

[0057] Optionally, the vehicle terminal can also control the vehicle to perform an unlocking sound and light action during the process of controlling the vehicle to enter the unlocking state, so as to remind the vehicle user that the vehicle has entered the unlocking state. The unlocking sound and light action includes a sound action and a light action. The sound action can be the vehicle emitting an unlocking prompt sound; the light action can be the vehicle's lights flashing.

[0058] Optionally, in the event that the verification result is unqualified, the vehicle-mounted terminal can keep the vehicle in a fortified state, where the fortified state is used to indicate that the vehicle's anti-theft system is in an armed mode and the vehicle is locked.

[0059] 303. When it is detected that the door of the vehicle is opened, the vehicle-mounted terminal controls the image acquisition device to acquire the image of the person entering the vehicle, and sends the image to the terminal associated with the vehicle.

[0060] In an embodiment of the present application, after the vehicle door is unlocked, the vehicle user can enter the cab of the vehicle by opening the door. Accordingly, when it is detected that the vehicle door is open, it can be confirmed that the vehicle user has entered the vehicle, so the vehicle-mounted terminal can control the image acquisition device of the vehicle to start. After starting, the image acquisition device can capture images of the environment inside the vehicle in real time, and send the captured images of the interior of the vehicle to the vehicle-mounted face recognition system. The vehicle-mounted face recognition system can perform face detection on the image inside the vehicle to detect whether the image contains a face. If the vehicle-mounted face recognition system detects a face in the image, it can send the image to the vehicle-mounted terminal, so that the vehicle-mounted terminal sends the image to the terminal associated with the vehicle, that is, the terminal used by the owner, via a wireless network.

[0061] After receiving the image of the vehicle user, the terminal associated with the vehicle can display the image and prompt information, and the prompt information is used to prompt whether the vehicle user in the image is a legal person. In response to the vehicle owner's confirmation operation on the prompt information, the terminal can determine that the vehicle user is a legal person, so the terminal can send a permission to start command to the vehicle. Conversely, in response to the vehicle owner's denial operation on the prompt information, the terminal can determine that the vehicle user is an illegal person, so the terminal can send an alarm command to the vehicle.

[0062] In some embodiments, the vehicle terminal can also set a duration threshold for the duration of the vehicle in the disarmed state when controlling the vehicle to enter the disarmed state. Accordingly, when the vehicle enters the disarmed state, if the terminal does not receive the start-up permission instruction within the duration threshold, the vehicle terminal can control the vehicle to switch from the disarmed state to the armed state, and the armed state is used to indicate that the anti-theft system of the vehicle is in the alert mode and the vehicle is locked. Among them, the duration threshold can be 5 minutes, 8 minutes, and 10 minutes, which is not limited in the embodiment of the present application. If the terminal still does not receive the start-up permission instruction within the duration threshold, the vehicle terminal can send a locking instruction to the body controller to control the vehicle to enter the armed state. The locking instruction is used to instruct the body controller to control the door lock of the vehicle and send an arming instruction to the anti-theft control unit of the vehicle to put the anti-theft system of the vehicle in the alert mode. In the alert mode, the vehicle will sound an alarm when the door is opened. By setting a duration threshold for the duration of the disarmed state, it is possible to avoid the vehicle from being in the disarmed state for a long time when the start-up permission instruction is not received for a long time, thereby improving the safety of the vehicle.

[0063] It should be noted that the vehicle-associated terminal can determine whether the vehicle user is a legal person or an illegal person based on the image. Accordingly, if the vehicle user is determined to be a legal person, the vehicle-mounted terminal can execute the following step 304; if the vehicle user is determined to be an illegal person, the vehicle-mounted terminal can execute the following steps 305-306.

[0064] 304. In response to receiving the start permission instruction from the terminal, the vehicle-mounted terminal controls the vehicle to start.

[0065] In an embodiment of the present application, when a start permission instruction is received from a terminal associated with the vehicle, it indicates that the person entering the vehicle is a legal person, so the on-board terminal sends a start instruction to the vehicle's power system to control the start of the vehicle's engine.

[0066] In some embodiments, after the vehicle is allowed to be started, the user can start the vehicle by voice or password. Accordingly, the vehicle terminal can control the vehicle start-up in the following two implementation methods.

[0067] Implementation method 1: In response to receiving the start permission instruction from the terminal, the vehicle-mounted terminal controls the speaker of the vehicle to output voice prompt information, and the voice prompt information is used to prompt the vehicle user to start the vehicle; in response to receiving the voice control signal for starting the vehicle, the vehicle-mounted terminal can control the engine start of the vehicle. Among them, a voice acquisition device, such as a microphone, is also installed in the vehicle. The voice acquisition device is used to collect voice data of the vehicle user. The voice control signal is a keyword for starting the vehicle identified from the collected voice data, such as the keyword "start using / starting the vehicle".

[0068] Implementation method 2: In response to receiving the terminal's permission to start command, the vehicle terminal controls the vehicle's display screen to display a password input interface, and the password input interface displays a prompt message, which is used to prompt the vehicle user to enter a password; in response to the password input operation on the password input interface, the vehicle terminal obtains the password entered on the password input interface; when the password is consistent with the preset password, the vehicle terminal controls the vehicle to start. Among them, after determining that the vehicle user is a legitimate person, the terminal associated with the vehicle can also send a preset password to the terminal used by the vehicle user designated by the owner through a text message, so that the vehicle user designated by the owner can enter the correct password on the password input interface. If the password entered by the vehicle user is inconsistent with the preset password, it indicates that the vehicle user entering the vehicle is not the vehicle user actually designated by the vehicle owner, that is, there is an illegal person who has invaded the vehicle's image acquisition device, so that the image captured by the image acquisition device is not the real image of the vehicle user, but a false image after the vehicle user has changed his face, thereby causing the terminal used by the vehicle owner to confirm that the vehicle user is a legitimate person based on the false image. By displaying the password input interface after receiving the start permission command, a second confirmation can be performed before starting the vehicle, further improving the security of remote vehicle starting.

[0069] In some embodiments, the vehicle terminal can also automatically control the vehicle to enter a fortified state after the vehicle user has finished using the vehicle. Accordingly, when it is detected that the vehicle's gear is in the parking gear and the vehicle's door is open, it indicates that the vehicle has stopped and the vehicle user may open the door to get off the vehicle, so at this time the vehicle terminal can determine that the vehicle user has an intention to end the use of the vehicle. In order to further determine whether the vehicle user has left the vehicle, the vehicle terminal can control the vehicle's image acquisition device to capture an image of the vehicle's driving seat; when it is detected that there is no vehicle user in the image of the vehicle's driving seat and the vehicle's door is closed, the vehicle terminal can confirm that the vehicle user has left the vehicle, so the vehicle terminal can control the vehicle to enter a fortified state, which is used to indicate that the vehicle's anti-theft system is in an alert mode and the vehicle is locked. By controlling the vehicle to enter a fortified state after detecting that the vehicle user has finished using the vehicle, the safety of the vehicle can be guaranteed.

[0070] Optionally, when it is detected that the gear of the vehicle is in the parking gear and the door of the vehicle is open, the vehicle terminal can also control the speaker of the vehicle to output a prompt message and control the display screen of the vehicle to display the prompt message. The prompt message is used to prompt the vehicle user whether to end the current use of the vehicle. In response to receiving a voice control signal for ending the use of the vehicle or detecting a confirmation operation of the prompt message displayed on the display screen, the vehicle terminal can control the vehicle to enter the fortified state after confirming that the vehicle user has left the vehicle.

[0071] Optionally, the vehicle-mounted terminal can also send vehicle information to a terminal associated with the vehicle, and the vehicle information is used to prompt the vehicle owner that the vehicle has completed this use and is in a fortified state.

[0072] 305. In response to receiving the alarm instruction from the terminal, the vehicle-mounted terminal controls the vehicle to enter a locked state, where the locked state is used to indicate that the vehicle doors, engine and steering wheel are locked.

[0073] In the embodiment of the present application, when an alarm instruction is received from a terminal associated with the vehicle, it indicates that the user who entered the vehicle is an illegal person, so the vehicle-mounted terminal can immediately control the vehicle to enter a locked state. In the locked state, the vehicle doors, engine and steering wheel are all locked. Among them, when the doors are locked, the user cannot open the doors from inside the vehicle, thereby preventing illegal persons from escaping during the process of invading the vehicle. When the engine and steering wheel are locked, the transmitter cannot be started and the steering wheel cannot be turned, thereby preventing the illegal person from starting the vehicle by illegal means.

[0074] 306. When the vehicle enters a locked state, the vehicle terminal controls the vehicle to alarm.

[0075] In the embodiment of the present application, when the vehicle enters a locked state, it indicates that the illegal person is in the vehicle and cannot move, so the vehicle-mounted terminal can control the vehicle alarm to prompt that the vehicle has been invaded by an illegal person.

[0076] In some embodiments, the vehicle terminal controls the vehicle alarm, including at least one of the following:

[0077] (1) Control the loudspeaker of the vehicle to emit an alarm sound. The loudspeaker is also the horn of the vehicle, which can emit a high-decibel alarm sound.

[0078] (2) Control the vehicle's warning lights to light up. The warning lights may be headlights, taillights, turn signals, or other lamps of the vehicle, or they may be anti-theft alarm lights designed specifically for the vehicle, which are not limited in the present application. By controlling the vehicle's speakers to sound an alarm and controlling the vehicle's warning lights to light up, the vehicle owner or people around the vehicle can pay attention to the vehicle's condition in a timely manner, thus preventing illegal persons from causing damage to the vehicle.

[0079] (3) Sending alarm information to the server connected to the security management agency, including the image of the person using the vehicle and the location of the vehicle. By sending the image of the person using the vehicle and the location of the vehicle to the server connected to the security management agency, the security management agency can be notified in a timely manner of illegal intrusion of the vehicle, which facilitates the security management personnel to quickly respond to the call and ensures the safety of the vehicle.

[0080] Combine the following Figure 4The structural diagram of the vehicle startup control system shown in FIG. 1 is used to describe the vehicle startup control scheme provided in the embodiment of the present application as a whole. Figure 4 As shown, the terminal used by the car owner can send a remote start command to the vehicle's TBOX (Telematics Box, on-board terminal) through a wireless network. TBOX can perform a security check on the remote start command and allow the vehicle to be disarmed after the check is qualified, that is, allow the body controller to control the door unlocking. After the vehicle is disarmed, the user can open the door and get on the vehicle. TBOX can control the camera equipped with the on-board face recognition system to start collecting the face information of the user, and send the collected face information to the terminal used by the car owner through a wireless network. After the car owner confirms that the information is correct, the terminal used by the car owner can send a start permission command to TBOX. After the start is allowed, TBOX directly prompts the user through the on-board voice "You can start the vehicle, please start the vehicle directly", or TBOX controls the display screen to pop up a password input prompt "Please enter the password", and the user can directly start the vehicle after entering a legal password. When the owner confirms that the user is an illegal person, the owner can click the one-key alarm button displayed on the terminal to enable the terminal to send an alarm command to TBOX. At this time, the vehicle will lock and trigger the sound and light alarm function, that is, TBOX controls the door lock, the horn alarm and the warning light through the body controller. After the user has finished using the vehicle, TBOX can prompt the user through the in-vehicle voice whether to end the use of the vehicle, and control the display screen to make a pop-up prompt simultaneously. When the user's voice reply "end use" or click "confirm" on the display screen is collected, if the camera detects that the user has left the vehicle and closed the door, TBOX will actively arm the vehicle.

[0081] An embodiment of the present application provides a vehicle startup control method, which can not only perform a security check on the received remote startup command when the vehicle is remotely started, but also control the vehicle's image acquisition device to capture images of vehicle users entering the vehicle after the security check is passed, thereby enabling the on-board terminal to control the vehicle startup when the vehicle-associated terminal determines that the vehicle user is a legitimate person based on the captured image, thereby greatly improving the security of the vehicle's remote startup.

[0082] Figure 5 is a block diagram of a vehicle startup control device provided according to an embodiment of the present application. The device is used to execute the steps of the above vehicle startup control method. Figure 5 , the device comprises:

[0083] A verification module 501 is used to perform a safety verification on the remote start instruction in response to the remote start instruction of the vehicle and obtain a verification result;

[0084] The acquisition module 502 is used to control the image acquisition device of the vehicle to acquire an image of the user entering the vehicle in response to detecting that the vehicle door is opened if the verification result is qualified, and send the image to a terminal associated with the vehicle, and the terminal is used to send a start permission instruction to the vehicle if the user is determined to be a legitimate person based on the image;

[0085] The first control module 503 is used to control the vehicle to start in response to receiving a start permission instruction from the terminal.

[0086] In some embodiments, Figure 6 is a block diagram of another vehicle startup control device provided according to an embodiment of the present application. Figure 6 , the acquisition module 502 includes:

[0087] The control unit 601 is used to control the vehicle to enter a disarmed state when the verification result is qualified, and the disarmed state is used to indicate that the anti-theft system of the vehicle is in a non-alert mode and the vehicle doors are unlocked;

[0088] The acquisition unit 602 is used to control the image acquisition device to acquire the image of the vehicle user entering the vehicle when it is detected that the vehicle door is opened.

[0089] In some embodiments, the control unit 601 is also used to control the vehicle to switch from the disarmed state to the armed state if no start-up permission instruction is received from the terminal within a time threshold when the vehicle enters the disarmed state. The armed state is used to indicate that the vehicle's anti-theft system is in an alert mode and the vehicle is locked.

[0090] In some embodiments, the first control module 503 is used to control the display screen of the vehicle to display a password input interface in response to receiving a start-up permission instruction from the terminal, the password input interface displays prompt information, and the prompt information is used to prompt the vehicle user to enter a password; in response to a password input operation on the password input interface, obtain the password entered on the password input interface; when the password is consistent with a preset password, control the vehicle to start.

[0091] In some embodiments, the terminal is also used to send an alarm instruction to the vehicle when the person using the vehicle is determined to be an illegal person based on the image. Figure 6 , the device further comprises:

[0092] The second control module 504 is used to control the vehicle to enter a locked state in response to receiving an alarm instruction from the terminal. The locked state is used to indicate that the vehicle's doors, engine and steering wheel are locked; when the vehicle enters the locked state, the vehicle is controlled to alarm.

[0093] In some embodiments, the second control module 504 is used to control the speaker of the vehicle to emit an alarm sound; control the warning lights of the vehicle to light up; and send an alarm message to a server connected to a security management agency, the alarm message including an image of the person using the vehicle and the location of the vehicle.

[0094] In some embodiments, see Figure 6 , the device further comprises:

[0095] The third control module 505 is used to control the image acquisition device of the vehicle to capture the image of the vehicle's driving seat when it is detected that the vehicle's gear position is the parking gear and the vehicle's door is open; when it is detected that there is no occupant in the image of the vehicle's driving seat and the vehicle's door is closed, control the vehicle to enter a fortified state, and the fortified state is used to indicate that the vehicle's anti-theft system is in an alert mode and the vehicle is locked.

[0096] An embodiment of the present application provides a vehicle start control device, which, when remotely starting a vehicle, can not only perform a security check on the received remote start command, but also control the vehicle's image acquisition device to capture images of vehicle users entering the vehicle after the security check is passed, thereby enabling the on-board terminal to control the vehicle start when the vehicle-associated terminal determines that the vehicle user is a legitimate person based on the captured image, thereby greatly improving the security of remote starting of the vehicle.

[0097] It should be noted that: the vehicle startup control device provided in the above embodiment only uses the division of the above functional modules as an example when running an application program. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the vehicle startup control device provided in the above embodiment and the vehicle startup control method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0098] Figure 7 It is a structural schematic diagram of a vehicle-mounted terminal provided according to an embodiment of the present application.

[0099] Typically, the vehicle-mounted terminal 700 includes: a processor 701 and a memory 702 .

[0100] The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 701 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 701 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 701 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0101] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include a high-speed random access memory and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 702 is used to store at least one computer program, which is used to be executed by the processor 701 to implement the vehicle startup control method provided in the method embodiment of the present application.

[0102] In some embodiments, the vehicle-mounted terminal 700 may further optionally include: a peripheral device interface 703 and at least one peripheral device. The processor 701, the memory 702 and the peripheral device interface 703 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 703 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707 and a power supply 708.

[0103] The peripheral device interface 703 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 701 and the memory 702. In some embodiments, the processor 701, the memory 702, and the peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 701, the memory 702, and the peripheral device interface 703 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0104] The radio frequency circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 704 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, the radio frequency circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 704 can communicate with other vehicle-mounted terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 704 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0105] The display screen 705 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 705 is a touch display screen, the display screen 705 also has the ability to collect touch signals on the surface or above the surface of the display screen 705. The touch signal can be input to the processor 701 as a control signal for processing. At this time, the display screen 705 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 705 can be one, set on the front panel of the vehicle terminal 700; in other embodiments, the display screen 705 can be at least two, respectively set on different surfaces of the vehicle terminal 700 or in a folding design; in other embodiments, the display screen 705 can be a flexible display screen, set on the curved surface or folding surface of the vehicle terminal 700. Even, the display screen 705 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 705 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0106] The camera assembly 706 is used to capture images or videos. In some embodiments, the camera assembly 706 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the vehicle terminal, and the rear camera is arranged on the back of the vehicle terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 706 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0107] The audio circuit 707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 701 for processing, or input them into the radio frequency circuit 704 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there can be multiple microphones, which are respectively arranged at different parts of the vehicle-mounted terminal 700. The microphone can also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 701 or the radio frequency circuit 704 into sound waves. The speaker can be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 707 may also include a headphone jack.

[0108] The power supply 708 is used to power various components in the vehicle-mounted terminal 700. The power supply 708 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When the power supply 708 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0109] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the vehicle-mounted terminal 700, and may include more or fewer components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0110] The embodiment of the present application also provides a computer-readable storage medium, in which at least one computer program is stored, and the at least one computer program is loaded and executed by the processor of the vehicle terminal to implement the operation performed by the vehicle terminal in the vehicle startup control method of the above embodiment. For example, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0111] An embodiment of the present application also provides a computer program product, including a computer program, wherein the computer program is loaded and executed by a processor to implement the vehicle startup control method as described in the above embodiment.

[0112] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0113] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A vehicle startup control method, characterized in that: The method comprises: In response to a remote start instruction for a vehicle, performing a safety check on the remote start instruction to obtain a check result; If the verification result is qualified, in response to detecting that the door of the vehicle is opened, controlling the image acquisition device of the vehicle to acquire an image of the user entering the vehicle, and sending the image to a terminal associated with the vehicle, the terminal is used to send a start permission instruction to the vehicle if it is determined that the user is a legitimate person based on the image; In response to receiving the start-up permission instruction from the terminal, the vehicle is controlled to start.

2. The method according to claim 1, characterized in that When the verification result is qualified, in response to detecting that the door of the vehicle is opened, controlling the image acquisition device of the vehicle to acquire an image of a user entering the vehicle, comprises: If the verification result is qualified, controlling the vehicle to enter a disarmed state, wherein the disarmed state is used to indicate that the anti-theft system of the vehicle is in a non-armed mode and the doors of the vehicle are unlocked; When it is detected that the door of the vehicle is opened, the image acquisition device is controlled to acquire an image of a user entering the vehicle.

3. The method according to claim 2, characterized in that The method further comprises: When the vehicle enters the disarmed state, if no start-up permission instruction is received from the terminal within a time threshold, the vehicle is controlled to switch from the disarmed state to the armed state, and the armed state is used to indicate that the anti-theft system of the vehicle is in an alert mode and the vehicle is locked.

4. The method according to claim 1, characterized in that: In response to receiving the start permission instruction from the terminal, controlling the vehicle to start includes: In response to receiving the start permission instruction from the terminal, controlling the display screen of the vehicle to display a password input interface, wherein the password input interface displays prompt information, and the prompt information is used to prompt the vehicle user to enter a password; In response to a password input operation on the password input interface, acquiring the password input on the password input interface; When the password is consistent with a preset password, the vehicle is controlled to start.

5. The method according to claim 1, characterized in that The terminal is further used to send an alarm instruction to the vehicle when it is determined based on the image that the vehicle user is an illegal person. The method also includes: In response to receiving an alarm instruction from the terminal, controlling the vehicle to enter a locked state, wherein the locked state is used to indicate that the doors, engine and steering wheel of the vehicle are locked; When the vehicle enters a locked state, the vehicle alarm is controlled.

6. The method according to claim 5, characterized in that The controlling of the vehicle alarm includes at least one of the following: controlling a speaker of the vehicle to emit an alarm sound; Controlling the warning lights of the vehicle to light up; An alarm message is sent to a server connected to a security management agency, wherein the alarm message includes an image of the vehicle user and the location of the vehicle.

7. The method according to claim 1, characterized in that The method further comprises: When it is detected that the gear position of the vehicle is the parking gear and the door of the vehicle is open, controlling the image acquisition device of the vehicle to acquire an image of the driving position of the vehicle; When it is detected that the vehicle user does not exist in the image of the vehicle driving seat and the vehicle door is closed, the vehicle is controlled to enter a fortified state, where the fortified state is used to indicate that the anti-theft system of the vehicle is in an alert mode and the vehicle is locked.

8. A vehicle startup control device, characterized in that: The device comprises: A verification module, configured to, in response to a remote start instruction for a vehicle, perform a safety verification on the remote start instruction and obtain a verification result; a collection module, configured to, if the verification result is qualified, in response to detecting that the door of the vehicle is opened, control the image collection device of the vehicle to collect an image of a user entering the vehicle, and send the image to a terminal associated with the vehicle, wherein the terminal is configured to send a start permission instruction to the vehicle if it is determined that the user is a legitimate person based on the image; The first control module is used to control the vehicle to start in response to receiving a start permission instruction from the terminal.

9. A vehicle-mounted terminal, characterized in that: The vehicle-mounted terminal includes a processor and a memory, the memory is used to store at least one computer program, and the at least one computer program is loaded by the processor and executes the vehicle startup control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store at least one computer program, and the at least one computer program is used to execute the vehicle startup control method according to any one of claims 1 to 7.

Images