Method for controlling non-road vehicle by mobile terminal and mobile terminal

Abstract

The invention provides a method for controlling a non-road vehicle by a mobile terminal and the mobile terminal applying the control method.The mobile terminal establishes communication connection with a target non-road vehicle, and the control method comprises the steps of recording a control instruction generated in a target time interval in response to clicking of an operation record control of the mobile terminal, the control instruction is used for controlling the target non-road vehicle; generating an operation step sequence set according to the recorded control instruction; and in response to calling of the operation step sequence set, controlling the target non-road vehicle to execute an operation instruction in the operation step sequence set. According to the method, the purpose of automatically controlling the target non-road vehicle to execute a series of continuous control instructions can be achieved, participation of a driver is not needed in the whole control process, the requirement for manpower in the vehicle control process is reduced, and the vehicle control efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of vehicles, and in particular, to a method for a mobile terminal to control a non-road vehicle and a mobile terminal. Background Art

[0002] A driver can control a vehicle inside the vehicle. However, in some cases, such as when the driver cannot enter the vehicle or the view inside the vehicle is not good enough to comprehensively see the external environment of the vehicle to judge specific operations, the driver needs to get out of the vehicle to observe the external environment while controlling the vehicle. In related technologies, a mobile terminal can be used to remotely control the vehicle to achieve vehicle control outside the vehicle. The driver can send different instructions to the vehicle through the mobile terminal, so as to control the vehicle to perform different actions.

[0003] When controlling the vehicle to perform a series of continuous actions, the driver needs to timely observe the running situation of the vehicle, so that after the vehicle finishes one action, the driver then controls the vehicle to perform another action. When controlling the vehicle to perform continuous actions, it takes the driver a lot of energy and the efficiency of controlling the vehicle is low. At the same time, in this control mode, it is easy to make mistakes. For example, the vehicle may get out of control due to untimely operation, which will cause various safety problems. Summary of the Invention

[0004] Embodiments of this application disclose a method for a mobile terminal to control a non-road vehicle and a mobile terminal, which solve the technical problem of low efficiency in vehicle control.

[0005] This application provides a method for a mobile terminal to control a non-road vehicle. The mobile terminal includes a display screen. The mobile terminal establishes a communication connection with a target non-road vehicle. The control method includes: when the mobile terminal detects the use of the target non-road vehicle, displaying an operation record control corresponding to the target non-road vehicle on the display screen; in response to a click on the operation record control, recording control instructions generated within a target time interval, where the control instructions are used to control the target non-road vehicle; generating an operation sequence set according to the recorded control instructions; on the display screen, displaying a target control corresponding to the operation sequence set; in response to a click on the target control, invoking the operation sequence set and controlling the target non-road vehicle to execute the operation instructions in the operation sequence set.

[0006] In some optional embodiments, before recording the control instructions generated within the target time interval, the method further includes: generating a function control corresponding to the function module according to the function module in the target non-road vehicle, and generating the function control on the display screen; when receiving a click on any one of the displayed function controls, generating a control instruction for the any one function module.

[0007] In some alternative embodiments, before recording the control instructions generated within the target time interval, the method further includes: determining the moment when the trigger operation recording instruction is issued as the first moment; determining the second moment when recording stops; and determining the time interval between the first moment and the second moment as the target time interval.

[0008] In some alternative embodiments, determining the second moment when recording stops includes: starting timing after receiving any control instruction; if the timing reaches a preset duration and no next control instruction is received within the preset duration, determining the moment when any control instruction is received as the second moment.

[0009] In some alternative embodiments, determining the second moment when recording stops includes: in response to a click on the stop control, determining the moment when the stop control is clicked as the second moment; or, in response to receiving a preset stop signal, determining the moment when the stop signal is received as the second moment, where the stop signal includes one or more of a voice signal and a gesture signal.

[0010] In some alternative embodiments, the step of recording the control instructions generated within the target time interval in response to a click on the operation recording control includes: in response to a click on the operation recording control, determining the corresponding user identifier; if the user identifier matches the vehicle identifier of the target non-road vehicle, recording the control instructions generated within the target time interval.

[0011] In some alternative embodiments, the control method further includes: establishing a communication connection between the mobile terminal and the radio frequency key of the target non-road vehicle, and establishing a communication connection between the radio frequency key and the target non-road vehicle.

[0012] In some alternative embodiments, after generating the control instruction for any function module, the control method further includes: sending the generated control instruction to the radio frequency key, so that the radio frequency key sends the received control instruction to the target non-road vehicle.

[0013] In some alternative embodiments, controlling the target non-road vehicle to execute the operation instructions in the operation sequence set includes: sequentially sending the operation instructions in the operation sequence set to the radio frequency key, so that the radio frequency key sends the received operation instructions to the target non-road vehicle.

[0014] In some alternative embodiments, the target non-road vehicle includes a signal receiving and converting device, and the control method further includes: when the signal receiving and converting device has a mobile network function, based on the cellular network, sending the control instruction to the signal receiving and converting device, so as to control the target non-road vehicle to perform corresponding actions according to the control instruction.

[0015] In some alternative embodiments, after controlling the target non-road vehicle to execute the operation instructions in the operation sequence set, the method further includes: controlling the target non-road vehicle to turn on the target detection device for detection, so that when the target non-road vehicle detects an obstacle, it stops executing the operation instructions, obtains the data information corresponding to the obstacle based on the target detection device, and sends the data information to the mobile terminal.

[0016] In some alternative embodiments, after generating the function controls corresponding to the function modules according to the function modules in the target non-road vehicle, the method further includes: when it is detected that any function module is added to the target non-road vehicle, generating the target function control corresponding to the any function module and displaying the target function control.

[0017] In some alternative embodiments, after the function controls are generated on the display screen, the method further includes: adjusting the display of the function controls based on the setting operations on the function controls.

[0018] In the non-road vehicle control method provided in this application, after a communication connection is established between the mobile terminal and the target non-road vehicle, operation record instructions can be used to record the control instructions generated within a target time interval; and according to the recorded control instructions, an operation sequence set can be generated, which can completely record the continuously generated control instructions within the target time interval. Subsequently, these continuously generated control instructions can be obtained by calling the operation sequence set; in response to the call of the operation sequence set, controlling the target non-road vehicle to execute the operation instructions in the operation sequence set realizes the purpose of controlling the target non-road vehicle to automatically execute a series of continuous control instructions. The entire control process does not require the participation of a driver, reduces the manpower required in the vehicle control process, and improves the efficiency of vehicle control. At the same time, controlling the target non-road vehicle to execute the control instructions according to the operation sequence set can ensure that the target non-road vehicle executes each control instruction in a timely manner, avoiding the situation of vehicle out of control caused by untimely manual operation. Description of the Drawings

[0019] Figure 1 It is a schematic diagram of the application scenario of the non-road vehicle control method provided in the embodiment of this application.

[0020] Figure 2 It is a flowchart of the non-road vehicle control method provided in the embodiment of this application.

[0021] Figure 3 It is a schematic diagram of a scenario where a first vehicle is connected to a mobile terminal provided in the embodiment of this application.

[0022] Figure 4 Schematic diagram of a target off-road vehicle function module provided by an embodiment of the present application.

[0023] Figure 5 Schematic diagram of the structure of a mobile terminal provided by an embodiment of the present application. Detailed implementation manners

[0024] For ease of understanding, some explanations of concepts related to the embodiments of the present application are exemplarily given for reference.

[0025] It should be noted that in the present application, "at least one" means one or more, and "a plurality" means two or more than two. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural. The terms "first", "second", "third", "fourth", etc. (if any) in the description, claims and drawings of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence.

[0026] To solve the technical problem of low vehicle control efficiency, the present application provides an off-road vehicle control method, a mobile terminal and a storage medium. The method is applied to the mobile terminal. After the mobile terminal establishes a communication connection with the target off-road vehicle, it can record the control instructions generated within a target time interval based on the user's click on the operation record control; and generate an operation sequence set according to the recorded control instructions, which can completely record the continuously generated control instructions within the target time interval. Subsequently, these continuously generated control instructions can be obtained by calling the operation sequence set; on the display screen, display the target control corresponding to the operation sequence set; in response to the user's click on the target control and the call of the operation sequence set, control the target off-road vehicle to execute the operation instructions in the operation sequence set, achieving the purpose of automatically controlling the target off-road vehicle to execute a series of continuous control instructions. The entire control process does not require the participation of the driver, reducing the manpower required in the vehicle control process and improving the vehicle control efficiency. At the same time, controlling the target off-road vehicle to execute the control instructions according to the operation sequence set can ensure that the target off-road vehicle executes each control instruction in a timely manner, avoiding the situation of vehicle out of control caused by untimely manual operation.

[0027] To better understand the off-road vehicle control method, mobile terminal and storage medium provided by the embodiments of the present application, the application scenario of the off-road vehicle control method of the present application will be described first below.

[0028] Figure 1It is a schematic diagram of the application scenario of the non-road vehicle control method provided by the embodiments of the present application. The non-road vehicle control method provided by the embodiments of the present application is applied to the mobile terminal 11. The mobile terminal 11 can be a mobile electronic device such as a mobile phone, a computer, a tablet computer, etc. The mobile terminal 11 includes a connection technology module for communication to establish communication with other devices. As Figure 1 shown, the mobile terminal 11 can establish a communication connection with the target non-road vehicle 22. In an embodiment of the present application, the mobile terminal 11 can establish a short-range communication connection with the target non-road vehicle 22, such as a connection without a network for implementing Bluetooth connection, Wi-Fi connection, radio frequency connection, etc. In an embodiment of the present application, the mobile terminal 11 can establish a long-range communication with the target non-road vehicle 22, such as a connection for implementing radio frequency connection, cellular network connection, etc. The cellular network connection can include 3G, 4G, and 5G connections, etc. For example, when the signal receiving and converting device of the target non-road vehicle 22 has a mobile network function, the mobile terminal 11 can communicate with the target non-road vehicle 22 based on the cellular network.

[0029] Figure 2 It is a flowchart of the non-road vehicle control method provided by the embodiments of the present application. The non-road vehicle control method is applied to a mobile terminal, such as Figure 1 the mobile terminal 11 shown. The mobile terminal includes a display screen, and the mobile terminal establishes a communication connection with the target non-road vehicle. Hereinafter, taking the mobile terminal as Figure 1 the mobile terminal 11 shown and the target non-road vehicle as Figure 1 the target non-road vehicle 22 shown as an example for illustration. According to different requirements, the order of the steps in this flowchart can be changed, and some steps can be omitted.

[0030] Step S200, when it is detected that the user uses the target non-road vehicle, display an operation record control for the target non-road vehicle on the display screen.

[0031] The operation record control is used to generate an operation record instruction. The operation record instruction is used to record the control instruction corresponding to the target non-road vehicle 22. In an embodiment of the present application, when the user clicks the operation record control, the mobile terminal generates an operation record instruction, so that the mobile terminal 11 records the control instruction for the target non-road vehicle 22 according to the generated operation record instruction.

[0032] In an embodiment of the present application, the mobile terminal 11 can determine the usage status of the target non-road vehicle 22 based on the established communication connection with the target non-road vehicle 22. The usage status can include one or more of a locked gear status, an accessory power-on gear status, an on gear status, and a start gear status. If the usage status of the target non-road vehicle 22 is the start gear status, it is determined that the user is using the target non-road vehicle 22.

[0033] In an embodiment of the present application, a target application for controlling a target non-road vehicle 22 is installed on the mobile terminal 11, and an operation record control can be displayed on the application interface of the target application. The user can set a user account through the target application and establish a binding relationship between the user account and the target non-road vehicle 22, so that the target non-road vehicle 22 can be controlled by logging in to the user account subsequently. It can be understood that when the user account logged in by a user on the target application is bound to a target non-road vehicle 22, the operation record control corresponding to the target non-road vehicle 22 can be displayed on the target application.

[0034] Step S201, in response to the user's click on the operation record control, record the control instructions generated within the target time interval.

[0035] The target non-road vehicle 22 is the vehicle to be controlled. In an embodiment of the present application, the mobile terminal 11 can directly establish a communication connection with the target non-road vehicle 22. In an embodiment of the present application, when the signal receiving and converting device of the target non-road vehicle 22 has a mobile network function, the mobile terminal 11 can directly establish a cellular network connection with the target non-road vehicle 22. Through the cellular network connection, a long-distance connection between the mobile terminal 11 and the target non-road vehicle 22 can be achieved, so that the user can control the target non-road vehicle 22 at a place far away from the target non-road vehicle 22. For example, the mobile terminal 11 can send control instructions to the signal receiving and converting device of the target non-road vehicle 22 through the cellular network, so that the target non-road vehicle 22 performs corresponding actions according to the control instructions. In another embodiment of the present application, the mobile terminal 11 can establish one or more non-network connections such as a Bluetooth connection, a Wi-Fi connection, and a radio frequency with the target non-road vehicle 22. Through the Bluetooth connection and the Wi-Fi connection, the connection between the mobile terminal 11 and the target non-road vehicle 22 can be achieved when the target non-road vehicle 22 does not insert a SIM card, without paying the SIM usage fee, reducing the cost of controlling the target non-road vehicle 22. At the same time, non-road vehicles are vehicles that exceed the restrictions of road traffic regulations and are generally not allowed to drive on the road, such as all-terrain vehicles, motorcycles, snow removal vehicles, snowmobiles, golf carts, etc. The areas where non-road vehicles travel are often far from urban areas and relatively remote. There may be many places in such areas where it is impossible to access cellular services or the access to cellular services is limited, such as the phenomenon that the network is easily disconnected during the access to cellular services. Therefore, the non-network connection will not be interfered by the environment. Therefore, even if the target non-road vehicle 22 is in a poor environment, the connection between the mobile terminal 11 and the target non-road vehicle 22 will not be disconnected, ensuring the stability of non-road vehicle control.

[0036] In another embodiment of the present application, the mobile terminal 11 can indirectly establish a communication connection with the target off-road vehicle 22. Figure 3 It is a schematic diagram of an indirect connection between a mobile terminal 11 and a target off-road vehicle provided in an embodiment of the present application. As Figure 3 shown, the mobile terminal 11 can establish a communication connection with the radio frequency key 33, and the radio frequency key 33 establishes a communication connection with the target off-road vehicle 22 to realize the connection between the mobile terminal 11 and the radio frequency key 33. For example, after the mobile terminal 11 establishes a communication connection with the radio frequency key 33, it can control the radio frequency key 33 to establish a communication connection with the target off-road vehicle 22. The mobile terminal 11 can establish one or more connections of a Bluetooth connection and a Wi-Fi connection with the target off-road vehicle 22. The radio frequency key 33 can establish a radio frequency connection with the target off-road vehicle 22. By establishing a communication connection between the radio frequency key 33 and the target off-road vehicle 22, the mobile terminal 11 can establish a communication connection with the target off-road vehicle 22 at a place far from the target off-road vehicle 22. At the same time, since the communication range of the radio frequency key 33 is small and the radio frequency key 33 and the mobile terminal 11 need to maintain a short physical distance, when the mobile terminal 11 controls the target off-road vehicle 22 through the radio frequency key, the user needs to control the target off-road vehicle 22 at a place close to the target off-road vehicle 22, avoiding the situation that the target off-road vehicle 22 is miscontrolled due to the user's accidental touch of the mobile terminal 11, thus ensuring the safety of vehicle control.

[0037] The control instruction is used to control the target non-road vehicle 22 so that the target non-road vehicle 22 performs corresponding actions, such as forward movement, return, reverse, unloading and other actions. In an embodiment of the present application, the target non-road vehicle 22 can be controlled through a target application. Function controls corresponding to the target non-road vehicle 22 can be displayed on the target application. When the user clicks on the function control, a control instruction for the target non-road vehicle 22 can be generated. In an embodiment of the present application, if the mobile terminal 11 is directly connected to the target non-road vehicle 22, after the mobile terminal 11 generates a control instruction for the target non-road vehicle 22, the generated control instruction can be sent to the target non-road vehicle 22, so that the target non-road vehicle 22 performs corresponding actions. In another embodiment of the present application, if the mobile terminal 11 is indirectly connected to the target non-road vehicle 22 through a radio frequency key, after the mobile terminal 11 generates a control instruction for the target non-road vehicle 22, the generated control instruction can be sent to the radio frequency key, so that the radio frequency key sends the received control instruction to the target non-road vehicle 22. After receiving the control instruction, the target non-road vehicle 22 can perform corresponding actions, thereby realizing the control of the target non-road vehicle 22. The function controls on the target application can be updated, for example, created, deleted, replaced, etc. By updating the function controls on the user interface of the target application, the purpose of controlling multiple functions in the target non-road vehicle 22 by a single mobile terminal 11 can be achieved.

[0038] In an embodiment of the present application, the mobile terminal 1111 can generate function controls corresponding to the function modules based on the determined function modules in the target non-road vehicle 22 and display the generated function controls on the display screen; when receiving a click on any one of the displayed function controls by the user, a control instruction for the any one function module is generated. The function modules are used to control the target non-road vehicle 22 and can implement various operations according to the control instructions of the mobile terminal 11 to adjust the state of the target non-road vehicle 22; or can feedback relevant information to the mobile terminal 11 according to the control instructions. In an embodiment of the present application, after the mobile terminal 11 establishes a communication connection with the target non-road vehicle 22, the mobile terminal 11 can obtain the module information corresponding to the function modules of the target non-road vehicle 22 based on the communication connection with the target non-road vehicle 22. Figure 4 Schematic diagram of a function module of a target non-road vehicle 22 provided by an embodiment of the present application. As Figure 4As shown, the target non-road vehicle 22 may include multiple functional modules, such as an electronic start-stop system 221, an electronic throttle 222, an electronic brake 223, an electronic steering 224, an electronic shift 225, a cargo bed tipping drive 226, an acoustic and optical system 227, a vehicle speed sensor 228, a steering angle sensor 229, a camera / radar sensor 230, a signal receiving and converting device 231, and various other in-vehicle electronic controls 232. Different functional modules can be connected through an in-vehicle network, such as Controller Area Network - Bus (CAN - Bus). Among them, the electronic start-stop system 221 is used to achieve automatic start and stop of the vehicle; the electronic throttle 222 is used to control the vehicle's power output, which may include drive-by-wire throttle, such as controlling engine drive or motor drive to achieve vehicle acceleration; the electronic brake 223 is used to control vehicle braking, decelerating or stopping the vehicle, which may include drive-by-wire braking; the electronic steering 224 is used to control the left and right steering of the vehicle, which may include drive-by-wire steering; the electronic shift 225 (drive-by-wire shift) is used to control the vehicle to switch between various gears, which may include drive-by-wire shift, such as park gear P, neutral gear N, high gear H, or low gear L, etc.; the cargo bed tipping drive 226 is used to control the tipping and unloading of the cargo bed and the return of the cargo bed; the acoustic and optical system 227 is used to control the vehicle horn or light flashing; the vehicle speed sensor 228 is used to obtain vehicle speed information; the steering angle sensor 229 is used to obtain the current steering angle of the vehicle; the camera / radar sensor 230 is used to monitor the vehicle's surrounding environment and the state of moving objects; the signal receiving and converting device 231 is used to establish a communication connection with other devices, for example, it can be used to establish a communication connection with the mobile terminal 11; various other in-vehicle electronic controls 232 may include modules such as electronic suspension, electronic instrument panel, and electric winch. Among them, the electronic suspension is used to control the mode of the electronic suspension, the electronic instrument panel is used to control the display state of the instrument panel, and the electric winch is used to control the start and stop state of the winch. In an embodiment of the present application, each time the target application is launched, the mobile terminal 11 can re-determine the functional modules on the target non-road vehicle 22 and generate functional controls based on the determined functional modules, so that the generated functional controls are more in line with the current situation of the target non-road vehicle 22. By determining the functional modules of the target non-road vehicle 22 and generating the corresponding functional controls for the target non-road vehicle 22, the above-described embodiment can make the generated functional controls match the actual situation of the target non-road vehicle 22, and the mobile terminal 11 will not include functional controls that cannot control the target non-road vehicle 22, thereby improving the accuracy of control of the mobile terminal 11.

[0039] In an embodiment of the present application, after generating function controls corresponding to the function modules in the target non-road vehicle 22 according to the function modules, the mobile terminal 11 will detect the function modules in the target non-road vehicle 22 to determine whether the function modules are updated. If it is determined whether the function modules are updated, function controls corresponding to the updated function modules are generated and displayed. For example, if it is detected that any function module is added to the target non-road vehicle 22, target function controls corresponding to the any function module are generated and the target function controls are displayed. Also, for example, when it is detected that a function module in the target non-road vehicle 22 is removed, the display of the function controls corresponding to the function module is stopped.

[0040] In an embodiment of the present application, when a user account logged in to the target application is bound to a target non-road vehicle 22, function controls corresponding to the target non-road vehicle 22 can be displayed on the target application. In an implementation manner of the present application, when a user account logged in to the target application is bound to a target non-road vehicle 22, the user of the mobile terminal 11 is verified; and whether to display function controls corresponding to the target non-road vehicle 22 is determined according to the verification result. For example, when the user account logged in to the target application does not have the permission to control the target non-road vehicle 22, it is determined that the user of the mobile terminal 11 passes the verification and function controls corresponding to the target non-road vehicle 22 are displayed; if the user account logged in to the target application does not have the permission to control the target non-road vehicle 22, it is determined that the user of the mobile terminal 11 fails the verification and function controls corresponding to the target non-road vehicle 22 are not displayed. The above method can perform double verification based on the binding situation between the user account and the target non-road vehicle 22 and the permissions of the user account, avoiding the situation of displaying function controls on the mobile terminal 11 of users who do not meet the control permissions, and ensuring the safety of controlling the target non-road vehicle 22.

[0041] In an implementation manner of the present application, the generated function controls can be displayed on the application interface of the target application on the display screen. After generating the function controls on the display screen, the display of the function controls can be adjusted based on the user's setting operations on the function controls. For example, the setting operations can include moving operations, deleting operations, hiding operations, etc. Among them, the moving operation can be used to change the display position of the function controls; the deleting operation can delete the function controls so that the function controls are not displayed; the hiding operation can hide the function controls.

[0042] When the mobile terminal 11 receives an operation recording instruction, a plurality of control instructions generated within a target time interval are recorded. In an embodiment of the present application, the first moment when the operation recording instruction is triggered and the second moment when recording stops can be determined, and the time interval between the first moment and the second moment is determined as the target time interval.

[0043] In one embodiment of the present application, the moment when the operation recording instruction is triggered may be determined as the first moment. The moment when the operation recording instruction is triggered may include the moment when the user clicks the recording control, the moment when the first target voice is input, or the moment when the first target gesture is input.

[0044] In one embodiment of the present application, the moment to stop recording may be determined according to a preset stop rule. The stop rule may include that after receiving any control instruction, if no new control instruction is received within a preset duration, the moment when the any control instruction is received is determined as the second moment. In one implementation manner of the present application, timing is performed after receiving any control instruction; if the timing time reaches the preset duration and no next control instruction is received within the preset duration, the moment when the any control instruction is received is determined as the second moment. In another embodiment of the present application, the moment to stop recording may be determined according to a preset second target voice or second target gesture. In response to the user inputting the preset stop signal, the moment when the stop signal is received is determined as the second moment, and the stop signal includes one or more of a voice signal and a gesture signal. For example, when the user inputs the second target voice or second target gesture to the mobile terminal 11, the mobile terminal 11 stops recording the control instruction. The moment when the second target voice or second target gesture is received may be determined as the second moment. In still another embodiment of the present application, the moment to stop recording may be determined according to the moment when the user clicks the stop control. The stop control is used to control the mobile terminal 11 to stop recording the control instruction. For example, in response to the user clicking the stop control, the moment when the user clicks the stop control may be determined as the second moment.

[0045] In another embodiment of the present application, a first target voice or a first target gesture corresponding to the operation recording instruction may be preset. When the user inputs the first target voice or the first target gesture to the mobile terminal 11, an operation recording instruction is generated. And in response to the generated operation recording instruction, the control instructions generated within the target time interval are recorded.

[0046] In an embodiment of the present application, recording the control instructions generated within the target time interval in response to the user's click on the operation recording control includes: in response to the user's click on the operation recording control, determining the user identification corresponding to the user; if the user identification matches the vehicle identification of the target non-road vehicle, recording the control instructions generated within the target time interval. The user identification may include identifiers such as user name, user number, user account, etc. for proving the user's identity. In one implementation, the mapping relationship between the user identification and the target non-road vehicle may be pre-recorded. When a user identification is mapped to a target non-road vehicle, it is determined that the user identification matches the vehicle identification of the target non-road vehicle. The mapping relationship between the user identification and the target non-road vehicle may be recorded based on the user's operation. For example, after the user establishes the binding relationship between the user account and the target non-road vehicle, the mapping relationship between the user identification and the target non-road vehicle is recorded. Step S202: Generate an operation step sequence set according to the recorded control instructions.

[0047] In an embodiment of the present application, an operation step sequence set may be generated according to the recorded control instructions and the trigger time of each control instruction. Each control instruction recorded in the operation step sequence set may include multiple control instructions. The time interval between two adjacent control instructions may be determined according to the trigger time of each control instruction, and an operation step sequence set is generated based on the control instructions and the time interval between each two adjacent control instructions. The operation step sequence set includes the execution time for the target non-road vehicle 22 to execute each control instruction. For example, the mobile terminal 11 records four control instructions (Control Instruction A, Control Instruction B, Control Instruction C, Control Instruction D), where the trigger time of Control Instruction A is 17:10, the trigger time of Control Instruction B is 17:15, the trigger time of Control Instruction C is 17:25, the trigger time of Control Instruction D is 17:32, and the time when the target non-road vehicle 22 stops executing Control Instruction D is 17:37. The generated operation step sequence set includes Control Instruction A, Control Instruction B, Control Instruction C, and Control Instruction D, where the execution time for the target non-road vehicle 22 to execute Control Instruction A is 5 mins, the execution time for the target non-road vehicle 22 to execute Control Instruction B is 10 mins, the execution time for the target non-road vehicle 22 to execute Control Instruction C is 7 mins, and the execution time for the target non-road vehicle 22 to execute Control Instruction D is 5 mins.

[0048] Step S203: Display the target control corresponding to the operation step sequence set on the display screen.

[0049] In an embodiment of the present application, after generating an operation step sequence set, a target control corresponding to the operation step sequence set can be generated and the target control can be displayed on a display screen. The target control is used to call the operation step sequence set. In response to a user's click on the target control, the operation step sequence set is called. One target control can correspond to one operation step sequence set. In an implementation manner of the present application, multiple operation step sequence sets can be generated based on operation record instructions generated by a user operation, and multiple target controls can be generated and displayed according to the multiple generated operation step sequence sets. After displaying the multiple target controls, the display positions of the multiple target controls can be adjusted according to the user's usage frequency. For example, the target control with a higher number of user clicks is displayed in a more forward position; the target control with a smaller number of user clicks is displayed in a more forward position. The display positions of the multiple target controls can be adjusted based on the user's settings.

[0050] Step S204, in response to the user's click on the target control, call the operation step sequence set and control the target non-road vehicle to execute the operation instructions in the operation step sequence set.

[0051] In an embodiment of the present application, after generating an operation step sequence set, the target control corresponding to the operation step sequence set can be generated and displayed. The target control is used to call the operation step sequence set; in response to the user's click on the target control, the operation step sequence set is called. In an implementation manner of the present application, the mobile terminal 11 can generate one or more operation step sequence sets, each operation step sequence set can correspond to a target control, and different operation step sequence sets correspond to different target controls.

[0052] In response to the invocation of the operation step sequence set, the target non-road vehicle 22 can be controlled to execute all the operation instructions in the operation step sequence set in the order of the operation instructions in the operation step sequence set. In an embodiment of the present application, the mobile terminal 11 can send the operation instructions in the operation step sequence set to the target non-road vehicle 22 based on the cellular network. In an embodiment of the present application, all the operation instructions in the operation step sequence set can be sequentially controlled to be executed by the target non-road vehicle 22 according to the execution time of each control instruction executed by the target non-road vehicle 22 in the operation step sequence set. For example, the execution time of each control instruction executed by the target non-road vehicle 22 in the operation step sequence set includes: the execution time of the target non-road vehicle 22 executing control instruction A is 5 mins, the execution time of the target non-road vehicle 22 executing control instruction B is 10 mins, the execution time of the target non-road vehicle 22 executing control instruction C is 7 mins, and the execution time of the target non-road vehicle 22 executing control instruction D is 5 min; if the moment when the user invokes the operation step sequence set is 19:10, the mobile terminal 11 controls the target non-road vehicle 22 to execute control instruction A at 19:10, the mobile terminal 11 controls the target non-road vehicle 22 to execute control instruction B at 19:15, the mobile terminal 11 controls the target non-road vehicle 22 to execute control instruction C at 19:25, the mobile terminal 11 controls the target non-road vehicle 22 to execute control instruction D at 19:32, and controls the target non-road vehicle 22 to stop executing control instruction D at 19:37.

[0053] In an embodiment of the present application, when the mobile terminal 11 establishes a communication connection with the target non-road vehicle 22 through the radio frequency key 33, controlling the target non-road vehicle 22 to execute the operation instructions in the operation step sequence set includes: sequentially sending the operation instructions in the operation step sequence set to the radio frequency key 33, so that the radio frequency key 33 sends the received operation instructions to the target non-road vehicle 22. For example, assuming that the moment when the user invokes the operation step sequence set is 19:10, the execution time of the target non-road vehicle 22 executing control instruction A is 5 mins, the execution time of the target non-road vehicle 22 executing control instruction B is 10 mins, the execution time of the target non-road vehicle 22 executing control instruction C is 7 mins, and the execution time of the target non-road vehicle 22 executing control instruction D is 5 min, the mobile terminal 11 sends control instruction A to the radio frequency key 33 at 19:10; the mobile terminal 11 sends control instruction B to the radio frequency key 33 at 19:15; the mobile terminal 11 sends control instruction C to the radio frequency key 33 at 19:25; the mobile terminal 11 sends control instruction D to the radio frequency key 33 at 19:32, and sends the instruction to execute control instruction D to the radio frequency key 33 at 19:37.

[0054] To ensure the safety of the target non-road vehicle 22 during the execution of the operation instructions in the operation sequence set, the method further includes: when controlling the target non-road vehicle 22 to execute the operation instructions in the operation sequence set, controlling the target non-road vehicle 22 to turn on the target monitoring device to obtain a monitoring result; and based on the monitoring result, determining whether to control the target non-road vehicle 22 to stop executing the operation instructions. If it is determined that there is an obstacle based on the monitoring result, control the target non-road vehicle 22 to stop executing the operation instructions. The target monitoring device may include a camera, a radar, an infrared sensor, etc. The monitoring result may include a captured image, a radar image obtained, etc. In an embodiment of the present application, a target program for obstacle avoidance may be preset in the target non-road vehicle 22. When the target non-road vehicle 22 executes the operation instructions in the operation sequence set, the target non-road vehicle 22 automatically runs the target program and turns on the target detection device for detection; when it is determined that there is an obstacle in the forward direction of the target non-road vehicle 22, stop executing the operation instructions, and the target detection device obtains data information corresponding to the obstacle and sends the data information to the mobile terminal 11, so that the user corresponding to the mobile terminal 11 determines whether to continue executing the operation instructions. In an embodiment of the present application, when the target non-road vehicle 22 stops executing the operation instructions, it may obtain environmental information of the current environment based on the target monitoring device and send the environmental information to the mobile terminal 11. The mobile terminal 11 may generate a corresponding prompt message based on the environmental information so that the user determines whether to execute the operation instructions. The mobile terminal 11 may generate a corresponding processing result based on the user's selection and send the processing result to the target non-road vehicle 22.

[0055] For the non-road vehicle control method provided in the above embodiment, after establishing a communication connection between the mobile terminal and the target non-road vehicle, it is possible to record the control instructions generated within the target time interval based on the user's click on the operation record control; and generate an operation sequence set according to the recorded control instructions, which can completely record the continuously generated control instructions within the target time interval. Subsequently, these continuously generated control instructions can be obtained by calling the operation sequence set; on the display screen, display the target control corresponding to the operation sequence set; in response to the user's click on the target control and the call of the operation sequence set, control the target non-road vehicle to execute the operation instructions in the operation sequence set, achieving the purpose of automatically controlling the target non-road vehicle to execute a series of continuous control instructions. The entire control process does not require the participation of a driver, reducing the manpower required in the vehicle control process. At the same time, controlling the target non-road vehicle to execute the control instructions according to the operation sequence set can ensure that the target non-road vehicle timely executes each control instruction, avoiding the situation of vehicle out of control caused by untimely manual operation.

[0056] Figure 5 It is a schematic structural diagram of the mobile terminal provided by an embodiment of the present application. AsFigure 5 As shown, the mobile terminal 11 may include, but is not limited to: a communication module 1001, a memory 1002, a processor 1003, an input / output (I / O) interface 1004, and a bus 1005. The processor 1003 is respectively coupled to the communication module 1001, the memory 1002, and the I / O interface 1004 through the bus 1005.

[0057] The communication module 1001 may include a wired communication module and / or a wireless communication module. The wired communication module may provide one or more of the solutions for wired communication such as Universal Serial Bus (USB), Controller Area Network (CAN), etc. The wireless communication module may provide one or more of the solutions for wireless communication such as Wireless Fidelity (Wi-Fi), Bluetooth (BT), a mobile communication network, Frequency Modulation (FM), near field communication (NFC), Infrared (IR) technology, etc.

[0058] The memory 1002 can be used to store computer-readable instructions and / or modules. The processor 1003 realizes various functions of the mobile terminal 11 by running or executing the computer-readable instructions and / or modules stored in the memory 1002, and by calling the data stored in the memory 1002. The memory 1002 may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created according to the use of the mobile terminal 11. The memory 1002 may include non-volatile and volatile memories, such as: a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, at least one magnetic disk storage device, a flash memory device, or other storage devices.

[0059] The memory 1002 may be an external memory and / or an internal memory of the mobile terminal 11. Further, the memory 1002 may be a memory in physical form, such as a memory stick, a TF card (Trans-flash Card), etc.

[0060] The processor 1003 may be a Central Processing Unit (CPU), or may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The processor 1003 is the operation core and control center of the mobile terminal 11, connecting various parts of the entire mobile terminal 11 through various interfaces and lines, and executing the operating system of the mobile terminal 11 and various installed application programs, program codes, etc.

[0061] Exemplarily, the computer-readable instructions may be divided into one or more modules / sub-modules / units. One or more modules / sub-modules / units are stored in the memory 1002 and executed by the processor 1003 to complete this application. One or more modules / sub-modules / units may be a series of computer-readable instruction segments capable of completing specific functions, and these computer-readable instruction segments are used to describe the execution process of the computer-readable instructions in the mobile terminal 11.

[0062] If the modules / units integrated in the mobile terminal 11 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, to implement all or part of the processes in the above-mentioned embodiment methods of this application, it can also be completed by instructing relevant hardware through computer-readable instructions. The computer-readable instructions can be stored in a computer-readable storage medium. When the computer-readable instructions are executed by the processor, the steps of the above-mentioned various method embodiments can be implemented.

[0063] Among them, the computer-readable instructions include computer-readable instruction codes, and the computer-readable instruction codes may be in the form of source code, object code, executable files, or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer-readable instruction codes, recording media, USB flash drives, mobile hard disks, magnetic disks, optical disks, computer memories, Read-Only Memories (ROMs), Random Access Memories (RAMs).

[0064] The memory 1002 in the mobile terminal 11 stores computer-readable instructions, and the processor 1003 can execute the computer-readable instructions stored in the memory 1002 to implement the non-road vehicle control method in each of the above embodiments. Specifically, the specific implementation method of the processor 1003 for the above computer-readable instructions can refer to the relevant descriptions above and will not be elaborated here.

[0065] The I / O interface 1004 is used to provide a channel for user input or output. For example, the I / O interface 1004 can be used to connect various input and output devices, such as a mouse, a keyboard, a touch device, a display screen, etc., so that the user can input information or visualize information.

[0066] The bus 1005 is at least used to provide a communication channel between the communication module 1001, the memory 1002, the processor 1003, and the I / O interface 1004 in the mobile terminal 11.

[0067] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the mobile terminal 11. In other embodiments of the present application, the mobile terminal 11 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0068] The embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and the method implemented when the program instructions are executed can refer to the non-road vehicle control method in each of the above embodiments of the present application.

[0069] Among them, the computer-readable storage medium may be the internal memory of the mobile terminal described in the above embodiments, such as the hard disk or memory of the mobile terminal. The computer-readable storage medium may also be an external storage device of the mobile terminal, such as a plug-in hard disk equipped on the mobile terminal, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc.

[0070] In some embodiments, the computer-readable storage medium may include a storage program area and a storage data area. Among them, the storage program area may store an operating system, application programs required for at least one function, etc.; the storage data area may store data created according to the use of the mobile terminal.

[0071] In the above embodiments, the descriptions of the respective embodiments have their own focuses. For parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0072] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0073] In the embodiments provided in this application, it should be understood that the disclosed device / terminal device and method can be implemented in other ways. For example, the device / terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0074] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0075] The above-described embodiments are only used to illustrate the technical solutions of this application, rather than to limit it; although this application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included.

Claims

1. A control method for a mobile terminal to control a non-road vehicle, the mobile terminal including a display screen, Characterized in that, The mobile terminal can establish a communication connection with the target non-road vehicle, and the control method includes: When the mobile terminal detects that the user uses the target non-road vehicle, display an operation record control corresponding to the target non-road vehicle on the display screen; In response to a click on the operation record control, record the control instructions generated within a target time interval, where the control instructions are used to control the target non-road vehicle; Generate an operation sequence set according to the recorded control instructions; On the display screen, display a target control corresponding to the operation sequence set; In response to a click on the target control, call the operation sequence set and control the target non-road vehicle to execute the operation instructions in the operation sequence set.

2. The control method according to claim 1, Characterized in that, Before recording the control instructions generated within a target time interval, the control method further includes: Generate a function control corresponding to the function module according to the function module in the target non-road vehicle, and generate the function control on the display screen; When receiving a click on any one of the displayed function controls, generate a control instruction for the any one function module.

3. The control method according to claim 1, Characterized in that, Before recording the control instructions generated within a target time interval, the control method further includes: Determine the moment when the operation record instruction is triggered as the first moment; Determine the second moment to stop recording; Determine the time interval between the first moment and the second moment as the target time interval.

4. The control method according to claim 3, Characterized in that, The determining of the second moment to stop recording includes: Start timing after receiving any control instruction; If the timing time reaches a preset duration and no next control instruction is received within the preset duration, determine the moment when the any control instruction is received as the second moment.

5. The control method according to claim 3, Characterized in that, The determining of the second moment to stop recording includes: In response to a click on the stop control, determine the moment when the stop control is clicked as the second moment; or, In response to input of a preset stop signal, determine the moment when the stop signal is received as the second moment, where the stop signal includes one or more of a voice signal and a gesture signal.

6. The control method according to claim 1, Characterized in that, The recording of the control instructions generated within a target time interval in response to a click on the operation record control includes: In response to a click on the operation record control, determine the user identification corresponding to the user; If the user identification matches the vehicle identification of the target non-road vehicle, record the control instructions generated within the target time interval.

7. The control method according to any one of claims 1 to 6, Characterized in that, The control method further includes: The mobile terminal establishes a communication connection with the radio frequency key of the target non-road vehicle, and the radio frequency key establishes a communication connection with the target non-road vehicle.

8. The control method according to claim 7, wherein, after generating a control instruction for any one of the function modules, the control method further includes: sending the generated control instruction to the radio frequency key, so that the radio frequency key sends the received control instruction to the target non-road vehicle.

9. The control method according to claim 7, wherein, controlling the target non-road vehicle to execute the operation instructions in the operation sequence set includes: sequentially sending the operation instructions in the operation sequence set to the radio frequency key, so that the radio frequency key sends the received operation instructions to the target non-road vehicle.

10. The control method according to claim 1, wherein, the target non-road vehicle includes a signal receiving and converting device, and the control method further includes: when the signal receiving and converting device has a mobile network function, based on the cellular network, sending the control instruction to the signal receiving and converting device, so as to control the target non-road vehicle to perform corresponding actions according to the control instruction.

11. The control method according to claim 1, wherein, after controlling the target non-road vehicle to execute the operation instructions in the operation sequence set, the control method further includes: controlling the target non-road vehicle to turn on the target detection device for detection, so that when the target non-road vehicle detects an obstacle, it stops executing the operation instruction, and based on the target detection device, obtains data information corresponding to the obstacle, and sends the data information to the mobile terminal.

12. The control method according to claim 2, wherein, after generating a function control corresponding to the function module according to the function module in the target non-road vehicle, the control method further includes: when it is detected that any function module is added to the target non-road vehicle, generating a target function control corresponding to the any function module, and displaying the target function control.

13. The control method according to claim 2, wherein, after generating the function control on the display screen, the control method further includes: adjusting the display of the function control based on the setting operation on the function control.

14. A mobile terminal, wherein, the mobile terminal includes a processor and a memory, and the processor is configured to execute a computer program stored in the memory to implement the control method according to any one of claims 1 to 13.

Images