Vehicle control apparatus, system, and method

Abstract

The invention provides a vehicle control device, system and method. The vehicle control device comprises a main control module and an optical sensor connected with the main control module. The optical sensor is used for collecting optical signals generated when the vehicle control equipment moves on the contact surface and transmitting the optical signals to the main control module; the main control module is used for generating cursor operation information for controlling a target interaction interface according to the received optical signal, and sending the cursor operation information to the vehicle host, so that the vehicle host executes a target vehicle function based on the cursor operation information; wherein the optical sensor works in an active illumination mode, and the target interactive interface is an interactive interface displayed by the target vehicle-mounted display screen. According to the technical scheme, the problem that a traditional control mode is highly dependent on the environment can be solved, and the control accuracy is improved; in addition, the vehicle can be effectively controlled only by moving the vehicle control equipment, and operation is convenient and fast.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle control, in particular to a vehicle control device, system and method. BACKGROUND

[0002] With the development of intelligent technology, the vehicle control system gradually tends to be more intelligent and convenient. At present, the gesture control or voice control is usually used to control the in-vehicle device.

[0003] However, the gesture control is easily affected by the light in the vehicle, and the voice control is affected by the noise, that is, the two control methods are strongly dependent on the environment in the vehicle, resulting in poor control accuracy, and the operation efficiency is low in actual use, which is difficult to meet the efficient and convenient operation demand of users. SUMMARY

[0004] Therefore, the embodiments of the present application aim to provide a vehicle control device, system and method to improve the control accuracy and operation convenience.

[0005] In a first aspect, an embodiment of the present application provides a vehicle control device, comprising: a main control module and an optical sensor connected with the main control module; the optical sensor is used to collect an optical signal generated by moving the vehicle control device on a contact surface and transmit the optical signal to the main control module; the main control module is used to generate a cursor operation information for controlling a target interactive interface according to the received optical signal, send the cursor operation information to a vehicle host, and make the vehicle host execute a target vehicle function based on the cursor operation information; wherein the optical sensor works in an active illumination mode, and the target interactive interface is an interactive interface displayed by a target vehicle display screen.

[0006] The embodiments of the present application combine the active illumination optical sensor with the interactive interface of the vehicle display screen, determine the cursor operation signal of the target interactive interface through the optical signal generated by moving the vehicle control device, and determine the target vehicle function to be executed through the target interactive interface and the cursor operation signal. That is, the cursor on the target interactive interface is controlled by moving the vehicle control device, and the vehicle is controlled by using the vehicle control mode of the vehicle display screen. Since the active illumination optical sensor is not affected by the environment, the above control method can overcome the problem that the traditional control method is strongly dependent on the environment, and improve the control accuracy. Moreover, the vehicle can be effectively controlled by moving the vehicle control device only, which is convenient to operate.

[0007] In some implementations of the first aspect, the vehicle control device further includes: an action collection module connected to the master module, configured to collect action information of the target user and send the action information to the master module; and the master module is further configured to send the action information to the vehicle host, so that the vehicle host determines a target vehicle display screen from the multiple vehicle display screens based on the action information, and renders a target interactive interface of the target vehicle display screen based on the cursor operation information after receiving the cursor operation information.

[0008] The action collection module can effectively collect the action information of the target user, thereby improving the accuracy of determining the target vehicle display screen in the scenario where multiple vehicle display screens exist, and avoiding operation errors caused by incorrect display screen selection. In combination with the cursor operation information generated based on the optical signals collected by the optical sensor, accurate and intuitive control of the vehicle function is achieved, and the target user can intuitively see the operation feedback by rendering the target interactive interface, thereby enhancing the operation experience and improving the reliability and convenience of vehicle control.

[0009] In some implementations of the first aspect, the action collection module includes at least one of an image collector, a posture sensor, and an inertial measurement unit.

[0010] The at least one of the image collector, the posture sensor, and the inertial measurement unit is integrated in the vehicle control device, thereby providing different collection methods of the action information of the target user, so as to flexibly and accurately collect the action information.

[0011] In some implementations of the first aspect, the vehicle control device further includes: an information feedback module connected to the master module; and the master module is further configured to receive execution feedback information sent by the vehicle host, generate a prompt instruction based on the execution feedback information, and send the prompt instruction to the information feedback module; and the information feedback module is configured to perform a prompt action based on the received prompt instruction.

[0012] The information feedback module is provided, so that the vehicle control device can timely feed back the execution result to the target user after controlling the vehicle function to be executed. The user does not need to pay attention to the execution state of the vehicle function at all times, and can know whether the vehicle function is accurately executed in time through the prompt action of the information feedback module, thereby greatly improving the convenience of the user using the vehicle.

[0013] In some implementations of the first aspect, the information feedback module includes at least one of a voice broadcast module, a vibration feedback module, an interface display module, and a light prompt module.

[0014] The embodiments of the present application provide feedback for the target user from the aspects of voice, interface display, haptic vibration and light display by configuring different types of information feedback modules, thereby improving the interactivity between the user and the vehicle control device, and meeting the prompt requirements in different driving scenes, so that the target user can accurately obtain the feedback information of the vehicle function execution state in various environments, and the convenience and safety of the user in using the vehicle are further improved.

[0015] With reference to the first aspect, in some implementations of the first aspect, the vehicle control device is a smart wearable device wirelessly connected to the target vehicle.

[0016] The embodiments of the present application design the vehicle control device as a smart wearable device, which is convenient for the user to carry, and can realize diversified vehicle control modes by integrating various function modules, thereby improving the convenience and safety of the user in controlling the vehicle, and making the vehicle control more intelligent and humanized.

[0017] With reference to the first aspect, in some implementations of the first aspect, the smart wearable device is integrated with a proximity sensor connected to the master control module; the proximity sensor is configured to detect distance information between the target user and the smart wearable device, and send the distance information to the master control module; the master control module is further configured to detect whether the target user carries the smart wearable device based on the distance information, and control the smart wearable device to enter a dormant state in the case that the target user does not carry the smart wearable device.

[0018] The embodiments of the present application integrate the proximity sensor in the smart wearable device, and design the dormant mechanism, thereby effectively controlling the energy consumption of the device. In this way, the power consumption of the device in the daily use process is significantly reduced, and the endurance time of the device is greatly prolonged, so that the user can use the device for a longer time without frequent charging, thereby improving the use experience and reducing the inconvenience caused by insufficient power.

[0019] With reference to the first aspect, in some implementations of the first aspect, the smart wearable device is integrated with an identity authentication module connected to the master control module; the identity authentication module is configured to perform an identity authentication operation on the target user carrying the smart wearable device by using the ultra-wideband near field communication technology.

[0020] The embodiments of the present application integrate the identity authentication module in the smart wearable device, and perform the identity authentication by using the ultra-wideband near field communication technology, thereby solving the problems of inconvenient carrying of the physical key, easy loss of the physical key, and network signal limitation of the mobile phone remote control, and improving the accuracy and reliability of the identity authentication. This identity authentication mode improves the convenience and safety of the user in entering the vehicle.

[0021] In a second aspect, the present application provides a vehicle control system, comprising: a vehicle control device; the vehicle control device comprising a master control module and an optical sensor connected to the master control module; the optical sensor is configured to collect an optical signal generated by movement of the vehicle control device on a contact surface and transmit the optical signal to the master control module; the master control module is configured to generate cursor operation information for controlling a target interactive interface according to the received optical signal, and send the cursor operation information to a vehicle host, so that the vehicle host performs a target vehicle function based on the cursor operation information; wherein the optical sensor works in an active illumination mode, and the target interactive interface is an interactive interface displayed by a target vehicle display screen.

[0022] In a third aspect, the present application provides a vehicle control method applied to a vehicle control system, the system comprising a vehicle control device; the vehicle control device comprising a master control module and an optical sensor connected to the master control module; the method comprising: collecting, by the optical sensor, an optical signal generated by movement of the vehicle control device on a contact surface and transmitting the optical signal to the master control module; generating, by the master control module, cursor operation information for controlling a target interactive interface according to the received optical signal, and sending the cursor operation information to a vehicle host, so that the vehicle host performs a target vehicle function based on the cursor operation information; wherein the optical sensor works in an active illumination mode, and the target interactive interface is an interactive interface displayed by a target vehicle display screen.

[0023] It should be understood that the description in this section is not intended to identify key or essential features of embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed in the embodiments will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.

[0025] Figure 1 Fig. 1 shows a structural schematic diagram of a vehicle control device provided by an embodiment of the present application.

[0026] Figure 2 Fig. 2 shows a structural schematic diagram of a smart wearable device provided by an embodiment of the present application.

[0027] Figure 3 Fig. 3 shows a structural schematic diagram of a vehicle control system provided by an embodiment of the present application.

[0028] Figure 4Fig. 1 shows a flowchart of a vehicle control method according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application.

[0030] The terms used in the embodiments of the present application are only for the purpose of describing the specific embodiments, and are not intended to limit the present application. The singular forms "a", "an" and "the" used in the embodiments of the present application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0031] It should be understood that the term "and / or" used herein is only to describe the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " in this paper generally represents that the front and rear associated objects are in an "or" relationship. In addition, the term "according to" used in this paper is not limited to only according to one object, for example, according to A to determine B, which can mean that only A is used to determine B, or part of A is used to determine B.

[0032] It should be noted that in the technical solutions of the present application, the collection, collection, update, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solutions of the present application comply with relevant laws and regulations, are used for legal purposes, and do not violate public order and good customs. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain user personal information security and network security.

[0033] Figure 1 Fig. 1 shows a structure diagram of a vehicle control device according to an embodiment of the present application. As shown in the figure, Figure 1 The vehicle control device 100 includes a main control module 101 and an optical sensor 102 connected to the main control module 101. The optical sensor 102 is used to collect the optical signal generated by the movement of the vehicle control device 100 on the contact surface, and transmit the optical signal to the main control module 101. The main control module 101 is used to generate cursor operation information for controlling the target interactive interface according to the received optical signal, and send the cursor operation information to the vehicle host, so that the vehicle host executes the target vehicle function based on the cursor operation information.

[0034] The optical sensor 102 works in an active illumination mode. For example, the optical sensor 102 working in the active illumination mode includes a laser sensor, an infrared sensor, and the like. Such sensors can work stably under various lighting conditions and ensure that the optical signals collected are accurate.

[0035] The target interactive interface is an interactive interface displayed by a target vehicle display screen. The target vehicle display screen can be a vehicle display screen specified by a target user. For example, the target vehicle display screen can include a center display screen, a co-pilot display screen, a rear entertainment display screen, a ceiling screen, and the like. The target user can specify the target vehicle display screen according to actual needs.

[0036] In actual applications, multiple vehicle display screens are usually provided in a vehicle. The vehicle display screens provide multiple interaction modes such as touch and voice. In addition, by operating the display screen, multiple different vehicle functions can be realized. For example, an air conditioner temperature adjustment control is provided on the display screen. By clicking the control, the air conditioner temperature can be increased or decreased.

[0037] Therefore, by using the above control method of controlling vehicle functions through a display screen, in combination with the vehicle control device provided in the embodiment, a method for effectively controlling vehicle functions without relying on environmental conditions can be provided.

[0038] Specifically, since the optical sensor working in the active illumination mode is integrated in the vehicle control device, the optical sensor can be used as an optical mouse. For example, the optical sensor can be arranged at the bottom of the vehicle control device. When the target user is in the vehicle and needs to adjust the cabin environment, the vehicle control device can be placed on any plane. By watching the interactive interface of the target vehicle display screen, the target user can move the vehicle control device by hand. During the movement, the optical sensor can collect the optical signals of the contact surface. The optical signals are a sequence of micro-texture images of the contact surface captured by the optical sensor frame by frame. The gray scale change between the frames is used to analyze the two-dimensional displacement vector of the device.

[0039] Further, the optical sensor can transmit the optical signals to the main control module. The main control module generates cursor operation information for controlling the target interactive interface by analyzing the received optical signals and sends the cursor operation information to the vehicle host. For example, the cursor operation information is used to reflect the moving direction and the moving position.

[0040] The vehicle host determines the target vehicle function to be executed in combination with the cursor operation information and the content displayed on the target interactive interface after receiving the cursor operation signal. For example, if the roof light control is displayed on the target interactive interface and the cursor operation information indicates that the cursor moves to the control and performs a click operation, the vehicle host can control the roof light in the vehicle to be turned on.

[0041] The embodiment of the present application uses the active illumination optical sensor in combination with the interactive interface of the vehicle display screen, determines the cursor operation signal of the target interactive interface through the optical signal generated by moving the vehicle control device, and determines the target vehicle function to be executed through the target interactive interface and the cursor operation signal. That is, the cursor on the target interactive interface is controlled by moving the vehicle control device, and the vehicle is controlled by using the vehicle control mode of the vehicle display screen. Since the active illumination optical sensor is not affected by the environment, the above control mode can overcome the problem that the traditional control mode is strongly dependent on the environment, and the control accuracy is improved. Moreover, the vehicle can be effectively controlled by moving the vehicle control device only, and the operation is convenient.

[0042] Optionally, in the case where there are multiple vehicle display screens, in order to accurately determine the target display screen, the vehicle control device further comprises: an action acquisition module connected with the master control module, configured to acquire the action information of the target user and send the action information to the master control module; the master control module is further configured to send the action information to the vehicle host, so that the vehicle host determines the target vehicle display screen among the multiple vehicle display screens based on the action information, and renders the target interactive interface of the target vehicle display screen based on the cursor operation information after receiving the cursor operation information.

[0043] The action information includes the pointing action, gesture action or head turning action of the target user, etc.

[0044] Optionally, the action acquisition module comprises at least one of an image collector, a posture sensor and an inertial measurement unit.

[0045] The image collector can capture the action image of the target user; the posture sensor can detect the body posture change of the target user in real time, such as head turning; and the inertial measurement unit can determine the motion acceleration and angular velocity of the target user, etc. The image collector, the posture sensor and the inertial measurement unit can work independently or cooperatively to acquire the action information of the target user. For example, after the image collector captures the gesture action of the target user pointing to a certain direction, the posture sensor and the inertial measurement unit can further detect the amplitude, speed and other detailed information of the action, and send these information to the master control module.

[0046] The embodiment of the present application integrates at least one of an image collector, a posture sensor and an inertial measurement unit in a vehicle control device, thereby providing different acquisition modes of action information of different target users, so as to flexibly and accurately acquire the action information.

[0047] After the action acquisition module acquires the action information, the action information can be sent to the master control module. The master control module can directly forward the action information to the vehicle host, or analyze and process the action information, extract key feature information, update the key feature information as the action information, and then send the updated action information to the vehicle host. After the vehicle host receives the action information, if it is detected that the action information is consistent with the preset target action, the vehicle-mounted display screen corresponding to the target action is determined as the target vehicle-mounted display screen. For example, if the target action is a gesture pointing to the central control display screen, when the vehicle host receives the action information matching the gesture, the central control display screen is determined as the target vehicle-mounted display screen.

[0048] Further, after determining the target vehicle-mounted display screen, the vehicle host continuously listens to the cursor operation information sent by the master control module. In the case of receiving the cursor operation information, in order to enable the target user to intuitively and clearly view the trajectory of the cursor on the target vehicle-mounted display screen, the target interaction interface of the target vehicle-mounted display screen can be rendered based on the cursor operation information, and the rendered target interaction interface can be displayed on the target vehicle-mounted display screen.

[0049] For example, when the target user holds the vehicle control device to move, the master control module generates cursor operation information based on the optical signal collected by the optical sensor and sends it to the vehicle host. After the vehicle host determines that the target vehicle-mounted display screen is the central control display screen, it receives the instruction that the cursor moves a certain distance to the right and clicks as indicated by the cursor operation information. At this time, the vehicle host renders the target interaction interface of the central control display screen based on the cursor operation information, and moves the original position of the cursor to the right on the central control display screen by a corresponding distance and displays the effect after clicking. For example, after the cursor moves, the cursor is displayed on an application icon, and after clicking, the application is opened. The central control display screen will display the interface after the application is opened, so that the target user can intuitively see the effect of operating the vehicle control device, and conveniently and accurately control the vehicle function.

[0050] In addition, a micro laser emitter can also be integrated in the vehicle control device, and by combining the posture sensor, visual auxiliary pointing can be realized to more accurately convey the pointing intention of the target user to the vehicle host and determine the target vehicle-mounted display screen.

[0051] Further, the eye tracking linkage scheme can also be used to determine the target vehicle display screen. Specifically, the eye movement data of the target user is collected, the eye movement data is transmitted to the master control module, the master control module analyzes and processes the eye movement data to determine the line-of-sight focus position of the target user, and then determines the target vehicle display screen that the target user wants to operate. This way can improve the interaction efficiency.

[0052] The action acquisition module of the embodiments of the present application can effectively collect the action information of the target user, thereby improving the accuracy of the target vehicle display screen determination in the scenario where there are multiple vehicle display screens, and avoiding operation errors caused by incorrect display screen selection. At the same time, in combination with the cursor operation information generated by the optical signals collected by the optical sensor, the vehicle functions are accurately and intuitively controlled, the target user can intuitively see the operation feedback through the rendering of the target interaction interface, the operation experience is enhanced, and the reliability and convenience of vehicle control are improved.

[0053] In some embodiments, the vehicle control device further comprises an information feedback module connected with the master control module; the master control module is further configured to receive execution feedback information sent by the vehicle host, and generate a prompt instruction based on the execution feedback information and send it to the information feedback module; and the information feedback module is configured to perform a prompt action based on the received prompt instruction.

[0054] It should be noted that the vehicle host can detect the execution of the vehicle function, and generate execution feedback information after determining that the vehicle function is accurately executed. The execution feedback information is used to prompt that the vehicle function has been executed. Moreover, the execution feedback information can be sent to the master control module.

[0055] For example, when the executed vehicle function is to adjust the air conditioner temperature to a target temperature, the vehicle host generates corresponding execution feedback information when it detects that the air conditioner system has successfully adjusted the temperature to the target temperature. For example, the execution feedback information can be a signal indicating that the air conditioner temperature has been adjusted to the target temperature.

[0056] Further, the master control module receives the execution feedback information sent by the vehicle host, analyzes and processes it, and generates a prompt instruction based on the analysis result. The prompt instruction is used to instruct the information feedback module to perform a corresponding prompt action to inform the target user that the vehicle function has been accurately executed.

[0057] The embodiments of the present application set the information feedback module, so that the vehicle control device can timely feedback the execution result to the target user after controlling the execution of the vehicle function. The user does not need to pay attention to the execution state of the vehicle function at all times, and can know whether the vehicle function is accurately executed in time through the prompt action of the information feedback module, greatly improving the convenience of the user using the vehicle.

[0058] Optionally, the information feedback module comprises at least one of a voice broadcast module, a vibration feedback module, an interface display module, and a light prompt module.

[0059] The voice broadcast module can be a small speaker integrated in the vehicle control device, and the prompt action adopted by the voice broadcast module is voice output. The vibration feedback module can be a micro linear vibration motor integrated in the vehicle control device, and the prompt action adopted by the vibration feedback module is vibration operation. The interface display module can be a display screen installed on the vehicle control device, and the corresponding prompt action is to display prompt text. The light prompt module is a display lamp, and the corresponding prompt action is that the light of the target color brightens or flashes.

[0060] In some embodiments, the vehicle control device can simultaneously integrate the voice broadcast module, the vibration feedback module, the interface display module, and the light prompt module. In this way, a vehicle control device can provide multiple prompt modes to meet the needs of target users for obtaining feedback information in different scenarios.

[0061] Specifically, the main control module selects the most suitable information feedback module for prompting based on the received execution feedback information and the current driving scenario. For example, when the vehicle is passing through a tunnel, the environment is relatively noisy and the light is dim, so it is more appropriate to use the vibration feedback module or the light prompt module. The vibration feedback module generates vibrations of different frequencies and intensities through a micro linear vibration motor to prompt the target user that the vehicle function has been executed; the light prompt module emits light of a specific color or flashes through the display lamp to attract the attention of the target user. When the vehicle is driving normally and the environment is relatively quiet, the voice broadcast module can inform the target user of the execution of the vehicle function in a clear voice. The interface display module is suitable for scenarios that require specific execution feedback information to be displayed, such as displaying text information such as "the air conditioner has been adjusted to the target temperature".

[0062] Further, the vehicle state can also be prompted through the information feedback module. For example, the intelligent wearable device can combine the global positioning system, the motion sensor, and the vehicle state data to realize intelligent functions such as voice car search, abnormal alarm (such as not locking the door), and power reminder, thereby improving safety and convenience.

[0063] The embodiments of the present application provide feedback for target users from the aspects of voice, interface display, tactile vibration, and light display by configuring different categories of information feedback modules, thereby improving the interactivity between users and the vehicle control device. Moreover, the information feedback module can meet the prompt needs in different driving scenarios, ensuring that the target user can accurately obtain feedback information about the execution state of the vehicle function in various environments, thereby further enhancing the convenience and safety of users using the vehicle.

[0064] For the convenience of use and carrying of the vehicle control device, in some embodiments, the vehicle control device is a smart wearable device wirelessly connected with the target vehicle.

[0065] The smart wearable device includes a smart watch, a smart bracelet, a smart ring, an implantable chip, and a smart glass, and the like, which can be worn on the body of the target user. For example, the smart watch is small and light, and the target user can wear it on the wrist. When the target user needs to control the vehicle function, he or she does not need to find and hold other devices, but only needs to operate the smart watch on the wrist.

[0066] In the present embodiment, the smart wearable device can integrate various modules, such as a main control module, a communication module, a sensor, a voice collection module, a voice broadcast module, a display screen, an image collection module, a vibration feedback module, a light prompt module, and a power management module, and the like. By integrating various modules in the smart wearable device, diversified control of the vehicle function can be realized.

[0067] The display screen can be an OLED (Organic Light-Emitting Diode) touch screen, which is used to display state information and provide an interactive interface. The target user can adjust the vehicle function by touching the display screen. For example, when the target user wants to adjust the volume of the music in the vehicle, he or she only needs to find the music control interface on the OLED touch screen of the smart watch, and adjust the volume of the music in the vehicle by sliding or clicking the corresponding volume adjustment control.

[0068] The communication module is responsible for the wireless communication connection between the smart wearable device and the target vehicle, supports Bluetooth, Wi-Fi (Wireless Fidelity), NFC (Near Field Communication), cellular network, and ultra-wideband communication, and is used to establish a secure connection with the vehicle, which can ensure stable connection, accurate positioning, and rapid response between the device and the vehicle.

[0069] The sensor part can provide an array of multiple active illumination optical sensors, and can also integrate an acceleration sensor, a three-axis accelerometer, a gyroscope, a geomagnetic sensor, a radar, an electromyographic sensor, and a proximity sensor, and the like. The acceleration sensor, the three-axis accelerometer, the gyroscope, the geomagnetic sensor, and the radar are used to detect the motion state and attitude of the smart wearable device, and provide more dimensional data support for vehicle control. The electromyographic sensor can recognize the operation intention by detecting the muscle electrical signal of the target user, and thus improve the interaction reliability.

[0070] The voice collection module can collect voice instructions of the target user. The target user only needs to speak corresponding voice instructions, and the intelligent wearable device can collect the voice instructions through the voice collection module, and then realize voice control of vehicle functions. For example, the target user speaks an instruction of "turning on the air conditioner in the vehicle", and the intelligent wearable device identifies the instruction and sends the instruction to the vehicle host through the communication module. After receiving the instruction, the vehicle host controls the air conditioner in the vehicle to start. Or, the intelligent wearable device also performs intelligent functions such as voice car searching and remote starting through the voice collection module.

[0071] The voice broadcast module can be a small speaker. When the vehicle function is executed or relevant information needs to be conveyed to the user, the voice broadcast module can clearly and accurately inform the user through voice.

[0072] The power management module is responsible for power supply and power management of the intelligent wearable device, so as to timely remind the target user to charge. For example, the power management module adopts a rechargeable lithium battery, supports a low-power standby mode, and has a continuous running time of not less than 7 days.

[0073] The image collection module can be a camera. For example, the camera is arranged above the dial of the smart watch, and can capture image information such as facial expressions and gestures of the target user. In combination with an image recognition algorithm, non-contact click recognition is realized.

[0074] The vibration feedback module adopts a micro linear vibration motor, which is used to provide click confirmation, reminders and other tactile feedback. The light prompting module adopts a high-brightness light-emitting diode, which can emit light of different colors and flashing frequencies in different scenes to play a prompting role.

[0075] Further, the vehicle control device can also integrate a touch panel, various physical controls and a brain-computer interface. The touch panel forms a touch area on the vehicle control device, and supports sliding and clicking operations. The physical controls include keys and knobs, which retain part of the mechanical operation structure to meet the needs of blind operation and improve driving safety. The brain-computer interface can be compatible with an intention recognition module based on EEG (Electroencephalogram, electroencephalogram), to realize "thought" level control.

[0076] It should be noted that the intelligent wearable device has good compatibility and expansion capability. It can support connection with different types of vehicles. In addition, an application programming interface can be reserved on the intelligent wearable device to facilitate subsequent expansion to access functions such as smart home and office systems.

[0077] The vehicle control device is designed as an intelligent wearable device in the embodiment of the application. Not only is it convenient for the user to carry, but also it can realize diversified vehicle control modes through integration of various function modules, improve the convenience and safety of the user controlling the vehicle, and make the vehicle control more intelligent and humanized.

[0078] In order to save the power of the smart wearable device and prolong the use time, in some embodiments, the smart wearable device is started only when the target user carries the smart wearable device. Specifically, the smart wearable device is integrated with a proximity sensor connected with a master control module; the proximity sensor is used to detect distance information between the target user and the smart wearable device, and send the distance information to the master control module; the master control module is also used to detect whether the target user carries the smart wearable device based on the distance information, and control the smart wearable device to enter a sleep state when the target user does not carry the smart wearable device.

[0079] The proximity sensor can be an infrared proximity sensor or a capacitive proximity sensor, etc. The infrared proximity sensor judges the distance between the target user and the smart wearable device by emitting infrared rays and detecting the intensity of the reflected infrared rays. The capacitive proximity sensor detects the distance by using the change of the capacitance formed between the target user and the sensor.

[0080] The proximity sensor sends the distance information to the master control module. After receiving the distance information, the master control module analyzes and processes it. The distance threshold is used to determine whether the target user carries the smart wearable device. For example, when the distance value corresponding to the detected distance information is less than the distance threshold, it is determined that the target user carries the smart wearable device, and at this time the smart wearable device remains in a normal working state, and each module operates according to the preset function to respond to the operation instruction of the target user. On the contrary, it is determined that the target user does not carry the smart wearable device. In this case, the master control module sends a control instruction to each module of the smart wearable device to make it enter a sleep state. In the sleep state, the functional modules of the smart wearable device stop working. The proximity sensor can remain in low-frequency operation to wake up the device in time when the target user approaches again.

[0081] The embodiments of the present application realize effective control of the energy consumption of the device by integrating the proximity sensor in the smart wearable device and designing the sleep mechanism. In this way, the power consumption of the device in daily use is significantly reduced, and the endurance time of the device is greatly prolonged, so that the user can use the device for a longer time without frequent charging, improving the use experience and reducing the inconvenience caused by insufficient power.

[0082] Currently, when the driver is ready to enter the vehicle, the target user usually needs to be authenticated by using a physical key or a mobile phone remote control method, and then it is determined whether to open the door. However, the physical key is inconvenient to carry and easy to lose, and once lost, it will also bring safety hazards; and the mobile phone remote control method is easy to be affected by the network signal of the mobile phone, and may not be able to unlock the door in time, which brings inconvenience to the user.

[0083] To solve the problem, the smart wearable device according to the embodiments of the present application is integrated with an identity authentication module connected with a master control module; the identity authentication module is configured to perform an identity authentication operation on a target user carrying the smart wearable device by using an ultra-wideband near field communication technology.

[0084] The ultra-wideband near field communication technology has the advantages of high positioning accuracy and strong anti-interference capability, and the identity authentication by using the technology can ensure the accuracy and reliability of the authentication.

[0085] Specifically, when the target user carrying the smart wearable device integrated with the identity authentication module approaches the vehicle, the identity authentication module communicates with the corresponding receiving device on the vehicle by using the ultra-wideband near field communication technology to complete the identity verification. After the authentication, the target user controls the functions of the vehicle.

[0086] For example, the target user can perform some gesture actions, and the smart wearable device determines whether the target user needs to unlock the vehicle door by recognizing the gesture actions. For example, after completing the identity verification, if the target user makes a hand waving action, the master control module recognizes it as an unlocking instruction, that is, sends an unlocking signal to the vehicle through the wireless communication module to unlock the vehicle door.

[0087] Further, if the authentication fails, the identity authentication module sends an authentication failure signal to the master control module, and the master control module does not perform any operation to control the vehicle after receiving the signal, and can send a prompt of authentication failure to the target user through the voice broadcast module or the vibration feedback module to inform the user that the identity authentication fails and the vehicle cannot be controlled. At the same time, the master control module disconnects the communication between the vehicle and the receiving device to ensure the safety of the vehicle. As can be seen, when the authentication fails, the user can be prompted in time, and the safety of the vehicle is ensured, avoiding the safety hazard of the vehicle. In addition, the identity authentication module can also be linked with other modules in the smart wearable device, such as the voice broadcast module and the vibration feedback module, to provide more rich user feedback and interactive experience.

[0088] The embodiments of the present application integrate the identity authentication module in the smart wearable device, and perform identity authentication by using the ultra-wideband near field communication technology, which not only solves the problems of inconvenient carrying of physical keys, easy loss of physical keys, and network signal limitation of remote control by mobile phones, but also improves the accuracy and reliability of identity authentication. This identity authentication method improves the convenience and safety of user control of the vehicle.

[0089] The embodiments of the vehicle control device are described in detail above, in order to make the technical personnel in the art further clear the technical scheme of the method, the following takes the smart watch as an example of the vehicle control device to explain the form and structure of the vehicle control device.

[0090] Figure 2 Fig. 1 shows a structural schematic diagram of a smart wearable device according to an embodiment of the present application. As shown in Fig. 1, the smart wearable device is a smart watch. Figure 2 As shown in Fig. 1, the smart watch is a modular device worn on the wrist or arm of a target user. The smart watch includes a main body 210 and a watchband 220. The main body 210 integrates a microphone 211, a camera 212 and a sensor 213. The main body 210 also has a built-in master control module, a wireless communication module, a communication module, a voice broadcast module, a display screen, a vibration feedback module, a light prompt module and a power management module, etc.

[0091] It should be noted that in the conventional vehicle control mode, a physical vehicle key is used to unlock the vehicle, a remote controller is used to control the air conditioner or the window, and the vehicle display screen is operated by touch or gesture. Therefore, if the target user wants to control the vehicle door lock, the window, the air conditioner, the light, the ceiling screen and other devices, the target user needs to carry multiple devices, which is prone to loss and complicated operation. The smart watch provided by the present application highly integrates various different functions, which significantly improves the user's convenience and device management efficiency.

[0092] Optionally, based on the smart watch, the implementation process of vehicle control includes: 1. The smart watch is determined to be in a wearing state by a proximity sensor. If the smart watch is not worn, it automatically enters a sleep state to ensure safety.

[0093] 2. If it is detected that the smart watch has been worn, and the non-inductive identity verification is realized by the ultra-wideband near field communication technology, it is ensured that the target user is an authorized user who can perform vehicle control operation.

[0094] 3. After the target user is authenticated, the user information can be obtained by gesture recognition, voice input and touch operation, so as to control the vehicle based on the user information. The user information includes motion information and voice information. In the process of controlling the vehicle by voice input, the current scheme adopts a voice recognition algorithm based on a preset instruction to realize the voice control function. In order to further improve the intelligent level of interaction, pure local voice recognition engine, edge computing gateway mode and introduction of end-side or cloud-side artificial intelligence voice recognition model can be used. The pure local voice recognition engine can guarantee privacy security and is suitable for sensitive scenes; the artificial intelligence voice recognition model adopts an automatic speech recognition system based on a deep neural network.

[0095] a. Gesture recognition mode The arm motion or gesture can be captured by a sensor, for example, waving left or right, and the arm motion is recognized and analyzed by a pointing algorithm to determine the vehicle function to be executed, such as unlocking or locking function. It should be noted that the smart watch can be continuously upgraded by over-the-air technology, so that the smart watch can continuously update and expand various gestures, such as double-finger sliding zoom, etc.

[0096] b、voice input mode The microphone can collect the voice instruction of the target user, and determine the vehicle function to be executed by analyzing the voice instruction.

[0097] c、touch operation mode The touch display screen is used to determine the vehicle function to be executed. For example, the air conditioning temperature adjustment mode or the light control mode is selected by sliding operation.

[0098] 4、The main control module can receive the user information sent by the sensor, the display screen and the microphone, and generate a control instruction based on the user information, and send the control instruction to the vehicle end after encryption by the wireless communication module.

[0099] 5、The vehicle end verifies the legality of the control instruction, and executes the vehicle function corresponding to the control instruction. For example, the vehicle door unlocking and air conditioning starting.

[0100] 6、After executing the vehicle function, the smart watch can feed back the operation result through vibration or voice broadcast mode to realize closed-loop interaction. For example, a short vibration feedback of 0.1 seconds is provided to simulate the real click feeling.

[0101] In addition, in actual application, the vehicle interior contains multiple vehicle display screens, and the vehicle function can also be controlled by triggering the interactive interface displayed by the vehicle display screen. Therefore, when it is not convenient to use voice control mode or gesture control mode to control the vehicle function due to environmental influence, the active illumination optical sensor in the smart watch can be used to control the vehicle display screen by mouse control mode to execute the vehicle function.

[0102] Exemplarily, the optical sensor is installed at the bottom of the smart watch, and the smart watch is placed on the tabletop, seat or other contact surface. The smart watch is moved, the optical information is detected by the optical sensor, and the optical information is sent to the main control module. The main control module converts the optical information into a cursor movement signal and wirelessly transmits it to the target vehicle display screen to control the vehicle function through the vehicle control mode of the target vehicle display screen. The gesture of the target user can also simulate a "mouse left button" event. For example, the target user makes a "tap" action, the camera captures the finger movement trajectory, and the accelerometer data is combined to determine an effective click to trigger a "mouse left button" event.

[0103] In the above manner, any vehicle display screen in the vehicle can be controlled. For example, when the rear passenger uses the smart watch to control the ceiling screen to play a video, the smart watch is moved to control the selection menu item of the ceiling screen, and then the video playing control is realized, without using voice, gesture or traditional remote control mode, thereby improving the operation convenience.

[0104] It is evident that by utilizing pointing algorithms, the optical sensors integrated into smartwatches, and the main control module, "cursor-level precise pointing control" of in-vehicle displays can be achieved. This avoids the problem of poor control accuracy caused by environmental influences when using traditional camera gesture recognition and voice input. Furthermore, it eliminates the need for large-scale limb movements, effectively reducing limb fatigue and making operation more intuitive and effortless.

[0105] Furthermore, in an office environment, a smartwatch can be used as an office mouse. For example, place the smartwatch stably on a desk and use it as a wireless mouse for convenient control of the computer. Thus, whether in an office or traveling setting, smartwatches can play a vital role, significantly improving user convenience and efficiency in various scenarios.

[0106] The smartwatch provided in this application integrates car key, mouse, remote control and voice interaction functions into one, which solves the problem that traditional vehicle control methods have single functions and scattered devices, and cannot meet users' needs for integrated and convenient smart devices. By constructing a vehicle control hub with smart wearable devices as the core, and combining wireless communication technology, voice recognition and multimodal interaction logic, unified control of multiple devices in the vehicle is realized, improving driving safety and the level of cabin intelligence.

[0107] It is worth noting that in the above embodiments of the vehicle control device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0108] Figure 3 The diagram shown is a structural schematic of a vehicle control system provided in an embodiment of this application. Figure 3 As shown, the vehicle control system includes: a vehicle control device 100; the vehicle control device 100 includes a main control module 101 and an optical sensor 102 connected to the main control module 101; the optical sensor 102 is used to collect optical signals generated by the movement of the vehicle control device 100 on the contact surface and transmit the optical signals to the main control module 101; the main control module 101 is used to generate cursor operation information for controlling the target interactive interface according to the received optical signals, and send the cursor operation information to the vehicle host, so that the vehicle host executes the target vehicle function based on the cursor operation information.

[0109] This application combines the optical sensor of active lighting with the interactive interface of the vehicle display screen. By using the optical signal generated by the mobile vehicle control device, the cursor operation signal of the target interactive interface is determined. The target vehicle function to be executed is determined by the target interactive interface and the cursor operation signal. In other words, the cursor on the target interactive interface is controlled by the mobile vehicle control device, and the vehicle is controlled by the vehicle control method of the vehicle display screen. Since the optical sensor of active lighting is not affected by the environment, the above control method can overcome the problem of strong environmental dependence of traditional control methods and improve the accuracy of control. Moreover, effective vehicle control can be achieved solely through the mobile vehicle control device, making operation convenient.

[0110] The above text combined Figure 3 The present application describes in detail the vehicle control system embodiments, which are then discussed below in conjunction with... Figure 4 This application describes in detail embodiments of the vehicle control method. It should be understood that the descriptions of the vehicle control system embodiments correspond to the descriptions of the vehicle control method embodiments; therefore, any parts not described in detail can be found in the preceding method embodiments.

[0111] Figure 4 The diagram shown is a schematic flowchart of a vehicle control method provided in an embodiment of this application. Figure 4 As shown, this is applied to a vehicle control system, which includes a vehicle control device; the vehicle control device includes a main control module and an optical sensor connected to the main control module; the vehicle control method provided in this application embodiment includes: Step S110: The optical signal generated by the movement of the vehicle control device on the contact surface is collected by the optical sensor and transmitted to the main control module.

[0112] In step S120, the main control module generates cursor operation information for controlling the target interactive interface based on the received optical signal, and sends the cursor operation information to the vehicle host, so that the vehicle host can execute the target vehicle function based on the cursor operation information.

[0113] The optical sensor operates using active illumination, and the target interactive interface is the interactive interface displayed on the target vehicle's in-vehicle display screen.

[0114] In one embodiment of this application, the vehicle control device further includes: a motion acquisition module connected to the main control module; the method further includes: The action acquisition module collects the target user's action information and sends the action information to the main control module. The action information is sent to the vehicle host through the master control module, so that the vehicle host determines a target vehicle display screen among multiple vehicle display screens based on the action information, and renders a target interaction interface of the target vehicle display screen based on the cursor operation information after receiving the cursor operation information.

[0115] In an embodiment of the present application, the action acquisition module comprises at least one of an image collector, a posture sensor and an inertial measurement unit.

[0116] In an embodiment of the present application, the vehicle control device further comprises an information feedback module connected with the master control module; and the method further comprises: The execution feedback information sent by the vehicle host is received through the master control module, and prompt instructions are generated based on the execution feedback information and sent to the information feedback module; The prompt action is executed through the information feedback module based on the received prompt instructions.

[0117] In an embodiment of the present application, the information feedback module comprises at least one of a voice broadcast module, a vibration feedback module, an interface display module and a light prompt module.

[0118] In an embodiment of the present application, the vehicle control device is a smart wearable device wirelessly connected with the target vehicle.

[0119] In an embodiment of the present application, the smart wearable device is integrated with a proximity sensor connected with the master control module; and the method further comprises: The distance information between the target user and the smart wearable device is detected through the proximity sensor, and the distance information is sent to the master control module; Whether the target user carries the smart wearable device is detected through the master control module based on the distance information, and the smart wearable device is controlled to enter a dormant state in the case that the target user does not carry the smart wearable device.

[0120] In an embodiment of the present application, the smart wearable device is integrated with an identity authentication module connected with the master control module; and the method further comprises: The identity authentication module is used to perform an identity authentication operation on the target user carrying the smart wearable device by using ultra-wideband near field communication technology.

[0121] The embodiment of the present application combines the active illumination optical sensor with the interactive interface of the vehicle display screen, determines the cursor operation signal of the target interactive interface through the optical signal generated by the movement of the vehicle control device, and determines the target vehicle function to be executed through the target interactive interface and the cursor operation signal. That is, the cursor on the target interactive interface is controlled through the movement of the vehicle control device, and the vehicle is controlled by using the vehicle control mode of the vehicle display screen. Since the active illumination optical sensor is not affected by the environment, the above control mode can overcome the problem that the traditional control mode is strongly dependent on the environment, and the control accuracy is improved. Moreover, the effective control of the vehicle can be realized only by moving the vehicle control device, and the operation is convenient.

[0122] The embodiment of the present application combines the active illumination optical sensor with the interactive interface of the vehicle display screen, determines the cursor operation signal of the target interactive interface through the optical signal generated by the movement of the vehicle control device, and determines the target vehicle function to be executed through the target interactive interface and the cursor operation signal. That is, the cursor on the target interactive interface is controlled through the movement of the vehicle control device, and the vehicle is controlled by using the vehicle control mode of the vehicle display screen. Since the active illumination optical sensor is not affected by the environment, the above control mode can overcome the problem that the traditional control mode is strongly dependent on the environment, and the control accuracy is improved. Moreover, the effective control of the vehicle can be realized only by moving the vehicle control device, and the operation is convenient.

[0123] In addition to the above method and device, the embodiment of the present application can also be a computer program product, which includes computer program instructions, and the computer program instructions make the processor execute the steps in the vehicle control method according to various embodiments of the present application described above in the specification when the processor runs.

[0124] The computer program product can be written in any combination of one or more programming languages to perform the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on the remote computing device, or entirely on the remote computing device or server.

[0125] In addition, the embodiment of the present application can also be a computer readable storage medium, which stores computer program instructions, and the computer program instructions make the processor execute the steps in the vehicle control method according to various embodiments of the present application described above in the specification when the processor runs.

[0126] A computer readable storage medium can have one or more of a plurality of features. A computer readable storage medium can be any media capable of storing information which can be read by a computer. Examples of computer readable storage media include a floppy disk, a zip disk, a magnetic hard disk, a solid state hard disk, a magnetic tape, a compact disc read only memory (CD-ROM), a digital versatile disc (DVD), a Blu-Ray disc, a flash memory, a memory stick, a punch card, a paper tape, an optical disc, a hard-wired circuit, a fiber optic cable, a compact disc read / write (CD-R / W) and the like. A computer readable storage medium can also be any medium that can be used to store or transfer information for use by or in connection with an instruction execution system. A computer readable storage medium can be any a combination of one or more of the above.

[0127] The above description of the disclosed aspects merely exemplifies the general principles of the application. It is intended to be illustrative only since numerous modifications and variations are possible in light of the above teachings without departing from the true spirit and intended scope of the application. It is therefore to be understood that not all variations that are possible are necessarily enumerated or described herein.

[0128] The block diagrams of the devices, apparatuses, systems, etc. involved in the present application are only illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be as shown in the block diagrams. As will be realized by one of ordinary skill in the art, the devices, apparatuses, systems, etc. can be connected, arranged, configured, etc. in any manner. Words such as "include," "contain," "have," etc. are to be construed as open-ended terms meaning "including, but not limited to," and are to be interpreted in the same manner as "comprising" and "comprises." The word "or" as used herein is intended to mean "and / or," unless explicitly stated otherwise. The word "such as" is intended to mean "such as, but not limited to."

[0129] It is also to be noted that the various components or steps can be divided into further components or steps, or combined into fewer components or steps. Such division or combination is to be considered within the scope of the present application.

[0130] The above description of the disclosed aspects is meant to be illustrative only and not limiting as to the scope of the application. Many variations of the disclosed aspects will become apparent to those of ordinary skill in the art upon reading the foregoing description. The foregoing description, therefore, is not to be taken in a limiting sense, and the scope of the application is defined by the following claims.

[0131] The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the application to forms disclosed herein. Although various example aspects and embodiments have been discussed above, those of ordinary skill in the art will appreciate a variety of modifications, alternatives, permutations, additions, and sub-combinations, which fall within the scope of the application.

Claims

1. A vehicle control device, characterized in that, include: The main control module and the optical sensor connected to the main control module; The optical sensor is used to collect the optical signals generated by the movement of the vehicle control device on the contact surface, and transmit the optical signals to the main control module; The main control module is used to generate cursor operation information for controlling the target interactive interface based on the received optical signal, and send the cursor operation information to the vehicle host, so that the vehicle host can execute the target vehicle function based on the cursor operation information. The optical sensor operates using active illumination, and the target interactive interface is the interactive interface displayed on the target vehicle display screen.

2. The vehicle control device according to claim 1, characterized in that, Also includes: The motion acquisition module, connected to the main control module, is used to acquire the motion information of the target user and send the motion information to the main control module. The main control module is also used to send the action information to the vehicle host, so that the vehicle host can determine the target vehicle display screen among multiple vehicle display screens based on the action information, and after receiving the cursor operation information, render the target interactive interface of the target vehicle display screen based on the cursor operation information.

3. The vehicle control device according to claim 2, characterized in that, The motion acquisition module includes at least one of an image acquisition unit, an attitude sensor, and an inertial measurement unit.

4. The vehicle control device according to claim 1, characterized in that, Also includes: The information feedback module is connected to the main control module; The main control module is also used to receive execution feedback information sent by the vehicle host, and generate a prompt instruction based on the execution feedback information and send it to the information feedback module; The information feedback module is used to perform a prompting action based on the received prompting instruction.

5. The vehicle control device according to claim 4, characterized in that, The information feedback module includes at least one of a voice broadcast module, a vibration feedback module, an interface display module, and a light prompt module.

6. The vehicle control device according to claim 1, characterized in that, The vehicle control device is a smart wearable device that is wirelessly connected to the target vehicle.

7. The vehicle control device according to claim 6, characterized in that, The smart wearable device integrates a proximity sensor connected to the main control module; The proximity sensor is used to detect the distance information between the target user and the smart wearable device, and send the distance information to the main control module; The main control module is also used to detect whether the target user is carrying the smart wearable device based on the distance information, and if the target user is not carrying the smart wearable device, control the smart wearable device to enter a sleep state.

8. The vehicle control device according to claim 6, characterized in that, The smart wearable device integrates an identity authentication module connected to the main control module; The identity authentication module is used to perform identity authentication operations on the target user carrying the smart wearable device using ultra-wideband near-field communication technology.

9. A vehicle control system, characterized in that, include: Vehicle control equipment; the vehicle control equipment includes a main control module and optical sensors connected to the main control module; The optical sensor is used to collect the optical signals generated by the movement of the vehicle control device on the contact surface, and transmit the optical signals to the main control module; The main control module is used to generate cursor operation information for controlling the target interactive interface based on the received optical signal, and send the cursor operation information to the vehicle host, so that the vehicle host can execute the target vehicle function based on the cursor operation information. The optical sensor operates using active illumination, and the target interactive interface is the interactive interface displayed on the target vehicle display screen.

10. A vehicle control method, characterized in that, The method is applied to a vehicle control system, the system including a vehicle control device; the vehicle control device including a main control module and an optical sensor connected to the main control module; the method includes: The optical sensor collects the optical signals generated by the movement of the vehicle control device on the contact surface, and transmits the optical signals to the main control module. The main control module generates cursor operation information for controlling the target interactive interface based on the received optical signal, and sends the cursor operation information to the vehicle host, so that the vehicle host can execute the target vehicle function based on the cursor operation information. The optical sensor operates using active illumination, and the target interactive interface is the interactive interface displayed on the target vehicle display screen.

Images