Vehicle interaction method, device, system and equipment and storage medium thereof

Abstract

The invention discloses a vehicle interaction method, device, system and equipment and a storage medium thereof, and belongs to the technical field of vehicle interaction. The vehicle interaction method comprises the following steps: in response to an interaction instruction sent by an intelligent remote controller, obtaining azimuth information of the intelligent remote controller; determining a target device interacting with the intelligent remote controller from a plurality of interaction devices of the vehicle according to the azimuth information; and controlling the target equipment to respond to the interaction instruction. The technical problem of poor convenience of vehicle interaction in the prior art is solved.

Description

Technical Field

[0001] The present application relates to the field of vehicle interaction technology, and in particular to a vehicle interaction method, device, system, equipment and storage medium thereof. Background Art

[0002] Human-computer interaction is an important part of the process of vehicle electrification, networking, intelligence and sharing. How to provide users with a safe and convenient way of interaction has become the main research direction of various companies and institutions in the industry.

[0003] The conventional human-computer interaction method is to input interactive commands through mechanical devices such as levers and buttons, or display touch devices such as touch screens. However, the function of a single button is single, and it is difficult to meet the multi-functional interaction with the vehicle. The touch screen is located at the front of the cockpit, which makes it difficult to meet the interaction needs of rear-seat users, resulting in poor convenience in interacting with the vehicle.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present application is to provide a vehicle interaction method, device, system, equipment and storage medium thereof, aiming to solve the technical problem that conventional vehicle interaction methods are less convenient.

[0006] To achieve the above object, the present application provides a vehicle interaction method, which comprises the following steps:

[0007] In response to an interactive instruction sent by the intelligent remote controller, obtaining position information of the intelligent remote controller;

[0008] Determining, according to the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle;

[0009] The target device is controlled to respond to the interaction instruction.

[0010] Optionally, the smart remote controller is provided with a posture sensor, and the step of obtaining the orientation information of the smart remote controller includes:

[0011] Acquiring posture data collected by the posture sensor;

[0012] According to the posture data, the orientation information and the position information of the intelligent remote controller in the vehicle cabin coordinate system of the vehicle are determined, and the orientation information and the position information are used as the orientation information.

[0013] Optionally, at least one positioning device is respectively disposed at the front and rear ends of the intelligent remote controller, and the identification numbers of the positioning devices are different. The step of obtaining the position information of the intelligent remote controller further includes:

[0014] Acquire coordinate information of each positioning device, wherein the coordinate information encapsulates an identification number of the positioning device;

[0015] Determine the front point and the rear point of the intelligent remote controller in the vehicle cockpit coordinate system of the vehicle according to the coordinate information;

[0016] Taking the rear point as the initial point, a direction ray is generated toward the front point, and the coordinate information and the direction ray are used as the orientation information.

[0017] Optionally, each of the interactive devices is preset with an interactive effective area, and the step of determining a target device for interacting with the intelligent remote controller from each of the interactive devices according to the position information includes:

[0018] Identify the direction ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the direction ray passes, as a valid device;

[0019] The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

[0020] Optionally, the step of determining a target device for interacting with the intelligent remote controller from among the interactive devices according to the position information further includes:

[0021] According to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position;

[0022] Identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas that the orientation ray passes through;

[0023] The interactive device with the largest number of valid sub-areas is used as the target device.

[0024] Optionally, the step of controlling the target device to respond to the interaction instruction includes:

[0025] Acquire an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device;

[0026] A target key signal in the interaction instruction is acquired, and a target interaction function pointed to by the target key signal is determined according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

[0027] Optionally, after the step of obtaining the position information of the intelligent remote controller, the method further includes:

[0028] If the target device is not identified according to the position information, a preset prompt signal is output to prompt the user to adjust the position of the intelligent remote controller.

[0029] The present application also provides a vehicle interaction device, the vehicle interaction device comprising:

[0030] An acquisition module, configured to acquire the position information of the intelligent remote controller in response to an interaction instruction sent by the intelligent remote controller;

[0031] A determination module, configured to determine, based on the position information, a target device for interacting with the intelligent remote controller from among a plurality of interactive devices of the vehicle;

[0032] The control module is used to control the target device to respond to the interaction instruction.

[0033] The present application also provides a vehicle interaction system, the vehicle interaction system comprising an intelligent remote controller and a control terminal, the intelligent remote controller being communicatively connected with the control terminal, and the vehicle interaction system comprising:

[0034] The intelligent remote controller is used to send interactive instructions to the control terminal in response to user operations;

[0035] The control terminal is used to obtain the orientation information of the smart remote control in response to the interaction instruction sent by the smart remote control; determine the target device that interacts with the smart remote control from multiple interaction devices of the vehicle based on the orientation information; and control the target device to respond to the interaction instruction.

[0036] The present application also provides an electronic device, comprising: a memory, a processor, and a vehicle interaction program stored in the memory and executable on the processor, wherein the vehicle interaction program is configured to implement the steps of the above-mentioned vehicle interaction method.

[0037] The present application also provides a storage medium, which is a computer-readable storage medium. A vehicle interaction program is stored on the computer-readable storage medium. The vehicle interaction program is executed by a processor to implement the steps of the above-mentioned vehicle interaction method.

[0038] The present application discloses a vehicle interaction method, which obtains the position information of the intelligent remote control by responding to the interaction command sent by the intelligent remote control; then, according to the position information of the intelligent remote control, determines the target device that the user needs to interact with from the numerous interactive devices in the vehicle, and then controls the target device to respond to the interaction command; through the setting of the intelligent remote control, users at various positions in the vehicle can interact with the interactive devices in the vehicle, which improves the convenience of human-vehicle interaction, especially the interaction in multi-person riding scenarios, can meet the interaction needs of passengers at various positions in the vehicle, and enhances the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of the structure of an electronic device in a hardware operating environment involved in an embodiment of the present application;

[0040] Figure 2 A schematic diagram of a vehicle interaction method according to an embodiment of the present application;

[0041] Figure 3 A schematic diagram of the structure of a smart remote controller involved in an embodiment of the present application;

[0042] Figure 4 Another structural diagram of the smart remote controller involved in the embodiment of the present application;

[0043] Figure 5 This is a schematic diagram of a scenario involved in the second embodiment of the present application;

[0044] Figure 6 A schematic diagram of a scenario involved in the third embodiment of the present application;

[0045] Figure 7 This is another schematic diagram of a scenario involved in the third embodiment of the present application;

[0046] Figure 8 This is a schematic diagram of the process involved in a more complete embodiment of the present application;

[0047] Fig. 9 It is a schematic diagram of the framework structure of the vehicle interaction device involved in the embodiment of the present application.

[0048] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0050] In addition, the descriptions of "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, "and / or" in the full text includes three solutions. Taking A and / or B as an example, it includes technical solution A, technical solution B, and technical solution that satisfies both A and B; in addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in this field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0051] Reference Figure 1 , Figure 1 A schematic diagram of the electronic device structure of the hardware operating environment involved in the embodiment of the present application.

[0052] like Figure 1 As shown, the electronic device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0053] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0054] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module and a vehicle interaction program.

[0055] exist Figure 1 In the electronic device shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the electronic device of the present application can be set in the electronic device, and the electronic device calls the vehicle interaction program stored in the memory 1005 through the processor 1001, and performs the following operations:

[0056] In response to an interactive instruction sent by the intelligent remote controller, obtaining position information of the intelligent remote controller;

[0057] Determining, according to the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle;

[0058] The target device is controlled to respond to the interaction instruction.

[0059] Furthermore, the smart remote controller is provided with a posture sensor, and the operation of obtaining the orientation information of the smart remote controller includes:

[0060] Acquiring posture data collected by the posture sensor;

[0061] According to the posture data, the orientation information and the position information of the intelligent remote controller in the vehicle cabin coordinate system of the vehicle are determined, and the orientation information and the position information are used as the orientation information.

[0062] Furthermore, at least one positioning device is respectively disposed at the front and rear ends of the intelligent remote controller, and the identification numbers of the positioning devices are different. The operation of obtaining the position information of the intelligent remote controller further includes:

[0063] Acquire coordinate information of each positioning device, wherein the coordinate information encapsulates an identification number of the positioning device;

[0064] Determine the front point and the rear point of the intelligent remote controller in the vehicle cockpit coordinate system of the vehicle according to the coordinate information;

[0065] Taking the rear point as the initial point, a direction ray is generated toward the front point, and the coordinate information and the direction ray are used as the orientation information.

[0066] Furthermore, each of the interactive devices is preset with an interactive effective area, and the operation of determining the target device to interact with the intelligent remote controller from each of the interactive devices according to the position information includes:

[0067] Identify the direction ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the direction ray passes, as a valid device;

[0068] The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

[0069] Furthermore, the operation of determining, from among the interactive devices, a target device for interacting with the intelligent remote controller according to the position information, further includes:

[0070] According to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position;

[0071] Identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas that the orientation ray passes through;

[0072] The interactive device with the largest number of valid sub-areas is used as the target device.

[0073] Further, the operation of controlling the target device to respond to the interaction instruction includes:

[0074] Acquire an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device;

[0075] A target key signal in the interaction instruction is acquired, and a target interaction function pointed to by the target key signal is determined according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

[0076] Furthermore, the processor 1001 may call the vehicle interaction program stored in the memory 1005, and further perform the following operations:

[0077] After the operation of obtaining the position information of the intelligent remote controller, the method further includes:

[0078] If the target device is not identified according to the position information, a preset prompt signal is output to prompt the user to adjust the position of the intelligent remote controller.

[0079] Based on the above structure, various embodiments of the vehicle interaction method are proposed.

[0080] Reference Figure 2 , Figure 2 This is a flow chart of the first embodiment of the vehicle interaction method of the present application.

[0081] In this embodiment, the execution subject of the vehicle interaction method can be an electronic device, which can be a local device, such as the vehicle's central control system, an electronic control unit (ECU), etc., or a control terminal, which can be a mobile terminal such as a mobile phone or a notebook, or a local device installed on the vehicle, used to respond to the interaction instructions sent by the remote control and control the various interactive devices on the vehicle; the electronic device can also be a network device, which is not limited in this embodiment. For the sake of convenience, the following description of each embodiment by the execution subject is omitted. In this embodiment, the vehicle interaction method includes:

[0082] Step S10, in response to the interactive command sent by the intelligent remote controller, obtaining the position information of the intelligent remote controller;

[0083] In response to the interactive command sent by the intelligent remote control, the position information of the intelligent remote control relative to the vehicle cabin is obtained.

[0084] Optionally, the position information can be obtained from the smart remote control when an interaction command is received; the position information of the smart remote control relative to the vehicle cabin can also be dynamically obtained and stored locally through low-power methods such as background running before the interaction command is received, and then when the interaction command is received, the position information is directly retrieved from the background to achieve a timely response to the interaction command.

[0085] Optionally, the vehicle interaction method is applied to a vehicle, and the vehicle includes multiple interactive devices; the interactive devices can be various functional devices provided on the vehicle, such as air conditioning, audio and video entertainment systems, seats, trunk, sunroof, windows, etc., which are not limited in this embodiment; the user can use the smart remote control to send interactive instructions to various interactive devices on the vehicle at any location in the vehicle cabin, so that the human-computer interaction with the various interactive devices in the vehicle is no longer limited to the user's location, and the human-computer interaction with the vehicle's interactive devices can be achieved at any location in the vehicle cabin, which especially improves the convenience of interaction in multi-person riding scenarios, can meet the interaction needs of passengers at various positions in the vehicle, and enhances the user experience.

[0086] Optionally, the smart remote control is a device that can send interactive commands. It can be a separate new physical device, or it can be a device that sends interactive commands by adding corresponding software and hardware modules to an existing device (for example, a car key, a mobile phone, etc.).

[0087] For example, refer to Figure 3 The smart remote control is a physical device 100 having a plurality of general function buttons, and a plurality of function buttons 110 are arranged on the physical device 100 .

[0088] For example, refer to Figure 4 By adding corresponding software and hardware modules to the mobile phone 200, a virtual button 210 is generated in the mobile phone 200, and the mobile phone 200 becomes an intelligent remote controller capable of sending interactive commands to various interactive devices in the vehicle.

[0089] Optionally, a vehicle cockpit coordinate system is established with the vehicle cockpit as a reference, and then the coordinate position and posture of the smart remote control in the vehicle cockpit coordinate system, such as steering angle, direction, pitch, etc., are determined and used as orientation information.

[0090] In a feasible implementation manner, after the step of obtaining the position information of the intelligent remote controller in step S10, the method further includes:

[0091] Step S11: If the target device is not identified according to the position information, a preset prompt signal is output to prompt the user to adjust the position of the intelligent remote controller.

[0092] According to the position information of the smart remote control device in the vehicle cabin, the user's target interaction device (hereinafter referred to as the target device for distinction) is identified; if the target device is not identified according to the position information, it indicates that when the user uses the smart remote control, there are certain problems with the position and posture of the smart remote control, and it is difficult to clearly identify the user's target interaction device through the position information of the smart remote control; then a preset prompt signal is output to prompt the user to adjust the position and posture of the smart remote control.

[0093] Optionally, a prompt signal may be sent to the intelligent remote controller so that the intelligent remote controller responds to the prompt signal, wherein the response mode may be vibration, flashing signal light, etc., which is not limited in this embodiment.

[0094] Optionally, if a display device is provided on the smart remote control, the target device can be predicted based on the position information, vehicle operation information, environmental information, personnel information, etc., and the prediction result can be displayed through the display device of the smart remote control to prompt the user to perform human-computer interaction, wherein the prediction result may include the predicted interactive device and the position of the smart remote control that needs to be adjusted to interact with the predicted interactive device.

[0095] In a feasible implementation, if the target device is not identified according to the position information, feedback is provided according to a preset feedback mechanism. The preset feedback mechanism may be feedback through vibration of the smart remote controller, flashing lights, outputting a prompt sound, etc.; or no response may be used as a feedback method, which is not limited in this embodiment.

[0096] In this embodiment, if the target device is not identified based on the position information, a preset prompt signal may be output to prompt the user to adjust the position of the smart remote controller, so as to achieve human-computer interaction and enhance the user experience.

[0097] Step S20, determining a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle according to the position information;

[0098] According to the orientation information of the smart remote controller, a target device for interacting with the smart remote controller is determined from a plurality of interactive devices of the vehicle, wherein the orientation information may include position information and orientation information of the smart remote controller.

[0099] Step S30: controlling the target device to respond to the interaction instruction.

[0100] After the target device is determined, the target device is controlled to respond to the interactive command sent by the smart remote controller.

[0101] Optionally, if the control terminal is a main control system on a vehicle, then after determining the target device, the target device can be controlled to respond to interactive instructions through the CAN bus (controller area network bus), thereby enabling each interactive device on the vehicle to respond to the interactive instructions sent by the intelligent remote control without the need to install an additional instruction receiving device, thereby reducing the implementation cost of the vehicle interaction method; and the intelligent remote control can interact with any vehicle through the vehicle interaction method.

[0102] In this embodiment, the position information of the smart remote control is obtained by responding to the interaction command sent by the smart remote control; then, based on the position information of the smart remote control, the target device that the user needs to interact with is determined from the numerous interactive devices of the vehicle, and then the target device is controlled to respond to the interaction command; through the setting of the smart remote control, users at various positions in the vehicle can interact with the interactive devices in the vehicle, which improves the convenience of human-vehicle interaction, especially the interaction in multi-person scenarios, can meet the interaction needs of passengers at various positions in the vehicle, and enhances the user experience.

[0103] In one feasible implementation, step S30, the step of controlling the target device to respond to the interaction instruction includes:

[0104] Step S31, obtaining an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device;

[0105] An interactive function mapping relationship matching the target device is obtained, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function possessed by the interactive device.

[0106] Optionally, the smart remote control of the present application is a "universal remote control" that sends interactive commands to any interactive device in the vehicle. The smart remote control is provided with universal function buttons, and corresponding specific function buttons can also be set according to specific interactive devices.

[0107] Step S32, acquiring a target key signal in the interaction instruction, and determining a target interaction function pointed to by the target key signal according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

[0108] The encapsulated key signal in the interactive instruction (hereinafter referred to as the target key signal for distinction) is obtained, and the target interactive function pointed to by the target key signal is determined according to the interactive function mapping relationship matching the target device, and then the target device is controlled to execute the target interactive function.

[0109] Optionally, the key signal is a key value sent after a key on the intelligent remote controller is triggered.

[0110] Optionally, the interactive function is a function that can be executed by the vehicle's interactive device. For example, if the target interactive device is an air conditioner, the target interactive function may be: increasing or decreasing the air conditioner temperature; if the target interactive device is a seat back, the target interactive function may be adjusting the seat back tilt angle, including increasing or decreasing the tilt angle, etc.

[0111] For example, refer to Figure 3 , the smart remote controller is provided with four universal buttons: up, down, left and right; if the target device is an air conditioner, the user triggers the "up" button on the smart remote controller; then obtains the mapping relationship of the air conditioner interaction function matching the air conditioner, and determines that the target interaction function pointed to by the target button signal corresponding to the "up" button is: increase the air conditioner temperature. If the target device is the vehicle central control screen, the user triggers the "up" button on the smart remote controller; then obtains the mapping relationship of the central control screen interaction function matching the central control screen, and determines that the target interaction function pointed to by the target button signal corresponding to the "up" button is: increase the volume.

[0112] In this embodiment, by obtaining the interactive function mapping relationship matching each interactive device, adaptive control of each interactive device by the universal function buttons of the intelligent remote control is achieved, the application scenarios of the intelligent remote control are increased, and the convenience of human-vehicle interaction, especially interaction in multi-person scenarios, is improved. It can meet the interactive needs of passengers in various positions of the vehicle and enhance the user experience.

[0113] Further, based on the above first embodiment, a second embodiment of the vehicle interaction method of the present application is proposed. In this embodiment, step S10 includes:

[0114] Step S12, acquiring the posture data collected by the posture sensor;

[0115] Step S13, determining the orientation information and position information of the intelligent remote controller in the vehicle cockpit coordinate system according to the posture data, and using the orientation information and the position information as the orientation information.

[0116] The smart remote control is provided with a posture sensor, which obtains posture data collected by the posture sensor of the smart remote control, and calculates the orientation information and position information of the smart remote control in the vehicle cabin coordinate system based on the posture data, and uses the orientation information and position information as the orientation information of the smart remote control.

[0117] Optionally, the attitude sensor can be an inertial sensor, including a gyroscope and an accelerometer, and then the orientation of the smart remote control is calculated based on the angular velocity sensed by the gyroscope and the acceleration sensed by the accelerometer; and the coordinate data collected by the inertial sensor is used as position information, wherein the coordinate data can be three-dimensional coordinates or two-dimensional coordinates, which is not limited in this embodiment.

[0118] In this embodiment, by acquiring posture data collected by the posture sensor provided on the smart remote control, the orientation information and position information of the smart remote control in the vehicle cabin coordinate system of the vehicle are determined based on the posture data, and the orientation information and the position information are used as the orientation information to achieve accurate identification of the position and orientation of the smart remote control on the vehicle.

[0119] In one feasible implementation, step S10, the step of obtaining the position information of the intelligent remote controller, further includes:

[0120] Step S14, obtaining coordinate information of each positioning device, wherein the coordinate information encapsulates the identification number of the positioning device;

[0121] At least one positioning device is respectively provided at the front and rear ends of the smart remote control, and each positioning device uses a different identification number. Then, according to the positioning device identification number encapsulated in the acquired coordinate information, the source of the coordinate information can be determined to distinguish the front and rear ends of the smart remote control; then, with the vehicle cabin coordinate system as a reference, the coordinate information collected by the positioning device is acquired; at least two coordinate points are included, and the coordinate points can be three-dimensional coordinate points.

[0122] Optionally, the positioning device can be an antenna, which can be a UWB (Ultra Wide Band) antenna or a Bluetooth antenna. By setting at least one antenna at the front and rear ends of the smart remote control, the front and rear ends of the smart remote control can be determined through multi-antenna technology to determine the direction of the smart remote control.

[0123] Optionally, specific identification numbers can be set in advance for the positioning devices at the front and rear ends of the smart remote control; illustratively, a positioning device is set at the front and rear ends of the smart remote control respectively, and the positioning device is a UWB antenna, that is, the smart remote control includes: a front-end UWB antenna and a rear-end UWB antenna, and then the identification number of the front-end UWB antenna is pre-set to 1, and the identification number of the rear-end UWB antenna is pre-set to 2; after obtaining the coordinate information of each positioning device, the source of the coordinate information can be confirmed by the identification number encapsulated in the coordinate information being 1 or 2.

[0124] Exemplarily, a positioning device is respectively provided at the front and rear ends of the smart remote control, and the positioning device is a Bluetooth antenna, that is, the smart remote control includes: a front-end Bluetooth antenna and a rear-end Bluetooth antenna, and the identification number of the front-end Bluetooth antenna is pre-set to A, and the identification number of the rear-end Bluetooth antenna is pre-set to B; after obtaining the coordinate information of each positioning device, the source of the coordinate information can be confirmed through the identification number A or B encapsulated in the coordinate information.

[0125] Step S15, determining the front point and the rear point of the intelligent remote controller in the vehicle cabin coordinate system of the vehicle according to the coordinate information;

[0126] According to the identification number encapsulated in the acquired coordinate information, the front point and the rear point of the intelligent remote control in the vehicle cockpit coordinate system are determined.

[0127] Optionally, the front point may be the front end point of the smart remote controller, and the rear point may be the rear end point of the smart remote controller; the front point may also be the rear end point of the smart remote controller, and the rear point may also be the front end point of the smart remote controller, which is not limited in this embodiment.

[0128] Step S16, taking the rear point as the initial point, generating a direction ray toward the front point, and using the coordinate information and the direction ray as the orientation information.

[0129] With the rear point as the initial point, a ray (hereinafter referred to as the direction ray for distinction) is generated in the direction of the front point, and then the coordinate information and the direction ray are used as the orientation information of the intelligent remote control.

[0130] For example, refer to Figure 5, taking the center point of the vehicle cockpit as the origin, establish a vehicle cockpit coordinate system (which can be a three-dimensional coordinate system or a two-dimensional coordinate system, and this embodiment takes a three-dimensional coordinate system as an example), and set UWB anchor points at four positions in the vehicle cockpit, namely Q A , Q B , Q C and Q D Four o'clock, Figure 5 The dotted square in the middle is the seat in the vehicle cabin; UWB antennas are set at the front and rear ends of the smart remote control, namely Q 1 and Q 2 , and determine Q by setting the UWB anchor point in the vehicle 1 and Q 2 coordinate information; then click Q 1 is the initial point, forward point Q 2 The direction generates a heading ray, and the target device of the intelligent remote control can be determined by the interactive device in the vehicle through which the heading ray passes.

[0131] In this embodiment, at least one positioning device is provided at the front and rear ends of the smart remote controller, and each positioning device uses a different identification number, thereby obtaining the coordinate information collected by each positioning device; and according to the coordinate information, determining the front point and the rear point of the smart remote controller in the vehicle cockpit coordinate system; and then taking the rear point as the initial point, generating a direction ray toward the front point, and using the coordinate information and the direction ray as the orientation information, so as to realize accurate identification of the position and direction of the smart remote controller on the vehicle.

[0132] Further, based on the above-mentioned first and / or second embodiments, a third embodiment of the vehicle interaction method of the present application is proposed. In this embodiment, step S20 includes:

[0133] Step S21, identifying a direction ray in the orientation information, and determining an interactive device corresponding to the interactive effective area through which the direction ray passes as a valid device;

[0134] Step S22: taking the valid device with the shortest distance to the initial point of the directional ray as the target device.

[0135] An interaction effective area is pre-set on each interactive device of the vehicle, wherein the effective area can be a surface or body composed of a series of points in the vehicle cockpit coordinate system, and the surface or body can be a regular surface and / or a regular body, or an irregular surface and / or an irregular body, which is not limited in this embodiment; then the orientation ray in the orientation information is identified, and the interaction effective area passed by the orientation device and the interaction device corresponding to the interaction effective area passed are determined as effective devices. Then the distance between each effective device and the initial point of the orientation ray is determined, and according to the principle of proximity, the effective device with the shortest distance to the initial point of the orientation ray is used as the target device.

[0136] Optionally, the condition "shortest distance" when determining the target device can be replaced with other conditions as needed. For example, the valid device with the farthest distance from the initial point of the ray or the distance within a preset distance range can be used as the target device. This embodiment does not set this.

[0137] For example, refer to Figure 6 , the gray square is the spatial position of the interactive device on the vehicle, and the white square in each gray square is the preset interactive effective area in each interactive device; then the orientation ray in the orientation information of the intelligent remote control is identified, and the interactive devices corresponding to the interactive effective area passed by the orientation ray are determined to include: P 1 and P 2 , P 1 and P 2 All are regarded as effective devices; then the effective device with the shortest distance to the initial point of the ray is determined as P 1 , and then P 1 as the target device.

[0138] In this embodiment, by presetting an interaction effective area in each of the interaction devices, and based on the phenomenon that when using a conventional remote control, the user will subconsciously point the remote control toward the target device, the orientation ray in the orientation information is identified, and the interaction device corresponding to the interaction effective area through which the orientation ray passes is determined as the effective device; then the effective device with the shortest distance to the initial point of the orientation ray is used as the target device to achieve accurate identification of the target device for interacting with the smart remote control, thereby improving the convenience of human-vehicle interaction, especially the interaction in multi-person scenarios, being able to meet the interaction needs of passengers in various positions of the vehicle, and improving the user experience.

[0139] In a feasible implementation manner, step S20, the step of determining a target device to interact with the intelligent remote controller from each of the interactive devices according to the position information, further includes:

[0140] Step S23, according to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position;

[0141] According to the preset area division rules, that is, the size of the sub-areas contained in each interactive device increases from the center position to the edge position of each interactive device, and the vehicle's interactive devices are spatially divided into multiple sub-areas, wherein the size of each sub-area can be calibrated according to the actual size of each interactive device in the vehicle.

[0142] Optionally, when dividing the sub-areas, each interactive device may divide the sub-areas according to the volume of each interactive device, and the divided sub-areas may include irregular areas and / or regular areas, which is not limited in this embodiment.

[0143] Step S24, identifying the orientation ray in the orientation information, and determining the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas that the orientation ray passes through;

[0144] The orientation ray in the orientation information is identified, and the sub-area through which the orientation ray passes is determined as the valid sub-area, and the number of the valid sub-areas of each interactive device is calculated.

[0145] Step S25: taking the interactive device with the largest number of valid sub-areas as the target device.

[0146] The interactive device with the largest number of valid sub-areas is taken as the target device.

[0147] In one feasible implementation, the difference in the number of valid sub-areas between the interactive device having the largest number of valid sub-areas and the interactive device having the second largest number of valid sub-areas is determined; if the difference in number is within a preset range of difference in number, the device with the shortest distance to the initial point of the ray is further selected as the target device.

[0148] Optionally, the quantity difference range can be set according to actual conditions, and this embodiment does not limit this.

[0149] For example, if the user sits directly behind the co-pilot and uses the smart remote controller to adjust the inclination of the co-pilot seat back, because there may be other interactive devices in front of the co-pilot, such as air-conditioning vents; it is possible to identify that the difference in number between the effective sub-areas of the two interactive devices, the air-conditioning vent and the co-pilot seat back, is within the preset difference range; and the device with the shortest distance to the initial point of the orientation ray, i.e., the co-pilot seat back, is used as the target device. At the same time, if the user wants to adjust the air-conditioning vent set in front of the co-pilot from the position directly behind the co-pilot, he only needs to slightly tilt the direction of the smart remote controller so that it slightly deviates from the center position of the co-pilot seat back to adjust the air-conditioning vent.

[0150] For example, refer to Figure 7 , the dashed square is the vehicle cabin, and the dotted lines are the interactive devices 1 and 2 in the vehicle. Then, according to the preset area division rule, the interactive devices of the vehicle are spatially divided into multiple sub-areas, wherein the size of the sub-areas contained in each of the interactive devices increases from the center position to the edge position of each of the interactive devices; then, the user uses the smart remote control in the direction of the interactive device 2 in front of the interactive device 1, and identifies the direction ray of the smart remote control; then, according to the preset area division rule, that is, the size of the sub-areas contained in each of the interactive devices increases from the center position to the edge position of each of the interactive devices; so that the number of effective sub-areas of the interactive device 1 is less than the number of effective sub-areas of the interactive device 2, and then the interactive device 2 is determined to be the target device.

[0151] In this embodiment, the interactive devices of the vehicle are spatially divided into multiple sub-areas according to a preset area division rule, wherein the size of the sub-areas contained in each of the interactive devices increases from the center position to the edge position of each of the interactive devices; then the orientation ray in the orientation information is identified, and the number of valid sub-areas in each of the interactive devices is determined, wherein the valid sub-areas are the sub-areas passed by the orientation ray; then the interactive device with the largest number of valid sub-areas is used as the target device. According to the user's remote control usage habits, the interactive devices of the vehicle are spatially divided into multiple sub-areas, so that the user can realize human-computer interaction with the interactive device at any position in the vehicle cabin, which improves the convenience of human-vehicle interaction, especially interaction in multi-person scenarios, can meet the interaction needs of passengers at various positions in the vehicle, and improve the user experience.

[0152] Further, based on the above-mentioned first, second and / or third embodiments, a more complete embodiment of the vehicle interaction method of the present application is proposed, referring to Figure 8, the driver and / or passenger enters the vehicle cabin, and the smart remote control is also in the vehicle cabin; then the driver and / or passenger, according to the interaction needs, aims the smart remote control at the interactive device to be controlled, and triggers the button on the smart remote control to send the interaction instruction, wherein the interaction instruction encapsulates the button signal; then the central control system of the vehicle identifies the position and orientation of the smart remote control in the vehicle cabin, and starts from the position of the smart remote control along the orientation direction, and according to the proximity principle, the interactive device closest to the position of the smart remote control is used as the target device; at the same time, it is determined whether the target device is found, if not, this operation is ignored; if so, the interaction instruction is sent to the target device through the CAN bus to control the target device to complete this interaction.

[0153] Furthermore, an embodiment of the present application also provides a vehicle interaction system, the vehicle interaction system comprising an intelligent remote controller and a control terminal, the intelligent remote controller being communicatively connected with the control terminal, and the vehicle interaction system comprising:

[0154] The intelligent remote controller is used to send interactive instructions to the control terminal in response to user operations.

[0155] Optionally, at least one positioning device is respectively provided at the front and rear ends of the intelligent remote controller, and the identification numbers of the positioning devices are different.

[0156] The control terminal is used to obtain the orientation information of the smart remote control in response to the interaction instruction sent by the smart remote control; determine the target device that interacts with the smart remote control from multiple interaction devices of the vehicle based on the orientation information; and control the target device to respond to the interaction instruction.

[0157] Optionally, the control terminal is also used to obtain posture data collected by the posture sensor; determine the orientation information and position information of the intelligent remote control in the vehicle cabin coordinate system of the vehicle based on the posture data, and use the orientation information and the position information as the orientation information.

[0158] Optionally, the control terminal is also used to obtain coordinate information of each of the positioning devices, wherein the coordinate information encapsulates an identification number of the positioning device; based on the coordinate information, determine the front point and the rear point of the intelligent remote control in the vehicle cabin coordinate system of the vehicle; take the rear point as the initial point, generate a direction ray toward the front point, and use the coordinate information and the direction ray as the orientation information.

[0159] Optionally, the control terminal is also used to identify the direction ray in the orientation information, and determine the interactive device corresponding to the interactive effective area passed by the direction ray as the effective device; and the effective device with the shortest distance to the initial point of the direction ray is used as the target device.

[0160] Optionally, the control terminal is also used to spatially divide the interactive devices of the vehicle into multiple sub-areas according to preset area division rules, wherein the size of the sub-areas contained in each interactive device increases from the center position to the edge position of each interactive device; identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each interactive device, wherein the valid sub-areas are the sub-areas passed by the orientation ray; and select the interactive device with the largest number of valid sub-areas as the target device.

[0161] Optionally, the control terminal is also used to obtain an interactive function mapping relationship that matches the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote control and an interactive function of the interactive device; obtain the target key signal in the interactive instruction, and determine the target interactive function pointed to by the target key signal based on the interactive function mapping relationship, so as to control the target device to execute the target interactive function.

[0162] Optionally, the control terminal is further configured to output a preset prompt signal to prompt the user to adjust the orientation of the intelligent remote controller if the target device is not identified according to the orientation information.

[0163] Furthermore, the embodiment of the present application also provides a vehicle interaction device, referring to Fig. 9 The vehicle interaction device is applied to an electronic device, and the vehicle interaction device comprises:

[0164] The acquisition module 10 is used to obtain the position information of the intelligent remote controller in response to the interaction command sent by the intelligent remote controller;

[0165] A determination module 20, configured to determine a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle according to the position information;

[0166] The control module 30 is used to control the target device to respond to the interaction instruction.

[0167] The acquisition module 10 is further configured to output a preset prompt signal to prompt the user to adjust the orientation of the intelligent remote controller if the target device is not identified according to the orientation information.

[0168] The acquisition module 10 is also used to acquire the posture data collected by the posture sensor; determine the orientation information and position information of the intelligent remote control in the vehicle cabin coordinate system of the vehicle based on the posture data, and use the orientation information and the position information as the orientation information.

[0169] The acquisition module 10 is also used to obtain the coordinate information of each of the positioning devices; determine the front point and the rear point of the intelligent remote control in the vehicle cabin coordinate system of the vehicle based on the coordinate information; use the rear point as the initial point, generate a direction ray toward the front point, and use the coordinate information and the direction ray as the orientation information.

[0170] The determination module 20 is also used to identify the orientation ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the orientation ray passes as a valid device; and the valid device with the shortest distance to the initial point of the orientation ray is used as the target device.

[0171] The determination module 20 is further used to spatially divide the interaction devices of the vehicle into multiple sub-areas according to a preset area division rule, wherein the size of the sub-areas contained in each interaction device increases from the center position to the edge position of each interaction device; identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each interaction device, wherein the valid sub-areas are the sub-areas passed by the orientation ray; and select the interaction device with the largest number of valid sub-areas as the target device.

[0172] The control module 30 is also used to obtain an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote control and an interactive function of the interactive device; obtain a target key signal in the interactive instruction, and determine the target interactive function pointed to by the target key signal based on the interactive function mapping relationship, so as to control the target device to execute the target interactive function.

[0173] The specific implementation of the vehicle interaction device of the present application is basically the same as the various embodiments of the above-mentioned vehicle interaction method, and will not be repeated here.

[0174] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0175] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0176] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A vehicle interaction method, It is characterized in that Applied to a control terminal, the vehicle interaction method comprises the following steps: In response to an interactive instruction sent by the intelligent remote controller, obtaining position information of the intelligent remote controller; Determining, according to the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle; The target device is controlled to respond to the interaction instruction.

2. The vehicle interaction method according to claim 1, It is characterized in that The smart remote controller is provided with a posture sensor, and the step of obtaining the orientation information of the smart remote controller comprises: Acquiring posture data collected by the posture sensor; According to the posture data, the orientation information and the position information of the intelligent remote controller in the vehicle cabin coordinate system of the vehicle are determined, and the orientation information and the position information are used as the orientation information.

3. The vehicle interaction method according to claim 1, It is characterized in that At least one positioning device is respectively disposed at the front and rear ends of the intelligent remote controller, and the identification numbers of the positioning devices are different. The step of obtaining the position information of the intelligent remote controller further includes: Acquire coordinate information of each positioning device, wherein the coordinate information encapsulates an identification number of the positioning device; Determine the front point and the rear point of the intelligent remote controller in the vehicle cockpit coordinate system of the vehicle according to the coordinate information; Taking the rear point as the initial point, a direction ray is generated toward the front point, and the coordinate information and the direction ray are used as the orientation information.

4. The vehicle interaction method according to claim 1, It is characterized in that Each of the interactive devices is preset with an interactive effective area, and the step of determining a target device for interacting with the intelligent remote controller from each of the interactive devices according to the orientation information comprises: Identify the direction ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the direction ray passes, as a valid device; The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

5. The vehicle interaction method according to claim 1, It is characterized in that The step of determining a target device for interacting with the intelligent remote controller from each of the interactive devices according to the position information further includes: According to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position; Identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas that the orientation ray passes through; The interactive device with the largest number of valid sub-areas is used as the target device.

6. The vehicle interaction method according to claim 1, It is characterized in that The step of controlling the target device to respond to the interaction instruction comprises: Acquire an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device; A target key signal in the interaction instruction is acquired, and a target interaction function pointed to by the target key signal is determined according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

7. The vehicle interaction method according to any one of claims 1 to 6, It is characterized in that After the step of obtaining the position information of the intelligent remote controller, the method further includes: If the target device is not identified according to the position information, a preset prompt signal is output to prompt the user to adjust the position of the intelligent remote controller.

8. A vehicle interaction device, It is characterized in that The device comprises: An acquisition module, configured to acquire the position information of the intelligent remote controller in response to an interaction instruction sent by the intelligent remote controller; A determination module, configured to determine, based on the position information, a target device for interacting with the intelligent remote controller from among a plurality of interactive devices of the vehicle; The control module is used to control the target device to respond to the interaction instruction.

9. A vehicle interaction system, It is characterized in that The vehicle interaction system includes an intelligent remote controller and a control terminal, wherein the intelligent remote controller is communicatively connected with the control terminal, and the vehicle interaction system includes: The intelligent remote controller is used to send interactive instructions to the control terminal in response to user operations; The control terminal is used to obtain the orientation information of the smart remote control in response to the interaction instruction sent by the smart remote control; determine the target device that interacts with the smart remote control from multiple interaction devices of the vehicle based on the orientation information; and control the target device to respond to the interaction instruction.

10. An electronic device, It is characterized in that The device comprises: a memory, a processor, and a vehicle interaction program stored in the memory and executable on the processor, wherein the vehicle interaction program is configured to implement the steps of the vehicle interaction method according to any one of claims 1 to 7.

11. A storage medium, It is characterized in that The storage medium stores a vehicle interaction program, and when the vehicle interaction program is executed by the processor, the steps of the vehicle interaction method according to any one of claims 1 to 7 are implemented.

Images