Vehicle interaction method and apparatus, and system, device and storage medium

Abstract

The present application belongs to the technical field of vehicle interaction. Disclosed are a vehicle interaction method and apparatus, and a system, a device and a storage medium. The vehicle interaction method comprises: in response to an interaction instruction sent by a smart remote controller, acquiring orientation information of the smart remote controller; on the basis of the orientation information, determining a target device interacting with the smart remote controller from a plurality of interaction devices of a vehicle; and controlling the target device to respond to the interaction instruction. The present application solves the technical problem of the convenience of interacting with vehicles being relatively poor in the prior art.

Description

Vehicle interaction method, device, system, equipment and storage medium thereof

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on December 5, 2023, with application number 202311660664.6 and application name “Vehicle Interaction Method, Device, System, Equipment and Storage Medium Thereof”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of vehicle interaction technology, and in particular to a vehicle interaction method, apparatus, system, device, and storage medium thereof. Background Art

[0003] Human-computer interaction is an important component in the process of vehicle electrification, networking, intelligence and sharing. How to provide users with a safe and convenient way of interaction has become the main research direction of various companies and institutions in the industry.

[0004] Conventional human-computer interaction methods involve inputting interactive commands through mechanical devices such as levers and buttons, or display touch devices such as touch screens. However, the function of a single button is single, making it difficult to meet the multi-functional interaction requirements of the vehicle. The touch screen is located at the front of the cockpit, making it difficult to meet the interaction needs of rear-seat users, resulting in poor convenience in interacting with the vehicle.

[0005] The above content is only used to assist in understanding the technical solution of this application and does not constitute an admission that the above content is prior art. Summary of the Invention

[0006] The main purpose of this application is to provide a vehicle interaction method, device, system, equipment and storage medium thereof, aiming to solve the technical problem that conventional vehicle interaction methods are less convenient.

[0007] To achieve the above objectives, the present application provides a vehicle interaction method, which includes the following steps:

[0008] Responding to an interaction instruction sent by the smart remote controller, obtaining position information of the smart remote controller;

[0009] Determining, based on the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices in the vehicle;

[0010] The target device is controlled to respond to the interaction instruction.

[0011] Optionally, the smart remote controller is provided with a posture sensor, and the step of obtaining the orientation information of the smart remote controller includes:

[0012] Acquiring posture data collected by the posture sensor;

[0013] According to the posture data, the orientation information and the position information of the intelligent remote controller in the vehicle cabin coordinate system are determined, and the orientation information and the position information are used as the orientation information.

[0014] Optionally, at least one positioning device is respectively provided at the front and rear ends of the smart remote control, and the identification numbers of the positioning devices are different. The step of obtaining the position information of the smart remote control further includes:

[0015] Acquiring coordinate information of each positioning device, wherein the coordinate information encapsulates an identification number of the positioning device;

[0016] Determining, based on the coordinate information, a front point and a rear point of the intelligent remote control in a vehicle cabin coordinate system of the vehicle;

[0017] Taking the rear point as an initial point, a direction ray is generated toward the front point, and the coordinate information and the direction ray are used as the orientation information.

[0018] Optionally, each interactive device is preset with an interactive effective area, and the step of determining a target device for interacting with the intelligent remote control from each interactive device according to the orientation information includes:

[0019] Identifying a direction ray in the orientation information, and determining an interactive device corresponding to the interactive valid area through which the direction ray passes as a valid device;

[0020] The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

[0021] Optionally, the step of determining a target device for interacting with the intelligent remote controller from among the interactive devices according to the position information further includes:

[0022] According to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position;

[0023] Identifying a direction ray in the orientation information, and determining the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas passed by the direction ray;

[0024] The interactive device with the largest number of valid sub-areas is used as the target device.

[0025] Optionally, the step of controlling the target device to respond to the interaction instruction includes:

[0026] Acquire an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device;

[0027] A target key signal in the interaction instruction is acquired, and a target interaction function pointed to by the target key signal is determined according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

[0028] Optionally, after the step of obtaining the position information of the intelligent remote controller, the method further includes:

[0029] If the target device is not identified according to the orientation information, a preset prompt signal is output to prompt the user to adjust the orientation of the intelligent remote controller.

[0030] The present application also provides a vehicle interaction device, the vehicle interaction device comprising:

[0031] an acquisition module, configured to acquire position information of the smart remote controller in response to an interaction instruction sent by the smart remote controller;

[0032] a determination module, configured to determine, based on the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle;

[0033] A control module is used to control the target device to respond to the interaction instruction.

[0034] The present application also provides a vehicle interaction system, the vehicle interaction system comprising an intelligent remote controller and a control terminal, the intelligent remote controller being communicatively connected to the control terminal, and the vehicle interaction system comprising:

[0035] The intelligent remote controller is configured to send interaction instructions to the control terminal in response to user operations;

[0036] The control terminal is used to obtain the orientation information of the smart remote control in response to the interaction instruction sent by the smart remote control; determine the target device that interacts with the smart remote control from multiple interaction devices of the vehicle based on the orientation information; and control the target device to respond to the interaction instruction.

[0037] The present application also provides an electronic device, which includes: a memory, a processor, and a vehicle interaction program stored in the memory and executable on the processor, wherein the vehicle interaction program is configured to implement the steps of the above-mentioned vehicle interaction method.

[0038] The present application also provides a storage medium, which is a computer-readable storage medium. A vehicle interaction program is stored on the computer-readable storage medium. The vehicle interaction program is executed by a processor to implement the steps of the above-mentioned vehicle interaction method.

[0039] The present application discloses a vehicle interaction method, which obtains the orientation information of the smart remote control by responding to the interaction command sent by the smart remote control; then, based on the orientation information of the smart remote control, determines the target device that the user needs to interact with from the numerous interactive devices in the vehicle, and then controls the target device to respond to the interaction command; through the setting of the smart remote control, users at various positions in the vehicle can interact with the interactive devices in the vehicle, thereby improving the convenience of human-vehicle interaction, especially the interaction in multi-person riding scenarios, and can meet the interaction needs of passengers at various positions in the vehicle, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] FIG1 is a schematic diagram of the structure of an electronic device in a hardware operating environment according to an embodiment of the present application;

[0041] FIG2 is a flow chart of a vehicle interaction method according to an embodiment of the present application;

[0042] FIG3 is a schematic diagram of the structure of a smart remote controller according to an embodiment of the present application;

[0043] FIG4 is another schematic diagram of the structure of the smart remote controller according to an embodiment of the present application;

[0044] FIG5 is a schematic diagram of a scenario involved in the second embodiment of the present application;

[0045] FIG6 is a schematic diagram of a scenario involved in the third embodiment of the present application;

[0046] FIG7 is a schematic diagram of another scenario involved in the third embodiment of the present application;

[0047] FIG8 is a schematic diagram of a process involved in a more complete embodiment of the present application;

[0048] FIG9 is a schematic diagram of the framework structure of the vehicle interaction device involved in the embodiment of the present application.

[0049] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0050] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0051] In addition, the descriptions of "first", "second", etc. in this application are for descriptive purposes only and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, "and / or" in the full text includes three solutions. Taking A and / or B as an example, it includes technical solution A, technical solution B, and technical solution that satisfies both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in this field to implement them. When the combination of technical solutions is mutually contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0052] Refer to Figure 1, which is a schematic diagram of the electronic device structure of the hardware operating environment involved in the embodiment of the present application.

[0053] As shown in Figure 1, the electronic device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WI-FI) interface). The memory 1005 may be a high-speed random access memory (RAM) memory, or a stable non-volatile memory (NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0054] Those skilled in the art will appreciate that the structure shown in FIG1 does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0055] As shown in FIG1 , the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module, and a vehicle interaction program.

[0056] In the electronic device shown in FIG1 , the network interface 1004 is primarily used for data communication with other devices; the user interface 1003 is primarily used for data interaction with a user; the processor 1001 and the memory 1005 in the electronic device of the present application may be provided in the electronic device. The electronic device calls the vehicle interaction program stored in the memory 1005 via the processor 1001 and performs the following operations:

[0057] Responding to an interaction instruction sent by the smart remote controller, obtaining position information of the smart remote controller;

[0058] Determining, based on the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices in the vehicle;

[0059] The target device is controlled to respond to the interaction instruction.

[0060] Furthermore, the smart remote controller is provided with a posture sensor, and the operation of obtaining the orientation information of the smart remote controller includes:

[0061] Acquiring posture data collected by the posture sensor;

[0062] According to the posture data, the orientation information and the position information of the intelligent remote controller in the vehicle cabin coordinate system are determined, and the orientation information and the position information are used as the orientation information.

[0063] Furthermore, at least one positioning device is provided at each of the front and rear ends of the smart remote control, and each positioning device has a different identification number. The operation of obtaining the orientation information of the smart remote control further includes:

[0064] Acquiring coordinate information of each positioning device, wherein the coordinate information encapsulates an identification number of the positioning device;

[0065] Determining, based on the coordinate information, a front point and a rear point of the intelligent remote control in a vehicle cabin coordinate system of the vehicle;

[0066] Taking the rear point as an initial point, a direction ray is generated toward the front point, and the coordinate information and the direction ray are used as the orientation information.

[0067] Furthermore, each of the interactive devices is preset with an interactive effective area, and the operation of determining the target device to interact with the smart remote control from each of the interactive devices according to the orientation information includes:

[0068] Identifying a direction ray in the orientation information, and determining an interactive device corresponding to the interactive valid area through which the direction ray passes as a valid device;

[0069] The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

[0070] Furthermore, the operation of determining a target device to interact with the smart remote controller from among the interactive devices based on the position information further includes:

[0071] According to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position;

[0072] Identifying a direction ray in the orientation information, and determining the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas passed by the direction ray;

[0073] The interactive device with the largest number of valid sub-areas is used as the target device.

[0074] Furthermore, the operation of controlling the target device to respond to the interaction instruction includes:

[0075] Acquire an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device;

[0076] A target key signal in the interaction instruction is acquired, and a target interaction function pointed to by the target key signal is determined according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

[0077] Furthermore, the processor 1001 may call the vehicle interaction program stored in the memory 1005 and perform the following operations:

[0078] After the operation of obtaining the position information of the intelligent remote controller, the method further includes:

[0079] If the target device is not identified according to the orientation information, a preset prompt signal is output to prompt the user to adjust the orientation of the intelligent remote controller.

[0080] Based on the above structure, various embodiments of the vehicle interaction method are proposed.

[0081] Refer to FIG. 2 , which is a flow chart of a first embodiment of the vehicle interaction method of the present application.

[0082] In this embodiment, the execution subject of the vehicle interaction method can be an electronic device, which can be a local device, such as the vehicle's central control system, electronic control unit (ECU), etc., or a control terminal, which can be a mobile terminal such as a mobile phone or notebook, or a local device installed on the vehicle, used to respond to interaction instructions sent by a remote control and control various interactive devices on the vehicle; the electronic device can also be a network device, which is not limited in this embodiment. For the sake of convenience, the following description of each embodiment will be omitted. In this embodiment, the vehicle interaction method includes:

[0083] Step S10, in response to the interaction instruction sent by the smart remote controller, obtaining the position information of the smart remote controller;

[0084] In response to the interactive command sent by the intelligent remote control, the position information of the intelligent remote control relative to the vehicle cabin is obtained.

[0085] Optionally, the position information can be obtained from the smart remote control when an interaction command is received; the position information of the smart remote control relative to the vehicle cabin can also be dynamically obtained and stored locally through low-power methods such as background running before the interaction command is received. Then, when the interaction command is received, the position information can be directly retrieved from the background to achieve a timely response to the interaction command.

[0086] Optionally, the vehicle interaction method is applied to a vehicle, and the vehicle includes multiple interactive devices; the interactive devices can be various functional devices provided on the vehicle, such as air conditioning, audio and video entertainment systems, seats, trunk, sunroof, windows, etc., which are not limited in this embodiment; the user can use the smart remote control to send interactive instructions to various interactive devices on the vehicle at any location in the vehicle cabin, so that the human-computer interaction with the various interactive devices in the vehicle is no longer limited to the user's location, and human-computer interaction with the vehicle's interactive devices can be achieved at any location in the vehicle cabin, especially improving the convenience of interaction in multi-person riding scenarios, and can meet the interaction needs of passengers at various positions in the vehicle, thereby enhancing the user experience.

[0087] Optionally, the smart remote control is a device that can send interactive commands. It can be a separate new physical device, or it can be a device that can send interactive commands by adding corresponding software and hardware modules to existing devices (for example, car keys, mobile phones, etc.).

[0088] Exemplarily, referring to FIG. 3 , the smart remote control is a physical device 100 having a plurality of general function buttons, and a plurality of function buttons 110 are provided on the physical device 100 .

[0089] Exemplarily, referring to FIG. 4 , by adding corresponding software and hardware modules to the mobile phone 200 , a virtual button 210 is generated in the mobile phone 200 , and the mobile phone 200 becomes an intelligent remote controller capable of sending interactive commands to various interactive devices in the vehicle.

[0090] Optionally, a vehicle cockpit coordinate system is established with the vehicle cockpit as a reference, and then the coordinate position and posture of the smart remote control in the vehicle cockpit coordinate system, such as steering angle, direction, pitch, etc., are determined and used as orientation information.

[0091] In one feasible implementation, after the step of obtaining the position information of the intelligent remote controller in step S10, the method further includes:

[0092] Step S11: If the target device is not identified according to the orientation information, a preset prompt signal is output to prompt the user to adjust the orientation of the smart remote controller.

[0093] Based on the position information of the smart remote control device in the vehicle cabin, the user's target interaction device (hereinafter referred to as the target device for distinction) is identified; if the target device is not identified based on the position information, it indicates that there are certain problems with the position and posture of the smart remote control when the user uses it, and it is difficult to clearly identify the user's target interaction device through the position information of the smart remote control; then a preset prompt signal is output to prompt the user to adjust the position and posture of the smart remote control.

[0094] Optionally, a prompt signal may be sent to the intelligent remote controller so that the intelligent remote controller responds to the prompt signal, wherein the response manner may be vibration, flashing of a signal light, etc., which is not limited in this embodiment.

[0095] Optionally, if a display device is provided on the smart remote control, the target device can be predicted based on the orientation information, as well as the vehicle's operating information, environmental information, personnel information, etc., and the prediction results can be displayed through the display device of the smart remote control to prompt the user to perform human-computer interaction. The prediction results may include the predicted interactive device and the orientation of the smart remote control that needs to be adjusted to interact with the predicted interactive device.

[0096] In one feasible embodiment, if the target device is not identified based on the position information, feedback is provided according to a preset feedback mechanism. The preset feedback mechanism may include providing feedback through vibration, flashing lights, or outputting a prompt sound on the smart remote controller. Alternatively, no response may be provided as a feedback method, which is not limited in this embodiment.

[0097] In this embodiment, if the target device is not identified based on the orientation information, a preset prompt signal may be output to prompt the user to adjust the orientation of the smart remote controller, thereby achieving human-computer interaction and improving user experience.

[0098] Step S20, determining a target device to interact with the smart remote controller from a plurality of interactive devices of the vehicle according to the position information;

[0099] According to the orientation information of the smart remote controller, a target device for interacting with the smart remote controller is determined from a plurality of interactive devices of the vehicle, wherein the orientation information may include position information and orientation information of the smart remote controller.

[0100] Step S30: controlling the target device to respond to the interaction instruction.

[0101] After determining the target device, the target device is controlled to respond to the interactive command sent by the smart remote control.

[0102] Optionally, if the control terminal is the main control system on the vehicle, after determining the target device, the target device can be controlled to respond to the interactive instructions through the CAN bus (controller area network bus), so that each interactive device on the vehicle can respond to the interactive instructions sent by the intelligent remote control without the additional installation of a command receiving device, thereby reducing the implementation cost of the vehicle interaction method; and the intelligent remote control can interact with any vehicle through the vehicle interaction method.

[0103] In this embodiment, the orientation information of the smart remote control is obtained by responding to the interaction instructions sent by the smart remote control; then, based on the orientation information of the smart remote control, the target device that the user needs to interact with is determined from the numerous interactive devices in the vehicle, and then the target device is controlled to respond to the interaction instructions; through the setting of the smart remote control, users at various positions in the vehicle can interact with the interactive devices in the vehicle, which improves the convenience of human-vehicle interaction, especially the interaction in multi-person scenarios, can meet the interaction needs of passengers at various positions in the vehicle, and enhance the user experience.

[0104] In one feasible implementation, step S30, the step of controlling the target device to respond to the interaction instruction includes:

[0105] Step S31, obtaining an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device;

[0106] An interactive function mapping relationship matching the target device is obtained, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function possessed by the interactive device.

[0107] Optionally, the smart remote control of the present application is a "universal remote control" that sends interactive instructions to any interactive device in the vehicle. The smart remote control is provided with universal function buttons, and corresponding specific function buttons can also be set according to specific interactive devices.

[0108] Step S32: Acquire the target key signal in the interaction instruction, and determine the target interaction function pointed to by the target key signal according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

[0109] Obtain the encapsulated key signal in the interaction instruction (hereinafter referred to as the target key signal for distinction), and determine the target interaction function pointed to by the target key signal based on the interaction function mapping relationship matching the target device, and then control the target device to execute the target interaction function.

[0110] Optionally, the key signal is a key value sent after a key on the intelligent remote controller is triggered.

[0111] Optionally, the interactive function is a function that can be performed by the vehicle's interactive device. For example, if the target interactive device is an air conditioner, the target interactive function may be: increasing or decreasing the air conditioner temperature; if the target interactive device is a seat back, the target interactive function may be adjusting the seat back tilt angle, including increasing or decreasing the tilt angle, etc.

[0112] For example, referring to Figure 3 , the smart remote control has four universal buttons: up, down, left, and right. If the target device is an air conditioner, the user triggers the "up" button on the smart remote control. This then obtains a mapping of air conditioner interaction functions that matches the air conditioner, and determines that the target interaction function pointed to by the target button signal corresponding to the "up" button is "increase the air conditioner temperature." If the target device is a vehicle's central control screen, the user triggers the "up" button on the smart remote control. This then obtains a mapping of central control screen interaction functions that matches the central control screen, and determines that the target interaction function pointed to by the target button signal corresponding to the "up" button is "increase the volume."

[0113] In this embodiment, by obtaining the interactive function mapping relationship matching each interactive device, adaptive control of each interactive device by the universal function buttons of the intelligent remote control is achieved, the application scenarios of the intelligent remote control are increased, and the convenience of human-vehicle interaction, especially interaction in multi-person scenarios, is improved. It can meet the interactive needs of passengers in various positions of the vehicle and enhance the user experience.

[0114] Furthermore, based on the above-mentioned first embodiment, a second embodiment of the vehicle interaction method of the present application is proposed. In this embodiment, step S10 includes:

[0115] Step S12, acquiring posture data collected by the posture sensor;

[0116] Step S13: determining the orientation information and position information of the intelligent remote controller in the vehicle cabin coordinate system according to the posture data, and using the orientation information and the position information as the orientation information.

[0117] The smart remote control is provided with a posture sensor, which obtains the posture data collected by the posture sensor of the smart remote control, and calculates the orientation information and position information of the smart remote control in the vehicle cabin coordinate system based on the posture data, and uses the orientation information and position information as the orientation information of the smart remote control.

[0118] Optionally, the attitude sensor can be an inertial sensor, including a gyroscope and an accelerometer, and then the orientation of the smart remote control is calculated based on the angular velocity sensed by the gyroscope and the acceleration sensed by the accelerometer; and the coordinate data collected by the inertial sensor is used as position information, wherein the coordinate data can be three-dimensional coordinates or two-dimensional coordinates, which is not limited in this embodiment.

[0119] In this embodiment, by obtaining the posture data collected by the posture sensor provided on the smart remote control, the orientation information and position information of the smart remote control in the vehicle cabin coordinate system of the vehicle are determined based on the posture data, and the orientation information and the position information are used as the orientation information to achieve accurate identification of the position and orientation of the smart remote control on the vehicle.

[0120] In one feasible implementation, step S10, the step of obtaining the position information of the intelligent remote controller, further includes:

[0121] Step S14, obtaining coordinate information of each positioning device, wherein the coordinate information encapsulates the identification number of the positioning device;

[0122] At least one positioning device is provided at each of the front and rear ends of the smart remote control, and each positioning device uses a different identification number. Then, based on the positioning device identification number encapsulated in the acquired coordinate information, the source of the coordinate information can be determined to distinguish the front and rear ends of the smart remote control; and then, with the vehicle cabin coordinate system as a reference, the coordinate information collected by the positioning device is obtained; at least two coordinate points are included, and the coordinate points can be three-dimensional coordinate points.

[0123] Optionally, the positioning device can be an antenna, which can be a UWB (Ultra Wide Band) antenna or a Bluetooth antenna. By setting at least one antenna at the front and rear ends of the smart remote control, the front and rear ends of the smart remote control can be determined through multi-antenna technology to determine the direction of the smart remote control.

[0124] Optionally, specific identification numbers can be set in advance for the positioning devices at the front and rear ends of the smart remote control; illustratively, a positioning device is set at the front and rear ends of the smart remote control respectively, and the positioning device is a UWB antenna, that is, the smart remote control includes: a front-end UWB antenna and a rear-end UWB antenna, and then the identification number of the front-end UWB antenna is pre-set to 1, and the identification number of the rear-end UWB antenna is pre-set to 2; after obtaining the coordinate information of each positioning device, the source of the coordinate information can be confirmed by the identification number encapsulated in the coordinate information being 1 or 2.

[0125] Exemplarily, a positioning device is provided at the front and rear ends of the smart remote control respectively, and the positioning device is a Bluetooth antenna, that is, the smart remote control includes: a front-end Bluetooth antenna and a rear-end Bluetooth antenna, and the identification number of the front-end Bluetooth antenna is pre-set to A, and the identification number of the rear-end Bluetooth antenna is pre-set to B; after obtaining the coordinate information of each positioning device, the source of the coordinate information can be confirmed by the identification number A or B encapsulated in the coordinate information.

[0126] Step S15, determining the front point and the rear point of the intelligent remote control in the vehicle cabin coordinate system of the vehicle according to the coordinate information;

[0127] According to the identification number encapsulated in the acquired coordinate information, the front point and the rear point of the intelligent remote control in the vehicle cabin coordinate system are determined.

[0128] Optionally, the front point can be the front end point of the smart remote control, and the rear point can be the rear end point of the smart remote control; the front point can also be the rear end point of the smart remote control, and the rear point can also be the front end point of the smart remote control, which is not limited in this embodiment.

[0129] Step S16: Taking the rear point as the initial point, generating a direction ray toward the front point, and using the coordinate information and the direction ray as the orientation information.

[0130] With the rear point as the initial point, a ray (hereinafter referred to as the direction ray for distinction) is generated in the direction of the front point, and then the coordinate information and the direction ray are used as the orientation information of the intelligent remote control.

[0131] For example, referring to Figure 5, a vehicle cockpit coordinate system is established with the center point of the vehicle cockpit as the origin (it can be a three-dimensional coordinate system or a two-dimensional coordinate system, and this embodiment takes the three-dimensional coordinate system as an example), and UWB anchor points are set at four positions in the vehicle cockpit, namely QA, QB, QC and QD. The dotted squares in Figure 5 are seats in the vehicle cockpit; then, UWB antennas are set at the front and rear ends of the smart remote control, namely Q1 and Q2, respectively, and the coordinate information of Q1 and Q2 is determined by setting UWB anchor points in the vehicle; then, with the rear point Q1 as the initial point, a heading ray is generated in the direction of the front point Q2, and the target device of the smart remote control can be determined by the interactive device in the vehicle through which the heading ray passes.

[0132] In this embodiment, at least one positioning device is installed at each of the front and rear ends of the smart remote control. Each positioning device uses a different identification number. The coordinate information collected by each positioning device is then acquired. Based on the coordinate information, the front and rear points of the smart remote control in the vehicle cabin coordinate system are determined. A heading ray is then generated toward the front point, starting from the rear point. The coordinate information and the heading ray are used as azimuth information. This allows for accurate identification of the smart remote control's position and orientation on the vehicle.

[0133] Furthermore, based on the first and / or second embodiments described above, a third embodiment of the vehicle interaction method of the present application is proposed. In this embodiment, step S20 includes:

[0134] Step S21, identifying a direction ray in the orientation information, and determining an interactive device corresponding to the interactive valid area through which the direction ray passes as a valid device;

[0135] Step S22: The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

[0136] An interaction valid area is pre-set on each interactive device of the vehicle, wherein the effective area can be a surface or body formed by a series of points in the vehicle cabin coordinate system. The surface or body can be a regular surface and / or regular body, or an irregular surface and / or irregular body, which is not limited in this embodiment. Then, the orientation ray in the orientation information is identified, and the interaction valid area passed by the orientation device and the interaction device corresponding to the interaction valid area passed by are determined as the effective device. Then, the distance between each effective device and the initial point of the orientation ray is determined. According to the principle of proximity, the effective device with the shortest distance to the initial point of the orientation ray is used as the target device.

[0137] Optionally, the condition "shortest distance" when determining the target device can be replaced with other conditions as needed. For example, the valid device with the farthest distance from the initial point of the ray or the distance within a preset distance range can be used as the target device. This embodiment does not set this.

[0138] For example, referring to Figure 6, the gray squares are the spatial positions of the interactive devices on the vehicle, and the white squares in each gray square are the preset interactive effective areas in each interactive device; then, the orientation ray in the orientation information of the smart remote control is identified, and it is determined that the interactive devices corresponding to the interactive effective areas passed by the orientation ray include: P1 and P2, and both P1 and P2 are regarded as valid devices; then, it is determined that the valid device with the shortest distance from the initial point of the orientation ray is P1, and then P1 is used as the target device.

[0139] In this embodiment, by pre-setting an interaction effective area in each of the interaction devices, and based on the phenomenon that when using a conventional remote control, the user will subconsciously point the remote control toward the target device, the orientation ray in the orientation information is identified, and the interaction device corresponding to the interaction effective area through which the orientation ray passes is determined as the effective device; and then the effective device with the shortest distance to the initial point of the orientation ray is used as the target device to achieve accurate identification of the target device for interaction with the smart remote control, thereby improving the convenience of human-vehicle interaction, especially the interaction in multi-person scenarios, and can meet the interaction needs of passengers in various positions of the vehicle, thereby enhancing the user experience.

[0140] In one feasible implementation, step S20, the step of determining a target device to interact with the intelligent remote controller from among the interactive devices based on the position information, further includes:

[0141] Step S23: spatially dividing each interactive device of the vehicle into a plurality of sub-areas according to a preset area division rule, wherein the size of the sub-area included in each interactive device increases from the center position of each interactive device to the edge position;

[0142] According to the preset area division rules, that is, the size of the sub-areas contained in each interactive device increases from the center position to the edge position of each interactive device, and the vehicle's interactive devices are spatially divided into multiple sub-areas, wherein the size of each sub-area can be calibrated according to the actual size of each interactive device in the vehicle.

[0143] Optionally, when dividing the sub-areas, each interactive device may divide the sub-areas according to the volume of each interactive device, and the divided sub-areas may include irregular areas and / or regular areas, which is not limited in this embodiment.

[0144] Step S24, identifying the direction ray in the orientation information, and determining the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas that the direction ray passes through;

[0145] The orientation ray in the orientation information is identified, and the sub-area passed by the orientation ray is determined as the valid sub-area, and the number of the valid sub-areas of each interactive device is calculated.

[0146] Step S25 : The interactive device with the largest number of valid sub-areas is used as the target device.

[0147] The interactive device with the largest number of valid sub-areas is used as the target device.

[0148] In one feasible implementation, the difference in the number of valid sub-areas between the interactive device with the largest number of valid sub-areas and the interactive device with the second largest number of valid sub-areas is determined; if the difference in number is within a preset range of difference in number, the device with the shortest distance to the initial point of the ray is further selected as the target device.

[0149] Optionally, the quantity difference range can be set according to actual conditions, and this embodiment does not limit this.

[0150] For example, if a user is sitting directly behind the front passenger seat and wants to adjust the passenger seat backrest's recline using the smart remote control, since there may be other interactive devices directly in front of the passenger seat, such as an air conditioning vent, the system can detect that the difference in the number of effective sub-areas between the air conditioning vent and the passenger seat backrest is within a preset range of differences. The system then selects the passenger seat backrest, which has the shortest distance from the initial point of the orientation ray, as the target device. Furthermore, if the user wants to adjust the air conditioning vent directly in front of the passenger seat while sitting directly behind the passenger seat, they can simply tilt the smart remote control slightly away from the center of the passenger seat backrest to adjust the vent.

[0151] Exemplarily, referring to Figure 7, the dotted square is the vehicle cabin, and the dotted lines are the interactive devices 1 and 2 in the vehicle. Then, according to the preset area division rules, the interactive devices of the vehicle are spatially divided into multiple sub-areas, wherein the size of the sub-areas contained in each of the interactive devices increases from the center position of each of the interactive devices to the edge position; then, the user uses the smart remote control in the direction of the interactive device 1 in the direction of the interactive device 2, and identifies the direction ray of the smart remote control; then, according to the preset area division rules, that is, the size of the sub-areas contained in each of the interactive devices increases from the center position to the edge position of each of the interactive devices; so that the number of effective sub-areas of the interactive device 1 is less than the number of effective sub-areas of the interactive device 2, and the interactive device 2 is determined to be the target device.

[0152] In this embodiment, the vehicle's interactive devices are spatially divided into multiple sub-areas based on preset area division rules, wherein the size of the sub-areas contained in each interactive device increases from the center position of each interactive device to the edge position. Then, the orientation ray in the orientation information is identified, and the number of valid sub-areas in each interactive device is determined, wherein the valid sub-areas are the sub-areas passed by the orientation ray. The interactive device with the largest number of valid sub-areas is then selected as the target device. Based on the user's remote control usage habits, the vehicle's interactive devices are spatially divided into multiple sub-areas, allowing users to interact with the interactive devices from any location in the vehicle cabin. This improves the convenience of human-vehicle interaction, especially in multi-person scenarios, meets the interaction needs of passengers at all locations in the vehicle, and enhances the user experience.

[0153] Furthermore, based on the above-mentioned first, second and / or third embodiments, a more complete embodiment of the vehicle interaction method of the present application is proposed. Referring to Figure 8, the driver and / or passenger enters the vehicle cabin, and the smart remote control is also in the vehicle cabin; then, the driver and / or passenger aims the smart remote control at the interactive device to be controlled according to the interaction needs, and triggers the button on the smart remote control to send an interaction instruction, wherein the interaction instruction encapsulates the button signal; then, the vehicle's central control system identifies the position and orientation of the smart remote control in the vehicle cabin, and starts from the position of the smart remote control along the orientation direction, and according to the proximity principle, the interactive device closest to the position of the smart remote control is used as the target device; at the same time, it is determined whether the target device is found. If not, this operation is ignored; if so, the interaction instruction is sent to the target device through the CAN bus to control the target device to complete this interaction.

[0154] Furthermore, an embodiment of the present application further provides a vehicle interaction system, the vehicle interaction system including an intelligent remote controller and a control terminal, the intelligent remote controller being communicatively connected to the control terminal, and the vehicle interaction system including:

[0155] The intelligent remote controller is used to send interaction instructions to the control terminal in response to user operations.

[0156] Optionally, at least one positioning device is provided at each of the front and rear ends of the intelligent remote controller, and each positioning device has a different identification number.

[0157] The control terminal is used to obtain the orientation information of the smart remote control in response to the interaction instruction sent by the smart remote control; determine the target device that interacts with the smart remote control from multiple interaction devices of the vehicle based on the orientation information; and control the target device to respond to the interaction instruction.

[0158] Optionally, the control terminal is also used to obtain the posture data collected by the posture sensor; determine the orientation information and position information of the intelligent remote control in the vehicle cabin coordinate system of the vehicle based on the posture data, and use the orientation information and the position information as the orientation information.

[0159] Optionally, the control terminal is also used to obtain coordinate information of each of the positioning devices, wherein the coordinate information encapsulates the identification number of the positioning device; based on the coordinate information, determine the front point and the rear point of the intelligent remote control in the vehicle cabin coordinate system of the vehicle; with the rear point as the initial point, generate a direction ray toward the front point, and use the coordinate information and the direction ray as the orientation information.

[0160] Optionally, the control terminal is also used to identify the direction ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the direction ray passes as the effective device; and the effective device with the shortest distance from the initial point of the direction ray is used as the target device.

[0161] Optionally, the control terminal is also used to spatially divide the interactive devices of the vehicle into multiple sub-areas according to preset area division rules, wherein the size of the sub-areas contained in each interactive device increases from the center position of each interactive device to the edge position; identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each interactive device, wherein the valid sub-areas are the sub-areas passed by the orientation ray; and use the interactive device with the largest number of valid sub-areas as the target device.

[0162] Optionally, the control terminal is also used to obtain an interactive function mapping relationship that matches the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote control and an interactive function of the interactive device; obtain the target key signal in the interactive instruction, and determine the target interactive function pointed to by the target key signal based on the interactive function mapping relationship, so as to control the target device to execute the target interactive function.

[0163] Optionally, the control terminal is further configured to output a preset prompt signal to prompt the user to adjust the orientation of the intelligent remote controller if the target device is not identified according to the orientation information.

[0164] Furthermore, an embodiment of the present application further provides a vehicle interaction device. Referring to FIG. 9 , the vehicle interaction device is applied to an electronic device, and the vehicle interaction device includes:

[0165] An acquisition module 10 is configured to acquire position information of the smart remote controller in response to an interaction instruction sent by the smart remote controller;

[0166] a determination module 20 for determining, based on the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle;

[0167] The control module 30 is configured to control the target device to respond to the interaction instruction.

[0168] The acquisition module 10 is further configured to output a preset prompt signal to prompt the user to adjust the orientation of the intelligent remote controller if the target device is not identified according to the orientation information.

[0169] The acquisition module 10 is also used to obtain the posture data collected by the posture sensor; determine the orientation information and position information of the intelligent remote control in the vehicle cabin coordinate system of the vehicle based on the posture data, and use the orientation information and the position information as the orientation information.

[0170] The acquisition module 10 is also used to obtain the coordinate information of each of the positioning devices; based on the coordinate information, determine the front point and the rear point of the intelligent remote control in the vehicle cabin coordinate system of the vehicle; use the rear point as the initial point, generate a direction ray towards the front point, and use the coordinate information and the direction ray as the orientation information.

[0171] The determination module 20 is also used to identify the directional ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the directional ray passes as the effective device; and the effective device with the shortest distance from the initial point of the directional ray is used as the target device.

[0172] The determination module 20 is further used to spatially divide the interactive devices of the vehicle into multiple sub-areas according to a preset area division rule, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position; identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each interactive device, wherein the valid sub-area is the sub-area passed by the orientation ray; and use the interactive device with the largest number of valid sub-areas as the target device.

[0173] The control module 30 is also used to obtain an interactive function mapping relationship that matches the target device, wherein the interactive function mapping relationship is a mapping relationship between the key signal triggered by the intelligent remote control and the interactive function of the interactive device; obtain the target key signal in the interactive instruction, and determine the target interactive function pointed to by the target key signal based on the interactive function mapping relationship, so as to control the target device to execute the target interactive function.

[0174] The specific implementation of the vehicle interaction device of the present application is basically the same as the embodiments of the above-mentioned vehicle interaction method, and will not be repeated here.

[0175] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0176] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0177] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A vehicle interaction method, characterized in that: Applied to a control terminal, the vehicle interaction method comprises the following steps: In response to an interactive instruction sent by the intelligent remote controller, obtaining position information of the intelligent remote controller; Determining, according to the position information, a target device for interacting with the intelligent remote controller from a plurality of interactive devices of the vehicle; The target device is controlled to respond to the interaction instruction.

2. The vehicle interaction method according to claim 1, characterized in that: The smart remote controller is provided with a posture sensor, and the step of obtaining the orientation information of the smart remote controller comprises: Acquiring posture data collected by the posture sensor; According to the posture data, the orientation information and the position information of the intelligent remote controller in the vehicle cabin coordinate system of the vehicle are determined, and the orientation information and the position information are used as the orientation information.

3. The vehicle interaction method according to claim 1, characterized in that: At least one positioning device is respectively disposed at the front and rear ends of the intelligent remote controller, and the identification numbers of the positioning devices are different. The step of obtaining the position information of the intelligent remote controller further includes: Acquire coordinate information of each positioning device, wherein the coordinate information encapsulates an identification number of the positioning device; Determine the front point and the rear point of the intelligent remote controller in the vehicle cockpit coordinate system of the vehicle according to the coordinate information; Taking the rear point as the initial point, a direction ray is generated toward the front point, and the coordinate information and the direction ray are used as the orientation information.

4. The vehicle interaction method according to claim 1, characterized in that: Each of the interactive devices is preset with an interactive effective area, and the step of determining a target device for interacting with the intelligent remote controller from each of the interactive devices according to the orientation information comprises: Identify the direction ray in the orientation information, and determine the interactive device corresponding to the interactive effective area through which the direction ray passes, as a valid device; The valid device with the shortest distance to the initial point of the heading ray is used as the target device.

5. The vehicle interaction method according to claim 1, characterized in that: The step of determining a target device for interacting with the intelligent remote controller from each of the interactive devices according to the position information further includes: According to a preset area division rule, each interactive device of the vehicle is spatially divided into a plurality of sub-areas, wherein the size of the sub-area contained in each interactive device increases from the center position of each interactive device to the edge position; Identify the orientation ray in the orientation information, and determine the number of valid sub-areas in each of the interactive devices, wherein the valid sub-areas are the sub-areas that the orientation ray passes through; The interactive device with the largest number of valid sub-areas is used as the target device.

6. The vehicle interaction method according to claim 1, characterized in that: The step of controlling the target device to respond to the interaction instruction comprises: Acquire an interactive function mapping relationship matching the target device, wherein the interactive function mapping relationship is a mapping relationship between a key signal triggered by the intelligent remote controller and an interactive function of the interactive device; A target key signal in the interaction instruction is acquired, and a target interaction function pointed to by the target key signal is determined according to the interaction function mapping relationship, so as to control the target device to execute the target interaction function.

7. The vehicle interaction method according to any one of claims 1 to 6, characterized in that: After the step of obtaining the position information of the intelligent remote controller, the method further includes: If the target device is not identified according to the position information, a preset prompt signal is output to prompt the user to adjust the position of the intelligent remote controller.

8. A vehicle interaction device, characterized in that: The device comprises: An acquisition module, configured to acquire the position information of the intelligent remote controller in response to an interaction instruction sent by the intelligent remote controller; A determination module, configured to determine, based on the position information, a target device for interacting with the intelligent remote controller from among a plurality of interactive devices of the vehicle; The control module is used to control the target device to respond to the interaction instruction.

9. A vehicle interaction system, characterized in that: The vehicle interaction system includes an intelligent remote controller and a control terminal, wherein the intelligent remote controller is communicatively connected with the control terminal, and the vehicle interaction system includes: The intelligent remote controller is used to send interactive instructions to the control terminal in response to user operations; The control terminal is used to obtain the orientation information of the smart remote control in response to the interaction instruction sent by the smart remote control; determine the target device that interacts with the smart remote control from multiple interaction devices of the vehicle based on the orientation information; and control the target device to respond to the interaction instruction.

10. An electronic device, characterized in that: The device comprises: a memory, a processor, and a vehicle interaction program stored in the memory and executable on the processor, wherein the vehicle interaction program is configured to implement the steps of the vehicle interaction method according to any one of claims 1 to 7.

11. A storage medium, characterized in that: The storage medium stores a vehicle interaction program, and when the vehicle interaction program is executed by the processor, the steps of the vehicle interaction method according to any one of claims 1 to 7 are implemented.

Images