Vehicle interaction device identification method and system, storage medium and intelligent remote controller

Abstract

The application discloses a vehicle interaction device identification method and system, a storage medium and an intelligent remote controller, and belongs to the technical field of vehicle interaction. The vehicle interaction device identification method comprises the following steps: in response to an interaction instruction sent by an intelligent remote controller, a target direction of the intelligent remote controller and a target operation area in a vehicle are determined respectively; according to a preset mapping relationship between operation areas and device areas in the vehicle, an effective device area of the intelligent remote controller in the target operation area is matched; according to the target direction, the target device area of the intelligent remote controller is determined from the effective device area; an interaction device in the target device area is taken as a target device, and the target device is controlled to respond to the interaction instruction. The application solves the technical problem that the recognition accuracy of an interaction device on a vehicle is low in the prior art.

Description

Technical Field

[0001] This application relates to the field of vehicle interaction technology, and in particular to a method, system, storage medium, and smart remote control for identifying vehicle interaction devices. Background Technology

[0002] With the development of vehicle technology, people have put forward higher requirements for the convenience and interactivity of vehicles; therefore, how to provide users with safe and convenient interaction methods has become the main research direction of enterprises and institutions in the industry.

[0003] The conventional way to interact with a device is to set up an infrared remote control and then send infrared commands through the remote control to interact with it. However, this method requires an infrared receiver to be installed on the device side. In addition, if there are people or other obstructions in the direction in which the remote control sends commands, it is difficult to accurately identify the target interactive device, resulting in low accuracy in identifying the interactive device.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this application is to provide a method, system, storage medium, and smart remote control for identifying vehicle interactive devices, aiming to solve the technical problem of low accuracy in identifying interactive devices on vehicles using conventional methods.

[0006] To achieve the above objectives, this application provides a method for identifying a vehicle interaction device, the method comprising the following steps: In response to the interactive commands sent by the smart remote control, the target orientation of the smart remote control and its target operating area in the vehicle are determined respectively; Based on the preset mapping relationship between the operating area and the device area in the vehicle, the effective device area of ​​the smart remote control in the target operating area is matched and obtained; The target device area of ​​the smart remote control is determined from the effective device area based on the target orientation; The interactive device in the target device area is designated as the target device, and the target device is controlled to respond to the interactive command.

[0007] Optionally, prior to the step of responding to an interactive command sent by the smart remote control, the method further includes: Identify interactive devices in the vehicle; Based on the spatial location of each interactive device in the vehicle, the vehicle is divided into device areas to obtain multiple device areas.

[0008] Optionally, after the step of dividing the vehicle into device areas based on the spatial location of each interactive device in the vehicle to obtain multiple device areas, the method further includes: Identify the window area and rearview mirror area within the device area; Determine the maximum overlap between the window area and the rearview mirror area projected in a first preset direction, wherein the first preset direction is the direction from the vehicle cabin toward the outside of the vehicle; The window area is corrected based on the maximum overlap to prevent the window area from obstructing the rearview mirror area.

[0009] Optionally, the equipment area of ​​the vehicle includes one or more of the following: multimedia area, air conditioning area, rearview mirror area, glove box area, ambient lighting area, reading light area, sunroof area, seat area, window area and trunk area.

[0010] Optionally, the operating area of ​​the vehicle includes one or more of the following: the driver's operating area, the co-driver's operating area, and the passenger operating area.

[0011] Optionally, the step of determining the target device area of ​​the smart remote control from the effective device area based on the target orientation includes: Generate a first orientation ray based on the target orientation; The effective device area that is traversed by the first directional ray and has the shortest distance to the starting point of the first directional ray is defined as the target device area.

[0012] Optionally, before the step of generating the orientation ray based on the target orientation, the method further includes: Determine whether the target orientation is consistent with the preset seat adjustment direction; If not, then proceed to the step of generating a first orientation ray based on the target orientation; If so, when the smart remote control is located in the seat adjustment area of ​​the target operating area, it extends bidirectionally based on the target orientation to generate two second orientation rays, and the starting points of the two second orientation rays are the same. The effective device area that is traversed by the second directional ray and has the shortest distance to the starting point of the second directional ray is defined as the target device area.

[0013] Optionally, at least one positioning device is provided at each of the front and rear ends of the smart remote control, and each positioning device has a different identification number. The step of determining the target orientation of the smart remote control and its target operating area in the vehicle includes: Obtain the coordinate information of each of the positioning devices, wherein the coordinate information encapsulates the identification number of the positioning device; Based on the coordinate information, the target operating area where the smart remote control is located is determined; Based on the coordinate information, the front and rear points of the smart remote control are determined, and the direction from the rear point to the front point is taken as the target orientation.

[0014] This application also provides a vehicle interaction device identification system, the vehicle interaction device identification system including a smart remote controller and a control terminal, the smart remote controller being communicatively connected to the control terminal, the vehicle interaction device identification system including: The intelligent remote control is used to send interactive commands to the control terminal in response to user operations; The control terminal is configured to respond to interactive commands sent by the smart remote control, determine the target orientation of the smart remote control and the target operating area in the vehicle; match the valid device area of ​​the smart remote control in the target operating area according to a preset mapping relationship between operating areas and device areas in the vehicle; determine the target device area of ​​the smart remote control from the valid device area according to the target orientation; take the interactive device in the target device area as the target device, and control the target device to respond to the interactive commands.

[0015] This application also provides a smart remote control, which includes: a memory, a processor, and a vehicle interaction device identification program stored in the memory and executable on the processor, wherein the vehicle interaction device identification program is configured to implement the steps of the above-described vehicle interaction device identification method.

[0016] This application also provides a storage medium, which is a computer-readable storage medium, storing a vehicle interaction device identification program thereon, which is executed by a processor to implement the steps of the vehicle interaction device identification method described above.

[0017] This application discloses a method for identifying vehicle interactive devices. By responding to interactive commands sent by a smart remote control, the method determines the target orientation and target operating area of ​​the smart remote control within the vehicle. Then, based on a preset mapping relationship between operating areas and device areas in the vehicle, it matches the effective device area of ​​the smart remote control within the target operating area. Based on the target orientation, it determines the target device area of ​​the smart remote control from the effective device area. The interactive device within the target device area is then used as the target device, and the target device is controlled to respond to the interactive commands. By setting up the smart remote control, users in various locations within the vehicle can interact with the interactive devices in the vehicle, improving human-vehicle interaction, especially in multi-passenger scenarios, and meeting the interaction needs of passengers in different locations, thus enhancing the user experience. Furthermore, by pre-dividing the vehicle into spatial areas, it obtains the device areas of each interactive device (e.g., air conditioning, windows, multimedia devices) and the user's operating area. Then, based on a preset mapping relationship between operating areas and device areas in the vehicle, it matches the effective device area of ​​the smart remote control within the target operating area. It restricts the controllable interactive devices of the smart remote control located in different operating areas of the vehicle to prevent, for example, passengers from... This system addresses situations where smart remote controls can interfere with vehicle rearview mirrors, potentially leading to traffic accidents. It aims to ensure driving safety while meeting user interaction needs. Furthermore, it determines the target device area based on the orientation of the smart remote control, enabling accurate identification of the target device from multiple interactive devices within the vehicle. Identifying the target device based on the orientation of the smart remote control when sending interaction commands avoids identification failures caused by passengers or other obstructions blocking infrared or other light signals, thus improving the accuracy of vehicle interactive device identification. Through interaction between the control terminal and the smart remote control, it eliminates the need for separate command receivers on each interactive device in the vehicle, reducing implementation costs. Attached Figure Description

[0018] Figure 1 This is a schematic diagram of the structure of a smart remote control for the hardware operating environment involved in the embodiments of this application; Figure 2 This is a flowchart illustrating the vehicle interaction device identification method according to the embodiments of this application; Figure 3 This is a schematic diagram of a scenario involving the first embodiment of the present application; Figure 4 This is a schematic diagram of the equipment area involved in the second embodiment of this application; Figure 5 This is a schematic diagram of the projection overlap scene involved in the second embodiment of this application; Figure 6This is a schematic diagram of an operating area involved in the second embodiment of this application; Figure 7 This is a schematic diagram of another operating area involved in the second embodiment of this application; Figure 8 This is a schematic diagram of a scenario involving the solution of the third embodiment of this application; Figure 9 This is a schematic diagram of the seat adjustment direction involved in the third embodiment of this application; Figure 10 This is a schematic diagram of the seat adjustment area involved in the third embodiment of this application; Figure 11 This is a schematic diagram of the second oriented ray involved in the third embodiment of this application.

[0019] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0020] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0021] Furthermore, the use of terms such as "first" and "second" in this application is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the term "and / or" throughout the text includes three solutions; taking A and / or B as an example, it includes technical solution A, technical solution B, and a technical solution that simultaneously satisfies A and B. Furthermore, the technical solutions of various embodiments can be combined with each other, but this must be based on the ability of a person skilled in the art to implement them. When the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.

[0022] Reference Figure 1 , Figure 1 This is a schematic diagram of the structure of a smart remote control for the hardware operating environment involved in the embodiments of this application.

[0023] like Figure 1As shown, the smart remote control may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk drive. The memory 1005 may also optionally be a storage device independent of the aforementioned processor 1001.

[0024] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the smart remote control and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0025] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a data storage module, a network communication module, a user interface module, and a vehicle interaction device identification program.

[0026] exist Figure 1 In the smart remote control shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and memory 1005 in the smart remote control of this application can be set in the smart remote control, and the smart remote control calls the vehicle interaction device identification program stored in the memory 1005 through the processor 1001 and performs the following operations: In response to the interactive commands sent by the smart remote control, the target orientation of the smart remote control and its target operating area in the vehicle are determined respectively; Based on the preset mapping relationship between the operating area and the device area in the vehicle, the effective device area of ​​the smart remote control in the target operating area is matched and obtained; The target device area of ​​the smart remote control is determined from the effective device area based on the target orientation; The interactive device in the target device area is designated as the target device, and the target device is controlled to respond to the interactive command.

[0027] Furthermore, the processor 1001 can call the vehicle interaction device identification program stored in the memory 1005 and also perform the following operations: Prior to the operation in response to the interactive command sent by the smart remote control, the method further includes: Identify interactive devices in the vehicle; Based on the spatial location of each interactive device in the vehicle, the vehicle is divided into device areas to obtain multiple device areas.

[0028] Furthermore, the processor 1001 can call the vehicle interaction device identification program stored in the memory 1005 and also perform the following operations: After dividing the vehicle into device areas based on the spatial location of each interactive device within the vehicle to obtain multiple device areas, the method further includes: Identify the window area and rearview mirror area within the device area; Determine the maximum overlap between the window area and the rearview mirror area projected in a first preset direction, wherein the first preset direction is the direction from the vehicle cabin towards the outside of the vehicle; The window area is corrected based on the maximum overlap to prevent the window area from obstructing the rearview mirror area.

[0029] Furthermore, the equipment areas of the vehicle include one or more of the following: multimedia area, air conditioning area, rearview mirror area, glove box area, ambient lighting area, reading light area, sunroof area, seat area, window area, and trunk area.

[0030] Furthermore, the operating area of ​​the vehicle includes one or more of the following: the driver's operating area, the co-driver's operating area, and the passenger operating area.

[0031] Further, the operation of determining the target device area of ​​the smart remote control from the effective device area based on the target orientation includes: Generate a first orientation ray based on the target orientation; The effective device area that is traversed by the first directional ray and has the shortest distance to the starting point of the first directional ray is defined as the target device area.

[0032] Furthermore, the processor 1001 can call the vehicle interaction device identification program stored in the memory 1005 and also perform the following operations: Prior to the operation of generating an orientation ray based on the target orientation, the method further includes: Determine whether the target orientation is consistent with the preset seat adjustment direction; If not, then perform the operation of generating a first orientation ray based on the target orientation; If so, when the smart remote control is located in the seat adjustment area of ​​the target operating area, it extends bidirectionally based on the target orientation to generate two second orientation rays, and the starting points of the two second orientation rays are the same. The effective device area that is traversed by the second directional ray and has the shortest distance to the starting point of the second directional ray is defined as the target device area.

[0033] Furthermore, at least one positioning device is provided at each of the front and rear ends of the smart remote control, and each positioning device has a different identification number. The operation of determining the target orientation of the smart remote control and its target operating area in the vehicle includes: Obtain the coordinate information of each of the positioning devices, wherein the coordinate information encapsulates the identification number of the positioning device; Based on the coordinate information, the target operating area where the smart remote control is located is determined; Based on the coordinate information, the front and rear points of the smart remote control are determined, and the direction from the rear point to the front point is taken as the target orientation.

[0034] Based on the above structure, various embodiments of the vehicle interaction device identification method are proposed.

[0035] Reference Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the vehicle interaction device identification method of this application.

[0036] In this embodiment, the executing entity of the vehicle interaction device identification method can be a smart remote control. The smart remote control is a device capable of sending interactive commands. It can be a separate, newly added physical device, or it can be a device that sends interactive commands by adding corresponding hardware and software modules to an existing device (e.g., a car key, a mobile phone, etc.). The executing entity of the method can also be a control terminal. The control terminal can be a local device, such as the vehicle's central control system, electronic control unit (ECU), etc., or a mobile terminal such as a mobile phone or laptop, or a local device installed in the vehicle, used to respond to interactive commands sent by the remote control and control various interactive devices on the vehicle. The executing entity of the method can also be a network device. This is not limited in this embodiment; for ease of description, the executing entity is omitted from the following description of each embodiment. In this embodiment, the vehicle interaction device identification method includes: Step S10: In response to the interactive command sent by the smart remote control, determine the target orientation of the smart remote control and the target operating area in the vehicle. In response to the interactive command sent by the smart remote control, and to obtain the orientation information of the smart remote control relative to the vehicle cabin, the orientation of the smart remote control when sending the interactive command is determined based on the orientation information (hereinafter referred to as the target orientation for distinction), and the operating area of ​​the smart remote control in the vehicle when sending the interactive command is determined (hereinafter referred to as the target operating area for distinction).

[0037] Optionally, the orientation information can be obtained from the smart remote control when an interaction command is received; alternatively, before receiving an interaction command, the orientation information of the smart remote control relative to the vehicle cabin can be dynamically obtained through low-power methods such as background operation and stored locally. Then, when an interaction command is received, the orientation information can be directly retrieved from the background to achieve timely response to the interaction command.

[0038] Optionally, the vehicle interaction device identification method is applied to a vehicle, which includes multiple interaction devices. These interaction devices can be various functional devices installed on the vehicle, such as air conditioning, audio-visual entertainment systems (multimedia), seats, trunk, sunroof, windows, etc. This embodiment does not impose any limitations on these. Users can send interaction commands to various interaction devices on the vehicle from any location in the vehicle cabin using a smart remote control. This makes human-computer interaction with the interaction devices in the vehicle no longer limited to the user's location. Human-computer interaction with the vehicle's interaction devices can be achieved from any location in the vehicle cabin, which in particular improves the convenience of interaction in multi-passenger scenarios, meets the interaction needs of passengers in different locations in the vehicle, and enhances the user experience.

[0039] Optionally, the vehicle can be divided into multiple interactive device areas (hereinafter referred to as device areas for distinction) in advance based on the spatial location of the interactive devices in the vehicle. Each device area contains one interactive device. By identifying the device areas, the target device for user interaction can be determined.

[0040] For example, the equipment area of ​​the vehicle includes one or more of the following: multimedia area, air conditioning area, rearview mirror area, glove box area, ambient lighting area, reading light area, sunroof area, seat area, window area and trunk area.

[0041] Optionally, after dividing the vehicle into equipment areas, the remaining area of ​​the vehicle cabin can be used as the user's operating area, i.e., the area where the user can move around in the cabin; and the operating area can be further divided according to each seat in the vehicle to obtain, for example, a driver's operating area, a co-driver's operating area, a passenger operating area, a public operating area, etc. This embodiment does not limit this.

[0042] Optionally, a vehicle cabin coordinate system can be established with the vehicle cabin as a reference, and then the spatial coordinates of the smart remote control in the vehicle cabin coordinate system can be determined, i.e., coordinate information. The coordinate information is used as the orientation information of the smart remote control; then the orientation of the smart remote control in the vehicle can be determined based on the coordinate information.

[0043] In one feasible embodiment, at least one positioning device is respectively provided at the front and rear ends of the smart remote control, and the identification number of each positioning device is different. In step S10, the step of determining the target orientation of the smart remote control and the target operating area in the vehicle in response to the interaction command sent by the smart remote control includes: Step S11: Obtain the coordinate information of each of the positioning devices, wherein the coordinate information encapsulates the identification number of the positioning device; The smart remote control has at least one positioning device at each of its front and rear ends, and each positioning device uses a different identification number. Therefore, the source of the coordinate information can be determined based on the positioning device identification number encapsulated in the acquired coordinate information, so as to distinguish the front and rear ends of the smart remote control. Furthermore, the coordinate information collected by the positioning device can be obtained with the vehicle cockpit coordinate system as a reference. The coordinate information includes at least two coordinate points, which can be three-dimensional coordinate points.

[0044] Optionally, the positioning device can be an antenna, which can be a UWB (Ultra Wide Band) antenna or a Bluetooth antenna. By setting at least one antenna at each of the front and rear ends of the smart remote control, and then using multi-antenna technology, the front and rear ends of the smart remote control can be determined to determine the orientation of the smart remote control.

[0045] Optionally, specific identifiers can be pre-set for the positioning devices at the front and rear ends of the smart remote control. For example, a positioning device is set at each of the front and rear ends of the smart remote control. The positioning device is a UWB antenna, that is, the smart remote control includes a front-end UWB antenna and a rear-end UWB antenna. The identifier of the front-end UWB antenna is pre-set as 1, and the identifier of the rear-end UWB antenna is set as 2. After obtaining the coordinate information of each positioning device, the source of the coordinate information can be confirmed by the identifier 1 or 2 encapsulated in the coordinate information.

[0046] For example, a positioning device is provided at both the front and rear ends of the smart remote control. The positioning device is a Bluetooth antenna. That is, the smart remote control includes a front Bluetooth antenna and a rear Bluetooth antenna. The identification number of the front Bluetooth antenna is set as A and the identification number of the rear Bluetooth antenna is set as B in advance. After obtaining the coordinate information of each positioning device, the source of the coordinate information can be confirmed by the identification number A or B encapsulated in the coordinate information.

[0047] Step S12: Determine the target operating area where the smart remote control is located based on the coordinate information; The vehicle is pre-divided into multiple operating areas. Based on the coordinate information of the smart remote control, the target operating area where the smart remote control is located when sending interactive commands can be determined.

[0048] For example, the pre-defined operating areas in the vehicle include: the driver's operating area, the front passenger operating area, and the first, second, and third passenger operating areas in the rear seats; the coordinate information of the smart remote control is in the front passenger operating area, thus determining the target operating area as the front passenger operating area, that is, the passenger sitting in the front passenger seat is using the smart remote control to interact with the interactive devices in the vehicle.

[0049] Step S13: Based on the coordinate information, determine the front and rear points of the smart remote control, and use the direction from the rear point to the front point as the target orientation.

[0050] Based on the identifier encapsulated in the obtained coordinate information, the front and rear points of the smart remote control in the vehicle cockpit coordinate system are determined; then the direction from the rear point to the front point is taken as the target orientation.

[0051] Optionally, the front point can be the front end point of the smart remote control, and the rear point can be the rear end point of the smart remote control; the front point can also be the rear end point of the smart remote control, and the rear point can also be the front end point of the smart remote control. This embodiment does not limit this.

[0052] For example, refer to Figure 3 A vehicle cabin coordinate system (which can be a three-dimensional or two-dimensional coordinate system; this embodiment uses a three-dimensional coordinate system as an example) is established with the center point of the vehicle cabin as the origin. UWB anchor points, i.e., Q, are set at four locations in the vehicle cabin. A Q B Q C and Q D Four o'clock, Figure 3 The dashed square in the middle represents the vehicle's operating area. Each seat in the vehicle's cabin corresponds to one operating area, resulting in five operating areas. Each operating area is assigned a number, i.e., 1-5. UWB antennas, Q1 and Q2, are then installed at the front and rear ends of the smart remote control, respectively. The coordinates of Q1 and Q2 are determined by setting UWB anchor points within the vehicle. Since Q1 and Q2 are located in operating area 1, operating area 1 is the target operating area. Using the rear point Q1 as the initial point and the forward point Q2 as the target orientation, the target device area of ​​the smart remote control can be determined based on the target orientation, thus identifying the target device.

[0053] In this embodiment, at least one positioning device is respectively set at the front and rear ends of the smart remote control. Each positioning device uses a different identification number, thereby obtaining the coordinate information of each positioning device. The coordinate information encapsulates the identification number of the positioning device. Based on the coordinate information, the target operating area where the smart remote control is located is determined. Based on the coordinate information, the front and rear points of the smart remote control are determined, and the direction from the rear point to the front point is taken as the target orientation. This achieves accurate identification of the operating area and orientation of the smart remote control on the vehicle.

[0054] Step S20: Based on the preset mapping relationship between the operating area and the device area in the vehicle, the effective device area of ​​the smart remote control in the target operating area is matched and obtained; By using a pre-defined mapping relationship between operating areas and device areas in the vehicle, the effective device area of ​​the smart remote control in the target operating area is matched; this allows for the restriction of controllable interactive devices of the smart remote control located in different operating areas of the vehicle, i.e., setting permissions for each operating area, thereby preventing situations such as passengers using the smart remote control to control the vehicle's rearview mirror, which could lead to traffic accidents; and ensuring driving safety while meeting user interaction needs.

[0055] For example, the operating area includes a driver's operating area and a passenger operating area, while the device area includes a multimedia area, an air conditioning area, and a rearview mirror area. Based on the preset mapping relationship between the operating area and the device area in the vehicle, the effective device area of ​​the driver's operating area is determined to include the multimedia area, the air conditioning area, and the rearview mirror area; while the effective device area of ​​the passenger operating area includes the multimedia area and the air conditioning area. That is, the smart remote control cannot be used to control the interactive device (rearview mirror) in the rearview mirror area in the passenger operating area, thereby avoiding the situation where passengers control the vehicle's rearview mirror through the smart remote control and causing traffic accidents, thus ensuring driving safety.

[0056] Step S30: Determine the target device area of ​​the smart remote control from the effective device area based on the target orientation; The target device area of ​​the smart remote control is determined from multiple valid device areas based on the target orientation of the smart remote control.

[0057] Step S40: Select the interactive device in the target device area as the target device, and control the target device to respond to the interactive command.

[0058] After determining the target device area, the interactive devices in the target device area are designated as target devices, enabling accurate identification of the target devices and then controlling the target devices to respond to the interactive commands sent by the smart remote control.

[0059] Optionally, if the control terminal is the main control system on the vehicle, after the target device is determined, the target device can be controlled to respond to the interaction command via the CAN bus (Controller Area Network bus). This allows each interaction device on the vehicle to respond to the interaction command sent by the smart remote control without the need for additional command receiving devices, reducing the implementation cost of the vehicle interaction device identification method. Furthermore, the smart remote control can interact with any vehicle through the vehicle interaction device identification method.

[0060] In this embodiment, by responding to the interactive commands sent by the smart remote control, the target orientation of the smart remote control and its target operating area in the vehicle are determined respectively. Then, according to the preset mapping relationship between operating areas and device areas in the vehicle, the effective device area of ​​the smart remote control in the target operating area is matched. According to the target orientation, the target device area of ​​the smart remote control is determined from the effective device area. The interactive device in the target device area is taken as the target device, and the target device is controlled to respond to the interactive commands. By setting the smart remote control, users in various positions in the vehicle can interact with the interactive devices in the vehicle, improving the convenience of human-vehicle interaction, especially in multi-passenger scenarios, meeting the interaction needs of passengers in various positions in the vehicle, and enhancing the user experience. Furthermore, by pre-dividing the vehicle into spatial areas, the device areas of each interactive device in the vehicle (e.g., air conditioning, windows, multimedia devices, etc.) and the operating areas of the users are obtained. Then, according to the preset mapping relationship between operating areas and device areas in the vehicle, the effective device area of ​​the smart remote control in the target operating area is matched. The controllable interactive devices of the smart remote control located in different operating areas of the vehicle are restricted to prevent, for example, passengers from using the device area of ​​the user area. This system addresses situations where smart remote controls can interfere with vehicle rearview mirrors, potentially leading to traffic accidents. It aims to ensure driving safety while meeting user interaction needs. Furthermore, it determines the target device area based on the orientation of the smart remote control, enabling accurate identification of the target device from multiple interactive devices within the vehicle. Identifying the target device based on the orientation of the smart remote control when sending interaction commands avoids identification failures caused by passengers or other obstructions blocking infrared or other light signals, thus improving the accuracy of vehicle interactive device identification. Through interaction between the control terminal and the smart remote control, it eliminates the need for separate command receivers on each interactive device in the vehicle, reducing implementation costs.

[0061] Furthermore, based on the first embodiment described above, a second embodiment of the vehicle interaction device identification method of this application is proposed. In this embodiment, before step S10, the step of responding to the interaction command sent by the smart remote control, the method further includes: Step A10: Identify the interactive devices in the vehicle; Obtain vehicle information, including interactive devices on the vehicle, device size, device location, vehicle size, etc.; and then identify the multiple interactive devices contained in the vehicle.

[0062] Step A20: Based on the spatial location of each interactive device in the vehicle, the vehicle is divided into device areas to obtain multiple device areas.

[0063] Determine the spatial location of each interactive device in the vehicle, and divide the vehicle into device areas based on the spatial location of each interactive device, thereby obtaining multiple device areas.

[0064] In one feasible implementation, the area where the interactive devices on the vehicle are located can be divided according to functional dimensions to obtain multiple device areas; wherein, the device areas of the vehicle may include one or more of the following: multimedia area, air conditioning area, rearview mirror area, glove box area, ambient lighting area, reading light area, sunroof area, seat area, window area and trunk area.

[0065] Optionally, the equipment areas obtained based on functional dimensions can be further divided according to their location in the vehicle. The multimedia area includes: the front multimedia center console area and the rear multimedia area (left, right, and top); the air conditioning area includes: the front air conditioning area and the rear air conditioning area; the rearview mirror area includes: the exterior rearview mirror area (left and right) and the interior rearview mirror area; the reading light area includes: the front reading light area and the rear reading light area (left, center, and right), etc. This embodiment does not impose any limitations on this, and the actual size boundaries of each equipment area can be determined after calibration on a real vehicle.

[0066] For example, refer to Figure 4 The equipment areas in the front cabin of the vehicle include: front reading light area 11, front multimedia central control area 21, first rearview mirror 31, second rearview mirror 32, third rearview mirror 33, glove box area 41, first window area 51, second window area 52, first ambient lighting area 61 and second ambient lighting area 62.

[0067] In this embodiment, interactive devices in the vehicle are identified; then, based on the spatial location of each interactive device in the vehicle, the vehicle is divided into device areas to obtain multiple device areas; the above method can be adapted to vehicles of different models, containing different interactive devices and different device layouts, thus reducing implementation costs.

[0068] In one feasible implementation, after step A20, which involves dividing the vehicle into device areas based on the spatial location of each interactive device within the vehicle to obtain multiple device areas, the method further includes: Step A30: Identify the window area and rearview mirror area within the device area; The identification device area includes the window area and the rearview mirror area.

[0069] Optionally, the front window area and the exterior rearview mirror area in the identification device area can be identified.

[0070] Optionally, the device area can identify the first front window area and the second front window area, which correspond to the left and right front windows of the vehicle, respectively; and the device area can identify the first and second outer rearview mirror areas, which correspond to the left and right outer rearview mirrors of the vehicle, respectively.

[0071] Step A40: Determine the maximum overlap between the window area and the rearview mirror area projected in a first preset direction, wherein the first preset direction is the direction from the vehicle cabin towards the outside of the vehicle. Step A50: Correct the window area based on the maximum overlap portion to avoid the window area obstructing the rearview mirror area.

[0072] Projecting the window area and rearview mirror area on the same side of the vehicle from the direction of the vehicle's cabin towards the outside, and determining the maximum overlap of the projections; then correcting the window area based on the maximum overlap to prevent the window area from obstructing the rearview mirror area when the user interacts with the interactive device.

[0073] For example, refer to Figure 5 P1 is the window area and P2 is the rearview mirror area. Projecting P1 and P2 from the direction of the vehicle cabin towards the outside of the vehicle yields P11 and P21 respectively. Among them, P21 is the maximum overlap between the projections of P1 and P2. Then, P2 is corrected based on P21. For example, the part of P1 corresponding to P21 is deleted, so that the window area does not obstruct the rearview mirror area.

[0074] In this embodiment, the window area and the rearview mirror area in the device area are identified; then the maximum overlap between the window area and the rearview mirror area in a first preset direction is determined, wherein the first preset direction is the direction from the vehicle cabin towards the outside of the vehicle; then the window area is corrected according to the maximum overlap to avoid the window area obstructing the rearview mirror area; so that the user in the vehicle cabin can interact with the various interactive devices of the vehicle through the smart remote control, thereby improving the accuracy of interactive device recognition.

[0075] In one feasible implementation, after step A20, which involves dividing the vehicle into device areas based on the spatial location of each interactive device within the vehicle to obtain multiple device areas, the method further includes: The seat area within the identified device area is defined as the operating area, with the region between the seat area and a reference area being the nearest device area in the direction of the seat's front and upper sides. The operating area can be a regular cube or an irregular shape; this embodiment does not impose any limitations on this.

[0076] Optionally, the operating area can be further classified according to the seat area; for example, if the seat area is the main driver's seat area, then the operating area determined according to the main driver's seat area is the main driver's operating area; the operating area can be marked according to the seat area to distinguish multiple operating areas.

[0077] For example, refer to Figure 6 The equipment area includes A1-A3 and a black frame, which can represent the edge of the vehicle cabin, etc. A1 is the first seat area, A2 is the second seat area, and A3 is the glove box area. The equipment area identifies the seat areas, A1 and A2, and then determines the corresponding reference areas for A1 and A2 respectively. The reference area for A1 includes A3 located in the direction in front of the seat of A1. Figure 6 The left side frame line, and the area above the seat in A1. Figure 6 The upper middle side frame line; the reference area of ​​A2 includes: A1 located in the direction of the front side of A2's seat, and A1 located in the direction of the upper side of A2's seat. Figure 6 Upper middle frame line. The area between the seat area and the reference area is used as the operating area, resulting in operating area B1 corresponding to A1 and operating area B2 corresponding to A2.

[0078] In one feasible implementation, the operating area of ​​the vehicle includes one or more of the following: a driver's operating area, a co-driver's operating area, and a passenger operating area.

[0079] Optionally, the passenger operating area can be further divided according to the number and position of the rear seats in the vehicle; for example, if the vehicle is a 5-seater vehicle, including: a driver's seat, a front passenger seat and three rear passenger seats, then the three rear passenger seats can be respectively designated as the first passenger operating area, the second passenger operating area and the third passenger operating area, and all three passenger operating areas can be used as the operating areas; this application does not limit this.

[0080] In one feasible implementation, a seat area in the equipment area is identified; the area between the seat area and the reference area is designated as the seat operation area, and the seat operation area corresponding to each seat area is determined; then the remaining area in the vehicle cabin can be designated as the common operation area, and both the seat operation area and the common operation area are designated as the operation area, so as to realize the division of the operation area in the vehicle cabin; wherein, the area in the cabin other than the already divided equipment area and operation area is designated as the remaining area.

[0081] For example, refer to Figure 7 The vehicle's equipment areas include: sunroof area 100, first window area 101, second window area 102, first seat area 103, and second seat area 104; the seat areas 103 and 104 in the equipment areas are identified; the area between the seat areas and the reference area is taken as the seat operation area, resulting in C1 and C2, and the corresponding seat operation area for each seat area is determined, namely, the first seat operation area C1 corresponding to the first seat area 103, and the second seat operation area C2 corresponding to the second seat area 104; the area in the cabin other than the already divided equipment and operation areas, i.e., the remaining area, is taken as the common operation area C3, and then C1, C2, and C3 are all taken as operation areas.

[0082] Furthermore, based on the first and / or second embodiments described above, a third embodiment of the vehicle interaction device identification method of this application is proposed. In this embodiment, step S30, the step of determining the target device area of ​​the smart remote control from the effective device area according to the target orientation, includes: Step S31: Generate a first orientation ray based on the target orientation; Step S32: The effective device area that is traversed by the first directional ray and has the shortest distance to the starting point of the first directional ray is taken as the target device area.

[0083] Based on the target orientation of the smart remote control, an orientation ray (hereinafter referred to as the first orientation ray for distinction) is generated; and the effective device area traversed by the first orientation ray is determined. The effective device area with the shortest distance from the starting point of the first orientation ray, i.e., the first effective device area traversed by the first orientation ray, is then designated as the target device area. If the first orientation ray extends beyond the vehicle and does not pass through any effective device area, the target device area recognition is deemed to have failed.

[0084] Optionally, the condition "shortest distance" for determining the target device area can be replaced with other conditions as needed. For example, the effective device area that is the furthest from the starting point of the first directional ray or within a preset distance range can be used as the target device area. This embodiment does not set this condition.

[0085] For example, refer to Figure 8 The gray squares D1 and D2 are the effective device areas of the smart remote control; then, according to the target orientation, a first orientation ray is generated, and the effective device areas traversed by the first orientation ray include D1 and D2, wherein the distance between D1 and the starting point of the first orientation ray is the shortest, that is, D1 is the target device area.

[0086] In this embodiment, a first orientation ray is generated based on the target orientation; the effective device area that the first orientation ray passes through and has the shortest distance to the starting point of the first orientation ray is taken as the target device area; so as to achieve accurate identification of the target device area for interaction with the smart remote control, improve the convenience of human-vehicle interaction, especially in multi-person vehicle scenarios, meet the interaction needs of passengers in various positions of the vehicle, and enhance the user experience.

[0087] In one feasible implementation, before step S31, which generates the orientation ray based on the target orientation, the method further includes: Step S33: Determine whether the target orientation is consistent with the preset seat adjustment direction; Step S34: If not, then proceed to the step of generating a first orientation ray based on the target orientation; Determine whether the target orientation of the smart remote control is consistent with the preset seat adjustment direction; if not, execute the step of generating a first orientation ray based on the target orientation, and subsequent steps.

[0088] For example, refer to Figure 9 1 is the smart remote control, 2 is the target orientation of the smart remote control, and 3 is the seating area in the device area; Figure 9 (a) to (d) represent the preset seat adjustment directions; since the adjustable directions of the seats in the vehicle cabin include fore-and-aft position adjustment parallel to the ground, i.e. Figure 9 (a); Vertical adjustment in the direction perpendicular to the ground, i.e. Figure 9 (b); and the tilt angle of the seat back, i.e. Figure 9 (b) and (d); therefore, a preset seat adjustment direction is set according to the adjustable direction of the seat.

[0089] Step S35, if yes, then when the smart remote control is located in the seat adjustment area of ​​the target operation area, it extends bidirectionally based on the target orientation to generate two second orientation rays, and the starting points of the two second orientation rays are the same. If so, it indicates that the user may have a need to interact with the seat in the interactive device. Then, it is determined whether the smart remote control is located in the seat adjustment area of ​​the target operating area. The vehicle has multiple operating areas, such as one or more of the driver's operating area, passenger's operating area, and passenger operating area. Each operating area can have a pre-set seat adjustment area to facilitate the user quickly locking onto the seat in the interactive device for seat adjustment. If the smart remote control is not located in the seat adjustment area of ​​the target operating area, the step of generating a first orientation ray based on the target orientation is executed. If the smart remote control is located in the seat adjustment area of ​​the target operating area, two orientation rays (hereinafter referred to as the second orientation ray for distinction) are generated based on the target orientation, extending bidirectionally from the same starting point.

[0090] Optionally, in the operation area corresponding to each seat area, the area within a preset distance from the seat seat towards the upper side of the seat is designated as the seat adjustment area in the operation area; for example, the seat adjustment area is the area near the passenger's thigh in the driver's operating area, passenger operating area, or passenger operating area of ​​the operation area; by dividing the seat adjustment area in each operation area, it is convenient for the user to quickly lock the seat in the interactive device for seat adjustment.

[0091] For example, refer to Figure 10 E1 is the operating area, and E2 is the preset seat adjustment area in E1. If the smart remote control is in E1 and the target orientation of the smart remote control is consistent with the preset seat adjustment direction, then the step of extending bidirectionally based on the target orientation to generate two second orientation rays is executed.

[0092] For example, refer to Figure 11 A represents the seat area, B represents the smart remote control, and Q1 represents the starting point of the target orientation. If the target orientation of the smart remote control is consistent with the preset seat adjustment direction, and the target operation area of ​​the smart remote control is the preset seat adjustment area, then two second orientation rays are obtained by extending bidirectionally from Q1 as the starting point. If the target orientation of the smart remote control is inconsistent with the preset seat adjustment direction, and / or the target operation area of ​​the smart remote control is not the preset seat adjustment area, then a first orientation ray is obtained from Q1 as the starting point.

[0093] Step S36: The effective device area that the second directional ray passes through and has the shortest distance to the starting point of the second directional ray is taken as the target device area.

[0094] The effective equipment area that is traversed by the two second directional rays and has the shortest distance to the starting point of the second directional rays is taken as the target equipment area.

[0095] In this embodiment, when a user adjusts the seat, they may subconsciously point the smart remote control in the same direction as the seat adjustment; for example, the user may hold the smart remote control parallel to the ground and point it towards the front of the vehicle, then adjust the seat forward (towards the front of the vehicle). In this case, if a first directional ray is generated based on the target direction of the smart remote control for target device identification, the seat may not be detected. Therefore, after determining the target direction, it is determined whether the target direction is consistent with the preset seat adjustment direction to determine if the target device might be a seat. If so, when the smart remote control is located in the seat adjustment area of ​​the target operating area, based on the target... The target orientation is extended bidirectionally to generate two second orientation rays. A seat adjustment area is preset in the operation area corresponding to each seat area for quick adjustment of the seat in the interactive device. Since users will subconsciously bring the smart remote control closer to the target device when interacting with the interactive device, if the smart remote control meets the above requirements, it indicates that the target device is likely a seat. To avoid users pointing the smart remote control away from the seat due to usage habits, the target orientation is extended bidirectionally to generate two orientation rays in opposite directions to accurately identify the target device area and improve the accuracy of target device identification.

[0096] Furthermore, embodiments of this application also provide a vehicle interaction device identification system, the vehicle interaction device identification system including a smart remote controller and a control terminal, the smart remote controller being communicatively connected to the control terminal, the vehicle interaction device identification system including: The intelligent remote control is used to send interactive commands to the control terminal in response to user operations.

[0097] Optionally, at least one positioning device is provided at each of the front and rear ends of the smart remote control, and the identification number of each positioning device is different.

[0098] The control terminal is configured to respond to interactive commands sent by the smart remote control, determine the target orientation of the smart remote control and the target operating area in the vehicle; match the valid device area of ​​the smart remote control in the target operating area according to a preset mapping relationship between operating areas and device areas in the vehicle; determine the target device area of ​​the smart remote control from the valid device area according to the target orientation; take the interactive device in the target device area as the target device, and control the target device to respond to the interactive commands.

[0099] Optionally, the control terminal is further configured to identify interactive devices in the vehicle; and to divide the vehicle into device areas based on the spatial location of each interactive device in the vehicle, thereby obtaining multiple device areas.

[0100] Optionally, the control terminal is further configured to identify the window area and the rearview mirror area in the device area; determine the maximum overlap portion of the window area that projects onto the rearview mirror area in a first preset direction, wherein the first preset direction is the direction from the vehicle cabin toward the outside of the vehicle; and correct the window area according to the maximum overlap portion to avoid the window area obstructing the rearview mirror area.

[0101] Optionally, the equipment area of ​​the vehicle includes one or more of the following: multimedia area, air conditioning area, rearview mirror area, glove box area, ambient lighting area, reading light area, sunroof area, seat area, window area and trunk area.

[0102] Optionally, the operating area of ​​the vehicle includes one or more of the following: the driver's operating area, the co-driver's operating area, and the passenger operating area.

[0103] Optionally, the control terminal is further configured to generate a first orientation ray based on the target orientation; and to use the effective device area that the first orientation ray passes through and that has the shortest distance to the starting point of the first orientation ray as the target device area.

[0104] Optionally, the control terminal is further configured to determine whether the target orientation is consistent with the preset seat adjustment direction; if not, then execute the step of generating a first orientation ray based on the target orientation; if yes, then when the smart remote control is located in the seat adjustment area of ​​the target operating area, it extends bidirectionally based on the target orientation to generate two second orientation rays, and the starting points of the two second orientation rays are the same; the effective device area that the second orientation ray passes through and has the shortest distance to the starting point of the second orientation ray is taken as the target device area.

[0105] Optionally, the control terminal is further configured to acquire coordinate information of each of the positioning devices, wherein the coordinate information encapsulates the identification number of the positioning device; determine the target operating area where the smart remote control is located based on the coordinate information; determine the front point and rear point of the smart remote control based on the coordinate information, and use the direction from the rear point to the front point as the target orientation.

[0106] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0107] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0108] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A method for identifying vehicle interaction devices, characterized in that, The vehicle interaction device identification method, applied to a control terminal, includes the following steps: In response to the interactive command sent by the smart remote control, the coordinate information of the positioning device of the smart remote control is obtained. Based on the coordinate information, the front point and the rear point of the smart remote control are determined, and the direction from the rear point to the front point is taken as the target orientation of the smart remote control. At least one positioning device is provided at the front and rear ends of the smart remote control, and the identification number of each positioning device is different. The coordinate information encapsulates the identification number of the positioning device. Determine the target operating area of ​​the smart remote control in the vehicle; Based on the preset mapping relationship between the operating area and the device area in the vehicle, the valid device area of ​​the smart remote control in the target operating area is matched and obtained. The mapping relationship between the operating area and the device area in the vehicle is used to characterize the correspondence between each operating area in the vehicle and its valid device area with operating authority. Generate a first orientation ray based on the target orientation; The effective device area that is traversed by the first directional ray and has the shortest distance to the starting point of the first directional ray is taken as the target device area of ​​the smart remote control. The interactive device in the target device area is designated as the target device, and the target device is controlled to respond to the interactive command.

2. The vehicle interaction device identification method as described in claim 1, characterized in that, Prior to the step of responding to the interactive command sent by the smart remote control, the method further includes: Identify interactive devices in the vehicle; Based on the spatial location of each interactive device in the vehicle, the vehicle is divided into device areas to obtain multiple device areas.

3. The vehicle interaction device identification method as described in claim 2, characterized in that, After the step of dividing the vehicle into device areas based on the spatial location of each interactive device in the vehicle to obtain multiple device areas, the method further includes: Identify the window area and rearview mirror area within the device area; Determine the maximum overlap between the window area and the rearview mirror area projected in a first preset direction, wherein the first preset direction is the direction from the vehicle cabin toward the outside of the vehicle; The window area is corrected based on the maximum overlap to prevent the window area from obstructing the rearview mirror area.

4. The vehicle interaction device identification method as described in claim 1 or 2, characterized in that, The equipment areas of the vehicle include one or more of the following: multimedia area, air conditioning area, rearview mirror area, glove box area, ambient lighting area, reading light area, sunroof area, seat area, window area, and trunk area.

5. The vehicle interaction device identification method as described in claim 1, characterized in that, The operating area of ​​the vehicle includes one or more of the following: the driver's operating area, the co-driver's operating area, and the passenger operating area.

6. The vehicle interaction device identification method as described in claim 1, characterized in that, Prior to the step of generating the first oriented ray based on the target orientation, the method further includes: Determine whether the target orientation is consistent with the preset seat adjustment direction; If not, then proceed to the step of generating a first orientation ray based on the target orientation; If so, when the smart remote control is located in the seat adjustment area of ​​the target operating area, it extends bidirectionally based on the target orientation to generate two second orientation rays, and the starting points of the two second orientation rays are the same. The effective device area that is traversed by the second directional ray and has the shortest distance to the starting point of the second directional ray is defined as the target device area.

7. The vehicle interaction device identification method as described in claim 1, characterized in that, The step of determining the target operating area of ​​the smart remote control in the vehicle includes: Based on the coordinate information, the target operating area where the smart remote control is located is determined.

8. A vehicle interaction device recognition system, characterized in that, The vehicle interaction device identification system includes a smart remote control and a control terminal, wherein the smart remote control is communicatively connected to the control terminal, and the vehicle interaction device identification system includes: The intelligent remote control is used to send interactive commands to the control terminal in response to user operations; The control terminal is configured to respond to interactive commands sent by the smart remote control, acquire coordinate information of the positioning device of the smart remote control, determine the front and rear points of the smart remote control based on the coordinate information, and use the direction from the rear point to the front point as the target orientation of the smart remote control. At least one positioning device is provided at each of the front and rear ends of the smart remote control, and each positioning device has a different identification number. The coordinate information encapsulates the identification number of the positioning device. The terminal also determines the target operating area of ​​the smart remote control within the vehicle; matches the effective device area of ​​the smart remote control within the target operating area according to a preset mapping relationship between operating areas and device areas in the vehicle, wherein the mapping relationship characterizes the correspondence between each operating area in the vehicle and its corresponding effective device area; generates a first orientation ray based on the target orientation; uses the effective device area traversed by the first orientation ray and with the shortest distance to the starting point of the first orientation ray as the target device area of ​​the smart remote control; and designates the interactive device within the target device area as the target device and controls the target device to respond to the interactive command.

9. A smart remote control, characterized in that, The intelligent remote control includes: a memory, a processor, and a vehicle interaction device identification program stored in the memory and executable on the processor, the vehicle interaction device identification program being configured to implement the steps of the vehicle interaction device identification method as described in any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium stores a vehicle interaction device identification program, which, when executed by a processor, implements the steps of the vehicle interaction device identification method as described in any one of claims 1 to 7.

Images