Intelligent human-vehicle interaction system and method based on BLE, UWB and NFC

By combining BLE, UWB and NFC technologies, intelligent interaction between cars and people is achieved, and the problems of inaccurate interaction methods in the existing technology are solved, and the user experience and interaction functions of smart cars are improved.

CN119018069APending Publication Date: 2024-11-26ANHUI MINGSHI ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411020220.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing vehicle-computer interaction methods mainly rely on people to actively communicate with the vehicle-computer, which cannot fully reflect the intelligent interaction characteristics of BLE, UWB and NFC technologies, and the identification and control are not accurate enough.

Method used

Using an intelligent human-vehicle interaction system based on BLE, UWB and NFC, the vehicle is actively interacting with people through external anchor points, internal anchor points, SOC (AI) controller and BCM controller, and the vehicle is accurately positioned using UWB. BLE performs voice recognition and broadcast, NFC is used to unlock and identify, integrates CAN communication network module and NCU network control module to improve interaction accuracy and intelligence.

Benefits of technology

It realizes intelligent interaction between the car and the human being, accurately identify the identity and status of the person in the car, improves the user experience, and enhances the interactive functions and service capabilities of the smart car.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119018069A_ABST
    Figure CN119018069A_ABST
Patent Text Reader

Abstract

The invention discloses an intelligent human-vehicle interaction system and method based on BLE, UWB and NFC, and relates to the technical field of automotive electronics. The system comprises an out-of-vehicle anchor point, a main driving handheld device end, an in-vehicle anchor point, an SOC (AI) controller and a BCM controller. The out-of-vehicle anchor point and the in-vehicle anchor point each comprise a UWB detection module, an NCU network control module and a CAN communication network module. The in-vehicle anchor point further comprises a BLE (Bluetooth Low Energy) module; the anchor point outside the vehicle sends a positioning signal to the anchor point inside the vehicle through the CAN communication network module, and the anchor point inside the vehicle sends the signal to the SOC (AI) controller and the BCM controller through the CAN communication network module; aOA accurate positioning is carried out on the anchor point outside the vehicle and the main driving handheld device end. According to the invention, the method is based on UWBamp; an NFCamp (NFCamp); the intelligent interaction mode of the BLE can well solve the problem of how to enable the vehicle machine to actively interact with people, can accurately identify the identity information of people in the vehicle, achieves the purpose of accurate identification and communication, and greatly improves the experience effect of a user on the intelligent vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of automobile electronics, and in particular relates to an intelligent human-vehicle interaction system and method based on BLE, UWB and NFC. Background Art

[0002] At present, BLE (Bluetooth technology) is mainly used for remote connection, data transmission, and identity recognition. UWB (ultra-wideband technology) is mainly used for positioning, ranging and other applications. NFC (near field communication technology) is mainly used for unlocking car doors or starting cars. The existing car-machine applications simply combine BLE modules, UWB modules, and NFC modules. The connection distance of the BLE module installed in the car is about 30-50m. The positioning process based on BLE&UWB technology is that the BCM starts the BLE scanning handheld terminal. When the main driver carries the handheld terminal close to the car-machine end, the message sent remotely by the BLE module on the car-machine end is received by the BLE module on the main driver's mobile phone, so as to identify the main driver. The connection distance of UWB is about 15m. When When the driver approaches the vehicle computer at a certain distance, the UWB modules installed at the left front end, left rear end, right front end and right rear end of the vehicle recognize that the driver is approaching the vehicle computer based on the UWB technology ranging principle, and then transmit the positioning information to the BCM end through the CAN bus. Then the BCM end dispatches the ECU as a whole to control the status of the car lights. When the driver walks to the door, he unlocks the door through the NFC function of the mobile phone. The one or two UWB modules installed in the car are only used to cooperate with the four UWB modules outside the car to perform ranging calculations. This is a common application method at present, and does not fully reflect the advantages of BLE&UWB&NFC technology, and does not perfectly combine the intelligent human-vehicle interaction methods. Therefore, an intelligent human-vehicle interaction system and method based on BLE, UWB and NFC are proposed. Summary of the invention

[0003] The purpose of the present invention is to provide an intelligent human-vehicle interaction system and method based on BLE, UWB and NFC, so as to solve the problem that the traditional interaction mode is that people actively communicate with the vehicle computer and cannot reflect the characteristics of intelligent interaction.

[0004] In order to solve the above technical problems, the present invention is achieved through the following technical solutions:

[0005] The present invention is an intelligent human-vehicle interaction system and method based on BLE, UWB and NFC. The system includes an external anchor point, a driver's handheld device, an internal anchor point, a SOC (AI) controller and a BCM controller. The external anchor point and the internal anchor point both include a UWB detection module, an NCU network control module and a CAN communication network module; the internal anchor point also includes a BLE Bluetooth module; the external anchor point sends a positioning signal to the internal anchor point through the CAN communication network module, and the internal anchor point sends a signal to the SOC (AI) controller and the BCM controller through the CAN communication network module;

[0006] The external anchor point of the vehicle and the driver's handheld device perform AOA precise positioning;

[0007] The in-vehicle anchor point is mainly used to detect the status of the driver, co-driver and passengers entering the vehicle;

[0008] The BCM controller acts as the main body of the dispatching ECU to control the body state of the car;

[0009] The SOC (AI) controller is used for intelligent voice recognition and broadcasting to achieve human-computer interaction;

[0010] The SOC (AI) controller communicates with the BCM to control the vehicle body status.

[0011] Furthermore, there are four external vehicle anchor points, which are respectively installed on both sides of the front and rear bumpers, as far away from the ground as possible, with the antenna facing upward. When the external vehicle anchor points are installed, the UWB antenna avoids metal and is at the same height.

[0012] Furthermore, there are two in-vehicle anchor points, which are respectively installed in the front and rear armrest boxes, with the antenna facing upward. When the in-vehicle anchor points are installed, the UWB antenna avoids metal and is 30 or 50 mm away from the armrest box frame.

[0013] Furthermore, the NFC module is installed on the left rearview mirror or the B-pillar of the main driving window.

[0014] An intelligent human-vehicle interaction method based on BLE, UWB and NFC includes the following steps:

[0015] S1, UWB anchor sensor works;

[0016] S2, detect whether the driver or passenger enters the car, if yes, proceed to the next step, if not, return to execute S1;

[0017] S3, greet the driver and ask whether the ignition needs to be started, if yes, proceed to the next step, if no, return to S1; or greet the co-driver or passenger and ask whether entertainment is needed; if yes, execute S6, if no, return to S1;

[0018] S4: Remind the driver to make preparations before driving (adjust the steering wheel, seat, rearview mirror, etc.);

[0019] S5. After the preparatory action is completed, the driver starts driving the car;

[0020] S6, open the entertainment selection mode (movies, games, etc.);

[0021] S7, the co-driver or passenger starts entertainment.

[0022] The present invention has the following beneficial effects:

[0023] The present invention can well solve the problem of how to make the car computer actively interact with people through an intelligent interaction method based on UWB&NFC&BLE, and can also accurately identify the identity information of people in the car, achieve the purpose of precise identification and communication, and greatly enhance the user experience of smart cars.

[0024] Of course, any product implementing the present invention does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0026] Figure 1 This is an application block diagram of an intelligent human-vehicle interaction system based on BLE, UWB and NFC;

[0027] Figure 2 This is a hardware block diagram of an intelligent human-vehicle interaction system based on BLE, UWB and NFC;

[0028] Figure 3 The figure is a flow chart of an intelligent human-vehicle interaction method based on BLE, UWB and NFC.

[0029] In the accompanying drawings, the components represented by the reference numerals are listed as follows:

[0030] 1. Anchor point outside the vehicle; 2. Anchor point inside the vehicle; 3. SOC (AI) controller; 4. BCM controller. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] In the description of the present invention, it should be understood that the terms "upper", "middle", "outer", "inner" and the like indicating directions or positional relationships are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the components or elements referred to must have a specific direction, be constructed and operated in a specific direction, and therefore should not be understood as limiting the present invention.

[0033] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "provided with", "connected", etc. should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0034] Embodiment 1

[0035] See also Figure 1-Figure 3 As shown, the intelligent human-vehicle interaction system based on BLE, UWB and NFC of this embodiment includes an external anchor point 1, a main driver's handheld device, an internal anchor point 2, a SOC (AI) controller 3 and a BCM controller 4. Both the external anchor point 1 and the internal anchor point 2 include a UWB detection module, an NCU network control module and a CAN communication network module; the internal anchor point 1 also includes a BLE Bluetooth module; the external anchor point 1 sends a positioning signal to the internal anchor point 2 through the CAN communication network module, and the internal anchor point 2 sends a signal to the SOC (AI) controller 3 and the BCM controller 4 through the CAN communication network module;

[0036] The external anchor point 1 and the driver's handheld device perform AOA precise positioning;

[0037] The in-vehicle anchor point 2 is mainly used to detect the status of the driver, co-driver and passengers entering the vehicle;

[0038] The BCM controller 4 acts as the main body of the dispatching ECU to control the body state of the vehicle;

[0039] SOC (AI) controller 3 is used for intelligent voice recognition and broadcasting to achieve human-computer interaction;

[0040] The SOC (AI) controller 3 communicates with the BCM controller 4 to control the vehicle body state.

[0041] Among them, there are four external anchor points 1, which are installed on both sides of the front and rear bumpers respectively, as far away from the ground as possible, with the antenna facing upward. When the external anchor points 1 are installed, the UWB antenna avoids metal and is at the same height.

[0042] Among them, there are two in-vehicle anchor points 2, which are respectively installed in the front and rear armrest boxes, with the antenna facing upward. When the in-vehicle anchor points 2 are installed, the UWB antenna avoids metal and is 30 or 50 mm away from the armrest box frame.

[0043] Among them, the NFC module is installed on the left rearview mirror or the B-pillar of the main driving window.

[0044] An intelligent human-vehicle interaction method based on BLE, UWB and NFC includes the following steps:

[0045] S1, UWB anchor sensor works;

[0046] S2, detect whether the driver or passenger enters the car, if yes, proceed to the next step, if not, return to execute S1;

[0047] S3, greet the driver and ask whether the ignition needs to be started, if yes, proceed to the next step, if no, return to S1; or greet the co-driver or passenger and ask whether entertainment is needed; if yes, execute S6, if no, return to S1;

[0048] S4: Remind the driver to make preparations before driving (adjust the steering wheel, seat, rearview mirror, etc.);

[0049] S5. After the preparatory action is completed, the driver starts driving the car;

[0050] S6, open the entertainment selection mode (movies, games, etc.);

[0051] S7, the co-driver or passenger starts entertainment.

[0052] Embodiment 2

[0053] See also Figure 1-Figure 3As shown, this embodiment is a method for using a human-computer interaction system based on BLE&UWB&NFC technology: the BLE module on the vehicle side can identify the identity of the main driver, and the UWB module on the vehicle side can accurately calculate the location of the main driver. When the main driver is close to the vehicle at a certain distance, he can unlock the door through NFC to enter the car. A UWB module is installed at a suitable position on the top of the front row and a suitable position on the top of the back row in the car. According to the AOA positioning calculation principle of the UWB module and the function of radar detecting vital signs, with the popularization of UWB technology, UWB positioning tags are becoming more and more popular in terminal devices. It should be specially explained that the main driver, the co-driver, and the passenger must hold a terminal device with UWB function to accurately identify the entry and exit of the door. The UWB module in the car can be used for liveness detection, further improving the accuracy of UWB detection of entry and exit of the door. When the driver, co-driver or rear passenger enters the car, the UWB module can accurately detect it. When the driver enters the driver's position, the UWB module transmits the signal to the cockpit controller through the CAN bus, so that the smart cockpit controller enters the standby mode from the dormant state and starts the AI ​​intelligent voice recognition function. The smart cockpit controller will then make a sound such as welcoming the owner to return to the car, and ask the driver whether he needs to start the car. If the driver replies that the car does not need to be started, the smart cockpit controller will remain in standby mode. If the driver replies that the car needs to be started, the smart cockpit controller will remind the driver to adjust the rearview mirror, seat, seat belt, and steering wheel. After the driver confirms that the preparations before starting are complete, the driver can send an ignition command to the smart cockpit controller through voice. After receiving the command, the smart cockpit controller will pass the start information to the BCM to ignite and start the car. When the UWB module detects that the co-pilot or rear passengers get on the car, the smart cockpit controller will also send a welcome voice, reminding to fasten the seat belt, and ask if you need to enter the entertainment mode (listen to music, watch movies, play games, listen to the radio, karaoke, etc.). This allows the perfect combination of BLE&UWB&NFC with the AI ​​voice recognition function of the smart cockpit controller, which can remind the driver to drive safely, provide good service to passengers, meet their entertainment needs, and achieve the purpose of realizing intelligent human-vehicle interaction.

[0054] Embodiment 3

[0055] Specific application scenarios:

[0056] When the driver opens the main driving door, the anchor point 1 outside the car detects that the door is open. When entering the main driving seat, the anchor point 2 inside the car detects that the driver is in the seat, and the AI ​​domain controller will issue a welcome statement. The driver will enter the novice mode by default when driving for the first time. The driver will be reminded to make preparations before driving (such as fastening the seat belt, adjusting the seat, rearview mirror, etc.), and introduce some relevant performance of the car, and start or shut down the car by voice. At the same time, the driver can turn off the novice mode by voice, and can directly enter the skilled mode when driving the car again. The AI ​​domain controller will ask whether to enter the music or radio mode or navigation mode; after the voice selects the mode, the central control screen will display the corresponding picture, so as to better facilitate the driver;

[0057] When the co-driver opens the front passenger door, the anchor point 1 outside the car detects that the door is open. When entering the front passenger seat, the anchor point 2 inside the car detects that the co-driver is in the seat. The AI ​​domain controller greets the co-driver and asks whether the co-driver wants to enter the entertainment mode (listening to music, watching videos, playing games, karaoke). After the voice selects the option, the co-driver screen will display the corresponding picture, so as to better facilitate the co-driver.

[0058] When the passenger opens the rear door, the anchor point 1 outside the vehicle detects that the door is open. When entering the rear seat, the anchor point 2 inside the vehicle detects that the passenger is in the seat. The AI ​​domain controller will greet the passenger and ask whether the passenger wants to enter the entertainment mode (listening to music, watching videos, playing games, karaoke). After the option is selected by voice, the headrest screen will display the corresponding picture, thereby better facilitating the rear passengers.

[0059] In the description of this specification, the description with reference to the terms "one embodiment", "example", "specific example", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0060] The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. An intelligent human-vehicle interaction system and method based on BLE, UWB and NFC, Features: The system includes an external anchor point, a driver's handheld device, an internal anchor point, an SOC (AI) controller and a BCM controller. Both the external anchor point and the internal anchor point include a UWB detection module, an NCU network control module and a CAN communication network module; the internal anchor point also includes a BLE Bluetooth module; the external anchor point sends a positioning signal to the internal anchor point through the CAN communication network module, and the internal anchor point sends a signal to the SOC (AI) controller and the BCM controller through the CAN communication network module; The external anchor point of the vehicle and the driver's handheld device perform AOA precise positioning; The in-vehicle anchor point is mainly used to detect the status of the driver, co-driver and passengers entering the vehicle; The BCM controller acts as the main body of the dispatching ECU to control the body state of the car; The SOC (AI) controller is used for intelligent voice recognition and broadcasting to achieve human-computer interaction; The SOC (AI) controller communicates with the BCM to control the vehicle body status.

2. According to claim 1, a smart human-vehicle interaction system and method based on BLE, UWB and NFC, It is characterized in that There are four external vehicle anchor points, which are respectively installed on both sides of the front and rear bumpers, away from the ground, with the antenna facing upward. When the external vehicle anchor points are installed, the UWB antenna avoids metal and is at the same height.

3. According to claim 1, a smart human-vehicle interaction system and method based on BLE, UWB and NFC, It is characterized in that There are two in-vehicle anchor points, which are respectively installed in the front and rear armrest boxes, with the antenna facing upward. When the in-vehicle anchor points are installed, the UWB antenna avoids metal and is 30-50 mm away from the armrest box frame.

4. According to claim 1, a smart human-vehicle interaction system and method based on BLE, UWB and NFC, It is characterized in that The NFC module is installed on the left rearview mirror or the B-pillar of the main driving window.

5. An intelligent human-vehicle interaction method based on BLE, UWB and NFC, applied to the system described in any one of claims 1-4, It is characterized in that The following steps are involved: S1, UWB anchor sensor works; S2, detect whether the driver or passenger enters the car, if yes, proceed to the next step, if not, return to execute S1; S3, greet the driver and ask whether the ignition needs to be started, if yes, proceed to the next step, if no, return to S1; or greet the co-driver or passenger and ask whether entertainment is needed; if yes, execute S6, if no, return to S1; S4: Remind the driver to make preparations before driving (adjust the steering wheel, seat, rearview mirror, etc.); S5. After the preparatory action is completed, the driver starts driving the car; S6, open the entertainment selection mode (movies, games, etc.); S7, the co-driver or passenger starts entertainment.