Control method and apparatus

Abstract

The application provides a control method and device, and relates to the technical field of terminals.In the method, when the position of a digital key is close to a vehicle, interaction data of a user is acquired, and when the interaction data meets unlocking conditions, the vehicle is controlled to be unlocked based on the digital key.In this way, when the position of the digital key is close to the vehicle, the vehicle will not be automatically unlocked, and when the position of the digital key is close to the vehicle and the interaction data meets the unlocking conditions, the vehicle is controlled to be unlocked.The frequent automatic unlocking problem caused by inaccurate distance determination due to user movement and real-time fluctuations of wireless signals can be avoided, and the reliability of the vehicle unlocking function and the use experience of the user are improved.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a control method and device. Background Technology

[0002] To improve user experience, various types of devices now support contactless locking and unlocking. Taking contactless locking and unlocking of a vehicle via a mobile phone as an example, the vehicle can determine the distance between the phone and the vehicle based on the signal strength of the Bluetooth signal between them; when the distance is less than a certain threshold, the vehicle automatically unlocks; when the distance is greater than a certain threshold, the vehicle automatically locks.

[0003] However, this unlocking method has low accuracy and may result in problems such as ping-pong unlocking, leading to a poor user experience. Summary of the Invention

[0004] This application provides a control method and device that can improve the reliability of vehicle unlocking and the user experience, and reduce problems such as ping-pong unlocking.

[0005] Firstly, this application provides a control method that can be executed by a first device. The first device can be a terminal, a component configured in the terminal (such as a chip, chip system, processor, controller, or circuit), or a logic module or software capable of implementing all or part of the terminal's functions; this application does not limit this. The terminal can be, for example, but is not limited to, a vehicle, robot, drone, or intelligent transportation equipment.

[0006] The method includes: obtaining the location information of the digital key when the digital key proximity automatic unlocking function of the first device is in a deactivated state; collecting interaction data through the interaction component in the first device when the digital key is close to the first device; and controlling the first device to unlock based on the digital key when the interaction data meets the unlocking conditions.

[0007] Therefore, the vehicle will not unlock automatically if the digital key is near the vehicle but the unlocking conditions are not met. Unlocking conditions may include the authorized user looking at the camera for a continuous period of time or the authorized user making a first gesture.

[0008] This avoids frequent automatic unlocking issues caused by inaccurate distance determination due to user movement and real-time fluctuations in wireless signals, thus improving the reliability of vehicle unlocking and the user experience.

[0009] In one possible implementation, collecting interaction data through an interaction component in the first device includes: collecting first interaction data and second interaction data through the interaction component in the first device; at least one of the first interaction data and second interaction data is used to obtain user identity information contained in the interaction data; at least one of the first interaction data and second interaction data is also used to perform intent verification to determine that another interaction data satisfies the non-false triggering condition.

[0010] Specifically, if the user identity information indicates that the user is an authorized user, and the intent verification indicates that the user has the intent to unlock (that is, the authorized user meets the non-false triggering condition), then the first interaction data and the second interaction data meet the unlocking condition.

[0011] In this way, the first device can collaboratively verify whether the unlocking conditions are met through two interactive data, reducing errors and improving the reliability of the embodiments of this application.

[0012] In one possible implementation, the interaction data satisfies the unlocking condition, including: the interaction data includes image data, which includes the user's screen; the interaction data satisfies the unlocking condition when the image data indicates that the user is an authorized user and the user gazes at the interaction component for a first duration; or, the interaction data satisfies the unlocking condition when the image data indicates that the user is an authorized user and the user performs a first gesture.

[0013] In this way, image data can be obtained through the camera component of the first device, and the unlocking conditions can be determined based on the recognition results of the image data. This solution can be implemented without adding other components and by reusing the existing camera component in the first device, without incurring additional costs.

[0014] Furthermore, based on image data, the user's identity and intent can be accurately identified to determine whether the unlocking conditions are met, thereby improving the reliability of this application.

[0015] In one possible implementation, the interaction data satisfies the unlocking conditions, including: the interaction data includes voiceprint data, which includes the user's voiceprint; the interaction data satisfies the unlocking conditions when the voiceprint data indicates that the user is an authorized user and the collection duration corresponding to the voiceprint data is greater than or equal to a second duration.

[0016] In this way, voiceprint data can be obtained through the voice acquisition component of the first device, and the unlocking conditions can be determined based on the recognition result of the voiceprint data. No other components need to be added, and the existing voice acquisition in the first device can be reused to achieve this solution without adding any extra costs.

[0017] Furthermore, based on voiceprint data, the user's identity and intent can be accurately identified to determine whether the unlocking conditions are met, thereby improving the reliability of this application.

[0018] In one possible implementation, when the interaction data meets the unlocking conditions, the first device is unlocked based on the digital key. This further includes: when the interaction data meets the unlocking conditions and the distance between the digital key and the first device is less than a preset threshold, the first device is unlocked based on the digital key.

[0019] If the distance between the digital key and the first device is less than a preset threshold, it indicates that the user carrying the digital key is close enough to the first device to unlock it, and unlocking is only performed in this case. This reduces the risk of accidental unlocking and improves the reliability of unlocking the first device.

[0020] In one possible implementation, the first device is unlocked based on a digital key when the interaction data meets the unlocking conditions. This further includes: when the interaction data meets the unlocking conditions and the authorized user is located outside the first device, the first device is unlocked based on a digital key.

[0021] This prevents misunderstandings caused by authorized users being inside the first device, thus improving the reliability of unlocking the first device.

[0022] In one possible implementation, when the interaction data includes N channels of interaction data, and the interaction data meets the unlocking conditions, the first device is unlocked based on the digital key, which includes: when one of the N channels of interaction data meets the unlocking conditions, the first device is unlocked based on the digital key.

[0023] In this way, N channels of interactive data are processed independently. If the interactive data from one channel meets the unlocking conditions, the first device can be unlocked, thus improving the efficiency of interactive data processing and the user experience.

[0024] In one possible implementation, if the digital key is located near the first device, it also includes: a wake-up interaction component.

[0025] In this way, the interactive component is only activated when the digital key is close to the first device, thus avoiding continuous energy consumption by the interactive component and reducing its energy consumption.

[0026] In one possible implementation, the interactive components include one or more of the following: a camera component, a sound acquisition component, and a tactile sensor component.

[0027] It is understood that the above description of interactive components is merely an example, and interactive components may also include other components. This application embodiment does not impose specific limitations on this.

[0028] In one possible implementation, the camera component includes a B-pillar camera.

[0029] B-pillar cameras can efficiently and conveniently collect image data, including the user's view, to determine whether the image data meets the unlocking conditions, thus improving efficiency and accuracy.

[0030] Secondly, this application provides a control device, including an acquisition module and a control module; the acquisition module is used to acquire the location information of a digital key when the automatic unlocking function of the first device is off; the acquisition module is also used to collect interactive data through the interactive components in the first device when the digital key is close to the first device; the control module is used to control the first device to unlock based on the digital key when the interactive data meets the unlocking conditions.

[0031] In one possible implementation, the acquisition module is used to collect first interaction data and second interaction data through the interaction component in the first device; at least one of the first interaction data and second interaction data is used to acquire user identity information contained in the interaction data; at least one of the first interaction data and second interaction data is also used to perform intent verification to determine that another interaction data meets the non-false triggering condition.

[0032] In one possible implementation, the interaction data includes image data, which includes the user's screen; the control module is used to determine that: if the image data indicates that the user is an authorized user and the user gazes at the interaction component for a first duration, the interaction data satisfies the unlocking condition; or, if the image data indicates that the user is an authorized user and the user presents a first gesture, the interaction data satisfies the unlocking condition.

[0033] In one possible implementation, the interaction data includes voiceprint data, which includes the user's voiceprint; the control module is used to determine that the interaction data satisfies the unlocking condition when the voiceprint data indicates that the user is an authorized user and the collection duration corresponding to the voiceprint data is greater than or equal to the second duration.

[0034] In one possible implementation, the control module is used to control the first device to unlock based on the digital key when the interaction data meets the unlocking conditions and the distance between the digital key and the first device is less than a preset threshold.

[0035] In one possible implementation, the control module is used to unlock the first device based on a digital key when the interaction data meets the unlocking conditions and the authorized user is located outside the first device.

[0036] In one possible implementation, when the interaction data includes N channels of interaction data, and when the interaction data meets the unlocking conditions, the control module is used to control the first device to unlock based on the digital key when one of the N channels of interaction data meets the unlocking conditions.

[0037] In one possible implementation, the control module is used to wake up the interactive components.

[0038] In one possible implementation, the interactive components include one or more of the following: a camera component, a sound acquisition component, and a tactile sensor component.

[0039] In one possible implementation, the camera component includes a B-pillar camera.

[0040] Thirdly, this application provides a control device that can implement the method in the first aspect or any possible implementation of the first aspect.

[0041] The apparatus includes corresponding units (or modules) for performing the methods described above. These units (or modules) can be implemented in software and / or hardware.

[0042] Fourthly, this application provides a control device including at least one processor, each of the at least one processor being configured to implement the method in the first aspect or any possible implementation of the first aspect.

[0043] Fifthly, this application provides a terminal device, which is equipped with: the control device of the first aspect or any possible implementation of the first aspect; or the control device of the third aspect; or the control device of the fourth aspect.

[0044] The vehicle is used to implement the method in the first aspect or any possible implementation of the first aspect.

[0045] In a sixth aspect, this application provides a chip system including at least one processor for supporting the implementation of the methods shown in the first aspect or any possible implementation of the first aspect.

[0046] In one possible design, the chip system also includes a memory for storing program instructions and data, which may be located inside or outside the processor.

[0047] The chip system can consist of chips or include chips and other discrete components.

[0048] In a seventh aspect, this application provides a computer-readable storage medium storing a computer program (also referred to as code or instructions) that, when executed by a processor, enables the implementation of the methods described in the first aspect or any possible implementation thereof.

[0049] Eighthly, this application provides a computer program product comprising: a computer program (also referred to as code or instructions) that, when executed, enables the implementation of the methods in the first aspect or any possible implementation thereof.

[0050] It should be understood that the second to eighth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0051] Figure 1 A schematic block diagram of an intelligent driving device provided in an embodiment of this application;

[0052] Figure 2 A schematic block diagram of an intelligent driving system provided in an embodiment of this application;

[0053] Figure 3 A schematic diagram illustrating a scenario where a vehicle's digital key automatically unlocks when it is brought close.

[0054] Figure 4 A schematic diagram of a communication system provided in an embodiment of this application;

[0055] Figure 5 A schematic diagram illustrating a control method provided in an embodiment of this application;

[0056] Figure 6 A schematic diagram of an interface for setting an unlocking strategy provided in an embodiment of this application;

[0057] Figure 7 A schematic diagram illustrating another control method provided in an embodiment of this application;

[0058] Figure 8 A schematic block diagram of a control device provided in an embodiment of this application;

[0059] Figure 9 A schematic block diagram of another control device provided in an embodiment of this application. Detailed Implementation

[0060] To facilitate understanding of the embodiments of this application, the following points will be explained first:

[0061] First, in the embodiments of this application, the indication includes explicit indication (also known as direct indication) and implicit indication (also known as indirect indication). Explicit indication information A refers to including information A; implicit indication information A refers to indicating information A through the correspondence between information A and information B and direct indication information B. The correspondence between information A and information B can be predefined, pre-stored, pre-burned, or pre-configured; or it can refer to indicating information A through information B and preset rules.

[0062] Second, in the embodiments of this application, information C is used to determine information D, which includes determining information D based solely on information C, as well as determining it based on information C and other information. Furthermore, information C can also be used to determine information D indirectly, for example, in the case where information D is determined based on information E, and information E is determined based on information C.

[0063] Third, in the embodiments of this application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates an "or" relationship between the preceding and following related objects, but it does not exclude the possibility of indicating an "and" relationship. The specific meaning can be understood in conjunction with the context. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c; a and b; a and c; b and c; or a and b and c. Here, a, b, and c can be single or multiple.

[0064] Fourth, in the embodiments of this application, the use of prefixes such as "first" and "second" is merely for the purpose of distinguishing and describing different things belonging to the same name category, and does not constrain the order, size, or quantity of things. For example, "first threshold" and "second threshold" are simply different thresholds, and there is no temporal order, size, or priority relationship between them.

[0065] Fifth, the "sending" and "receiving" in the embodiments of this application can be performed between devices, such as between a second device and a first device; or they can be performed within a device, such as between components, modules, chips, software modules, or hardware modules within a device via a bus, wiring, or interface.

[0066] Sixth, in the embodiments of this application, "when," "if," and "if" all refer to the device making corresponding processing under certain objective circumstances, and are not limited to a time, nor do they require the device to make a judgment action when it is implemented, nor do they mean that there are other limitations.

[0067] Seventh, in the embodiments of this application, the words "example," "exemplarily," "for example," or "such as" are used to indicate that they are examples, illustrations, or explanations. Any embodiment or design that is described as "example," "exemplarily," "for example," or "such as" in this application should not be construed as being more preferred or advantageous than other embodiments or design options. Specifically, the use of the words "example," "exemplarily," "for example," or "such as" is intended to present the relevant concepts in a specific manner.

[0068] Eighth, the control method in the embodiments of this application can be applied to vehicle networks, such as vehicle to everything (V2X), long term evolution-vehicle (LTE-V), and vehicle to vehicle (V2V).

[0069] For example, the control method in this embodiment can be applied to a vehicle. Through this control method, the vehicle can automatically unlock. Alternatively, the control method in this embodiment can also be applied to other devices in the vehicle. These other devices can be, for example, hardware units, software modules, or a combination of hardware units and software modules. These other devices include, but are not limited to, vehicle-mounted terminals, vehicle-mounted controllers, vehicle-mounted modules, vehicle-mounted components, vehicle-mounted chips, vehicle-mounted units, vehicle-mounted radar, or vehicle-mounted cameras, and other sensors. The vehicle can implement the control method provided in this embodiment through these other devices.

[0070] Of course, the control method in this application embodiment can also be used in other intelligent terminals besides vehicles, or installed in other intelligent terminals besides vehicles, or installed in components of such intelligent terminals. The intelligent terminal can be, but is not limited to, intelligent transportation equipment, robots, etc. For example, it includes, but is not limited to, the intelligent terminal itself or a controller, chip, or chip system within the intelligent terminal.

[0071] The embodiments of this application can be applied to intelligent driving devices, or devices equipped with intelligent driving systems. Below, in conjunction with... Figure 1 and Figure 2 A detailed description of intelligent driving equipment and intelligent driving systems is provided.

[0072] Figure 1 This is a schematic block diagram of an intelligent driving device 100 to which this application embodiment applies. For example... Figure 1As shown, the intelligent driving device 100 may include a perception system 120, a display device 130, a communication device 140, and a computing platform 150.

[0073] The perception system 120 may include several types of sensors for sensing information about the environment surrounding the intelligent driving device 100. For example, the perception system 120 may include a positioning system, which may be a global navigation satellite system (GNSS), such as GPS or BeiDou. Alternatively, the perception system 120 may also include one or more of the following sensors: an inertial measurement unit (IMU), a vibration sensor, a lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0074] Display devices 130 are typically located within the cockpit of the intelligent driving device 100. Display devices 130 are mainly divided into two categories: the first category is in-vehicle displays; the second category is projection displays, such as head-up displays (HUDs).

[0075] Among them, the in-vehicle display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cabin, such as digital instrument cluster displays and central control screens. In some possible implementations, one or more of the aforementioned in-vehicle displays can be human-machine interfaces (HMIs); for example, the central control screen can be an HMI.

[0076] Head-up displays (HUDs), also known as head-up display systems, are primarily used to display driving information such as speed and navigation on a display device (e.g., the windshield) in front of the driver. This reduces driver eye movement time, avoids pupil dilation caused by eye shifts, and improves driving safety and comfort. Examples of HUDs include combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.

[0077] For example, in this embodiment of the application, the display device 130 can display a setting interface for the unlock control strategy, so that the user can set the unlock control strategy. The unlock control strategy is the unlocking method under various conditions, such as setting the unlocking condition to require an authorized user (such as the car owner) to look at the B-pillar camera for 2 seconds, etc. For details, please refer to the description below, which will not be elaborated here.

[0078] The communication device 140 can be used to establish a communication connection with other devices. The communication connection can be a wired connection or a wireless connection, and the wireless connection can be, but is not limited to, Bluetooth connection, wireless fidelity (Wi-Fi) (including Wi-Fi Direct), near field communication (NFC), ultrawide band (UWB) or ZigBee connection.

[0079] For example, in this embodiment of the application, the intelligent driving device 100 can communicate with a digital key via a communication device 140. The digital key is a device used to unlock and lock the intelligent driving device 100, such as a mobile phone, smartwatch, or key. The intelligent driving device 100 can receive wireless signals from the digital key via the communication device 140 and automatically unlock based on the wireless signals.

[0080] Furthermore, the intelligent driving device 100 can also communicate with the cloud via the communication device 140. For example, the intelligent driving device 100 can receive unlocking control policies from the cloud.

[0081] Some or all of the functions of the intelligent driving device 100 can be controlled by the computing platform 150. For example, the computing platform 150 may include processors 151 to 15n.

[0082] It should be understood that in the embodiments of this application, a processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a type of microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships of hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. Furthermore, a processor can also be a hardware circuit designed for artificial intelligence, which can be understood as a type of ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), or a deep learning processing unit (DPU). For the sake of brevity, this will not be elaborated further below.

[0083] In addition, the computing platform 150 may also include a memory for storing instructions, and some or all of the processors 151 to 15n may call the instructions in the memory to perform the corresponding functions.

[0084] The computing platform 150 can also control the operation of intelligent driving systems, which may include advanced driving assistance systems (ADAS) and autonomous driving systems (ADS). Intelligent driving systems utilize various sensors on the vehicle (including but not limited to: lidar, millimeter-wave radar, cameras, ultrasonic sensors, GPS, and inertial measurement units) to acquire information from the vehicle's surroundings, and analyze and process this information to achieve functions such as obstacle perception, target recognition, vehicle localization, path determination, and driver monitoring / alerts, thereby improving the safety, automation, and comfort of vehicle driving.

[0085] Under different levels of autonomous driving (or intelligent driving levels, a total of six levels from L0 to L5), based on artificial intelligence algorithms and information acquired by multiple sensors, intelligent driving systems can achieve different levels of autonomous driving assistance. The aforementioned autonomous driving levels are based on the classification standards of the Society of Automotive Engineers (SAE).

[0086] In one possible implementation, the computing platform 150 can acquire perception data from the perception system 120 and determine whether the unlocking conditions are met based on the perception data. When the computing platform 150 determines that the unlocking conditions are met, it can control the intelligent driving device 100 to unlock.

[0087] Figure 2 A schematic block diagram of an intelligent driving system 200 provided in an embodiment of this application is shown. The intelligent driving system 200 can also be understood as a system in the intelligent driving device 100, that is, the modules included in the intelligent driving device 200 can be integrated into one device; or, the modules included in the intelligent driving device 200 can belong to different devices respectively, and this embodiment of the application does not specifically limit this.

[0088] like Figure 2 As shown, system 200 includes a sensing module 210, a human-computer interaction module 220, a display module 230, a control module 240, and a communication module 250.

[0089] The sensing module 210 may include Figure 1The sensing system 120 contains one or more sensors. The sensing module 210 can process the collected environmental information to build a world model consisting of roads, obstacles, etc., for downstream modules (such as the human-machine interaction module 220, the control module 240, etc.). The sensing module 210 can send the information it collects and / or determines to the control module 240. The control module 240 can control the vehicle (or components in the vehicle) based on the information from the sensing module 210.

[0090] The human-computer interaction module 220 may include Figure 1 One or more of the display devices 130 shown may include, for example, an HMI; the human-computer interaction module 220 may also include a sound-generating device (such as a speaker, audio jack, etc.) and a sound-receiving device (such as a microphone). The display module 230 may include... Figure 1 One or more of the display devices 130 shown, display module 230 can display the vehicle interface, such as the setting interface for the locking / unlocking strategy.

[0091] The human-computer interaction module 220 can receive user input (including voice input, touch operation, etc.); and then respond to the user input by controlling the display module 230 to change the displayed interface. For example, the human-computer interaction module 220 receives user input 1; and responds to input 1 by controlling the display module 230 to display multiple unlocking methods, and... Figure 6 The interface shown is similar; when multiple unlocking methods are displayed, the human-computer interaction module 220 receives user input 2; then, in response to input 2, it sets the corresponding unlocking method.

[0092] Communication module 250 and Figure 1 Similar to the communication device 140, it can communicate with the main control device and the cloud. Please refer to the description above, which will not be repeated here.

[0093] In this embodiment of the application, the control module 240 can determine whether the unlocking conditions are met based on the sensing data from the sensing module 210; and can control the vehicle to unlock when it is determined that the unlocking conditions are met.

[0094] It should be understood that Figure 1 The intelligent driving device 100 shown is... Figure 2 The intelligent driving system 200 shown is merely an example. In real-world applications, intelligent driving devices may include more or fewer components, and intelligent driving systems may include more or fewer modules. This application does not impose specific limitations in this regard.

[0095] Currently, with the intelligent development of electronic devices, the contactless unlocking and locking function (or automatic unlocking and locking function) of devices is widely used. Taking the contactless unlocking and locking function of vehicles as an example, such as... Figure 3As shown, in a digital key system that includes a mobile phone and a vehicle, if the mobile phone establishes a short-range communication connection with the vehicle, wireless signals can be transmitted between the mobile phone and the vehicle.

[0096] It should also be understood that this description uses a mobile phone as an example. In actual application scenarios, the mobile phone can also be replaced by other smart terminals, such as tablet computers, smartwatches, smart bracelets, digital keys, etc. This application embodiment does not specifically limit this.

[0097] When a mobile phone establishes a short-range communication connection with a vehicle, the mobile phone can send wireless signals to the vehicle; correspondingly, the vehicle can receive wireless signals from the mobile phone. Furthermore, the vehicle can determine the distance between the mobile phone and the vehicle based on the wireless signals from the mobile phone, or based on the wireless signals sent from the vehicle to the mobile phone.

[0098] In one example, the vehicle can determine the distance between the mobile phone and the vehicle based on the signal strength of the wireless signal, such as received signal strength indication (RSSI); in another example, the vehicle can determine the distance between the mobile phone and the vehicle based on UWB, such as by measuring parameters such as the transmission time or phase difference of the extremely wide frequency bandwidth (typically ≥500MHz) signal.

[0099] It should be understood that in real-world applications, the distance between the vehicle and the mobile phone can be determined in other ways, and this application embodiment does not specifically limit this.

[0100] like Figure 3 As shown in (a), the vehicle automatically unlocks when it determines that the distance between the mobile phone and the vehicle is less than a preset distance of 1.

[0101] like Figure 3 As shown in (b), the vehicle automatically locks when it determines that the distance between the mobile phone and the vehicle is greater than or equal to a preset distance of 1. Here, the preset distance of 1 is a parameter preset in the vehicle.

[0102] In this way, the vehicle can automatically lock when the user leaves with their mobile phone and automatically unlock when the user approaches with their mobile phone. This enables seamless locking and unlocking of the vehicle, reducing user operations and providing a smart and convenient driving experience.

[0103] Understandable Figure 3 The automatic unlocking method shown can be understood as the default proximity-based automatic unlocking method, which can be implemented based on the vehicle's default digital key proximity-based automatic unlocking function. For the sake of simplicity, the default digital key proximity-based automatic unlocking function will not be described in detail below.

[0104] However, with such a solution, as the user moves, the real-time distance between the mobile phone and the vehicle may frequently switch between within and beyond the preset distance of 1, or the signal strength of the wireless signal may change in real time, resulting in a deviation in the calculated distance between the mobile phone and the vehicle. This causes the vehicle to frequently unlock and unlock automatically, resulting in a ping-pong unlocking problem, which affects the user experience.

[0105] To address the aforementioned issues, this application provides a control method that, when the digital key is near the vehicle, acquires user interaction data, and, if the interaction data meets the unlocking conditions, controls the vehicle to unlock based on the digital key.

[0106] Therefore, the vehicle will not unlock automatically if the digital key is near the vehicle but the unlocking conditions are not met. Unlocking conditions may include the authorized user looking at the camera for a continuous period of time or the authorized user making a first gesture.

[0107] This avoids frequent automatic unlocking issues caused by inaccurate distance determination due to user movement and real-time fluctuations in wireless signals, thus improving the reliability of vehicle unlocking and the user experience.

[0108] In some examples, such as Figure 4 The diagram shown is a schematic of a communication system applicable to the embodiments of this application, including a digital key and a vehicle.

[0109] The vehicle may include a digital key processing module, a body domain controller, a driving domain controller, a cockpit domain controller, interactive components, and door locks.

[0110] The digital key processing module can wirelessly communicate with the digital key via an antenna. It can also communicate with the body domain controller via a controller area network (CAN) bus, and with the cockpit domain controller via CAN and / or Ethernet buses. The body domain controller can communicate with the intelligent driving domain controller via CAN and / or Ethernet buses. The intelligent driving domain controller can communicate with the cockpit domain controller via CAN and / or a gigabit multimedia serial link (GMSL).

[0111] The digital key can be used to send wireless signals (such as Bluetooth signals) to the vehicle's digital key processing module. The digital key processing module can receive these wireless signals and, as the signal strength increases, send an interaction component wake-up command to the intelligent driving domain controller. The intelligent driving domain controller then activates the interaction components based on the wake-up command.

[0112] Specifically, the digital key processing module can send an interactive component wake-up command to the intelligent driving domain controller via the cockpit domain controller; alternatively, it can send the interactive component wake-up command to the intelligent driving domain controller via the body domain controller; or it can send the interactive component wake-up command to the intelligent driving domain controller via a direct-connect bus. This application does not impose specific limitations on these methods.

[0113] The interactive component can be used to collect interactive data and send it to the intelligent driving domain controller. The intelligent driving domain controller can then send this interactive data to the digital key processing module. Specifically, the intelligent driving domain controller can send the interactive data to the digital key processing module through the cockpit domain controller; alternatively, it can send the interactive data through the body domain controller; or it can send the interactive data to the digital key processing module via a direct-connect bus. This application does not impose specific limitations on these methods.

[0114] The digital key processing module can determine whether the interaction data meets the unlocking conditions. If the interaction data meets the unlocking conditions, it sends an unlocking command to the vehicle domain controller. The vehicle domain controller is then used to unlock the door locks based on the unlocking command.

[0115] Optionally, the digital key processing module can also obtain the distance between itself and the digital key, and send an unlock command to the vehicle domain controller if the interaction data meets the unlocking conditions and the distance is less than a preset threshold.

[0116] Optionally, the digital key processing module can also determine whether the authorized user is located outside the vehicle based on the interaction data. If the interaction data meets the unlocking conditions and the authorized user is located outside the vehicle, an unlocking command is sent to the vehicle domain controller.

[0117] Optionally, the digital key processing module can also acquire the distance to the digital key and determine whether the authorized user is located outside the vehicle based on the interaction data. If the interaction data meets the unlocking conditions, the distance is less than a preset threshold, and the authorized user is located outside the vehicle, an unlocking command is sent to the vehicle domain controller.

[0118] The above example uses the determination of whether the interaction data meets the unlocking conditions in the digital key processing module as an example. However, the determination of whether the interaction data meets the unlocking conditions can also be made in the vehicle domain controller, intelligent driving domain controller, or cockpit domain controller. This application embodiment does not impose specific limitations on this.

[0119] Below, taking the automatic unlocking of a first device (such as a vehicle or a device within a vehicle) as an example, combined with... Figures 5-7The control method of this application is described in detail below. The following embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The specific forms and quantities of the devices shown are merely examples and should not constitute any limitation on the implementation of the method provided in this application.

[0120] Figure 5 This is a flowchart illustrating a control method 500 provided in an embodiment of this application. Figure 5 As shown, method 500 includes the following steps:

[0121] 501. When the digital key proximity automatic unlocking function of the first device is in the off state, obtain the location information of the digital key.

[0122] Among them, the digital key proximity automatic unlocking function is the function that automatically unlocks the vehicle when the distance between the digital key and the vehicle is less than a preset distance.

[0123] Users can disable the digital key proximity automatic unlocking function in the vehicle's settings interface. The vehicle will then disable the digital key proximity automatic unlocking function based on the user's disabling action.

[0124] In one example, a user can disable the digital key proximity auto-unlock function in the vehicle's settings interface. Based on the user's disabling action, the digital key proximity auto-unlock function will switch from an on to an off state. Conversely, a user can enable the digital key proximity auto-unlock function in the vehicle's settings interface. Based on the user's enabling action, the digital key proximity auto-unlock function will switch from an off state to an on state. See below for details, which will not be elaborated upon here.

[0125] The location information of the digital key can be used to indicate the distance between the digital key and the vehicle.

[0126] For example, the vehicle can determine the distance information between the digital key and the vehicle based on the signal strength of the Bluetooth signal between the digital key and the vehicle, such as RSSI.

[0127] Alternatively, the location information of the digital key can be used to indicate the distance and direction between the digital key and the vehicle.

[0128] For example, multiple UWB antennas can be deployed in a vehicle to determine the distance and direction information between the digital key and the vehicle based on the UWB signal between the digital key and the vehicle.

[0129] 502. When the digital key is close to the first device, collect interactive data through the interactive components in the first device.

[0130] The vehicle can obtain the location information of the digital key. When the distance between the vehicle and the digital key gets closer and closer, it means that the digital key is approaching the vehicle. The vehicle can then wake up the interaction component and collect interaction data through the interaction component.

[0131] Alternatively, if the distance between the digital key and the vehicle is less than a certain threshold, the vehicle can wake up the interaction component and collect interaction data through the interaction component.

[0132] This certain threshold can be determined based on experience or experimentation, such as 10m, 15m, etc., and this application embodiment does not impose specific restrictions on it.

[0133] The interactive components may include one or more of the following: a camera component, a sound acquisition component, and a tactile sensor component. Correspondingly, the interactive data may include image data, audio data, or tactile data. The camera component may be a red-green-blue (RGB) camera.

[0134] Optionally, the interaction data may include the user's biometric data, such as facial data, iris data, fingerprint data, user gestures, or voiceprint data. Alternatively, the interaction data may also include capacitive sensor data, knock-knock (KK) interaction data, pressure-sensitive data, etc.

[0135] 503. When the interaction data meets the unlocking conditions, the first device unlocks based on the digital key.

[0136] The unlocking conditions may be set by the R&D personnel before the vehicle leaves the factory, or they may be set by the vehicle owner or other users. This application embodiment does not impose specific restrictions on this.

[0137] For example, unlocking conditions include setting authorized users to perform specific actions.

[0138] Authorized users can be understood as individuals who are authorized to unlock the vehicle. This could include the vehicle owner, their family members, or other users. Authorized users' facial data, iris data, fingerprint data, user actions, voiceprint data, capacitive sensor data, tap interaction data, and pressure-sensitive data can be pre-recorded in the vehicle data.

[0139] Specific actions can include looking at the B-pillar camera for 2 seconds, or raising your hand to greet someone. Alternatively, there may be other unlocking conditions; please refer to the following text for details.

[0140] In this way, when the digital key is close to the vehicle and the interaction data meets the unlocking conditions, the vehicle will be unlocked. This avoids frequent automatic unlocking caused by inaccurate distance judgment due to user movement or real-time fluctuations in wireless signal, improving the reliability of the vehicle unlocking function and the user experience.

[0141] Optionally, if the interaction data does not meet the unlocking conditions, the interaction component can continue to collect interaction data and obtain the location information of the digital key. If the location of the digital key is far away from the vehicle, the collection of interaction data will stop, and the interaction component can enter a sleep state or a closed state.

[0142] Alternatively, the collection of interaction data can be stopped when the distance between the digital key and the vehicle exceeds a preset threshold. This preset threshold can be determined based on experience or experimentation. If the distance between the digital key and the vehicle exceeds this preset threshold, it can be assumed that the user carrying the digital key is merely passing by the vehicle and has no intention of unlocking it, thus the vehicle will not be unlocked.

[0143] Alternatively, the collection of interaction data can stop after the user unlocks the vehicle using other methods. For example, the user could physically insert the digital key into the corresponding lock cylinder to unlock the vehicle via mechanical triggering.

[0144] In some examples, the vehicle can collect first interaction data and second interaction data through the interaction components in the first device.

[0145] At least one of the first and second interaction data is used to obtain user identity information contained in the interaction data; at least one of the first and second interaction data is also used to perform intent verification to determine that the other interaction data meets the non-false triggering condition.

[0146] If the user identity information indicates that the user is an authorized user, and the intent verification indicates that the user has the intent to unlock (that is, the authorized user meets the non-false triggering conditions), then the first interaction data and the second interaction data meet the unlocking conditions.

[0147] Optionally, the first interactive data and the second interactive data can be of the same type.

[0148] For example, if the interaction component is a camera component, both the first and second interaction data can be image data. Alternatively, if the interaction component is a sound acquisition component, both the first and second interaction data can be audio data. Or, if the interaction component is a tactile sensor component, both the first and second interaction data can be tactile data.

[0149] The first interactive data and the second interactive data can be the same data, or in other words, the first interactive data and the second interactive data are the same data.

[0150] For example, the first interaction data and the second interaction data can both be image data A. Image data A can be used to obtain user identity information or to perform intent verification.

[0151] It is understood that image data A can be used first to obtain user identity information and then to perform intent verification; or image data A can be used first to perform intent verification and then to obtain user identity information; or image data A can be used simultaneously to obtain user identity information and perform intent verification. This application embodiment does not impose specific limitations on this.

[0152] Alternatively, the first interactive data and the second interactive data can be different data, or in other words, the first interactive data and the second interactive data are data acquired at different times.

[0153] Specifically, the time interval between acquiring the first interaction data and acquiring the second interaction data is less than a time threshold. This time threshold can be obtained based on experience or experiments. When the time interval between acquiring the first interaction data and acquiring the second interaction data is less than the time threshold, the first interaction data and the second interaction data can be considered as data acquired at adjacent times, which can be used to collaboratively verify user identity information and intent, reducing verification errors.

[0154] For example, the first interactive data can be image data A, and the second interactive data can be image data B. Image data A can be used to obtain user identity information, and image data B can be used for intent verification. Alternatively, image data A can be used to obtain user identity information, and both image data A and image data B can be used for intent verification. This application does not impose specific limitations in this regard.

[0155] It is understood that image data A and image data B can be image frames acquired at different times. This application embodiment does not impose a specific limitation on the acquisition order of image data A and image data B.

[0156] In some examples, the control method of this application embodiment is described using the camera component as the interactive component and the same image data as the first interactive data and the second interactive data as examples.

[0157] The camera components may include one or more of the following: a B-pillar camera, a front-view monocular camera, a front-view binocular camera, a surround-view fisheye camera, a rear-view reversing camera, a side blind spot camera, a rear-end high-definition sensing camera, a windshield streaming media camera, and a rearview mirror streaming media camera. This application embodiment does not impose specific limitations on these components.

[0158] This application uses a B-pillar camera as an example to illustrate the embodiments.

[0159] In one scenario, the unlocking condition includes the authorized user gazing at the B-pillar camera for a sustained duration of a first time. Alternatively, the authorized user's sustained gaze at the B-pillar camera must be greater than or equal to the first duration.

[0160] The first duration can be determined based on experience or experiments. If an authorized user gazes at the B-pillar camera for a continuous first duration, it can be considered that the authorized user is preparing to open the car door, has the intention to unlock, and meets the unlocking conditions. If an authorized user gazes at the B-pillar camera for less than the first duration, it can be considered that the authorized user may have only glanced at the B-pillar camera, does not have the intention to unlock, and does not meet the unlocking conditions.

[0161] For example, the first duration can be 2 seconds, or 2.5 seconds, etc.

[0162] The B-pillar camera can capture image data. When the image data includes the user's view, it identifies whether the user is an authorized user and determines whether the user has been looking at the B-pillar camera for a continuous period of time. If the user is an authorized user and has been looking at the B-pillar camera for a continuous period of time, the unlocking conditions are met, and the vehicle can be unlocked.

[0163] It is understandable that the B-pillar camera can collect image data, which can be multi-frame image data, or video data, and the duration of the video data collection is greater than or equal to the first duration.

[0164] Optionally, the vehicle may store the facial data of authorized users, and the system can identify whether a user is an authorized user by comparing the stored facial data of authorized users with the collected facial data of users.

[0165] Alternatively, the vehicle can store the iris data of authorized users, and the system can compare the stored iris data of authorized users with the collected iris data of users to identify whether the user is an authorized user.

[0166] Alternatively, the vehicle can store the gait information of authorized users. The user's gait information can be determined from the dynamic features of the user's walking posture in multi-frame image data. The stored gait information of authorized users can be compared with the collected gait information of users to identify whether the user is an authorized user.

[0167] Alternatively, the vehicle may identify whether the user is an authorized user through a combination of the above methods, or it may identify whether the user is an authorized user from the collected image data through other methods. This application embodiment does not impose specific limitations on this.

[0168] In another scenario, unlocking requires the authorized user to perform a first gesture.

[0169] The B-pillar camera can capture image data. When the image data includes the user's view, it identifies whether the user is an authorized user and determines whether the user is making a first gesture. If the user is an authorized user and is making the first gesture while looking at the camera, the unlocking conditions are met, and the vehicle can be unlocked.

[0170] It is understandable that the image data captured by the B-pillar camera can be multi-frame image data, or it can also be called video data.

[0171] The first gesture can be a "greeting" gesture. Specifically, the user raises their arm to a preset height, with their palm facing the B-pillar camera, and then moves their arm slightly left and right.

[0172] Alternatively, the first gesture can be an arm raised in an "OK" shape. Specifically, the user raises their arm upwards, with the tips of the thumb and index finger touching to form a closed loop, while the other three fingers extend naturally.

[0173] Alternatively, the first gesture can be other gestures, such as raising the arm and making a scissor gesture with the fingers, etc. This application embodiment does not impose specific limitations on this.

[0174] In other examples, taking the interactive component as the sound acquisition component and the first interactive data and the second interactive data as the same voiceprint data as an example, the control method of the embodiments of this application will be introduced.

[0175] Alternatively, the sound acquisition components may be, for example, an in-vehicle microphone, an in-vehicle micro-electro-mechanical system (MEMS) acoustic sensor, or an in-vehicle pickup array.

[0176] This application uses a vehicle-mounted microphone as an example to illustrate the embodiments of the sound acquisition component.

[0177] In one scenario, the unlocking condition includes authorizing the user to speak for a second consecutive duration.

[0178] The second duration can be determined based on experience or experimentation. If the authorized user speaks for the second duration, it can be assumed that the authorized user is preparing to open the car door and has the intention to unlock it, thus meeting the unlocking conditions. If the authorized user speaks for less than the second duration (or does not speak), it can be assumed that the authorized user may have simply passed by the vehicle and does not have the intention to unlock it, thus not meeting the unlocking conditions.

[0179] For example, the second duration could be 2 seconds, or 2.5 seconds, etc.

[0180] The vehicle-mounted microphone can collect audio data and process it to obtain voiceprint data. Based on the voiceprint data, it identifies whether the user making the sound is an authorized user and determines whether the collection duration of the voiceprint data is greater than or equal to a second duration. If the user making the sound is identified as an authorized user and the collection duration of the voiceprint data is greater than or equal to the second duration, the unlocking conditions are met, and the vehicle can be unlocked.

[0181] Optionally, the vehicle may store the voiceprint data of authorized users, and the user may be identified as an authorized user by comparing the stored voiceprint data of authorized users with the collected voiceprint data of users.

[0182] In another scenario, unlocking conditions include authorizing the user to output a preset voice message.

[0183] The preset voice can be set by the R&D personnel or the user. For example, the preset voice can be "unlock" or "unlock vehicle", and this application embodiment does not impose specific limitations on this.

[0184] The vehicle-mounted microphone can collect audio data and process it to obtain voiceprint data and voice data. Based on the voiceprint data, it identifies whether the user speaking is an authorized user and whether the voice data matches a preset voice. If the user speaking is identified as an authorized user and the voice data matches the preset voice, the unlocking conditions are met, and the vehicle can be unlocked.

[0185] In other examples, taking the interactive component as a tactile sensor component and the first interactive data and the second interactive data as the same tactile data as examples, the control method of the embodiments of this application will be described.

[0186] Optionally, the tactile sensor component can be a capacitive fingerprint sensor, a capacitive touch sensor, a pressure sensor, a piezoelectric sensor, or a vibration sensor, etc., and the embodiments of this application do not impose specific limitations.

[0187] The tactile sensor assembly can be deployed at the door handle of the vehicle. For example, the tactile sensor assembly can be installed on the inside of the door handle as the sensing area for unlocking the vehicle, while a groove can be provided on the outside of the door handle for locking. Alternatively, the tactile sensor assembly can be deployed in other locations on the vehicle, such as the front or rear of the vehicle. This application embodiment does not impose specific limitations on this.

[0188] Unlocking conditions include authorizing a user to touch the haptic sensor component for a certain period of time, or authorizing a user to tap the haptic sensor component according to a certain pattern.

[0189] In one scenario, a capacitive fingerprint sensor deployed at the door handle of a vehicle is used as an example. The unlocking condition includes an authorized user touching the capacitive fingerprint sensor for a continuous third duration.

[0190] The third duration can be determined based on experience or experiments. If an authorized user touches the capacitive fingerprint sensor for a continuous third duration, it can be considered that the authorized user is preparing to open the car door, has the intention to unlock, and meets the unlocking conditions. If the authorized user touches the capacitive fingerprint sensor for less than a third duration (or does not touch it), it can be considered that the authorized user may have only accidentally touched it, does not have the intention to unlock, and does not meet the unlocking conditions.

[0191] For example, the third duration could be 2 seconds, or 2.5 seconds, etc.

[0192] A capacitive fingerprint sensor can collect tactile data, such as fingerprint data, and determine the touch duration. Based on the fingerprint data, it identifies whether the user is authorized and determines whether the touch duration is greater than or equal to a third duration. If the user is identified as authorized and the touch duration is greater than or equal to the third duration, the unlocking conditions are met, and the vehicle can be unlocked.

[0193] Optionally, the vehicle may store the fingerprint data of authorized users, and the system can identify whether a user is an authorized user by comparing the stored fingerprint data of authorized users with the collected fingerprint data of users.

[0194] In another scenario, taking a vibration sensor deployed at the front of the vehicle as an example, the unlocking condition includes an authorized user tapping the vibration sensor a preset number of times. Alternatively, the unlocking condition includes the user's tapping interaction data (i.e., tactile data), which is the preset number of taps on the vibration sensor.

[0195] The preset number of taps can be set by the user, such as 2 taps or 3 taps, etc. This application embodiment does not impose specific limitations on this.

[0196] Vibration data (which can also be understood as tapping interaction data) can be collected using vibration sensors. The tapping force and / or rhythm of the user are calculated based on the vibration data. The user's authorization is determined based on the tapping force and / or rhythm, and the number of taps is checked against a preset limit. If the user is identified as authorized and the preset number of taps is met, the unlocking conditions are satisfied, and the vehicle can be unlocked.

[0197] Optionally, the vehicle may store the tapping force and / or tapping rhythm information of authorized users. Based on the comparison between the stored tapping force and / or tapping rhythm information of authorized users and the collected tapping force and / or tapping rhythm information of users, it can be identified whether the user is an authorized user.

[0198] The tapping rhythm can represent the user's tapping frequency, such as tapping twice within 3 seconds or tapping twice within 4 seconds.

[0199] The above embodiments describe a scenario where the first interactive data and the second interactive data are of the same type, specifically, one of image data, audio data, or tactile data. In other examples, the first interactive data and the second interactive data can be of different types. Furthermore, the first interactive data and the second interactive data can also be two or more of the following: image data, audio data, or tactile data.

[0200] The time interval between acquiring the first interaction data and acquiring the second interaction data is less than a time threshold, thereby coordinating user identity verification and intent verification to reduce verification errors.

[0201] For example, the interactive component includes a camera component and a sound acquisition component, where the first interactive data can be image data and the second interactive data can be audio data. Alternatively, the interactive component includes a camera component and a tactile sensor component, where the first interactive data can be image data and the second interactive data can be tactile data. Or, the interactive component includes a sound acquisition component and a tactile sensor component, where the first interactive data can be audio data and the second interactive data can be tactile data.

[0202] Alternatively, the interactive components may include a camera component, a sound acquisition component, and a tactile sensor component. The first interactive data may be image data and audio data, and the second interactive data may be tactile data, etc. This application does not impose specific limitations on this.

[0203] In this embodiment, the first interaction data can be used to obtain user identity information, and the second interaction data can be used to perform intent verification. Alternatively, both the first and second interaction data can be used to obtain user identity information, and the second interaction data can be used to perform intent verification. Or, the first interaction data can be used to obtain user identity information, and both the first and second interaction data can be used to perform intent verification, etc. This application does not impose specific limitations in these embodiments.

[0204] It is understood that the naming of the first and second interactive data is only to distinguish between different data, and does not limit the specific content of the data.

[0205] In one scenario, the first interaction data can be image data, and the second interaction data can be tactile data. The first interaction data is used to obtain user identity information, and the second interaction data is used for intent verification.

[0206] Taking the B-pillar camera as an example and the capacitive touch sensor deployed on the door handle of the vehicle as an example, the unlocking conditions include an authorized user touching the capacitive touch sensor for a continuous period of four hours.

[0207] The fourth duration can be determined based on experience or experiments. If an authorized user touches the capacitive touch sensor for a continuous fourth duration, it can be considered that the authorized user is preparing to open the car door and has the intention to unlock, thus meeting the unlocking conditions. If the authorized user touches the capacitive touch sensor for less than a fourth duration (or does not touch it at all), it can be considered that the authorized user may have only accidentally touched it and does not have the intention to unlock, thus not meeting the unlocking conditions.

[0208] For example, the fourth duration can be 2 seconds, or 2.5 seconds, etc.

[0209] Image data is captured by a camera on the B-pillar, and touch data is collected by a capacitive touch sensor. When the image data includes the user's image, the system identifies whether the user is authorized. Based on the touch data, the system determines the duration of the user's touch and checks if the touch duration is greater than or equal to a fourth duration. If the user is identified as authorized and the touch duration is determined to be greater than or equal to a fourth duration, the unlocking conditions are met, and the vehicle can be unlocked.

[0210] Optionally, the vehicle may store the facial data of authorized users, and the system can identify whether a user is an authorized user by comparing the stored facial data of authorized users with the collected facial data of users.

[0211] In another scenario, the first interaction data can be audio data, and the second interaction data can be tactile data. The first interaction data is used to obtain user identity information, and the second interaction data is used for intent verification.

[0212] Taking the sound acquisition component as an example, such as an in-vehicle microphone, and the tactile sensor component as a capacitive touch sensor deployed at the door handle of the vehicle, the unlocking conditions include an authorized user touching the capacitive touch sensor for a continuous period of time.

[0213] The vehicle-mounted microphone can collect audio data and process it to obtain voiceprint data. A capacitive touch sensor can also collect touch data. Based on the voiceprint data, the system identifies whether the user is authorized; and based on the touch data, it determines the duration of the user's touch, checking if the touch duration is greater than or equal to a fourth duration. If the user is identified as authorized and the touch duration is greater than or equal to a fourth duration, the unlocking conditions are met, and the vehicle can be unlocked.

[0214] Optionally, the vehicle may store the voiceprint data of authorized users, and the user may be identified as an authorized user by comparing the stored voiceprint data of authorized users with the collected voiceprint data of users.

[0215] Alternatively, the interaction data may include image data and audio data, and the unlocking conditions are determined based on the image data and audio data. Alternatively, the interaction data may include image data, audio data, and tactile data, and the unlocking conditions are determined based on the image data, audio data, and tactile data. Alternatively, the interaction data may also include other data, which are not specifically limited in this embodiment.

[0216] In another scenario, the first interactive data can be image data, and the second interactive data can be audio data.

[0217] Optionally, the first interaction data and the second interaction data can be used to obtain user identity information, and the second interaction data can be used to perform intent verification.

[0218] Taking a B-pillar camera as an example and a car microphone as an example for sound acquisition components, the unlocking conditions may include authorizing a user to speak for a second duration.

[0219] Image data is captured via a B-pillar camera. If the image data includes the user's image, the system identifies whether the user is an authorized user. Audio data is captured via a vehicle microphone and processed to obtain voiceprint data. The system then identifies whether the user speaking is an authorized user based on the voiceprint data. If the user is identified as an authorized user based on both image data and / or voiceprint data, the user is confirmed as an authorized user.

[0220] Simultaneously, it is determined whether the collection duration corresponding to the voiceprint data is greater than or equal to the second duration. If the user is an authorized user and the collection duration corresponding to the voiceprint data is greater than or equal to the second duration, the unlocking conditions are met, and the vehicle can be unlocked.

[0221] Alternatively, the first and second interaction data can be used to obtain user identity information, with the first interaction data used for intent verification.

[0222] Taking the B-pillar camera as an example and the car microphone as an example for sound acquisition, the unlocking conditions may include authorizing the user to look at the B-pillar camera for a continuous period of time.

[0223] Image data is captured via a B-pillar camera. If the image data includes the user's image, the system identifies whether the user is an authorized user. Audio data is captured via a vehicle microphone and processed to obtain voiceprint data. The system then identifies whether the user speaking is an authorized user based on the voiceprint data. If the user is identified as an authorized user based on both image data and / or voiceprint data, the user is confirmed as an authorized user.

[0224] Simultaneously, based on image data, it is determined whether the user has been looking at the B-pillar camera for a continuous period of time. If the user is an authorized user and has been looking at the B-pillar camera for a continuous period of time, the unlocking conditions are met, and the vehicle can be unlocked.

[0225] Alternatively, the first interaction data can be used to obtain user identity information, and the first interaction data and the second interaction data can be used for intent verification.

[0226] Taking a B-pillar camera as an example and a car microphone as an example for sound acquisition components, the unlocking conditions may include an authorized user looking at the B-pillar camera for a continuous duration and the authorized user outputting a preset voice.

[0227] Image data is captured by a camera on the B-pillar. When the image data includes the user's view, the system identifies whether the user is an authorized user. Simultaneously, based on the image data, it determines whether the user has been looking at the B-pillar camera for a specific duration.

[0228] The vehicle-mounted microphone can collect audio data and process it to obtain voice data. It can then identify whether the voice data is a preset voice.

[0229] If the user is identified as an authorized user, the user gazes at the B-pillar camera for a continuous duration, and the voice data is the preset voice, the unlocking conditions are met, and the vehicle can be unlocked.

[0230] Alternatively, the first and second interaction data can be used to obtain user identity information, and the first and second interaction data can be used for intent verification.

[0231] Taking a B-pillar camera as an example and a car microphone as an example for sound acquisition components, the unlocking conditions may include an authorized user looking at the B-pillar camera for a continuous duration and the authorized user outputting a preset voice.

[0232] Image data is captured by a camera on the B-pillar. When the image data includes the user's view, the system identifies whether the user is an authorized user. Simultaneously, based on the image data, it determines whether the user has been looking at the B-pillar camera for a specific duration.

[0233] The vehicle-mounted microphone can collect audio data and process it to obtain voiceprint data and voice data. Based on the voiceprint data, it identifies whether the user speaking is an authorized user and whether the voice data is a preset voice.

[0234] If the user is identified as an authorized user based on both image data and voiceprint data, then the user is determined to be an authorized user.

[0235] If the user is identified as an authorized user, the user gazes at the B-pillar camera for a continuous duration, and the voice data is the preset voice, the unlocking conditions are met, and the vehicle can be unlocked.

[0236] The above embodiments describe how to determine whether the first and second interactive data meet the unlocking conditions when the first and second interactive data are different types of data. The first and second interactive data can also be other types of data, which will not be elaborated upon in this embodiment.

[0237] The above embodiments describe the process of unlocking the vehicle when the interaction data meets the unlocking conditions. In other examples, the vehicle can also determine the distance between the digital key and the vehicle, and if the distance is less than a preset threshold and the interaction data meets the unlocking conditions, the vehicle will be unlocked. This further verifies that the user carrying the digital key intends to unlock the vehicle, improving the reliability of vehicle unlocking.

[0238] The preset threshold can be determined based on experience or experimentation, such as 2m or 3m, and this embodiment does not impose specific limitations on it. When the distance between the digital key and the vehicle is less than the preset threshold, it indicates that the user carrying the digital key is close to the vehicle and has the intention to unlock it.

[0239] Optionally, the vehicle can determine the distance between the digital key and the vehicle based on the signal strength of the wireless signal between the two keys, such as RSSI.

[0240] In some scenarios, when the digital key communicates with the vehicle via Bluetooth, the Bluetooth signal is susceptible to environmental interference and cannot accurately locate the spatial position of the digital key, making it impossible to distinguish whether the digital key is located inside or outside the vehicle.

[0241] The vehicle can also determine whether an authorized user is located outside the vehicle based on interaction data, thereby determining whether to unlock the vehicle. If it is determined that the authorized user is located outside the vehicle and the interaction data meets the unlocking conditions, the vehicle will be unlocked.

[0242] For example, when the interaction data is image data, if the image data includes the user's image, the user is an authorized user, and the user is located on the outside of the vehicle, then the vehicle can be unlocked.

[0243] For example, when the interaction data is tactile data, since the tactile sensor components are deployed on the outside of the vehicle, when the tactile sensor components collect the user's tactile data, it means that the user is on the outside of the vehicle and can control the vehicle to unlock.

[0244] Alternatively, if the digital key communicates with the vehicle via UWB, the positional relationship between the digital key and the vehicle can be accurately determined through the UWB signal, thereby determining whether the user carrying the digital key is located outside the vehicle.

[0245] Thus, when the interaction data meets the unlocking conditions and the authorized user is located outside the vehicle, unlocking the vehicle based on the digital key can improve the accuracy of vehicle unlocking.

[0246] In some examples, there can be N interactive components in the vehicle, and the collected interactive data also corresponds to N data streams, where N is an integer greater than or equal to 1.

[0247] Optionally, if one of the N interactive data sets meets the unlocking conditions, the vehicle can be unlocked using a digital key.

[0248] For example, if the interaction component is a B-pillar camera, the vehicle is equipped with a left B-pillar camera and a right B-pillar camera (the left side can be the left side of the vehicle, i.e. the driver's side, and the right side can be the right side of the vehicle, i.e. the passenger's side). When the digital key is close to the vehicle, it can wake up these two B-pillar cameras, thereby collecting two channels of interaction data.

[0249] For example, vehicle owner A and accompanying person B approach the vehicle simultaneously. Vehicle owner A, carrying a digital key, moves towards the driver's side, while accompanying person B moves towards the passenger side. Both vehicle owner A and accompanying person B are authorized users of the vehicle.

[0250] With the digital key positioned near the vehicle, the left and right B-pillar cameras are activated. The left B-pillar camera captures image data including the vehicle owner (A), while the right B-pillar camera captures image data including passenger B. If either set of image data meets the unlocking conditions, the vehicle is unlocked using the digital key.

[0251] Optionally, the vehicle can also perform weighted summation and / or confidence processing on the N-way interaction data to determine whether the interaction data meets the unlocking conditions.

[0252] For example, if the interaction component is an in-vehicle microphone, then there are multiple in-vehicle microphones in the vehicle. When the digital key is close to the vehicle, these multiple in-vehicle microphones can be activated, thereby collecting multiple interaction data.

[0253] When the user outputs voice, multiple in-vehicle microphones can collect the user's voice information. The weight of the audio data collected by each in-vehicle microphone is determined based on the distance between the in-vehicle microphone and the user, and then a weighted calculation is performed to determine whether the audio data meets the unlocking conditions.

[0254] In some examples, users can set the vehicle's unlocking method in the vehicle's unlocking policy settings interface. Different unlocking methods have different unlocking conditions. The system responds to user input and sets the corresponding unlocking method. User input can be touch input, voice input, or input via an external device.

[0255] For example, such as Figure 6 The diagram shown is a schematic of the vehicle unlocking strategy setting interface provided in an embodiment of this application. Unlocking methods may include: automatic unlocking upon proximity, unlocking by looking at the B-pillar camera, first gesture unlocking, voiceprint unlocking, tap unlocking, or fingerprint unlocking.

[0256] Among them, when the automatic unlocking function is turned off when the digital key is near, other unlocking methods can be set in response to user input.

[0257] For example, in response to a user's input indicating that they want to unlock by looking at the B-pillar camera, the vehicle can be configured to unlock if the user looks at the B-pillar camera for a continuous period of time. Thus, when the digital key approaches the vehicle, the B-pillar camera is activated, and the vehicle unlocks if the image data captured by the B-pillar camera indicates that the user should look at it for the specified duration.

[0258] Optionally, multiple unlocking methods can be set in the vehicle at the same time.

[0259] For example, in response to a user's input of looking at the B-pillar camera to unlock or using a first gesture to unlock, the vehicle can be configured to unlock when the user looks at the B-pillar camera for a continuous period of time; and unlock when the user performs a first gesture. Thus, when the digital key approaches the vehicle, the B-pillar camera is activated, and the vehicle unlocks when image data captured by the B-pillar camera indicates that the user should look at the camera for a continuous period of time; and / or when image data captured by the B-pillar camera indicates that the user should perform a first gesture.

[0260] Optionally, users can also set the first duration for each unlocking method, the specific gesture of the first gesture, and the specific sensors of the interactive components. For example, the vehicle can respond to the user's input and set the specific gesture for the first gesture, such as a "greeting" gesture or an "OK" shape gesture. This application embodiment does not impose specific limitations on this.

[0261] Optionally, the vehicle can also respond to user input and customize the unlocking method; this application embodiment does not impose specific limitations on this.

[0262] The above embodiments describe the situation where the unlocking method is set on the vehicle side. Optionally, the vehicle unlocking method can also be set on the digital key side (such as a mobile phone). This application embodiment does not impose specific limitations on this.

[0263] In some examples, this application embodiment uses the unlocking method of looking at the B-pillar camera and the digital key as a Bluetooth digital key as an example to introduce the control method of this application embodiment.

[0264] It is understandable that before unlocking the vehicle, the vehicle is stationary, in Park (P) gear, not in motion, and the vehicle's digital key proximity unlock function is disabled, while the B-pillar camera unlock function is enabled. The B-pillar camera in the vehicle is functioning normally, and communication between the vehicle and the digital key is normal. For example... Figure 7 As shown, method 700 includes the following steps:

[0265] S01. The vehicle detects the digital key approaching and activates the B-pillar camera.

[0266] Optionally, the vehicle's Bluetooth module can automatically broadcast Bluetooth signals, while the digital key's Bluetooth module continuously scans for nearby Bluetooth signals and can collect the Bluetooth signals broadcast by the vehicle. After recognizing that the Bluetooth signal is a signal broadcast by a paired vehicle, both parties automatically initiate a link handshake authentication, verify the pairing key to complete identity verification, and then synchronously establish a data transmission channel, ultimately achieving automatic Bluetooth connection between the vehicle and the digital key.

[0267] After the vehicle establishes a Bluetooth connection with the digital key, the vehicle can determine the distance between itself and the digital key based on the signal strength of the Bluetooth signal. As the distance gets closer, the B-pillar camera is activated.

[0268] S702, the vehicle collects image data through the B-pillar camera.

[0269] Optionally, the vehicle is equipped with two B-pillar cameras, which can simultaneously collect two channels of image data.

[0270] S703, The vehicle determines that the image data meets the unlocking conditions.

[0271] S704, the distance between the vehicle and the digital key is determined to be less than a preset threshold.

[0272] S705. The vehicle obtains the location of the authorized user and determines that the authorized user is located outside the vehicle.

[0273] S706, Vehicle unlocked.

[0274] The execution order of S703-S705 is only one example. The execution order of S703-S705 can also be other, such as S704, S703, S705, etc. This application embodiment does not impose specific restrictions on this.

[0275] For details regarding the content of method 700, please refer to the above text; it will not be repeated here.

[0276] Thus, the vehicle unlocks when the digital key is close to the vehicle, meets the unlocking conditions, the distance between the vehicle and the digital key is less than a preset threshold, and the authorized user is located outside the vehicle. This avoids frequent automatic unlocking caused by inaccurate distance judgment due to user movement or real-time fluctuations in wireless signals, improving the reliability of vehicle unlocking and the user experience.

[0277] It should be noted that, in the embodiments of this application, all steps in the accompanying drawings are merely examples, and the order of the numbers of the methods described above does not imply the order of execution and should not constitute any limitation on the embodiments of this application. For example, in practical applications, the execution order of the steps shown in this application can be adjusted, and some steps can be added or removed; the embodiments of this application do not limit this.

[0278] The above text combined Figures 5 to 7 The control method of the embodiments of this application is described in detail below, in conjunction with Figure 8 and Figure 9This application describes in detail the control device according to embodiments of the present application. The control device includes modules or units for executing each part of the above embodiments. The modules or units shown may be software or hardware, or hardware, or a combination of software and hardware. The control device is only briefly illustrated below; for details of the implementation, please refer to the description of the foregoing method embodiments, which will not be repeated below.

[0279] Figure 8 This is a schematic block diagram of a control device 800 provided in an embodiment of this application. Figure 8 As shown, the device 800 includes an acquisition module 801 and a control module 802.

[0280] In one possible implementation, the device 800 is used to implement the steps performed by the vehicle in the above method embodiments.

[0281] The acquisition module 801 is used to acquire the location information of the digital key when the automatic unlocking function of the first device is turned off.

[0282] The acquisition module 801 is also used to collect interactive data through the interactive components in the first device when the digital key is close to the first device.

[0283] The control module 802 is used to control the first device to unlock based on the digital key when the interaction data meets the unlocking conditions.

[0284] It should be understood that the device 800 here is embodied in the form of a functional module. The term "module" here can refer to application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors) and memory for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components supporting the described functionality. For example, when a module is implemented in the form of processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU), or other processors capable of calling program code, such as a controller. Furthermore, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0285] In an optional example, those skilled in the art will understand that the device 800 may specifically be the control device in the above embodiments. The device 800 may be used to execute the various processes and / or steps corresponding to the control device in the above method embodiments. To avoid repetition, it will not be described again here.

[0286] The aforementioned device 800 has the function of implementing the corresponding steps executed by the control device in the aforementioned method; the aforementioned function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned function. In an embodiment of this application, Figure 8 The device 800 in the middle can also be a chip.

[0287] Figure 9 A schematic block diagram of a control device 900 provided in an embodiment of this application is shown. The device 900 can be a chip system; or it can be an apparatus configured with a chip system to implement the methods shown in the above method embodiments. In this embodiment, the chip system can be composed of chips, or it can include chips and other discrete devices.

[0288] like Figure 9 As shown, the device 900 may include a processor 910, which can be used to execute computer programs or instructions in memory to perform the various steps and / or processes corresponding to the control device in the above method embodiments.

[0289] In one possible implementation, the device 900 further includes a communication interface 920. The communication interface 920 can be used to communicate with other devices via a transmission medium, thereby enabling the device 900 to communicate with other devices. The communication interface 920 may be, for example, a transceiver, an input / output interface, a pin, a bus, a transceiver circuit, or a device capable of transmitting and receiving functions. The processor 910 can utilize the communication interface 920 to input and output data for executing the various steps and / or processes corresponding to the control device in the above method embodiments.

[0290] In one possible implementation, the device 900 further includes at least one memory 930 for storing program instructions and / or data. The memory 930 is coupled to the processor 910. The coupling in this embodiment is an indirect coupling or communication connection between devices, units, or modules, and can be electrical, mechanical, or other forms, for information exchange between devices, units, or modules. The processor 910 may operate in conjunction with the memory 930. The processor 910 may execute program instructions stored in the memory 930.

[0291] Optionally, the memory 930 may be a memory disposed in the device 900. Exemplarily, the memory 930 may be integrated with the processor 910; or, the memory 930 may be disposed separately from the processor 910.

[0292] Optionally, memory 930 may be memory outside of device 900. It may also be memory outside of device 900.

[0293] This application provides an electronic device, which includes a processor and a memory; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, causing the electronic device to perform the above-described method.

[0294] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0295] This application provides a vehicle equipped with a control device and an anti-skid device. The anti-skid device is described above, and the control device is capable of performing the above-described method.

[0296] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0297] In one possible implementation, a computer-readable medium may include random access memory (RAM), read-only memory (ROM), compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage or other magnetic storage devices, or any other medium intended to carry or store required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0298] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0299] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0300] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

[0301] It is understood that, in the embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

Claims

1. A control method, characterized in that, include: When the automatic unlock function of the digital key is turned off, the location information of the digital key is obtained. When the digital key is located close to the first device, interactive data is collected through the interactive components in the first device. If the interaction data meets the unlocking conditions, the first device is unlocked based on the digital key.

2. The method according to claim 1, characterized in that, The step of collecting interactive data through the interactive components in the first device includes: The first interaction data and the second interaction data are collected through the interaction component in the first device; at least one of the first interaction data and the second interaction data is used to obtain the user identity information contained in the interaction data; at least one of the first interaction data and the second interaction data is also used to perform intent verification to determine that the other interaction data meets the non-false triggering condition.

3. The method according to claim 1 or 2, characterized in that, The interactive data satisfies the unlocking conditions, including: The interactive data includes image data, which includes the user's image. If the image data indicates that the user is an authorized user, and the user gazes at the interactive component for a continuous period of time, the interactive data satisfies the unlocking condition. Alternatively, if the image data indicates that the user is an authorized user and the user performs a first gesture, the interaction data satisfies the unlocking conditions.

4. The method according to any one of claims 1-3, characterized in that, The interactive data satisfies the unlocking conditions, including: The interaction data includes voiceprint data, which includes the user's voiceprint. If the voiceprint data indicates that the user is an authorized user, and the collection duration corresponding to the voiceprint data is greater than or equal to the second duration, the interaction data satisfies the unlocking conditions.

5. The method according to any one of claims 1-4, characterized in that, The step of controlling the first device to unlock based on the digital key when the interaction data meets the unlocking conditions further includes: If the interaction data satisfies the unlocking conditions and the distance between the digital key and the first device is less than a preset threshold, the first device is unlocked based on the digital key.

6. The method according to any one of claims 1-5, characterized in that, The step of controlling the first device to unlock based on the digital key when the interaction data meets the unlocking conditions further includes: When the interaction data meets the unlocking conditions and the authorized user is located outside the first device, the first device can be unlocked using the digital key.

7. The method according to any one of claims 1-6, characterized in that, When the interaction data includes N channels of interaction data, the step of controlling the first device to unlock based on the digital key when the interaction data meets the unlocking conditions includes: If one of the N interactive data streams meets the unlocking conditions, the first device is unlocked based on the digital key.

8. The method according to any one of claims 1-7, characterized in that, When the digital key is located near the first device, it also includes: The interactive component is activated.

9. The method according to any one of claims 1-8, characterized in that, The interactive components include one or more of the following: a camera component, a sound acquisition component, and a tactile sensor component.

10. The method according to claim 9, characterized in that, The camera assembly includes a B-pillar camera.

11. A control device, characterized in that, This includes an acquisition module and a control module; The acquisition module is used to acquire the location information of the digital key when the automatic unlocking function of the first device is turned off. The acquisition module is also used to collect interactive data through the interactive components in the first device when the digital key is located near the first device. The control module is used to control the first device to unlock based on the digital key when the interaction data meets the unlocking conditions.

12. A control device, characterized in that, Includes a processor that executes computer execution instructions to implement the method as described in any one of claims 1 to 10.

13. A terminal device, characterized in that, Includes the apparatus of claim 11 and / or the apparatus of claim 12.

14. A computer program product, characterized in that, The computer program product includes: a computer program or instructions that, when run on a computer, cause the computer to perform the method as described in any one of claims 1 to 10.

Images