A method of acquiring a position and related apparatus
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2021-10-30
- Publication Date
- 2026-06-05
Smart Images

Figure CN116074736B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular to a method for obtaining location and related equipment. Background Technology
[0002] As car functions continue to upgrade, the user experience becomes increasingly rich and diverse. These functions are often provided to users in a uniform manner, regardless of the user's location relative to the vehicle. However, users in different locations may have different needs for vehicle functions, but determining the user's current location is a prerequisite for realizing these functions.
[0003] Therefore, a solution for measuring a user's position relative to a vehicle is urgently needed. Summary of the Invention
[0004] This application provides a method for obtaining location and related equipment, which determines whether the terminal device is inside or outside the vehicle based on the time interval between a first time set and a second time set, thereby providing a scheme for measuring the user's position relative to the vehicle; in addition, the audio signal can be emitted by the vehicle's built-in speakers, without the need to add additional hardware to the vehicle or terminal device, thus avoiding additional overhead.
[0005] To solve the above-mentioned technical problems, this application provides the following technical solution:
[0006] Firstly, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a location acquisition system, which includes a vehicle and a terminal device. The method includes: when the vehicle detects that a first trigger condition is met, transmitting at least one target audio signal, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal. Further, transmitting the at least one target audio signal by the vehicle includes: transmitting multiple target audio signals at a first preset frequency; wherein the multiple target audio signals include a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device via direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device via direct and / or reflection. Further, the time when the vehicle transmits the first detection signal may be earlier than the time when the vehicle transmits the second detection signal, or the time when the vehicle transmits the first detection signal may be later than the time when the vehicle transmits the second detection signal; the first detection signal and the second detection signal are two different target audio signals and arrive at the terminal device adjacent to each other. The vehicle acquires first location information corresponding to the terminal device. The first location information is used to indicate whether the terminal device is located inside or outside the vehicle. The time interval between the arrival times in the first time set and the second time set is used to determine the first location information.
[0007] In this implementation, the vehicle sends multiple target audio signals. Since the interior space of the vehicle is relatively enclosed, multiple audio signals obtained after direct and / or reflection of a single target audio signal can reach the terminal device in a relatively concentrated manner. However, the exterior space of the vehicle is relatively open, and multiple audio signals obtained after direct and / or reflection of a single target audio signal will reach the terminal device in a more dispersed manner. Therefore, the location of the terminal device inside or outside the vehicle can be determined based on the time interval between the first and second time sets, thus providing a solution for measuring the user's position relative to the vehicle. In addition, the audio signals can be emitted through the vehicle's built-in speakers, eliminating the need to add additional hardware to the vehicle or terminal device, thereby avoiding additional overhead.
[0008] In one possible implementation of the first aspect, the target audio signal is a linear frequency modulated signal or a ZC sequence signal. Further, the frequency band of the target audio signal can be 17kHz-48kHz, and optionally, the frequency band of the target audio signal can be 17kHz-22kHz.
[0009] In this implementation, since the linear frequency modulated signal or the ZC sequence signal is an energy-concentrating signal, using the linear frequency modulated signal or the ZC sequence signal as the target audio signal is beneficial for accurately estimating at least one arrival time corresponding to each target audio signal, thereby facilitating the acquisition of accurate first position information.
[0010] In one possible implementation of the first aspect, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first location information indicates that the terminal device is located inside the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first location information indicates that the terminal device is located outside the vehicle. The factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle. The time measurement unit used for the preset time range may include sampling points, milliseconds, seconds, or other time measurement units, etc. For example, the preset time range may be from dc sampling points to d+e sampling points, where d sampling points represent the time interval between two target audio signals sent by the vehicle.
[0011] In this implementation, the preset time range can be determined based on the time interval between two adjacent target audio signals sent by the vehicle, thus providing a simple way to determine the preset time range.
[0012] In one possible implementation of the first aspect, the time interval between arrival times in the first time set and the second time set includes the time interval between the latest time in the first time set and the earliest time in the second time set. This implementation provides a specific method for obtaining the first location information of a terminal device using the time interval between arrival times in the first time set and the second time set; it is simple to operate and easy to implement.
[0013] In one possible implementation of the first aspect, the vehicle is deemed to have detected a first triggering condition when it detects any one or more of the following conditions: the vehicle is detected to be parked; or the distance between the terminal device and the vehicle is detected to meet a first distance condition; or a first instruction is obtained, the first instruction being used to trigger the vehicle to obtain first location information.
[0014] This implementation provides multiple specific manifestations of the first triggering condition, expanding the application scenarios of this solution and improving its implementation flexibility.
[0015] In one possible implementation of the first aspect, vehicle detection of a stopped vehicle may include: the vehicle acquiring its speed, acceleration, and angular velocity, and inputting these values into a classification model to obtain predicted category information output by the model. This classification model is a pre-trained model, which can be a neural network or a non-neural network model. For example, the classification model could be a decision tree, random forest, extremely random tree, support vector machine, K-nearest neighbor (KNN) model, logistic regression model, or other types of classification models, etc., which are not exhaustively listed here. The predicted category information indicates whether the vehicle is in a stopped or moving state. In one implementation, the predicted category information output by the classification model may include a first probability value and a second probability value. The first probability value indicates the probability that the vehicle is stopped, and the second probability value indicates the probability that the vehicle is moving. In another implementation, the predicted category information output by the classification model can be either the first or the second value. When the predicted category information output by the classification model is the first value, it indicates that the vehicle is stopped; when the predicted category information output by the classification model is the second value, it indicates that the vehicle is moving.
[0016] In this implementation, the vehicle's speed, acceleration, and angular velocity are input into the classification model to determine whether the vehicle is stationary or moving. This avoids obtaining the vehicle's state from the vehicle's control system, ensuring the independence of the vehicle's control system in the measurement process of the target position information of the terminal device, and thus improving the safety of the vehicle's operation.
[0017] Secondly, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a location acquisition system, which includes a vehicle and a terminal device. The method includes: when the terminal device detects that a second trigger condition is met, acquiring at least one arrival time corresponding to at least one target audio signal, wherein the at least one target audio signal includes multiple target audio signals emitted by the vehicle at a preset frequency, the multiple target audio signals including a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection. The terminal device generates first location information corresponding to the terminal device based on the time interval between the arrival times in the first and second time sets. The first location information indicates whether the terminal device is located inside or outside the vehicle.
[0018] In one possible implementation of the second aspect, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first location information indicates that the terminal device is located inside the vehicle, wherein the factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first location information indicates that the terminal device is located outside the vehicle.
[0019] In one possible implementation of the second aspect, the terminal device generates first location information corresponding to the terminal device based on the time interval between arrival times in the first time set and the second time set, including: the terminal device generates the first location information based on the time interval between the latest time in the first time set and the earliest time in the second time set.
[0020] In one possible implementation of the second aspect, the terminal device is deemed to have detected that the second triggering condition is met when it detects any one or more of the following situations: the vehicle is detected to be parked; or the distance between the terminal device and the vehicle is detected to meet the first distance condition; or the displacement of the terminal device is detected to meet the preset displacement; or a second instruction is obtained, which is used to trigger the terminal device to obtain the first location information.
[0021] For details regarding the specific implementation steps, the specific meanings of terms, and the beneficial effects of each possible implementation of the second aspect of this application, please refer to the descriptions of the various possible implementations in the first aspect; they will not be repeated here.
[0022] Thirdly, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a location acquisition system, which includes a vehicle and a terminal device. The method includes: the vehicle transmitting multiple target audio signals at a second preset frequency; wherein, when the vehicle is in motion, one target audio signal is used to determine a first arrival time of the target audio signal arriving at the terminal device; and when a second trigger condition is met, another target audio signal is used to determine a second arrival time of the target audio signal arriving at the terminal device. Further, the first arrival time can be at least one arrival time corresponding to each target audio signal, or it can include only one arrival time; or, the aforementioned first arrival time can be the earliest of the at least one arrival times corresponding to each target audio signal; or, the aforementioned first arrival time can be the latest of the at least one arrival times corresponding to each target audio signal; or, the first arrival time can also be other arrival times among the at least one arrival times corresponding to each target audio signal; the second arrival time has a similar meaning to the first arrival time, the difference being that the first arrival time is obtained when the vehicle is in motion, while the second arrival time is obtained after the terminal device detects that the second trigger condition is met. The vehicle acquires first location information corresponding to the terminal device. The first location information is used to indicate whether the terminal device is located inside or outside the vehicle. Multiple first arrival times and at least one second arrival time are used to determine the first location information.
[0023] This application provides an alternative solution for measuring whether a terminal device is located inside or outside a vehicle, improving the implementation flexibility of this solution; and that is, using audio signals to measure whether the terminal device is located inside or outside the vehicle does not require adding additional hardware to the vehicle or the terminal device, thus avoiding additional costs.
[0024] In one possible implementation of the third aspect, a plurality of first arrival times are used to determine a first prediction time corresponding to a second arrival time. The first prediction time indicates the time when the target audio signal arrives at the terminal device when the terminal device is located inside the vehicle. The first prediction time and the second arrival time are used to determine first location information.
[0025] In this embodiment, since the terminal device that can continuously receive audio signals must be located inside the vehicle when the vehicle is in motion, the first predicted time can be obtained based on the multiple first arrival times. Then, based on the generated first predicted time and the actual second arrival time, it can be determined whether the terminal device is located inside or outside the vehicle. Only one speaker is needed to detect the first location information of the terminal device, which further reduces the implementation difficulty of this solution and is conducive to expanding the application scenarios of this solution.
[0026] For the specific meanings of the terms in the third aspect of this application and the various possible implementations of the third aspect, please refer to the descriptions in the various possible implementations of the first aspect, which will not be repeated here.
[0027] Fourthly, this application provides a location acquisition method that can be used in the field of intelligent vehicles. The method is applied to a location acquisition system, which includes a vehicle and a terminal device. The method includes: when the vehicle is in motion, the terminal device acquires multiple first arrival times corresponding to multiple target audio signals, each first arrival time representing the time when a target audio signal arrives at the terminal device, and the multiple target audio signals being emitted by the vehicle at a preset frequency; upon detecting that a second trigger condition is met, the terminal device acquires at least one second arrival time corresponding to at least one target audio signal; and based on the multiple first arrival times and at least one second arrival time, generates first location information corresponding to the terminal device, the first location information indicating whether the terminal device is located inside or outside the vehicle.
[0028] In one possible implementation of the fourth aspect, the terminal device generates first location information corresponding to the terminal device based on a plurality of first arrival times and at least one second arrival time, including: the terminal device determining a first prediction time corresponding to the second arrival time based on the plurality of first arrival times, the first prediction time indicating the time when the target audio signal arrives at the terminal device when the terminal device is located inside the vehicle; and the terminal device generating the first location information based on the first prediction time and the second arrival time.
[0029] For the specific implementation steps, the specific meanings of terms, and the beneficial effects of each possible implementation of the fourth aspect of this application, please refer to the descriptions of the various possible implementations in the third aspect. They will not be repeated here.
[0030] Fifthly, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a location acquisition system, which includes a vehicle and a terminal device. The vehicle is equipped with at least three speakers, which are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. The method includes: the vehicle transmitting a first audio signal through the first speaker, the first audio signal being used to determine a first signal strength of the first audio signal received by the terminal device; the vehicle transmitting a second audio signal through the second speaker, the second audio signal being used to determine a second signal strength of the second audio signal received by the terminal device; and the vehicle transmitting a third audio signal through the third speaker, the third audio signal being used to determine a third signal strength of the third audio signal received by the terminal device. The first signal strength, the second signal strength, and the third signal strength are used to determine second location information corresponding to the terminal device, the second location information indicating the location of the terminal device outside the vehicle.
[0031] In this embodiment, since the distance between the terminal device and each speaker varies depending on the location of the terminal device outside the vehicle, and the greater the distance the audio signal travels, the weaker the intensity of the audio signal received by the terminal device, the first signal strength, the second signal strength, and the third signal strength can respectively reflect the distance between the terminal device and the first speaker, the second speaker, and the third speaker. Therefore, the specific location of the terminal device outside the vehicle can be obtained based on the first signal strength, the second signal strength, and the third signal strength, providing another way to measure the specific location of the terminal device outside the vehicle and improving the implementation flexibility of this solution.
[0032] In one possible implementation of the fifth aspect, the second location information is used to enable the vehicle to determine, from among the multiple components included in the vehicle, the component closest to the terminal device, so as to control the component closest to the terminal device to perform a preset operation. The component can be a door, headlights, trunk, or other vehicle components, and the preset operation can be unlocking the door, opening the door, unlocking the trunk, turning on the headlights, or other operations.
[0033] This application provides specific application scenarios for the second location information, which can be used to provide users with more accurate services and improve user stickiness.
[0034] Sixthly, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a location acquisition system, which includes a vehicle and a terminal device. The vehicle is equipped with at least three speakers, which are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. The method includes: the terminal device receiving a first audio signal transmitted by the first speaker, receiving a second audio signal transmitted by the second speaker, and receiving a second audio signal transmitted by the third speaker; the terminal device generating second location information corresponding to the terminal device based on a first signal strength of the received first audio signal, a second signal strength of the received second audio signal, and a third signal strength of the received third audio signal. The second location information indicates the location of the terminal device outside the vehicle.
[0035] For details regarding the specific implementation steps, the specific meanings of terms, and the beneficial effects of each possible implementation of the sixth aspect of this application, please refer to the descriptions of the various possible implementations in the fifth aspect; they will not be repeated here.
[0036] Seventhly, this application provides a location acquisition device that can be used in the field of intelligent vehicles. The location acquisition device is applied to a vehicle, the vehicle including a location acquisition system, the location acquisition system further including a terminal device. The device includes: a transmitting module, configured to transmit at least one target audio signal upon detecting that a first trigger condition is met, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal; the transmitting module is specifically configured to transmit multiple target audio signals at a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection; and an acquisition module, configured to acquire first location information corresponding to the terminal device, the first location information indicating whether the terminal device is located inside or outside the vehicle, the time interval between the arrival times in the first time set and the second time set being used to determine the first location information.
[0037] In this application, the location acquisition device provided in the seventh aspect can also be used to perform the steps performed by the vehicle in various possible implementations of the first aspect. For the specific implementation steps, specific meanings of terms, and beneficial effects of each possible implementation of the seventh aspect and its various possible implementations, please refer to the descriptions in the various possible implementations of the first aspect, which will not be repeated here.
[0038] Eighthly, this application provides a location acquisition device that can be used in the field of intelligent vehicles. The location acquisition device is applied to a terminal device, which is included in a location acquisition system. The location acquisition system further includes a vehicle. The device includes: an acquisition module, configured to acquire at least one arrival time corresponding to at least one target audio signal when a second trigger condition is detected, wherein the at least one target audio signal includes multiple target audio signals emitted by the vehicle at a preset frequency, the multiple target audio signals including a first detection signal and a second detection signal, and the at least one arrival time including a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set including at least one time when the first detection signal arrives at the terminal device via direct and / or reflection, and the second time set including at least one time when the second detection signal arrives at the terminal device via direct and / or reflection; and a generation module, configured to generate first location information corresponding to the terminal device based on the time interval between the arrival times in the first and second time sets, the first location information indicating whether the terminal device is located inside or outside the vehicle.
[0039] In this application, the location acquisition device provided in the eighth aspect can also be used to perform the steps executed by the terminal device in various possible implementations of the second aspect. For the specific implementation steps, specific meanings of terms, and beneficial effects of each possible implementation of the eighth aspect and its various possible implementations, please refer to the descriptions in the various possible implementations of the second aspect, which will not be repeated here.
[0040] Ninthly, this application provides a location acquisition device for use in the field of intelligent vehicles. The location acquisition device is applied to a vehicle, the vehicle including a location acquisition system, and the location acquisition system further including a terminal device. The device includes: a transmitting module, configured to transmit multiple target audio signals at a preset frequency; when the vehicle is in motion, one target audio signal is used to determine a first arrival time of the target audio signal arriving at the terminal device; and when a second triggering condition is met, one target audio signal is used to determine a second arrival time of the target audio signal arriving at the terminal device; and an acquisition module, configured to acquire first location information corresponding to the terminal device, the first location information indicating whether the terminal device is located inside or outside the vehicle, and multiple first arrival times and at least one second arrival time are used to determine the first location information.
[0041] In this application, the location acquisition device provided in the ninth aspect can also be used to perform the steps performed by the vehicle in various possible implementations of the third aspect. For the specific implementation steps, specific meanings of terms, and beneficial effects of each possible implementation of the ninth aspect and its various possible implementations, please refer to the descriptions in the various possible implementations of the third aspect, which will not be repeated here.
[0042] Tenthly, this application provides a location acquisition device for use in the field of intelligent vehicles. The location acquisition device is applied to a terminal device, which is included in a location acquisition system. The location acquisition system further includes a vehicle. The device includes: an acquisition module, configured to acquire multiple first arrival times corresponding to multiple target audio signals when the vehicle is in motion, wherein each first arrival time represents the time when a target audio signal arrives at the terminal device, and the multiple target audio signals are emitted by the vehicle at a preset frequency; and a generation module, configured to acquire at least one second arrival time corresponding to at least one target audio signal when a second trigger condition is detected, and to generate first location information corresponding to the terminal device based on the multiple first arrival times and at least one second arrival time, wherein the first location information indicates whether the terminal device is located inside or outside the vehicle.
[0043] In this application, the location acquisition device provided in the tenth aspect can also be used to perform the steps performed by the vehicle in various possible implementations of the fourth aspect. For the specific implementation steps, specific meanings of terms, and beneficial effects of each possible implementation of the tenth aspect and its various possible implementations, please refer to the descriptions in the various possible implementations of the fourth aspect, which will not be repeated here.
[0044] Eleventhly, this application provides a location acquisition device that can be used in the field of intelligent vehicles. The location acquisition device is applied to a vehicle, the vehicle includes a location acquisition system, the location acquisition system further includes a terminal device, the vehicle is equipped with at least three speakers, the at least three speakers are not located in a straight line, the at least three speakers include a first speaker, a second speaker, and a third speaker, the location acquisition device includes: a transmitting module, configured to transmit a first audio signal through the first speaker, the first audio signal being used to determine a first signal strength of the first audio signal received by the terminal device; the transmitting module is further configured to transmit a second audio signal through the second speaker, the second audio signal being used to determine a second signal strength of the second audio signal received by the terminal device; the transmitting module is further configured to transmit a third audio signal through the third speaker, the third audio signal being used to determine a third signal strength of the third audio signal received by the terminal device, the first signal strength, the second signal strength, and the third signal strength being used to determine second location information corresponding to the terminal device, the second location information being used to indicate the location of the terminal device outside the vehicle.
[0045] In this application, the location acquisition device provided in the eleventh aspect can also be used to perform the steps performed by the vehicle in various possible implementations of the fifth aspect. For the specific implementation steps, specific meanings of terms, and beneficial effects of each possible implementation of the eleventh aspect and its various possible implementations, please refer to the descriptions in the various possible implementations of the fifth aspect, which will not be repeated here.
[0046] In a twelfth aspect, this application provides a location acquisition device for use in the field of intelligent vehicles. The location acquisition device is applied to a terminal device, which is included in a location acquisition system. The location acquisition system also includes a vehicle equipped with at least three speakers, which are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. The location acquisition device includes: a receiving module for receiving a first audio signal transmitted by the first speaker, a second audio signal transmitted by the second speaker, and a second audio signal transmitted by the third speaker; and a generating module for generating second location information corresponding to the terminal device based on the first signal strength of the received first audio signal, the second signal strength of the received second audio signal, and the third signal strength of the received third audio signal. The second location information indicates the location of the terminal device outside the vehicle.
[0047] In this application, the location acquisition device provided in the twelfth aspect can also be used to perform the steps executed by the vehicle in various possible implementations of the sixth aspect. For the specific implementation steps, the specific meanings of terms, and the beneficial effects of each possible implementation of the twelfth aspect and its various possible implementations, please refer to the descriptions in the various possible implementations of the sixth aspect; they will not be repeated here. In the thirteenth aspect, this application provides a location acquisition method that can be used in the field of intelligent vehicles. The method is applied to a vehicle, which is included in a location acquisition system. The location acquisition system also includes a terminal device. The vehicle is equipped with at least two speakers, including a first speaker and a second speaker, located on opposite sides of the vehicle. The method includes: transmitting a first audio signal through the first speaker, the first audio signal being used by the terminal device to determine the reception time of the first audio signal, the reception time of the first audio signal being the time when the terminal device receives the first audio signal; and transmitting a second audio signal through the second speaker, the second audio signal being used by the terminal device to determine the reception time of the second audio signal, the reception time of the second audio signal being the time when the terminal device receives the second audio signal. The reception times of the first audio signal and the second audio signal are used to determine target location information, the target location information indicating the position of the terminal device relative to the vehicle.
[0048] In one possible implementation of the thirteenth aspect, transmitting a first audio signal via a first speaker and a second audio signal via a second speaker includes: transmitting the first audio signal via the first speaker and transmitting the second audio signal via the second speaker simultaneously, wherein the first audio signal and the second audio signal are different audio signals, and the order in which the first audio signal and the second audio signal arrive at the terminal device is used to determine the target location information.
[0049] In one possible implementation of the thirteenth aspect, a first audio signal is sent through a first speaker and a second audio signal is sent through a second speaker, comprising: first sending the first audio signal through the first speaker, and then sending the second audio signal through the second speaker after a preset time interval, wherein the reception time of the first audio signal, the reception time of the second audio signal, and the preset time interval are used to determine the target location information.
[0050] In one possible implementation of aspect thirteen, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0051] In one possible implementation of aspect thirteen, at least three speakers include four speakers located at the front left, front right, rear left, and rear right positions in the vehicle, respectively.
[0052] In one possible implementation of aspect thirteen, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0053] In one possible implementation of aspect thirteen, the position inside the vehicle is either the left side or the right side of the vehicle; or, the position inside the vehicle is either the front side or the rear side of the vehicle; or, the position inside the vehicle is any one of the following: the driver's seat, the front passenger seat, the left side of the rear seat, the right side of the rear seat, or the middle of the rear seat; or, there are N positions inside the vehicle, and the position inside the vehicle is a target position among the N positions, where N is an integer greater than or equal to 2.
[0054] In one possible implementation of aspect thirteen, the target location information is used to determine the terminal device's control authority over the vehicle, with terminal devices located in different locations having different control authority over the vehicle; or, the target location information is used to indicate whether the terminal device is located in the driver's seat of the vehicle; or, when the terminal device is connected to the vehicle, the target location information is used for the vehicle to determine the on-board device that is closest to the terminal device.
[0055] In one possible implementation of the thirteenth aspect, the method further includes: when the vehicle initiates a location sensing operation, sending a first instruction message to a terminal device, the first instruction message instructing the terminal device to initiate a location sensing operation, the location sensing operation being an operation for acquiring target location information; receiving a first feedback message sent by the terminal device, the first feedback message instructing the vehicle to send a first audio signal and a second audio signal; or, receiving a second instruction message sent by the terminal device, and in response to the received second instruction message, initiating a location sensing operation; sending a second feedback message to the terminal device, the second feedback message instructing the terminal device to receive the first audio signal and the second audio signal.
[0056] In a fourteenth aspect, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a terminal device included in a location acquisition system. The location acquisition system also includes a vehicle equipped with at least two speakers, including a first speaker and a second speaker, located on different sides of the vehicle. The method includes: receiving a first audio signal transmitted by the first speaker; receiving a second audio signal transmitted by the second speaker; and determining target location information based on the reception time of the first audio signal and the reception time of the second audio signal. The target location information indicates the position of the terminal device relative to the vehicle.
[0057] In one possible implementation of the fourteenth aspect, determining the target location information based on the reception time of the first audio signal and the reception time of the second audio signal includes: when the first audio signal and the second audio signal are transmitted simultaneously, determining the order in which the first audio signal and the second audio signal arrive at the terminal device based on the reception time of the first audio signal and the reception time of the second audio signal; and determining the target location information based on the order in which the first audio signal and the second audio signal arrive at the terminal device.
[0058] In one possible implementation of the fourteenth aspect, determining the target location information based on the reception time of the first audio signal and the reception time of the second audio signal includes: determining the target location information based on the reception time of the first audio signal, the reception time of the second audio signal, and a preset time interval, wherein the preset time interval is the transmission time interval between two adjacent audio signals.
[0059] In one possible implementation of aspect fourteen, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0060] In a fifteenth aspect, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a vehicle, which includes a location acquisition system. The location acquisition system further includes a terminal device. The vehicle is equipped with at least two speakers, positioned on both sides of the vehicle. A target speaker is any one of the at least two speakers. The method includes: receiving a first measurement signal transmitted by the terminal device through the target speaker, and determining the time of receiving the first measurement signal as a first time; transmitting a second measurement signal to the terminal device through the target speaker, and determining the time of transmitting the second measurement signal as a second time, wherein both the first and second measurement signals are audio signals; determining the distance between the terminal device and the target speaker based on the first time, the second time, a third time, and a fourth time, wherein the third time is the time the terminal device transmits the first measurement signal, and the fourth time is the time the terminal device receives the second measurement signal; and determining target location information based on the distance between the terminal device and each of the at least two speakers, wherein the target location information indicates the position of the terminal device relative to the vehicle.
[0061] In one possible implementation of aspect fifteen, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0062] In one possible implementation of the fifteenth aspect, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0063] In a sixteenth aspect, this application provides a location acquisition method applicable to the field of intelligent vehicles. The method is applied to a terminal device, which includes a location acquisition system. The location acquisition system also includes a vehicle equipped with at least two speakers positioned at different locations within the vehicle. A target speaker is any one of the at least two speakers. The method includes: sending a first measurement signal to the target speaker, determining the transmission time of the first measurement signal as a third time; receiving a second measurement signal sent by the target speaker, determining the reception time of the second measurement signal as a fourth time, wherein both the first and second measurement signals are audio signals; determining the distance between the terminal device and the target speaker based on the first, second, third, and fourth times, wherein the first time is the time when the vehicle receives the first measurement signal, and the second time is the time when the vehicle sends the second measurement signal; and determining target location information based on the distance between the terminal device and each of the at least two speakers, wherein the target location information indicates the position of the terminal device relative to the vehicle.
[0064] In one possible implementation of the sixteenth aspect, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0065] In one possible implementation of the sixteenth aspect, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0066] In a seventeenth aspect, this application provides an audio stream processing method applicable to the field of intelligent vehicles. The method is applied to a data processing system, which further includes a vehicle and a first terminal device. The method includes: establishing a connection between the vehicle and the first terminal; the vehicle receiving data sent by the first terminal device, the data containing a target audio stream; the vehicle playing the target audio stream; and during the playback of the target audio stream, continuing to play the target audio stream when a preset condition occurs, wherein the preset condition includes: the first terminal device moving from inside the vehicle to outside the vehicle while connected to the vehicle, and the target audio stream being of a first category.
[0067] In one possible implementation of the seventeenth aspect, the playback device of the second type of audio stream is switched to the first terminal device, the second type and the first type are different types, and the audio stream of the second type is generated by the first terminal device.
[0068] Eighteenthly, this application provides an audio stream processing method that can be used in the field of intelligent vehicles. The method is applied to a first terminal device, which is included in a data processing system. The data processing system also includes a vehicle. The method includes: establishing a connection between the first terminal device and the vehicle; the first terminal device sending data to the vehicle, the data containing a target audio stream; during the process of the vehicle playing the target audio stream and the first terminal device being connected to the vehicle, when it is detected that the first terminal device has moved from inside the vehicle to outside, obtaining the target category corresponding to the target audio stream being sent to the vehicle; if the target category is a first category, then continuing to send the target audio stream to the vehicle.
[0069] In one possible implementation of aspect eighteen, the first category includes media, and the second category differs from the first category.
[0070] In one possible implementation of the eighteenth aspect, the method further includes: switching the playback device of the second type of audio stream from the vehicle to the first terminal device, wherein the second type of audio stream is generated by the first terminal device; if the first terminal device receives a playback instruction to play the second audio stream, the first terminal device plays the second audio stream; the category of the second audio stream is the second type.
[0071] In one possible implementation of the eighteenth aspect, the method further includes: outputting first information, the first information being used to prompt the user to switch the playback device of the target audio stream from the vehicle to the first terminal device.
[0072] In one possible implementation of the eighteenth aspect, if the target category is the first category, after continuing to send the target audio stream to the vehicle, the method further includes: when the first terminal device obtains a playback operation on the first audio stream, outputting first information; wherein the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream played by the vehicle, and the first information is used to prompt the user to switch the playback device of the first audio stream from the vehicle to the first terminal device.
[0073] In one possible implementation of the eighteenth aspect, the method further includes: if the target category is not the first category, then the first terminal device continues to play the target audio stream.
[0074] Nineteenthly, this application provides an audio stream processing method applicable to the field of intelligent vehicles. The method is applied to a data processing system, which includes a first terminal device and a vehicle. The method includes: establishing a connection between the first terminal device and the vehicle; switching the playback device of a third category of audio streams from the first terminal device to the vehicle, where the third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle; while the first terminal device and the vehicle are in a connected state, when it is detected that the first terminal device has moved from inside the vehicle to outside, acquiring a target category corresponding to a target audio stream being played by the vehicle, where the target audio stream is generated by the first terminal device and sent to the vehicle; the vehicle continues to play the target audio stream, and switches the playback device of other second category audio streams in the third category (excluding the target category) from the vehicle to the first terminal device.
[0075] In one possible implementation of the nineteenth aspect, the vehicle continues to play the target audio stream, including: if the target category is the first category, then the vehicle continues to play the target audio stream.
[0076] In a twentieth aspect, this application provides an address processing method that can be used in the field of intelligent vehicles. The method is applied to a navigation system, which includes a vehicle, a first terminal device, and a second terminal device. The method includes: the second terminal device displaying a target address on a display interface; and, while the first terminal device is connected to the vehicle, the second terminal device sending the target address to the vehicle, wherein the sent target address is used to indicate that the target address is the destination when navigating the vehicle.
[0077] In one possible implementation of the twentieth aspect, before the second terminal device sends the target address to the vehicle, the method further includes: the second terminal device acquiring first location information corresponding to the second terminal device, the first location information indicating whether the second terminal device is located inside or outside the vehicle; if the second terminal device is located inside the vehicle, the second terminal device outputting second information, the second information prompting the user to input a target operation; while the first terminal device is in a connected state with the vehicle, the second terminal device sending the target address to the vehicle includes: the second terminal device receiving the target operation input by the user; while the first terminal device is in a connected state with the vehicle, in response to the received target operation, the second terminal device sending the target address to the vehicle.
[0078] In one possible implementation of aspect 20, the display interface for showing the target address includes the interface of any one or more of the following types of applications: navigation applications, instant messaging applications, lifestyle service applications, or travel applications.
[0079] In one possible implementation of the twentieth aspect, after the second terminal device displays the target address on the display interface, the method further includes: the second terminal device receiving a trigger operation input by the user; the second terminal device acquiring first location information corresponding to the second terminal device, including: in response to the trigger operation, the second terminal device acquiring the first location information corresponding to the second terminal device.
[0080] In a twentieth aspect, this application provides an address processing method that can be used in the field of intelligent vehicles. The method is applied to a navigation system, which includes a vehicle, a second terminal device, and a first terminal device. The method includes: during a connection between the first terminal device and the vehicle, the vehicle obtains a target address, which is generated by the second terminal device; the vehicle uses the target address as its destination when navigating.
[0081] In one possible implementation of the 21st provision, the second terminal device is located inside the vehicle.
[0082] In one possible implementation of the twenty-one points, the vehicle uses the target address as the destination when navigating, including: when the vehicle obtains the target address, it is navigating with the first address as the destination; the vehicle changes the first address to the target address and continues navigating with the target address as the destination.
[0083] In a twentieth aspect, this application provides a vehicle that may include a processor coupled to a memory, the memory storing program instructions which, when executed by the processor, implement the methods described in the above aspects.
[0084] In a twentieth aspect, this application provides a terminal device that may include a processor, the processor and a memory coupled together, the memory storing program instructions, which, when executed by the processor, implement the methods described in the above aspects.
[0085] In a twentieth aspect, this application provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the methods described in the above aspects.
[0086] In a twentieth aspect, this application provides a computer program product comprising program code that, when run on a computer, causes the computer to perform the methods described in the above aspects.
[0087] In a twentieth aspect, this application provides a circuit system including a processing circuit configured to perform the methods described in the foregoing aspects.
[0088] In a twenty-seventh aspect, this application provides a chip system including a processor for implementing the functions involved in the foregoing aspects, such as transmitting or processing data and / or information involved in the foregoing methods. In one possible design, the chip system further includes a memory for storing program instructions and data necessary for a server or communication device. This chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description
[0089] Figure 1a A schematic diagram of the architecture of a data processing system provided in the embodiments of this application;
[0090] Figure 1b A schematic diagram of the architecture of a data processing system provided in the embodiments of this application;
[0091] Figure 2 A schematic diagram of the structure of a vehicle provided in an embodiment of this application;
[0092] Figure 3 A schematic flowchart illustrating a location acquisition method provided in an embodiment of this application;
[0093] Figure 4 A schematic diagram illustrating the location of at least three speakers in the location acquisition method provided in this application embodiment;
[0094] Figure 5 A schematic diagram illustrating the principle of a location acquisition method provided in an embodiment of this application;
[0095] Figure 6 A schematic flowchart illustrating a location acquisition method provided in an embodiment of this application;
[0096] Figure 7 This is a schematic diagram of a location acquisition method provided in an embodiment of this application;
[0097] Figure 8a A schematic flowchart illustrating a location acquisition method provided in an embodiment of this application;
[0098] Figure 8b This is a schematic diagram illustrating the external position of a vehicle in the location acquisition method provided in this application embodiment.
[0099] Figure 9 A schematic flowchart illustrating a location acquisition method provided in an embodiment of this application;
[0100] Figure 10 A schematic diagram illustrating the control permissions of terminal devices located at different locations in the location acquisition method provided in this application embodiment;
[0101] Figure 11 A schematic diagram illustrating the control permissions of terminal devices located at different locations in the location acquisition method provided in this application embodiment;
[0102] Figure 12 This is a schematic diagram illustrating screen projection from a terminal device located in the driver's seat in the location acquisition method provided in this application embodiment.
[0103] Figure 13 This is a schematic diagram illustrating screen projection from a terminal device located in the driver's seat in the location acquisition method provided in this application embodiment.
[0104] Figure 14a A schematic diagram of a location acquisition device provided in an embodiment of this application;
[0105] Figure 14b Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0106] Figure 15 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0107] Figure 16 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0108] Figure 17 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0109] Figure 18 A schematic flowchart illustrating a location acquisition method provided in an embodiment of this application;
[0110] Figure 19 A schematic diagram of an audio source in the location acquisition method provided in the embodiments of this application;
[0111] Figure 20 A schematic diagram of the matching degree curve in the location acquisition method provided in the embodiments of this application;
[0112] Figure 21 Two schematic diagrams illustrating the matching degree curve in the location acquisition method provided in the embodiments of this application;
[0113] Figure 22 Another schematic flowchart illustrating the location acquisition method provided in this application embodiment;
[0114] Figure 23 Another schematic flowchart illustrating the location acquisition method provided in this application embodiment;
[0115] Figure 24A schematic diagram illustrating the principle of the location acquisition method provided in this application embodiment;
[0116] Figure 25 An application scenario diagram of the location acquisition method provided in the embodiments of this application;
[0117] Figure 26 A schematic diagram of a location acquisition device provided in an embodiment of this application;
[0118] Figure 27 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0119] Figure 28 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0120] Figure 29 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0121] Figure 30 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0122] Figure 31 Another schematic diagram of the location acquisition device provided in the embodiments of this application;
[0123] Figure 32 A schematic flowchart of an audio stream processing method provided in an embodiment of this application;
[0124] Figure 33 A schematic diagram of the receiving interface for the first switching operation in the audio stream processing method provided in the embodiments of this application;
[0125] Figure 34 A schematic diagram of an off-vehicle mode in the audio stream processing method provided in the embodiments of this application;
[0126] Figure 35 A schematic diagram of an off-vehicle mode in the audio stream processing method provided in the embodiments of this application;
[0127] Figure 36 Two schematic diagrams illustrating the first information displayed by the first terminal device in the audio stream processing method provided in the embodiments of this application;
[0128] Figure 37 This is a schematic diagram of the first information in the audio stream processing method provided in the embodiments of this application;
[0129] Figure 38a This is a schematic diagram corresponding to a switching operation in the audio stream processing method provided in the embodiments of this application;
[0130] Figure 38b This is a schematic diagram illustrating the output of indication information in the audio stream processing method provided in the embodiments of this application;
[0131] Figure 39 A flowchart illustrating a data processing method provided in an embodiment of this application;
[0132] Figure 40 A flowchart illustrating an address processing method provided in an embodiment of this application;
[0133] Figure 41 Three schematic diagrams illustrating the output of second information in the address processing method provided in the embodiments of this application;
[0134] Figure 42 Another schematic diagram illustrating the output of second information in the address processing method provided in the embodiments of this application;
[0135] Figure 43 Two schematic diagrams illustrating the output of prompt information in the address processing method provided in the embodiments of this application;
[0136] Figure 44 This is a schematic diagram illustrating the output of prompt information in the address processing method provided in the embodiments of this application;
[0137] Figure 45 This is a schematic diagram illustrating the output of notification information in the address processing method provided in this application embodiment;
[0138] Figure 46 Two schematic diagrams illustrating the output of prompt information in the address processing method provided in the embodiments of this application;
[0139] Figure 47 A flowchart illustrating a data transfer method provided in an embodiment of this application;
[0140] Figure 48 A flowchart illustrating a data transfer method provided in an embodiment of this application;
[0141] Figure 49 Another flowchart illustrating the data transfer method provided in the embodiments of this application;
[0142] Figure 50 A schematic flowchart illustrating a volume processing method provided in an embodiment of this application;
[0143] Figure 51 A schematic diagram of an audio stream processing apparatus provided in an embodiment of this application;
[0144] Figure 52 A schematic diagram of an audio stream processing apparatus provided in an embodiment of this application;
[0145] Figure 53 A schematic diagram of an audio stream processing apparatus provided in an embodiment of this application;
[0146] Figure 54 A schematic diagram of an address processing apparatus provided in an embodiment of this application;
[0147] Figure 55 A schematic diagram of an address processing apparatus provided in an embodiment of this application;
[0148] Figure 56 A schematic diagram of an address processing apparatus provided in an embodiment of this application;
[0149] Figure 57 A schematic diagram of the structure of a vehicle provided in an embodiment of this application;
[0150] Figure 58 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation
[0151] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms are interchangeable where appropriate; this is merely a way of distinguishing objects with the same attributes in the description of embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of units is not necessarily limited to those units, but may include other units not explicitly listed or inherent to those processes, methods, products, or apparatuses.
[0152] The embodiments of this application will now be described with reference to the accompanying drawings. Those skilled in the art will recognize that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.
[0153] The embodiments of this application can be applied to the field of intelligent vehicles. Specifically, in some subsequent embodiments, it is possible to detect whether the terminal device is located inside or outside the vehicle; in other embodiments, it is possible to detect the specific location of the terminal device inside the vehicle; and in still other embodiments, it is possible to detect the specific location of the terminal device outside the vehicle. The terminal device refers to a terminal device carried or worn by the user; thus, the position of the terminal device relative to the vehicle is equivalent to the position of the user relative to the vehicle.
[0154] Furthermore, in some subsequent embodiments, after knowing the location information of the terminal device relative to the vehicle, some application scenarios for interaction between the vehicle and the terminal device are provided.
[0155] To facilitate understanding of this solution, the embodiments of this application first combine... Figure 1a This application describes the network architecture of the location acquisition system and the vehicle structure used in the embodiments of this application. For some embodiments of this application, please refer to [the relevant documentation]. Figure 1a , Figure 1a This is a schematic diagram of the architecture of a data processing system provided in an embodiment of this application. Figure 1a As shown, the data processing system may include a vehicle 100 and a terminal device 200, and a communication connection is established between the vehicle 100 and the terminal device 200.
[0156] Vehicle 100 can be either an autonomous vehicle or a non-autonomous vehicle. When vehicle 100 is an autonomous vehicle, it is configured in a fully or partially autonomous driving mode. For example, vehicle 100 can control itself while in autonomous driving mode, and can determine the current state of the vehicle and its surrounding environment through human intervention, determine the possible behaviors of at least one other vehicle in the surrounding environment, and determine the confidence level corresponding to the probability of other vehicles performing possible behaviors, and control vehicle 100 based on the determined information. While vehicle 100 is in autonomous driving mode, it can also be configured to operate without human interaction.
[0157] The terminal device 200 can specifically refer to a mobile phone, tablet, laptop, smart wearable device or other types of terminal device, etc., without limitation here.
[0158] Please refer to other embodiments of this application. Figure 1b , Figure 1b This is a schematic diagram of another architecture of the data processing system provided in the embodiments of this application. For example... Figure 1b As shown, the data processing system may include a vehicle 100, a first terminal device 300, and a second terminal device 400. The vehicle 100 and the first terminal device 300 are connected; the vehicle 100 and the second terminal device 400 may or may not be connected. Further optionally, the first terminal device 300 may be projecting its screen through the central control screen of the vehicle 100, while the second terminal device 400 is not projecting its screen through the central control screen of the vehicle 100.
[0159] It should be noted that when the vehicle 100 and the first terminal device 300 are in a connected state, the first terminal device 300 can perform any one or more of the following tasks through the vehicle 100: playing audio streams, playing videos, navigation, video calls, making calls, or other tasks, etc.
[0160] Both the first terminal device 300 and the second terminal device 400 are terminal devices. The product form of the first terminal device 300 includes, but is not limited to, mobile phones, smart wearable devices, tablets, laptops or other types of first terminal devices, etc., which are not limited here.
[0161] The product form of the second terminal device 400 can be the same as or different from that of the first terminal device 300; that is, the product form of the second terminal device 400 includes, but is not limited to, mobile phones, smart wearable devices, tablets, laptops or other types of terminal devices, etc., which will not be listed here.
[0162] After the first terminal device 300 establishes a connection with the vehicle 100, the first terminal device 300 can project its screen through the vehicle 100's central control screen. During this projection process, the content displayed on the vehicle 100's central control screen may not be exactly the same as the content on the first terminal device 300's screen. The content displayed on the central control screen can include applications already configured on the vehicle 100 and multiple applications from the terminal device. In other words, the vehicle 100 has its own user interface (UI) even when not connected to the first terminal device 300. After connecting to the first terminal device 300, the vehicle 100's UI may display more application icons or have more functions.
[0163] Optionally, after the first terminal device 300 and the vehicle 100 are connected, hardware-level cooperation between the first terminal device 300 and the vehicle 100 can also be achieved. For example, the first terminal device 300 can use the Global Positioning System (GPS) configured on the vehicle 100 to improve the accuracy of navigation; as another example, the first terminal device 300 can use the camera on the vehicle 100 for video calls, etc., without exhaustive examples.
[0164] Further, please refer to Figure 2 , Figure 2This is a schematic diagram of a vehicle structure provided in an embodiment of this application. The vehicle 100 may include various subsystems, such as a driving system 102, a sensor system 104, a control system 106, one or more peripheral devices 108, a power supply 110, a computer system 112, and a user interface 116. Optionally, the vehicle 100 may also include intelligent assistance devices 160; further optionally, the vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and component of the vehicle 100 can be interconnected via wired or wireless means.
[0165] The propulsion system 102 may include components that provide powered motion to the vehicle 100. In one embodiment, the propulsion system 102 may include an engine 118, an energy source 119, a transmission 120, and wheels (also referred to as tires) 121.
[0166] Engine 118 can be an internal combustion engine, an electric motor, an air-compressed engine, or other combinations of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air-compressed engine. Engine 118 converts energy source 119 into mechanical energy. Examples of energy source 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. Energy source 119 can also provide energy to other systems of vehicle 100. Transmission 120 transmits mechanical power from engine 118 to wheels 121. Transmission 120 may include a gearbox, a differential, and a drive shaft. In one embodiment, transmission 120 may also include other components, such as a clutch. The drive shaft may include one or more axles that can be coupled to one or more wheels 121.
[0167] Sensor system 104 may include several sensors for sensing information about the environment surrounding vehicle 100. For example, sensor system 104 may include a positioning system 122 (which may be a Global Positioning System (GPS), a BeiDou Navigation Satellite System, or another positioning system), an inertial measurement unit (IMU) 124, a radar 126, a laser rangefinder 128, and a camera 130. Sensor system 104 may also include sensors for the internal systems of the monitored vehicle 100 (e.g., an in-vehicle air quality monitor, fuel gauge, oil temperature gauge, etc.). Sensing data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, speed, etc.). This detection and identification is a key function for the safe operation of the autonomous vehicle 100.
[0168] The positioning system 122 can be used to estimate the geographical location of the vehicle 100. An IMU 124 is used to sense changes in the position and orientation of the vehicle 100 based on inertial acceleration. In one embodiment, the IMU 124 can be a combination of an accelerometer and a gyroscope. A radar 126 can use radio signals to sense objects in the surrounding environment of the vehicle 100, specifically millimeter-wave radar or lidar. In some embodiments, in addition to sensing objects, the radar 126 can also be used to sense the speed and / or direction of travel of objects. A laser rangefinder 128 can use lasers to sense objects in the environment in which the vehicle 100 is located. In some embodiments, the laser rangefinder 128 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components. A camera 130 can be used to capture multiple images of the surrounding environment of the vehicle 100. The camera 130 can be a still camera or a video camera.
[0169] The control system 106 is an operating system for controlling the vehicle 100 and its components. The control system 106 may include various components, including a steering system 132, a throttle 134, a braking unit 136, a computer vision system 140, a line control system 142, and an obstacle avoidance system 144.
[0170] The steering system 132 is used to adjust the forward direction of the vehicle 100. For example, in one embodiment, the steering system 132 may be a steering wheel system. The throttle 134 is used to control the operating speed of the engine 118 and thus the speed of the vehicle 100. The braking unit 136 is used to control the deceleration of the vehicle 100. The braking unit 136 may use friction to slow down the wheels 121. In other embodiments, the braking unit 136 may convert the kinetic energy of the wheels 121 into electrical current. The braking unit 136 may also take other forms to slow down the rotational speed of the wheels 121 to control the speed of the vehicle 100. The computer vision system 140 may be operated to process and analyze images captured by the camera 130 to identify objects and / or features in the environment surrounding the vehicle 100. The objects and / or features may include traffic signals, road boundaries, and obstacles. The computer vision system 140 may use object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, the computer vision system 140 may be used to map the environment, track objects, estimate the speed of objects, etc. The route control system 142 is used to determine the driving route and speed of the vehicle 100. In some embodiments, the route control system 142 may include a lateral planning module 1421 and a longitudinal planning module 1422, which are respectively used to combine data from the obstacle avoidance system 144, GPS 122, and one or more predetermined maps to determine the driving route and speed for the vehicle 100. The obstacle avoidance system 144 is used to identify, evaluate, and avoid or otherwise traverse obstacles in the environment of the vehicle 100, which may specifically be physical obstacles and virtual moving bodies that may collide with the vehicle 100. In one instance, the control system 106 may add or replace components other than those shown and described. Alternatively, some of the components shown above may be reduced.
[0171] Vehicle 100 interacts with external sensors, other vehicles, other computer systems, or users via peripheral devices 108. Peripheral devices 108 may include a wireless communication system 146, a microphone 148, an audio system 150, and / or an onboard computer 152. In some embodiments, peripheral devices 108 provide a means for users of vehicle 100 to interact with user interface 116. For example, onboard computer 152 may provide information to users of vehicle 100. User interface 116 may also operate onboard computer 152 to receive user input. Onboard computer 152 may be operated via a touchscreen.
[0172] In other cases, peripheral device 108 may provide a means for vehicle 100 to communicate with other devices located within the vehicle. For example, microphone 148 may receive audio (e.g., voice commands or other audio input) from users of vehicle 100. Similarly, audio system 150 may output audio to users of vehicle 100. Wireless communication system 146 may communicate wirelessly with one or more devices directly or via a communication network. For example, wireless communication system 146 may use 3G cellular communication, 4G cellular communication, 5G cellular communication, or wireless local area network (WLAN) communication, etc. In some embodiments, wireless communication system 146 may communicate directly with devices using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicle communication systems, may also be used. For example, wireless communication system 146 may include one or more dedicated short-range communications (DSRC) devices that may enable public and / or private data communication between the vehicle and / or roadside stations.
[0173] Power source 110 can provide power to various components of vehicle 100. In one embodiment, power source 110 can be a rechargeable lithium-ion or lead-acid battery. One or more such battery packs can be configured to provide power to various components of vehicle 100. In some embodiments, power source 110 and energy source 119 can be implemented together, as is the case in some fully electric vehicles.
[0174] Some or all of the functions of vehicle 100 are controlled by computer system 112. Computer system 112 may include at least one processor 113, which executes instructions 115 stored in a non-transitory computer-readable medium such as memory 114. Computer system 112 may also be multiple computing devices controlling individual components or subsystems of vehicle 100 in a distributed manner. Processor 113 may be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, processor 113 may be a dedicated device such as an application-specific integrated circuit (ASIC) or other hardware-based processor. Although... Figure 2The processor, memory, and other components of computer system 112 within the same block are functionally illustrated; however, those skilled in the art will understand that the processor or memory may actually include multiple processors or memories not stored in the same physical housing. For example, memory 114 may be a hard disk drive or other storage media located in a housing different from that of computer system 112. Therefore, references to processor 113 or memory 114 will be understood to include a collection of processors or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as steering and deceleration components, may each have their own processor that performs calculations only related to the component's specific function.
[0175] In all the aspects described herein, processor 113 may be located remotely from vehicle 100 and may communicate wirelessly with vehicle 100. In other aspects, some of the processes described herein are executed on processor 113 located within vehicle 100, while others are executed by remote processor 113, including taking the necessary steps to perform a single operation.
[0176] In some embodiments, memory 114 may contain instructions 115 (e.g., program logic) that can be executed by processor 113 to perform various functions of vehicle 100, including those described above. Memory 114 may also contain additional instructions, including instructions to send data to, receive data from, interact with, and / or control one or more of the mobility system 102, sensor system 104, control system 106, and peripheral devices 108. In addition to instructions 115, memory 114 may also store data such as road maps, route information, vehicle position, direction, speed, and other such vehicle data, as well as other information. This information may be used by vehicle 100 and computer system 112 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes. A user interface 116 is provided to or receives information from a user of vehicle 100. Optionally, user interface 116 may include one or more input / output devices within the set of peripheral devices 108, such as wireless communication system 146, on-board computer 152, microphone 148, and audio 150.
[0177] Computer system 112 can control the functions of vehicle 100 based on input received from various subsystems (e.g., driving system 102, sensor system 104, and control system 106) and from user interface 116. For example, computer system 112 can utilize input from control system 106 to control steering system 132 to avoid obstacles detected by sensor system 104 and obstacle avoidance system 144. In some embodiments, computer system 112 is operable to provide control over many aspects of vehicle 100 and its subsystems.
[0178] Alternatively, one or more of these components may be installed separately from or associated with vehicle 100. For example, memory 114 may exist partially or completely separately from vehicle 100. The components may be communicatively coupled together in a wired and / or wireless manner.
[0179] Optionally, the components described above are merely examples. In actual applications, components in each of the above modules may be added or removed as needed. Figure 2 This should not be construed as a limitation on the embodiments of this application. An autonomous vehicle traveling on a road, such as vehicle 100 above, can identify objects in its surrounding environment to determine adjustments to its current speed. These objects can be other vehicles, traffic control equipment, or other types of objects. In some examples, each identified object can be considered independently, and based on the object's individual characteristics, such as its current speed, acceleration, and distance from the vehicle, the speed adjustment to be made by the autonomous vehicle can be determined.
[0180] Specifically, in some embodiments (such as Embodiment 2), it is possible to measure whether the terminal device is located inside or outside the vehicle 100; in other embodiments (such as Embodiments 1 and 2), it is also possible to measure the location of the terminal device outside the vehicle 100; in other embodiments (such as Embodiment 1), it is also possible to measure the location of the terminal device inside the vehicle 100. In other embodiments (such as Embodiments 1, 2, and 3), various application scenarios for interaction between the vehicle and the terminal device after obtaining the location information of the terminal device are also provided.
[0181] It should be noted that, in the specific application scenarios based on the location information of the terminal device relative to the vehicle provided in the various embodiments of this application, the method for obtaining the location information of the terminal device can adopt any of the methods provided in the various embodiments of this application, or it can adopt methods in the prior art, and is not limited here. The location information of the terminal device relative to the vehicle refers to whether the terminal device is located inside or outside the vehicle (including determining whether the terminal device is inside or outside the vehicle, or from inside to outside, or from outside to inside, etc.), or the specific location of the terminal device outside the vehicle, or the specific location of the terminal device inside the vehicle, etc.
[0182] The aforementioned terminal device can be terminal device 200, first terminal device 300, or second terminal device 400. It should be noted that the terminal device refers to the terminal device carried or worn by the user. Therefore, the position of the terminal device relative to the vehicle is equivalent to the position of the user relative to the vehicle.
[0183] In some implementations, the above measurement method is pre-loaded into memory 114 in the form of a computer program. The processor 113 in vehicle 100 can execute the instructions in memory 114 to emit an audio signal using speaker 150, thereby obtaining the location information of terminal 200.
[0184] In some other implementations, the subject of the above measurement method can be vehicle auxiliary equipment 160. Vehicle auxiliary equipment 160 is installed in vehicle 100 as an independent device. Vehicle auxiliary equipment 160 can specifically take the form of vehicle display screen, driving recorder, vehicle rearview mirror or other product forms, etc., without limitation here.
[0185] The aforementioned vehicle 100 can be a car, truck, motorcycle, bus, ship, airplane, helicopter, lawnmower, recreational vehicle, amusement park vehicle, construction equipment, tram, golf cart, train, and handcart, etc., and this application embodiment does not impose any special limitations.
[0186] Based on the above description, in this application embodiment, as an example, in one application scenario, when at least one user walks into the vehicle from a distance outside the vehicle and begins driving, in order to control the vehicle components corresponding to the user's position to perform preset operations, the user's specific position outside the vehicle can be detected; as an example, when the user is detected to be at the left front door outside the vehicle, the left front door can be unlocked; as another example, when the user is detected to be at the position of the vehicle's trunk, the trunk can be opened, etc., and so on.
[0187] When a user approaches a vehicle, they may enter the vehicle directly, or they may linger outside the vehicle for a while before entering. The vehicle and / or terminal devices can provide different services depending on whether the user is inside or outside the vehicle. Therefore, this application also provides a method for detecting whether the user is inside or outside the vehicle. Accordingly, it is possible to identify whether a user has entered the vehicle from outside.
[0188] Once a user is inside a vehicle, in order to provide more accurate services to users in different locations, this application embodiment also provides a method for detecting the user's specific location inside the vehicle. It should be noted that, since users generally carry terminal devices, this application embodiment represents the user's location by detecting the position of the terminal device.
[0189] When a user moves from inside the vehicle to outside, the vehicle and / or terminal devices can provide corresponding services based on the user's location change. The method provided in this application embodiment can detect when a user moves from inside the vehicle to outside. Furthermore, the method provided in this application embodiment can again detect the user's specific location outside the vehicle, further providing corresponding services.
[0190] Furthermore, after obtaining the user's location information through the solution in this application embodiment, corresponding services can be provided to the user based on the user's location information; for example, what services can be provided when the user is inside the vehicle; what services can be provided when the user is in a specific location inside the vehicle; what services can be provided when the user moves from inside the vehicle to outside the vehicle; and what services can be provided when the user moves from outside the vehicle to inside the vehicle, etc., will all be described in the subsequent Embodiment 1, Embodiment 2, and Embodiment 3.
[0191] Please refer to the following Embodiment 1. Embodiment 1 of this application provides a method for obtaining location. The vehicle is equipped with at least two speakers. The processor in the vehicle (or a vehicle auxiliary device) generates target location information corresponding to the terminal device by emitting ultrasonic signals through the speakers. The target location information can be used to indicate the specific location of the terminal device inside the vehicle; or, it can be used to indicate the specific location of the terminal device outside the vehicle. Furthermore, Embodiment 1 also provides some application scenarios, performing different operations based on the specific location of the terminal device to provide corresponding services to the user.
[0192] Example 1
[0193] In this application embodiment, specifically, in one implementation, the target location information can be generated without obtaining the distance between the terminal device and the speakers; in another implementation, the target location information is generated based on the distance between the terminal device and each speaker. The following four scenarios will be described separately: generating the location of the terminal device inside the vehicle without obtaining the distance between the terminal device and the speakers; generating the location of the terminal device inside the vehicle based on the distance between the terminal device and each speaker; generating the location of the terminal device outside the vehicle without obtaining the distance between the terminal device and the speakers; and generating the location of the terminal device outside the vehicle based on the distance between the terminal device and each speaker.
[0194] 1. Generating the location of the terminal device inside the vehicle without obtaining the distance between the terminal device and the speaker.
[0195] In this embodiment, audio signals are transmitted through at least two speakers in the vehicle. The position of the terminal device relative to the vehicle can be determined based on the time it takes for the terminal device to receive each audio signal. In the following embodiment, only ultrasonic signals are used as an example for illustration. It should be noted that non-ultrasonic audio signals, such as those audible to the human ear, can also be used in this embodiment. These will not be elaborated upon in this embodiment. The frequency band of the ultrasonic signal can be 17kHz-48kHz, or optionally 17kHz-22kHz. The specific frequency of the target audio signal can be determined based on the actual application product and is not limited here. For example, the ultrasonic signal can be a linear frequency modulated (Chirp) signal, a ZC (zadoff-chu) sequence signal, or other types of audio signals, etc., which are not exhaustively listed here. For a further description of the specific audio signal, please refer to the relevant description in embodiment two.
[0196] For details, please refer to Figure 3 , Figure 3 This is a flowchart illustrating a location acquisition method provided in an embodiment of this application. The location acquisition method provided in an embodiment of this application may include:
[0197] 301. The vehicle and terminal equipment initiate in-vehicle location sensing operations.
[0198] In some application scenarios, during vehicle operation, when the vehicle determines that it needs to know the location of the terminal device inside the vehicle, it will initiate an in-vehicle location sensing operation and send a first instruction message to the terminal device. The first instruction message is used to instruct the terminal device to initiate the in-vehicle location sensing operation. It should be noted that the steps performed by the vehicle in Embodiment 1 can be executed by the processor in the vehicle or by the vehicle auxiliary equipment in the vehicle, depending on the actual product form, and will not be described further.
[0199] As an example, if a vehicle needs to assign control permissions to at least one terminal device inside the vehicle, but the control permissions corresponding to terminal devices located in different locations inside the vehicle are different, then it is necessary to obtain the location of each terminal device inside the vehicle, and the vehicle can trigger the activation of the in-vehicle location sensing operation.
[0200] As another example, if a vehicle needs to connect to a terminal device located in the passenger seat and project the screen of the terminal device in the passenger seat onto the central control screen, the vehicle needs to obtain the location of each terminal device in the vehicle in order to determine the terminal device in the passenger seat from at least one terminal device. In this case, the vehicle can trigger the in-vehicle location perception operation. It should be noted that the vehicle can also trigger the in-vehicle location perception operation in other scenarios. The example here is only for the convenience of understanding this solution and is not intended to limit this solution.
[0201] In other application scenarios, during the operation of the terminal device, when the terminal device determines that it needs to know its position inside the vehicle, it will initiate the in-vehicle location sensing operation and send a second instruction message to the vehicle. The second instruction message is used to instruct the vehicle to initiate the in-vehicle location sensing operation.
[0202] As an example, when a terminal device located in a vehicle wants to start a screen mirroring operation, since the vehicle can be equipped with multiple displays, the terminal device can activate the in-vehicle location sensing operation to obtain the display screen closest to the terminal device from the multiple displays in the vehicle and automatically connect to the terminal device; or, the terminal device can display a list of displays, which shows all the displays that can be connected, with the display screen closest to the terminal device being pinned to the top.
[0203] As another example, if the terminal device is a wireless headset, and the wireless headset wants to connect to the nearest screen in the car to play the sound output from the screen, then the wireless headset can activate the in-vehicle location awareness operation to select the screen closest to the wireless headset from among the multiple displays in the car. It should be understood that the terminal device can also trigger the activation of the in-vehicle location awareness operation in other scenarios, which will not be listed here.
[0204] Specifically, in some application scenarios, the vehicle can send a first instruction message to the terminal device in the vehicle via broadcast. After receiving the first instruction message, the terminal device triggers the terminal device to start the in-vehicle location sensing operation and sends a first feedback message to the vehicle, thereby completing the communication connection between the vehicle and a specific terminal device. The first feedback message is used to inform the vehicle that the terminal device has successfully started the in-vehicle location sensing operation.
[0205] The broadcasting methods mentioned above can include broadcasting via Bluetooth signals, broadcasting via wireless broadband (WIFI) hotspots, or other methods, and will not be listed exhaustively here.
[0206] After confirming that the terminal device has activated its in-vehicle location sensing operation, the vehicle can send a third instruction message to at least one terminal device inside the vehicle. This third instruction message instructs the terminal device to prepare to receive ultrasonic signals, and then it begins transmitting ultrasonic signals through at least two speakers. However, it should be noted that if multiple terminal devices exist inside the vehicle simultaneously, since this solution generates the target location information for each terminal device, the vehicle can send the third instruction message to multiple terminal devices simultaneously, or it can acquire the location of each terminal device inside the vehicle one by one.
[0207] In other application scenarios, the in-vehicle terminal device can broadcast a second instruction message to the vehicle. After receiving the second instruction message, the vehicle triggers the in-vehicle location sensing operation. The terminal device then sends a second feedback message to the vehicle, which informs the terminal device that the vehicle has successfully activated the in-vehicle location sensing operation, so that the terminal device can prepare to start receiving ultrasonic signals.
[0208] Furthermore, if the vehicle receives second instruction information from multiple terminal devices inside the vehicle, the vehicle can simultaneously send second feedback messages to the multiple terminal devices inside the vehicle, so that the multiple terminal devices can simultaneously start measuring their own positions inside the vehicle; the vehicle can also send second feedback messages to the multiple terminal devices inside the vehicle one by one, so that the multiple terminal devices can start measuring their own positions inside the vehicle one by one.
[0209] This implementation provides specific methods for triggering the vehicle to start sending ultrasonic signals and the terminal device to start receiving ultrasonic signals, improving the completeness of the solution. Furthermore, whether the vehicle wants to obtain the target location information of the terminal device or the terminal device wants to obtain the target location information of the terminal device, the sending and receiving of ultrasonic signals can be triggered, expanding the application scenarios of this solution.
[0210] 302. The vehicle sends a first ultrasonic signal to the terminal device through the first sound system.
[0211] In this embodiment, the vehicle is equipped with at least two speakers, including a first speaker and a second speaker, which are located on different sides of the vehicle. Further, if the first speaker and the second speaker are located on the front and rear sides of the vehicle respectively, a target location information can be used to indicate whether a terminal device is located in the front or rear seats of the vehicle; or, if the first speaker and the second speaker are located on the left and right sides of the vehicle respectively, a target location information can be used to indicate whether a terminal device is located on the left or right side of the vehicle.
[0212] Optionally, the at least two speakers configured inside the vehicle may include at least three speakers, which may include a first speaker, a second speaker, and a third speaker. These at least three speakers are not located in a straight line. In this case, target location information can be used to indicate a specific location of a terminal device inside the vehicle. For example, if the vehicle has five interior positions: the driver's seat, the front passenger seat, the left rear seat, the middle rear seat, and the right rear seat, then target location information can be used to indicate a specific location within these five positions. It should be understood that the above examples are only for illustrative purposes and are not intended to limit the scope of this solution.
[0213] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 4 , Figure 4 This is a schematic diagram illustrating the location of at least three speakers in the location acquisition method provided in the embodiments of this application. Figure 4 Taking a car as an example, it transmits ultrasonic signals through three speakers. Figure 4 Includes three sub-diagrams: (a), (b), and (c), as shown below. Figure 4 As shown in the sub-diagram (a), the three speakers can be located in the front left, front right, and rear left positions inside the vehicle, respectively; as Figure 4 As shown in diagram (b), the three speakers can be located in the front left, front right, and middle rear seats of the vehicle, respectively; Figure 4 As shown in the (c) diagram, the three speakers can be located in the front left, front right, and rear right positions inside the vehicle, respectively. It should be understood that... Figure 4 The examples provided are only for ease of understanding the location of the speakers; vehicles can also emit ultrasonic signals through speakers in other locations, etc., which are not exhaustively listed here. Figure 4 and Figure 5As shown, the embodiments of this application describe the positions of each speaker based on a top view of the vehicle, such as the front left position, the front right position, the rear left position, and the rear right position.
[0214] In this embodiment, at least three speakers inside the vehicle are used to determine the location of the terminal device inside the vehicle, and the at least three speakers are not on the same straight line. This allows for the precise location of the terminal device inside the vehicle, which is beneficial for providing more refined management of the terminal device in the future.
[0215] Optionally, the vehicle interior may include at least three speakers, comprising four speakers: a first speaker, a second speaker, a third speaker, and a fourth speaker, located at the front left, front right, rear left, and rear right positions, respectively. In this embodiment, the standard vehicle speakers are typically located at these positions, eliminating the need for additional components. Furthermore, the greater the number of speakers used, the lower the error rate of the obtained target location information. Utilizing the four existing speakers in the vehicle improves the accuracy of the obtained target location information.
[0216] In this embodiment, the vehicle can broadcast a first ultrasonic signal to a terminal device via a first speaker. Correspondingly, a specific terminal device inside the vehicle (hereinafter referred to as the "target terminal device") receives the first ultrasonic signal sent by the first speaker, and the target terminal device also obtains the reception time of the first ultrasonic signal.
[0217] The frequency band of the first ultrasonic signal can be 17kHz-48kHz, or optionally, 17kHz-23kHz. For example, the frequency of the first ultrasonic signal can be around 23kHz. The specific frequency of the first ultrasonic signal can be determined based on the actual application product, and is not limited here.
[0218] 303. The vehicle sends a second ultrasonic signal to the terminal device via the second speaker.
[0219] In this embodiment, the vehicle can broadcast a second ultrasonic signal to the terminal device via a second speaker. Correspondingly, the target terminal device receives the second ultrasonic signal sent by the second speaker and also obtains the reception time of the second ultrasonic signal. The second speaker and the first speaker are two different speakers.
[0220] Specifically, in one implementation, if steps 302 and 303 are executed simultaneously, the first ultrasonic signal and the second ultrasonic signal are different ultrasonic signals. The two different ultrasonic signals can be any one or more of the following: different frequencies, different signal modulation methods, different waveforms, different sub-values, or other types of differences.
[0221] In another implementation, if step 302 is executed first, and step 303 is executed after a preset time interval, the first ultrasonic signal and the second ultrasonic signal can be the same ultrasonic signal or different ultrasonic signals. For example, the preset time interval can be 0.05 seconds, 0.1 seconds, 0.15 seconds, 0.2 seconds or other durations, etc. The specific value can be determined in combination with the actual application product, and is not limited here.
[0222] 304. The vehicle sends a third ultrasonic signal to the terminal device via the third speaker.
[0223] In some embodiments of this application, if the vehicle uses at least three speakers to obtain the specific location of the terminal device inside the vehicle, the vehicle can also send a third ultrasonic signal to the terminal device via a broadcast through the third speaker. Correspondingly, the target terminal device receives the third ultrasonic signal sent by the third speaker, and the target terminal device also obtains the reception time of the third ultrasonic signal. The third speaker, the second speaker, and the first speaker are all different speakers.
[0224] Specifically, in one implementation, if steps 302, 303, and 304 are executed simultaneously, then the first ultrasonic signal, the second ultrasonic signal, and the third ultrasonic signal are all different ultrasonic signals.
[0225] In another implementation, if step 302 is executed first, then step 303 is executed after a preset time interval, and then step 304 is executed after a preset time interval, then the first ultrasonic signal, the second ultrasonic signal, and the third ultrasonic signal can be the same ultrasonic signal or different ultrasonic signals.
[0226] Optionally, if the vehicle uses four speakers to obtain the specific location of the terminal device inside the vehicle, the vehicle can also send a fourth ultrasonic signal to the terminal device via the fourth speaker in a broadcast manner. Correspondingly, the target terminal device receives the fourth ultrasonic signal sent by the fourth speaker, and the target terminal device also obtains the reception time of the fourth ultrasonic signal. The fourth speaker, the second speaker, and the first speaker are all different speakers.
[0227] Specifically, in one implementation, if the vehicle simultaneously sends ultrasonic signals to the terminal device through the first, second, third, and fourth speakers, then the first, second, third, and fourth ultrasonic signals are all different ultrasonic signals.
[0228] In another implementation, if ultrasonic signals are sent to the terminal device one by one through the first, second, third, and fourth speakers, and the time interval between the transmission times of two adjacent ultrasonic signals is a preset time interval, then the first, second, third, and fourth ultrasonic signals can be the same ultrasonic signal or different ultrasonic signals.
[0229] 305. The terminal device determines the target location information based on the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal. The target location information is used to indicate the location of the terminal device inside the vehicle.
[0230] In this embodiment of the application, the terminal device can determine the target location information based on the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal. The target location information is used to indicate the position of the terminal device inside the vehicle.
[0231] Furthermore, since the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal can reflect the relationship between the distance between the terminal device and the first and second speakers, and the positions of the multiple speakers in the vehicle are fixed, the distance relationship between the terminal device and each speaker will also be different when the position of the terminal device relative to the vehicle is different. Therefore, the target position information of the terminal device can be determined.
[0232] Optionally, if the vehicle transmits ultrasonic signals through at least three speakers, the terminal device can determine the target location information based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, and the reception time of the third ultrasonic signal.
[0233] Alternatively, if the vehicle transmits ultrasonic signals through four speakers, the terminal device can determine the target location information based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, the reception time of the third ultrasonic signal, and the reception time of the fourth ultrasonic signal.
[0234] Specifically, in one implementation, the vehicle simultaneously transmits ultrasonic signals through at least two speakers, i.e., steps 302, 303, and 304 are executed simultaneously. Step 305 may include: the target terminal device can be configured with a one-to-one correspondence between different types of ultrasonic signals and speakers at different locations; that is, each speaker at a specific location can consistently emit one type of ultrasonic signal, allowing the terminal device to know in advance which type of ultrasonic signal is emitted by which speaker. The target terminal device determines the order in which the different ultrasonic signals arrive at the terminal device based on the reception time of the at least two ultrasonic signals.
[0235] Since the vehicle transmits ultrasonic signals simultaneously through multiple speakers, the later the ultrasonic signal from a particular speaker arrives at the target terminal device, the greater the distance between that speaker and the target terminal device. In other words, the order in which the ultrasonic signals arrive at the terminal device represents the distance between the target terminal device and each speaker. The positions of the multiple speakers in the vehicle are fixed, but the distance relationship between different locations within the vehicle and each speaker varies. Therefore, the terminal device can determine the location of the target terminal device inside the vehicle (i.e., determine the target location information of the target terminal device) based on the order in which the ultrasonic signals arrive at the terminal device.
[0236] More specifically, in one scenario, if a vehicle sends ultrasonic signals to a terminal device via four speakers located at the left front, right front, left rear, and right rear positions, the target terminal device can obtain the reception times of the first, second, third, and fourth ultrasonic signals, respectively, determine the order in which the first, second, third, and fourth ultrasonic signals arrive at the target terminal device, and thus determine the target terminal device's target location information. Here, there are N positions inside the vehicle, and the target location information is used to indicate that the target terminal device is located at one of these N positions, where N is an integer greater than 1.
[0237] Furthermore, taking five locations inside the vehicle—the driver's seat, front passenger seat, left rear seat, right rear seat, and middle rear seat—as an example, this section demonstrates the principle of determining the target location information of the target terminal device based on the order in which each ultrasonic signal arrives at the target terminal device. If the ultrasonic signal emitted by the speaker located at the front left reaches the target terminal device first, followed by the ultrasonic signals emitted by the speakers located at the front right and rear left, and the ultrasonic signal emitted by the speaker located at the rear right reaches the target terminal device last, then the target terminal device is determined to be located in the driver's seat of the vehicle.
[0238] If the ultrasonic signal emitted by the speaker located at the front right reaches the target terminal device first, followed by the ultrasonic signals emitted by the speakers located at the front left and rear right, and the ultrasonic signal emitted by the speaker located at the rear left reaches the target terminal device last, then it is determined that the target terminal device is located in the passenger seat inside the vehicle.
[0239] If the ultrasonic signal emitted by the speaker located at the left rear reaches the target terminal device first, followed by the ultrasonic signals emitted by the speakers located at the left front and right rear, and the ultrasonic signal emitted by the speaker located at the right front reaches the target terminal device last, then the target terminal device is determined to be located on the left rear seat of the vehicle.
[0240] If the ultrasonic signal emitted by the speaker located at the right rear reaches the target terminal device first, followed by the ultrasonic signals emitted by the speakers located at the right front and left rear, and the ultrasonic signal emitted by the speaker located at the left front reaches the target terminal device last, then the target terminal device is determined to be located on the right rear seat of the vehicle.
[0241] If the ultrasonic signals emitted by the speakers located at the left front and right front positions arrive at the target terminal device at approximately the same time, and the ultrasonic signals emitted by the speakers located at the left rear and right rear positions arrive at the target terminal device at approximately the same time, and the ultrasonic signals emitted by the speakers located at the left rear and right rear positions arrive at the target terminal device earlier than the ultrasonic signals emitted by the speakers located at the left front and right front positions, then it is determined that the target terminal device is located in the middle of the rear row of the vehicle.
[0242] For a more intuitive understanding of the embodiments of this application, please refer to [link / reference]. Figure 5 , Figure 5 This is a schematic diagram illustrating the principle of a location acquisition method provided in an embodiment of this application. Figure 5 As shown, the distance between speaker 1 and terminal device 1 is the shortest, the distance between speaker 2 and speaker 3 and terminal device 1 is the next shortest, and the distance between speaker 4 and terminal device 1 is the farthest. If terminal device 1 detects that the ultrasonic signal emitted by speaker 1 arrives first, the ultrasonic signals emitted by speaker 2 and speaker 3 arrive next, and the ultrasonic signal emitted by speaker 4 arrives last, then terminal device 1 can determine that it is in the driver's seat.
[0243] If the distances between speakers 1 and 2 and terminal device 2 are similar, and the distances between speakers 3 and 4 and terminal device 2 are similar, and the distances between speakers 1 and 2 and terminal device 2 are greater than the distances between speakers 3 and 4 and terminal device 2, then if terminal device 2 detects that the ultrasonic signals emitted by speakers 3 and 4 arrive at approximately the same time, and the ultrasonic signals emitted by speakers 1 and 2 arrive at approximately the same time, and the ultrasonic signals emitted by speakers 3 and 4 arrive earlier than the ultrasonic signals emitted by speakers 1 and 2, then terminal device 2 can determine that it is located in the middle of the back row. This should be understood. Figure 5 The examples in the text are only for a more intuitive understanding of this solution and are not intended to limit this solution.
[0244] In another scenario, the vehicle can determine the location of the terminal device inside the vehicle (left or right) using two speakers. The two speakers are positioned on the left and right sides of the vehicle, such that the distance between the left speaker and the left-side location is less than the distance between the left speaker and the right-side location, and vice versa. The vehicle transmits ultrasonic signals to the terminal device through these two speakers, and the location of the target terminal device (left or right) can be determined by the ultrasonic signals received by the target terminal device.
[0245] Furthermore, if the ultrasonic signal emitted by the speaker on the left side of the vehicle arrives at the target terminal device first, and the ultrasonic signal emitted by the speaker on the right side of the vehicle arrives at the target terminal device later, then the target terminal device is located on the left side of the vehicle. If the ultrasonic signal emitted by the speaker on the right side of the vehicle arrives at the target terminal device first, and the ultrasonic signal emitted by the speaker on the left side of the vehicle arrives at the target terminal device later, then the target terminal device is located on the right side of the vehicle.
[0246] In another scenario, the vehicle can determine whether the terminal device is located in the front (driver's seat and front passenger seat) or rear (rear seat) area inside the vehicle using two speakers. The two speakers are positioned at the front and rear of the vehicle, respectively, such that the distance between the front speaker and the front seats is less than the distance between the front speaker and the rear seats, and the distance between the rear speaker and the rear seats is less than the distance between the rear speaker and the front seats. The target terminal device's location within the vehicle (front or rear) can be determined based on the ultrasonic signals received by the target terminal device.
[0247] Furthermore, if the ultrasonic signal emitted by the speaker located at the front of the vehicle arrives at the target terminal device first, and the ultrasonic signal emitted by the speaker located at the rear of the vehicle arrives at the target terminal device later, then the target terminal device is located in the front row of the vehicle. If the ultrasonic signal emitted by the speaker located at the rear of the vehicle arrives at the target terminal device first, and the ultrasonic signal emitted by the speaker located at the front of the vehicle arrives at the target terminal device later, then the target terminal device is located in the rear row of the vehicle.
[0248] It should be noted that, in this application embodiment, the specific implementation schemes for determining the in-vehicle position of the terminal device when there are other numbers of speakers or when the speakers are located in other positions are not described in detail one by one. They can be understood based on the same principle. The aforementioned principle is that after the position of sending ultrasonic signals is fixed, the distance between the terminal device in different in-vehicle positions and the speakers in different positions is different. Since the order in which different ultrasonic signals arrive at the target terminal device can represent the distance between the speakers in different positions and the terminal device, the target terminal device can determine its in-vehicle position based on the order in which different ultrasonic signals arrive at the target terminal device.
[0249] In this embodiment, since the greater the distance between the terminal device and a certain speaker, the later the ultrasonic signal emitted by the speaker arrives at the terminal device, if the vehicle simultaneously sends different ultrasonic signals to the terminal device through speakers in different locations, the order in which the different ultrasonic signals arrive at the terminal device can well reflect the distance relationship between the terminal device and each speaker, and thus the specific location of the terminal device inside the vehicle can be intuitively deduced, providing a simple and easy-to-implement scheme for obtaining target location information.
[0250] In another implementation, the vehicle transmits ultrasonic signals to the terminal device sequentially through at least two different speakers. The time interval between the transmission times of two adjacent ultrasonic signals is a preset time interval. The ultrasonic signals emitted by the vehicle through the different speakers can be the same or different. Then step 305 can include: the target terminal device determining its position inside the vehicle (i.e., determining the target position information of the target terminal device) based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, and the preset time interval.
[0251] Since the vehicle transmits ultrasonic signals one by one through different speakers at preset time intervals, the target terminal device can determine which speaker each received ultrasonic signal comes from based on the actual receiving order of each ultrasonic signal. Furthermore, based on the actual receiving time and preset time interval of each ultrasonic signal, it can determine the actual order of the distance between the target terminal device and each speaker, and thus determine the position of the target terminal device inside the vehicle. This principle can be found in the description of the previous implementation method.
[0252] More specifically, in one scenario, if a vehicle sends ultrasonic signals to a terminal device via four speakers located at the left front, right front, left rear, and right rear positions respectively, the target terminal device can obtain the first reception time of the first arriving ultrasonic signal (i.e., the first ultrasonic signal sent by the first speaker), the second arriving ultrasonic signal (i.e., the second ultrasonic signal sent by the second speaker), the third arriving ultrasonic signal (i.e., the third ultrasonic signal sent by the third speaker), and the fourth arriving ultrasonic signal (i.e., the fourth ultrasonic signal sent by the fourth speaker), respectively. Subtracting a preset time interval from the reception time of the second arriving ultrasonic signal yields the second reception time corresponding to the second arriving ultrasonic signal; subtracting 2 * the preset time interval from the reception time of the third arriving ultrasonic signal yields the third reception time corresponding to the third arriving ultrasonic signal; and subtracting 3 * the preset time interval from the reception time of the fourth arriving ultrasonic signal yields the fourth reception time corresponding to the fourth arriving ultrasonic signal.
[0253] The target terminal device determines its target location information based on the first, second, third, and fourth reception times. Furthermore, since the vehicle emits a first ultrasonic signal, followed by a second, third, and fourth ultrasonic signal after a preset time interval, the first, second, third, and fourth reception times can represent the distances between each speaker and the target terminal device. An earlier first reception time indicates a closer distance between the first speaker and the target terminal device, while a later first reception time indicates a greater distance. The second, third, and fourth reception times have the same meaning as the first reception time. With at least two speakers fixed in position, the distance relationships between different locations within the vehicle and each speaker vary. Therefore, the target terminal device can determine its target location information based on the first, second, third, and fourth reception times.
[0254] In another scenario, if a vehicle sends ultrasonic signals to a terminal device via two speakers, the target terminal device can obtain the first reception time of the first arriving ultrasonic signal (i.e., the first ultrasonic signal sent by the first speaker) and the second arriving ultrasonic signal (i.e., the second ultrasonic signal sent by the second speaker), respectively. Subtracting a preset time interval from the reception time of the second arriving ultrasonic signal yields the second reception time corresponding to the second arriving ultrasonic signal. If the first reception time is earlier than the second reception time, the target terminal device is determined to be located on the side where the first speaker is located; if the first reception time is later than the second reception time, the target terminal device is determined to be located on the side where the second speaker is located.
[0255] Specifically, if the first speaker and the second speaker are respectively located on the left and right sides of the vehicle, such that the distance between the left-side speaker and the left-side position is less than the distance between the left-side speaker and the right-side position, and the distance between the right-side speaker and the right-side position is less than the distance between the right-side speaker and the left-side position. The target position information of the target terminal device is used to indicate whether the target terminal device is located on the left or right side inside the vehicle.
[0256] If the first and second speakers are respectively located at the front and rear of the vehicle, such that the distance between the front speaker and the front passenger seat is less than the distance between the front speaker and the rear passenger seat, and the distance between the rear speaker and the rear passenger seat is less than the distance between the rear speaker and the front passenger seat, then the target location information of the target terminal device is used to indicate whether the target terminal device is located in the front or rear passenger seat inside the vehicle.
[0257] It should be noted that the specific implementation schemes for determining the in-vehicle position of the terminal device when there are other numbers of speakers or when the speakers are located in other positions are not described in detail in this application embodiment. Please refer to the above description for understanding.
[0258] This application provides another scheme for obtaining target location information, which improves the implementation flexibility of the scheme. By sequentially sending ultrasonic signals to the terminal device through different speakers, the difficulty of the terminal device processing each ultrasonic signal is reduced, which helps to improve the accuracy of the final obtained target location information.
[0259] In this embodiment of the application, a scheme for measuring the position of a user relative to a vehicle is provided. Using ultrasonic signals to measure the position of a terminal device relative to a vehicle is beneficial for obtaining accurate target position information. Since the user cannot perceive the ultrasonic signals, the user's accurate positioning relative to the vehicle is achieved without the user's awareness. In addition, no additional hardware needs to be added to the vehicle or terminal device, thus avoiding additional expenses.
[0260] II. Calculating the location of the terminal device inside the vehicle based on the distance between the terminal device and each speaker.
[0261] For details, please refer to Figure 6 , Figure 6 This is a flowchart illustrating a location acquisition method provided in an embodiment of this application. The location acquisition method provided in an embodiment of this application may include:
[0262] 1001. The vehicle and terminal equipment initiate in-vehicle location sensing operations.
[0263] For a detailed implementation of step 1001 in this embodiment, please refer to [link / reference needed]. Figure 3 The description of step 301 in the corresponding embodiment will not be repeated here.
[0264] 1002. The vehicle receives the first measurement signal sent by the target audio receiving terminal equipment.
[0265] In this embodiment, after both the vehicle and the terminal device initiate in-vehicle location sensing, the terminal device can send a first measurement signal to the vehicle. Correspondingly, the vehicle will also receive the first measurement signal sent by the terminal device through a target speaker. The vehicle is equipped with at least two speakers, and the target speaker is any one of the at least two speakers in the vehicle. The first measurement signal is an ultrasonic signal; the specific manifestation of the ultrasonic signal can be found in [reference needed]. Figure 3 The description in the corresponding embodiment.
[0266] 1003. The terminal device determines the transmission time of the first measurement signal as the third time.
[0267] 1004. The time when the vehicle receives the first measurement signal is defined as the first time.
[0268] 1005. The vehicle sends a second measurement signal to the terminal equipment via the target audio system.
[0269] In this embodiment, after both the vehicle and the terminal device initiate in-vehicle location sensing, the vehicle also sends a second measurement signal to the terminal device via a target speaker, and the terminal device receives this second measurement signal. The second measurement signal is an ultrasonic signal; the specific form of the ultrasonic signal can be found in [reference needed]. Figure 3 The description in the corresponding embodiment.
[0270] 1006. The time when the vehicle sends the second measurement signal is determined as the second time.
[0271] 1007. The terminal device determines the reception time of the second measurement signal as the fourth time.
[0272] It should be noted that steps 1002 to 1004 can be executed first, followed by steps 1005 to 1007; alternatively, steps 1005 to 1007 can be executed first, followed by steps 1002 to 1004. This embodiment does not limit the order in which the terminal device sends the first measurement signal and the vehicle sends the second measurement signal. If the terminal device sends the first measurement signal first, the vehicle sends the second measurement signal after receiving the first measurement signal; if the vehicle sends the second measurement signal first, the terminal device sends the first measurement signal after receiving the second measurement signal.
[0273] 1008. The vehicle or terminal equipment determines the distance between the terminal equipment and the target speaker based on the first time, the second time, the third time, and the fourth time.
[0274] In this embodiment of the application, after the vehicle or terminal device obtains the first time, the second time, the third time, and the fourth time, it can determine the distance between the terminal device and the target speaker based on the dual-end ranging algorithm according to the first time, the second time, the third time, and the fourth time.
[0275] Specifically, in one scenario, if the terminal device first sends a first measurement signal to the vehicle, and the vehicle, after receiving the first measurement signal, then sends a second measurement signal to the terminal device, then step 1008 may include: the vehicle or terminal device subtracting the first time from the second time to obtain a first time difference, subtracting the third time from the fourth time to obtain a second time difference, and then subtracting the first time difference from the second time difference to obtain a target time difference. The target time difference is the duration for the ultrasonic signal to propagate twice between the target speaker and the terminal device. Based on the target time difference, the vehicle or terminal device generates the distance between the terminal device and the target speaker.
[0276] In another scenario, if the vehicle first sends a second measurement signal to the terminal device, and the terminal device, after receiving the second measurement signal, then sends a first measurement signal back to the vehicle, then step 1008 may include: the vehicle or terminal device subtracting a fourth time from a third time to obtain a third time difference, subtracting the second time from the first time to obtain a fourth time difference, and then subtracting the third time difference from the fourth time difference to obtain a target time difference. The target time difference is the duration for the ultrasonic signal to propagate twice between the target speaker and the terminal device. The vehicle or terminal device then generates the distance between the terminal device and the target speaker based on the target time difference.
[0277] In this embodiment, since there may be clock misalignment between the vehicle and the terminal device, the difference between the two times obtained by the terminal and the difference between the two times obtained by the vehicle are used to avoid the error caused by the clock misalignment between the vehicle and the terminal device, so as to obtain an accurate distance.
[0278] In this embodiment, based on the principle of steps 1002 to 1008, the vehicle or terminal device can obtain the distance between the terminal device and each speaker. Specifically, in one implementation, the vehicle and terminal device repeatedly execute steps 1002 to 1008 at least once to obtain the distance between the terminal device and each speaker one by one.
[0279] In another implementation, steps 1002 and 1003 can be performed only once for the process of the terminal device sending a measurement signal to the speakers. That is, the terminal device can send the first measurement signal to each speaker in the vehicle in the form of broadcast. Correspondingly, each speaker in the vehicle receives the first measurement signal and records the time when the first measurement signal arrives at each of the at least two speakers.
[0280] Regarding the process of a vehicle sending measurement signals to a terminal device via audio, in one implementation, the vehicle can simultaneously send different ultrasonic signals (i.e., different measurement signals) to the terminal device via different audio sources. The terminal device can record the arrival time of the measurement signal emitted by each audio source.
[0281] In another implementation, the vehicle can also send ultrasonic signals (i.e., measurement signals) to the terminal device one by one through each speaker. The terminal device can record the time when the measurement signal emitted by each speaker arrives at the terminal device.
[0282] 1009. The vehicle or terminal device determines target location information based on the distance between the terminal device and each of at least two speakers, the target location information being used to indicate the location of the terminal device inside the vehicle.
[0283] In one implementation of this application embodiment, after the vehicle or terminal device obtains the distance between the terminal device and each of at least two speakers, it can base its actions on... Figure 3 Based on the principle described in the corresponding embodiment, the target location information is determined. For specific implementation details, please refer to [link / reference]. Figure 3 The description in the corresponding embodiment.
[0284] In another implementation, the vehicle or terminal device can draw circles with each speaker as the center and the distance between each speaker and the terminal device as the radius, to obtain at least two circles that correspond one-to-one with at least two speakers. The intersection area of the aforementioned at least two circles is the location of the terminal device inside the vehicle.
[0285] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 7 , Figure 7 This is a schematic diagram of a location acquisition method provided in an embodiment of this application. Figure 7Taking the use of speakers 1, 2, and 3 to measure the location of the terminal equipment inside the vehicle as an example. Figure 7 As shown, after obtaining the distances between the vehicle or terminal device and speakers 1, 2, and 3 respectively, a circle is drawn with speaker 1 as the center and the distance between the terminal device and speaker 1 as the radius; a circle is drawn with speaker 2 as the center and the distance between the terminal device and speaker 2 as the radius; a circle is drawn with speaker 3 as the center and the distance between the terminal device and speaker 3 as the radius; the vehicle or terminal device will... Figure 7 The shaded area (the intersection of the three circles mentioned above) is determined to be the location of the terminal device inside the vehicle. Figure 7 In this context, the terminal device is located inside the vehicle in the driver's seat; it should be understood that... Figure 7 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0286] It should be noted that the location of the vehicle's audio system and the purpose of the target location information can be found in [reference needed]. Figure 3 The descriptions in the corresponding embodiments will not be repeated here.
[0287] In this embodiment of the application, another scheme for measuring the position of a user relative to a vehicle is provided, which can improve the implementation flexibility of the scheme; using ultrasonic signals to measure the position of the terminal device relative to the vehicle is beneficial to obtaining accurate target position information, and since the user cannot perceive the ultrasonic signal, the user's accurate positioning relative to the vehicle is achieved without the user's awareness.
[0288] 3. Without obtaining the distance between the terminal device and the speaker, generate the location of the terminal device outside the vehicle.
[0289] For details, please refer to Figure 8a , Figure 8a This is a flowchart illustrating a location acquisition method provided in an embodiment of this application. The location acquisition method provided in an embodiment of this application may include:
[0290] 1201. The vehicle and terminal equipment initiate the external location sensing operation.
[0291] In some application scenarios, during the operation of a vehicle, when the vehicle determines that it needs to know the location of the terminal device outside the vehicle, it will initiate an external location sensing operation and send instruction information to the terminal device. The aforementioned instruction information is used to instruct the terminal device to initiate the external location sensing operation.
[0292] In other application scenarios, during the operation of the terminal device, when the terminal device determines that it needs to know its location outside the vehicle, it will initiate the external location sensing operation and send instruction information to the vehicle. The aforementioned instruction information is used to instruct the vehicle to initiate the external location sensing operation.
[0293] The specific implementation methods of the above steps and Figure 3 The specific implementation of step 301 in the corresponding embodiment is similar. That is, when the vehicle or terminal device detects the triggering condition of "external location sensing operation", the specific implementation of triggering both the vehicle and the terminal device to start the external location sensing operation can be referred to the above. Figure 3 The description of step 301 in the corresponding embodiment is different in that... Figure 3 In the corresponding embodiment, "in-vehicle position sensing operation" is replaced with Figure 8a The specific implementation scheme of "external position perception operation" will not be elaborated here.
[0294] The triggering conditions for activating external location sensing operations for vehicles and terminal devices are as follows. For example, when the vehicle or terminal device detects that the distance between itself and the vehicle is less than a preset distance threshold, the external location sensing operation can be triggered. Another example is when the vehicle or terminal device detects that the terminal device is located outside the vehicle. Yet another example is when the vehicle is parked, and so on. The specific scenarios in which external location sensing operations will be triggered can be determined based on the actual product form; they will not be listed here in detail.
[0295] 1202. The vehicle sends a first ultrasonic signal to the terminal device through the first sound system.
[0296] 1203. The vehicle sends a second ultrasonic signal to the terminal device via the second speaker.
[0297] 1204. The vehicle sends a third ultrasonic signal to the terminal device via the third speaker.
[0298] 1205. The terminal device determines the target location information based on the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal. The target location information is used to indicate the location of the terminal device outside the vehicle.
[0299] In this embodiment of the application, steps 1202 to 1205 are... Figure 3 The specific implementation principles of steps 302 to 305 in the corresponding embodiments are the same, and the specific implementation methods of steps 1202 to 1205 are the same as those in the embodiments. Figure 3 The specific implementations of 302 to 305 in the corresponding embodiments are similar, the difference being that... Figure 3 In the corresponding embodiment, the measurement is of the "position of the terminal device inside the vehicle". Figure 12 In the corresponding embodiment, the measurement is "the position of the terminal device located outside the vehicle".
[0300] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 8b , Figure 8b This is a schematic diagram illustrating the vehicle's external position in the location acquisition method provided in this application embodiment. As shown, Z1, Z2, Z3, Z4, and Z5 are five different external vehicle positions. In this embodiment, the target position information is used to indicate that the terminal device is located at one of the Z1, Z2, Z3, Z4, and Z5 external vehicle positions. Since the position of the speakers inside the vehicle is fixed, the distance relationship between different external vehicle positions and each speaker is different. Figure 3 The implementation principle is the same as the corresponding embodiments. In this embodiment, the location of the terminal device outside the vehicle can also be determined based on the reception time of each ultrasonic signal. It should be understood that the location outside the vehicle can also be divided in other ways. Figure 8b The examples provided are only for the purpose of understanding the feasibility of this solution.
[0301] For information on the location of multiple speakers within the vehicle used to measure the specific location of the terminal device located outside the vehicle, please refer to [reference needed]. Figure 3 The descriptions in the corresponding embodiments will not be repeated here.
[0302] That is, if the multiple speakers used to measure the specific location of the terminal device outside the vehicle include two speakers, then the two speakers can be located on the left and right sides of the vehicle, or the two speakers can be located on the front and rear sides of the vehicle, respectively.
[0303] If the multiple speakers used to measure the specific location of the terminal device outside the vehicle include at least three speakers, then the aforementioned at least three speakers are not located in a straight line.
[0304] If the multiple speakers used to measure the specific location of the terminal device outside the vehicle include four speakers, then the aforementioned four speakers can be located at the left front position, right front position, left rear position and right rear position inside the vehicle, respectively.
[0305] It should be noted that, in Figure 3 In a corresponding embodiment, the at least two speakers used to measure the specific location of the terminal device inside the vehicle are generally speakers located inside the vehicle; Figure 8a In a corresponding embodiment, the at least two speakers used to measure the specific location of the terminal device outside the vehicle can both be speakers located outside the vehicle, or both can be speakers located inside the vehicle.
[0306] In this embodiment, the position of the terminal device can be measured not only inside the vehicle but also outside the vehicle, which helps to expand the application scenarios of this solution.
[0307] IV. Calculating the location of the terminal device outside the vehicle based on the distance between the terminal device and each speaker.
[0308] For details, please refer to Figure 9 , Figure 9 This is a flowchart illustrating a location acquisition method provided in an embodiment of this application. The location acquisition method provided in an embodiment of this application may include:
[0309] 1301. The vehicle and terminal equipment initiate external location sensing operations.
[0310] 1302. The vehicle receives the first measurement signal from the target audio receiving terminal equipment.
[0311] 1303. The terminal device determines the transmission time of the first measurement signal as the third time.
[0312] 1304. The time when the vehicle receives the first measurement signal is defined as the first time.
[0313] 1305. The vehicle sends a second measurement signal to the terminal equipment via the target audio system.
[0314] 1306. The time when the vehicle sends the second measurement signal is determined as the second time.
[0315] 1307. The terminal device determines the reception time of the second measurement signal as the fourth time.
[0316] 1308. The vehicle or terminal equipment determines the distance between the terminal equipment and the target sound based on the first time, the second time, the third time, and the fourth time.
[0317] 1309. The vehicle or terminal device determines target location information based on the distance between the terminal device and each of at least two speakers, the target location information being used to indicate the location of the terminal device outside the vehicle.
[0318] In this embodiment of the application, steps 1301 to 1309 and... Figure 6 The specific implementation principles of steps 1001 to 1009 in the corresponding embodiments are the same, and the specific implementation methods of steps 1301 to 1309 are the same. Figure 6 The specific implementation methods of 1001 to 1009 in the corresponding embodiments are similar, the difference being that, Figure 6 In the corresponding embodiment, the measurement is of the "position of the terminal device inside the vehicle". Figure 9In the corresponding embodiment, the measurement refers to the "position of the terminal device outside the vehicle." For a description of the position outside the vehicle, please refer to the above description. Figure 9 The specific implementation methods of steps 1301 to 1309 will not be elaborated here.
[0319] V. Application Scenarios Based on the Specific Location of Terminal Devices
[0320] Optionally, in one application scenario, the target location information of the terminal device inside the vehicle is used to determine the terminal device's control authority over the vehicle, and terminal devices located in different locations have different control authority over the vehicle.
[0321] As an example, the control permissions of a terminal device located in the passenger seat may include: adjusting the passenger seat angle, adjusting the air conditioning temperature, adjusting the volume of the headrest on the passenger seat, and adjusting the brightness of the front lights; optionally, the terminal device permanently located in the passenger seat may also be able to switch music. The control permissions of a terminal device located in the rear right seat may include: adjusting the rear seat temperature, adjusting the brightness of the rear lights, and adjusting the volume of the headrest on the rear right seat. It should be understood that this example is only for the purpose of understanding this solution.
[0322] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 10 , Figure 10 This is a schematic diagram illustrating the control permissions of terminal devices located at different locations in the location acquisition method provided in the embodiments of this application. Figure 10 Includes two sub-diagrams, (a) and (b). Figure 10 The sub-diagram (a) illustrates the control permissions of the vehicle by the terminal device located in the passenger seat. Figure 10 (b) The sub-diagram illustrates the control permissions of the vehicle by the terminal device located on the left rear seat, such as Figure 10 As shown, the terminal device located in the passenger seat supports functions including: music switching, turning on and adjusting the temperature of the passenger-side air conditioning, adjusting the heating temperature of the passenger seat, and turning the smart aromatherapy diffuser on or off. The terminal device located on the right rear seat supports functions including: music switching, adjusting the heating temperature of the rear seats, and turning the smart aromatherapy diffuser on or off. This list is not exhaustive; that is, terminal devices located in different positions within the vehicle have different control permissions. It should be understood that the examples provided are for illustrative purposes only and are not intended to limit the scope of this solution.
[0323] Specifically, after obtaining its own target location information, any target terminal device inside the vehicle can send its location information back to the vehicle. The vehicle can then send permission information corresponding to the target terminal device's location within the vehicle. Upon receiving the permission information, the target terminal device can output a prompt message to remind the operator of its control permissions over the vehicle. The specific message used for this prompt can be determined based on the actual product and is not limited here.
[0324] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 11 , Figure 11 This is a schematic diagram illustrating the control permissions of terminal devices located at different locations in the location acquisition method provided in the embodiments of this application. Figure 11 (b) Sub-diagram needs to be combined with the above. Figure 10 To understand the description of sub-diagram (a), Figure 11 Includes two sub-diagrams, (a) and (b). Figure 11 In the sub-diagram (a), A1 represents the prompt information output by the target terminal device. When the user clicks A1, it triggers entry... Figure 11 (b) Sub-diagram, so that users can... Figure 11 The sub-diagram (b) illustrates vehicle control. It should be noted that in other implementations, in... Figure 11 As shown in sub-illustration (a), on the interface, the user can hold the terminal device and perform preset operations. Correspondingly, if the terminal device can detect that its movement trajectory is a preset trajectory through its built-in inertial measurement unit (IMU), it can trigger entry. Figure 11 (b) is a sub-diagram. Preset operations can include shaking or other actions, as detailed below. Figure 11 (a) Sub-diagram enters Figure 11 The method of (b) sub-diagram can be flexibly set according to the actual product form. The example here is only for the convenience of understanding this solution and is not intended to limit this solution.
[0325] In another application scenario, target location information is used to indicate whether a terminal device is located in the driver's seat of the vehicle. Specifically, after obtaining its own target location information, any terminal device inside the vehicle can send its target location information back to the vehicle. In this way, the vehicle can know the location of each terminal device inside the vehicle, that is, it can know which terminal device inside the vehicle is located in the driver's seat.
[0326] Optionally, the vehicle can project the screen content of a terminal device located in the driver's seat onto the vehicle's central control screen. Furthermore, when projecting the screen content of the terminal device in the driver's seat onto the central control screen, the content displayed on the central control screen does not need to be exactly the same as the screen content of the terminal device. The content displayed on the central control screen can include applications already configured in the vehicle and multiple applications from the terminal device. That is, the vehicle has its own user interface (UI) when not connected to the terminal device in the driver's seat. After connecting to the terminal device in the driver's seat, the number of application icons on the vehicle's UI may increase, or the vehicle's functions may increase, without significant changes to the vehicle's UI.
[0327] It should be noted that the terminal device can only perform the above screen projection operation after it has been paired with the vehicle.
[0328] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 12 and Figure 13 , Figure 12 This is a schematic diagram illustrating screen projection from a terminal device located in the driver's seat in the location acquisition method provided in this application embodiment. Figure 12 Includes two sub-diagrams, (a) and (b), please refer to them first. Figure 12 As shown in sub-diagram (a), if the terminal device located in the driver's seat has never been paired with the vehicle, the vehicle will send an inquiry message to the aforementioned terminal device. The terminal device can output this inquiry message, which is used to inquire whether to connect to the vehicle (i.e., pair with the vehicle). Figure 12 In sub-diagram (a), for example, if a user instructs the terminal device to connect to the vehicle via voice and text box, it will trigger the entry... Figure 12 (b) Sub-diagram; see also Figure 12 (b) Sub-diagram, Figure 12 (b) shows a schematic diagram of the terminal device and the vehicle side when the terminal device is connected to the vehicle. It should be understood that the specific schematic diagram when the terminal device is connected to the vehicle should be flexibly set in conjunction with the example application product. Figure 12 The examples in this document are merely illustrative of the solution and are not intended to limit the scope of the solution.
[0329] Furthermore, if the terminal device located in the driver's seat and the terminal device located in the passenger's seat exchange positions, the vehicle will determine whether the updated terminal device in the driver's seat has been paired with the vehicle. If the result is yes, the screen content of the updated terminal device will be projected onto the vehicle's central control screen; if the result is no, a pairing request will be sent to the updated terminal device to ensure that the screen content of the terminal device located in the driver's seat is always displayed on the vehicle's central control screen.
[0330] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 13 , Figure 13 This is a schematic diagram illustrating screen projection from a terminal device located in the driver's seat in the location acquisition method provided in this application embodiment. Figure 13 Includes two sub-diagrams, one on the left and one on the right. Refer to them first. Figure 13 The diagram on the left shows B1 on the screen of the terminal device located in the driver's seat and B2 on the screen of the terminal device located in the passenger seat. The fact that B1 is displayed on the vehicle's screen indicates that the terminal device located in the driver's seat (i.e., the terminal device pointed to by B1) is projecting its screen through the vehicle's central control screen.
[0331] See also Figure 13 The diagram on the right shows B2 on the screen of the terminal device located in the driver's seat and B1 on the screen of the terminal device located in the passenger seat. The vehicle screen shows B2, which means that the terminal device located in the driver's seat (that is, the terminal device pointed to by B2) is projecting its screen through the vehicle's central control screen. It should be understood that this example is only for the convenience of understanding this solution and is not intended to limit this solution.
[0332] In another application scenario, when a terminal device is connected to a vehicle, the target location information is used to help the vehicle determine the nearest in-vehicle device to the terminal device. Further, as an example, when the terminal device needs to perform a screen projection operation through the vehicle, the target location information is used to determine the nearest screen to the terminal device. As another example, when the terminal device is a wireless headset, the target location information is used to determine the nearest screen to the wireless headset; optionally, the target location information is used to enable the wireless headset to establish a communication connection with the nearest screen.
[0333] This application provides multiple application scenarios for target location information, improving the implementation flexibility of this solution.
[0334] exist Figures 1a to 13 Based on the corresponding embodiments, in order to better implement the above-described solutions of this application, related equipment for implementing the above solutions is also provided below. See details. Figure 14a , Figure 14aThis is a schematic diagram of a location acquisition device provided in an embodiment of this application. The location acquisition device 1400 is applied to a vehicle, which is included in a location acquisition system. The location acquisition system also includes a terminal device. The vehicle is equipped with at least two speakers, including a first speaker and a second speaker, located on both sides of the vehicle. The location acquisition device 1400 includes: a transmitting module 1401, used to transmit a first ultrasonic signal through the first speaker, the first ultrasonic signal being used by the terminal device to determine the reception time of the first ultrasonic signal, the reception time of the first ultrasonic signal being the time when the terminal device receives the first ultrasonic signal; the transmitting module 1401 is also used to transmit a second ultrasonic signal through the second speaker, the second ultrasonic signal being used by the terminal device to determine the reception time of the second ultrasonic signal, the reception time of the second ultrasonic signal being the time when the terminal device receives the second ultrasonic signal, the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal being used to determine target location information, the target location information indicating the position of the terminal device relative to the vehicle.
[0335] In one possible design, the transmitting module 1401 is specifically used to transmit a second ultrasonic signal through a second speaker while transmitting a first ultrasonic signal through a first speaker. The first ultrasonic signal and the second ultrasonic signal are different ultrasonic signals. The order in which the first ultrasonic signal and the second ultrasonic signal arrive at the terminal device is used to determine the target location information.
[0336] In one possible design, the transmitting module 1401 is specifically used to first transmit a first ultrasonic signal through a first speaker, and after a preset time interval, transmit a second ultrasonic signal through a second speaker. The reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, and the preset time interval are used to determine the target location information.
[0337] In one possible design, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0338] In one possible design, at least three speakers include four speakers, located at the front left, front right, rear left, and rear right positions in the vehicle.
[0339] In one possible design, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0340] In one possible design, the position inside the vehicle is either the left side or the right side; or, the position inside the vehicle is either the front side or the rear side; or, the position inside the vehicle is any one of the following: driver's seat, front passenger seat, left rear seat, right rear seat, or middle rear seat; or, there are N positions inside the vehicle, and the position inside the vehicle is a target position among these N positions, where N is greater than 5.
[0341] In one possible design, the target location information is used to determine the terminal device's control authority over the vehicle, with terminal devices located in different locations having different control authority over the vehicle; or, the target location information is used to indicate whether the terminal device is located in the driver's seat of the vehicle; or, when the terminal device is connected to the vehicle, the target location information is used to allow the vehicle to determine the on-board device that is closest to the terminal device.
[0342] In one possible design, please refer to Figure 14b , Figure 14b This is another schematic diagram of the location acquisition device provided in this application embodiment. The sending module 1401 is further configured to send a first indication message to the terminal device when the vehicle initiates a location sensing operation. The first indication message instructs the terminal device to initiate a location sensing operation, which is an operation for acquiring target location information. The location acquisition device 1400 also includes a receiving module 1402, configured to receive a first feedback message sent by the terminal device. The first feedback message instructs the vehicle to send a first ultrasonic signal and a second ultrasonic signal. Alternatively, the receiving module 1402 is further configured to receive a second indication message sent by the terminal device, and in response to the received second indication message, initiate a location sensing operation; the sending module 1401 is further configured to send a second feedback message to the terminal device, which instructs the terminal device to receive the first ultrasonic signal and the second ultrasonic signal.
[0343] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 1400 are different from those in this application. Figure 3 and Figure 8a The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0344] This application also provides another location acquisition device, please refer to... Figure 15 , Figure 15This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 1500 is applied to a terminal device, which is included in a location acquisition system. The location acquisition system also includes a vehicle equipped with at least two speakers, including a first speaker and a second speaker, located on different sides of the vehicle. The location acquisition device 1500 includes: a receiving module 1501 for receiving a first ultrasonic signal transmitted by the first speaker; the receiving module 1501 is also used to receive a second ultrasonic signal transmitted by the second speaker; and a determining module 1502 for determining target location information based on the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal, wherein the target location information indicates the position of the terminal device relative to the vehicle.
[0345] In one possible design, the determining module 1502 is specifically used to determine the order in which the first ultrasonic signal and the second ultrasonic signal arrive at the terminal device based on the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal when the first ultrasonic signal and the second ultrasonic signal are transmitted simultaneously; and to determine the target location information based on the order in which the first ultrasonic signal and the second ultrasonic signal arrive at the terminal device.
[0346] In one possible design, the determining module 1502 is specifically used to determine the target location information based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, and a preset time interval, wherein the preset time interval is the transmission time interval between two adjacent ultrasonic signals.
[0347] In one possible design, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0348] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 1500 are different from those in this application. Figure 3 and Figure 8a The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0349] This application also provides another location acquisition device, please refer to... Figure 16 , Figure 16This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 1600 is applied to a vehicle, which is included in the location acquisition system. The location acquisition system also includes a terminal device. The vehicle is equipped with at least two speakers, which are located on both sides of the vehicle. The target speaker is any one of the at least two speakers. The location acquisition device 1600 includes: a receiving module 1601, used to receive a first measurement signal sent by the terminal device through the target speaker, and determine the time of receiving the first measurement signal as a first time; a sending module 1602, used to send a second measurement signal to the terminal device through the target speaker, and determine the time of sending the second measurement signal as a second time, wherein both the first measurement signal and the second measurement signal are ultrasonic signals; a determining module 1603, used to determine the distance between the terminal device and the target speaker according to the first time, the second time, the third time, and the fourth time, wherein the third time is the time when the terminal device sends the first measurement signal, and the fourth time is the time when the terminal device receives the second measurement signal; the determining module 1603 is also used to determine target location information according to the distance between the terminal device and each of the at least two speakers, wherein the target location information indicates the position of the terminal device relative to the vehicle.
[0350] In one possible design, at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0351] In one possible design, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0352] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 1600 are different from those in this application. Figure 6 and Figure 9 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0353] This application also provides another location acquisition device, please refer to... Figure 17 , Figure 17This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 1700 is applied to a terminal device, which is included in a location acquisition system. The location acquisition system also includes a vehicle, which is equipped with at least two speakers located at different positions within the vehicle. The target speaker is any one of the at least two speakers. The location acquisition device 1700 includes: a transmitting module 1701, used to transmit a first measurement signal to the target speaker, and determine the transmission time of the first measurement signal as a third time; a receiving module 1702, used to receive a second measurement signal transmitted by the target speaker, and determine the reception time of the second measurement signal as a fourth time, wherein both the first and second measurement signals are ultrasonic signals; a determining module 1703, used to determine the distance between the terminal device and the target speaker based on the first time, the second time, the third time, and the fourth time, wherein the first time is the time when the vehicle receives the first measurement signal, and the second time is the time when the vehicle transmits the second measurement signal; the determining module 1703 is also used to determine target location information based on the distance between the terminal device and each of the at least two speakers, wherein the target location information indicates the position of the terminal device relative to the vehicle.
[0354] In one possible design, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0355] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 1700 are different from those in this application. Figure 6 and Figure 9 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0356] Referring to the following second embodiment, some embodiments of the second embodiment in this application are used to detect whether the terminal device is located inside or outside the vehicle; other embodiments are used to detect the specific location of the terminal device outside the vehicle.
[0357] Example 2
[0358] For specific details in the embodiments described in this application, please refer to [link / reference]. Figure 18 , Figure 18 This is a flowchart illustrating a location acquisition method provided in an embodiment of this application. The location acquisition method provided in an embodiment of this application may include:
[0359] 2001. When the vehicle detects that the first trigger condition is met and / or the terminal device detects that the second trigger condition is met, the vehicle and the terminal device initiate the first location sensing operation.
[0360] In some application scenarios, when the vehicle detects that a first triggering condition is met, it will initiate a first position sensing operation and send an instruction message to the terminal device. This instruction message is used to instruct the terminal device to initiate the first position sensing operation, which is used to measure whether the terminal device is inside or outside the vehicle. It should be noted that the steps executed by the vehicle in Embodiment 2 can be executed by the processor in the vehicle or by vehicle auxiliary equipment in the vehicle, depending on the actual product form, and will not be described further thereafter.
[0361] Specifically, the vehicle is deemed to have detected that the first triggering condition is met when it detects any one or more of the following situations: the vehicle detects that the vehicle is parked; or the vehicle detects that the distance between the terminal device and the vehicle meets the first distance condition; or the vehicle receives a first instruction, which is used to trigger the vehicle to obtain the first location information.
[0362] In this application embodiment, various specific manifestations of the first triggering condition are provided, which expands the application scenarios of this solution and improves the implementation flexibility of this solution.
[0363] For the scenario of vehicle detection and parking, the vehicle's auxiliary equipment can be equipped with various types of inertial measurement units (IMUs). These IMUs can use GPS or other sensors to measure the vehicle's speed, accelerometers to measure acceleration, and gyroscopes to measure angular velocity. The vehicle's auxiliary equipment then inputs the vehicle's speed, acceleration, and angular velocity into a classification model to obtain the predicted category information output by the model.
[0364] Here, the classification model is a model that has already undergone training. The classification model can be represented by a neural network or a non-neural network model. As examples, the classification model can be represented by a decision tree, random forest, extremely random tree, support vector machine, K-nearest neighbor (KNN) model, logistic regression model, or other types of classification models, etc., which are not exhaustive here.
[0365] The predicted category information indicates whether the vehicle is stationary or moving. In one implementation, the predicted category information output by the classification model may include a first probability value and a second probability value. The first probability value indicates the probability that the vehicle is stationary, and the second probability value indicates the probability that the vehicle is moving. For example, if the predicted category information includes 0.3 (i.e., the first probability value) and 0.7 (i.e., the second probability value), where 0.3 indicates a 0.3 probability that the vehicle is stationary and 0.7 indicates a 0.7 probability that the vehicle is moving, then the predicted category information indicates that the vehicle is moving. In another implementation, the predicted category information output by the classification model can be either a first value or a second value. When the predicted category information output by the classification model is the first value, it represents that the vehicle is stationary; when the predicted category information output by the classification model is the second value, it represents that the vehicle is moving. For example, the first value could be 0 and the second value could be 1, etc. These examples are only for the convenience of understanding this solution and are not intended to limit this solution.
[0366] In this embodiment, the vehicle's speed, acceleration, and angular velocity are input into a classification model to determine whether the vehicle is stationary or moving. This avoids obtaining the vehicle's state from the vehicle's control system, ensuring the independence of the vehicle's control system in the measurement process of the target position information of the terminal device, and is beneficial to improving the safety of the vehicle's operation.
[0367] This document addresses the scenario of detecting the distance between a vehicle and a terminal device. Specifically, in one implementation, both the vehicle and the terminal device can be equipped with Bluetooth. The vehicle can broadcast Bluetooth signals, and the terminal device, upon receiving the signal, can calculate the actual distance between them. In another implementation, the terminal device can also broadcast Bluetooth signals, and the vehicle, upon receiving this signal, can calculate the distance. Yet another implementation may utilize wireless communication technology (Wi-Fi) to calculate the distance. These methods for obtaining the actual distance between the vehicle and the terminal device are not exhaustively listed here.
[0368] The vehicle determines whether the distance between the terminal device and the vehicle meets a first distance condition. This first distance condition can be whether the distance between the terminal device and the vehicle is less than a preset distance, which can be 5 meters, 3 meters, 2 meters, 1 meter, or other values, etc., and is not limited here. Alternatively, the first distance condition can be that the distance between the terminal device and the vehicle gradually decreases until it meets the preset distance.
[0369] This addresses the scenario where the vehicle receives its first command. Specifically, in some implementations, the user can interact with the vehicle through vehicle auxiliary devices and / or the onboard computer. When the vehicle receives a preset operation input by the user, it can trigger the vehicle to generate a first command. The preset operation includes, but is not limited to, a request to retrieve a list of in-vehicle terminal devices, a request to switch terminal devices connected to the vehicle, or other types of operations.
[0370] In other implementations, the vehicle may receive instruction information sent by a terminal device, the instruction information being used to request the acquisition of the terminal device's first location information, and the vehicle, in response to the received instruction information, generates a first instruction.
[0371] It should be noted that when the vehicle detects other events, it can also be considered as triggering the first trigger condition. The specific events included in the first trigger condition need to be flexibly set according to the actual application scenario, and are not limited here.
[0372] In other application scenarios, when the terminal device detects that the second triggering condition is met, it will initiate the first location sensing operation and send an instruction message to the vehicle. This instruction message is used to instruct the vehicle to initiate the first location sensing operation, which is used to measure whether the terminal device is inside or outside the vehicle.
[0373] Specifically, when the terminal device detects any one or more of the following situations, it is considered that the second triggering condition has been met: the terminal device detects that the vehicle is parked; or, the terminal device detects that the distance between the terminal device and the vehicle meets the first distance condition; or, the terminal device detects that the displacement of the terminal device conforms to the preset displacement; or, the terminal device receives a second instruction, which is used to trigger the terminal device to obtain the first location information.
[0374] This scenario involves a terminal device detecting parked vehicles. Specifically, the terminal device can be pre-configured with a classification model. After the vehicle's speed, acceleration, and angular velocity are acquired, they can be sent to the terminal device. The terminal device then inputs these data into the classification model to obtain the predicted category information output by the model. The specific meanings of the classification model and the predicted category information can be found in the description above and will not be elaborated upon here.
[0375] For the scenario where the terminal device detects the distance between itself and the vehicle, the specific implementation method of the terminal device is similar to that of the scenario where the vehicle detects the distance between itself and the vehicle, and can be referred to the above description, so it will not be repeated here.
[0376] This scenario involves a terminal device detecting a displacement that matches a preset displacement. Specifically, the terminal device can be pre-configured with at least one type of IMU. The terminal device can obtain the displacement of the terminal device in the horizontal and / or vertical directions through the IMU, determine whether the displacement of the terminal device in the horizontal and / or vertical directions matches the preset displacement, and if the determination result is yes, then it is determined that the second triggering condition is met.
[0377] The preset displacement can be a horizontal displacement of the terminal device greater than or equal to a preset threshold; or, the preset displacement can be a vertical displacement of the terminal device greater than or equal to a preset threshold; or, the preset displacement can include both horizontal and vertical displacements of the terminal device greater than or equal to a preset threshold. When the detected displacement of the terminal device matches the preset displacement, it indicates that a possible boarding or alighting event has been detected. The specific preset displacement setting can be flexibly determined according to the actual situation and is not limited in detail here.
[0378] Regarding the scenario where the vehicle receives a second instruction, specifically, the terminal device can receive instruction information sent by He Liang. This instruction information is used to request the terminal device's first location information. In response to the received instruction information, the vehicle generates a second instruction, etc. The terminal device can also receive a second instruction in other scenarios, which will not be listed here.
[0379] It should be noted that when the terminal device detects other events, it can also be regarded as triggering the second triggering condition. The specific events included in the second triggering condition need to be flexibly set according to the actual application scenario, and are not limited here.
[0380] 2002. The vehicle sends at least one target audio signal to the terminal device.
[0381] In this embodiment, after both the vehicle and the terminal device initiate the first location sensing operation, the vehicle can send at least one target audio signal to the terminal device via its audio system. The target audio signal can be an ultrasonic signal, with a frequency band of 17kHz-48kHz. Optionally, the target audio signal can be in the frequency band of 17kHz-22kHz. The specific frequency of the target audio signal can be determined based on the actual application product and is not limited here. For example, the target audio signal can be a chirp signal, a ZC (zadoff-chu) sequence signal, or other types of audio signals, etc., which are not exhaustively listed here.
[0382] Furthermore, the specific formula for the Chirp signal in the time domain is as follows: Where φ0 is the initial phase difference, f0 is the starting frequency, and c is a constant.
[0383] The specific formula for the ZC sequence signal in the time domain is as follows: Where j is an imaginary number, and the square of j equals -1; 0 <u<N ZC gcd(N zc ,u)=1,c f =N ZC mod 2, N ZC Let q be the signal length of the ZC sequence signal, and q is an integer.
[0384] The aforementioned speaker can be a speaker located anywhere inside the vehicle, for example, in the upper left corner, upper right corner, lower left corner, lower right corner, or other locations; alternatively, if the vehicle is equipped with vehicle auxiliary equipment, the aforementioned speaker can also be a speaker on the vehicle auxiliary equipment.
[0385] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 19 , Figure 19 This is a schematic diagram of an audio source in the location acquisition method provided in an embodiment of this application. Figure 19 Taking in-vehicle smart screens as an example, vehicle assistance devices can use the speakers integrated into these screens to determine whether the terminal device is located inside or outside the vehicle. This should be understood. Figure 19 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0386] In this embodiment, since the linear frequency modulated signal or the ZC sequence signal is an energy-concentrating signal, using the linear frequency modulated signal or the ZC sequence signal as the target audio signal is beneficial for accurately estimating at least one arrival time corresponding to each target audio signal, thereby facilitating the acquisition of accurate first position information.
[0387] Specifically, in one implementation, the vehicle broadcasts multiple target audio signals via its speakers at a first preset frequency. The first preset frequency can be defined as the vehicle sending one target audio signal every d sampling points. For example, d could be 880, 1320, 1760, or other values, and can be flexibly set according to the actual scenario.
[0388] Multiple target audio signals include a first detection signal and a second detection signal. At least one arrival time corresponding to a target audio signal may include a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection. The second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection. The latest time in the first time set and the earliest time in the second time set can be used to determine the first location information.
[0389] In another implementation, the vehicle transmits one or more target audio signals via an audio system, wherein each target audio signal is used to determine a target time set corresponding to that target audio signal. The target time set includes at least one time when the target audio signal arrives at the terminal device via direct and / or reflected light. The earliest and latest times in the target time set can be used to determine first location information.
[0390] 2003. The terminal device acquires at least one arrival time corresponding to at least one target audio signal, wherein the at least one arrival time corresponding to a target audio signal includes the time when the target audio signal arrives at the terminal device by direct and / or reflected light.
[0391] In one embodiment of this application, when a vehicle broadcasts one or more target audio signals via a loudspeaker at a first preset frequency, the terminal device can obtain at least one arrival time corresponding to each target audio signal within a preset duration. The at least one arrival time corresponding to a target audio signal includes the time it takes for the target audio signal to reach the terminal device via direct and / or reflected light.
[0392] Specifically, the terminal device can pre-store parameter information of the target audio signal, such as the frequency band of the target audio signal, the amplitude, intensity, or other parameter information of the target audio signal. After each target audio signal reaches the terminal device through direct and / or reflection, the terminal device can filter the received audio signal through a bandpass filter to obtain a filtered signal. The frequency band of the filtered signal is consistent with the frequency band of the target audio signal.
[0393] The terminal device obtains a matching degree curve between the filtered signal and the target audio signal through a matched filter based on the filtered signal. This matching degree curve is used to indicate at least one arrival time corresponding to each target audio signal.
[0394] In this curve, the horizontal axis represents time, which can be measured in sampling points or seconds. The vertical axis represents the impulse response of the filtered signal at each time point. Each peak exceeding a preset peak threshold is considered as a target audio signal received by the terminal device, and the sampling point corresponding to each peak exceeding the preset threshold is considered an arrival time of the target audio signal.
[0395] Furthermore, the preset peak threshold can be any of the following: the maximum peak value * a within d sampling points (i.e., within one transmission cycle of the target audio signal) in the matching curve, where a ranges from 0.5 to 1; or, the average value * b of all values in the vertical direction within d sampling points (i.e., within one transmission cycle of the target audio signal) in the matching curve, where b ranges from 5 to 10; or the preset peak threshold can be set to other values. The value of the preset peak threshold can be flexibly set according to the actual product form. The example here is only for the convenience of understanding this solution and is not intended to limit this solution.
[0396] To understand this solution more intuitively, please refer to [link / reference]. Figure 20 , Figure 20 This is a schematic diagram of the matching degree curve in the location acquisition method provided in the embodiments of this application. Figure 20 The example illustrates five target audio signals arriving at a terminal device via direct and reflected signals, with a preset peak threshold set to the maximum peak value *a within the transmission period of a single target audio signal. Since each target audio signal may arrive at the terminal device via direct and / or reflected signals, after the vehicle emits one target audio signal, the terminal device may receive one or more target audio signals. Figure 20 Taking the example where the terminal device receives each target audio signal sent by the vehicle, the terminal device can obtain the arrival time corresponding to each audio signal. This should be understood as follows: Figure 20 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0397] In another scenario, since the vehicle transmits the target audio signal through its in-vehicle audio system, if the doors and all windows are closed, and the terminal device is located outside the vehicle and at a considerable distance, the target audio signal emitted by the vehicle may not reach the terminal device. In other words, the terminal device may not be able to collect any target audio signal within a preset time period. Specifically, if the terminal device can obtain zero arrival times corresponding to each target audio signal within the preset time period, the terminal device can generate first location information corresponding to the terminal device. In this application scenario, the first location information indicates that the terminal device is located outside the vehicle. Optionally, the terminal device can send the generated first location information to the vehicle.
[0398] The preset duration can range from 100ms to 20000ms. For example, the preset duration could be 200ms, 400ms, 600ms, or other values, etc., which are not exhaustive examples here. The specific implementation method for the terminal device to obtain the arrival time corresponding to each target audio signal can be found in the above description.
[0399] 2004. The terminal device generates first location information corresponding to the terminal device based on at least one arrival time, the first location information being used to indicate whether the terminal device is located inside or outside the vehicle.
[0400] In this embodiment, after obtaining at least one arrival time corresponding to each target audio signal, the terminal device can directly generate first location information corresponding to the terminal device based on the at least one arrival time corresponding to each target audio signal. Optionally, the terminal device can also send at least one arrival time corresponding to each target audio signal to the vehicle, so that the vehicle can generate the first location information corresponding to the terminal device.
[0401] To understand the principles of this solution more intuitively, please refer to [link / reference]. Figure 21 , Figure 21 Two schematic diagrams of the matching degree curve in the location acquisition method provided in the embodiments of this application. Figure 21 Includes two sub-diagrams, (a) and (b). Figure 21 The sub-schematic diagram (a) shows a schematic diagram of the matching degree curve obtained by the terminal device after the three target audio signals emitted by the vehicle at the first preset frequency arrive at the terminal device when the terminal device is located inside the vehicle. Figure 21 The sub-schematic diagram (b) shows a matching degree curve obtained by the terminal device after the three target audio signals emitted by the vehicle at the first preset frequency arrive at the terminal device when the terminal device is located outside the vehicle. Figure 21 (a) Sub-diagram and Figure 21In the sub-diagram (b), the sampling point is used as the time measurement unit, and the preset peak threshold is the maximum peak value *a within the transmission period of a target audio signal.
[0402] After a vehicle emits a target audio signal, the signal may reach the terminal device directly or after reflection from the surrounding environment. Because the interior of a vehicle is relatively small and enclosed, ... Figure 21 As shown in sub-schematic (a), when the terminal device is located inside the vehicle, the arrival times of at least one target audio signal are relatively concentrated. However, the space outside the vehicle is more open, as... Figure 21 As shown in sub-diagram (b), when the terminal device is located outside the vehicle, the multiple arrival times corresponding to a target audio signal are relatively dispersed. Therefore, after obtaining at least one arrival time corresponding to each target audio signal, the terminal device or vehicle can determine whether the terminal device is located inside or outside the vehicle. It should be understood that... Figure 21 The examples in this document are merely illustrative of the implementation principles of this solution and are not intended to limit the scope of this solution.
[0403] Specifically, in one implementation, at least one target audio signal includes multiple target audio signals emitted by the vehicle at a first preset frequency. The multiple target audio signals include a first detection signal and a second detection signal. The multiple arrival times corresponding to the multiple target audio signals include a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection. The second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection. The time interval between the arrival times in the first time set and the second time set is used to determine the first location information.
[0404] The vehicle may send the first detection signal earlier than the vehicle sends the second detection signal, or the vehicle may send the first detection signal later than the vehicle sends the second detection signal. The first time set and the second time set are adjacent on the matching degree curves corresponding to multiple target audio signals, that is, the first detection signal and the second detection signal are two different target audio signals, and they arrive at the terminal device adjacent to each other.
[0405] The judgment conditions for the first location information are as follows: If the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first location information indicates that the terminal device is located inside the vehicle. The factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first location information indicates that the terminal device is located outside the vehicle.
[0406] The time measurement unit used in the preset time range can include sampling points, milliseconds, seconds, or other time measurement units. For example, the preset time range can be from dc sampling points to d+e sampling points, where d sampling points is the time interval between two target audio signals sent by the vehicle. The values of c and e can be the same or different. For example, the values of c and e are both related to the sampling rate when processing the received target audio signal. For example, the value of e can be 50 sampling points, and the value of c can be between 400 and 960 sampling points. c and e can also have other values, which need to be flexibly determined based on the actual application scenario. This is not exhaustive.
[0407] In this implementation, the preset time range can be determined based on the time interval between two adjacent target audio signals sent by the vehicle, thus providing a simple way to determine the preset time range.
[0408] Regarding the meaning of the time interval between arrival times in the first time set and the second time set. In one case, the time interval between arrival times in the first time set and the second time set includes: a first time interval between the latest time in the first time set and the earliest time in the second time set. Then step 2004 may include: the terminal device or vehicle generating first location information based on the first time interval between the latest time in the first time set and the earliest time in the second time set.
[0409] More specifically, the terminal device or vehicle acquires a first time interval between the latest time in the first time set and the earliest time in the second time set, and determines whether the first time interval is within a preset time range. If the first time interval is within the preset time range, it is determined that the terminal device is located inside the vehicle; if the first time interval is not within the preset time range, it is determined that the terminal device is located outside the vehicle.
[0410] This application provides a specific implementation method for obtaining the first location information of a terminal device by utilizing the time interval between the arrival times in the first time set and the second time set. The method is simple to operate and easy to implement.
[0411] In another scenario, the time interval between arrival times in the first and second time sets includes the time interval between the middle time in the first time set and the earliest time in the second time set. In yet another scenario, the time interval between arrival times in the first and second time sets includes the time interval between the middle time in the first time set and the latest time in the second time set. The time interval between arrival times in the first and second time sets can also be expressed in other ways, and can be flexibly set according to the actual application product. No limitation is made here.
[0412] In another implementation, step 2004 may include: the terminal device or vehicle can acquire a target time set corresponding to each target audio signal, the target time set including at least one time when a target audio signal arrives at the terminal device via direct and / or reflected light. The terminal device or vehicle acquires the earliest and latest times in the target time set, and acquires a second time interval between the earliest and latest times in the target time set, and determines whether the second time interval is greater than or equal to a first time threshold. If the determination result is yes, it is determined that the terminal device is located outside the vehicle; if the determination result is no, it is determined that the terminal device is located inside the vehicle.
[0413] It should be noted that other methods can also be used to measure the dispersion of at least one arrival time corresponding to at least one target audio signal. The more dispersed the at least one arrival time corresponding to at least one target audio signal, the more it proves that the terminal device is located outside the vehicle; the more closely the at least one arrival time corresponding to at least one target audio signal, the more it proves that the terminal device is located inside the vehicle. Not all implementation methods will be listed here.
[0414] Optionally, after generating the first location information corresponding to the terminal device, the terminal device can send the first location information to the vehicle; correspondingly, after generating the first location information corresponding to the terminal device, the vehicle can send the first location information to the terminal device.
[0415] In this embodiment, the vehicle sends multiple target audio signals. These target audio signals can reach the terminal device through direct and / or reflection. Since the interior space of the vehicle is relatively enclosed, the multiple audio signals obtained after direct and / or reflection of a single target audio signal can reach the terminal device in a relatively concentrated manner. However, the exterior space of the vehicle is relatively open, and the multiple audio signals obtained after direct and / or reflection of a single target audio signal will reach the terminal device in a more dispersed manner. Therefore, the location of the terminal device inside or outside the vehicle can be determined based on the time interval between the first and second time sets, thus providing a solution for measuring the user's position relative to the vehicle. Furthermore, the audio signals can be emitted through the vehicle's built-in speakers, eliminating the need for additional hardware in the vehicle or terminal device and avoiding additional costs.
[0416] This application also provides another method for obtaining location, namely, measuring whether the terminal device is located inside or outside the vehicle. Please refer to [link to relevant documentation]. Figure 22 , Figure 22 This is another schematic flowchart illustrating the location acquisition method provided in this application embodiment. The location acquisition method provided in this application embodiment may include:
[0417] 2401. The vehicle sends multiple target audio signals to the terminal device at the second preset frequency.
[0418] In this embodiment of the application, when the vehicle is in a moving state, the vehicle can start to send multiple target audio signals outward in a broadcast manner through the audio system at a second preset frequency; since the vehicle is in a moving state, the terminal devices that the vehicle can detect are generally located inside the vehicle, so the multiple target audio signals sent by the vehicle at the second preset frequency can all reach the terminal devices.
[0419] Among them, the second preset frequency and Figure 18 The first preset frequency in the corresponding embodiments may be the same or different, and the specific meaning of the target audio signal can be found in [reference needed]. Figure 18 For details on how to determine whether a vehicle is in motion, please refer to the description in the corresponding embodiments. Figure 18 The specific implementation of step 2401 can also be found in the corresponding embodiments. Figure 18 The descriptions in the corresponding embodiments will not be repeated here.
[0420] 2402. When the vehicle is in motion, the terminal device acquires multiple first arrival times corresponding to multiple target audio signals. Each first arrival time represents the time when a target audio signal arrives at the terminal device.
[0421] In this embodiment, when the vehicle is in motion, the vehicle sends multiple target audio signals at a second preset frequency, which can reach the terminal device after direct and / or reflected transmission. The terminal device can obtain at least one arrival time corresponding to each target audio signal. For a detailed implementation of the aforementioned steps, please refer to [reference needed]. Figure 18 The description in the corresponding embodiment.
[0422] The terminal device can determine a first arrival time corresponding to each target audio signal based on at least one arrival time corresponding to each target audio signal. The first arrival time can be one of the at least one arrival times corresponding to each target audio signal; or, the first arrival time can be the earliest of the at least one arrival times corresponding to each target audio signal; or, the first arrival time can be the latest of the at least one arrival times corresponding to each target audio signal; or, the first arrival time can also be other arrival times among the at least one arrival times corresponding to each target audio signal, which are not exhaustively listed here.
[0423] The terminal device repeatedly performs the above operation and can obtain multiple first arrival times that correspond one-to-one with multiple target audio signals. A first arrival time represents the time when a target audio signal arrives at the terminal device when the terminal device is inside the vehicle.
[0424] 2403. When the terminal device detects that the second triggering condition is met, it acquires at least one second arrival time corresponding to at least one target audio signal.
[0425] In this embodiment, when the terminal device detects that a second trigger condition is met, it acquires at least one second arrival time corresponding to at least one target audio signal. For a detailed implementation of the terminal device detecting that the second trigger condition is met, please refer to [reference needed]. Figure 18 The specific implementation method of the terminal device acquiring at least one second arrival time corresponding to at least one target audio signal is the same as the specific implementation method of the terminal device acquiring multiple first arrival times corresponding to multiple target audio signals. The difference is that the first arrival time is obtained when the vehicle is in motion, and the second arrival time is obtained after the terminal device detects that the second triggering condition is met.
[0426] 2404. The terminal device generates first location information corresponding to the terminal device based on multiple first arrival times and at least one second arrival time. The first location information is used to indicate whether the terminal device is located inside or outside the vehicle.
[0427] In this embodiment of the application, after obtaining multiple first arrival times and at least one second arrival time, the terminal device can generate first location information corresponding to the terminal device based on the multiple first arrival times and at least one second arrival time. The first location information is used to indicate whether the terminal device is located inside or outside the vehicle.
[0428] Specifically, the terminal device determines a first predicted time corresponding to a second arrival time based on multiple first arrival times. The first predicted time indicates the time when the target audio signal arrives at the terminal device when the relative position between the terminal device and the vehicle remains unchanged, that is, when the terminal device is located inside the vehicle. Based on the first predicted time and the second arrival time, first location information is generated.
[0429] More specifically, regarding the process of generating the first predicted time: After the terminal device obtains multiple first arrival times corresponding one-to-one with multiple target audio signals, due to the clock difference between the vehicle and the terminal device, each first arrival time can be expressed as the following formula: in, The time when the i-th target audio signal sent by the vehicle arrives at the terminal device is represented by , where i represents the i-th target audio signal sent by the vehicle, T represents the time interval between two target audio signals sent by the vehicle, and b represents the clock difference between the vehicle and the terminal device.
[0430] The terminal device can calculate the clock difference 'b' between the vehicle and the terminal device using the least squares method, based on multiple first arrival times that correspond one-to-one with multiple target audio signals. When the terminal device detects that the second trigger condition is met, it can determine that the vehicle is about to send the k-th target audio signal, and can then use the formula... The first prediction time corresponding to the k-th target audio signal is calculated.
[0431] Regarding the process of generating first location information based on a first predicted time and a second arrival time, in one implementation, the terminal device can calculate a third time interval between the second arrival time and a first preset time, and determine whether the third time interval is greater than or equal to a second time threshold. If the determination result is yes, then it is determined that the terminal device is located outside the vehicle; if the determination result is no, then it is determined that the terminal device is located inside the vehicle.
[0432] In another implementation, the terminal device can calculate a third time interval Δt between the second arrival time and the first preset time. k and the third time interval Δt k Multiplying the distance by the speed of sound (s) yields the distance value d. The terminal device then determines whether the distance d is greater than or equal to a preset distance threshold d. thresholdIf the judgment result is yes, then the terminal device is determined to be located outside the vehicle; if the judgment result is no, then the terminal device is determined to be located inside the vehicle.
[0433] In this embodiment, since the terminal device that can continuously receive audio signals must be located inside the vehicle when the vehicle is in motion, the first predicted time can be obtained based on the multiple first arrival times. Then, based on the generated first predicted time and the actual second arrival time, it can be determined whether the terminal device is located inside or outside the vehicle. Only one speaker is needed to detect the first location information of the terminal device, which further reduces the implementation difficulty of this solution and is conducive to expanding the application scenarios of this solution.
[0434] Optionally, after generating the first location information corresponding to the terminal device, the terminal device can send the aforementioned first location information to the vehicle.
[0435] This application provides an alternative solution for measuring whether a terminal device is located inside or outside a vehicle, improving the implementation flexibility of this solution; and that is, using audio signals to measure whether the terminal device is located inside or outside the vehicle does not require adding additional hardware to the vehicle or the terminal device, thus avoiding additional costs.
[0436] This application also provides another method for obtaining location information, which measures the specific location of the terminal device outside the vehicle. Please refer to [link to relevant documentation]. Figure 23 , Figure 23 This is another schematic flowchart illustrating the location acquisition method provided in this application embodiment. The location acquisition method provided in this application embodiment may include:
[0437] 2501. The vehicle and terminal equipment initiate external location sensing operations.
[0438] In some application scenarios, during the operation of a vehicle, when the vehicle determines that it needs to know the location of the terminal device outside the vehicle, it will initiate an external location sensing operation and send instruction information to the terminal device. The aforementioned instruction information is used to instruct the terminal device to initiate the external location sensing operation, which is used to obtain the specific location of the terminal device outside the vehicle.
[0439] As an example, if a vehicle detects that the distance between itself and the terminal device is less than a preset threshold, it may need to know the specific location of the terminal device outside the vehicle. As another example, if a vehicle detects that the distance between itself and the terminal device is decreasing, it may need to know the specific location of the terminal device outside the vehicle. It should be understood that the distances mentioned here are for illustrative purposes only and are not intended to limit the scope of this solution.
[0440] 2502. The vehicle sends a first audio signal to the terminal device through the first speaker.
[0441] In this embodiment of the application, the vehicle may be equipped with at least three speakers, which are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. After the external location sensing operation is activated, a first audio signal can be sent to the terminal device via the first speaker in a broadcast manner.
[0442] 2503. The vehicle sends a second audio signal to the terminal device through the second speaker.
[0443] 2504. The vehicle sends a third audio signal to the terminal device through the third speaker.
[0444] In this embodiment, the vehicle can also transmit a second audio signal to the terminal device via a second speaker in a broadcast manner; and transmit a third audio signal to the terminal device via a third speaker in a broadcast manner. The specific representations of the first, second, and third audio signals are similar to those of the target audio signal and can be directly referred to... Figure 18 The descriptions in the corresponding embodiments will not be repeated here. Furthermore, the first audio signal, the second audio signal, and the third audio signal are signals with the same signal strength, that is, the volume of the first audio signal, the second audio signal, and the third audio signal is the same. The locations of the first speaker, the second speaker, and the third speaker can be referred to the description in Embodiment 1. It should be noted that the speakers in Embodiment 2 can be speakers located inside the vehicle or speakers located outside the vehicle.
[0445] Specifically, in one implementation, the vehicle can execute steps 2502 to 2504 simultaneously. In this case, the first audio signal, the second audio signal, and the third audio signal need to use different audio signals. The specific meaning of the different audio signals can be found in the description of one embodiment, and will not be repeated here.
[0446] In another implementation, the vehicle can first execute step 2502, then execute step 2503 after a preset time interval, and then execute step 2504 after a preset time interval. In this case, the first audio signal, the second audio signal, and the third audio signal can be the same audio signal or different audio signals.
[0447] Optionally, the vehicle can also send a fourth audio signal to the terminal device via the fourth speaker. Correspondingly, the terminal device can obtain the fourth signal strength of the received fourth audio signal. It should be noted that the vehicle can also use more speakers to send audio signals to the terminal device. The specific number of speakers used and the position of each speaker can be flexibly set according to the actual situation, and there is no limitation here.
[0448] It should be noted that the specific implementation method of the terminal device in determining the correspondence between each audio signal and the speaker at each location can be found in the description in Embodiment 1, and will not be repeated here.
[0449] 2505. The terminal device generates second location information corresponding to the terminal device based on the first signal strength of the received first audio signal, the second signal strength of the received second audio signal, and the third signal strength of the received third audio signal. The second location information is used to indicate the location of the terminal device outside the vehicle.
[0450] In this embodiment, since the distance between the terminal device and each speaker varies depending on the location of the terminal device outside the vehicle, the greater the distance the audio signal travels, the weaker the intensity of the audio signal received by the terminal device. Therefore, the terminal device can generate second location information corresponding to itself based on the first signal intensity of the received first audio signal, the second signal intensity of the received second audio signal, and the third signal intensity of the received third audio signal. The terminal device can then send its second location information to the vehicle.
[0451] To understand the principles of this solution more intuitively, please refer to [link / reference]. Figure 8b and Figure 24 , Figure 8b This is a schematic diagram illustrating the location outside the vehicle in the location acquisition method provided in this application embodiment. Figure 24 This is a schematic diagram illustrating the principle of the location acquisition method provided in the embodiments of this application. (See also:) Figure 8b , Figure 8b Taking the division of the vehicle's exterior into five zones, Z1 to Z5, as an example, it should be understood that... Figure 8b The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0452] See also Figure 24 , Figure 24 It needs to be combined Figure 8b To understand, Figure 24 Taking the terminal device located in region Z4 as an example, speaker 1 is the farthest from the terminal device, speaker 2 is the next furthest, and speaker 3 is the closest. Therefore, the audio signal emitted by speaker 1 reaches the terminal device with the weakest signal strength, followed by speaker 2, and then speaker 3. The audio signal emitted by speaker 3 reaches the terminal device with the strongest signal strength. Conversely, if the strengths of the three audio signals received by the terminal device from the three speakers meet the aforementioned criteria, it proves that the terminal device is located in region Z4. Figure 24 The examples in this document are merely illustrative of the implementation principles of this solution and are not intended to limit the scope of this solution.
[0453] Specifically, the terminal device can pre-store multiple sets of preset intensity information corresponding to multiple areas outside the vehicle. Each set of preset intensity information corresponding to a target area (any area outside the vehicle) includes at least three target intensity values corresponding to at least three speakers. A target intensity value represents the intensity of the audio signal emitted by one speaker when the terminal device is located at the center point of the target area. For example, if the exterior of the vehicle is divided into five areas, Z1 to Z5, the terminal device pre-stores five sets of intensity information corresponding to each of the five areas.
[0454] After acquiring the first signal strength, second signal strength, and third signal strength, the terminal device obtains a set of actual signal strength information. The terminal device calculates the distance between the actual signal strength information and each of the multiple preset signal strength information sets, and selects the set of preset signal strength information sets that is closest to the actual signal strength information. The area corresponding to the set of preset signal strength information sets with the closest distance is determined as the area where the terminal device is located. The aforementioned distances can be Euclidean distance, Mahalanobis distance, or other types of distances, etc., which are not exhaustively listed here.
[0455] In this embodiment, since the distance between the terminal device and each speaker varies depending on the location of the terminal device outside the vehicle, and the greater the distance the audio signal travels, the weaker the intensity of the audio signal received by the terminal device, the first signal strength, the second signal strength, and the third signal strength can respectively reflect the distance between the terminal device and the first speaker, the second speaker, and the third speaker. Therefore, the specific location of the terminal device outside the vehicle can be obtained based on the first signal strength, the second signal strength, and the third signal strength, providing another way to measure the specific location of the terminal device outside the vehicle and improving the implementation flexibility of this solution.
[0456] Optionally, after obtaining the second location information from the terminal device, the vehicle uses the second location information to determine the component closest to the terminal device from among the multiple components included in the vehicle, so as to control the component closest to the terminal device to perform a preset operation. The component can be a door, headlights, trunk, or other vehicle components, and the preset operation can be unlocking the door, opening the door, unlocking the trunk, turning on the headlights, or other operations, etc., without limitation.
[0457] For a more intuitive understanding of this solution, please refer to [link / reference]. Figure 25 , Figure 25 This is an application scenario diagram of the location acquisition method provided in the embodiments of this application. For example... Figure 25As shown, when the vehicle determines that the terminal device is located in area Z1 outside the vehicle, the left front door can be unlocked; when the vehicle determines that the terminal device is located in area Z2 outside the vehicle, the left rear door can be unlocked; when the vehicle determines that the terminal device is located in area Z5 outside the vehicle, the trunk can be unlocked. It should be understood that... Figure 25 This is merely an example to facilitate understanding of the solution and is not intended to limit the scope of the solution.
[0458] As another example, at night, when the vehicle determines that the terminal device is located in the Z1 area outside the vehicle, the left front headlight can be turned on to provide illumination for the user; as another example, when the vehicle determines that the terminal device is located in the Z2 area outside the vehicle, the car door can be opened automatically, and so on. Specific examples will not be listed here.
[0459] This application provides specific application scenarios for the second location information, which can be used to provide users with more accurate services and improve user stickiness.
[0460] exist Figures 1a to 25 Based on the corresponding embodiments, in order to better implement the above-described solutions of this application, related equipment for implementing the above solutions is also provided below. See details. Figure 26 , Figure 26 This is a schematic diagram of a location acquisition device provided in an embodiment of this application. The location acquisition device 2900 is applied to a vehicle, the vehicle is included in a location acquisition system, and the location acquisition system further includes a terminal device. The location acquisition device 2900 includes: a sending module 2901, used to send at least one target audio signal when a first trigger condition is detected, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal; the sending module 2901 is specifically used to send multiple target audio signals at a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection; and an acquisition module 2902, used to acquire first location information corresponding to the terminal device, the first location information being used to indicate whether the terminal device is located inside or outside the vehicle, and the time interval between the arrival times in the first time set and the second time set being used to determine the first location information.
[0461] In one possible design, the target audio signal is a linear frequency modulated signal or a ZC sequence signal.
[0462] In one possible design, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first location information indicates that the terminal device is located inside the vehicle, wherein the factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first location information indicates that the terminal device is located outside the vehicle.
[0463] In one possible design, the time interval between arrival times in the first time set and the second time set includes the time interval between the latest time in the first time set and the earliest time in the second time set.
[0464] In one possible design, the sending module 2901 is considered to have detected that the first triggering condition is met when it detects any one or more of the following situations: the vehicle is detected to be parked; or the distance between the terminal device and the vehicle is detected to meet the first distance condition; or a first instruction is obtained, which is used to trigger the vehicle to obtain the first location information.
[0465] In one possible design, the sending module 2901 is specifically used to acquire the vehicle's speed, acceleration, and angular velocity, and input the vehicle's speed, acceleration, and angular velocity into the classification model to obtain the predicted category information output by the classification model. The predicted category information indicates whether the vehicle is in a stationary or moving state.
[0466] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 2900 are different from those in this application. Figures 18 to 21 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0467] This application also provides another location acquisition device, please refer to... Figure 27 , Figure 27This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 3000 is applied to a terminal device, which is included in a location acquisition system. The location acquisition system also includes a vehicle. The location acquisition device 3000 includes: an acquisition module 3001, configured to acquire at least one arrival time corresponding to at least one target audio signal when a second trigger condition is detected, wherein the at least one target audio signal includes multiple target audio signals emitted by the vehicle at a preset frequency, the multiple target audio signals include a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection; and a generation module 3002, configured to generate first location information corresponding to the terminal device based on the time interval between the arrival times in the first time set and the second time set, wherein the first location information is used to indicate whether the terminal device is located inside or outside the vehicle.
[0468] In one possible design, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first location information indicates that the terminal device is located inside the vehicle, wherein the factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first location information indicates that the terminal device is located outside the vehicle.
[0469] In one possible design, the generation module 3002 is specifically used to generate first location information based on the time interval between the latest time in the first time set and the earliest time in the second time set.
[0470] In one possible design, when the acquisition module 3001 detects any one or more of the following situations, it is considered that the second triggering condition has been met: the vehicle is detected to be parked; or the distance between the terminal device and the vehicle is detected to meet the first distance condition; or the displacement of the terminal device is detected to meet the preset displacement; or a second instruction is obtained, which is used to trigger the terminal device to acquire the first position information.
[0471] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 3000 are different from those in this application. Figures 18 to 21 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0472] This application also provides another location acquisition device, see embodiments. Figure 28 , Figure 28 This is a schematic diagram of a location acquisition device provided in an embodiment of this application. The location acquisition device 3100 is applied to a vehicle, which includes a location acquisition system. The location acquisition system also includes a terminal device. The location acquisition device 3100 includes: a transmitting module 3101, used to transmit multiple target audio signals at a preset frequency. When the vehicle is in motion, one target audio signal is used to determine a first arrival time of the target audio signal arriving at the terminal device. When a second triggering condition is met, one target audio signal is used to determine a second arrival time of the target audio signal arriving at the terminal device; and an acquisition module 3102, used to acquire first location information corresponding to the terminal device. The first location information indicates whether the terminal device is located inside or outside the vehicle. Multiple first arrival times and at least one second arrival time are used to determine the first location information.
[0473] In one possible design, multiple first arrival times are used to determine a first prediction time corresponding to a second arrival time. The first prediction time indicates the time when the target audio signal arrives at the terminal device when the terminal device is located inside the vehicle. The first prediction time and the second arrival time are used to determine first location information.
[0474] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 3100 are different from those in this application. Figure 22 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0475] This application also provides another location acquisition device, please refer to... Figure 29 , Figure 29 This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 3200 is applied to a terminal device, which is included in a location acquisition system. The location acquisition system also includes a vehicle. The location acquisition device 3200 includes: an acquisition module 3201, used to acquire multiple first arrival times corresponding to multiple target audio signals when the vehicle is in motion, where each first arrival time represents the time when a target audio signal arrives at the terminal device, and the multiple target audio signals are emitted by the vehicle at a preset frequency; and a generation module 3202, used to acquire at least one second arrival time corresponding to at least one target audio signal when a second trigger condition is detected, and to generate first location information corresponding to the terminal device based on the multiple first arrival times and at least one second arrival time, whereby the first location information indicates whether the terminal device is located inside or outside the vehicle.
[0476] In one possible design, the generation module 3202 is specifically used to determine a first prediction time corresponding to a second arrival time based on a plurality of first arrival times, the first prediction time indicating the time when the target audio signal arrives at the terminal device when the terminal device is located inside the vehicle; and to generate first location information based on the first prediction time and the second arrival time.
[0477] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 3200 are different from those in this application. Figure 22 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0478] This application also provides another location acquisition device, see embodiments. Figure 30 , Figure 30 This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 3300 is applied to a vehicle, which includes a location acquisition system. The location acquisition system also includes a terminal device. The vehicle is equipped with at least three speakers, which are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. The location acquisition device 3300 includes: a transmitting module 3301, used to transmit a first audio signal through the first speaker, the first audio signal being used to determine a first signal strength of the first audio signal received by the terminal device; the transmitting module 3301 is also used to transmit a second audio signal through the second speaker, the second audio signal being used to determine a second signal strength of the second audio signal received by the terminal device; the transmitting module 3301 is also used to transmit a third audio signal through the third speaker, the third audio signal being used to determine a third signal strength of the third audio signal received by the terminal device. The first signal strength, the second signal strength, and the third signal strength are used to determine second location information corresponding to the terminal device, the second location information being used to indicate the location of the terminal device outside the vehicle.
[0479] In one possible design, the second location information is used to enable the vehicle to determine the component closest to the terminal device from among the multiple components included in the vehicle, so as to control the component closest to the terminal device to perform a preset operation.
[0480] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 3300 are different from those in this application. Figures 23 to 25 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0481] This application also provides another location acquisition device, please refer to... Figure 31 , Figure 31 This is another schematic diagram of the location acquisition device provided in an embodiment of this application. The location acquisition device 3400 is applied to a terminal device, which is included in a location acquisition system. The location acquisition system also includes a vehicle, which is equipped with at least three speakers that are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. The location acquisition device 3400 includes: a receiving module 3401, used to receive a first audio signal sent by the first speaker, a second audio signal sent by the second speaker, and a second audio signal sent by the third speaker; and a generating module 3402, used to generate second location information corresponding to the terminal device based on the first signal strength of the received first audio signal, the second signal strength of the received second audio signal, and the third signal strength of the received third audio signal. The second location information is used to indicate the location of the terminal device outside the vehicle.
[0482] It should be noted that the information interaction and execution process between the modules / units in the location acquisition device 3400 are different from those in this application. Figures 23 to 25 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.
[0483] In Embodiment 3 of this application, after obtaining the location information of the terminal device relative to the vehicle, that is, whether the terminal device is inside or outside the vehicle, it can be applied to various interaction scenarios between the vehicle and the terminal device. The various application scenarios are described one by one below.
[0484] Example 3
[0485] I. How the audio stream is processed when the first terminal device moves from inside the vehicle to outside the vehicle.
[0486] For details, please refer to Figure 32 , Figure 32 This is a flowchart illustrating an audio stream processing method provided in an embodiment of this application. The audio stream processing method provided in an embodiment of this application may include:
[0487] 3701. The first terminal device establishes a connection with the vehicle and switches the playback device for the first and second category audio streams from the first terminal device to the vehicle.
[0488] In this embodiment, if the first terminal device establishes a connection with a vehicle for the first time, the first terminal device can scan for surrounding electronic devices using Bluetooth, wireless fidelity (WIFI), or other technologies. If at least one vehicle is found within a preset distance threshold, the first terminal device can send a connection request to each vehicle to trigger a pairing operation between the first terminal device and the vehicle. If the first terminal device successfully pairs with one of the at least one vehicle, the first terminal device successfully establishes a connection with the aforementioned vehicle; if the pairing fails, the first terminal device cannot establish a connection with the aforementioned vehicle.
[0489] Specifically, after receiving a connection request from the first terminal device, the vehicle generates a personal identification number (PIN) in response and sends a response message to the first terminal device. Upon receiving the response message, the first terminal device can send the PIN code to the vehicle. The vehicle then matches the PIN code sent by the first terminal device with the generated PIN code. If the match is successful, it proves that the first terminal device and the vehicle have successfully paired; if the match fails, it proves that the first terminal device and the vehicle have failed to pair.
[0490] If the first terminal device and the vehicle are not establishing a connection for the first time, the first terminal device can use Bluetooth, wireless fidelity (WIFI) or other technologies to scan for surrounding electronic devices. If it finds at least one vehicle that has already been paired within a preset distance threshold, the first terminal device can send a connection request to the aforementioned vehicle. In response to the received connection request, the aforementioned vehicle establishes a connection with the first terminal device.
[0491] During the connection between the first terminal device and the vehicle, the first terminal device can send synchronization data to the vehicle. Correspondingly, the vehicle receives the synchronization data sent by the first terminal device, so that the first terminal device can perform one or more of the following tasks through the vehicle: playing audio streams, playing videos, navigation, video calls, making calls, or other tasks, etc., which are not exhaustive here.
[0492] After establishing a connection with the vehicle, the first terminal device can switch the playback device for the third category of audio streams from the first terminal device to the vehicle. The third category includes at least two categories of audio streams, namely the first and second categories. The specific categories of audio streams included in the third category can be flexibly determined based on the actual application scenario. For example, the third category may include media, calls, or other types of audio streams. The meanings of the first and second categories will be explained in subsequent steps and will not be elaborated here.
[0493] Specifically, the first terminal device may store indication information that records which playback device is used for at least two categories of audio streams included in the third category. The first terminal device may update the indication information. The indication information before the update indicates that the playback device for the third category of audio streams is the first terminal device, and the indication information after the update indicates that the playback device for the third category of audio streams is the vehicle.
[0494] As an example, the third type of audio stream could include the speaker of the first terminal device, the earpiece of the first terminal device, a vehicle connected to the first terminal device, or other possible playback devices, etc., which will not be listed here.
[0495] Furthermore, the aforementioned instructions may be presented as tables, flags, or other information types, which will not be listed exhaustively here.
[0496] 3702. During the process of the first terminal device being connected to the vehicle, the first terminal device or the vehicle detects that the first terminal device has moved from inside the vehicle to outside the vehicle.
[0497] In this embodiment of the application, during the process of the first terminal device being connected to the vehicle, the first terminal device or the vehicle can detect the first location information of the first terminal device within a preset time period. Based on the first location information of the first terminal device within the preset time period, it can be determined whether the first terminal device has moved from inside the vehicle to outside the vehicle.
[0498] Optionally, while the first terminal device is connected to the vehicle and the first terminal device is projecting its screen through the vehicle, the first terminal device or the vehicle detects that the first terminal device has moved from inside the vehicle to outside the vehicle.
[0499] The first terminal device refers to a terminal device that has established a connection with the vehicle and is located inside the vehicle; optionally, the first terminal device refers to a terminal device that has established a connection with the vehicle, performs screen projection operations through the vehicle, and is located inside the vehicle.
[0500] The preset time period can range from 10 seconds to 2 minutes. For example, the preset time period can be 20 seconds, 370 seconds, 45 seconds, 1 minute, 80 seconds, 90 seconds or other values. The specific preset time period can be flexibly set according to the actual application product, and there is no limitation here.
[0501] More specifically, in one implementation, the solution provided in Embodiment 2 can be used to obtain the first location information of the first terminal device within a preset time period. That is, in Embodiment 2, when the vehicle detects that the first trigger condition is met and / or the first terminal device detects that the second trigger condition is met, the vehicle and the first terminal device initiate a first location sensing operation and continuously obtain the first location information of the first terminal device within the preset time period. If the first terminal device or the vehicle detects that the first terminal device has moved from inside the vehicle to outside the vehicle, step 3702 is triggered. If the first terminal device or the vehicle detects that the first terminal device has always been inside the vehicle, the first terminal device can continue to project its screen through the vehicle.
[0502] Specifically, the vehicle transmits multiple target audio signals at a preset frequency. These multiple target audio signals include a first detection signal and a second detection signal. At least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the first terminal device via direct and / or reflected light, and the second time set includes at least one time when the second detection signal arrives at the first terminal device via direct and / or reflected light. The first terminal device generates first location information corresponding to itself based on the time interval between the arrival times in the first and second time sets. This first location information indicates whether the first terminal device is located inside or outside the vehicle. Based on the first location information of the first terminal device within a preset time period, it is determined that the first terminal device has moved from inside the vehicle to outside the vehicle.
[0503] It should be noted that the specific implementation of the above steps can be found in the description in Embodiment 2, and will not be repeated here.
[0504] In another implementation, when the vehicle detects that a first trigger condition is met and / or the first terminal device detects that a second trigger condition is met, the vehicle or the first terminal device can continuously acquire the distance between the first terminal device and the vehicle within a preset time period based on ultra-wideband (UWB) technology, Bluetooth technology, or other technologies. Based on the distance between the first terminal device and the vehicle within the preset time period, the first location information of the first terminal device within the preset time period is determined. Specifically, if the distance between the first terminal device and the vehicle is greater than or equal to a preset distance threshold, it proves that the first terminal device is outside the vehicle; if the distance between the first terminal device and the vehicle is less than the preset distance threshold, it proves that the first terminal device is inside the vehicle.
[0505] It should be noted that the vehicle or the first terminal device can also generate the first location information of the first terminal device through other technologies, which will not be listed here.
[0506] Furthermore, if the vehicle detects that the first terminal device has moved from inside the vehicle to outside, the vehicle will send an instruction message to the first terminal device, which instructs the first terminal device to move from inside the vehicle to outside within a preset time period. Alternatively, if the vehicle detects that the first terminal device has remained inside the vehicle, the vehicle will send an instruction message to the first terminal device, which instructs the first terminal device to remain inside the vehicle within a preset time period.
[0507] Optionally, to ensure a good user experience during calls, when the first terminal device is connected to the vehicle, if the target category of the target audio stream played by the first terminal device through the vehicle is a call, then during the user's call through the first terminal device, the first terminal device and the vehicle may not obtain the first location information of the first terminal device; that is, during the user's call through the first terminal device, the first terminal device and the vehicle will not detect whether the first terminal device has moved from inside the vehicle to outside the vehicle.
[0508] If a user wants to switch the playback device of the target audio stream (category: call) from the vehicle to another electronic device, the user needs to actively input a first switching operation. The first terminal device or vehicle responds to the received first switching operation by switching the playback device of the target audio stream (category: call) to the electronic device corresponding to the first switching operation.
[0509] Audio streams categorized as "calls" can include: audio streams generated during calls through instant messaging applications, audio streams generated during video calls through instant messaging applications, or other audio streams classified as "calls".
[0510] Specifically, regarding the method of user-initiated first switching operation, in one implementation, the user can input the first switching operation through the display interface of the first terminal device, or the user can input the first switching operation through the vehicle's display interface. For a more intuitive understanding of this solution, please refer to [link to relevant documentation]. Figure 33 , Figure 33 This is a schematic diagram of the receiving interface for the first switching operation in the audio stream processing method provided in the embodiments of this application. Figure 33 The image shows an example of the display interface of a vehicle's central control screen. As shown in the figure, the current playback device for the target audio stream of type "call" is the audio system configured in the vehicle. Figure 33 The document also shows three connection methods for the terminal device: speaker, earpiece, and Bluetooth. Users can initiate the first switching operation by clicking the icons on the display interface. It should be understood that... Figure 33 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0511] In another implementation, during the process of the first terminal device playing a target audio stream of type "call" through the vehicle, if the first terminal device detects that the user is holding the first terminal device close to their ear, it can be regarded as the user inputting a first switching operation through the first terminal device, and the playback device corresponding to the first switching operation is the earpiece of the first terminal device.
[0512] As an example, when a user brings the first terminal device close to their ear, the first terminal device can detect the proximity of the device to the ear through its capacitive screen. Alternatively, the first terminal device can detect the action of being picked up and brought close to the ear through devices such as a gyroscope, gravity sensor, or proximity sensor, thereby determining that the user has brought the first terminal device close to their ear. It should be noted that the first terminal device can also detect whether the user has brought the first terminal device close to their ear through other technologies. The examples given here are only to demonstrate the feasibility of this solution and are not intended to limit this solution.
[0513] Further optionally, after a user finishes a call using the first terminal device, the first terminal device or the vehicle can be triggered to obtain the location information of the first terminal device. If the first terminal device is detected to be outside the vehicle, the playback device for at least one type of audio stream played by the vehicle can be switched from the vehicle to the first terminal device; or, the playback device for other types of audio streams besides media can be switched from the vehicle to the first terminal device.
[0514] After the detection terminal device is located outside the vehicle, the display interface of the vehicle's central control screen can be switched to off-vehicle mode. In off-vehicle mode, the content displayed on the vehicle's central control screen can be any one or more combinations of the following: black screen, wallpaper, display time or illustration, prompts or other information; the aforementioned prompts are used to indicate the current status of the vehicle's central control screen. It should be noted that other information can also be displayed on the vehicle's central control screen in off-vehicle mode. The specific information displayed can be flexibly set according to the actual product form, and will not be exhaustive here.
[0515] In this embodiment, when the first terminal device and the vehicle are connected, and audio pickup is required, whether to use the pickup device on the first terminal device or the pickup device in the vehicle can be determined based on the playback device used for the audio stream of the "call" category. That is, if the first terminal device plays the "call" category audio stream through the vehicle, then the first terminal device can pick up audio through the vehicle; if the first terminal device plays the "call" category audio stream through itself, then the first terminal device can pick up audio through itself. Specifically, the pickup device can be a microphone or other types of pickup devices.
[0516] In this embodiment, during the process of the first terminal device being connected to the vehicle, and while the first terminal device remains inside the vehicle, if the first terminal device detects that a connection has been established between the headphones and the first terminal device, in one implementation, the output devices of all audio streams included in the third category can be automatically switched to headphones; in another implementation, the first terminal device can output a query message to inquire whether to switch the output devices of all audio streams to headphones. The first terminal device can respond to the user's input switching operation and switch the output devices of all audio streams to headphones.
[0517] 3703. The first terminal device determines whether there is a target audio stream being played through the vehicle. If the determination result is yes, proceed to step 3704; if the determination result is no, switch the playback device of the third category audio stream from the vehicle to the first terminal device. The third category includes all categories corresponding to the audio stream played by the first terminal device through the vehicle.
[0518] In some embodiments of this application, when the first terminal device determines that it has moved from inside the vehicle to outside the vehicle, it can determine whether there is a target audio stream being played through the vehicle. If the determination result is yes, then step 3704 is triggered; if the determination result is no, then the playback devices of the third category of audio streams are switched from the vehicle to the first terminal device. The third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle.
[0519] Specifically, during the process of the first terminal device being connected to the vehicle, and during the process of the first terminal device moving from inside the vehicle to outside the vehicle, if the first terminal device does not play any audio stream through the vehicle, the playback devices for all categories of audio streams included in the third category can be switched from the vehicle to the first terminal device, and the display interface of the vehicle's central control screen can enter the off-vehicle mode.
[0520] To understand this solution more intuitively, please refer to [link / reference]. Figure 34 , Figure 34 This is a schematic diagram of an off-vehicle mode in the audio stream processing method provided in the embodiments of this application. Figure 34 Includes three sub-diagrams: (a), (b), and (c). Figure 34 The three sub-diagrams (a), (b), and (c) illustrate the display interface of the vehicle's central control screen after switching the playback device for all audio streams including the third category from the vehicle to the first terminal device. It should be understood that... Figure 34 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0521] 3704. The first terminal device obtains the target category corresponding to the target audio stream being played in the vehicle.
[0522] In this embodiment of the application, when the first terminal device is connected to the vehicle, when it is detected that the first terminal device has moved from inside the vehicle to outside the vehicle and the first terminal device has a target audio stream being played through the vehicle, the first terminal device can obtain the target category corresponding to the target audio stream being played by the vehicle.
[0523] The target audio stream can be categorized as follows: call, music, system, or other. System audio streams can include one or more of the following: ringtones for incoming calls, alarm clocks or countdowns, voice assistant announcements, notifications, touchscreen sounds, lock screen sounds, dial key tones, camera sound effects, screenshot sound effects, screen reading, or other sound effects, etc. This list is not exhaustive. It should be noted that the specific types of audio streams that can be played through a vehicle should be determined based on the actual product; no limitations are specified here.
[0524] 3705. The first terminal device determines whether the target category is the first category. If the determination result is yes, proceed to step 3706; if the determination result is no, proceed to step 3709.
[0525] In this embodiment of the application, after the first terminal device obtains the target category corresponding to the target audio stream being played by the vehicle, it can determine whether the target category is the first category. If the target category is the first category, it proceeds to step 3706; if the target category is not the first category, it proceeds to step 3709.
[0526] The first category can include media, and audio streams categorized as media can include: audio streams generated by music, video, and game applications, audio in instant messaging applications, or other audio streams classified as media, etc., which will not be listed exhaustively here.
[0527] In this embodiment, since audio streams categorized as media are generally more entertaining and have lower privacy requirements, when the first terminal device moves from inside the vehicle to outside, the vehicle will only continue playing the target audio stream if the type of the target audio stream being played is media. This ensures the entertainment of other people in the vehicle while minimizing the leakage of user privacy.
[0528] Of course, in this embodiment of the application, the first category can also be any category other than media, and this is not limited here.
[0529] 3706. The first terminal device continues to send the target audio stream to the vehicle, and then proceeds to step 3707.
[0530] In this embodiment of the application, step 3705 is an optional step. If step 3705 is not executed, step 3706 can be entered after step 3704 is executed. The first terminal device can continue to send the target audio stream to the vehicle. Correspondingly, after the vehicle receives the target audio stream sent by the first terminal device, it will continue to play the target audio stream. That is, after the first terminal device moves from inside the vehicle to outside the vehicle, the playback device of the target type audio stream is still the vehicle.
[0531] Optionally, the playback device for audio streams in other categories besides the target category in the third category can be switched from the vehicle to the first terminal device. The third category includes all categories of audio streams played by the first terminal device through the vehicle.
[0532] If step 3705 is executed, the first terminal device can continue to send the target audio stream to the vehicle if it determines that the target category corresponding to the target audio stream being played in the vehicle belongs to the first category. Correspondingly, after receiving the target audio stream sent by the first terminal device, the vehicle will continue to play the target audio stream. That is, after the first terminal device moves from inside the vehicle to outside the vehicle, the playback device for the audio stream of the first category is still the vehicle.
[0533] After detecting that the first terminal device has moved from inside the vehicle to outside, the vehicle's central control screen can switch to off-vehicle mode. For a more intuitive understanding of this solution, please refer to [link to relevant documentation]. Figure 35 , Figure 35 This is a schematic diagram of an off-vehicle mode in the audio stream processing method provided in the embodiments of this application. Figure 35 Includes four sub-diagrams: (a), (b), (c), and (d). Figure 35 The sub-illustrative diagram (a) represents the interface when the first terminal device is located inside the vehicle and the first terminal device plays an audio stream of a media type through the vehicle; Figure 35 Sub-diagrams (b), (c), and (d) represent three different display interfaces on the vehicle's central control screen when the first terminal device is moved from inside the vehicle to outside. It should be understood that... Figure 35 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0534] Specifically, regarding the process of the first terminal device playing a target audio stream through the vehicle. In one implementation, if the vehicle auxiliary device is an aftermarket device installed in the vehicle, the first terminal device can send the target audio stream to the vehicle auxiliary device configured in the vehicle (i.e., an example of the vehicle's central control screen) to play the target audio stream through the vehicle auxiliary device's speakers and display the projected data through the vehicle auxiliary device's screen.
[0535] In another implementation, if the vehicle auxiliary device is an aftermarket device for the vehicle, the first terminal device can send the target audio stream to the vehicle's processor to play the target audio stream through the speakers located in the main body of the vehicle, and send other projection data to the vehicle auxiliary device configured in the vehicle (i.e., an example of the vehicle's central control screen) to display the projection data through the screen of the vehicle auxiliary device.
[0536] In another implementation, if the vehicle is not equipped with vehicle auxiliary equipment, the first terminal device can send all the projection data to the vehicle's processor to play the target audio stream through the vehicle's main audio system and display the projection data on the screen of the onboard computer integrated in the vehicle.
[0537] Optionally, while the first terminal device is playing the first type of audio stream through the vehicle, the first terminal device can output first information, which prompts the user to switch the playback device of the first type of audio stream from the vehicle to the first terminal device. Furthermore, the first terminal device may display the first information in various forms, including but not limited to displaying the first information in a pop-up window, displaying the first information in a drop-down menu, displaying the first information in the form of a toggle icon, or other methods, etc., which are not exhaustively listed here.
[0538] If the first terminal device obtains the first switching operation input by the user based on the first information, then in response to the obtained first switching operation, the playback device of the first type of audio stream is switched from the vehicle to the first terminal device, and the first terminal device stops sending the first type of audio stream to the vehicle.
[0539] To understand this solution more intuitively, please refer to [link / reference]. Figure 36 , Figure 36 Two schematic diagrams illustrating the first information displayed by the first terminal device in the audio stream processing method provided in the embodiments of this application. Figure 36 Includes two sub-diagrams, (a) and (b). Figure 36 In the sub-illustration diagram (a), area C1 shows the first information displayed in the form of a pop-up window. Users can click "Switch to mobile phone" in area C1 to input the first switching operation. Figure 36 In sub-diagram (b), area C2 shows the first information displayed in a drop-down box. Users can click on "Switch audio / video to mobile phone" in area C1 to input the first switching operation, etc. It should be understood that... Figure 36 The examples provided are only for the purpose of understanding how the first information is displayed. The specific display method of the first information and the method of obtaining the first switching operation can be flexibly set according to the actual product form, and they are not listed here.
[0540] In this embodiment of the application, while the target audio stream continues to be played by the vehicle, first information is output. The first information is used to prompt the user to switch the playback device of the first type of audio stream from the vehicle to the first terminal device. That is, the user can decide whether to switch the playback device of the first type of audio stream back to the first terminal device according to the actual situation, which improves the flexibility of this solution in the switching process of the audio stream playback device.
[0541] 3707. The first terminal device switches the playback device of audio streams of other categories in the third category, excluding the target category, from the vehicle to the first terminal device.
[0542] In some embodiments of this application, step 3705 is an optional step. If step 3705 is not executed, after detecting that the first terminal device has moved from inside the vehicle to outside the vehicle, while the playback device of the first category of audio streams remains the vehicle, the playback device of audio streams of other categories in the third category, excluding the target category, can be switched from the vehicle to the first terminal device.
[0543] Specifically, when the first terminal device is already outside the vehicle and playing an audio stream of the first category through the vehicle, if the first terminal device needs to play a new audio stream, the first terminal device can obtain the category corresponding to the new audio stream. If the category corresponding to the new audio stream is not the target category, since the playback device for audio streams of other categories in the third category besides the target category has been switched from the vehicle to the first terminal device, the first terminal device can play the aforementioned new audio stream, and the first terminal device does not send the aforementioned new audio stream to the vehicle.
[0544] Furthermore, if the first terminal device stores indication information that records which playback device is used for at least two categories of audio streams included in the third category, the first terminal device needs to update the indication information again. Specifically, the indication information before the update indicates that the playback device for at least two categories of audio streams included in the third category is a vehicle. If step 3705 is not executed, the updated indication information can indicate that the playback device for audio streams in other categories besides the target category in the third category is the first terminal device. If step 3705 is executed, since the target category audio stream is determined to be a first category audio stream, and the third category audio stream includes both first and second category audio streams, the updated indication information can indicate that the playback device for the second category audio stream is the first terminal device.
[0545] In this embodiment, after the first terminal device moves from inside the vehicle to outside, not only does the vehicle continue to play the first type of audio stream, but the playback device for the second type of audio stream is switched from the vehicle to the first terminal device. The first and second categories are different categories, meaning that the playback device for some audio streams remains in the vehicle, while the playback device for the other part of the audio streams is switched from the vehicle to the first terminal device. This allows for flexible settings based on actual circumstances as to which categories of audio streams continue to be played by the vehicle and which categories of audio streams are switched to the first terminal device, thus improving the implementation flexibility of this solution.
[0546] If step 3705 is executed, the first terminal device, having determined that the target category is the first category, continues to send the target audio stream of the first category to the vehicle. That is, step 3707 can also be described as switching the playback device of the second category audio stream generated by the first terminal device from the vehicle to the first terminal device. Here, the second category and the first category are different categories; the second category can include all audio streams of all categories other than the first category included in the third category.
[0547] Specifically, when the first terminal device is already outside the vehicle and playing an audio stream of the first category through the vehicle, if the first terminal device needs to play a new audio stream, the first terminal device can obtain the category corresponding to the new audio stream. If the category corresponding to the new audio stream is the second category, since the playback device for the second category audio stream has been switched from the vehicle to the first terminal device, the first terminal device can play the second category audio stream, and the first terminal device does not send the second category audio stream to the vehicle.
[0548] It should be noted that step 3707 is an optional step. If step 3707 is not executed, in another implementation, after detecting that the first terminal device has moved from inside the vehicle to outside the vehicle, since the playback device of the target audio stream is still the vehicle, the playback device of all audio streams in the third category can be defaulted to the vehicle.
[0549] When the first terminal device needs to play a new audio stream, it can output third information. This third information prompts the user to switch the playback device for all audio streams in the third category from the vehicle to the first terminal device. It should be noted that the specific implementation of the first terminal device outputting the third information is similar to that of the first terminal device outputting the first information; please refer directly to the above description, which will not be repeated here.
[0550] 3708. When the first terminal device receives a playback operation for the first audio stream, it outputs first information, wherein the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream being played by the vehicle. The first information is used to prompt the user to switch the playback device of the first category audio stream from the vehicle to the first terminal device.
[0551] In some embodiments of this application, during the process of the first terminal device continuing to play the target audio stream through the vehicle, if the first terminal device obtains a playback operation for a new first audio stream, it can obtain the category of the new first audio stream. If the category of the new first audio stream is the first category, the first terminal device can output first information, and the user can select to switch the playback device of the first category audio stream from the vehicle to the first terminal device based on the first information.
[0552] In this scenario, the playback operation for a new audio stream of category 1 obtained by the first terminal device can originate from the same application as the target audio stream being played by the vehicle, or it can originate from a different application. For example, if the target audio stream being played by the vehicle originates from a video application, the playback operation for the new audio stream obtained by the first terminal device may originate from a music application. As another example, if the target audio stream being played by the vehicle originates from video application 1, the playback operation for the new audio stream obtained by the first terminal device may also originate from that video application 1. It should be understood that these examples are only for illustrative purposes and are not intended to limit the scope of this solution.
[0553] The forms in which the first terminal device displays the first information include, but are not limited to, displaying the first information in the form of a pop-up window, displaying a notification in a drop-down box, displaying the first information in the form of a toggle icon, or other methods, etc., which will not be listed here.
[0554] Specifically, in one implementation, if in step 3707 the playback device for the second type of audio stream has been switched from the vehicle to the first terminal device, then when the first terminal device receives a playback operation for the new audio stream, it can obtain the category of the new audio stream. If the category of the new first audio stream is the first category, the first terminal device can play the new first audio stream through the vehicle and output first information, so that the user can switch the new audio stream (i.e., the first audio stream of the first category) to the first terminal device based on the first information; if the category of the new first audio stream is the second category, the second terminal device can play the second type of audio stream through the first terminal device.
[0555] If the first terminal device receives a second switching operation from the user based on the first information input, then in response to the received second switching operation, the playback device for the first type of audio stream is switched from the vehicle to the first terminal device.
[0556] After switching the playback device of the first type of audio stream from the vehicle to the first terminal device, the first terminal device can be triggered to pause playback of the audio stream, or it can be triggered to resume playback of the audio stream previously played by the vehicle. Optionally, the first terminal device can display the management interface of the first type of audio stream in the foreground and / or background, and the management interface of the first type of audio stream is used to control the playback / pause / termination of the first type of audio stream.
[0557] As an example, the management interface for the first category of audio streams can be displayed in any one or more combinations of the following: displaying a notification on the lock screen, displaying a notification in a drop-down menu, displaying a control widget on the main screen, displaying the management interface within the application corresponding to the first category of audio streams, displaying management results in the control center, or displaying the management interface in other ways, etc., which will not be listed exhaustively here.
[0558] To understand this solution more intuitively, please refer to [link / reference]. Figure 37 , Figure 37 This is a schematic diagram of the first information in the audio stream processing method provided in the embodiments of this application. Figure 37 Includes three sub-diagrams: (a), (b), and (c). Figure 37 (a) Sub-diagram and Figure 37 The first information is not shown in sub-diagram (c). Figure 37 The first information is shown in the (c) sub-diagram. Figure 37 Taking the first category as an example, media is used in this case. Figure 37 The sub-illustrative diagram (a) shows the interface displayed by the first terminal device when the first terminal device is playing an audio stream of the second category. Figure 37 Taking the example of the second category of audio stream playback devices switching to the first terminal device, therefore, Figure 37 The first information will not appear in the (a) sub-diagram; Figure 37 (b) shows the interface displayed by the first terminal device when the first terminal device is playing an audio stream of the first category. Figure 37 In the (b) sub-schematic diagram, area D1 outputs the first information in the form of a pop-up window; Figure 37 The sub-diagram (c) represents when the user is based on Figure 37 The first information output by sub-diagram (b) indicates the off-vehicle mode displayed on the vehicle's central control screen after switching the playback device of the first type of audio stream from the vehicle to the first terminal device; it should be understood that... Figure 37 The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0559] In one implementation, if step 3707 is not included, meaning that the playback device for all categories of audio streams (including the first and second categories) played by the vehicle is still defaulted to the vehicle, then when the first terminal device receives a playback operation for a new audio stream, regardless of whether the new audio stream is of the first or second category, the first terminal device can output first information. This first information is used to prompt the user to switch the playback device for all categories of audio streams from the vehicle to the first terminal device. Furthermore, the method by which the first terminal device displays the first information can be found in the above description, and will not be repeated here.
[0560] In this embodiment, when a playback operation for the first type of audio stream is obtained again, the first information will be output. The first information is used to prompt the user to switch the playback device of the first type of audio stream from the vehicle to the first terminal device. That is, when the user plays the first type of audio stream again using the first terminal device, he / she can decide whether to switch the playback device of the first type of audio stream back to the first terminal device according to the actual situation, which improves the flexibility of this solution in the switching process of the audio stream playback device.
[0561] 3709. The first terminal device stops sending the target audio stream to the vehicle.
[0562] In this embodiment, if in step 3705 the first terminal device determines that the target category corresponding to the target audio stream being played by the vehicle is not the first category, then the playback device for all categories (including the first and second categories) of audio streams generated by the first terminal device can be switched from the vehicle to the first terminal device. That is, the first terminal device stops sending the target audio stream to the vehicle, and correspondingly, the display interface of the vehicle's central control screen can enter the off-vehicle mode. In the aforementioned off-vehicle mode, the vehicle can prompt the user through the display interface of the central control screen that "all operations of the first terminal device have been switched to the first terminal device".
[0563] Alternatively, after step 3708, if the user selects to switch the playback device of the first type of audio stream from the vehicle to the first terminal device based on the first information, the first terminal device stops sending audio streams to the vehicle.
[0564] As mentioned above, in specific implementations, steps 3705 and 3707 can be optional. For example, one implementation may include steps 3701-3704 and 3706-3709. Alternatively, another implementation may include steps 3701-3706, 3708, and 3709; in this implementation, when the target category is determined to be the first category in step 3705, the first terminal device does not switch the playback device corresponding to all categories of audio streams; if the playback device for a certain category of audio stream was previously in the vehicle, it will continue to play in the vehicle; if the playback device for a certain category of audio stream was previously in the first terminal device, it will continue to play in the first terminal device.
[0565] This implementation not only provides processing methods for the target audio stream as the first category, but also for the target audio stream as the second category, thus improving the completeness of the solution and expanding its application scenarios.
[0566] In this embodiment, when the first terminal device is connected to the vehicle, and the first terminal device is detected to have moved from inside the vehicle to outside, the target category corresponding to the target audio stream being played by the vehicle is obtained. The target audio stream is sent from the first terminal device to the vehicle. If the target category is the first category, the vehicle continues to play the target audio stream. Through the aforementioned scheme, it is possible to determine whether to switch the audio stream playback device back to the first terminal device based on the specific type of the audio stream being played by the vehicle, thereby improving the flexibility of the audio stream playback process and enhancing user stickiness.
[0567] Alternatively, in this embodiment, while the first terminal device is connected to the vehicle, when it is detected that the first terminal device has moved from inside the vehicle to outside, the target category corresponding to the target audio stream being played in the vehicle is obtained. This target audio stream is sent from the first terminal device to the vehicle. Then, the first terminal device continues to play the target audio stream through the vehicle, but switches the playback device for other types of audio streams (excluding the target category) to the first terminal device. This allows the target audio to continue playing in the vehicle after the terminal device leaves, but if other types of audio streams need to be played later, they can be automatically played on the terminal device. Through the aforementioned solution, the playback device can be partially switched according to the specific type of audio stream being played in the vehicle, improving the flexibility of the audio stream playback process and enhancing user engagement.
[0568] II. Audio stream processing method when the first terminal device moves from outside the vehicle to inside the vehicle.
[0569] In some embodiments of this application, when the first terminal device is detected to have moved from outside the vehicle to inside the vehicle, the output device of the audio stream generated by the first terminal device can be switched to the vehicle; correspondingly, the vehicle exits the off-vehicle mode. It should be noted that the specific implementation of detecting the movement of the first terminal from outside the vehicle to inside the vehicle can be referred to the description in step 301 above, and will not be repeated here.
[0570] Optionally, if a user makes a call using the first terminal device while moving from outside the vehicle to inside, the vehicle and the first terminal device may not obtain the first location information of the first terminal device in order to ensure the privacy of the call, that is, the change in the location of the first terminal device will no longer be detected.
[0571] After a user finishes a call via the first terminal device, the first terminal device can trigger the acquisition of its first location information to detect whether it is inside the vehicle. If the first terminal device is inside the vehicle, the output device of at least one type of audio stream generated by the first terminal device can be switched to the vehicle; correspondingly, the vehicle exits the off-vehicle mode. It should be noted that the specific implementation of acquiring the first location information of the first terminal device can be found in the description of step 301 above, and will not be repeated here.
[0572] Alternatively, the user can manually input a switching operation to switch the playback device of the first terminal device from the first terminal device to the vehicle. The user can input the switching operation through the display interface of the first terminal device; alternatively, the user can input the switching operation through buttons configured on the first terminal device; or the user can input the switching operation via voice, etc., and so on. These are not exhaustive examples.
[0573] To understand this solution more intuitively, please refer to [link / reference]. Figure 38a , Figure 38a This is a schematic diagram corresponding to a switching operation in the audio stream processing method provided in this application embodiment. For example... Figure 38a As shown, the call interface of the first terminal device can display a list of multiple playback devices, allowing users to switch between them by clicking the corresponding icons. Figure 38a Taking the example of manually switching the playback device to the vehicle, it should be understood that... Figure 38a The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0574] In some embodiments of this application, when the vehicle's central control screen displays the "away mode," the user can also input a switching operation to exit the "away mode." The input methods for the aforementioned switching operation include, but are not limited to: clicking the icon corresponding to the switching operation, clicking the button corresponding to the switching operation, inputting a voice command to exit the "away mode," or other methods, etc., and are not limited here.
[0575] Optionally, when the vehicle receives a switching operation input by the user, the aforementioned switching operation is used to instruct the vehicle to exit the off-vehicle mode. In response to the received switching operation, the vehicle may also trigger the output of indication information, which is used for the user to confirm again whether to instruct the vehicle to exit the off-vehicle mode.
[0576] To understand this solution more intuitively, please refer to [link / reference]. Figure 38b , Figure 38b This is a schematic diagram illustrating the output of indication information in the audio stream processing method provided in the embodiments of this application. Figure 38b Includes two sub-illustrations on the left and right, which appear when the user clicks... Figure 38bWhen the "Exit" button is displayed in the left-hand diagram, it can trigger entry. Figure 38b The right child diagram, Figure 38b The right sub-illustration uses a text box to display the prompt information as an example. It should be understood that... Figure 38b The examples in this document are for illustrative purposes only and are not intended to limit the scope of this solution.
[0577] Specifically, after the vehicle detects that it has exited the off-vehicle mode, in one implementation, the playback device of all audio streams in the third category can be switched to the vehicle. The third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle.
[0578] In another implementation, after the vehicle detects that it has exited the vehicle exit mode, if the first terminal device is not in a call state, the playback device for all audio streams in the third category can be switched to the vehicle. The third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle.
[0579] If the first terminal device is in a call, in one implementation, the first terminal device can still default to the playback device of all audio streams in the third category as the first terminal device. After the call ends, the playback device of all audio streams in the third category will be switched from the first terminal device to the vehicle.
[0580] In another implementation, after the vehicle detects that it has exited the off-vehicle mode, if the first terminal device is in a call state, the first terminal device can switch the playback device of the generated fourth category audio stream from the first terminal device to the vehicle, while keeping the playback device of the call category audio stream generated by the first terminal device as the first terminal device. After the aforementioned call ends, the playback device of the aforementioned call category audio stream is switched back from the first terminal device to the vehicle. The fourth category of audio stream includes all audio streams of all categories included in the third category, except for the call category audio stream.
[0581] In another implementation, after the vehicle detects that it has exited the off-vehicle mode, if the first terminal device is in a call state, the user can manually input a switching operation to switch the playback device for all audio streams including the third category from the first terminal device to the vehicle. The specific implementation method is the same as described above. Figure 38a The corresponding implementations are similar, and will not be described in detail here.
[0582] In some embodiments of this application, if it is detected that the user is already wearing headphones before the first terminal device arrives in the vehicle (i.e., a connection has been established between the first terminal device and the headphones), then when the first terminal device is inside the vehicle, if it is detected that the connection between the first terminal device and the headphones is broken, the first terminal device can send a target event to the vehicle. The target event is that the connection between the first terminal device and the headphones is broken.
[0583] The target event can trigger the acquisition of the first location information of the first terminal device. If the first location information of the first terminal device indicates that the first terminal device is located in the vehicle, the vehicle can be automatically triggered to exit the off-vehicle mode and switch the playback device of all audio streams in the third category from the first terminal device to the vehicle.
[0584] Optionally, the target event can only be triggered to obtain the first location information of the first terminal device if the first terminal device is not in a call state. If the first location information of the first terminal device indicates that the first terminal device is in the vehicle, the vehicle can be automatically triggered to exit the off-vehicle mode and switch the playback device of all audio streams including the third category from the first terminal device to the vehicle.
[0585] Furthermore, during the process of switching the playback device for all audio streams included in the third category from the first terminal device to the vehicle, if the first terminal device is playing an audio stream, the vehicle may pause the playback of the aforementioned audio stream, or the vehicle may continue playing the aforementioned audio stream.
[0586] III. Processing of navigation tasks for the first terminal device when it moves between inside and outside the vehicle.
[0587] In some embodiments of this application, when the first terminal device is not yet connected to the vehicle, during the process of the user searching for a destination through the first terminal device and obtaining at least one n...
Claims
1. A method for obtaining a location, characterized in that, The method is applied to a vehicle, the vehicle including a location acquisition system, the location acquisition system further including a terminal device, and the method includes: Upon detecting that a first triggering condition is met, at least one target audio signal is sent, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal; Sending at least one target audio signal includes: sending multiple target audio signals at a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection. Obtain first location information corresponding to the terminal device, the first location information being used to indicate whether the terminal device is located inside or outside the vehicle, and the time interval between the arrival times in the first time set and the second time set being used to determine the first location information; Wherein, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, then the first location information indicates that the terminal device is located inside the vehicle; If the time interval between the arrival times in the first time set and the second time set is not within the preset time range, then the first location information indicates that the terminal device is located outside the vehicle.
2. The method according to claim 1, characterized in that, The target audio signal is a linear frequency modulated signal or a ZC sequence signal.
3. The method according to claim 1 or 2, characterized in that, The factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle.
4. The method according to claim 1 or 2, characterized in that, The time interval between arrival times in the first time set and the second time set includes the time interval between the latest time in the first time set and the earliest time in the second time set.
5. The method according to claim 1 or 2, characterized in that, The first triggering condition is considered to be satisfied when any one or more of the following conditions are detected: The vehicle was detected to be parked; or, The distance between the terminal device and the vehicle is detected to meet the first distance condition; or, A first instruction is received, which is used to trigger the vehicle to acquire the first location information.
6. The method according to claim 5, characterized in that, The detection of the vehicle stopping includes: The vehicle's speed, acceleration, and angular velocity are acquired and input into a classification model to obtain the predicted category information output by the classification model. The predicted category information indicates whether the vehicle is in a stationary or moving state.
7. A method for obtaining a location, characterized in that, The method is applied to a terminal device, the terminal device including a location acquisition system, the location acquisition system further including a vehicle, and the method includes: Upon detecting that a second triggering condition is met, at least one arrival time corresponding to at least one target audio signal is acquired. The at least one target audio signal includes multiple target audio signals emitted by the vehicle at a preset frequency. The multiple target audio signals include a first detection signal and a second detection signal. The at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection. The second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection. Based on the time interval between the arrival times in the first time set and the second time set, first location information corresponding to the terminal device is generated, and the first location information is used to indicate whether the terminal device is located inside or outside the vehicle. Wherein, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, then the first location information indicates that the terminal device is located inside the vehicle; If the time interval between the arrival times in the first time set and the second time set is not within the preset time range, then the first location information indicates that the terminal device is located outside the vehicle.
8. The method according to claim 7, characterized in that, The factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle.
9. The method according to claim 7, characterized in that, The step of generating first location information corresponding to the terminal device based on the time interval between arrival times in the first time set and the second time set includes: The first location information is generated based on the time interval between the latest time in the first time set and the earliest time in the second time set.
10. The method according to any one of claims 7 to 9, characterized in that, The second trigger condition is considered to be satisfied when any one or more of the following conditions are detected: The vehicle was detected to be parked; or, The distance between the terminal device and the vehicle is detected to meet the first distance condition; or, The displacement of the terminal device was detected to conform to a preset displacement. or, A second instruction is received, which is used to trigger the terminal device to obtain the first location information.
11. A location acquisition device, characterized in that, The location acquisition device is applied to a vehicle, the vehicle being included in a location acquisition system, the location acquisition system further including a terminal device, and the device comprising: A sending module is configured to send at least one target audio signal when a first triggering condition is detected, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal; The transmitting module is specifically used to transmit multiple target audio signals at a preset frequency. The multiple target audio signals include a first detection signal and a second detection signal. The at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection. The second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection. The acquisition module is used to acquire first location information corresponding to the terminal device. The first location information is used to indicate whether the terminal device is located inside or outside the vehicle. The time interval between the arrival times in the first time set and the second time set is used to determine the first location information. Wherein, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, then the first location information indicates that the terminal device is located inside the vehicle; If the time interval between the arrival times in the first time set and the second time set is not within the preset time range, then the first location information indicates that the terminal device is located outside the vehicle.
12. The apparatus according to claim 11, characterized in that, The target audio signal is a linear frequency modulated signal or a ZC sequence signal.
13. The apparatus according to claim 11 or 12, characterized in that, The factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle.
14. The apparatus according to claim 11 or 12, characterized in that, The time interval between arrival times in the first time set and the second time set includes the time interval between the latest time in the first time set and the earliest time in the second time set.
15. The apparatus according to claim 11 or 12, characterized in that, The sending module is deemed to have detected that the first triggering condition is met when it detects any one or more of the following conditions: The vehicle was detected to be parked; or, The distance between the terminal device and the vehicle is detected to meet the first distance condition; or, A first instruction is received, which is used to trigger the vehicle to acquire the first location information.
16. The apparatus according to claim 15, characterized in that, The sending module is specifically used to acquire the vehicle's speed, acceleration, and angular velocity, and input the vehicle's speed, acceleration, and angular velocity into a classification model to obtain the predicted category information output by the classification model. The predicted category information indicates whether the vehicle is in a stopped or moving state.
17. A location acquisition device, characterized in that, The location acquisition device is applied to a terminal device, the terminal device being included in a location acquisition system, the location acquisition system further including a vehicle, and the device comprising: The acquisition module is configured to acquire at least one arrival time corresponding to at least one target audio signal when a second triggering condition is detected, wherein the at least one target audio signal includes a plurality of target audio signals emitted by the vehicle at a preset frequency, the plurality of target audio signals include a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, wherein the first time set includes at least one time when the first detection signal arrives at the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct and / or reflection; The generation module is configured to generate first location information corresponding to the terminal device based on the time interval between the arrival times in the first time set and the second time set, wherein the first location information is used to indicate whether the terminal device is located inside or outside the vehicle. Wherein, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, then the first location information indicates that the terminal device is located inside the vehicle; If the time interval between the arrival times in the first time set and the second time set is not within the preset time range, then the first location information indicates that the terminal device is located outside the vehicle.
18. The apparatus according to claim 17, characterized in that, The factors determining the preset time range include the time interval between two adjacent target audio signals sent by the vehicle.
19. The apparatus according to claim 17, characterized in that, The generation module is specifically used to generate the first location information based on the time interval between the latest time in the first time set and the earliest time in the second time set.
20. The apparatus according to any one of claims 17 to 19, characterized in that, When the acquisition module detects any one or more of the following conditions, it is considered that the second triggering condition has been met: The vehicle was detected to be parked; or, The distance between the terminal device and the vehicle is detected to meet the first distance condition; or, The displacement of the terminal device was detected to conform to a preset displacement. or, A second instruction is received, which is used to trigger the terminal device to obtain the first location information.
21. A vehicle, characterized in that, The method includes a processor coupled to a memory storing program instructions that, when executed by the processor, implement the method of any one of claims 1 to 6.
22. A terminal device, characterized in that, The method includes a processor coupled to a memory storing program instructions that, when executed by the processor, implement the method of any one of claims 7 to 10.
23. A computer-readable storage medium, characterized in that, Includes program code that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 10.
24. A computer program product, characterized in that, The computer program product includes program code that, when executed on a computer or processor, performs the method as described in any one of claims 1 to 10.