A method for processing audio stream and related equipment
By detecting the audio stream type and switching the playback device when the terminal device leaves the vehicle, the problem of automatic switching of the audio stream playback device in the prior art is solved, improving the flexibility and user experience of audio stream playback, while protecting privacy.
Patent Information
- Application Number
- CN202111278594.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-30
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-10-30
AI Technical Summary
In the prior art, the playback device of the audio stream generated by the mobile phone is automatically switched from the mobile phone to the vehicle or the mobile phone, which lacks flexibility and cannot decide whether to switch back to the mobile phone play based on the type of audio stream being played by the vehicle.
By detecting the type of audio stream when the terminal device establishes a connection with the vehicle, and determining whether to switch the audio stream playback device to the terminal device according to the type when the terminal device leaves the vehicle, including the distinction between media and non-media audio streams, only Switch back to the terminal device when streaming media audio to ensure privacy.
It improves the flexibility of the audio streaming process, enhances the user experience, ensures the entertainment of other people in the car, and protects user privacy.
Smart Images

Figure CN116074734B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method for processing an audio stream and related equipment. Background Art
[0002] As car functions continue to upgrade, the user experience is becoming more and more diverse. For example, after a mobile phone is connected to a vehicle, the audio stream generated by the mobile phone can be played through the vehicle; when the mobile phone and the vehicle are disconnected, the playback device of the audio stream generated by the mobile phone switches back to the mobile phone.
[0003] At present, the playback device of the audio stream generated by the mobile phone is generally automatically determined by whether the mobile phone is connected to the vehicle. That is, if the mobile phone is connected to the vehicle, the audio stream generated by the mobile phone is automatically played through the vehicle. This is not flexible. Summary of the invention
[0004] The present application provides an audio stream processing method and related equipment, which can determine whether to switch the audio stream playback device back to the terminal device according to the specific type of audio stream being played by the vehicle when the terminal device leaves the vehicle, thereby improving the flexibility of the audio stream playback process and facilitating improving the user stickiness of the present solution.
[0005] In order to solve the above technical problems, this application provides the following technical solutions:
[0006] In the first aspect, the present application provides a method for processing an audio stream, which can be used in the field of intelligent vehicles. The method is applied to a data processing system, the data processing system includes a first terminal device and a vehicle, and the method includes: the first terminal device establishes a connection with the vehicle; it should be noted that, during the process in which the first terminal device and the vehicle are connected, the first terminal device can perform any one or more of the following tasks through the vehicle: play audio streams, play videos, navigation, video calls, calls or other tasks, etc. Then the first terminal device can switch the playback device of the first category and the second category audio streams from the first terminal device to the vehicle; during the process in which the first terminal device and the vehicle are connected, when it is detected that the first terminal device moves from inside the vehicle to outside the vehicle, the target category corresponding to the target audio stream being played by the vehicle is obtained, and the target audio stream is generated by the first terminal device and sent to the vehicle; if the target category is the first category, the vehicle continues to play the target audio stream.
[0007] In this implementation, when the first terminal device is detected to be moved from inside the vehicle to outside the vehicle during the process of the first terminal device being connected to the vehicle, a target category corresponding to the target audio stream being played by the vehicle is obtained, and the target audio stream is sent by the first terminal device to the vehicle; if the target category is the first category, the vehicle continues to play the target audio stream; through the aforementioned scheme, it is possible to determine whether to switch the playback device of the audio stream back to the first terminal device according to the specific type of the audio stream being played by the vehicle, thereby improving the flexibility of the audio stream playback process and facilitating improving the user stickiness of this scheme.
[0008] In a possible implementation of the first aspect, the first category includes a media category, and the second category is different from the first category. Furthermore, the audio streams categorized as media may include: music, video, audio streams generated by game applications, audio in instant messaging applications, or other audio streams categorized as media, etc., which are not exhaustively listed here. In this implementation, since audio streams categorized as media are generally more entertaining and have weaker requirements for privacy, when the first terminal device is moved from inside the vehicle to outside the vehicle, the vehicle will continue to play the target audio stream only when the type of the target audio stream being played by the vehicle is media, which not only ensures the entertainment of other people in the vehicle, but also avoids the leakage of user privacy as much as possible.
[0009] In a possible implementation of the first aspect, the method further includes: switching the playback device of the second category of audio streams from the vehicle to the first terminal device, and the second category of audio streams is generated by the first terminal device. In an embodiment of the present application, after the first terminal device is moved from inside the vehicle to outside the vehicle, not only does the vehicle continue to play the first category of audio streams, but the playback device of the second category of audio streams is switched from the vehicle to the first terminal device, and the first category and the second category are different categories, that is, the playback device of some audio streams is kept as the vehicle, and the playback device of another part of the audio streams is switched from the vehicle to the first terminal device, so that which categories of audio streams continue to be played by the vehicle and which categories of audio streams are switched to the first terminal device can be flexibly set according to actual conditions, thereby improving the implementation flexibility of the present solution.
[0010] In a possible implementation of the first aspect, the method further includes: the first terminal device outputs first information, and the first information is used to prompt the user to switch the playback device of the target audio stream from the vehicle to the first terminal device. In this implementation, while the target audio stream continues to be played by the vehicle, the first information is output, and the first information is used to prompt the user to switch the playback device of the first category of audio streams from the vehicle to the first terminal device. That is, when the user can decide whether to switch the playback device of the first category of audio streams back to the first terminal device according to actual conditions, the flexibility of the present solution in the switching process of the audio stream playback device is improved.
[0011] In a possible implementation of the first aspect, if the target category is the first category, after the vehicle continues to play the target audio stream, the method also includes: when the first terminal device obtains the play operation of the first audio stream, outputting first information; wherein, the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream played by the vehicle, and the first information is used to prompt the user to switch the playback device of the first audio stream from the vehicle to the first terminal device.
[0012] In this implementation, when the playback operation for the first category of audio stream is obtained again, the first information will be triggered to be output. The first information is used to prompt the user to switch the playback device of the first category of audio stream from the vehicle to the first terminal device. That is, when the user uses the first terminal device to play the first category of audio stream again, it can be decided whether to switch the playback device of the first category of audio stream back to the first terminal device based on actual conditions, thereby improving the flexibility of this scheme in the switching process of the audio stream playback device.
[0013] In a possible implementation of the first aspect, after the first terminal device outputs the first information, the method further includes: the first terminal device receives an operation input by a user, and in response to the operation input by the user, the first terminal device switches the playback device of the first category of audio streams from the vehicle to the first terminal device.
[0014] In a possible implementation of the first aspect, detecting that a first terminal device moves from inside a vehicle to outside a vehicle includes: the vehicle sends a plurality of target audio signals at a preset frequency, wherein the plurality of target audio signals include a first detection signal and a second detection signal, at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal reaches the first terminal device by direct radiation and / or reflection, and the second time set includes at least one time when the second detection signal reaches the first terminal device by direct radiation and / or reflection; the first terminal device generates first position information corresponding to the terminal device according to the time interval between the arrival times in the first time set and the second time set, the first position information being used to indicate that the first terminal device is located inside or outside the vehicle; and determining that the first terminal device moves from inside the vehicle to outside the vehicle according to the first position information of the first terminal device within a preset time period.
[0015] In this implementation, since the space inside the vehicle is relatively closed, multiple audio signals obtained after direct radiation and / or reflection of a target audio signal can reach the terminal device in a relatively concentrated manner, while the space outside the vehicle is relatively open relative to the space inside the vehicle, and multiple audio signals obtained after direct radiation and / or reflection of a target audio signal will reach the terminal device in a relatively dispersed manner. Therefore, it is possible to determine whether the terminal device is inside or outside the vehicle based on the time interval between the first time set and the second time set, thereby providing a solution for measuring the user's position relative to the vehicle; in addition, the audio signal can be emitted through the vehicle's built-in speakers, without the need to add additional hardware to the vehicle or terminal device, thereby avoiding additional overhead.
[0016] In a possible implementation of the first aspect, the method further includes: if the target category is not the first category, switching the target audio stream to the first terminal device for playback. In this implementation, not only a processing method is provided when the target audio stream is the first category, but also a processing method is provided when the target audio stream is not the first category, thereby improving the integrity of the solution and expanding the application scenarios of the solution.
[0017] In a second aspect, the present application provides a method for processing an audio stream, which can be used in the field of intelligent vehicles. The method is applied to a data processing system, which also includes a vehicle and a first terminal device, and the method includes: the vehicle establishes a connection with the first terminal; the vehicle receives data sent by the first terminal device, and the data includes a target audio stream; the vehicle plays the target audio stream; during the process of the vehicle playing the target audio stream, when a preset situation occurs, the target audio stream continues to be played, wherein the preset situation includes: the first terminal device moves from inside the vehicle to outside the vehicle during the process of being connected to the vehicle, and the category of the target audio stream is the first category.
[0018] In a possible implementation manner of the second aspect, a playback device of the audio stream of the second category is switched to the first terminal device, the second category and the first category are different categories, and the audio stream of the second category is generated by the first terminal device.
[0019] For the specific implementation steps of the second aspect of the present application and the various possible implementation methods of the second aspect, as well as the beneficial effects brought about by each possible implementation method, please refer to the description of the various possible implementation methods in the first aspect, and will not be repeated here one by one.
[0020] In the third aspect, the present application provides a method for processing an audio stream, which can be used in the field of intelligent vehicles. The method is applied to a first terminal device, the first terminal device is included in a data processing system, and the data processing system also includes a vehicle. The method includes: the first terminal device establishes a connection with the vehicle; the first terminal device sends data to the vehicle, and the data includes a target audio stream; in the process of the vehicle playing the target audio stream and the first terminal device and the vehicle are in a connected state, when it is detected that the first terminal device moves from inside the vehicle to outside the vehicle, the target category corresponding to the target audio stream being sent to the vehicle is obtained; if the target category is the first category, the target audio stream continues to be sent to the vehicle.
[0021] In a possible implementation manner of the third aspect, the first category includes a media category, and the second category is different from the first category.
[0022] In a possible implementation of the third aspect, the method also includes: switching the playback device of the second category audio stream from the vehicle to the first terminal device, and the second category audio stream is generated by the first terminal device; if the first terminal device receives a playback instruction to play the second audio stream, the second audio stream is played by the first terminal device; the category of the second audio stream is the second category.
[0023] In a possible implementation manner of the third aspect, the method further includes: outputting first information, where the first information is used to prompt a user to switch a playback device of the target audio stream from the vehicle to the first terminal device.
[0024] In a possible implementation of the third aspect, if the target category is the first category, after continuing to send the target audio stream to the vehicle, the method also includes: when the first terminal device obtains the play operation of the first audio stream, outputting first information; wherein, the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream played by the vehicle, and the first information is used to prompt the user to switch the playback device of the first audio stream from the vehicle to the first terminal device.
[0025] In a possible implementation manner of the third aspect, the method further includes: if the target category is not the first category, continuing to play the target audio stream by the first terminal device.
[0026] For the specific implementation steps of the third aspect of the present application and various possible implementation methods of the third aspect, as well as the beneficial effects brought about by each possible implementation method, please refer to the description of the various possible implementation methods in the first aspect, and will not be repeated here one by one.
[0027] In a fourth aspect, the present application provides a method for processing an audio stream, which can be used in the field of intelligent vehicles. The method is applied to a data processing system, the data processing system includes a first terminal device and a vehicle, and the method includes: the first terminal device establishes a connection with the vehicle; the first terminal device switches the playback device of the third category of audio streams from the first terminal device to the vehicle, and the third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle; when the first terminal device and the vehicle are connected, when it is detected that the first terminal device moves from inside the vehicle to outside the vehicle, the target category corresponding to the target audio stream being played by the vehicle is obtained, and the target audio stream is generated by the first terminal device and sent to the vehicle; the vehicle continues to play the target audio stream, and the playback device of the second category of audio streams other than the target category in the third category is switched from the vehicle to the first terminal device.
[0028] In this implementation, when the first terminal device is detected to be moved from inside the vehicle to outside the vehicle while the first terminal device is connected to the vehicle, the target category corresponding to the target audio stream being played by the vehicle is obtained, and the target audio stream is sent to the vehicle by the first terminal device; then the first terminal device continues to play the target audio stream through the vehicle, but switches the playback device of the audio streams of other categories except the target category to the first terminal device. This allows the target audio to continue to be played on the vehicle after the terminal device leaves the vehicle, but when other types of audio streams need to be played in the terminal device later, other types of audio streams can be automatically played in the terminal device. Through the aforementioned scheme, the playback device can be partially switched according to the specific type of the audio stream being played by the vehicle, which improves the flexibility of the audio stream playback process and is conducive to improving the user stickiness of this scheme.
[0029] In a possible implementation manner of the fourth aspect, the vehicle continues to play the target audio stream, including: if the target category is the first category, the vehicle continues to play the target audio stream.
[0030] In a possible implementation manner of the fourth aspect, the third category of audio streams includes a first category of audio streams and a second category of audio streams, the first category includes a media class, and the second category is different from the first category.
[0031] In a possible implementation manner of the fourth aspect, the method further includes: the first terminal device outputs first information, where the first information is used to prompt a user to switch a playback device of the target audio stream from the vehicle to the first terminal device.
[0032] In a possible implementation of the fourth aspect, if the target category is the first category, after the vehicle continues to play the target audio stream, the method also includes: when the first terminal device obtains the playback operation of the first audio stream, outputting first information; wherein, the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream played by the vehicle, and the first information is used to prompt the user to switch the playback device of the first audio stream from the vehicle to the first terminal device.
[0033] In a possible implementation of the fourth aspect, detecting that the first terminal device moves from inside a vehicle to outside the vehicle includes: the vehicle sends multiple target audio signals at a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal arrives at the first terminal device by direct radiation and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the first terminal device by direct radiation and / or reflection; the first terminal device generates first position information corresponding to the terminal device according to the time interval between the arrival times in the first time set and the second time set, the first position information being used to indicate that the first terminal device is located inside or outside the vehicle; and determining that the first terminal device moves from inside the vehicle to outside the vehicle according to the first position information of the first terminal device within a preset time period.
[0034] In the fifth aspect, the present application provides an address processing method that can be used in the field of intelligent vehicles. The method is applied to a navigation system, the navigation system includes a vehicle, a first terminal device and a second terminal device, and the method includes: the second terminal device displays the target address on a display interface; when the first terminal device is connected to the vehicle, the second terminal device sends the target address to the vehicle, wherein the sent target address is used to prompt the target address to be used as the destination when the vehicle is navigating. In this implementation, since the first terminal device is generally a terminal device located at the main driving position when the first terminal device is connected to the vehicle, if the destination of the vehicle during navigation can only be modified through the first terminal device, it is very likely that the driver will perform the modification operation, which will increase the risk of the driving process; in this solution, the second terminal device can modify the destination of the vehicle during navigation, which is conducive to improving the safety of the driving process and the efficiency of modifying the navigation destination.
[0035] In a possible implementation of the fifth aspect, before the second terminal device sends the target address to the vehicle, the method further includes: the second terminal device obtains first location information corresponding to the second terminal device, the first location information is used to indicate that the second terminal device is located inside the vehicle or outside the vehicle; when the second terminal device is located inside the vehicle, the second terminal device outputs second information, the second information is used to prompt the user to input a target operation. When the first terminal device is connected to the vehicle, the second terminal device sends the target address to the vehicle, including: the second terminal device receives the target operation input by the user; when the first terminal device is connected to the vehicle, in response to the received target operation, the second terminal device sends the target address to the vehicle.
[0036] In this implementation, when it is detected that the second terminal device is located in the vehicle and address information is displayed on the second terminal device, second information can be output, and the second information is used to prompt the user to enter the target operation of "send target address", that is, the second terminal device sends the target address based on the user's wishes; in addition, the operation of "sending target address" can only be implemented when it is detected that the second terminal device is located in the vehicle, which avoids interference of other devices with the first terminal device and is conducive to improving the safety of the vehicle driving process.
[0037] In a possible implementation of the fifth aspect, the display interface for displaying the target address includes an interface of any one or more of the following types of applications: a navigation application, an instant messaging application, a life service application, or a travel application. In this implementation, not only navigation applications can adopt this solution, but also instant messaging applications, life service applications, or travel applications can adopt this solution, which greatly expands the application scenarios of this solution.
[0038] In a possible implementation of the fifth aspect, after the second terminal device displays the target address on the display interface, the method further includes: the second terminal device receives a trigger operation input by the user. The second terminal device obtains the first location information corresponding to the second terminal device, including: in response to the trigger operation, the second terminal device obtains the first location information corresponding to the second terminal device. In this implementation, when the second terminal device displays the target address on the display interface and the second terminal device receives the trigger operation input by the user, the second terminal device will obtain the first location information corresponding to the second terminal device, that is, the detection of whether the second terminal device is located inside the vehicle is triggered based on the user's intention, rather than when the target address is displayed on the display interface, it will automatically trigger the acquisition of the first location information corresponding to the second terminal device, so as to avoid wasting computer resources on the terminal device.
[0039] In a sixth aspect, the present application provides an address processing method that can be used in the field of intelligent vehicles. The method is applied to a navigation system, the navigation system includes a vehicle, a second terminal device and a first terminal device, and the method includes: when the first terminal device is connected to the vehicle, the vehicle obtains a target address, the target address is generated by the second terminal device; the vehicle uses the target address as the destination when the vehicle is navigating.
[0040] In a possible implementation of the sixth aspect, the second terminal device is located inside the vehicle.
[0041] In a possible implementation of the sixth aspect, the vehicle uses the target address as the destination when the vehicle is navigating, including: when the vehicle obtains the target address, it is navigating with the first address as the destination; the vehicle changes the first address to the target address and continues to navigate with the target address as the destination. In this implementation, a specific application scenario of the present solution is provided. In the seventh aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a vehicle, the vehicle is included in a position acquisition system, the position acquisition system also includes a terminal device, the vehicle is configured with at least two speakers, the at least two speakers include a first speaker and a second speaker, the first speaker and the second speaker are located on both sides of the vehicle, and the method includes: sending a first audio signal through the first speaker, the first audio signal is used for the terminal device to determine the reception time of the first audio signal, and the reception time of the first audio signal is the time when the terminal device receives the first audio signal; sending a second audio signal through the second speaker, the second audio signal is used for the terminal device to determine the reception time of the second audio signal, the reception time of the second audio signal is the time when the terminal device receives the second audio signal, the reception time of the first audio signal and the reception time of the second audio signal are used to determine the target position information, and the target position information indicates the position of the terminal device relative to the vehicle.
[0042] In a possible implementation of the seventh aspect, a first audio signal is sent through a first speaker, and a second audio signal is sent through a second speaker, including: while sending the first audio signal through the first speaker, the second audio signal is sent through the second speaker, the first audio signal and the second audio signal are different audio signals, and the order in which the first audio signal and the second audio signal arrive at the terminal device is used to determine the target position information.
[0043] In a possible implementation of the seventh aspect, a first audio signal is sent through a first speaker, and a second audio signal is sent through a second speaker, including: first sending the first audio signal through the first speaker, and after a preset time interval, sending the second audio signal through the second speaker, and the receiving time of the first audio signal, the receiving time of the second audio signal and the preset time interval are used to determine the target position information.
[0044] In a possible implementation manner of the seventh aspect, the at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0045] In a possible implementation of the seventh aspect, the at least three speakers include four speakers, and the four speakers are respectively located at a left front position, a right front position, a left rear position, and a right rear position in the vehicle.
[0046] In a possible implementation of the seventh aspect, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0047] In a possible implementation of the seventh aspect, the position inside the vehicle is a left position inside the vehicle or a right position inside the vehicle; or, the position inside the vehicle is a front position inside the vehicle or a rear position inside the vehicle; or, the position inside the vehicle is any one of the positions inside the vehicle including the main driver's seat, the co-driver's seat, the left side of the rear row, the right side of the rear row, or the middle of the rear row; or, there are N positions in total inside the vehicle, and the position inside the vehicle is a target position among the N positions, and N is an integer greater than or equal to 2.
[0048] In a possible implementation of the seventh aspect, the target location information is used to determine the terminal device's control authority over the vehicle, and terminal devices located at different locations have different control authority over the vehicle; or, the target location information is used to indicate whether the terminal device is located at the vehicle's main driving position; or, when the terminal device is connected to the vehicle, the target location information is used for the vehicle to determine the on-board device that is closest to the terminal device.
[0049] In a possible implementation of the seventh aspect, the method also includes: when the vehicle starts a position awareness operation, sending a first indication message to the terminal device, the first indication message is used to instruct the terminal device to start a position awareness operation, and the position awareness operation is an operation for obtaining target position information; receiving a first feedback message sent by the terminal device, the first feedback message is used to instruct the vehicle to send a first audio signal and a second audio signal; or, receiving a second indication message sent by the terminal device, and starting the position awareness operation in response to the received second indication message; sending a second feedback message to the terminal device, the second feedback message is used to instruct the terminal device to receive the first audio signal and the second audio signal.
[0050] In an eighth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a terminal device, the terminal device is included in a position obtaining system, the position obtaining system also includes a vehicle, the vehicle is configured with at least two speakers, the at least two speakers include a first speaker and a second speaker, the first speaker and the second speaker are located on different sides of the vehicle, the method includes: receiving a first audio signal sent by the first speaker; receiving a second audio signal sent by the second speaker; determining target position information according to the reception time of the first audio signal and the reception time of the second audio signal, the target position information indicating the position of the terminal device relative to the vehicle.
[0051] In a possible implementation of the eighth aspect, the target position information is determined according to the receiving time of the first audio signal and the receiving time of the second audio signal, including: when the first audio signal and the second audio signal are sent simultaneously, determining the order in which the first audio signal and the second audio signal arrive at the terminal device according to the receiving time of the first audio signal and the receiving time of the second audio signal; determining the target position information according to the order in which the first audio signal and the second audio signal arrive at the terminal device.
[0052] In a possible implementation of the eighth aspect, the target position information is determined according to the receiving time of the first audio signal and the receiving time of the second audio signal, including: determining the target position information according to the receiving time of the first audio signal, the receiving time of the second audio signal and a preset time interval, where the preset time interval is the sending time interval of two adjacent audio signals.
[0053] In a possible implementation manner of the eighth aspect, the at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0054] In the ninth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a vehicle, the vehicle is included in a position acquisition system, the position acquisition system also includes a terminal device, at least two speakers are configured in the vehicle, at least two speakers are configured on both sides of the vehicle, and the target speaker is any one of the at least two speakers. The method includes: receiving a first measurement signal sent by the terminal device through the target speaker, and determining the time of receiving the first measurement signal as the first time; sending a second measurement signal to the terminal device through the target speaker, and determining the time of sending the second measurement signal as the second time, the first measurement signal and the second measurement signal are both audio signals; determining the distance between the terminal device and the target speaker according to the first time, the second time, the third time and the fourth time, wherein the third time is the time when the terminal device sends the first measurement signal, and the fourth time is the time when the terminal device receives the second measurement signal; determining the target position information according to the distance between the terminal device and each of the at least two speakers, and the target position information indicates the position of the terminal device relative to the vehicle.
[0055] In a possible implementation manner of the ninth aspect, the at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0056] In a possible implementation of the ninth aspect, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0057] In the tenth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a terminal device, the terminal device includes a position obtaining system, the position obtaining system also includes a vehicle, at least two speakers are configured in the vehicle, at least two speakers are configured at different positions of the vehicle, and the target speaker is any one of the at least two speakers. The method includes: sending a first measurement signal to the target speaker, and determining the sending time of the first measurement signal as a third time; receiving a second measurement signal sent by the target speaker, and determining the receiving time of the second measurement signal as a fourth time, the first measurement signal and the second measurement signal are both audio signals; determining the distance between the terminal device and the target speaker according to the first time, the second time, the third time and the fourth time, wherein the first time is the time when the vehicle receives the first measurement signal, and the second time is the time when the vehicle sends the second measurement signal; determining the target position information according to the distance between the terminal device and each of the at least two speakers, and the target position information indicates the position of the terminal device relative to the vehicle.
[0058] In a possible implementation of the tenth aspect, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0059] In the eleventh aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a vehicle, the vehicle includes a position acquisition system, the position acquisition system also includes a terminal device, and the method includes: when a first trigger condition is detected, at least one target audio signal is sent, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal; sending at least one target audio signal includes: sending multiple target audio signals at a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal reaches the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal reaches the terminal device through direct and / or reflection; obtaining first position information corresponding to the terminal device, the first position information is used to indicate that the terminal device is located inside or outside the vehicle, and the time interval between the arrival times in the first time set and the second time set is used to determine the first position information.
[0060] In a possible implementation manner of the eleventh aspect, the target audio signal is a linear frequency modulation signal or a ZC sequence signal.
[0061] In a possible implementation of the eleventh aspect, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first position information indicates that the terminal device is located inside the vehicle, wherein the determining factor of the preset time range includes the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first position information indicates that the terminal device is located outside the vehicle.
[0062] In a possible implementation manner of the eleventh aspect, the time interval between the arrival times in the first time set and the second time set includes: the time interval between the latest time in the first time set and the earliest time in the second time set.
[0063] In a possible implementation of the eleventh aspect, when any one or more of the following situations are detected, it is deemed that the first trigger condition is detected to be met: the vehicle is detected to be stopped; or, it is detected that the distance between the terminal device and the vehicle meets the first distance condition; or, a first instruction is obtained, and the first instruction is used to trigger the vehicle to obtain the first position information.
[0064] In a possible implementation of the eleventh aspect, detecting that the vehicle has stopped includes: acquiring the speed, acceleration and angular velocity of the vehicle, and inputting the speed, acceleration and angular velocity of the vehicle into a classification model to obtain predicted category information output by the classification model, wherein the predicted category information indicates that the vehicle is in a stopped state or a moving state.
[0065] In the twelfth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a terminal device, the terminal device includes a position acquisition system, the position acquisition system also includes a vehicle, and the method includes: when detecting that a second trigger condition is met, obtaining at least one arrival time corresponding to at least one target audio signal, the at least one target audio signal includes multiple target audio signals emitted by the vehicle at a preset frequency, the multiple target audio signals include a first detection signal and a second detection signal, at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal reaches the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal reaches the terminal device through direct and / or reflection; according to the time interval between the arrival times in the first time set and the second time set, generating first location information corresponding to the terminal device, the first location information is used to indicate that the terminal device is located inside or outside the vehicle.
[0066] In a possible implementation of the twelfth aspect, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first position information indicates that the terminal device is located inside the vehicle, wherein the determining factor of the preset time range includes the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first position information indicates that the terminal device is located outside the vehicle.
[0067] In a possible implementation of the twelfth aspect, first location information corresponding to the terminal device is generated based on the time interval between the arrival times in the first time set and the second time set, including: generating the first location information based on the time interval between the latest time in the first time set and the earliest time in the second time set.
[0068] In a possible implementation of the twelfth aspect, when any one or more of the following situations are detected, it is deemed that the second trigger condition is detected to be met: the vehicle is detected to be stopped; or, it is detected that the distance between the terminal device and the vehicle satisfies the first distance condition; or, it is detected that the displacement of the terminal device meets the preset displacement; or, a second instruction is obtained, and the second instruction is used to trigger the terminal device to obtain the first location information.
[0069] In the thirteenth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a vehicle, the vehicle includes a position obtaining system, the position obtaining system also includes a terminal device, and the method includes: sending multiple target audio signals at a preset frequency, when the vehicle is in a moving state, a target audio signal is used to determine a first arrival time of the target audio signal arriving at the terminal device, when the second trigger condition is met, a target audio signal is used to determine a second arrival time of the target audio signal arriving at the terminal device; obtaining first position information corresponding to the terminal device, the first position information is used to indicate that the terminal device is located inside or outside the vehicle, and multiple first arrival times and at least one second arrival time are used to determine the first position information.
[0070] In a possible implementation of the thirteenth aspect, multiple first arrival times are used to determine a first predicted time corresponding to a second arrival time, the first predicted time indicating the time when the target audio signal arrives at the terminal device when the terminal device is located inside a vehicle, and the first predicted time and the second arrival time are used to determine the first position information.
[0071] In a possible implementation of the thirteenth aspect, the method is applied to a terminal device, the terminal device includes a position acquisition system, the position acquisition system also includes a vehicle, the method includes: when the vehicle is in a moving state, obtaining multiple first arrival times corresponding to multiple target audio signals, a first arrival time represents the time when a target audio signal arrives at the terminal device, and the multiple target audio signals are emitted by the vehicle at a preset frequency; when it is detected that a second trigger condition is met, obtaining at least one second arrival time corresponding to at least one target audio signal, and generating first position information corresponding to the terminal device based on the multiple first arrival times and the at least one second arrival time, the first position information is used to indicate that the terminal device is inside or outside the vehicle.
[0072] In a possible implementation of the thirteenth aspect, first position information corresponding to the terminal device is generated based on multiple first arrival times and at least one second arrival time, including: determining a first predicted time corresponding to the second arrival time based on the multiple first arrival times, the first predicted time indicating the time when the target audio signal arrives at the terminal device when the terminal device is located inside a vehicle; generating the first position information based on the first predicted time and the second arrival time.
[0073] In the fourteenth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a vehicle, the vehicle includes a system for obtaining a position, the system for obtaining a position also includes a terminal device, the vehicle is equipped with at least three speakers, the at least three speakers are not located in a straight line, and the at least three speakers include a first speaker, a second speaker, and a third speaker. The method includes: sending a first audio signal through the first speaker, the first audio signal is used to determine the first signal strength of the first audio signal received by the terminal device; sending a second audio signal through the second speaker, the second audio signal is used to determine the second signal strength of the second audio signal received by the terminal device; sending a third audio signal through the third speaker, the third audio signal is used to determine the third signal strength of the third audio signal received by the terminal device, the first signal strength, the second signal strength, and the third signal strength are used to determine the second position information corresponding to the terminal device, and the second position information is used to indicate the position of the terminal device outside the vehicle.
[0074] In a possible implementation of the fourteenth aspect, the second location information is used for the vehicle to determine a component that is closest to the terminal device from a plurality of components included in the vehicle, so as to control the component that is closest to the terminal device to perform a preset operation.
[0075] In the fifteenth aspect, the present application provides a method for obtaining a position, which can be used in the field of intelligent vehicles. The method is applied to a terminal device, the terminal device includes a position obtaining system, the position obtaining system also includes a vehicle, the vehicle is equipped with at least three speakers, the at least three speakers are not located in a straight line, the at least three speakers include a first speaker, a second speaker and a third speaker, the method includes: receiving a first audio signal sent by the first speaker, receiving a second audio signal sent by the second speaker, and receiving a second audio signal sent by the third speaker; according to the first signal strength of the received first audio signal, the second signal strength of the received second audio signal and the third signal strength of the received third audio signal, generating second position information corresponding to the terminal device, the second position information is used to indicate the position of the terminal device outside the vehicle.
[0076] In the sixteenth aspect, the present application provides a vehicle, which may include a processor, the processor and a memory are coupled, the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the vehicle implements the steps performed by the vehicle in the methods described in the above aspects.
[0077] In the seventeenth aspect, the present application provides a terminal device, which may include a processor, the processor and a memory are coupled, and the memory stores program instructions. When the program instructions stored in the memory are executed by the processor, the terminal device implements the steps performed by the terminal device in the methods described in the above aspects.
[0078] In an eighteenth aspect, the present application provides a computer-readable storage medium, in which program code is stored. When the program code runs on a computer, the computer executes the methods described in the above aspects.
[0079] In a nineteenth aspect, the present application provides a computer program, including a program code, which enables the computer to execute the methods described in the above aspects when the program code runs on a computer.
[0080] In the twentieth aspect, the present application provides a chip system, which includes a processor for supporting the implementation of the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the server or communication device. The chip system can be composed of chips, or it can include chips and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS
[0081] Figure 1a A schematic diagram of an architecture of a data processing system provided in an embodiment of the present application;
[0082] Figure 1b A schematic diagram of an architecture of a data processing system provided in an embodiment of the present application;
[0083] Figure 2 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application;
[0084] Figure 3 A schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0085] Figure 4 A schematic diagram of the positions of at least three speakers in the method for obtaining the position provided in an embodiment of the present application;
[0086] Figure 5 A schematic diagram of a principle of a method for obtaining a position provided in an embodiment of the present application;
[0087] Figure 6 A schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0088] Figure 7 A schematic diagram of a method for obtaining a position provided in an embodiment of the present application;
[0089] Figure 8a A schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0090] Figure 8bA schematic diagram of the external position of a vehicle in the method for obtaining a position provided in an embodiment of the present application;
[0091] Fig. 9 A schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0092] Fig.10 A schematic diagram of the control authority of terminal devices located at different locations in the location acquisition method provided in an embodiment of the present application;
[0093] Fig.11 A schematic diagram of the control authority of terminal devices located at different locations in the location acquisition method provided in an embodiment of the present application;
[0094] Fig.12 A schematic diagram of screen projection by a terminal device located at a main driving position in a method for obtaining a position provided in an embodiment of the present application;
[0095] Fig.13 A schematic diagram of screen projection by a terminal device located at a main driving position in a method for obtaining a position provided in an embodiment of the present application;
[0096] Fig.14a A schematic diagram of a structure of a position acquisition device provided in an embodiment of the present application;
[0097] Fig.14b Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0098] Fig.15 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0099] Fig.16 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0100] Fig.17 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0101] Fig.18 A schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0102] Fig.19 A schematic diagram of a sound in the method for obtaining a position provided in an embodiment of the present application;
[0103] Fig. 20 A schematic diagram of a matching degree curve in the location acquisition method provided in an embodiment of the present application;
[0104] Fig.21Two schematic diagrams of matching degree curves in the location acquisition method provided in the embodiments of the present application;
[0105] Fig. 22 Another schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0106] Fig.23 Another schematic diagram of a flow chart of a method for obtaining a position provided in an embodiment of the present application;
[0107] Fig.24 A schematic diagram of a principle of a method for obtaining a position provided in an embodiment of the present application;
[0108] Fig.25 An application scenario diagram of the location acquisition method provided in an embodiment of the present application;
[0109] Fig.26 A schematic diagram of a structure of a position acquisition device provided in an embodiment of the present application;
[0110] Fig. 27 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0111] Fig.28 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0112] Fig.29 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0113] Fig.30 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0114] Fig.31 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application;
[0115] Fig.32 A flowchart of a method for processing an audio stream provided in an embodiment of the present application;
[0116] Fig.33 A schematic diagram of a receiving interface of a first switching operation in the audio stream processing method provided in an embodiment of the present application;
[0117] Fig.34 A schematic diagram of an off-vehicle mode in the audio stream processing method provided in an embodiment of the present application;
[0118] Fig.35 A schematic diagram of an off-vehicle mode in the audio stream processing method provided in an embodiment of the present application;
[0119] Fig.36 Two schematic diagrams of the first terminal device displaying the first information in the audio stream processing method provided in the embodiment of the present application;
[0120] Fig.37 A schematic diagram of first information in the audio stream processing method provided in an embodiment of the present application;
[0121] Fig.38a A schematic diagram corresponding to a switching operation in the audio stream processing method provided in an embodiment of the present application;
[0122] Figure 38b A schematic diagram of outputting indication information in the audio stream processing method provided in an embodiment of the present application;
[0123] Fig.39 A schematic diagram of a flow chart of a method for processing data provided in an embodiment of the present application;
[0124] Fig.40 A flowchart of a method for processing an address provided in an embodiment of the present application;
[0125] Fig.41 Three schematic diagrams of outputting second information in the address processing method provided in the embodiments of the present application;
[0126] Fig.42 Another schematic diagram of outputting second information in the address processing method provided in an embodiment of the present application;
[0127] Fig.43 Two schematic diagrams of outputting prompt information in the address processing method provided in the embodiment of the present application;
[0128] Fig.44 A schematic diagram of outputting prompt information in the address processing method provided in an embodiment of the present application;
[0129] Fig.45 A schematic diagram of outputting notification information in the address processing method provided in an embodiment of the present application;
[0130] Fig.46 Two schematic diagrams of outputting prompt information in the address processing method provided in the embodiment of the present application;
[0131] Fig.47 A schematic diagram of a flow chart of a data transfer method provided in an embodiment of the present application;
[0132] Fig.48 A schematic diagram of a flow chart of a data transfer method provided in an embodiment of the present application;
[0133] Fig.49Another schematic diagram of a flow chart of a data transfer method provided in an embodiment of the present application;
[0134] Fig.50 A flow chart of a volume processing method provided in an embodiment of the present application;
[0135] Fig.51 A schematic diagram of the structure of an audio stream processing device provided in an embodiment of the present application;
[0136] Fig.52 A schematic diagram of the structure of an audio stream processing device provided in an embodiment of the present application;
[0137] Fig.53 A schematic diagram of the structure of an audio stream processing device provided in an embodiment of the present application;
[0138] Fig.54 A schematic diagram of a structure of an address processing device provided in an embodiment of the present application;
[0139] Fig.55 A schematic diagram of a structure of an address processing device provided in an embodiment of the present application;
[0140] Fig.56 A schematic diagram of a structure of an address processing device provided in an embodiment of the present application;
[0141] Fig.57 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application;
[0142] Fig.58 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0143] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances. This is merely a way of distinguishing objects with the same properties when describing the embodiments of the present application. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, so that a process, method, system, product, or device that includes a series of units is not necessarily limited to those units, but may include other units that are not explicitly listed or inherent to these processes, methods, products, or devices.
[0144] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0145] The embodiments of the present application can be applied to the field of intelligent vehicles. Specifically, in some subsequent embodiments, it is possible to detect whether the terminal device is located inside or outside the vehicle. In other subsequent embodiments, it is possible to detect the specific location of the terminal device inside the vehicle; in other subsequent embodiments, it is possible to detect the specific location of the terminal device outside the vehicle. The terminal device refers to a terminal device carried or worn by a user, so the position of the terminal device relative to the vehicle is equivalent to the position of the user relative to the vehicle.
[0146] In addition, in some subsequent embodiments, after the position information of the terminal device relative to the vehicle is known, some application scenarios of the interaction between the vehicle and the terminal device can be provided.
[0147] In order to facilitate the understanding of this solution, the present application embodiment first combines Figure 1a The network architecture of the position acquisition system and the structure of the vehicle used in the embodiments of the present application are introduced. In some embodiments of the present application, please refer to Figure 1a , Figure 1a A schematic diagram of the architecture of a data processing system provided in an embodiment of the present application. Figure 1a As shown, the data processing system may include a vehicle 100 and a terminal device 200 , and a communication connection is established between the vehicle 100 and the terminal device 200 .
[0148] The vehicle 100 may be an autonomous vehicle or a non-autonomous vehicle. When the vehicle 100 is an autonomous vehicle, the autonomous vehicle is configured in a fully or partially autonomous mode. For example, the vehicle 100 may control itself while in the autonomous mode, and may determine the current state of the vehicle and its surroundings through human operation, determine the possible behavior of at least one other vehicle in the surrounding environment, and determine the confidence level corresponding to the possibility of the other vehicles performing the possible behavior, and control the vehicle 100 based on the determined information. When the vehicle 100 is in the autonomous mode, the vehicle 100 may also be set to operate without human interaction.
[0149] The terminal device 200 can be specifically manifested as a mobile phone, a tablet, a laptop computer, a smart wearable device, or other types of terminal devices, etc., which are not limited here.
[0150] In other embodiments of the present application, please continue to refer to Figure 1b , Figure 1b Another schematic diagram of the architecture of the data processing system provided in the embodiment of the present application. Figure 1bAs shown, the data processing system may include a vehicle 100, a first terminal device 300, and a second terminal device 400. The vehicle 100 and the first terminal device 300 are in a connected state; a connection may be established between the vehicle 100 and the second terminal device 400, or a connection may not be established. Further, optionally, the first terminal device 300 may be projecting a screen through the central control screen of the vehicle 100, while the second terminal device 400 is not projecting a screen through the central control screen of the vehicle 100.
[0151] It should be noted that when the vehicle 100 and the first terminal device 300 are in a connected state, the first terminal device 300 can perform any one or more of the following tasks through the vehicle 100: playing audio streams, playing videos, navigation, video calls, calls or other tasks, etc.
[0152] Among them, the first terminal device 300 and the second terminal device 400 are both terminal devices. The product form of the first terminal device 300 includes but is not limited to a mobile phone, a smart wearable device, a tablet, a laptop computer or other types of first terminal devices, etc., which are not limited here.
[0153] The product form of the second terminal device 400 may be the same as or different from the product form of the first terminal device 300; that is, the product form of the second terminal device 400 includes but is not limited to a mobile phone, a smart wearable device, a tablet, a laptop computer or other types of terminal devices, etc., which are not exhaustive here.
[0154] After the first terminal device 300 establishes a connection with the vehicle 100, the first terminal device 300 can project the screen through the central control screen of the vehicle 100. When the first terminal device 300 projects the screen through the central control screen of the vehicle 100, the content displayed on the central control screen of the vehicle 100 may not be exactly the same as the screen content of the first terminal device 300. The content displayed on the central control screen may be the application that has been configured for the vehicle 100 and multiple applications in the terminal device. That is, when the vehicle 100 is not connected to the first terminal device 300, it has its own user interface (UI). After the vehicle 100 is connected to the first terminal device 300, there may be more icons of applications on the UI interface of the vehicle 100, or the functions of the vehicle 100 may be more.
[0155] Optionally, after the first terminal device 300 and the vehicle 100 are connected, the first terminal device 300 and the vehicle 100 can also achieve mutual assistance at the hardware level. As an example, for example, the first terminal device 300 can use the global positioning system GPS configured in the vehicle 100 to improve the navigation accuracy of the first terminal device 300; as another example, for example, the first terminal device 300 can use the camera on the vehicle 100 to make a video call, etc., which are not exhaustive here.
[0156] For further information, see Figure 2 , Figure 2 A schematic diagram of a structure of a vehicle provided in an embodiment of the present application, the vehicle 100 may include various subsystems, such as a travel system 102, a sensor system 104, a control system 106, one or more peripheral devices 108, and a power supply 110, a computer system 112, and a user interface 116. Optionally, the vehicle 100 may also include an intelligent auxiliary device 160; further optionally, the vehicle 100 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and component of the vehicle 100 may be interconnected by wire or wirelessly.
[0157] The travel system 102 may include components that provide powered movement to the vehicle 100. In one embodiment, the travel system 102 may include an engine 118, a power source 119, a transmission 120, and wheels (also referred to as tires) 121.
[0158] Among them, the engine 118 can be an internal combustion engine, an electric motor, an air compression engine, or a combination of other types of engines, for example, a hybrid engine consisting of a gasoline engine and an electric motor, and a hybrid engine consisting of an internal combustion engine and an air compression engine. The engine 118 converts the energy source 119 into mechanical energy. Examples of the energy source 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. The energy source 119 can also provide energy for other systems of the vehicle 100. The transmission 120 can transmit the mechanical power from the engine 118 to the wheels 121. The transmission 120 may include a gearbox, a differential, and a drive shaft. In one embodiment, the transmission 120 may also include other devices, such as a clutch. Among them, the drive shaft may include one or more shafts that can be coupled to one or more wheels 121.
[0159] The sensor system 104 may include several sensors that sense information about the environment around the vehicle 100. For example, the sensor system 104 may include a positioning system 122 (the positioning system may be a global positioning system GPS, or a Beidou system or other positioning systems), an inertial measurement unit (IMU) 124, a radar 126, a laser rangefinder 128, and a camera 130. The sensor system 104 may also include sensors of the internal systems of the monitored vehicle 100 (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). The sensing data from one or more of these sensors may be used to detect objects and their corresponding characteristics (position, shape, direction, speed, etc.). Such detection and recognition are key functions for the safe operation of the autonomous vehicle 100.
[0160] Among them, the positioning system 122 can be used to estimate the geographic location of the vehicle 100. The IMU 124 is used to sense the position and orientation changes of the vehicle 100 based on inertial acceleration. In one embodiment, the IMU 124 can be a combination of an accelerometer and a gyroscope. The radar 126 can use radio signals to sense objects in the surrounding environment of the vehicle 100, and can be specifically expressed as a millimeter wave radar or a laser radar. In some embodiments, in addition to sensing objects, the radar 126 can also be used to sense the speed and / or direction of travel of the object. The laser rangefinder 128 can use lasers to sense objects in the environment where the vehicle 100 is located. In some embodiments, the laser rangefinder 128 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components. The camera 130 can be used to capture multiple images of the surrounding environment of the vehicle 100. The camera 130 can be a static camera or a video camera.
[0161] Control system 106 is an operating system that controls vehicle 100 and its components. Control system 106 may include various components, including a steering system 132 , a throttle 134 , a brake unit 136 , a computer vision system 140 , a lane control system 142 , and an obstacle avoidance system 144 .
[0162] Among them, the steering system 132 is used to adjust the forward direction of the vehicle 100. For example, in one embodiment, the steering system 132 can be a steering wheel system. The throttle 134 is used to control the operating speed of the engine 118 and thus control the speed of the vehicle 100. The brake unit 136 is used to control the deceleration of the vehicle 100. The brake unit 136 can use friction to slow down the wheel 121. In other embodiments, the brake unit 136 can convert the kinetic energy of the wheel 121 into electric current. The brake unit 136 can also take other forms to slow down the rotation speed of the wheel 121 to control the speed of the vehicle 100. The computer vision system 140 can operate to process and analyze the images captured by the camera 130 in order to identify objects and / or features in the surrounding environment of the vehicle 100. The objects and / or features may include traffic signals, road boundaries, and obstacles. The computer vision system 140 can use object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, and other computer vision technologies. In some embodiments, the computer vision system 140 can be used to map the environment, track objects, estimate the speed of objects, and the like. The route control system 142 is used to determine the route and speed of the vehicle 100. In some embodiments, the route control system 142 may include a lateral planning module 1421 and a longitudinal planning module 1422, which are respectively used to determine the route and speed of the vehicle 100 in combination with data from the obstacle avoidance system 144, GPS122, and one or more predetermined maps. The obstacle avoidance system 144 is used to identify, evaluate, and avoid or otherwise cross obstacles in the environment of the vehicle 100, and the aforementioned obstacles can be specifically manifested as actual obstacles and virtual moving bodies that may collide with the vehicle 100. In one example, the control system 106 may include components other than those shown and described in addition or in an alternative manner. Alternatively, a portion of the components shown above may be reduced.
[0163] The vehicle 100 interacts with external sensors, other vehicles, other computer systems, or users through the peripheral devices 108. The peripheral devices 108 may include a wireless communication system 146, a microphone 148, an audio system 150, and / or an onboard computer 152. In some embodiments, the peripheral devices 108 provide a means for the user of the vehicle 100 to interact with the user interface 116. For example, the onboard computer 152 may provide information to the user of the vehicle 100. The user interface 116 may also operate the onboard computer 152 to receive user input. The onboard computer 152 may be operated via a touch screen.
[0164] In other cases, the peripheral device 108 may provide a means for the vehicle 100 to communicate with other devices located in the vehicle. For example, the microphone 148 may receive audio (e.g., voice commands or other audio input) from a user of the vehicle 100. Similarly, the speaker 150 may output audio to the user of the vehicle 100. The wireless communication system 146 may communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system 146 may use 3G cellular communication, 4G cellular communication, 5G cellular communication, or wireless local area network (WLAN) communication, etc. In some embodiments, the wireless communication system 146 may communicate directly with the device using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicle communication systems, for example, the wireless communication system 146 may include one or more dedicated short range communications (DSRC) devices, which may include public and / or private data communications between vehicles and / or roadside stations.
[0165] The power source 110 can provide power to various components of the vehicle 100. In one embodiment, the power source 110 can be a rechargeable lithium-ion or lead-acid battery. One or more battery packs of such batteries can be configured as a power source to provide power to various components of the vehicle 100. In some embodiments, the power source 110 and the energy source 119 can be implemented together, such as in some all-electric vehicles.
[0166] Some or all of the functions of the vehicle 100 are controlled by a computer system 112. The computer system 112 may include at least one processor 113 that executes instructions 115 stored in a non-transitory computer-readable medium such as a memory 114. The computer system 112 may also be a plurality of computing devices that control individual components or subsystems of the vehicle 100 in a distributed manner. The processor 113 may be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, the processor 113 may be a dedicated device such as an application specific integrated circuit (ASIC) or other hardware-based processor. Although Figure 2The processor, memory, and other components of the computer system 112 in the same block are functionally illustrated, but it will be appreciated by those skilled in the art that the processor, or memory, may actually include multiple processors, or memories that are not stored in the same physical housing. For example, the memory 114 may be a hard drive or other storage medium located in a housing different from the computer system 112. Therefore, references to the processor 113 or memory 114 will be understood to include references to a collection of processors or memories that may or may not operate in parallel. Different from using a single processor to perform the steps described herein, some components such as the steering assembly and the deceleration assembly may each have their own processor that performs only calculations related to the functions specific to the component.
[0167] In various aspects described herein, the processor 113 may be located remotely from the vehicle 100 and in wireless communication with the vehicle 100. In other aspects, some of the processes described herein are performed on a processor 113 disposed within the vehicle 100 while others are performed by the remote processor 113, including taking the necessary steps to perform a single maneuver.
[0168] In some embodiments, the memory 114 may include instructions 115 (e.g., program logic) that can be executed by the processor 113 to perform various functions of the vehicle 100, including those described above. The memory 114 may also include additional instructions, including instructions to send data to, receive data from, interact with, and / or control one or more of the travel system 102, the sensor system 104, the control system 106, and the peripheral devices 108. In addition to the instructions 115, the memory 114 may also store data such as road maps, route information, the vehicle's location, direction, speed, and other such vehicle data, as well as other information. This information can be used by the vehicle 100 and the computer system 112 during the operation of the vehicle 100 in autonomous, semi-autonomous, and / or manual modes. A user interface 116 is used to provide information to or receive information from a user of the vehicle 100. Optionally, the user interface 116 may include one or more input / output devices within the set of peripheral devices 108, such as a wireless communication system 146, an onboard computer 152, a microphone 148, and an audio system 150.
[0169] The computer system 112 may control functions of the vehicle 100 based on input received from various subsystems (e.g., the travel system 102, the sensor system 104, and the control system 106) and from the user interface 116. For example, the computer system 112 may utilize input from the control system 106 in order to control the steering system 132 to avoid obstacles detected by the sensor system 104 and the obstacle avoidance system 144. In some embodiments, the computer system 112 may be operable to provide control over many aspects of the vehicle 100 and its subsystems.
[0170] Alternatively, one or more of the above-mentioned components may be installed or associated separately from the vehicle 100. For example, the memory 114 may exist partially or completely separately from the vehicle 100. The above-mentioned components may be communicatively coupled together in a wired and / or wireless manner.
[0171] Optionally, the above components are only examples. In actual applications, the components in the above modules may be added or deleted according to actual needs. Figure 2 It should not be construed as limiting the embodiments of the present application. An autonomous vehicle traveling on a road, such as vehicle 100 above, can identify objects in its surrounding environment to determine adjustments to the current speed. The objects can be other vehicles, traffic control devices, or other types of objects. In some examples, each identified object can be considered independently, and based on the respective characteristics of the object, such as its current speed, acceleration, spacing from the vehicle, etc., it can be used to determine the speed to be adjusted by the autonomous vehicle.
[0172] Specifically, in some of the following embodiments (such as in Embodiment 2), it is possible to measure whether the terminal device is located inside or outside the vehicle 100; in some other embodiments (such as in Embodiment 1 and Embodiment 2), it is also possible to measure where the terminal device is located outside the vehicle 100; in some other embodiments (such as in Embodiment 1), it is also possible to measure where the terminal device is located inside the vehicle 100. In some other embodiments (such as in Embodiment 1, Embodiment 2, and Embodiment 3), multiple application scenarios for interaction between the vehicle and the terminal device after obtaining the location information of the terminal device are provided.
[0173] It should be noted that in the specific application scenarios based on the location information of the terminal device relative to the vehicle provided in the embodiments of the present application, the method for obtaining the location information of the terminal device can adopt any of the methods provided in the embodiments of the present application, or can adopt the method in the prior art, which is not limited here. Among them, the location information of the terminal device relative to the vehicle refers to: whether the terminal device is inside or outside the vehicle (including determining whether the terminal device is inside or outside the vehicle, or from inside to outside, or from outside to inside, etc.), or the specific location of the terminal device outside the vehicle, or the specific location of the terminal device inside the vehicle, etc.
[0174] Among them, the above-mentioned terminal device can be a terminal device 200, a first terminal device 300, or a second terminal device 400. It should be noted that the terminal device refers to a terminal device carried or worn by a user. Therefore, the position of the terminal device relative to the vehicle is equivalent to the position of the user relative to the vehicle.
[0175] In some implementations, the above-mentioned measurement method is pre-loaded into the memory 114 in the form of a computer program product, and the processor 113 in the vehicle 100 can execute the instructions in the memory 114 to use the speaker 150 to emit an audio signal, thereby obtaining the location information of the terminal 200.
[0176] In other implementations, the executor of the above-mentioned measurement method can be a vehicle auxiliary device 160, and the vehicle auxiliary device 160 is loaded in the vehicle 100 in the form of an independent device. The vehicle auxiliary device 160 can be specifically manifested as a vehicle-mounted display screen, a driving recorder, a vehicle-mounted rearview mirror or other product forms, etc., which are not limited here.
[0177] The vehicle 100 may be a car, a truck, a motorcycle, a bus, a ship, an airplane, a helicopter, a lawn mower, an entertainment vehicle, an amusement park vehicle, construction equipment, a tram, a golf cart, a train, a cart, etc., and the embodiments of the present application are not particularly limited.
[0178] In combination with the above description, in an embodiment of the present application, as an example, for example, in an application scenario, at least one user walks into the vehicle from a long distance outside the vehicle and starts driving the vehicle. In order to be able to control the vehicle components corresponding to the user's position to perform preset operations, the user's specific position outside the vehicle can be detected; as an example, for example, when it is detected that the user is at the left front door outside the vehicle, the unlocking of the left front door can be triggered; as another example, for example, when it is detected that the user is at the trunk of the vehicle, the opening of the trunk of the vehicle can be triggered, etc., and the examples are not exhaustive here.
[0179] After the user walks near the vehicle, he may directly enter the vehicle, or he may stay outside the vehicle for a while before entering the vehicle. When the user is inside the vehicle and when the user is outside the vehicle, the vehicle and / or the terminal device can provide different services to the user. Therefore, the embodiment of the present application also provides a method for detecting whether the user is inside the vehicle or outside the vehicle. Accordingly, it is possible to identify that the user enters the vehicle from outside the vehicle.
[0180] When the user is inside the vehicle, in order to provide more accurate services to users at different locations, the embodiment of the present application also provides a method for detecting the specific location of the user inside the vehicle. It should be noted that since the user generally carries a terminal device, the location of the user is indicated by detecting the location of the terminal device in the embodiment of the present application.
[0181] When the user moves from the inside of the vehicle to the outside of the vehicle, the vehicle and / or the terminal device can provide corresponding services according to the change in the user's position. The method provided in the embodiment of the present application can detect the user's moving from the inside of the vehicle to the outside of the vehicle. In addition, the method provided in the embodiment of the present application can be used to detect the specific location of the user outside the vehicle and further provide corresponding services.
[0182] In addition, after obtaining the user's location information through the solution in the embodiment of the present application, corresponding services can also be provided to the user based on the user's location information; for example, what services can be provided when the user is inside the vehicle; for example, what services can be provided when the user is at a specific location inside the vehicle; for example, what services can be provided when the user moves from the inside of the vehicle to the outside of the vehicle; for example, what services can be provided when the user moves from the outside of the vehicle to the inside of the vehicle, etc., which will be described in the subsequent embodiments one, two and three.
[0183] Please refer to the following Example 1. Example 1 in the embodiments of the present application provides a method for obtaining a location. The vehicle is equipped with at least two speakers. The processor in the vehicle (or the vehicle auxiliary device in the vehicle) generates target location information corresponding to the terminal device by sending ultrasonic signals from the speakers. The target location information can be used to indicate where the terminal device is located inside the vehicle; or, it can also be used to indicate where the terminal device is located outside the vehicle. In addition, this Example 1 also provides some application scenarios, and different operations are performed based on the specific location of the terminal device to provide corresponding services to the user.
[0184] Embodiment 1
[0185] In the embodiments of the present application, specifically, in one implementation, the target location information can be generated without obtaining the distance between the terminal device and the audio system; in another implementation, the target location information is generated based on the distance between the terminal device and each audio system. The following four situations are introduced respectively: generating the location of the terminal device inside the vehicle without obtaining the distance between the terminal device and the audio system; generating the location of the terminal device inside the vehicle based on the distance between the terminal device and each audio system; generating the location of the terminal device outside the vehicle without obtaining the distance between the terminal device and the audio system; and generating the location of the terminal device outside the vehicle based on the distance between the terminal device and each audio system.
[0186] 1. Generate the location of the terminal device inside the vehicle without obtaining the distance between the terminal device and the speaker
[0187] In the embodiment of the present application, audio signals are sent respectively by at least two speakers in the vehicle, and the position of the terminal device relative to the vehicle can be determined according to the time when each audio signal is received by the terminal device. In the subsequent embodiment 1, only the audio signal is specifically expressed as an ultrasonic signal as an example for explanation. It should be noted that audio signals in non-ultrasonic frequency bands can also be used in the embodiment of the present application, such as audio signals that can be heard by the human ear, etc., which will not be repeated one by one in the embodiment 1 of the present application. Among them, the frequency band where the ultrasonic signal is located can be 17KHZ-48KHZ, and optionally, the frequency band where the ultrasonic signal is located can be 17KHZ-22KHZ. The frequency of the specific target audio signal can be determined in combination with the actual application product, which is not limited here. As an example, for example, the ultrasonic signal can be a linear frequency modulation (Chirp) signal, a ZC (zadoff–chu) sequence signal or other types of audio signals, etc., which are not exhaustively listed here. For the description of the specific audio signal, please refer to the relevant description in the second embodiment.
[0188] For details, please refer to Figure 3 , Figure 3 A flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0189] 301. The vehicle and the terminal device initiate an in-vehicle location sensing operation.
[0190] In the embodiments of the present application, in some application scenarios, during the operation of the vehicle, when the vehicle determines that it needs to know the location of the terminal device inside the vehicle, it will start the in-vehicle location sensing operation and send a first indication information to the terminal device, and the first indication information is used to instruct the terminal device to start the in-vehicle location sensing operation. It should be noted that the steps executed by the vehicle in the first embodiment can be specifically executed by a processor in the vehicle or by a vehicle auxiliary device in the vehicle, which is determined in combination with the actual product form and will not be explained later.
[0191] As an example, for example, a vehicle needs to assign control permissions to at least one terminal device in the vehicle, but the control permissions corresponding to terminal devices located at different positions in the vehicle are different. In this case, the position of each terminal device in the vehicle needs to be obtained, and the vehicle can trigger the start of the in-vehicle location awareness operation.
[0192] As another example, for example, the vehicle needs to connect to the terminal device located on the co-pilot seat and project the screen of the terminal device located on the co-pilot seat onto the central control screen. The vehicle needs to obtain the position of each terminal device in the vehicle to determine the terminal device located on the co-pilot seat from at least one terminal device. The vehicle can trigger the start of the in-vehicle position sensing operation, etc. It should be noted that the vehicle can also trigger the start of the in-vehicle position sensing operation in other scenarios. The examples given here are only for the convenience of understanding this solution and are not used to limit this solution.
[0193] In other application scenarios, during the operation of the terminal device, when the terminal device determines that it needs to know the location of the terminal device inside the vehicle, it will start the in-vehicle position sensing operation and send a second indication information to the vehicle. The second indication information is used to instruct the vehicle to start the in-vehicle position sensing operation.
[0194] As an example, when a terminal device located in a car wants to start a screen projection operation, since the vehicle can be configured with multiple display screens, the terminal device can start the in-vehicle location awareness operation to obtain the display screen closest to the terminal device from the multiple display screens in the car and automatically connect to the terminal device; or, a display screen list can be displayed on the terminal device, which shows all the display screens that can be connected, and the display screen closest to the terminal device is pinned to the top.
[0195] As another example, for example, the terminal device is a wireless headset, and the wireless headset wants to connect to the nearest screen in the car so as to play the sound output by the aforementioned screen through the wireless headset. Then, the wireless headset can initiate the in-car position sensing operation to obtain a display screen that is closest to the wireless headset from multiple display screens in the car, etc. It should be understood that the terminal device can also trigger the initiation of the in-car position sensing operation in other scenarios, which are not listed one by one here.
[0196] Specifically, in some application scenarios, the vehicle can send a first indication message to a terminal device in the vehicle by broadcasting. After receiving the first indication message, the terminal device is triggered to start the in-vehicle location sensing operation. The terminal device sends a first feedback message to the vehicle, thereby completing the communication connection between the vehicle and a certain terminal device. The first feedback message is used to inform the vehicle that the terminal device has successfully started the in-vehicle location sensing operation.
[0197] The above-mentioned broadcasting method can be broadcasting through Bluetooth signals, broadcasting through wireless broadband (wireless fidelity, WIFI) hotspots or other methods, etc., which are not exhaustive here.
[0198] After the vehicle determines that the terminal device has started the in-vehicle location sensing operation, the vehicle can send a third indication message to at least one terminal device in the vehicle. The third indication message is used to instruct the terminal device to start preparing to receive ultrasonic signals, and then start sending ultrasonic signals through at least two speakers. However, it should be noted that if there are multiple terminal devices in the vehicle at the same time, since the terminal device generates the target location information corresponding to each terminal device in this solution, the vehicle can send the third indication message to multiple terminal devices in the vehicle at the same time, or obtain the location of the terminal devices in the vehicle one by one.
[0199] In other application scenarios, the terminal device in the vehicle can send a second indication message to the vehicle by broadcasting. After receiving the second indication message, the vehicle is triggered to start the in-vehicle position sensing operation. The terminal device sends a second feedback message to the vehicle. The second feedback message is used to inform the terminal device that the vehicle has successfully started the in-vehicle position sensing operation, so that the terminal device can prepare to start receiving ultrasonic signals.
[0200] Furthermore, if the vehicle receives second indication information sent by multiple terminal devices in the vehicle, the vehicle can simultaneously send a second feedback message to the multiple terminal devices in the vehicle, so that the multiple terminal devices simultaneously start measuring their own positions inside the vehicle; the vehicle can also send a second feedback message to the multiple terminal devices in the vehicle one by one, so that the multiple terminal devices start measuring their own positions inside the vehicle one by one.
[0201] In this implementation, a specific implementation method for triggering a vehicle to start sending an ultrasonic signal and a terminal device to start receiving an ultrasonic signal is provided, thereby improving the integrity of this solution; and whether the vehicle wants to obtain the target position information of the terminal device or the terminal device wants to obtain the target position information of the terminal device, the sending and receiving operations of the ultrasonic signal can be triggered, thereby expanding the application scenarios of this solution.
[0202] 302. The vehicle sends a first ultrasonic signal to a terminal device via a first speaker.
[0203] In the embodiment of the present application, at least two speakers are configured in the vehicle, and the at least two speakers include a first speaker and a second speaker, and the first speaker and the second speaker are configured on different sides of the vehicle. Further, if the first speaker and the second speaker are respectively configured on the front side and the rear side of the vehicle, a target location information can be used to indicate whether a terminal device is in the front row position inside the vehicle or in the rear row position inside the vehicle; or, if the first speaker and the second speaker can be respectively configured on the left side and the right side of the vehicle, a target location information can be used to indicate whether a terminal device is in the left side position inside the vehicle or in the right side position inside the vehicle.
[0204] Optionally, the at least two speakers configured inside the vehicle may include at least three speakers, and the at least three speakers may include a first speaker, a second speaker, and a third speaker, and the at least three speakers are not located in a straight line, then a target position information may be used to indicate a certain position of a terminal device inside the vehicle. As an example, for example, there are five in-vehicle positions in the vehicle, and the five positions are the main driving position, the co-pilot position, the left rear position, the middle rear position, and the right rear position, then a target position information may be used to indicate a specific in-vehicle position among the five in-vehicle positions. It should be understood that the above examples are only for the convenience of understanding this solution and are not used to limit this solution.
[0205] For a more intuitive understanding of this solution, please refer to Figure 4 , Figure 4 A schematic diagram of the positions of at least three speakers in the method for obtaining the position provided in an embodiment of the present application, Figure 4 In the example, a vehicle sends ultrasonic signals through three speakers and the vehicle is a car. Figure 4 It includes three sub-schematic diagrams (a), (b) and (c), as shown in Figure 4 As shown in the sub-schematic diagram (a) of FIG. 1 , the three speakers may be located at the left front position, the right front position and the left rear position inside the vehicle, respectively; Figure 4 As shown in the sub-schematic diagram (b) of FIG. 1 , the three speakers may be located at the left front position, the right front position and the middle of the rear row in the vehicle, respectively; Figure 4 As shown in the sub-schematic diagram (c) of FIG. 1 , the three speakers may be located at the left front position, the right front position and the right rear position in the vehicle, etc. It should be understood that Figure 4 The examples in the figure are only for the convenience of understanding the location of the speakers. The vehicle can also send ultrasonic signals through speakers in other locations, etc., which are not exhaustive here. Figure 4 and Figure 5As shown, the embodiment of the present application describes the positions of various speakers according to a top view of the vehicle, such as a left front position, a right front position, a left rear position, and a right rear position.
[0206] In an embodiment of the present application, at least three speakers inside the vehicle are used to determine the position of the terminal device inside the vehicle, and the at least three speakers are not in the same straight line, so the precise position of the terminal device inside the vehicle can be obtained, which is conducive to providing more refined management for the terminal device later.
[0207] Further optionally, the at least three speakers configured inside the vehicle include four speakers, the four speakers include a first speaker, a second speaker, a third speaker and a fourth speaker, and the four speakers are respectively located at the left front position, the right front position, the left rear position and the right rear position of the vehicle. In the embodiment of the present application, the speakers that generally come with the vehicle are respectively located at the left front position, the right front position, the left rear position and the right rear position, which not only does not require the addition of additional components to the vehicle, but also because the more speakers are used, the lower the error rate of the target position information obtained, and after making full use of the four existing speakers in the vehicle, it is beneficial to improve the accuracy of the target position information obtained.
[0208] In the embodiment of the present application, the vehicle can send a first ultrasonic signal to the terminal device by broadcasting through the first speaker. Correspondingly, a certain terminal device inside the vehicle (hereinafter referred to as the "target terminal device" for the convenience of description) receives the first ultrasonic signal sent by the first speaker, and the target terminal device also obtains the reception time of the first ultrasonic signal.
[0209] Among them, the frequency band of the first ultrasonic signal can be 17KHZ-48KHZ. Optionally, the frequency band of the first ultrasonic signal can be 17KHZ-23KHZ. As an example, the frequency of the first ultrasonic signal can be about 23KHZ. The specific frequency of the first ultrasonic signal can be determined in combination with the actual application product and is not limited here.
[0210] 303. The vehicle sends a second ultrasonic signal to the terminal device through the second speaker.
[0211] In the embodiment of the present application, the vehicle can send a second ultrasonic signal to the terminal device by broadcasting through the second speaker. Correspondingly, the target terminal device receives the second ultrasonic signal sent by the second speaker. The target terminal device also obtains the reception time of the second ultrasonic signal. The second speaker and the first speaker are two different speakers.
[0212] Specifically, in one implementation, if step 302 and step 303 are performed simultaneously, the first ultrasonic signal and the second ultrasonic signal are different ultrasonic signals, and the two different ultrasonic signals may be any one or more of the following differences: different frequencies, different signal modulation methods, different waveforms, different secondary values, or other types of differences.
[0213] In another implementation, if step 302 is executed first and step 303 is executed after a preset time interval, the first ultrasonic signal and the second ultrasonic signal may be the same ultrasonic signal or different ultrasonic signals. As an example, the preset time interval may be 0.05 seconds, 0.1 seconds, 0.15 seconds, 0.2 seconds or other durations. The specific value may be determined in combination with the actual application product and is not limited here.
[0214] 304. The vehicle sends a third ultrasonic signal to the terminal device via a third speaker.
[0215] In some embodiments of the present application, if the vehicle uses at least three speakers to obtain the specific location of the terminal device in the vehicle, the vehicle can also send a third ultrasonic signal to the terminal device through the third speaker in a broadcasting manner. Correspondingly, the target terminal device receives the third ultrasonic signal sent by the third speaker, and the target terminal device also obtains the reception time of the third ultrasonic signal. The third speaker, the second speaker and the first speaker are all different speakers.
[0216] Specifically, in one implementation, if step 302, step 303, and step 304 are performed simultaneously, the first ultrasonic signal, the second ultrasonic signal, and the third ultrasonic signal are all different ultrasonic signals.
[0217] In another implementation, if step 302 is executed first, step 303 is executed after a preset time interval, and step 304 is executed after a preset time interval, the first ultrasonic signal, the second ultrasonic signal, and the third ultrasonic signal may be the same ultrasonic signal or different ultrasonic signals.
[0218] Optionally, if the vehicle uses four speakers to obtain the specific location of the terminal device in the vehicle, the vehicle can also send a fourth ultrasonic signal to the terminal device through the fourth speaker by broadcasting. Correspondingly, the target terminal device receives the fourth ultrasonic signal sent by the fourth speaker, and the target terminal device also obtains the reception time of the fourth ultrasonic signal. The fourth speaker, the second speaker and the first speaker are all different speakers.
[0219] Specifically, in one implementation, if the vehicle simultaneously sends an ultrasonic signal to the terminal device through the first speaker, the second speaker, the third speaker, and the fourth speaker, the first ultrasonic signal, the second ultrasonic signal, the third ultrasonic signal, and the fourth ultrasonic signal are all different ultrasonic signals.
[0220] In another implementation, if ultrasonic signals are sent to a terminal device through the first speaker, the second speaker, the third speaker, and the fourth speaker one by one, and the time interval between the sending times of two adjacent ultrasonic signals is a preset time interval, then the first ultrasonic signal, the second ultrasonic signal, the third ultrasonic signal, and the fourth ultrasonic signal can be the same ultrasonic signal or different ultrasonic signals.
[0221] 305. The terminal device determines target position information according to the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal, where the target position information is used to indicate the position of the terminal device inside the vehicle.
[0222] In an embodiment of the present application, the terminal device can determine the target position information based on the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal, and the target position information is used to indicate the position of the terminal device inside the vehicle.
[0223] Furthermore, since the receiving time of the first ultrasonic signal and the receiving time of the second ultrasonic signal can reflect the distance relationship between the terminal device and the first speaker and the second speaker, and the positions of multiple speakers in the vehicle are fixed, when the position of the terminal device relative to the vehicle is different, the distance relationship between the terminal device and each speaker will also be different, and therefore the target position information of the terminal device can be determined.
[0224] Optionally, if the vehicle sends ultrasonic signals through at least three speakers, the terminal device can determine the target location information based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, and the reception time of the third ultrasonic signal.
[0225] Further optionally, if the vehicle sends ultrasonic signals through four speakers, the terminal device can determine the target position information based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, the reception time of the third ultrasonic signal and the reception time of the fourth ultrasonic signal.
[0226] Specifically, in one implementation, the vehicle sends ultrasonic signals through at least two speakers at the same time, that is, step 302, step 303 and step 304 are performed at the same time, and step 305 may include: the target terminal device may be configured with a one-to-one correspondence between different types of ultrasonic signals and speakers at different positions, that is, the speakers at each position may send a fixed type of ultrasonic signal, so that the terminal device can know in advance which type of ultrasonic signal is sent by the speakers at which position. The target terminal device determines the order in which different ultrasonic signals arrive at the terminal device according to the reception time of different ultrasonic signals in at least two ultrasonic signals.
[0227] Since the vehicle sends ultrasonic signals through multiple speakers at the same time, the later the ultrasonic signal sent by a speaker at a certain position arrives at the target terminal device, the longer the distance between the speaker and the target terminal device. That is, the order in which each ultrasonic signal arrives at the terminal device represents the distance between the target terminal device and the speakers at each position. The positions of multiple speakers in the vehicle are fixed, and the distance relationship between different positions in the vehicle and each speaker is different. Therefore, the terminal device can determine the position of the target terminal device inside the vehicle (that is, determine the target position information of the target terminal device) according to the order in which different ultrasonic signals arrive at the terminal device.
[0228] More specifically, in one case, if the vehicle sends ultrasonic signals to a terminal device through four speakers located at the left front position, the right front position, the left rear position and the right rear position, respectively, the target terminal device can obtain the receiving time of the first ultrasonic signal, the receiving time of the second ultrasonic signal, the receiving time of the third ultrasonic signal and the receiving time of the fourth ultrasonic signal, respectively, determine the order in which the first ultrasonic signal, the second ultrasonic signal, the third ultrasonic signal and the fourth ultrasonic signal arrive at the target terminal device, and determine the target position information of the target terminal device; wherein, there are N positions inside the vehicle, and the target position information is used to indicate that the target terminal device is located at a target position among the N positions, and N is an integer greater than 1.
[0229] Furthermore, here, taking the five positions in the vehicle including the main driver's seat, the co-driver's seat, the left side of the rear seat, the right side of the rear seat and the middle of the rear seat as examples, the principle of determining the target position information of the target terminal device based on the order in which each ultrasonic signal reaches the target terminal device is demonstrated. If the ultrasonic signal emitted by the speaker at the left front position reaches the target terminal device first, the ultrasonic signal emitted by the speaker at the right front position and the left rear position is second, and the ultrasonic signal emitted by the speaker at the right rear position reaches the target terminal device last, then it is determined that the target terminal device is located at the main driver's seat in the vehicle.
[0230] If the ultrasonic signal emitted by the speaker at the right front position reaches the target terminal device first, the ultrasonic signals emitted by the speakers at the left front position and the right rear position arrive at the target terminal device second, and the ultrasonic signal emitted by the speaker at the left rear position arrives at the target terminal device last, then it is determined that the target terminal device is located at the co-pilot seat in the vehicle.
[0231] If the ultrasonic signal emitted by the speaker at the left rear position reaches the target terminal device first, the ultrasonic signals emitted by the speakers at the left front position and the right rear position arrive at the target terminal device second, and the ultrasonic signal emitted by the speaker at the right front position arrives at the target terminal device last, then it is determined that the target terminal device is located at the left rear seat in the vehicle.
[0232] If the ultrasonic signal emitted by the speaker at the right rear position reaches the target terminal device first, and the ultrasonic signals emitted by the speakers at the right front position and the left rear position arrive at the target terminal device second, and the ultrasonic signal emitted by the speaker at the left front position arrives at the target terminal device last, then it is determined that the target terminal device is located at the right rear seat in the vehicle.
[0233] If the ultrasonic signals emitted by the speakers at the left front position and the right front position arrive at the target terminal device at substantially the same time, the ultrasonic signals emitted by the speakers at the left rear position and the right rear position arrive at the target terminal device at substantially the same time, and the ultrasonic signals emitted by the speakers at the left rear position and the right rear position arrive at the target terminal device earlier than the ultrasonic signals emitted by the speakers at the left front position and the right front position, then it is determined that the target terminal device is located in the middle rear row of the vehicle.
[0234] For a more intuitive understanding of the embodiments of this application, please refer to Figure 5 , Figure 5 A schematic diagram of the principle of the method for obtaining the position provided in the embodiment of the present application. Figure 5 As shown, the distance between speaker 1 and terminal device 1 is the shortest, the distance between speaker 2 and speaker 3 and terminal device 1 is the second shortest, and the distance between speaker 4 and terminal device 1 is the farthest; if terminal device 1 finds that the ultrasonic signal emitted by speaker 1 arrives first, the ultrasonic signals emitted by speakers 2 and 3 arrive second, and the ultrasonic signal emitted by speaker 4 arrives last, then terminal device 1 can determine that it is located in the main driving position.
[0235] The distances between speakers 1 and 2 and terminal device 2 are similar, the distances between speakers 3 and 4 and terminal device 2 are similar, and the distances between speakers 1 and 2 and terminal device 2 are greater than the distances between speakers 3 and 4 and terminal device 2. If terminal device 2 finds that the ultrasonic signals emitted by speakers 3 and 4 arrive at almost the same time, the ultrasonic signals emitted by speakers 1 and 2 arrive at almost the same time, and the ultrasonic signals emitted by speakers 3 and 4 arrive earlier than the ultrasonic signals emitted by speakers 1 and 2, then terminal device 2 can determine that it is located in the middle position of the back row. It should be understood that Figure 5 The examples are only for a more intuitive understanding of the present invention and are not intended to limit the present invention.
[0236] In another case, the vehicle can determine whether the terminal device is located at the left side or the right side of the vehicle through two speakers. The two speakers are respectively located on the left and right sides of the vehicle, so that the distance between the left speaker and the left side is smaller than the distance between the left speaker and the right side, and the distance between the right speaker and the right side is smaller than the distance between the right speaker and the left side. The vehicle sends an ultrasonic signal to the terminal device through the two speakers, and can determine whether the target terminal device is located at the left side or the right side of the vehicle through the ultrasonic signal received by the target terminal device.
[0237] Furthermore, if the ultrasonic signal emitted by the speaker on the left side of the vehicle reaches the target terminal device first, and the ultrasonic signal emitted by the speaker on the right side of the vehicle reaches the target terminal device later, the target terminal device is located on the left side of the vehicle. If the ultrasonic signal emitted by the speaker on the right side of the vehicle reaches the target terminal device first, and the ultrasonic signal emitted by the speaker on the left side of the vehicle reaches the target terminal device later, the target terminal device is located on the right side of the vehicle.
[0238] In another case, the vehicle can determine that the terminal device is located in the front row (main driving position and co-pilot position) or the back row (back seat) inside the vehicle through two speakers. The two speakers are respectively arranged at the front and back sides of the vehicle, so that the distance between the front speaker and the front row position is smaller than the distance between the front speaker and the back row position, and the distance between the back speaker and the back row position is smaller than the distance between the back speaker and the front row position. According to the ultrasonic signal received by the target terminal device, it can be determined that the target terminal device is located in the front row or the back row inside the vehicle.
[0239] Furthermore, if the ultrasonic signal emitted by the speaker at the front side of the vehicle reaches the target terminal device first, and the ultrasonic signal emitted by the speaker at the rear side of the vehicle reaches the target terminal device later, the target terminal device is located in the front row of the vehicle. If the ultrasonic signal emitted by the speaker at the rear side of the vehicle reaches the target terminal device first, and the ultrasonic signal emitted by the speaker at the front side of the vehicle reaches the target terminal device later, the target terminal device is located in the rear row of the vehicle.
[0240] It should be noted that, in the embodiments of the present application, the specific implementation scheme for determining the position of the terminal device in the vehicle when there are other numbers of speakers in the vehicle or the speakers are located at other positions is no longer described in detail one by one. It can be inferred and understood based on the same principle. The aforementioned principle is that after the position for sending the ultrasonic signal is fixed, the distance relationship between the terminal devices at different positions in the vehicle and the speakers at different positions is different, and because the order in which different ultrasonic signals arrive at the target terminal device can represent the distance relationship between the speakers at different positions and the terminal device, the target terminal device can determine the position of the target terminal device in the vehicle according to the order in which different ultrasonic signals arrive at the target terminal device.
[0241] In the embodiment of the present application, since the farther the distance between the terminal device and a certain speaker is, the later the ultrasonic signal emitted by the speaker arrives at the terminal device. If the vehicle simultaneously sends different ultrasonic signals to the terminal device through speakers at different positions, the order in which the different ultrasonic signals arrive at the terminal device can well reflect the distance relationship between the terminal device and each speaker, and then the specific position of the terminal device inside the vehicle can be intuitively deduced, providing a simple solution for obtaining target position information, which is easy to implement.
[0242] In another implementation, the vehicle sends ultrasonic signals to the terminal device one by one through different speakers of at least two speakers, the time interval between the sending time of two adjacent ultrasonic signals is a preset time interval, and the ultrasonic signals sent by the vehicle through different speakers can be the same or different. Then step 305 may include: the target terminal device determines the position of the target terminal device inside the vehicle (that is, determines the target position information of the target terminal device) according to the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal, and the preset time interval.
[0243] Since the vehicle sends ultrasonic signals through different speakers one by one at preset time intervals, the target terminal device can determine the speaker at which position each received ultrasonic signal comes from based on the actual reception order of each ultrasonic signal, and can know the actual order of the distances between the target terminal device and the speakers at each position based on the actual reception time of each ultrasonic signal and the preset time interval, and thus can determine the position of the target terminal device inside the vehicle. This principle can be found in the description in the previous implementation method.
[0244] More specifically, in one case, if the vehicle sends ultrasonic signals to the terminal device through four speakers located at the left front position, the right front position, the left rear position and the right rear position, respectively, the target terminal device can respectively obtain the first receiving time of the first arriving ultrasonic signal (that is, the first ultrasonic signal sent by the first speaker), the receiving time of the second arriving ultrasonic signal (that is, the second ultrasonic signal sent by the second speaker), the receiving time of the third arriving ultrasonic signal (that is, the third ultrasonic signal sent by the third speaker), and the receiving time of the fourth arriving ultrasonic signal (that is, the fourth ultrasonic signal sent by the fourth speaker); subtract the preset time interval from the receiving time of the second arriving ultrasonic signal to obtain the second receiving time corresponding to the second arriving ultrasonic signal; subtract 2*the preset time interval from the receiving time of the third arriving ultrasonic signal to obtain the third receiving time corresponding to the third arriving ultrasonic signal; subtract 3*the preset time interval from the receiving time of the fourth arriving ultrasonic signal to obtain the fourth receiving time corresponding to the fourth arriving ultrasonic signal.
[0245] The target terminal device determines the target location information of the target terminal device according to the first receiving time, the second receiving time, the third receiving time and the fourth receiving time. Furthermore, since the vehicle sends out the first ultrasonic signal, sends out the second ultrasonic signal after the preset time interval, sends out the third ultrasonic signal after the preset time interval, and sends out the fourth ultrasonic signal after the preset time interval, the first receiving time, the second receiving time, the third receiving time and the fourth receiving time can represent the distance between each speaker and the target terminal device. Among them, the earlier the first receiving time, the closer the distance between the first speaker and the target terminal device, the later the first receiving time, the farther the distance between the first speaker and the target terminal device, and the meanings represented by the second receiving time, the third receiving time and the fourth receiving time are the same as those represented by the first receiving time. After the positions of at least two speakers are fixed, the distance relationship between different positions in the vehicle and each speaker is different, so the target terminal device can determine the target location information of the target terminal device according to the first receiving time, the second receiving time, the third receiving time and the fourth receiving time.
[0246] In another case, if the vehicle sends ultrasonic signals to the terminal device through two speakers, the target terminal device can respectively obtain the first receiving time of the first ultrasonic signal (i.e., the first ultrasonic signal sent by the first speaker) and the receiving time of the second ultrasonic signal (i.e., the second ultrasonic signal sent by the second speaker), and subtract the preset time interval from the receiving time of the second ultrasonic signal to obtain the second receiving time corresponding to the second ultrasonic signal. If the first receiving time is earlier than the second receiving time, it is determined that the target terminal device is located on the side where the first speaker is located; if the first receiving time is later than the second receiving time, it is determined that the target terminal device is located on the side where the second speaker is located.
[0247] If the first speaker and the second speaker are respectively arranged on the left and right sides of the vehicle, the distance between the first speaker and the second speaker located on the left side and the left side position is smaller than the distance between the left speaker and the right side position, and the distance between the first speaker and the second speaker located on the right side and the right side position is smaller than the distance between the right speaker and the left side position. The target position information of the target terminal device is used to indicate whether the target terminal device is located at the left side position or the right side position inside the vehicle.
[0248] If the first speaker and the second speaker are respectively arranged at the front and rear sides of the vehicle, the distance between the first speaker and the front row is smaller than the distance between the first speaker and the rear row, and the distance between the first speaker and the rear row is smaller than the distance between the rear speaker and the front row. The target position information of the target terminal device is used to indicate that the target terminal device is located at the front row or the rear row in the vehicle.
[0249] It should be noted that in the embodiments of the present application, the specific implementation scheme for determining the position of the terminal device in the vehicle when there are other numbers of speakers in the vehicle or the speakers are located in other positions will not be described one by one. Please refer to the above description for understanding.
[0250] The embodiment of the present application provides another solution for obtaining target location information, which improves the implementation flexibility of the solution and sends ultrasonic signals to the terminal device through different speakers in sequence, thereby reducing the difficulty of the terminal device processing each ultrasonic signal, which is beneficial to improving the accuracy of the target location information finally obtained.
[0251] In an embodiment of the present application, a solution for measuring the position of a user relative to a vehicle is provided. The use of ultrasonic signals to measure the position of a terminal device relative to the vehicle is conducive to obtaining accurate target position information. Since the user cannot perceive the ultrasonic signal, the user can be accurately positioned relative to the vehicle without the user noticing. In addition, there is no need to add additional hardware to the vehicle or terminal device to avoid additional overhead.
[0252] 2. Generate the location of the terminal device inside the vehicle based on the distance between the terminal device and each speaker
[0253] For details, please refer to Figure 6 , Figure 6 A flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0254] 1001. The vehicle and the terminal device initiate an in-vehicle location sensing operation.
[0255] In the embodiment of the present application, the specific implementation of step 1001 can be found in Figure 3 The description of step 301 in the corresponding embodiment is not repeated here.
[0256] 1002. The vehicle receives a first measurement signal sent by a terminal device through a target speaker.
[0257] In the embodiment of the present application, after both the vehicle and the terminal device start the in-vehicle position sensing operation, the terminal device can send a first measurement signal to the vehicle, and correspondingly, the vehicle will also receive the first measurement signal sent by the terminal device through the target speaker. The vehicle is equipped with at least two speakers, the target speaker is any one of the at least two speakers equipped with the vehicle, and the first measurement signal is an ultrasonic signal. The specific expression form of the aforementioned ultrasonic signal can be referred to in Figure 3 Corresponding to the description in the embodiment.
[0258] 1003. The terminal device determines the sending time of the first measurement signal as the third time.
[0259] 1004. The vehicle determines the time of receiving the first measurement signal as the first time.
[0260] 1005. The vehicle sends a second measurement signal to the terminal device through the target speaker.
[0261] In the embodiment of the present application, after both the vehicle and the terminal device start the in-vehicle position sensing operation, the vehicle will also send a second measurement signal to the terminal device through the target speaker, and correspondingly, the terminal device also receives the second measurement signal. The second measurement signal is an ultrasonic signal. The specific expression form of the ultrasonic signal can be found in Figure 3 Corresponding to the description in the embodiment.
[0262] 1006. The vehicle determines the time for sending the second measurement signal as the second time.
[0263] 1007. The terminal device determines the reception time of the second measurement signal as the fourth time.
[0264] It should be noted that steps 1002 to 1004 may be performed first, and then steps 1005 to 1007; steps 1005 to 1007 may also be performed first, and then steps 1002 to 1004. The embodiment of the present application does not limit the order in which the terminal device sends the first measurement signal and the vehicle sends the second measurement signal. If the terminal device sends the first measurement signal first, the vehicle sends the second measurement signal after receiving the first measurement signal; if the vehicle sends the second measurement signal first, the terminal device sends the first measurement signal after receiving the second measurement signal.
[0265] 1008. The vehicle or the terminal device determines the distance between the terminal device and the target audio device according to the first time, the second time, the third time, and the fourth time.
[0266] In the embodiment of the present application, after obtaining the first time, the second time, the third time and the fourth time, the vehicle or the terminal device can determine the distance between the terminal device and the target audio based on the two-end ranging algorithm according to the first time, the second time, the third time and the fourth time.
[0267] Specifically, in one case, if the terminal device first sends a first measurement signal to the vehicle, and the vehicle sends a second measurement signal to the terminal device after receiving the first measurement signal, step 1008 may include: the vehicle or the terminal device subtracts the first time from the second time to obtain a first time difference, subtracts the third time from the fourth time to obtain a second time difference, and then subtracts the first time difference from the second time difference to obtain a target time difference, where the target time difference is the duration of the ultrasonic signal propagating twice between the target sound and the terminal device. The vehicle or the terminal device generates the distance between the terminal device and the target sound according to the target time difference.
[0268] In another case, if the vehicle first sends the second measurement signal to the terminal device, and the terminal device sends the first measurement signal to the vehicle after receiving the second measurement signal, step 1008 may include: the vehicle or the terminal device subtracts the fourth time from the third time to obtain a third time difference, subtracts the second time from the first time to obtain a fourth time difference, and then subtracts the third time difference from the fourth time difference to obtain a target time difference, where the target time difference is the time length for the ultrasonic signal to propagate twice between the target sound and the terminal device. The vehicle or the terminal device generates the distance between the terminal device and the target sound according to the target time difference.
[0269] In an embodiment of the present application, since there may be a clock misalignment problem between the vehicle and the terminal device, the difference is calculated using two times obtained by the terminal, and the difference is calculated using two times obtained by the vehicle, thereby avoiding the error caused by the clock misalignment between the vehicle and the terminal device to obtain an accurate distance.
[0270] In the embodiment of the present application, based on the principle of steps 1002 to 1008, the vehicle or terminal device can obtain the distance between the terminal device and each speaker. Specifically, in one implementation, the vehicle and the terminal device repeatedly perform steps 1002 to 1008 at least once to obtain the distance between the terminal device and each speaker one by one.
[0271] In another implementation, in the process of the terminal device sending a measurement signal to the speaker, steps 1002 and 1003 may be performed only once, that is, the terminal device may send a first measurement signal to each speaker in the vehicle in the form of a broadcast, and correspondingly, each speaker in the vehicle receives the first measurement signal and records the time when the first measurement signal arrives at each of the at least two speakers mentioned above.
[0272] Regarding the process of a vehicle sending a measurement signal to a terminal device through a speaker, in one implementation, the vehicle can simultaneously send different ultrasonic signals (i.e., different measurement signals) to the terminal device through different speakers, and the terminal device can separately record the time when the measurement signal emitted by the speaker at each location arrives at the terminal device.
[0273] In another implementation, the vehicle may also send ultrasonic signals (ie, measurement signals) to the terminal device through each speaker one by one, and the terminal device may respectively record the time when the measurement signal emitted by the speaker at each position reaches the terminal device.
[0274] 1009. The vehicle or the terminal device determines target position information according to the distance between the terminal device and each of the at least two speakers, where the target position information is used to indicate the position of the terminal device inside the vehicle.
[0275] In an embodiment of the present application, in one implementation, after obtaining the distance between the terminal device and each of the at least two speakers, the vehicle or the terminal device can Figure 3 Corresponding to the principle in the embodiment, the target position information is determined. For specific implementation methods, see Figure 3 Corresponding to the description in the embodiment.
[0276] In another implementation, the vehicle or terminal device can draw a circle with each speaker as the center and the distance between each speaker and the terminal device as the radius, to obtain at least two circles corresponding to at least two speakers, and the intersection area of the at least two circles is the position where the terminal device is located inside the vehicle.
[0277] For a more intuitive understanding of this solution, please refer to Figure 7 , Figure 7 A schematic diagram of a method for obtaining a position provided in an embodiment of the present application. Figure 7In this example, the position of the terminal device inside the vehicle is measured by using speakers 1, 2, and 3. Figure 7 As shown, after obtaining the distances between the terminal device and the audio 1, the audio 2, and the audio 3, the vehicle or the terminal device draws a circle with the audio 1 as the center and the distance between the terminal device and the audio 1 as the radius; draws a circle with the audio 2 as the center and the distance between the terminal device and the audio 2 as the radius; draws a circle with the audio 3 as the center and the distance between the terminal device and the audio 3 as the radius; the vehicle or the terminal device Figure 7 The shaded area in (i.e., the intersection of the three circles) is determined as the location of the terminal device inside the vehicle. Figure 7 In the case of a terminal device located in the main driving position inside the vehicle, it should be understood that Figure 7 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0278] It should be noted that the location of the audio system in the vehicle and the purpose of the target location information can be found in Figure 3 The description in the corresponding embodiment is not repeated here.
[0279] In an embodiment of the present application, another solution for measuring the position of a user relative to a vehicle is provided, which can improve the implementation flexibility of the present solution; the position of a terminal device relative to the vehicle is measured using ultrasonic signals, which is conducive to obtaining accurate target position information, and because the user cannot perceive the ultrasonic signal, the user is accurately positioned relative to the vehicle without the user being aware of it.
[0280] 3. Generate the location of the terminal device outside the vehicle without obtaining the distance between the terminal device and the speaker
[0281] For details, please refer to Figure 8a , Figure 8a A flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0282] 1201. The vehicle and the terminal device initiate an off-vehicle location sensing operation.
[0283] In the embodiments of the present application, in some application scenarios, during the operation of the vehicle, when the vehicle determines that it needs to know the location of the terminal device outside the vehicle, it will start the outside-vehicle position sensing operation and send an indication message to the terminal device. The aforementioned indication message is used to instruct the terminal device to start the outside-vehicle position sensing operation.
[0284] In other application scenarios, during the operation of the terminal device, when the terminal device determines that it needs to know the location of the terminal device outside the vehicle, it will start the outside vehicle position sensing operation and send an indication information to the vehicle. The above indication information is used to instruct the vehicle to start the outside vehicle position sensing operation.
[0285] The specific implementation methods of the above steps are Figure 3 The specific implementation method of step 301 in the corresponding embodiment is similar, that is, when the vehicle or the terminal device detects the trigger condition of the "out-of-vehicle position sensing operation", the specific implementation method of triggering the vehicle and the terminal device to start the out-of-vehicle position sensing operation can refer to the above Figure 3 The description of step 301 in the corresponding embodiment is different in that Figure 3 The “in-vehicle position sensing operation” in the corresponding embodiment is replaced by Figure 8a The specific implementation scheme of "outside vehicle position sensing operation" is not described here.
[0286] Trigger conditions for starting the vehicle's and terminal devices' outside-vehicle position sensing operations. As an example, when the vehicle or terminal device detects that the distance between the terminal device and the vehicle is less than a preset distance threshold, the outside-vehicle position sensing operation can be triggered to start. As another example, when the vehicle or terminal device detects that the terminal device is outside the vehicle, the outside-vehicle position sensing operation can be triggered to start. As another example, when the vehicle is parked, the outside-vehicle position sensing operation can be triggered to start, and so on. The specific scenarios in which the outside-vehicle position sensing operation will be triggered to start can be determined in combination with the actual product form, and will not be listed one by one here.
[0287] 1202. The vehicle sends a first ultrasonic signal to a terminal device via a first speaker.
[0288] 1203. The vehicle sends a second ultrasonic signal to the terminal device via a second speaker.
[0289] 1204. The vehicle sends a third ultrasonic signal to the terminal device via a third speaker.
[0290] 1205. The terminal device determines target position information according to a reception time of the first ultrasonic signal and a reception time of the second ultrasonic signal, where the target position information is used to indicate a position of the terminal device outside the vehicle.
[0291] In the embodiment of the present application, steps 1202 to 1205 are Figure 3 The specific implementation principles of steps 302 to 305 in the corresponding embodiment are consistent, and the specific implementation methods of steps 1202 to 1205 are the same as those of Figure 3 The specific implementation methods of 302 to 305 in the corresponding embodiment are similar, except that: Figure 3 In the corresponding embodiment, what is measured is "the position of the terminal device inside the vehicle". Fig.12 What is measured in the corresponding embodiment is "the position of the terminal device outside the vehicle".
[0292] For a more intuitive understanding of this solution, please refer to Figure 8b , Figure 8b A schematic diagram of the vehicle external position in the position acquisition method provided in the embodiment of the present application. As shown in the figure, Z1, Z2, Z3, Z4 and Z5 are 5 different positions outside the vehicle. The target position information in this embodiment is used to indicate that the terminal device is located at one of the positions outside the vehicle among Z1, Z2, Z3, Z4 and Z5. After the position of the audio inside the vehicle is fixed, the distance relationship between different positions outside the vehicle and each audio is different. Figure 3 The implementation principle of the corresponding embodiment is consistent. In this embodiment, the position of the terminal device outside the vehicle can also be determined according to the reception time of each ultrasonic signal. It should be understood that the position outside the vehicle can also be divided in other ways. Figure 8b The examples are only for the convenience of understanding the feasibility of this solution.
[0293] For the location of multiple speakers in the vehicle used to measure the specific location of the terminal device outside the vehicle, please refer to Figure 3 The descriptions in the corresponding embodiments will not be repeated here one by one.
[0294] That is, if the multiple speakers used to measure the specific position of the terminal device outside the vehicle include two speakers, the two speakers may be located on the left and right sides of the vehicle, respectively, or the two speakers may be located on the front and rear sides of the vehicle, respectively.
[0295] If the plurality of speakers used to measure the specific position of the terminal device outside the vehicle include at least three speakers, the at least three speakers are not located in a straight line.
[0296] If the multiple speakers used to measure the specific position of the terminal device outside the vehicle include four speakers, the aforementioned four speakers may be located at the left front position, the right front position, the left rear position and the right rear position in the vehicle respectively.
[0297] It should be noted that in Figure 3 In the corresponding embodiment, the at least two speakers used to measure the specific position of the terminal device inside the vehicle are generally speakers located inside the vehicle; Figure 8a In a corresponding embodiment, the at least two speakers used to measure the specific position of the terminal device outside the vehicle may both be speakers arranged outside the vehicle, or may both be speakers arranged inside the vehicle.
[0298] In the embodiment of the present application, not only the position of the terminal device inside the vehicle can be measured, but also the position of the terminal device outside the vehicle can be measured, which is conducive to expanding the application scenarios of the present solution.
[0299] 4. Generate the location of the terminal device outside the vehicle based on the distance between the terminal device and each speaker
[0300] For details, please refer to Fig. 9 , Fig. 9 A flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0301] 1301. The vehicle and the terminal device initiate an off-vehicle location sensing operation.
[0302] 1302. The vehicle receives a first measurement signal sent by a terminal device through a target speaker.
[0303] 1303. The terminal device determines the sending time of the first measurement signal as the third time.
[0304] 1304. The vehicle determines the time of receiving the first measurement signal as the first time.
[0305] 1305. The vehicle sends a second measurement signal to the terminal device through the target speaker.
[0306] 1306. The vehicle determines the time for sending the second measurement signal as the second time.
[0307] 1307. The terminal device determines the reception time of the second measurement signal as the fourth time.
[0308] 1308. The vehicle or the terminal device determines the distance between the terminal device and the target audio device according to the first time, the second time, the third time, and the fourth time.
[0309] 1309. The vehicle or the terminal device determines target position information according to the distance between the terminal device and each of the at least two speakers, where the target position information is used to indicate the position of the terminal device outside the vehicle.
[0310] In the embodiment of the present application, steps 1301 to 1309 are Figure 6 The specific implementation principles of steps 1001 to 1009 in the corresponding embodiment are consistent, and the specific implementation methods of steps 1301 to 1309 are the same as those in the embodiment of the present invention. Figure 6 The specific implementation methods of 1001 to 1009 in the corresponding embodiments are similar, except that: Figure 6 In the corresponding embodiment, what is measured is "the position of the terminal device inside the vehicle". Fig. 9In the corresponding embodiment, what is measured is "the position of the terminal device outside the vehicle". For the description of the position outside the vehicle, please refer to the above description of Fig. 9 The specific implementation methods of steps 1301 to 1309 will not be described one by one here.
[0311] 5. Application scenarios based on the specific location of the terminal device
[0312] Optionally, in an application scenario, the target location information of the terminal device inside the vehicle is used to determine the terminal device's control authority over the vehicle, and terminal devices located at different locations have different control authorities over the vehicle.
[0313] As an example, the control rights of the terminal device located at the front passenger seat to the vehicle may include: adjusting the front passenger seat angle, adjusting the air conditioning temperature, adjusting the volume of the headrest at the front passenger seat, and adjusting the brightness of the front lights; optionally, the resident terminal device at the front passenger seat can also switch music. The control rights of the terminal device located at the right rear seat to the vehicle may include: adjusting the rear seat temperature, adjusting the brightness of the rear lights, and adjusting the volume of the headrest at the right rear seat. It should be understood that the examples here are only for the convenience of understanding this solution.
[0314] For a more intuitive understanding of this solution, please refer to Fig.10 , Fig.10 A schematic diagram of the control authority of terminal devices located at different locations in the location acquisition method provided in an embodiment of the present application. Fig.10 It includes two sub-schematic diagrams (a) and (b). Fig.10 The sub-schematic diagram (a) shows the control authority of the terminal device located at the co-pilot seat over the vehicle. Fig.10 The sub-schematic diagram (b) shows the control authority of the terminal device located at the left rear seat over the vehicle, such as Fig.10 As shown, the functions supported by the terminal device located at the front passenger seat may include: music switching, turning on and adjusting the air conditioner at the front passenger seat, adjusting the heating temperature of the front passenger seat, and turning on or off the smart aromatherapy machine, etc. The functions supported by the terminal device located at the right rear seat may include: music switching, adjusting the heating temperature of the rear seat, and turning on or off the smart aromatherapy machine, etc., which are not exhaustive here, that is, the terminal devices located at different positions in the car have different control rights over the vehicle. It should be understood that the examples here are only for the convenience of understanding this solution and are not used to limit this solution.
[0315] Specifically, after obtaining its own target location information, the target terminal device inside the vehicle (that is, any terminal device inside the vehicle) can send the target location information of the target terminal device to the vehicle, and the vehicle can send the permission information corresponding to the in-vehicle location of the target terminal device to the target terminal device. After receiving the permission information, the target terminal device can output prompt information, which is used to remind the operator of the target terminal device of the control authority of the vehicle. The specific prompt information message can be determined in combination with the actual product and is not limited here.
[0316] For a more intuitive understanding of this solution, please refer to Fig.11 , Fig.11 A schematic diagram of the control authority of terminal devices located at different locations in the location acquisition method provided in an embodiment of the present application. Fig.11 The sub-diagram (b) of Fig.10 The description of the sub-schematic diagram (a) can be understood. Fig.11 It includes two sub-schematic diagrams (a) and (b). Fig.11 A1 in the sub-diagram (a) of FIG. 1 represents the prompt information output by the target terminal device. When the user clicks A1, the user enters the Fig.11 (b) sub-diagram of Fig.11 The vehicle is controlled by the sub-schematic diagram (b) of FIG. 1 . It should be noted that in other implementations, Fig.11 In the interface shown in the sub-diagram (a) of FIG. 1 , the user can hold the terminal device to perform a preset operation. Correspondingly, the terminal device can trigger the entry when the terminal device's movement trajectory is a preset trajectory through the built-in inertial measurement unit (IMU). Fig.11 The preset operation can be shake or other operations, etc. Fig.11 (a) Sub-diagram of the entry Fig.11 The method of the sub-schematic diagram (b) can be flexibly set according to the actual product form. The example given here is only an example to facilitate the understanding of this solution and is not used to limit this solution.
[0317] In another application scenario, the target location information is used to indicate whether the terminal device is located at the main driving position of the vehicle. Specifically, after obtaining its own target location information, the target terminal device inside the vehicle (that is, any terminal device inside the vehicle) can send the target location information of the target terminal device to the vehicle, so that the vehicle can know the in-vehicle location of each terminal device inside the vehicle, that is, the vehicle can know which terminal device inside the vehicle is the terminal device located at the main driving position.
[0318] Optionally, the vehicle can project the screen content of the terminal device at the main driving position onto the vehicle's central control screen. Furthermore, when the screen content of the terminal device at the main driving position is projected onto the vehicle's central control screen, the content displayed on the vehicle's central control screen may not be exactly the same as the screen content of the terminal device. The content displayed on the central control screen may be an application that has been configured for the vehicle and multiple applications in the terminal device. That is, when the vehicle is not connected to the terminal device at the main driving position, it has its own user interface (UI). After the vehicle is connected to the terminal device at the main driving position, the icons of the application programs on the vehicle's UI interface may increase, or the vehicle's functions may increase, but the vehicle's UI interface may not change significantly.
[0319] It should be noted that the above screen projection operation can only be performed after the terminal device has been paired with the vehicle.
[0320] For a more intuitive understanding of this solution, please refer to Fig.12 and Fig.13 , Fig.12 A schematic diagram of screen projection for a terminal device located at a main driving position in the position acquisition method provided in an embodiment of the present application. Fig.12 There are two sub-diagrams (a) and (b). Please refer to Fig.12 In the sub-schematic diagram (a), if the terminal device at the main driving position has never been paired with the vehicle, the vehicle will send an inquiry message to the aforementioned terminal device, and the terminal device can output the inquiry message, which is used to inquire whether to connect with the vehicle (that is, pair with the vehicle). Fig.12 In the (a) sub-diagram, the query information is output in the form of voice and text box. If the user instructs the terminal device to connect to the vehicle in the form of voice, it will trigger the entry Fig.12 (b) sub-diagram of Fig.12 (b) Sub-schematic diagram of Fig.12 The sub-schematic diagram (b) of FIG. 1 shows a schematic diagram of the terminal device side and the vehicle side when the terminal device is connected to the vehicle. It should be understood that the schematic diagram when the specific terminal device is connected to the vehicle should be flexibly set in combination with the example application product. Fig.12 The example in is only an example to facilitate understanding of the present solution and is not intended to limit the present solution.
[0321] Furthermore, if the terminal device located at the main driving position exchanges positions with the terminal device located at the co-pilot position, the vehicle will determine whether the updated terminal device located at the main driving position has been paired with the vehicle. If the judgment result is yes, the screen content of the updated terminal device will be projected onto the vehicle's central control screen; if the judgment result is no, a pairing request will be sent to the updated terminal device to always keep the screen content of the terminal device located at the main driving position displayed on the vehicle's central control screen.
[0322] For a more intuitive understanding of this solution, please refer to Fig.13 , Fig.13 A schematic diagram of screen projection for a terminal device located at a main driving position in the position acquisition method provided in an embodiment of the present application. Fig.13 Includes two sub-diagrams, left and right. Fig.13 In the left sub-schematic diagram, B1 is displayed on the screen of the terminal device located at the main driving position, and B2 is displayed on the screen of the terminal device located at the co-pilot position; B1 is displayed on the screen of the vehicle, indicating that the terminal device located at the main driving position (that is, the terminal device pointed to by B1) is being projected through the central control screen of the vehicle.
[0323] See also Fig.13 In the right sub-schematic diagram, B2 is displayed on the screen of the terminal device located at the main driving position, and B1 is displayed on the screen of the terminal device located at the co-pilot position; B2 is displayed on the screen of the vehicle, which means that the terminal device located at the main driving position (that is, the terminal device pointed to by B2) is being projected through the central control screen of the vehicle. It should be understood that the examples given here are only for the convenience of understanding this solution and are not used to limit this solution.
[0324] In another application scenario, when the terminal device is connected to the vehicle, the target location information is used for the vehicle to determine the vehicle-mounted device that is closest to the terminal device. Further, as an example, when the terminal device needs to perform a screen projection operation through the vehicle, the target location information is used to determine the screen that is closest to the terminal device. As another example, when the terminal device is a wireless headset, the target location information is used to determine the screen that is closest to the wireless headset; optionally, the target location information is used to establish a communication connection between the wireless headset and the nearest screen.
[0325] The embodiments of the present application provide multiple application scenarios of target location information, thereby improving the implementation flexibility of the solution.
[0326] exist Figures 1a to 13 On the basis of the corresponding embodiments, in order to better implement the above solutions of the embodiments of the present application, the following also provides related devices for implementing the above solutions. Fig.14a , Fig.14aA structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 1400 is applied to a vehicle, the vehicle is included in a position acquisition system, the position acquisition system also includes a terminal device, the vehicle is configured with at least two speakers, the at least two speakers include a first speaker and a second speaker, the first speaker and the second speaker are located on both sides of the vehicle. The position acquisition device 1400 includes: a sending module 1401, which is used to send a first ultrasonic signal through a first speaker, the first ultrasonic signal is used for the terminal device to determine the reception time of the first ultrasonic signal, and the reception time of the first ultrasonic signal is the time when the terminal device receives the first ultrasonic signal; the sending module 1401 is also used to send a second ultrasonic signal through a second speaker, the second ultrasonic signal is used for the terminal device to determine the reception time of the second ultrasonic signal, the reception time of the second ultrasonic signal is the time when the terminal device receives the second ultrasonic signal, the reception time of the first ultrasonic signal and the reception time of the second ultrasonic signal are used to determine the target position information, and the target position information indicates the position of the terminal device relative to the vehicle.
[0327] In one possible design, the sending module 1401 is specifically used to send a second ultrasonic signal through a second speaker while sending a first ultrasonic signal through a first speaker. The first ultrasonic signal and the second ultrasonic signal are different ultrasonic signals, and the order in which the first ultrasonic signal and the second ultrasonic signal arrive at the terminal device is used to determine the target position information.
[0328] In one possible design, the sending module 1401 is specifically used to first send a first ultrasonic signal through a first speaker, and after a preset time interval, send a second ultrasonic signal through a second speaker. The receiving time of the first ultrasonic signal, the receiving time of the second ultrasonic signal and the preset time interval are used to determine the target position information.
[0329] In a possible design, the at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0330] In a possible design, the at least three speakers include four speakers, and the four speakers are respectively located at a left front position, a right front position, a left rear position, and a right rear position in the vehicle.
[0331] In one possible design, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0332] In one possible design, the position inside the vehicle is the left side of the vehicle or the right side of the vehicle; or, the position inside the vehicle is the front side of the vehicle or the rear side of the vehicle; or, the position inside the vehicle is any one of the positions inside the vehicle including the driver's seat, the co-driver's seat, the left side of the rear row, the right side of the rear row, or the middle of the rear row; or, there are N positions in total inside the vehicle, and the position inside the vehicle is a target position among the N positions, and N is greater than 5.
[0333] In one possible design, the target location information is used to determine the terminal device's control authority over the vehicle, and terminal devices located at different locations have different control authority over the vehicle; or, the target location information is used to indicate whether the terminal device is located at the vehicle's main driving position; or, when the terminal device is connected to the vehicle, the target location information is used for the vehicle to determine the on-board device that is closest to the terminal device.
[0334] In one possible design, see Fig.14b , Fig.14b Another structural schematic diagram of the position acquisition device provided in the embodiment of the present application. The sending module 1401 is also used to send a first indication message to the terminal device when the vehicle starts the position sensing operation, and the first indication message is used to instruct the terminal device to start the position sensing operation, and the position sensing operation is an operation for obtaining target position information; the position acquisition device 1400 also includes a receiving module 1402, which is used to receive a first feedback message sent by the terminal device, and the first feedback message is used to instruct the vehicle to send a first ultrasonic signal and a second ultrasonic signal. Alternatively, the receiving module 1402 is also used to receive a second indication message sent by the terminal device, and start the position sensing operation in response to the received second indication message; the sending module 1401 is also used to send a second feedback message to the terminal device, and the second feedback message is used to instruct the terminal device to receive the first ultrasonic signal and the second ultrasonic signal.
[0335] It should be noted that the information interaction, execution process, etc. between the modules / units in the location acquisition device 1400 are the same as those in the present application. Figure 3 and Figure 8a The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0336] The present application embodiment also provides another device for obtaining a position, see Fig.15 , Fig.15Another structural schematic diagram of the position acquisition device provided in the embodiment of the present application. The position acquisition device 1500 is applied to a terminal device, and the terminal device is included in a position acquisition system. The position acquisition system also includes a vehicle, and the vehicle is equipped with at least two speakers, and the at least two speakers include a first speaker and a second speaker, and the first speaker and the second speaker are located on different sides of the vehicle. The position acquisition device 1500 includes: a receiving module 1501, which is used to receive a first ultrasonic signal sent by a first speaker; the receiving module 1501 is also used to receive a second ultrasonic signal sent by a second speaker; a determining module 1502, which is used to determine the target position information according to the receiving time of the first ultrasonic signal and the receiving time of the second ultrasonic signal, and the target position information indicates the position of the terminal device relative to the vehicle.
[0337] In one possible design, the determination module 1502 is specifically used to determine the order in which the first ultrasonic signal and the second ultrasonic signal arrive at the terminal device according to the receiving time of the first ultrasonic signal and the receiving time of the second ultrasonic signal when the first ultrasonic signal and the second ultrasonic signal are sent simultaneously; and determine the target position information according to the order in which the first ultrasonic signal and the second ultrasonic signal arrive at the terminal device.
[0338] In one possible design, the determination module 1502 is specifically used to determine the target position information based on the reception time of the first ultrasonic signal, the reception time of the second ultrasonic signal and a preset time interval, where the preset time interval is the time interval between sending two adjacent ultrasonic signals.
[0339] In a possible design, the at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0340] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 1500 are the same as those in the present application. Figure 3 and Figure 8a The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0341] The present application embodiment also provides another device for obtaining a position, see Fig.16 , Fig.16Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 1600 is applied to a vehicle, the vehicle is included in the position acquisition system, the position acquisition system also includes a terminal device, at least two speakers are configured in the vehicle, at least two speakers are configured on both sides of the vehicle, and the target speaker is any one of the at least two speakers. The position acquisition device 1600 includes: a receiving module 1601, which is used to receive a first measurement signal sent by the terminal device through the target speaker, and determine the time of receiving the first measurement signal as the first time; a sending module 1602, which is used to send a second measurement signal to the terminal device through the target speaker, and determine the time of sending the second measurement signal as the second time, the first measurement signal and the second measurement signal are both ultrasonic signals; a determination module 1603, which is used to determine the distance between the terminal device and the target speaker according to the first time, the second time, the third time and the fourth time, wherein the third time is the time when the terminal device sends the first measurement signal, and the fourth time is the time when the terminal device receives the second measurement signal; the determination module 1603 is also used to determine the target position information according to the distance between the terminal device and each of the at least two speakers, and the target position information indicates the position of the terminal device relative to the vehicle.
[0342] In a possible design, the at least two speakers include at least three speakers, and the at least three speakers are not located in a straight line.
[0343] In one possible design, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0344] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 1600 are the same as those in the present application. Figure 6 and Fig. 9 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0345] The present application embodiment also provides another device for obtaining a position, see Fig.17 , Fig.17Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 1700 is applied to a terminal device, the terminal device includes a position acquisition system, the position acquisition system also includes a vehicle, at least two speakers are configured in the vehicle, at least two speakers are configured at different positions of the vehicle, and the target speaker is any one of the at least two speakers. The position acquisition device 1700 includes: a sending module 1701, which is used to send a first measurement signal to the target speaker, and determine the sending time of the first measurement signal as a third time; a receiving module 1702, which is used to receive a second measurement signal sent by the target speaker, and determine the receiving time of the second measurement signal as a fourth time, and the first measurement signal and the second measurement signal are both ultrasonic signals; a determination module 1703, which is used to determine the distance between the terminal device and the target speaker according to the first time, the second time, the third time and the fourth time, wherein the first time is the time when the vehicle receives the first measurement signal, and the second time is the time when the vehicle sends the second measurement signal; the determination module 1703 is also used to determine the target position information according to the distance between the terminal device and each of the at least two speakers, and the target position information indicates the position of the terminal device relative to the vehicle.
[0346] In one possible design, the target location information is used to indicate the location of the terminal device inside the vehicle; or, the target location information is used to indicate the location of the terminal device outside the vehicle.
[0347] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 1700 are the same as those in the present application. Figure 6 and Fig. 9 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0348] Referring to the following second embodiment, a part of the embodiments provided in the second embodiment of the present application is used to detect whether the terminal device is located inside or outside the vehicle; another part of the embodiments is used to detect where the terminal device is located outside the vehicle.
[0349] Embodiment 2
[0350] In the embodiments of this application, please refer to Fig.18 , Fig.18 A flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0351] 2001. When the vehicle detects that a first trigger condition is met and / or the terminal device detects that a second trigger condition is met, the vehicle and the terminal device initiate a first location sensing operation.
[0352] In the embodiments of the present application, in some application scenarios, when the vehicle detects that the first trigger condition is met, it will start the first position sensing operation and send an indication message to the terminal device, the indication message is used to instruct the terminal device to start the first position sensing operation, and the first position sensing operation is used to measure whether the terminal device is located inside or outside the vehicle. It should be noted that the steps executed by the vehicle in the second embodiment can be specifically executed by a processor in the vehicle, or by a vehicle auxiliary device in the vehicle, which is determined in combination with the actual product form and will not be explained later.
[0353] Among them, when the vehicle detects any one or more of the following situations, it is deemed that the first trigger condition is detected to be met: the vehicle detects that the vehicle has stopped; or the vehicle detects that the distance between the terminal device and the vehicle meets the first distance condition; or the vehicle obtains a first instruction, and the first instruction is used to trigger the vehicle to obtain the first position information.
[0354] In the embodiments of the present application, a variety of specific expressions of the first trigger condition are provided, which expands the application scenarios of the present solution and improves the implementation flexibility of the present solution.
[0355] For the scenario of vehicle detection and vehicle parking. Specifically, the vehicle auxiliary equipment in the vehicle can be configured with various types of inertial measurement units, so that the vehicle auxiliary equipment can use GPS or other sensors to measure the speed of the vehicle, use an accelerometer to measure the acceleration of the vehicle, and use a gyroscope to measure the angular velocity of the vehicle. The vehicle auxiliary equipment in the vehicle inputs the speed, acceleration and angular velocity of the vehicle into the classification model to obtain the predicted category information output by the classification model.
[0356] The classification model is a model that has been trained, and the classification model can be specifically represented by a neural network or a non-neural network model. For example, the classification model can be specifically represented by a decision tree, a random forest, an extremely random tree, a support vector machine, a K-nearest neighbor (KNN) model, a logistic regression model, or other types of classification models, which are not exhaustive here.
[0357] The predicted category information indicates that the vehicle is in a stopped state or a moving state; in one implementation, the predicted category information output by the classification model may include a first probability value and a second probability value, the first probability value is used to indicate the probability that the vehicle is in a stopped state, and the second probability value is used to indicate the probability that the vehicle is in a moving state; as an example, for example, the predicted category information includes 0.3 (also the first probability value) and 0.7 (also the second probability value), 0.3 is used to indicate that the probability that the vehicle is in a stopped state is 0.3, and 0.7 is used to indicate that the probability that the vehicle is in a moving state is 0.7, then the predicted category information indicates that the vehicle is in a moving state. In another implementation, the predicted category information output by the classification model may be a first value or a second value, when the predicted category information output by the classification model is the first value, it represents that the vehicle is in a stopped state, and when the predicted category information output by the classification model is the second value, it represents that the vehicle is in a moving state, as an example, for example, the first value is 0, the second value is 1, etc. The examples here are only for the convenience of understanding this solution and are not used to limit this solution.
[0358] In an embodiment of the present application, the speed, acceleration and angular velocity of the vehicle are input into a classification model to determine whether the vehicle is in a stopped state or a moving state through the classification model, thereby avoiding obtaining the state of the vehicle from the vehicle's control system and ensuring the independence of the vehicle's control system during the measurement of the target position information of the terminal device, which is beneficial to improving the safety of the vehicle's operation process.
[0359] For the scenario where the vehicle detects the distance between the terminal device and the vehicle. Specifically, in one implementation, both the vehicle and the terminal device can be configured with Bluetooth, and the vehicle can send Bluetooth signals outward in the form of broadcasting. After the terminal device receives the Bluetooth signal sent by the vehicle, it can calculate the actual distance between the terminal device and the vehicle. In another implementation, the terminal device can also send Bluetooth signals outward, and after the vehicle receives the Bluetooth signal sent by the terminal device, it calculates the actual distance between the terminal device and the vehicle. In another implementation, the vehicle and the terminal device can also use wireless communication technology (WIFI) to calculate the actual distance between the terminal device and the vehicle, etc. The methods for obtaining the actual distance between the vehicle and the terminal device are not exhaustively enumerated here.
[0360] The vehicle determines whether the distance between the terminal device and the vehicle satisfies a first distance condition; wherein the first distance condition may be whether the distance between the terminal device and the vehicle is less than a preset distance, and the value of the preset distance may be 5 meters, 3 meters, 2 meters, 1 meter or other values, etc., which are not limited here. Alternatively, the first distance condition may be that the distance between the terminal device and the vehicle gradually decreases until the preset distance is satisfied.
[0361] Regarding the scenario where the vehicle obtains the first instruction. Specifically, in some implementations, the user can interact with the vehicle through vehicle auxiliary equipment and / or the onboard computer. When the vehicle obtains a preset operation input by the user, it can trigger the vehicle to generate the first instruction. The preset operation includes but is not limited to a request operation to obtain a list of terminal devices in the vehicle, a request operation to switch a terminal device connected to the vehicle, or other types of operations, etc.
[0362] In some other implementations, the vehicle may receive indication information sent by the terminal device, where the indication information is used to request to obtain the first location information of the terminal device, and the vehicle generates a first instruction in response to the received indication information.
[0363] It should be noted that when the vehicle detects other events, it can also be regarded as triggering the first trigger condition. The specific events included in the first trigger condition need to be flexibly set in combination with the actual application scenario, and are not limited here.
[0364] In other application scenarios, when the terminal device detects that the second trigger condition is met, it will initiate a first location sensing operation and send an indication message to the vehicle. The indication message is used to instruct the vehicle to initiate the first location sensing operation. The first location sensing operation is used to measure whether the terminal device is inside or outside the vehicle.
[0365] Among them, when the terminal device detects any one or more of the following situations, it is deemed that the second trigger condition is detected: the terminal device detects that the vehicle has stopped; or the terminal device detects that the distance between the terminal device and the vehicle satisfies the first distance condition; or the terminal device detects that the displacement of the terminal device meets the preset displacement; or the terminal device obtains a second instruction, and the second instruction is used to trigger the terminal device to obtain the first location information.
[0366] For the scenario where the terminal device detects vehicle parking, specifically, a classification model can be pre-configured on the terminal device, and after the vehicle speed, acceleration and angular velocity are acquired, they can be sent to the terminal device, and the terminal device inputs the vehicle speed, acceleration and angular velocity into the classification model to obtain the predicted category information output by the classification model; the specific meaning of the classification model and the predicted category information can be found in the above description, which will not be elaborated here.
[0367] For the scenario where the terminal device detects the distance between the terminal device and the vehicle, the specific implementation method of the terminal device is similar to the specific implementation method of the scenario where the vehicle detects the distance between the terminal device and the vehicle. Please refer to the above description and will not be repeated here.
[0368] For the scenario where the terminal device detects that the displacement of the terminal device meets the preset displacement. Specifically, at least one type of IMU can be pre-configured on the terminal device, and the terminal device can obtain the displacement of the terminal device in the horizontal direction and / or vertical direction through the IMU, and judge whether the displacement of the terminal device in the horizontal direction and / or vertical direction meets the preset displacement. If the judgment result is yes, it is determined that the second trigger condition is met.
[0369] The preset displacement may be that the displacement of the terminal device in the horizontal direction is greater than or equal to the preset threshold; or, the preset displacement may be that the displacement of the terminal device in the vertical direction is greater than or equal to the preset threshold; or, the preset displacement may include that the displacement of the terminal device in the horizontal direction is greater than or equal to the preset threshold, and the displacement of the terminal device in the vertical direction is greater than or equal to the preset threshold. When it is detected that the displacement of the terminal device meets the preset displacement, it means that the terminal device may have a boarding or alighting event. The specific preset displacement setting can be flexibly determined according to the actual situation and is not limited in detail here.
[0370] Regarding the scenario where the vehicle obtains the second instruction. Specifically, the terminal device can receive the instruction information sent by He Liang, the aforementioned instruction information is used to request the first location information of the terminal device, and the vehicle generates the second instruction in response to the received aforementioned instruction information. The terminal device can also obtain the second instruction in other scenarios, which are not listed here one by one.
[0371] It should be noted that when the terminal device detects other events, it can also be regarded as triggering the second trigger condition. The specific events included in the second trigger condition need to be flexibly set in combination with the actual application scenario and are not limited here.
[0372] 2002. The vehicle sends at least one target audio signal to a terminal device.
[0373] In an embodiment of the present application, after both the vehicle and the terminal device have started the first position sensing operation, the vehicle can send at least one target audio signal to the terminal device through the audio. Among them, the target audio signal can be an ultrasonic signal, and the frequency band of the ultrasonic signal can be 17KHZ-48KHZ. Optionally, the frequency band of the target audio signal can be 17KHZ-22KHZ. The frequency of the specific target audio signal can be determined in combination with the actual application product, which is not limited here. As an example, for example, the target audio signal can be a linear frequency modulation (Chirp) signal, a ZC (zadoff–chu) sequence signal, or other types of audio signals, etc., which are not exhaustive here.
[0374] Furthermore, the formula of Chirp signal in the time domain is as follows: Among them, φ0 is the initial phase difference, f0 is the starting frequency, and c is a constant.
[0375] The specific formula of the ZC sequence signal in the time domain is: Among them, j is an imaginary number, and the square of j is equal to -1; 0 <u<N ZC , gcd(N zc ,u)=1,c f =N ZC mod 2, N ZC is the signal length of the ZC sequence signal, and the value of q is an integer.
[0376] The above-mentioned audio system may be a audio system arranged at any position inside the vehicle, for example, at the upper left corner, upper right corner, lower left corner, lower right corner or other positions; optionally, if the vehicle is equipped with vehicle auxiliary equipment, the above-mentioned audio system may also be an audio system on the vehicle auxiliary equipment.
[0377] For a more intuitive understanding of this solution, please refer to Fig.19 , Fig.19 A schematic diagram of a sound in the method for obtaining a position provided in an embodiment of the present application, Fig.19 Taking the vehicle auxiliary equipment as an example, the vehicle can measure whether the terminal device is located inside or outside the vehicle through the audio configured on the vehicle smart screen. It should be understood that Fig.19 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0378] In the embodiment of the present application, since the linear frequency modulation signal or the ZC sequence signal is an energy-intensive signal, selecting the linear frequency modulation signal or the ZC sequence signal as the target audio signal is beneficial to accurately estimate at least one arrival time corresponding to each target audio signal, thereby facilitating obtaining accurate first position information.
[0379] Specifically, in one implementation, the vehicle uses a broadcasting method to send multiple target audio signals through a speaker at a first preset frequency. The first preset frequency may be that the vehicle sends a target audio signal every d sampling points. For example, the value of d may be 880, 1320, 1760 or other values, and may be flexibly set in combination with actual scenarios.
[0380] Multiple target audio signals include a first detection signal and a second detection signal. At least one arrival time corresponding to the target audio signal may include a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal. The first time set includes at least one time when the first detection signal arrives at the terminal device through direct radiation and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the terminal device through direct radiation and / or reflection. The latest time in the first time set and the earliest time in the second time set can be used to determine the first position information.
[0381] In another implementation, the vehicle sends one or more target audio signals through the audio system, wherein each target audio signal is used to determine a target time set corresponding to the target audio signal, the target time set includes at least one time when the target audio signal reaches the terminal device through direct and / or reflection, and the earliest time and the latest time in the target time set can be used to determine the first position information.
[0382] 2003. The terminal device obtains at least one arrival time corresponding to at least one target audio signal, where the at least one arrival time corresponding to one target audio signal includes the time when the target audio signal reaches the terminal device through direct radiation and / or reflection.
[0383] In an embodiment of the present application, in one case, when a vehicle uses broadcasting to send one or more target audio signals through an audio system at a first preset frequency, the terminal device can obtain at least one arrival time corresponding to each target audio signal within a preset time period, and at least one arrival time corresponding to a target audio signal includes the time it takes for the target audio signal to reach the terminal device through direct radiation and / or reflection.
[0384] Specifically, the terminal device may pre-store parameter information of the target audio signal, such as the frequency band of the target audio signal, the amplitude, intensity or other parameter information of the target audio signal, etc. After each target audio signal reaches the terminal device through direct radiation and / or reflection, the terminal device may filter the received audio signal through a bandpass filter to obtain a filtered signal, and the frequency band of the filtered signal is consistent with the frequency band of the target audio signal.
[0385] The terminal device obtains a matching curve between the filtered signal and the target audio signal through a matched filter according to the filtered signal, and the matching curve is used to indicate at least one arrival time corresponding to each target audio signal.
[0386] The horizontal axis of the matching curve is time, which can be measured by sampling points or seconds; the vertical axis of the matching curve can be the impulse response of the filtered signal at each time point. Each peak exceeding the preset peak threshold in the multiple peaks included in the matching curve is considered to be a target audio signal received by the terminal device, and each sampling point corresponding to the peak exceeding the preset peak threshold is considered to be an arrival time corresponding to a target audio signal.
[0387] Furthermore, the preset peak threshold can be any one of the following: in the matching curve, the maximum peak value *a within d sampling points (that is, within the sending period of a target audio signal), and the value range of a is 0.5-1; or, in the matching curve, the average value *b of all values in the vertical axis direction within d sampling points (that is, within the sending period of a target audio signal), and the value range of b is 5-10; or the preset peak threshold can also be set to other values. The value of the preset peak threshold can be flexibly set in combination with the actual product form. The examples here are only for the convenience of understanding this solution and are not used to limit this solution.
[0388] For a more intuitive understanding of this solution, please refer to Fig. 20 , Fig. 20 A schematic diagram of a matching degree curve in the location acquisition method provided in an embodiment of the present application, Fig. 20 In the example, 5 target audio signals are shown to reach the terminal device through direct and reflected signals, and the preset peak threshold is the maximum peak value *a within the transmission cycle of a target audio signal. Since each target audio signal may reach the terminal device through direct and / or reflected signals, after the vehicle transmits a target audio signal, the terminal device may receive one or more target audio signals. Fig. 20 In the example, each time a vehicle sends a target audio signal, the terminal device can receive a target audio signal. Then the terminal device can obtain an arrival time corresponding to each audio signal. It should be understood that Fig. 20 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0389] In another case, since the vehicle sends the target audio signal through the audio system inside the vehicle, if the doors and all windows are closed and the terminal device is outside the vehicle and far away from the vehicle, the target audio signal sent by the vehicle may not be able to reach the terminal device, that is, the terminal device cannot collect any target audio signal within the preset time. Specifically, if the terminal device can obtain zero arrival times corresponding to each target audio signal within the preset time, the terminal device can generate first location information corresponding to the terminal device. The first location information in this application scenario is used to indicate that the terminal device is outside the vehicle; optionally, the terminal device can send the generated first location information to the vehicle.
[0390] The preset duration may range from 100ms to 20000ms. For example, the preset duration may be 200ms, 400ms, 600ms or other values, which are not exhaustive. The specific implementation method of the terminal device obtaining the arrival time corresponding to each target audio signal can refer to the above description.
[0391] 2004. The terminal device generates first location information corresponding to the terminal device according to at least one arrival time, where the first location information is used to indicate whether the terminal device is located inside or outside the vehicle.
[0392] In the embodiment of the present application, after obtaining at least one arrival time corresponding to each target audio signal, the terminal device can directly generate the first position information corresponding to the terminal device according to the at least one arrival time corresponding to each target audio signal. Optionally, the terminal device can also send the at least one arrival time corresponding to each target audio signal to the vehicle, and the vehicle generates the first position information corresponding to the terminal device.
[0393] To understand the principle of this solution more intuitively, please refer to Fig.21 , Fig.21 Two schematic diagrams of matching degree curves in the location acquisition method provided in the embodiments of the present application. Fig.21 It includes two sub-schematic diagrams (a) and (b). Fig.21 The sub-schematic diagram (a) is a schematic diagram showing a matching degree curve obtained by the terminal device after three target audio signals emitted by the vehicle at a first preset frequency reach the terminal device when the terminal device is located inside the vehicle; Fig.21 Sub-schematic diagram (b) shows a schematic diagram of a matching degree curve obtained by the terminal device after three target audio signals emitted by the vehicle at a first preset frequency reach the terminal device when the terminal device is located outside the vehicle. Fig.21 (a) Sub-diagram and Fig.21In the sub-schematic diagram (b), the sampling point is used as the time measurement unit, and the preset peak threshold is the maximum peak value *a within a sending period of a target audio signal.
[0394] After the vehicle sends out a target audio signal, the target audio signal may reach the terminal device in a direct manner, or it may reach the terminal device after being reflected by the surrounding environment. Since the space inside the vehicle is relatively small and closed, Fig.21 As shown in the sub-schematic diagram (a) of FIG. 1 , when the terminal device is located inside the vehicle, at least one arrival time corresponding to a target audio signal is relatively concentrated. However, the space outside the vehicle is relatively open. Fig.21 As shown in the sub-schematic diagram (b) of FIG. 1 , when the terminal device is located outside the vehicle, the multiple arrival times corresponding to a target audio signal are relatively dispersed. Therefore, after obtaining at least one arrival time corresponding to each target audio signal, the terminal device or the vehicle can determine whether the terminal device is located inside or outside the vehicle. It should be understood that Fig.21 The example in the figure is only an example to facilitate understanding of the implementation principle of this solution and is not used to limit this solution.
[0395] Specifically, in one implementation, at least one target audio signal includes multiple target audio signals emitted by the vehicle at a first preset frequency, the multiple target audio signals include a first detection signal and a second detection signal, the multiple arrival times corresponding to the multiple target audio signals include a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal arrives at the terminal device by direct radiation and / or reflection, the second time set includes at least one time when the second detection signal arrives at the terminal device by direct radiation and / or reflection, and the time interval between the arrival times in the first time set and the second time set is used to determine the first position information.
[0396] The time when the vehicle sends the first detection signal may be earlier than the time when the vehicle sends the second detection signal, or the time when the vehicle sends the first detection signal may be later than the time when the vehicle sends the second detection signal. The first time set and the second time set are adjacent on the matching curve corresponding to the multiple target audio signals, that is, the first detection signal and the second detection signal are two different target audio signals, and arrive at the terminal device adjacently.
[0397] Judgment conditions for the first location information. If the time interval between the arrival times in the first time set and the second time set is within the preset time range, the first location information indicates that the terminal device is located inside the vehicle, and the determining factors of the preset time range include the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first location information indicates that the terminal device is located outside the vehicle.
[0398] The time measurement unit used in the preset time range may include sampling points, milliseconds, seconds or other time measurement units, etc. As an example, the preset time range may be dc sampling points to d+e sampling points, where d sampling points are the time interval between two target audio signals sent by the vehicle. The values of c and e may be the same or different. As an example, the values of c and e are both related to the sampling rate when the received target audio signal is processed. As an example, the value of e may be 50 sampling points, and the value of c may be between 400 sampling points and 960 sampling points. c and e may also be other values, which need to be flexibly determined in combination with the actual application scenario, and are not exhaustively listed here.
[0399] In this implementation, the preset time range may be determined based on the time interval between two adjacent target audio signals sent by the vehicle, thereby providing a simple method for determining the preset time range.
[0400] Meaning of the time interval between the arrival times in the first time set and the second time set. In one case, the time interval between the arrival times in the first time set and the second time set includes: the first time interval between the latest time in the first time set and the earliest time in the second time set. Then step 2004 may include: the terminal device or vehicle generates the first location information according to the first time interval between the latest time in the first time set and the earliest time in the second time set.
[0401] More specifically, the terminal device or vehicle obtains a first time interval between the latest time in the first time set and the earliest time in the second time set, and determines whether the first time interval is within a preset time range. If the first time interval is within the preset time range, it is determined that the terminal device is located inside the vehicle; if the first time interval is not within the preset time range, it is determined that the terminal device is located outside the vehicle.
[0402] In an embodiment of the present application, a specific implementation method is provided for obtaining the first location information of the terminal device by utilizing the time interval between the arrival times in the first time set and the second time set. The method is simple to operate and easy to implement.
[0403] In another case, the time interval between the arrival times in the first time set and the second time set includes: the time interval between the middle time in the first time set and the earliest time in the second time set; in another case, the time interval between the arrival times in the first time set and the second time set includes: the time interval between the middle time in the first time set and the latest time in the second time set, etc. The time interval between the arrival times in the first time set and the second time set can also be specifically expressed as other meanings, etc., which can be flexibly set in combination with actual application products and are not limited here.
[0404] In another implementation, step 2004 may include: the terminal device or vehicle may obtain a target time set corresponding to each target audio signal, the target time set including at least one time when a target audio signal reaches the terminal device through direct radiation and / or reflection. The terminal device or vehicle obtains the earliest time and the latest time in the target time set, and obtains a second time interval between the earliest time and the latest time in the target time set, and determines whether the second time interval is greater than or equal to the first time threshold. If the determination result is yes, it is determined that the terminal device is located outside the vehicle; if the determination result is no, it is determined that the terminal device is located inside the vehicle.
[0405] It should be noted that the degree of dispersion of at least one arrival time corresponding to at least one target audio signal can also be measured by other methods. The more dispersed the at least one arrival time corresponding to at least one target audio signal is, the more it proves that the terminal device is located outside the vehicle; the closer the at least one arrival time corresponding to at least one target audio signal is, the more it proves that the terminal device is located inside the vehicle. Not all implementation methods are listed here one by one.
[0406] Optionally, after generating the first location information corresponding to the terminal device, the terminal device may send the aforementioned first location information to the vehicle; correspondingly, after generating the first location information corresponding to the terminal device, the vehicle may send the aforementioned first location information to the terminal device.
[0407] In an embodiment of the present application, the vehicle sends multiple target audio signals, and the target audio signals can reach the terminal device through direct radiation and / or reflection. Since the space inside the vehicle is relatively closed, the multiple audio signals obtained after direct radiation and / or reflection of a target audio signal can reach the terminal device in a relatively concentrated manner, while the space outside the vehicle is relatively open relative to the space inside the vehicle. The multiple audio signals obtained after direct radiation and / or reflection of a target audio signal will reach the terminal device in a relatively dispersed manner. Therefore, it is possible to determine whether the terminal device is inside or outside the vehicle based on the time interval between the first time set and the second time set, thereby providing a solution for measuring the user's position relative to the vehicle; in addition, the audio signal can be emitted through the built-in speakers in the vehicle, without the need to add additional hardware to the vehicle or terminal device, thereby avoiding additional overhead.
[0408] The present application embodiment also provides another location acquisition method to measure whether the terminal device is inside or outside the vehicle. Fig. 22 , Fig. 22 Another flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0409] 2401. The vehicle sends multiple target audio signals to the terminal device according to a second preset frequency.
[0410] In an embodiment of the present application, when the vehicle is in a moving state, the vehicle can start to send multiple target audio signals to the outside by broadcasting through the speakers at a second preset frequency; since the vehicle is in a moving state, the terminal devices that can be detected by the vehicle are generally located inside the vehicle, so the multiple target audio signals sent by the vehicle at the second preset frequency can all reach the terminal devices.
[0411] Among them, the second preset frequency and Fig.18 The first preset frequencies in the corresponding embodiments may be the same or different. The specific meaning of the target audio signal can be found in Fig.18 For the specific implementation method of determining whether the vehicle is in a moving state, please refer to the description in the corresponding embodiment. Fig.18 The specific implementation of step 2401 can also be found in the description of the corresponding embodiment. Fig.18 The description in the corresponding embodiments will not be repeated here.
[0412] 2402. When the vehicle is in a moving state, the terminal device obtains multiple first arrival times corresponding to multiple target audio signals, and a first arrival time represents the time when a target audio signal arrives at the terminal device.
[0413] In the embodiment of the present application, when the vehicle is in a moving state, the vehicle sends multiple target audio signals according to the second preset frequency, which can reach the terminal device through direct radiation and / or reflection, and the terminal device can obtain at least one arrival time corresponding to each target audio signal. The specific implementation method of the above steps can be referred to. Fig.18 Corresponding to the description in the embodiment.
[0414] The terminal device can determine a first arrival time corresponding to each target audio signal based on at least one arrival time corresponding to each target audio signal. The aforementioned first arrival time may be that the at least one arrival time corresponding to each target audio signal may only include one arrival time; or the aforementioned first arrival time may be the earliest arrival time among the at least one arrival time corresponding to each target audio signal; or the aforementioned first arrival time may be the latest arrival time among the at least one arrival time corresponding to each target audio signal; or the first arrival time may also be selected from other arrival times among the at least one arrival time corresponding to each target audio signal, which are not exhaustively listed here.
[0415] The terminal device repeatedly performs the above operations to obtain multiple first arrival times corresponding to multiple target audio signals. A first arrival time represents the time when a target audio signal arrives at the terminal device when the terminal device is located inside the vehicle.
[0416] 2403. When detecting that a second trigger condition is met, the terminal device obtains at least one second arrival time corresponding to at least one target audio signal.
[0417] In the embodiment of the present application, when the terminal device detects that the second trigger condition is met, it obtains at least one second arrival time corresponding to at least one target audio signal. The specific implementation method of the terminal device detecting that the second trigger condition is met can be found in Fig.18 As described in the corresponding embodiment, a specific implementation method in which the terminal device obtains at least one second arrival time corresponding one-to-one to at least one target audio signal is the same as a specific implementation method in which the terminal device obtains multiple first arrival times corresponding one-to-one to multiple target audio signals, with the difference that the first arrival time is obtained when the vehicle is in a moving state, and the second arrival time is obtained after the terminal device detects that the second trigger condition is met.
[0418] 2404. The terminal device generates first location information corresponding to the terminal device based on multiple first arrival times and at least one second arrival time, where the first location information is used to indicate that the terminal device is inside or outside the vehicle.
[0419] In an embodiment of the present application, after obtaining multiple first arrival times and at least one second arrival time, the terminal device can generate first location information corresponding to the terminal device based on the multiple first arrival times and at least one second arrival time, and the first location information is used to indicate that the terminal device is inside or outside the vehicle.
[0420] Specifically, the terminal device determines a first predicted time corresponding to a second arrival time based on multiple first arrival times, the first predicted time indicating the time when the target audio signal arrives at the terminal device when the relative position between the terminal device and the vehicle remains unchanged, that is, when the terminal device is located inside the vehicle; first position information is generated based on the first predicted time and the second arrival time.
[0421] More specifically, for the process of generating the first predicted time, after the terminal device obtains multiple first arrival times corresponding to multiple target audio signals, due to the clock difference between the vehicle and the terminal device, each first arrival time can be expressed as the following formula: in, represents the time when the i-th target audio signal sent by the vehicle arrives at the terminal device, i represents the i-th target audio signal sent by the vehicle, T represents the time interval between two target audio signals sent by the vehicle, and b represents the clock difference between the vehicle and the terminal device.
[0422] The terminal device can calculate the clock difference b between the vehicle and the terminal device using the least square method according to the multiple first arrival times corresponding to the multiple target audio signals. When the terminal device detects that the second trigger condition is met, it can be known that the vehicle is about to send the kth target audio signal, and the formula Calculate the first prediction time corresponding to the kth target audio signal
[0423] In a process of generating first location information according to a first predicted time and a second arrival time, in one implementation, the terminal device may calculate a third time interval between the second arrival time and the first preset time, and determine whether the third time interval is greater than or equal to a second time threshold, and if the determination result is yes, determine that the terminal device is located outside the vehicle; if the determination result is no, determine that the terminal device is located inside the vehicle.
[0424] In another implementation, the terminal device may calculate a third time interval Δt between the second arrival time and the first preset time. k , and the third time interval Δt k The distance value d is obtained by multiplying it by the sound propagation speed s. The terminal device determines whether the distance d is greater than or equal to the preset distance threshold d thresholdIf the judgment result is yes, it is determined that the terminal device is located outside the vehicle; if the judgment result is no, it is determined that the terminal device is located inside the vehicle.
[0425] In the embodiment of the present application, since the terminal device that can continuously receive the audio signal must be located inside the vehicle when the vehicle is in a moving state, the first predicted time can be obtained based on the multiple first arrival times obtained, and then based on the generated first predicted time and the actual second arrival time, it is determined whether the terminal device is located inside or outside the vehicle. Only one speaker is required to detect the first position information of the terminal device, which further reduces the difficulty of implementing the present solution and is conducive to expanding the application scenarios of the present solution.
[0426] Optionally, after generating the first location information corresponding to the terminal device, the terminal device may send the aforementioned first location information to the vehicle.
[0427] In an embodiment of the present application, another solution for measuring whether a terminal device is located inside or outside a vehicle is provided, thereby improving the implementation flexibility of the solution; and that is, by using an audio signal to measure whether the terminal device is located inside or outside the vehicle, there is no need to add additional hardware to the vehicle or the terminal device, thereby avoiding additional overhead.
[0428] The present application embodiment also provides another method for obtaining a position to measure the specific position of the terminal device outside the vehicle. Fig.23 , Fig.23 Another flowchart of a method for obtaining a position provided in an embodiment of the present application is provided. The method for obtaining a position provided in an embodiment of the present application may include:
[0429] 2501. The vehicle and the terminal device initiate an off-vehicle location sensing operation.
[0430] In the embodiments of the present application, in some application scenarios, during the operation of the vehicle, when the vehicle determines that it needs to know the position of the terminal device outside the vehicle, it will start the outside-vehicle position sensing operation and send an indication message to the terminal device. The aforementioned indication message is used to instruct the terminal device to start the outside-vehicle position sensing operation, and the outside-vehicle position sensing operation is used to obtain the specific position of the terminal device outside the vehicle.
[0431] As an example, when the vehicle detects that the distance between the terminal device and the vehicle is less than a preset threshold, it may be necessary to know the specific location of the terminal device outside the vehicle. As another example, when the vehicle detects that the distance between the terminal device and the vehicle is getting smaller and smaller, it may be necessary to know the specific location of the terminal device outside the vehicle. It should be understood that the distance here is only for the convenience of understanding this solution and is not used to limit this solution.
[0432] 2502. The vehicle sends a first audio signal to a terminal device through a first speaker.
[0433] In an embodiment of the present application, at least three speakers may be configured on the vehicle, and the at least three speakers are not located in a straight line. The at least three speakers include a first speaker, a second speaker, and a third speaker. After starting the off-vehicle position sensing operation, the first audio signal may be sent to the terminal device through the first speaker in a broadcasting manner.
[0434] 2503. The vehicle sends a second audio signal to the terminal device through the second speaker.
[0435] 2504. The vehicle sends a third audio signal to the terminal device via a third speaker.
[0436] In the embodiment of the present application, the vehicle can also send a second audio signal to the terminal device by broadcasting through the second speaker; and send a third audio signal to the terminal device by broadcasting through the third speaker. The specific expressions of the first audio signal, the second audio signal and the third audio signal are similar to the specific expressions of the target audio signal, which can be directly referred to in Fig.18 The description in the corresponding embodiment is not repeated here. Further, the first audio signal, the second audio signal and the third audio signal are signals with consistent signal strength, that is, the volume of the first audio signal, the second audio signal and the third audio signal is the same. For the positions of the first sound, the second sound and the third sound, please refer to the introduction in the first embodiment. It should be noted that the sound in the second embodiment can be a sound located inside the vehicle or outside the vehicle.
[0437] Specifically, in one implementation, the vehicle can execute steps 2502 to 2504 simultaneously, and the first audio signal, the second audio signal and the third audio signal need to use different audio signals. The specific meanings of the different audio signals can be found in the description of the first embodiment, which will not be described one by one here.
[0438] In another implementation, the vehicle may first execute step 2502, then execute step 2503 after a preset time interval, and then execute step 2504 after a preset time interval. The first audio signal, the second audio signal, and the third audio signal may be the same audio signal or different audio signals.
[0439] Optionally, the vehicle can also send a fourth audio signal to the terminal device through a fourth speaker. Correspondingly, the terminal device can obtain a fourth signal strength of the received fourth audio signal. It should be noted that the vehicle can also use more speakers to send audio signals to the terminal device. The specific number of speakers used and the position of each speaker can be flexibly set according to actual conditions and are not limited here.
[0440] It should be noted that the specific implementation manner in which the terminal device determines the corresponding relationship between each audio signal and the sound at each position can refer to the description in the first embodiment, which will not be repeated here.
[0441] 2505. The terminal device generates second location information corresponding to the terminal device based on the first signal strength of the received first audio signal, the second signal strength of the received second audio signal, and the third signal strength of the received third audio signal, wherein the second location information is used to indicate the location of the terminal device outside the vehicle.
[0442] In the embodiment of the present application, when the terminal device is located at different positions outside the vehicle, the distance relationship between the terminal device and each speaker is different, and the farther the audio signal propagates, the smaller the strength of the audio signal received by the terminal device. The terminal device can generate the second position information corresponding to the terminal device according to the first signal strength of the received first audio signal, the second signal strength of the received second audio signal, and the third signal strength of the received third audio signal. The terminal device can send the second position information of the terminal device to the vehicle.
[0443] To understand the principle of this solution more intuitively, please refer to Figure 8b and Fig.24 , Figure 8b A schematic diagram of the position outside the vehicle in the method for obtaining the position provided in an embodiment of the present application, Fig.24 A schematic diagram of the principle of the method for obtaining the position provided in the embodiment of the present application. Figure 8b , Figure 8b Taking the example of dividing the exterior of the vehicle into five zones, Z1 to Z5, it should be understood that Figure 8b The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0444] See also Fig.24 , Fig.24 Need to combine Figure 8b To understand, Fig.24 Taking the terminal device located in Z4 area as an example, speaker 1 is farthest from the terminal device, speaker 2 is the second farthest from the terminal device, and speaker 3 is the closest to the terminal device. Then the signal strength of the audio signal emitted by speaker 1 when it reaches the terminal device is the weakest, the signal strength of the audio signal emitted by speaker 1 when it reaches the terminal device is the second strongest, and the signal strength of the audio signal emitted by speaker 1 when it reaches the terminal device is the strongest. Conversely, if the strength of the three audio signals sent by the three speakers received by the terminal device meets the above settings, it proves that the terminal device is located in Z4 area. It should be understood that Fig.24 The example in the figure is only an example to facilitate understanding of the implementation principle of this solution and is not used to limit this solution.
[0445] Specifically, the terminal device may pre-store multiple sets of preset intensity information corresponding to multiple areas outside the vehicle, and a set of preset intensity information corresponding to a target area outside the vehicle (any area outside the vehicle) includes at least three target intensity values corresponding to at least three speakers, and a target intensity value represents the intensity value of an audio signal emitted by a speaker when the terminal device is located at the center of the target area. As an example, if the exterior of the vehicle is divided into five areas, Z1 to Z5, then five sets of intensity information corresponding to the five areas are pre-stored on the terminal device.
[0446] After the terminal device obtains the first signal strength, the second signal strength, and the third signal strength, it obtains a set of actual strength information, calculates the distance between the actual strength information and each set of preset strength information in the multiple sets of preset strength information, and selects a set of preset strength information closest to the actual strength information from the multiple sets of preset strength information, and determines the area corresponding to the set of preset strength information closest to the actual strength information as the area where the terminal device is located. The aforementioned distance may be Euclidean distance, Mahalanobis distance, or other types of distances, etc., which are not exhaustively listed here.
[0447] In the embodiment of the present application, since the distance relationship between the terminal device and each speaker is different when the terminal device is located at different positions outside the vehicle, the farther the audio signal propagates, the smaller the strength of the audio signal received by the terminal device. The first signal strength, the second signal strength and the third signal strength can respectively reflect the distance relationship between the terminal device and the first speaker, the second speaker and the third speaker. Therefore, the specific position of the terminal device outside the vehicle can be obtained based on the first signal strength, the second signal strength and the third signal strength, thereby providing another implementation method for measuring the specific position of the terminal device outside the vehicle and improving the implementation flexibility of the present solution.
[0448] Optionally, after the vehicle obtains the second location information of the terminal device, the second location information is used for the vehicle to determine the component closest to the terminal device from multiple components included in the vehicle, so as to control the component closest to the terminal device to perform a preset operation. The component may be a door, a light, a trunk, or other vehicle components, and the preset operation may be unlocking the door, opening the door, unlocking the trunk, turning on the light, or other operations, etc., which are not limited here.
[0449] For a more intuitive understanding of this solution, please refer to Fig.25 , Fig.25 This is an application scenario diagram of the location acquisition method provided in the embodiment of the present application. Fig.25As shown, when the vehicle determines that the terminal device is located in the Z1 area outside the vehicle, the left front door can be unlocked; when the vehicle determines that the terminal device is located in the Z2 area outside the vehicle, the left rear door can be unlocked; when the vehicle determines that the terminal device is located in the Z5 area outside the vehicle, the trunk can be unlocked. It should be understood that Fig.25 This is only an example to facilitate understanding of the present invention and is not intended to limit the present invention.
[0450] As another example, at night, when the vehicle determines that the terminal device is located in the Z1 area outside the vehicle, the left front light can be turned on to provide lighting for the user; as another example, when the vehicle determines that the terminal device is located in the Z2 area outside the vehicle, the door can be opened automatically, etc. The specific examples are not listed here one by one.
[0451] In the embodiment of the present application, a specific application scenario of the second location information is provided, and the second location information is used to provide users with more accurate services, which is conducive to improving the user stickiness of the present solution.
[0452] exist Figure 1a to Figure 25 On the basis of the corresponding embodiments, in order to better implement the above solutions of the embodiments of the present application, the following also provides related devices for implementing the above solutions. Fig.26 , Fig.26 A structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 2900 is applied to a vehicle, the vehicle includes a position acquisition system, the position acquisition system also includes a terminal device, and the position acquisition device 2900 includes: a sending module 2901, which is used to send at least one target audio signal when a first trigger condition is detected, wherein the target audio signal is used to determine at least one arrival time corresponding to the target audio signal; the sending module 2901 is specifically used to send multiple target audio signals according to a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, and at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal reaches the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal reaches the terminal device through direct and / or reflection; an acquisition module 2902, which is used to acquire first position information corresponding to the terminal device, the first position information is used to indicate that the terminal device is located inside or outside the vehicle, and the time interval between the arrival times in the first time set and the second time set is used to determine the first position information.
[0453] In a possible design, the target audio signal is a linear frequency modulation signal or a ZC sequence signal.
[0454] In one possible design, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first position information indicates that the terminal device is located inside the vehicle, wherein the determining factor of the preset time range includes the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first position information indicates that the terminal device is located outside the vehicle.
[0455] In one possible design, the time interval between the arrival times in the first time set and the second time set includes: the time interval between the latest time in the first time set and the earliest time in the second time set.
[0456] In one possible design, when the sending module 2901 detects any one or more of the following situations, it is deemed that the first trigger condition is detected to be met: the vehicle is detected to be stopped; or, it is detected that the distance between the terminal device and the vehicle satisfies the first distance condition; or, a first instruction is obtained, and the first instruction is used to trigger the vehicle to obtain the first position information.
[0457] In one possible design, the sending module 2901 is specifically used to obtain the speed, acceleration and angular velocity of the vehicle, and input the speed, acceleration and angular velocity of the vehicle into a classification model to obtain predicted category information output by the classification model, and the predicted category information indicates that the vehicle is in a stopped state or a moving state.
[0458] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 2900 are the same as those in the present application. Figures 18 to 21 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0459] The present application embodiment also provides another device for obtaining a position, see Fig. 27 , Fig. 27Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 3000 is applied to a terminal device, the terminal device includes a position acquisition system, the position acquisition system also includes a vehicle, and the position acquisition device 3000 includes: an acquisition module 3001, which is used to acquire at least one arrival time corresponding to at least one target audio signal when detecting that a second trigger condition is met, the at least one target audio signal includes multiple target audio signals emitted by the vehicle at a preset frequency, the multiple target audio signals include a first detection signal and a second detection signal, and the at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal reaches the terminal device through direct and / or reflection, and the second time set includes at least one time when the second detection signal reaches the terminal device through direct and / or reflection; a generation module 3002, which is used to generate first position information corresponding to the terminal device according to the time interval between the arrival times in the first time set and the second time set, and the first position information is used to indicate that the terminal device is located inside or outside the vehicle.
[0460] In one possible design, if the time interval between the arrival times in the first time set and the second time set is within a preset time range, the first position information indicates that the terminal device is located inside the vehicle, wherein the determining factor of the preset time range includes the time interval between two adjacent target audio signals sent by the vehicle; if the time interval between the arrival times in the first time set and the second time set is not within the preset time range, the first position information indicates that the terminal device is located outside the vehicle.
[0461] In one possible design, the generation module 3002 is specifically used to generate the first position information according to the time interval between the latest time in the first time set and the earliest time in the second time set.
[0462] In one possible design, when the acquisition module 3001 detects any one or more of the following situations, it is deemed that the second trigger condition is detected to be met: detecting that the vehicle is stopped; or detecting that the distance between the terminal device and the vehicle satisfies the first distance condition; or detecting that the displacement of the terminal device meets the preset displacement; or obtaining a second instruction, the second instruction is used to trigger the terminal device to obtain the first position information.
[0463] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 3000 are the same as those in the present application. Figures 18 to 21 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0464] The present application also provides another device for obtaining a position, see Fig.28 , Fig.28 A structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 3100 is applied to a vehicle, the vehicle includes a position acquisition system, the position acquisition system also includes a terminal device, and the position acquisition device 3100 includes: a sending module 3101, which is used to send multiple target audio signals at a preset frequency, when the vehicle is in a moving state, a target audio signal is used to determine a first arrival time of the target audio signal arriving at the terminal device, when the second trigger condition is met, a target audio signal is used to determine a second arrival time of the target audio signal arriving at the terminal device; an acquisition module 3102, which is used to acquire first position information corresponding to the terminal device, the first position information is used to indicate that the terminal device is located inside or outside the vehicle, and multiple first arrival times and at least one second arrival time are used to determine the first position information.
[0465] In one possible design, multiple first arrival times are used to determine a first predicted time corresponding to a second arrival time, the first predicted time indicating the time when the target audio signal arrives at the terminal device when the terminal device is located inside a vehicle, and the first predicted time and the second arrival time are used to determine the first position information.
[0466] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 3100 are the same as those in the present application. Fig. 22 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0467] The present application embodiment also provides another device for obtaining a position, see Fig.29 , Fig.29 Another structural schematic diagram of the position acquisition device provided in the embodiment of the present application. The position acquisition device 3200 is applied to a terminal device, the terminal device includes a position acquisition system, the position acquisition system also includes a vehicle, and the position acquisition device 3200 includes: an acquisition module 3201, which is used to acquire multiple first arrival times corresponding to multiple target audio signals when the vehicle is in a moving state, and a first arrival time represents the time when a target audio signal arrives at the terminal device, and the multiple target audio signals are emitted by the vehicle at a preset frequency; a generation module 3202, which is used to acquire at least one second arrival time corresponding to at least one target audio signal when it is detected that a second trigger condition is met, and generate first position information corresponding to the terminal device according to the multiple first arrival times and at least one second arrival time, and the first position information is used to indicate that the terminal device is located inside or outside the vehicle.
[0468] In one possible design, generation module 3202 is specifically used to determine a first predicted time corresponding to a second arrival time based on multiple first arrival times, the first predicted time indicating the time when the target audio signal arrives at the terminal device when the terminal device is located inside a vehicle; and generate first position information based on the first predicted time and the second arrival time.
[0469] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 3200 are the same as those in the present application. Fig. 22 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0470] The present application also provides another device for obtaining a position, see Fig.30 , Fig.30 Another structural schematic diagram of a position acquisition device provided in an embodiment of the present application. The position acquisition device 3300 is applied to a vehicle, the vehicle includes a position acquisition system, the position acquisition system also includes a terminal device, the vehicle is configured with at least three speakers, the at least three speakers are not located in a straight line, the at least three speakers include a first speaker, a second speaker and a third speaker, the position acquisition device 3300 includes: a sending module 3301, which is used to send a first audio signal through a first speaker, and the first audio signal is used to determine the first signal strength of the first audio signal received by the terminal device; the sending module 3301 is also used to send a second audio signal through a second speaker, and the second audio signal is used to determine the second signal strength of the second audio signal received by the terminal device; the sending module 3301 is also used to send a third audio signal through a third speaker, and the third audio signal is used to determine the third signal strength of the third audio signal received by the terminal device, the first signal strength, the second signal strength and the third signal strength are used to determine the second position information corresponding to the terminal device, and the second position information is used to indicate the position of the terminal device outside the vehicle.
[0471] In one possible design, the second location information is used for the vehicle to determine a component that is closest to the terminal device from among multiple components included in the vehicle, so as to control the component that is closest to the terminal device to perform a preset operation.
[0472] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 3300 are the same as those in the present application. Figure 23 to Figure 25 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0473] The present application embodiment also provides another device for obtaining a position, see Fig.31 , Fig.31 Another structural schematic diagram of the device for obtaining a position provided in an embodiment of the present application. The device for obtaining a position 3400 is applied to a terminal device, the terminal device includes a system for obtaining a position, the system for obtaining a position also includes a vehicle, the vehicle is equipped with at least three speakers, the at least three speakers are not located in a straight line, the at least three speakers include a first speaker, a second speaker and a third speaker, the device for obtaining a position 3400 includes: a receiving module 3401, for receiving a first audio signal sent by a first speaker, receiving a second audio signal sent by a second speaker, and receiving a second audio signal sent by a third speaker; a generating module 3402, for generating second position information corresponding to the terminal device according to the first signal strength of the received first audio signal, the second signal strength of the received second audio signal and the third signal strength of the received third audio signal, the second position information is used to indicate the position of the terminal device outside the vehicle.
[0474] It should be noted that the information interaction, execution process, etc. between the modules / units in the position acquisition device 3400 are the same as those in the present application. Figure 23 to Figure 25 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.
[0475] In Example 3 of the embodiments of the present application, after being able to obtain the position information of the terminal device relative to the vehicle, that is, obtaining whether the terminal device is located inside or outside the vehicle, it can be applied to various interaction scenarios between the vehicle and the terminal device. The various application scenarios are introduced one by one as follows.
[0476] Embodiment 3
[0477] 1. How to process the audio stream when the first terminal device moves from inside the vehicle to outside the vehicle
[0478] For details, please refer to Fig.32 , Fig.32 A flowchart of a method for processing an audio stream provided in an embodiment of the present application is provided. The method for processing an audio stream provided in an embodiment of the present application may include:
[0479] 3701. A first terminal device establishes a connection with a vehicle, and a playback device for audio streams of a first category and a second category is switched from the first terminal device to the vehicle.
[0480] In the embodiment of the present application, if the first terminal device establishes a connection with the vehicle for the first time, the first terminal device may use Bluetooth, wireless broadband (wireless fidelity, WIFI) or other technologies to scan the surrounding electronic devices. If at least one vehicle is found within a preset distance threshold, the first terminal device may send a connection request to each vehicle to trigger the pairing operation between the first terminal device and the vehicle. If the first terminal device is successfully paired with one of the at least one vehicle, the first terminal device successfully establishes a connection with the aforementioned vehicle; if the first terminal device is unsuccessful in pairing with one of the at least one vehicle, the first terminal device cannot establish a connection with the aforementioned vehicle.
[0481] Specifically, after receiving the connection request sent by the first terminal device, the vehicle generates a personal identification number (PIN) of the vehicle in response to the received connection request, and sends a response message to the first terminal device. After receiving the response message, the first terminal device can send the PIN code to the vehicle. The vehicle matches the PIN code sent by the first terminal device with the generated PIN code. If the match is successful, it proves that the first terminal device is successfully paired with the vehicle; if the match fails, it proves that the first terminal device is unpaired with the vehicle.
[0482] If this is not the first time that the first terminal device establishes a connection with the vehicle, the first terminal device can use Bluetooth, wireless broadband (wireless fidelity, WIFI) or other technologies to scan surrounding electronic devices. If at least one paired vehicle is found within a preset distance threshold, the first terminal device can send a connection request to the aforementioned vehicle. The aforementioned vehicle establishes a connection with the first terminal device in response to the obtained connection request.
[0483] While the first terminal device and the vehicle are connected, the first terminal device can send synchronization data to the vehicle, and correspondingly, the vehicle receives the synchronization data sent by the first terminal device, so that the first terminal device can perform any one or more of the following tasks through the vehicle: playing audio streams, playing videos, navigation, video calls, calls or other tasks, etc., which are not listed here exhaustively.
[0484] After the first terminal device establishes a connection with the vehicle, the playback device of the third category audio stream can be switched from the first terminal device to the vehicle. The third category includes at least two categories of audio streams, and the at least two categories of audio streams include the first category and the second category. The specific categories of audio streams included in the third category can be flexibly determined in combination with the actual application scenario. As an example, the third category can include media, call or other types of audio streams, etc. The meanings of the first category and the second category will be explained in subsequent steps and will not be explained here for the time being.
[0485] Specifically, the first terminal device may store indication information, which records which playback device is used for at least two categories of audio streams included in the third category of audio streams. The first terminal device may update the indication information. The indication information before the update indicates that the playback device of the third category of audio streams is the first terminal device, and the indication information after the update indicates that the playback device of the third category of audio streams is a vehicle.
[0486] As an example, the audio stream of the third category may include a speaker of the first terminal device, a receiver of the first terminal device, a vehicle connected to the first terminal device, or other possible playback devices, etc., which are not exhaustive here.
[0487] Furthermore, the above indication information may be specifically expressed as a table, a flag, or other information types, etc., which are not exhaustively listed here.
[0488] 3702. While the first terminal device and the vehicle are connected, the first terminal device or the vehicle detects that the first terminal device moves from inside the vehicle to outside the vehicle.
[0489] In an embodiment of the present application, while the first terminal device and the vehicle are in a connected state, the first terminal device or the vehicle can detect the first location information of the first terminal device within a preset time period. Based on the first location information of the first terminal device within the preset time period, it can be known whether the first terminal device has moved from inside the vehicle to outside the vehicle.
[0490] Optionally, while the first terminal device is connected to the vehicle and the first terminal device is projecting the screen through the vehicle, the first terminal device or the vehicle detects that the first terminal device moves from inside the vehicle to outside the vehicle.
[0491] Among them, the first terminal device refers to a terminal device that has established a connection with the vehicle and is located in the vehicle; optionally, the first terminal device refers to a terminal device that has established a connection with the vehicle, performs a screen projection operation through the vehicle and is located in the vehicle.
[0492] The value range of the preset time period can be, for example, 10 seconds to 2 minutes. As an example, the value of the preset time period can be 20 seconds, 370 seconds, 45 seconds, 1 minute, 80 seconds, 90 seconds or other values, etc. The specific value of the preset time period can be flexibly set in combination with the actual application product, and is not limited here.
[0493] More specifically, in one implementation, the solution provided in Example 2 can be used to obtain the first location information of the first terminal device within a preset time period, that is, in Example 2, when the vehicle detects that the first trigger condition is met and / or the first terminal device detects that the second trigger condition is met, the vehicle and the first terminal device start the first location sensing operation and continue to obtain the first location information of the first terminal device within the preset time period. If the first terminal device or the vehicle detects that the first terminal device moves from inside the vehicle to outside the vehicle, it triggers to enter step 3702. If the first terminal device or the vehicle detects that the first terminal device is always in the vehicle, the first terminal device can continue to project the screen through the vehicle.
[0494] Specifically, the vehicle sends multiple target audio signals at a preset frequency, wherein the multiple target audio signals include a first detection signal and a second detection signal, at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal arrives at the first terminal device by direct radiation and / or reflection, and the second time set includes at least one time when the second detection signal arrives at the first terminal device by direct radiation and / or reflection; the first terminal device generates first position information corresponding to the terminal device according to the time interval between the arrival times in the first time set and the second time set, and the first position information is used to indicate that the first terminal device is located inside or outside the vehicle; based on the first position information of the first terminal device within a preset time period, it is determined that the first terminal device has moved from inside the vehicle to outside the vehicle.
[0495] It should be noted that the specific implementation of the above steps can be found in the description of Example 2 and will not be repeated here.
[0496] In another implementation, when the vehicle detects that the first trigger condition is met and / or the first terminal device detects that the second trigger condition is met, the vehicle or the first terminal device can continuously obtain the distance between the first terminal device and the vehicle within a preset time period based on ultra wide band (UWB) technology, Bluetooth technology or other technology, and determine the first location information of the first terminal device within the preset time period according to the distance between the first terminal device and the vehicle within the preset time period. If the distance between the first terminal device and the vehicle is greater than or equal to the preset distance threshold, it proves that the first terminal device is located outside the vehicle; if the distance between the first terminal device and the vehicle is less than the preset distance threshold, it proves that the first terminal device is located inside the vehicle.
[0497] It should be noted that the vehicle or the first terminal device may also generate the first location information of the first terminal device through other technologies, which are not listed one by one here.
[0498] In addition, if the vehicle detects that the first terminal device moves from inside the vehicle to outside the vehicle, the vehicle will send indication information to the first terminal device, and the indication information is used to indicate that the first terminal device moves from inside the vehicle to outside the vehicle within the preset time period. Alternatively, if the vehicle detects that the first terminal device is always inside the vehicle, the vehicle will send indication information to the first terminal device, and the first indication information is used to indicate that the first terminal device is always inside the vehicle within the preset time period.
[0499] Optionally, in order to ensure that the user has a good experience during the call, when the first terminal device and the vehicle are connected, if the target category corresponding to the target audio stream played by the first terminal device through the vehicle is a call, then while the user is talking on the phone through the first terminal device, the first terminal device and the vehicle may not obtain the first location information of the first terminal device; that is, while the user is talking on the phone through the first terminal device, the first terminal device and the vehicle will not detect whether the first terminal device is moved from inside the vehicle to outside the vehicle.
[0500] If the user wants to switch the playback device of the target audio stream classified as calls from the vehicle to other electronic devices, the user needs to actively input a first switching operation, and the first terminal device or the vehicle responds to the received first switching operation by switching the playback device of the target audio stream classified as calls to the electronic device corresponding to the first switching operation.
[0501] The audio stream categorized as a call may include: an audio stream generated when a call is made through an instant messaging application, an audio stream generated when a video is played through an instant messaging application, or other audio streams categorized as calls.
[0502] Specifically, the user actively inputs the first switching operation. In one implementation, the user can input the first switching operation through the display interface of the first terminal device, or the user can input the first switching operation through the display interface of the vehicle. For a more intuitive understanding of this solution, please refer to Fig.33 , Fig.33 A schematic diagram of a receiving interface for a first switching operation in the audio stream processing method provided in an embodiment of the present application. Fig.33 An example of the display interface of the central control screen of a vehicle is shown in FIG. As shown in the figure, the current playback device of the target audio stream of the call type is the audio configured in the vehicle. Fig.33 The figure also shows the speaker of the terminal device, the handset of the terminal device and the Bluetooth connection with the terminal device. The user can input the first switching operation by clicking the icon on the display interface. It should be understood that Fig.33 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0503] In another implementation, during the process of the first terminal device playing a target audio stream of call type through a vehicle, if the first terminal device detects that the user holds the first terminal device close to the ear, it can be regarded as the user inputting a first switching operation through the first terminal device, and the playback device corresponding to the first switching operation is the earpiece of the first terminal device.
[0504] As an example, when the user brings the first terminal device close to the ear, the first terminal device can detect the proximity of the auricle through the capacitive screen to detect that the user brings the first terminal device close to the ear. Alternatively, the first terminal device can detect the action of being picked up and brought close to the ear through devices such as gyroscopes, gravity sensors, and proximity light sensors, thereby determining that the user brings the first terminal device close to the ear. It should be noted that the first terminal device can also detect whether the user brings the first terminal device close to the ear through other technologies. The examples here are only used to prove the feasibility of this solution and are not used to limit this solution.
[0505] Further optionally, after the user ends a call through the first terminal device, the first terminal device or the vehicle can be triggered to obtain the location information of the first terminal device. If it is detected that the first terminal device is outside the vehicle, the playback device of at least one type of audio stream played by the vehicle can be switched from the vehicle to the first terminal device; alternatively, the playback device of other types of audio streams other than media can also be switched from the vehicle to the first terminal device.
[0506] After detecting that the first terminal device is outside the vehicle, the display interface of the vehicle's central control screen can be switched to the out-of-vehicle mode. In the out-of-vehicle mode, the content displayed on the display interface of the vehicle's central control screen can be any one or more of the following combinations: black screen, wallpaper, display time or illustrations, prompt information or other information; the aforementioned prompt information is used to indicate the current status of the vehicle's central control screen. It should be noted that other information can also be displayed on the vehicle's central control screen in the out-of-vehicle mode. The specific information to be displayed can be flexibly set in combination with the actual product form, and it is not exhaustive here.
[0507] In the embodiment of the present application, when the first terminal device is connected to the vehicle, when a sound pickup operation is required, whether to use the sound pickup device on the first terminal device or the sound pickup device of the vehicle can be determined according to the playback device used for the audio stream of the call category. That is, if the first terminal device plays the audio stream of the call category through the vehicle, the first terminal device can pick up the sound through the vehicle; if the first terminal device plays the audio stream of the call category through the first terminal device, the first terminal device can pick up the sound through the first terminal device. Among them, the sound pickup device can specifically use a microphone or other types of sound pickup devices.
[0508] In the embodiment of the present application, during the process in which the first terminal device is connected to the vehicle and the first terminal device is always in the vehicle, if the first terminal device detects that a connection is established between the headset and the first terminal device, then in one implementation, the output devices of all categories of audio streams included in the third category can be automatically switched to the headset; in another implementation, the first terminal device can output inquiry information, which is used to inquire whether to switch the output devices of all categories of audio streams to the headset. The first terminal device can respond to the switching operation input by the user and switch the output devices of all categories of audio streams to the headset.
[0509] 3703. The first terminal device determines whether there is a target audio stream being played through the vehicle. If the judgment result is yes, proceed to step 3704; if the judgment result is no, the playback device of the third category of audio streams is switched from the vehicle to the first terminal device. The third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle.
[0510] In some embodiments of the present application, when the first terminal device determines that the first terminal device has moved from inside the vehicle to outside the vehicle, it can determine whether the first terminal device has a target audio stream being played through the vehicle. If the judgment result is yes, it triggers entry into step 3704; if the judgment result is no, it triggers the switching of the playback devices of the third category of audio streams from the vehicle to the first terminal device, and the third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle.
[0511] Specifically, while the first terminal device is connected to the vehicle, and while the first terminal device is moved from inside the vehicle to outside the vehicle, if the first terminal device does not play any audio stream through the vehicle, the playback devices of all categories of audio streams included in the third category can be switched from the vehicle to the first terminal device, and the display interface of the vehicle's central control screen can enter off-vehicle mode.
[0512] For a more intuitive understanding of this solution, please refer to Fig.34 , Fig.34 A schematic diagram of the off-vehicle mode in the audio stream processing method provided in an embodiment of the present application. Fig.34 It includes three sub-schematic diagrams (a), (b) and (c). Fig.34 The three sub-schematic diagrams (a), (b) and (c) all show the display interface of the central control screen of the vehicle after the playback devices of all categories of audio streams included in the third category are switched from the vehicle to the first terminal device. It should be understood that Fig.34 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0513] 3704. The first terminal device obtains a target category corresponding to the target audio stream being played by the vehicle.
[0514] In an embodiment of the present application, when the first terminal device is connected to the vehicle, when it is detected that the first terminal device moves from inside the vehicle to outside the vehicle, and the first terminal device has a target audio stream being played through the vehicle, the first terminal device can obtain the target category corresponding to the target audio stream being played by the vehicle.
[0515] The categories corresponding to the target audio stream may include: call, media (music), system or other categories; the audio streams classified as system may include: ring when a call comes in, alarm or countdown (alarm), voice assistant broadcast, notification (notification), sound when the screen is touched, lock screen sound, dial key tone, photo sound effect, screenshot sound effect, screen reading or other sound effects, etc., which are not exhaustive here. It should be noted that the specific types of audio streams that can be played through the vehicle can be determined in combination with the actual product and are not limited here.
[0516] 3705. The first terminal device determines whether the target category is the first category. If the judgment result is yes, the process proceeds to step 3706; if the judgment result is no, the process proceeds to step 3709.
[0517] In an embodiment of the present application, after the first terminal device obtains the target category corresponding to the target audio stream being played by the vehicle, it can determine whether the target category is the first category. If the target category is the first category, it proceeds to step 3706; if the target category is not the first category, it proceeds to step 3709.
[0518] Among them, the first category may include media, and the audio streams classified as media may include: music, video, audio streams generated by game applications, audio in instant messaging applications, or other audio streams classified as media, etc., which are not listed here exhaustively.
[0519] In the embodiment of the present application, since audio streams classified as media are generally more entertaining and have weaker requirements for privacy, when the first terminal device is moved from inside the vehicle to outside the vehicle, the vehicle will continue to play the target audio stream only when the type of the target audio stream being played by the vehicle is media, which not only ensures the entertainment of other people in the vehicle, but also minimizes the privacy leakage of users.
[0520] Of course, in the embodiment of the present application, the first category may also be other categories besides media, which is not limited here.
[0521] 3706. The first terminal device continues to send the target audio stream to the vehicle, and then enters step 3707.
[0522] In the embodiment of the present application, step 3705 is an optional step. If step 3705 is not executed, step 3706 can be entered after step 3704 is executed. The first terminal device can continue to send the target audio stream to the vehicle. Correspondingly, after receiving the target audio stream sent by the first terminal device, the vehicle will continue to play the target audio stream, that is, after the first terminal device moves from inside the vehicle to outside the vehicle, the playback device of the audio stream of the target category is still the vehicle.
[0523] Optionally, the playback device of audio streams of other categories in the third category except the target category may be switched from the vehicle to the first terminal device, and the third category includes categories of audio streams played by all first terminal devices through the vehicle.
[0524] If step 3705 is executed, the first terminal device can continue to send the target audio stream to the vehicle when it determines that the target category corresponding to the target audio stream being played by the vehicle belongs to the first category. Correspondingly, after receiving the target audio stream sent by the first terminal device, the vehicle will continue to play the target audio stream. That is, after the first terminal device moves from inside the vehicle to outside the vehicle, the playback device of the audio stream of the first category is still the vehicle.
[0525] After detecting that the first terminal device moves from inside the vehicle to outside the vehicle, the display interface of the vehicle's central control screen can be switched to the out-of-vehicle mode. Fig.35 , Fig.35 A schematic diagram of the off-vehicle mode in the audio stream processing method provided in an embodiment of the present application. Fig.35 It includes four sub-schematic diagrams (a), (b), (c) and (d). Fig.35 The sub-schematic diagram (a) represents an interface when the first terminal device is located in a vehicle and the first terminal device plays an audio stream of a media type through the vehicle; Fig.35 The sub-schematic diagrams (b), (c) and (d) represent three different display interfaces of the central control screen of the vehicle when the first terminal device is moved from inside the vehicle to outside the vehicle. It should be understood that Fig.35 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0526] Specifically, for the process of the first terminal device playing the target audio stream through the vehicle. In one implementation, if the vehicle auxiliary device is an aftermarket device of the vehicle, the first terminal device can send the target audio stream to the vehicle auxiliary device configured for the vehicle (that is, an example of the central control screen of the vehicle) to play the target audio stream through the audio of the vehicle auxiliary device and display the projection data through the screen of the vehicle auxiliary device.
[0527] In another implementation, if the vehicle auxiliary device is a rear-mounted device of the vehicle, the first terminal device can send the target audio stream to the vehicle's processor to play the target audio stream through the speakers located in the main part of the vehicle, and send other projection data to the vehicle auxiliary device configured for the vehicle (that is, an example of the vehicle's central control screen) to display the projection data through the screen of the vehicle auxiliary device.
[0528] In another implementation, if the vehicle is not equipped with vehicle auxiliary equipment, the first terminal device can send all projection data to the vehicle's processor to play the target audio stream through the speakers in the main part of the vehicle, and display the projection data through the screen of the on-board computer integrated in the vehicle.
[0529] Optionally, while the first terminal device plays the first category of audio streams through the vehicle, the first terminal device may output a first message, the first message being used to prompt the user to switch the playback device of the first category of audio streams from the vehicle to the first terminal device. Furthermore, the first terminal device may display the first information in a form including, but not limited to, a pop-up window, a drop-down box, a switch icon, or other forms, which are not exhaustive here.
[0530] If the first terminal device obtains a first switching operation input by the user based on the first information, then in response to the obtained first switching operation, the playback device of the first category of audio stream is switched from the vehicle to the first terminal device, and the first terminal device stops sending the first category of audio stream to the vehicle.
[0531] For a more intuitive understanding of this solution, please refer to Fig.36 , Fig.36 Two schematic diagrams of the first terminal device displaying the first information in the audio stream processing method provided in the embodiment of the present application. Fig.36 It includes two sub-schematic diagrams (a) and (b). Fig.36 The C1 area in the sub-schematic diagram (a) shows that the first information is displayed in the form of a pop-up box, and the user can enter the first switching operation by clicking "Switch to mobile phone" in the C1 area; Fig.36 The C2 area in the (b) sub-schematic diagram shows that the first information is displayed in the drop-down box. The user can click "Switch the audio and video to the mobile phone" in the C1 area to input the first switching operation, etc. It should be understood that Fig.36 The examples are only for the convenience of understanding the display method of the first information. The specific display method of the first information and the method of obtaining the first switching operation can be flexibly set in combination with the actual product form, and are not listed one by one here.
[0532] In an embodiment of the present application, while the target audio stream continues to be played by the vehicle, a first information is output, and the first information is used to prompt the user to switch the playback device of the first category of audio streams from the vehicle to the first terminal device. That is, the user can decide whether to switch the playback device of the first category of audio streams back to the first terminal device based on actual conditions, thereby improving the flexibility of the present solution in the switching process of the audio stream playback device.
[0533] 3707. The first terminal device switches the playback device of the audio streams of other categories in the third category except the target category from the vehicle to the first terminal device.
[0534] In some embodiments of the present application, step 3705 is an optional step. If step 3705 is not performed, after detecting that the first terminal device moves from inside the vehicle to outside the vehicle, while the playback device of the audio stream of the first category is still the vehicle, the playback device of the audio stream of other categories in the third category except the target category can be switched from the vehicle to the first terminal device.
[0535] Specifically, when the first terminal device is already outside the vehicle and is playing an audio stream of the first category through the vehicle, if the first terminal device needs to play a new audio stream, the first terminal device can obtain the category corresponding to the new audio stream. If the category corresponding to the new audio stream is not the target category, since the playback devices of audio streams of other categories in the third category except the target category have been switched from the vehicle to the first terminal device, the first terminal device can play the aforementioned new audio stream, and the first terminal device does not send the aforementioned new audio stream to the vehicle.
[0536] Furthermore, if the first terminal device stores indication information, which records which playback devices are used for at least two categories of audio streams included in the third category of audio streams, the first terminal device needs to update the indication information again. The indication information before the update indicates that the playback devices for at least two categories of audio streams included in the third category of audio streams are both vehicles. If step 3705 is not performed, the updated indication information can indicate that the playback devices for audio streams of other categories in the third category except the target category are the first terminal device; if step 3705 is performed, since the audio stream of the target category is determined to be the audio stream of the first category, and the audio stream of the third category includes the audio stream of the first category and the audio stream of the second category, the updated indication information can indicate that the playback device for the audio stream of the second category is the first terminal device.
[0537] In an embodiment of the present application, after the first terminal device is moved from inside the vehicle to outside the vehicle, not only does the vehicle continue to play the audio stream of the first category, but the playback device of the audio stream of the second category is switched from the vehicle to the first terminal device. The first category and the second category are different categories, that is, the playback device of some audio streams is kept as the vehicle, and the playback device of another part of the audio streams is switched from the vehicle to the first terminal device. Therefore, it is possible to flexibly set which categories of audio streams continue to be played by the vehicle and which categories of audio streams are switched to the first terminal device according to actual conditions, thereby improving the implementation flexibility of the present solution.
[0538] If step 3705 is executed, the first terminal device continues to send the target audio stream of the first category to the vehicle when determining that the target category is the first category, that is, step 3707 can also be described as switching the playback device of the second category audio stream generated by the first terminal device from the vehicle to the first terminal device. The second category and the first category are different categories, and the second category can include all categories of audio streams in the audio streams included in the third category except the audio streams of the first category.
[0539] Specifically, when the first terminal device is already outside the vehicle and is playing an audio stream of the first category through the vehicle, if the first terminal device needs to play a new audio stream, the first terminal device can obtain the category corresponding to the new audio stream. If the category corresponding to the new audio stream is the second category, since the playback device of the audio stream of the second category has been switched from the vehicle to the first terminal device, the audio stream of the second category can be played by the first terminal device, and the first terminal device does not send the audio stream of the second category to the vehicle.
[0540] It should be noted that step 3707 is an optional step. If step 3707 is not performed, in another implementation, after detecting that the first terminal device moves from inside the vehicle to outside the vehicle, since the playback device of the target audio stream is still the vehicle, the playback devices of all categories of audio streams included in the third category can be defaulted to the vehicle.
[0541] When the first terminal device needs to play a new audio stream, the first terminal device can output the third information, and the third information is used to prompt the user to switch the playback device of all categories of audio streams included in the third category from the vehicle to the first terminal device. It should be noted that the specific implementation method of the first terminal device outputting the third information can be similar to the specific implementation method of the first terminal device outputting the first information, and can be directly referred to the above description, which is not repeated here.
[0542] 3708. When the first terminal device obtains the playback operation of the first audio stream, the first information is output. The category of the first audio stream is the first category, and the first audio stream is different from the target audio stream being played by the vehicle. The first information is used to prompt the user to switch the playback device of the first category audio stream from the vehicle to the first terminal device.
[0543] In some embodiments of the present application, while the first terminal device continues to play the target audio stream through the vehicle, if the first terminal device obtains a playback operation for a new first audio stream, the category of the new first audio stream can be obtained. If the category of the new first audio stream is the first category, the first terminal device can output first information, and the user can choose to switch the playback device of the audio stream of the first category from the vehicle to the first terminal device based on the first information.
[0544] Among them, the play operation of the new audio stream of the first category obtained by the first terminal device can come from the same application as the target audio stream being played by the vehicle, or from a different application. As an example, for example, the target audio stream being played by the vehicle comes from a video application, and the play operation for the new audio stream obtained by the first terminal device comes from a music application; as another example, for example, the target audio stream being played by the vehicle comes from video application 1, and the play operation for the new audio stream obtained by the first terminal device also comes from the video application 1. It should be understood that the examples given here are only for the convenience of understanding this solution and are not used to limit this solution.
[0545] The form in which the first terminal device displays the first information includes, but is not limited to, displaying the first information in a pop-up box, displaying a notification in a drop-down box, displaying the first information in a toggle icon, or other forms, etc., which are not exhaustive here.
[0546] Specifically, in one implementation, if in step 3707, the playback device of the second category audio stream has been switched from the vehicle to the first terminal device, then when the first terminal device obtains the playback operation for the new audio stream, the category of the new audio stream can be obtained. If the category of the new first audio stream is the first category, the first terminal device can play the new first audio stream through the vehicle and output the first information, so that the user can switch the new audio stream (i.e., the first audio stream of the first category) to the first terminal device based on the first information; if the category of the new first audio stream is the second category, the second terminal device can play the second category audio stream through the first terminal device.
[0547] If the first terminal device obtains a second switching operation input by the user based on the first information, then in response to the obtained second switching operation, the playback device of the first category of audio streams is switched from the vehicle to the first terminal device.
[0548] After the playback device of the first category of audio streams is switched from the vehicle to the first terminal device, the first terminal device can be triggered to pause playback of the audio stream, or the first terminal device can be triggered to continue playback of the audio stream previously played by the vehicle. Optionally, the first terminal device can display the management interface of the first category of audio streams in a foreground and / or background manner, and the management interface of the first category of audio streams is used to control playback / pause playback / termination of playback of the first category of audio streams.
[0549] As an example, the display form of the management interface of the first category of audio streams can be any one or more combinations of the following: displaying notifications on the lock screen interface, displaying notifications in a drop-down box, displaying a control widget on the main interface, displaying the management interface in the application corresponding to the first category of audio streams, displaying management results in the control center or displaying the management interface in other ways, etc., and the examples are not exhaustive here.
[0550] For a more intuitive understanding of this solution, please refer to Fig.37 , Fig.37 A schematic diagram of the first information in the audio stream processing method provided in an embodiment of the present application. Fig.37 It includes three sub-schematic diagrams (a), (b) and (c). Fig.37 (a) Sub-diagram and Fig.37 The first information is not shown in the sub-schematic diagram (c) of Fig.37 The first information is shown in sub-schematic diagram (c). Fig.37 The first category, media, is taken as an example. Fig.37 The (a) sub-schematic diagram shows an interface displayed by the first terminal device when the first terminal device plays an audio stream of the second category. Fig.37 In the example, the playback device of the second category audio stream has been switched to the first terminal device. Therefore, Fig.37 The first information will not appear in the sub-schematic diagram (a); Fig.37 The sub-schematic diagram (b) shows an interface displayed by the first terminal device when the first terminal device plays an audio stream of the first category. Fig.37 The D1 area in the sub-schematic diagram (b) outputs the first information in the form of a pop-up box; Fig.37 The (c) diagram shows that when the user Fig.37 The first information outputted by the sub-schematic diagram (b) switches the playback device of the first category of audio streams from the vehicle to the first terminal device, and the vehicle's central control screen displays the out-of-vehicle mode; it should be understood that Fig.37 The examples are only for facilitating the understanding of this solution and are not intended to limit this solution.
[0551] In one implementation, if step 3707 is not included, that is, the playback device of all categories of audio streams (including the first category and the second category) played by the vehicle is still the default vehicle, then when the first terminal device obtains a playback operation for a new audio stream, regardless of whether the new audio stream is of the first category or the second category, the first terminal device can output the first information, and the first information is used to prompt the user to switch the playback device of all categories of audio streams from the vehicle to the first terminal device. Furthermore, the way in which the first terminal device displays the first information can refer to the above description and will not be repeated here.
[0552] In an embodiment of the present application, when a playback operation for an audio stream of the first category is obtained again, a first information will be triggered to be output. The first information is used to prompt the user to switch the playback device of the audio stream of the first category from the vehicle to the first terminal device. That is, when the user uses the first terminal device to play the audio stream of the first category again, it can be decided whether to switch the playback device of the audio stream of the first category back to the first terminal device based on actual conditions, thereby improving the flexibility of the present solution in the switching process of the audio stream playback device.
[0553] 3709. The first terminal device stops sending the target audio stream to the vehicle.
[0554] In the embodiment of the present application, if in step 3705, the first terminal device determines that the target category corresponding to the target audio stream being played by the vehicle is not the first category, the playback device of all categories of audio streams (including the first category and the second category) generated by the first terminal device can be switched from the vehicle to the first terminal device. That is, the first terminal device stops sending the target audio stream to the vehicle, and correspondingly, the display interface of the vehicle's central control screen can enter the vehicle exit mode. In the aforementioned vehicle exit mode, the vehicle can prompt the user through the display interface of the central control screen that "all operations of the first terminal device are switched to the first terminal device".
[0555] Alternatively, after step 3708, if the user chooses to switch the playback device of the first category of audio streams from the vehicle to the first terminal device according to the first information, the first terminal device stops sending the audio stream to the vehicle.
[0556] As mentioned above, in a specific implementation, both step 3705 and step 3707 can be optional. For example: in one implementation, the aforementioned steps 3701-3704, step 3706-3709 may be included. Or, in another implementation, the aforementioned steps 3701-3706, step 3708 and step 3709 may be included; in this implementation, when it is determined in step 3705 that the target category is the first category, the first terminal device does not switch the playback devices corresponding to the audio streams of all categories; if the previous playback device of an audio stream of a certain category is the vehicle, it is still played in the vehicle; if the previous playback device of an audio stream of a certain category is the first terminal device, it is still played in the first terminal device.
[0557] In this implementation, not only a processing method is provided when the target audio stream is of the first category, but also a processing method is provided when the target audio stream is not of the first category, which improves the integrity of this solution and expands the application scenarios of this solution.
[0558] In an embodiment of the present application, when the first terminal device is detected to be moved from inside the vehicle to outside the vehicle while the first terminal device is connected to the vehicle, a target category corresponding to the target audio stream being played by the vehicle is obtained, and the target audio stream is sent by the first terminal device to the vehicle; if the target category is the first category, the vehicle continues to play the target audio stream; through the aforementioned scheme, it is possible to determine whether to switch the playback device of the audio stream back to the first terminal device according to the specific type of the audio stream being played by the vehicle, thereby improving the flexi...
Claims
1. A method for processing an audio stream, It is characterized in that The method is applied in a data processing system, the data processing system includes a first terminal device and a vehicle, and the method includes: The first terminal device establishes a connection with the vehicle; The first terminal device switches the playback device of the first category and the second category audio streams from the first terminal device to the vehicle; When the first terminal device is detected to move from inside the vehicle to outside the vehicle while the first terminal device is connected to the vehicle, a target category corresponding to a target audio stream being played by the vehicle is obtained, where the target audio stream is generated by the first terminal device and sent to the vehicle; If the target category is the first category, the vehicle continues to play the target audio stream.
2. The method according to claim 1, It is characterized in that The first category includes a media category, and the second category includes a non-media category.
3. The method according to claim 1 or 2, It is characterized in that The method further comprises: The playback device of the second category of audio stream is switched from the vehicle to the first terminal device, and the second category of audio stream is generated by the first terminal device.
4. The method according to claim 1 or 2, It is characterized in that The method further comprises: The first terminal device outputs first information, where the first information is used to prompt a user to switch a playback device of the target audio stream from the vehicle to the first terminal device.
5. The method according to claim 1 or 2, It is characterized in that If the target category is the first category, after the vehicle continues to play the target audio stream, the method further includes: When the first terminal device obtains the playback operation of the first audio stream, the first information is output; wherein the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream played by the vehicle, and the first information is used to prompt the user to switch the playback device of the first audio stream from the vehicle to the first terminal device.
6. The method according to claim 1 or 2, It is characterized in that The detecting that the first terminal device moves from inside the vehicle to outside the vehicle includes: The vehicle sends a plurality of target audio signals at a preset frequency, wherein the plurality of target audio signals include a first detection signal and a second detection signal, at least one arrival time includes a first time set corresponding to the first detection signal and a second time set corresponding to the second detection signal, the first time set includes at least one time when the first detection signal reaches the first terminal device by direct radiation and / or reflection, and the second time set includes at least one time when the second detection signal reaches the first terminal device by direct radiation and / or reflection; The first terminal device generates first location information corresponding to the terminal device according to the time interval between the arrival times in the first time set and the second time set, where the first location information is used to indicate that the first terminal device is inside or outside the vehicle; According to the first location information of the first terminal device within a preset time period, it is determined that the first terminal device moves from inside the vehicle to outside the vehicle.
7. The method according to claim 1 or 2, It is characterized in that The method further comprises: If the target category is not the first category, the target audio stream is switched to the first terminal device for playback.
8. A method for processing an audio stream, It is characterized in that The method is applied in a data processing system, the data processing system further comprising a vehicle and a first terminal device, and the method comprises: The vehicle establishes a connection with the first terminal; The vehicle receives data sent by the first terminal device, wherein the data includes a target audio stream; The vehicle plays the target audio stream; During the process of the vehicle playing the target audio stream, when a preset situation occurs, the target audio stream continues to be played, wherein the preset situation includes: the first terminal device moves from inside the vehicle to outside the vehicle while being connected to the vehicle, and the category of the target audio stream is the first category.
9. The method according to claim 8, It is characterized in that The playback device of the audio stream of the second category is switched to the first terminal device, the second category and the first category are different categories, and the audio stream of the second category is generated by the first terminal device.
10. A method for processing an audio stream, It is characterized in that The method is applied to a first terminal device, the first terminal device is included in a data processing system, the data processing system also includes a vehicle, and the method includes: The first terminal device establishes a connection with the vehicle; The first terminal device sends data to the vehicle, wherein the data includes a target audio stream; In the process of the target audio stream being played by the vehicle and the first terminal device being connected to the vehicle, when it is detected that the first terminal device moves from inside the vehicle to outside the vehicle, obtaining a target category corresponding to the target audio stream being sent to the vehicle; If the target category is the first category, continue to send the target audio stream to the vehicle.
11. The method according to claim 10, It is characterized in that The first category includes media.
12. The method according to claim 11, It is characterized in that The method further comprises: Switching a playback device of an audio stream of a second category from the vehicle to the first terminal device, the audio stream of the second category being generated by the first terminal device, and the second category being a non-media category; If the first terminal device receives a play instruction to play the second audio stream, the first terminal device plays the second audio stream; the category of the second audio stream is the second category.
13. The method according to any one of claims 10 to 12, It is characterized in that The method further comprises: Outputting first information, where the first information is used to prompt a user to switch a playback device of the target audio stream from the vehicle to the first terminal device.
14. The method according to any one of claims 10 to 12, It is characterized in that If the target category is the first category, after continuing to send the target audio stream to the vehicle, the method further includes: When the first terminal device obtains the playback operation of the first audio stream, the first information is output; wherein the category of the first audio stream is the first category, and the first audio stream is different from the target audio stream played by the vehicle, and the first information is used to prompt the user to switch the playback device of the first audio stream from the vehicle to the first terminal device.
15. The method according to claim 10 or 11, It is characterized in that The method further comprises: If the target category is not the first category, the first terminal device continues to play the target audio stream.
16. A method for processing an audio stream, It is characterized in that The method is applied to a data processing system, the data processing system includes a first terminal device and a vehicle, and the method includes: The first terminal device establishes a connection with the vehicle; The first terminal device switches a playback device of a third category of audio streams from the first terminal device to the vehicle, where the third category includes all categories corresponding to the audio streams played by the first terminal device through the vehicle; When the first terminal device is detected to move from inside the vehicle to outside the vehicle while the first terminal device is connected to the vehicle, a target category corresponding to a target audio stream being played by the vehicle is obtained, where the target audio stream is generated by the first terminal device and sent to the vehicle; The target audio stream continues to be played by the vehicle, and the playback device of the audio streams of the second category other than the target category in the third category is switched from the vehicle to the first terminal device.
17. The method according to claim 16, It is characterized in that The continuing to play the target audio stream by the vehicle includes: if the target category is the first category, continuing to play the target audio stream by the vehicle.
18. A vehicle, It is characterized in that The invention comprises a processor, wherein the processor is coupled to a memory, wherein the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the vehicle implements the steps performed by the vehicle in any one of the methods of claims 1 to 7, or the vehicle implements the method of claim 8 or 9, or the vehicle implements the steps performed by the vehicle in the method of claim 16 or 17.
19. A terminal device, It is characterized in that The invention comprises a processor, wherein the processor is coupled to a memory, wherein the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the terminal device implements the steps performed by the terminal device in the method described in any one of claims 1 to 7, or the terminal device implements the method described in any one of claims 10 to 15, or the terminal device implements the steps performed by the terminal device in the method described in claim 16 or 17.
20. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores program codes, and when the program codes are executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 17.
21. A computer program product, It is characterized in that The method comprises a program code, which is used to perform the method according to any one of claims 1 to 17 when the program code is executed on a computer or a processor.
