Audio playing method, vehicle, mobile terminal and storage medium

Abstract

The present disclosure relates to an audio playing method, a vehicle, a mobile terminal and a storage medium. The audio playing method comprises: receiving a first audio and / or a second audio sent by a mobile terminal located in the vehicle; determining a current driving scenario of the vehicle; playing at most one of the first audio and / or the second audio according to the current driving scenario; and sending an instruction to the mobile terminal, so that the mobile terminal modulates the audio of the first audio and / or the second audio which is not played by the vehicle to an ultrasonic frequency band for directional playing. The audio playing method can improve the driving experience of the driver.

Description

Technical Field

[0001] This disclosure pertains to the field of vehicle technology, and particularly relates to audio playback methods, vehicles, mobile terminals, and storage media. Background Technology

[0002] In modern cars, navigation and music playback have become common features. Navigation and music information can be output through the vehicle's audio system, allowing drivers to easily obtain navigation guidance while enjoying music. Furthermore, some vehicles offer intelligent voice assistant functions, allowing drivers to control navigation and music playback via voice commands, which makes operating the vehicle's navigation and entertainment systems safer. Summary of the Invention

[0003] In a first aspect, embodiments of this disclosure provide an audio playback method applied to a vehicle. The audio playback method includes: receiving a first audio and / or a second audio sent by a mobile terminal located inside the vehicle; determining the current driving scenario of the vehicle; playing at most one of the first audio and / or the second audio according to the current driving scenario; and sending an instruction to the mobile terminal, causing the mobile terminal to modulate the audio in the first audio and / or the second audio that is not played by the vehicle to an ultrasonic frequency band for directional playback based on the instruction.

[0004] In one implementation of the first aspect, when the current driving scenario includes only the driver, the vehicle plays the first audio, and the mobile terminal modulates the second audio to the ultrasonic frequency band for directional playback based on the instruction.

[0005] In one implementation of the first aspect, the current driving scenario includes a driver and one or more passengers, and at least one passenger is detected to be in a resting state. The vehicle does not play the first audio and / or the second audio, and the mobile terminal modulates the first audio and / or the second audio to the ultrasonic frequency band for directional playback based on the instruction.

[0006] In one implementation of the first aspect, the first audio is music audio and the second audio is navigation audio.

[0007] In one implementation of the first aspect, the mobile terminal modulates audio from the first audio and / or the second audio that is not played by the vehicle onto an ultrasonic frequency band for directional playback based on the instruction, comprising: the mobile terminal determining the first audio and / or the second audio that is not played by the vehicle based on the instruction; the mobile terminal's carrier oscillator generating a high-frequency oscillation signal; the mobile terminal's modulator modulating the audio signals of the first audio and / or the second audio into the high-frequency oscillation signal; and the mobile terminal's ultrasonic transmitter propagating the ultrasonic signal mixed with the audio signal directionally along the direction in which the mobile terminal screen faces.

[0008] In one implementation of the first aspect, determining the current driving scenario of the vehicle includes: acquiring images inside the vehicle using a camera, and determining the current driving scenario based on the images.

[0009] Secondly, this disclosure provides an audio playback method applied to a mobile terminal. The audio playback method includes: sending a first audio and / or a second audio to a vehicle where the mobile terminal is located, so that the vehicle plays at most one of the first audio and / or the second audio based on the current driving scenario; receiving an instruction sent by the vehicle, and based on the instruction, modulating the audio of the first audio and / or the second audio that is not played by the vehicle to an ultrasonic frequency band for directional playback.

[0010] In one implementation of the second aspect, when the current driving scenario only includes the driver, the vehicle plays the first audio, and the mobile terminal modulates the second audio to the ultrasonic frequency band for directional playback based on the instruction.

[0011] In one implementation of the second aspect, the current driving scenario includes a driver and one or more passengers, and at least one passenger is detected to be in a resting state. The vehicle does not play the first audio and / or the second audio, and the mobile terminal modulates the first audio and / or the second audio to the ultrasonic frequency band for directional playback based on the instruction.

[0012] In one implementation of the second aspect, the first audio is music audio and the second audio is navigation audio.

[0013] In one implementation of the second aspect, based on the instruction, one or both of the first audio and the second audio that are not played by the vehicle are modulated to an ultrasonic frequency band for directional playback, including: determining the first audio and / or the second audio that are not played by the vehicle based on the instruction; the carrier oscillator of the mobile terminal generates a high-frequency oscillation signal, and the modulator of the mobile terminal modulates the audio signals of the first audio and / or the second audio into the high-frequency oscillation signal; the ultrasonic transmitter of the mobile terminal propagates the ultrasonic signal mixed with the audio signal directionally along the direction in which the mobile terminal screen faces.

[0014] Thirdly, embodiments of this disclosure provide a vehicle, the vehicle comprising: a memory storing a computer program; and a processor communicatively connected to the memory, which executes the method described in any one of the first aspects of this disclosure when the computer program is invoked.

[0015] Fourthly, embodiments of this disclosure provide a mobile terminal, the mobile terminal comprising: a memory storing a computer program; and a processor communicatively connected to the memory, which executes the method described in any one of the second aspects of this disclosure when the computer program is invoked.

[0016] In one implementation of the fourth aspect, the mobile terminal further includes: a carrier oscillator configured to generate a high-frequency oscillation signal; a modulator configured to modulate an audio signal generated by the mobile terminal onto the high-frequency oscillation signal; and an ultrasonic transmitter configured to propagate an ultrasonic signal mixed with the audio signal in a directional manner along the direction in which the screen of the mobile terminal faces.

[0017] Fifthly, embodiments of this disclosure provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in any one of the first or second aspects of this disclosure. Attached Figure Description

[0018] Figure 1 The diagram shown illustrates an application scenario of an audio playback method provided in an embodiment of this disclosure.

[0019] Figure 2 The flowchart shown is an embodiment of an audio playback method provided in this disclosure.

[0020] Figure 3 The diagram shown is a schematic representation of directional audio signal transmission in one embodiment of this disclosure.

[0021] Figure 4A The diagram shown is a schematic diagram of a directional screen provided in an embodiment of this disclosure.

[0022] Figure 4BThe diagram shown is a schematic representation of the directional propagation of sound waves in one embodiment of this disclosure.

[0023] Figure 5 This is a flowchart illustrating the directional playback of audio that is not being played by a vehicle, according to one embodiment of this disclosure.

[0024] Figure 6 The flowchart shown is an embodiment of an audio playback method provided in this disclosure.

[0025] Figure 7 This is a flowchart illustrating the directional playback of audio that is not being played by a vehicle, according to one embodiment of this disclosure. Detailed Implementation

[0026] The following specific examples illustrate the implementation of this disclosure. Those skilled in the art can easily understand other advantages and effects of this disclosure from the content disclosed in this specification. This disclosure can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this disclosure. It should be noted that, unless otherwise specified, the following embodiments and features in the embodiments can be combined with each other.

[0027] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this disclosure. Therefore, the illustrations only show the components related to this disclosure and are not drawn according to the number, shape and size of the components in actual implementation. In actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0028] The following embodiments of this disclosure provide an audio playback method. Figure 1 The diagram illustrates an application scenario of an audio playback method provided in an embodiment of this disclosure. For example... Figure 1 As shown, the device includes a vehicle with a mobile terminal inside, which is connected to the vehicle's infotainment system.

[0029] In the embodiments of this disclosure, the mobile terminal may include terminal devices such as mobile phones, tablet computers, wearable devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs), but is not limited thereto.

[0030] For example, a vehicle infotainment system can be a multi-functional in-vehicle terminal installed on the dashboard. It typically includes a central control unit and is equipped with a touchscreen, knobs, or buttons for user convenience. The system can provide various functions for drivers and passengers, such as audio and video playback, Bluetooth connectivity, vehicle information display, voice recognition and control, intelligent assistants, and information communication.

[0031] Various communication methods can be used to connect the mobile terminal and the vehicle's infotainment system to achieve data exchange, function control, and information transmission. For example, in some embodiments, the mobile terminal and the vehicle's infotainment system can establish a wireless connection via Bluetooth technology. In other embodiments, the mobile terminal and the vehicle's infotainment system can be connected via WiFi (Wireless Fidelity). In still other embodiments, the mobile terminal and the vehicle's infotainment system can also be connected via a wired connection using a USB (Universal Serial Bus) interface and a USB cable. It should be noted that the connection methods between the mobile terminal and the vehicle's infotainment system in this disclosure are not limited to the types listed above.

[0032] After a communication connection is established between the mobile terminal and the vehicle's infotainment system, the navigation audio and / or music audio generated by the mobile terminal can be transmitted to the vehicle's infotainment system via this connection. The infotainment system then controls the vehicle's audio system, speakers, and other devices to play the navigation audio and / or music audio. However, when there are other passengers in the vehicle, playing navigation audio and / or music audio through the audio system and speakers can interfere with and affect them. In some possible implementations, the navigation audio generated by the mobile terminal can also be played through the headrest speakers on the vehicle seats. However, installing headrest speakers in the vehicle increases vehicle costs, and headrest speakers are typically only used for playing navigation audio and not music audio.

[0033] One embodiment of this disclosure provides an audio playback method that can be applied to a vehicle. Figure 2 The flowchart shown is an example of an audio playback method provided in this disclosure. Figure 2 As shown, the audio playback method provided in this embodiment includes the following steps S21 to S24.

[0034] S21, receiving first audio and / or second audio sent by a mobile terminal located inside the vehicle.

[0035] In some possible implementations, the first audio can be music-related audio, such as a song that is playing or a music radio broadcast that is being listened to, and the second audio can be navigation-related audio, such as navigation announcements provided by a navigation application, but this disclosure is not limited to this.

[0036] For example, the vehicle's infotainment system can receive a song being played from a mobile terminal, or a navigation message from a mobile terminal, or both a song being played and a navigation message from a mobile terminal.

[0037] S22, determine the current driving scenario of the vehicle.

[0038] For example, a driving scenario could be one where the vehicle only includes the driver, or a driving scenario could be one where the vehicle includes both the driver and passengers and no passengers are resting, and another driving scenario could be one where the vehicle includes both the driver and passengers and at least one passenger is resting.

[0039] In one example, the current driving scenario can be determined based on the camera inside the vehicle. For instance, the camera can capture images of the vehicle's interior during driving, and these images can be input into a trained neural network for recognition to determine the number and status of people in the interior images, thereby determining the current driving scenario.

[0040] It is understood that the aforementioned neural network can be an open-source neural network, such as ResNet, VGG, Transformer, etc. The training process of the neural network can refer to the training process known in the field (e.g., dividing the network into training set, validation set, and test set, and training the network until the loss function no longer decreases, etc.). Therefore, this disclosure will not elaborate on the relevant content.

[0041] In one example, the current driving scenario can also be determined by combining the image recognition described above with sensors (such as pressure sensors) on the vehicle seat. For instance, the pressure value from the pressure sensor can be used to determine whether someone is sitting in the seat, and if someone is sitting there, image recognition can be used to determine the person's state, thereby determining the current driving scenario.

[0042] It is understood that the above methods for determining the current driving scenario are all exemplary descriptions of this disclosure and do not constitute a limitation of this disclosure.

[0043] In one example, the vehicle's current driving scenario can be used to determine whether the vehicle is playing a first audio and / or a second audio.

[0044] S23, play at most one of the first audio and / or the second audio based on the current driving scenario.

[0045] For example, when the vehicle includes only a driver, or when the vehicle includes a driver and passengers and no passengers are resting, the vehicle's in-vehicle speaker equipment or headrest equipment can be used to play one of the first audio or the second audio; when the vehicle includes a driver and passengers and at least one passenger is resting, the vehicle does not play the aforementioned first audio or the second audio.

[0046] S24, a command is sent to the mobile terminal, causing the mobile terminal to modulate the audio that is not played by the vehicle in the first audio and / or the second audio to the ultrasonic frequency band for directional playback. The target area for this directional playback could be, for example, the driver's head or more precisely, the ear area.

[0047] In some possible implementations, the mobile terminal sends a first audio signal or a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, not to play the first or second audio signal. The vehicle then sends a command to the mobile terminal to modulate the first or second audio signal onto an ultrasonic frequency band for directional playback.

[0048] In some possible implementations, the mobile terminal sends a first audio signal and a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, to play the first audio signal but not the second. The vehicle then sends a command to the mobile terminal to modulate the second audio signal onto an ultrasonic frequency band for directional playback.

[0049] In some possible implementations, the mobile terminal sends a first audio signal and a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, to play the second audio signal instead of the first. The vehicle sends a command to the mobile terminal to modulate the first audio signal onto an ultrasonic frequency band for directional playback.

[0050] In some possible implementations, the mobile terminal sends a first audio signal and a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, not to play the first and second audio signals. The vehicle then sends a command to the mobile terminal to modulate the first and second audio signals onto the ultrasonic frequency band for directional playback.

[0051] As described above, the audio playback method provided in this embodiment can play at most one of a first audio and / or a second audio based on the current driving scenario of the vehicle, and can also use a mobile terminal to play audio that is not being played in the vehicle. This approach can meet the different needs of drivers and passengers, and improve their driving experience.

[0052] In one example, such as Figure 3 As shown, an ultrasonic signal (i.e., a signal with a frequency greater than 20kHz) can be generated by a carrier oscillator (e.g., an ultrasonic oscillator) of a mobile terminal. After the audio signal is modulated onto the ultrasonic signal to form a carrier signal, the carrier signal is transmitted out along the direction of the ultrasonic transmitter through an ultrasonic transmitter.

[0053] It is understood that a mobile terminal may include one or more ultrasonic transmitters, for example, located in different areas of the mobile terminal and facing the same or different directions. Depending on the different directional directions, the aforementioned carrier signal can be configured to be emitted through different ultrasonic transmitters to meet the requirements of directional propagation.

[0054] It should be noted that the propagation of the aforementioned carrier signal in the air medium and in the skin and bones of the receiver can usually be regarded as a nonlinear system. After passing through the nonlinear system, the carrier signal will generate a new frequency (usually down-frequency). Since the human ear can only receive sound waves with frequencies from 20Hz to 20kHz, after receiving the down-frequency carrier signal, the human ear filters out the high-frequency ultrasound signal and retains only the low-frequency audio signal. In this way, the human ear can hear the directional audio signal again.

[0055] In one embodiment of this disclosure, directional playback can be achieved using a directional speaker on a mobile terminal. A directional speaker is an acoustic device that focuses sound into a specific area using ultrasound, preventing sound from spreading to other areas. The ultrasound emitted by the directional speaker is a sound wave with a frequency higher than the human hearing range (20Hz-20kHz). Ultrasound is generated by vibrating the surface of the directional speaker; as it propagates through the air, it is focused into a narrow beam due to acoustic impedance. When the ultrasound reaches the surface of an object, it causes minute vibrations on the surface, which are called sound wave vibrations or sound. Because ultrasound is only converted into audible sound when it is close to the target area, the directional speaker can focus sound only within a specific area.

[0056] In this embodiment of the disclosure, a directional screen modulates the audio to be played in a specific direction onto the ultrasonic frequency band, and uses the principle of acoustic focusing to focus the ultrasonic waves onto a specific area, thereby achieving directional transmission of the audio. Furthermore, during transmission, the audio is confined to a narrow sound beam, and sound waves outside the beam attenuate rapidly. Therefore, outside the target area for directional playback, sound is essentially inaudible. By controlling parameters such as the position, amplitude, and frequency of the sound source, the directional screen can precisely control the direction and range of sound propagation, achieving high-precision sound localization and focusing.

[0057] Figure 4A The diagram shown is a schematic of the directional screen in an embodiment of this disclosure. Figure 4B This diagram illustrates the directional propagation of sound waves in an embodiment of this disclosure. Figure 4A and Figure 4B As shown, the sound source modulates the audio to the ultrasonic frequency band through a conversion device, and focuses it through a beam lens to form a narrow sound beam. The audio will propagate along the sound beam without spreading to other areas.

[0058] As described above, in this embodiment, a directional screen uses ultrasonic technology to modulate the audio that is not played by the vehicle in the first and / or second audio frequencies onto the ultrasonic band, so that the audio is focused only on a specific target area and does not diffuse to other areas. When the directional screen is pointed at the driver, the directionally played audio can only be heard by the driver, and other passengers cannot hear it.

[0059] In one embodiment of this disclosure, the mobile terminal is fixed inside a vehicle, with its directional screen facing the driver. The mobile terminal can be fixed using a terminal bracket or other securing device. Furthermore, to ensure the directional screen faces the driver, the mobile terminal can be placed in a position easily accessible to the driver. For example, the mobile terminal can be placed on the vehicle's dashboard, or it can be fixed to a bracket facing the driver.

[0060] In one embodiment of this disclosure, when the current driving scenario involves only the driver, the vehicle plays a first audio signal, and the mobile terminal, based on an instruction, modulates a second audio signal to the ultrasonic frequency band for directional playback. Specifically, when only the driver is in the vehicle, to improve the driver's experience, the vehicle uses its in-vehicle speakers to play the first audio signal, shuts off the second audio signal transmitted from the mobile terminal, and sends an instruction to the mobile terminal. Based on the instruction, the mobile terminal modulates the second audio signal to the ultrasonic frequency band and uses an ultrasonic transmitter to directionally play it towards the driver. The in-vehicle speakers are, for example, the vehicle's infotainment system. This method avoids interference between the first and second audio signals, thereby providing the driver with a better driving experience.

[0061] In one embodiment of this disclosure, the current driving scenario includes a driver and one or more passengers, and at least one passenger is detected to be in a resting state. The vehicle does not play the first audio and / or the second audio from the mobile terminal. Specifically, when the mobile terminal only sends the first audio to the vehicle, the vehicle does not play the first audio and sends a command to the mobile terminal, which then modulates the first audio to the ultrasonic frequency band for directional playback based on the command. When the mobile terminal only sends the second audio to the vehicle, the processing method of the vehicle and the mobile terminal is similar to that when the mobile terminal only sends the first audio, and will not be described in detail here. When the mobile terminal sends both the first and second audio to the vehicle, the vehicle does not play either the first or second audio and sends a command to the mobile terminal, which then modulates the first and second audio to the ultrasonic frequency band for directional playback based on the command.

[0062] As can be seen from the above description, in this embodiment of the present disclosure, the vehicle will not play the first audio and / or the second audio from the first terminal, but will instead instruct the mobile terminal to play the first audio and / or the second audio in a specific direction, thereby reducing disturbance to the passengers in the vehicle.

[0063] Please see Figure 5 In one embodiment of this disclosure, enabling a mobile terminal to modulate audio that is not played by the vehicle in the first audio and / or the second audio to the ultrasonic frequency band for directional playback based on an instruction includes the following steps S51 to S53.

[0064] S51, the mobile terminal determines the first audio and / or the second audio that are not played by the vehicle based on the instruction.

[0065] For example, when a mobile terminal sends a first audio and a second audio to a vehicle, if the current scenario only includes the driver, the audio not played by the vehicle is the second audio; if the current scenario includes the driver and one or more passengers, and at least one passenger is detected to be resting, then the audio not played by the vehicle is both the first and second audio. As another example, when the mobile terminal only sends the second audio to the vehicle, if the current scenario only includes the driver, the audio not played by the vehicle is the second audio; if the current scenario includes the driver and one or more passengers, and at least one passenger is detected to be resting, then the audio not played by the vehicle is also the second audio.

[0066] S52, the carrier oscillator of the mobile terminal generates a high-frequency oscillation signal, and the modulator of the mobile terminal modulates the audio signals of the first audio and / or the second audio that are not played by the vehicle into the high-frequency oscillation signal.

[0067] It should be noted that the aforementioned carrier oscillator can be an ultrasonic oscillator, and the aforementioned high-frequency oscillation signal can be an ultrasonic signal, such as a 30kHz, 40kHz, or other higher frequency ultrasonic signal.

[0068] S53, the ultrasonic transmitter of the mobile terminal propagates an ultrasonic signal mixed with an audio signal in a directional manner along the direction in which the mobile terminal screen is facing.

[0069] In one embodiment of this disclosure, determining the current driving scenario of the vehicle includes: acquiring images inside the vehicle using a camera, and determining the current driving scenario based on the images.

[0070] In some possible implementations, OMS (Occupancy Monitoring System) cameras can be used to collect images inside the vehicle.

[0071] In some possible implementations, techniques such as deep learning models can be used to process images to determine whether the current driving scenario includes passengers and whether any passengers are resting.

[0072] In one embodiment of this disclosure, when the mobile terminal disconnects from the vehicle and detects that the user has left the vehicle and is performing a touch operation on the mobile terminal, if the user wants to play the first audio and / or the second audio using the mobile terminal, the mobile terminal prompts the user to select whether to play the first audio and / or the second audio in a specific direction through a system pop-up or other means.

[0073] One embodiment of this disclosure also provides another audio playback method, which can be applied, for example, to a mobile terminal. Figure 6 The flowchart shown is an example of an audio playback method provided in this disclosure. Figure 6 As shown, the audio playback method provided in this embodiment includes the following steps S61 and S62.

[0074] S61, send a first audio and / or a second audio to the vehicle where the mobile terminal is located, so that the vehicle plays at most one of the first audio and / or the second audio based on the current driving scenario.

[0075] In some possible implementations, the first audio can be music-related audio, such as a song that is playing or a music radio broadcast that is being listened to, and the second audio can be navigation-related audio, such as navigation announcements provided by a navigation application, but this disclosure is not limited to this.

[0076] For example, the mobile terminal sends a song that is playing to the vehicle it is in, or the mobile terminal sends a navigation message to the vehicle it is in, or the mobile terminal sends both the song that is playing and the navigation message to the vehicle it is in.

[0077] For example, a driving scenario may be one where the vehicle only includes a driver, or a driving scenario may be one where the vehicle includes a driver and passengers but no passengers are resting, and another driving scenario may be one where the vehicle includes a driver and passengers but at least one passenger is resting.

[0078] In one example, the current driving scenario can be determined based on the camera inside the vehicle. For instance, the camera can capture images of the vehicle's interior during driving, and these images can be input into a trained neural network for recognition to determine the number and status of people in the interior images, thereby determining the current driving scenario.

[0079] It is understood that the aforementioned neural network can be an open-source neural network, such as ResNet, VGG, Transformer, etc. The training process of the neural network can refer to the training process known in the field (e.g., dividing the network into training set, validation set, and test set, and training the network until the loss function no longer decreases, etc.). Therefore, this disclosure will not elaborate on the relevant content.

[0080] In one example, the current driving scenario can also be determined by combining the image recognition described above with sensors (such as pressure sensors) on the vehicle seat. For instance, the pressure value from the pressure sensor can be used to determine whether someone is sitting in the seat, and if someone is sitting there, image recognition can be used to determine the person's state, thereby determining the current driving scenario.

[0081] It is understood that the above methods for determining the current driving scenario are all exemplary descriptions of this disclosure and do not constitute a limitation of this disclosure.

[0082] For example, when the vehicle includes only a driver, or when the vehicle includes a driver and passengers and no passengers are resting, the vehicle's in-vehicle speaker equipment or headrest equipment can be used to play one of the first audio or the second audio; when the vehicle includes a driver and passengers and at least one passenger is resting, the vehicle does not play the aforementioned first audio or the second audio.

[0083] S62, receiving instructions from the vehicle, and based on the instructions, modulating the audio from the first audio and / or the second audio that is not played by the vehicle to the ultrasonic frequency band for directional playback. The target area for this directional playback could be, for example, the driver's head or more precisely, the ear area.

[0084] In some possible implementations, the mobile terminal sends a first audio signal or a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, not to play the first or second audio signal. The mobile terminal receives an instruction from the vehicle and, based on the instruction, modulates the first or second audio signal into an ultrasonic frequency band for directional playback.

[0085] In some possible implementations, the mobile terminal sends a first audio signal and a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, to play the first audio signal but not the second. The mobile terminal receives instructions from the vehicle and, based on those instructions, modulates the second audio signal into the ultrasonic frequency band for directional playback.

[0086] In some possible implementations, the mobile terminal sends a first audio signal and a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, to play the second audio signal instead of the first. The mobile terminal receives instructions from the vehicle and, based on those instructions, modulates the first audio signal onto an ultrasonic frequency band for directional playback.

[0087] In some possible implementations, the mobile terminal sends a first audio signal and a second audio signal to the vehicle. The vehicle determines, based on the current driving scenario, not to play the first and second audio signals. The mobile terminal receives instructions from the vehicle and, based on these instructions, modulates the first and second audio signals into the ultrasonic frequency band for directional playback.

[0088] In one embodiment of this disclosure, when the current driving scenario involves only the driver, the vehicle plays a first audio signal, and the mobile terminal, based on an instruction, modulates a second audio signal to the ultrasonic frequency band for directional playback. Specifically, when only the driver is in the vehicle, to improve the driver's experience, the vehicle uses its in-vehicle speakers to play the first audio signal, shuts off the second audio signal transmitted from the mobile terminal, and sends an instruction to the mobile terminal. Based on the instruction, the mobile terminal uses its built-in ultrasonic transmitter to modulate the second audio signal to the ultrasonic frequency band for directional playback towards the driver. The in-vehicle speakers are, for example, the vehicle's infotainment system speakers. This method avoids interference between the first and second audio signals, thereby providing the driver with a better driving experience.

[0089] In one embodiment of this disclosure, the current driving scenario includes a driver and one or more passengers, and at least one passenger is detected to be in a resting state. The vehicle does not play the first audio and / or the second audio from the mobile terminal. Specifically, when the mobile terminal only sends the first audio to the vehicle, the vehicle does not play the first audio and sends a command to the mobile terminal, which then modulates the first audio to the ultrasonic frequency band for directional playback based on the command. When the mobile terminal only sends the second audio to the vehicle, the processing method of the vehicle and the mobile terminal is similar to that when the mobile terminal only sends the first audio, and will not be described in detail here. When the mobile terminal sends both the first and second audio to the vehicle, the vehicle does not play either the first or second audio and sends a command to the mobile terminal, which then modulates the first and second audio to the ultrasonic frequency band for directional playback based on the command.

[0090] Please see Figure 7 In one embodiment of this disclosure, the step of modulating one or both of the first and second audio frequencies that are not played by the vehicle into the ultrasonic frequency band for directional playback based on instructions includes steps S71 to S73.

[0091] S71, based on instructions, determines the first audio and / or the second audio that is not played by the vehicle.

[0092] For example, when a mobile terminal sends a first audio and a second audio to a vehicle, if the current scenario only includes the driver, the audio not played by the vehicle is the second audio; if the current scenario includes the driver and one or more passengers, and at least one passenger is detected to be resting, then the audio not played by the vehicle is both the first and second audio. As another example, when the mobile terminal only sends the second audio to the vehicle, if the current scenario only includes the driver, the audio not played by the vehicle is the second audio; if the current scenario includes the driver and one or more passengers, and at least one passenger is detected to be resting, then the audio not played by the vehicle is also the second audio.

[0093] S72, the carrier oscillator of the mobile terminal generates a high-frequency oscillation signal, and the modulator of the mobile terminal modulates the audio signals of the first audio and / or the second audio into the high-frequency oscillation signal.

[0094] It should be noted that the aforementioned carrier oscillator can be an ultrasonic oscillator, and the aforementioned high-frequency oscillation signal can be an ultrasonic signal, such as a 30kHz, 40kHz, or other higher frequency ultrasonic signal.

[0095] S73, the ultrasonic transmitter of the mobile terminal propagates an ultrasonic signal mixed with an audio signal in a directional manner along the direction in which the mobile terminal screen is facing.

[0096] One embodiment of this disclosure also provides a vehicle, which includes a memory and a processor. The memory is used to store computer programs. In some possible implementations, the memory may include various media capable of storing program code, such as ROM, RAM, magnetic disk, USB flash drive, memory card, or optical disk.

[0097] In embodiments of this disclosure, the memory may include a computer system readable medium in the form of volatile memory, such as RAM and / or cache memory. The memory may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this disclosure.

[0098] The processor communicates with the memory to execute computer programs stored in the memory, enabling the electronic device to perform at least the following tasks: Figure 2 The audio playback method is shown.

[0099] In this embodiment of the disclosure, the processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0100] One embodiment of this disclosure also provides a mobile terminal. The mobile terminal includes a memory and a processor. The memory is used to store computer programs. In some possible implementations, the memory may include various media capable of storing program code, such as ROM, RAM, magnetic disk, USB flash drive, memory card, or optical disk.

[0101] In embodiments of this disclosure, the memory may include a computer system readable medium in the form of volatile memory, such as RAM and / or cache memory. The memory may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this disclosure.

[0102] The processor communicates with the memory to execute computer programs stored in the memory, enabling the electronic device to perform at least the following tasks: Figure 2 or Figure 6 The audio playback method is shown.

[0103] In this embodiment of the disclosure, the processor may be a general-purpose processor, including a central processing unit, a network processor, etc.; it may also be a digital signal processor, an application-specific integrated circuit, a field-programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component.

[0104] In one embodiment of this disclosure, the mobile terminal may further include a carrier oscillator, a modulator, and an ultrasonic transmitter. The carrier oscillator is configured to generate a high-frequency oscillation signal. The modulator is configured to modulate an audio signal generated by the mobile terminal onto the high-frequency oscillation signal. The ultrasonic transmitter is configured to propagate the ultrasonic signal, which is mixed with the audio signal, in a directional manner along the direction in which the mobile terminal screen is facing.

[0105] In one embodiment of this disclosure, a computer-readable storage medium is also provided, on which a computer program is stored, which, when executed by a processor, at least implements... Figure 2 or Figure 6 The audio playback method is illustrated. Those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing a processor. The program can be stored in a computer-readable storage medium, which is a non-transitory medium, such as random access memory, read-only memory, flash memory, hard disk, solid-state drive, magnetic tape, floppy disk, optical disc, and any combination thereof. The storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. This available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disc (DVD)), or a semiconductor medium (e.g., solid-state drive (SSD)).

[0106] The descriptions of the processes or structures corresponding to the above figures each have their own emphasis. For parts of a process or structure that are not described in detail, please refer to the relevant descriptions of other processes or structures.

[0107] The above embodiments are merely illustrative of the principles and effects of this disclosure and are not intended to limit this disclosure. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this disclosure. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this disclosure should still be covered by the claims of this disclosure.

Claims

1. An audio playback method, applied in a vehicle, comprising: Receive a first audio and / or a second audio from a mobile terminal located inside the vehicle, wherein the mobile terminal is fixed inside the vehicle, the directional screen of the mobile terminal faces the driver, the first audio is music audio, and the second audio is navigation audio; Determine the current driving and riding scenario of the vehicle; Play at most one of the first audio and / or the second audio according to the current driving scenario; Send an instruction to the mobile terminal, causing the mobile terminal to modulate the audio that was not played by the vehicle in the first audio and / or the second audio to the ultrasonic frequency band for directional playback based on the instruction; When the current driving scenario only includes the driver, the vehicle plays the first audio, and the mobile terminal modulates the second audio to the ultrasonic frequency band for directional playback based on the instruction; The current driving scenario includes a driver and one or more passengers, and at least one passenger is detected to be in a resting state: If the mobile terminal only sends the first audio to the vehicle, and the vehicle does not play the first audio and sends an instruction to the mobile terminal, the mobile terminal modulates the first audio to the ultrasonic frequency band for directional playback based on the instruction; If the mobile terminal only sends the second audio to the vehicle, and the vehicle does not play the second audio and sends a command to the mobile terminal, the mobile terminal modulates the second audio to the ultrasonic frequency band for directional playback based on the command; If the mobile terminal sends the first audio and the second audio to the vehicle, the vehicle does not play the first audio and the second audio and sends a command to the mobile terminal. Based on the command, the mobile terminal modulates the first audio and the second audio to the ultrasonic frequency band for directional playback.

2. The audio playback method according to claim 1, wherein the mobile terminal modulates the audio that was not played by the vehicle in the first audio and / or the second audio to the ultrasonic frequency band for directional playback based on the instruction, comprising: The mobile terminal determines, based on the instruction, the first audio and / or the second audio that were not played by the vehicle; The carrier oscillator of the mobile terminal generates a high-frequency oscillation signal, and the modulator of the mobile terminal modulates the audio signals of the first audio and / or the second audio onto the high-frequency oscillation signal. The ultrasonic transmitter of the mobile terminal propagates the ultrasonic signal, which is mixed with the audio signal, in a directional manner along the direction in which the mobile terminal screen is facing.

3. The audio playback method according to claim 1, determining the current driving scenario of the vehicle, includes: The system uses a camera to capture images inside the vehicle and determines the current driving / riding scenario based on these images.

4. An audio playback method, applied to a mobile terminal, comprising: Send a first audio and / or a second audio to the vehicle where the mobile terminal is located, so that the vehicle plays at most one of the first audio and / or the second audio based on the current driving scenario, wherein the first audio is music audio and the second audio is navigation audio; Receive instructions sent by the vehicle, and based on the instructions, modulate the audio that was not played by the vehicle in the first audio and / or the second audio to the ultrasonic frequency band for directional playback; The mobile terminal is fixed inside the vehicle, with its directional screen facing the driver. When the current driving scenario only includes the driver, the vehicle plays the first audio, and the mobile terminal modulates the second audio to the ultrasonic frequency band for directional playback based on the instruction; The current driving scenario includes a driver and one or more passengers, and at least one passenger is detected to be in a resting state: If the mobile terminal only sends the first audio to the vehicle, and the vehicle does not play the first audio and sends an instruction to the mobile terminal, the mobile terminal modulates the first audio to the ultrasonic frequency band for directional playback based on the instruction; If the mobile terminal only sends the second audio to the vehicle, and the vehicle does not play the second audio and sends a command to the mobile terminal, the mobile terminal modulates the second audio to the ultrasonic frequency band for directional playback based on the command; If the mobile terminal sends the first audio and the second audio to the vehicle, the vehicle does not play the first audio and the second audio and sends a command to the mobile terminal. Based on the command, the mobile terminal modulates the first audio and the second audio to the ultrasonic frequency band for directional playback.

5. The audio playback method according to claim 4, wherein one or both of the first audio and the second audio that are not played by the vehicle are modulated to an ultrasonic frequency band for directional playback based on the instruction, comprising: Based on the instruction, determine the first audio and / or the second audio that were not played by the vehicle; The carrier oscillator of the mobile terminal generates a high-frequency oscillation signal, and the modulator of the mobile terminal modulates the audio signals of the first audio and / or the second audio onto the high-frequency oscillation signal. The ultrasonic transmitter of the mobile terminal propagates the ultrasonic signal, which is mixed with the audio signal, in a directional manner along the direction in which the mobile terminal screen is facing.

6. A vehicle, wherein, The vehicles include: A memory that stores a computer program; The processor, which is communicatively connected to the memory, executes the method of any one of claims 1 to 3 when the computer program is invoked.

7. A mobile terminal, wherein, The mobile terminal includes: A memory that stores a computer program; The processor, which is communicatively connected to the memory, executes the method of any one of claims 4 to 5 when the computer program is invoked.

8. The mobile terminal according to claim 7, further comprising: A carrier oscillator is configured to generate a high-frequency oscillation signal; A modulator is configured to modulate an audio signal generated by the mobile terminal onto the high-frequency oscillation signal; An ultrasonic transmitter is configured to propagate an ultrasonic signal, which is mixed with the audio signal, in a directional manner along the direction in which the mobile terminal screen is facing.

9. A computer-readable storage medium having a computer program stored thereon, wherein, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 3, or the method of any one of claims 4 to 5.

Images