An audio playing method, an electronic device and a storage medium

Abstract

The application provides an audio playing method, an electronic device and a storage medium, and belongs to the technical field of vehicle control. The method is applied to a vehicle controller which is in communication connection with a mobile terminal. The method comprises the following steps: receiving audio data of the mobile terminal; in response to the audio data, controlling a vehicle playing device to play the audio data; in response to listening to a first target event, obtaining an audio file matched with the audio data from a target data source other than the mobile terminal; the first target event refers to an event of interrupting an audio playing process of the mobile terminal playing the audio data; and controlling the vehicle playing device to play the audio file. In this way, once the vehicle controller listens to the first event of interrupting the audio playing process of the mobile terminal, the playing source of the audio indicated by the audio data can be changed from the mobile terminal to the target data source other than the mobile terminal, so as to reduce the situation that the audio data played by the vehicle playing device is interrupted, and a better music experience can be brought to the user.

Description

Technical Field

[0001] This application belongs to the field of vehicle control technology, and in particular relates to an audio playback method, electronic device and storage medium. Background Technology

[0002] Currently, passengers have increasingly higher requirements for sound quality when listening to audio. Therefore, they often use mobile devices to connect to the vehicle's Bluetooth to play audio, ensuring that the sound quality and volume meet their needs in the relatively enclosed vehicle space.

[0003] In related technologies, if the mobile terminal receives an incoming call during the Bluetooth connection process between the mobile terminal and the vehicle, the audio played on the mobile terminal will be interrupted, and consequently, the audio played by the vehicle's Bluetooth connected to the mobile terminal will also be interrupted. Summary of the Invention

[0004] In view of this, this application provides an audio playback method, an electronic device, and a storage medium to solve the technical problem in the related art where the audio played by the in-vehicle Bluetooth connected to the mobile terminal is interrupted when a call comes in.

[0005] One object of this application is to provide an audio playback method applied to a vehicle controller, the vehicle controller being communicatively connected to a mobile terminal, the method comprising the following steps:

[0006] Receive audio data from the mobile terminal;

[0007] In response to the audio data, control the vehicle playback device to play the audio data;

[0008] In response to the detection of a first target event, an audio file matching the audio data is obtained from a target data source other than the mobile terminal; the first target event refers to an event that interrupts the audio playback process of the mobile terminal playing the audio data.

[0009] Control the vehicle's playback device to play the audio file.

[0010] Another object of this application is to provide an electronic device, including a processor, a memory, and computer instructions stored in the memory and executable on the processor, wherein the computer instructions, when executed by the processor, implement the above-described audio playback method.

[0011] Another object of this application is to provide a readable storage medium storing computer instructions that, when executed by a processor, implement the above-described audio playback method.

[0012] This application provides an audio playback method, an electronic device, and a readable storage medium. Its advantage is that once the vehicle controller detects the first event that interrupts the audio playback process of the mobile terminal, it can change the audio playback source indicated by the audio data from the mobile terminal to a target data source outside the mobile terminal, thereby reducing the interruption of the audio data played by the vehicle playback device and providing users with a better music experience.

[0013] The above description is merely an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this application more obvious and understandable, specific embodiments of this application are given below. Attached Figure Description

[0014] Figure 1 This is a flowchart illustrating the steps of an audio playback method provided in an embodiment of this application;

[0015] Figure 2 This is a flowchart of another audio playback method provided in an embodiment of this application;

[0016] Figure 3 This is a flowchart illustrating the steps of another audio playback method provided in this application embodiment;

[0017] Figure 4 This is a logic flowchart of an audio playback method provided in an embodiment of this application;

[0018] Figure 5 This is an interactive schematic diagram of audio playback provided in an embodiment of this application;

[0019] Figure 6 This is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0020] Exemplary embodiments of the present application will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the scope of the present application to those skilled in the art.

[0021] Currently, Xiaomi's MiPlay only streams audio between Xiaomi phones and smart speakers, essentially relaying audio between various smart devices. Apple's audio relay feature, however, allows you to simply bring your iPhone close to your Apple smart speaker (HomePod mini) to take over the audio playing on the HomePod mini. Conversely, music playing on the HomePod mini can also be relayed to the iPhone when it's brought close.

[0022] The smart cockpit supports multi-zone audio, allowing users to continue listening to their preferred audio in different zones. Vehicle smart cockpits often use smartphones to play Bluetooth music. Therefore, once a Bluetooth connection is established between the phone and the vehicle, if the phone is playing audio, the audio played by the vehicle's infotainment system is transmitted to the vehicle via Bluetooth. If the phone makes a call or receives an incoming call, the music playback on the phone will be interrupted, causing the phone to pause playback. In this case, the vehicle's infotainment system will also pause playback.

[0023] When the driver's phone is connected to the vehicle's infotainment system via Bluetooth, if the phone is playing audio and receives an incoming call, the audio playback will pause. This is because the driver needs to answer the call, but the passenger does not. If the driver, in the driver's seat, answers the call, it will interrupt the passenger's enjoyment of music.

[0024] To address the aforementioned problems, this application proposes an audio playback method, an electronic device, and a readable storage medium.

[0025] Figure 1 This is a flowchart illustrating the steps of an audio playback method provided in this application embodiment. The method is applied to a vehicle controller, which is communicatively connected to a mobile terminal. The method includes the following steps:

[0026] Step 101: Receive audio data from the mobile terminal.

[0027] In the embodiments of this application, the mobile terminal can be a mobile electronic device, such as a mobile phone, tablet computer, laptop computer, handheld computer, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc., or it can be a non-mobile electronic device, such as a server, network attached storage (NAS), personal computer (PC), etc. The specific device can be determined according to actual needs and is not limited here.

[0028] In this embodiment of the application, the audio data may include at least: audio volume, song title, artist name, and first playback progress, wherein the first playback progress is the current playback position of the Bluetooth music currently being played on the mobile terminal, the song title is the name of the Bluetooth music currently being played on the mobile terminal, the artist name is the name of the artist of the Bluetooth music currently being played on the mobile terminal, and the audio volume is the volume of the Bluetooth music currently being played on the mobile terminal. The specific details can be determined according to actual needs and are not limited here.

[0029] In this embodiment, the mobile terminal searches for the vehicle's Bluetooth. When the mobile terminal finds the vehicle's Bluetooth, it establishes a Bluetooth connection with the vehicle's Bluetooth. If the mobile terminal is playing audio data, the audio data will be transmitted to the vehicle via Bluetooth when the user selects Bluetooth playback. At this time, the vehicle controller will receive the audio data.

[0030] For example, see Figure 4 and Figure 5As shown, the mobile terminal activates the Bluetooth search function to search for the vehicle's Bluetooth. It then determines whether the vehicle's Bluetooth is found. If the mobile terminal finds the vehicle's Bluetooth, it establishes a Bluetooth connection. If the mobile terminal receives a Bluetooth selection operation from the user, the vehicle controller can determine whether the vehicle's playback device is playing audio data. If so, the audio data played by the mobile terminal's multimedia system can be transmitted to the vehicle via the classic Bluetooth Audio / Video Remote Control Profile (AVRCP). The vehicle controller receives this audio data and, upon receiving it, uses the audio continuation module to extract information such as audio volume, song title, artist name, and first playback duration from the currently playing Bluetooth music audio data every preset interval (e.g., 1 second or 2 seconds). This information is then recorded and updated in real-time to the continuation media database via the smart cockpit AVRCP.

[0031] In this embodiment of the application, the preset duration can be a default value preset in the system (e.g., 1s) or a default value preset in the vehicle controller (e.g., 2s). The specific duration can be determined according to actual needs and is not limited here.

[0032] Step 102: In response to the audio data, control the vehicle's playback device to play the audio data.

[0033] In this embodiment of the application, the vehicle playback device can be any of the vehicle's in-vehicle playback devices (e.g., car audio or speakers), or it can be one or more of all the in-vehicle playback devices. The specific device can be determined according to actual needs and is not limited here.

[0034] In this embodiment of the application, after the vehicle controller receives the audio data sent by the mobile terminal, the vehicle controller will respond to the audio data and control the vehicle playback device to play the audio data.

[0035] For example, after the vehicle controller receives audio data sent by the mobile terminal, the vehicle controller searches for currently available vehicle playback devices and then controls the available vehicle playback devices to play the audio data.

[0036] Step 103: In response to the first target event being detected, obtain an audio file that matches the audio data from a target data source other than the mobile terminal.

[0037] In this embodiment of the application, the first target event refers to the event that interrupts the audio playback process of the mobile terminal playing audio data. The first target event may include at least: a telephone call event and a network interruption event. The specific event can be determined according to actual needs and is not limited here.

[0038] In this embodiment, the target data source may include: local storage and cloud server. The vehicle controller is communicatively connected to the local storage and cloud server. The local storage may include: USB flash drive, vehicle local storage, etc. The cloud server may include: Kuwo Cloud, NetEase Cloud Music Cloud, etc. The specific data source can be determined according to actual needs and is not limited here.

[0039] In this embodiment of the application, when the vehicle playback device plays audio data from the mobile terminal, if the vehicle controller detects the first target event, it will respond to the detection of the first target event by obtaining an audio file that matches the audio data from a target data source other than the mobile terminal.

[0040] For example, see Figure 4 As shown, when the vehicle playback device plays audio data from the mobile terminal, if the vehicle controller detects a first target event (e.g., an incoming phone call) through the smart cockpit, it will respond by first determining the target data source other than the mobile terminal, and then obtaining the audio file that matches the audio data from that target data source.

[0041] Step 104: Control the vehicle's playback device to play audio files.

[0042] In this embodiment of the application, after the vehicle controller obtains an audio file that matches the audio data, the vehicle controller can control at least one of the vehicle playback devices to play the audio file.

[0043] For example, after the vehicle controller obtains an audio file that matches the audio data, the vehicle controller can search for currently available vehicle playback devices and then control the available vehicle playback devices to play the audio file, or search for the user's location in the vehicle and control the vehicle playback device at the user's location to play the audio file.

[0044] This application provides an audio playback method that receives audio data from a mobile terminal and then controls a vehicle playback device to play the audio data in response to the audio data. Once the vehicle controller detects a first event that interrupts the audio playback process of the mobile terminal, it can obtain an audio file matching the audio data from a target data source outside the mobile terminal. This changes the playback source of the audio indicated by the audio data from the mobile terminal to a target data source outside the mobile terminal, and then controls the vehicle playback device to play the audio file. This reduces the chances of the audio data being interrupted by the vehicle playback device and provides users with a better music experience.

[0045] Figure 2 This is a flowchart illustrating another audio playback method provided in this application embodiment. The method is applied to a vehicle controller, which is communicatively connected to a mobile terminal. The method includes the following steps:

[0046] Step 201: Receive audio data from the mobile terminal.

[0047] This step can be referred to in the detailed description of step 101, and will not be repeated here.

[0048] Step 202: In response to the audio data, control the vehicle's playback device to play the audio data.

[0049] This step can be referred to in the detailed description of step 102, and will not be repeated here.

[0050] Step 203: In response to the first target event being detected, obtain an audio file that matches the audio data from a target data source other than the mobile terminal.

[0051] This step can be referred to in the detailed description of step 103, and will not be repeated here.

[0052] Step 204: Control the vehicle's playback device to play audio files.

[0053] This step can be referred to in the detailed description of step 104, and will not be repeated here.

[0054] Step 205: In response to the second target event being detected, display a prompt message to the user.

[0055] In this embodiment of the application, the prompt information is used to prompt the user to select a playback terminal; the second target event refers to the event that is resumed after the audio playback process is interrupted, that is, the second target event is corresponding to the first target event. The second target event may include at least: a phone call ending event and a network recovery event, which can be determined according to actual needs and are not limited here.

[0056] In this embodiment of the application, if the audio playback process of the mobile terminal is interrupted and suspended due to the first target event and is not released, then when the vehicle controller detects the second target event, it will display a prompt message to the user in response to the second target event, prompting the user to select a playback terminal.

[0057] For example, if the audio playback process on a mobile terminal is interrupted and suspended due to a first target event but not released, and the vehicle controller detects a second target event through the smart cockpit, the vehicle controller will respond by displaying a prompt message to the user through a pop-up window to prompt the driver or passenger to select a playback source to determine the playback terminal. Furthermore, the vehicle controller will remember this operation, record the user's operating habits, and may not display the prompt message next time, using that playback terminal as the default selection.

[0058] Step 206: In response to the continue playback operation returned by the prompt information, determine the playback terminal indicated by the continue playback operation, and control the playback terminal to play the audio file.

[0059] In this embodiment, the "continue playback" operation refers to the vehicle controller displaying a prompt to the user to select a playback terminal, and receiving the operation data input by the user; the "continue playback" operation can instruct the playback terminal for playing audio files.

[0060] In this embodiment of the application, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it responds to the continue playback operation, obtains the playback terminal indicated by the continue playback operation, and then controls the playback terminal to play the audio file.

[0061] For example, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it will extract the user's selected playback source, determine the playback terminal indicated by the continue playback operation based on the playback source, and then control the playback terminal to play the audio file.

[0062] Another audio playback method provided in this application embodiment receives audio data from a mobile terminal, and then controls a vehicle playback device to play the audio data in response to the audio data. Once the vehicle controller detects a first event that interrupts the audio playback process of the mobile terminal, it can obtain an audio file matching the audio data from a target data source other than the mobile terminal. This achieves the purpose of changing the playback source of the audio indicated by the audio data from the mobile terminal to a target data source other than the mobile terminal. Then, it controls the vehicle playback device to play the audio file, which can reduce the occurrence of audio data interruption by the vehicle playback device. Afterwards, in response to detecting a second target event, the vehicle controller can display a prompt message to the user to prompt the user to select a playback terminal, thereby giving the user the choice. Then, in response to the "continue playback" operation returned by the prompt message, it can determine the playback terminal indicated by the "continue playback" operation and control the playback terminal to play the audio file, thereby achieving the purpose of changing the audio playback source to the playback terminal required by the user.

[0063] Figure 3 This is a flowchart illustrating another audio playback method provided in this application embodiment. The method is applied to a vehicle controller, which is communicatively connected to a mobile terminal. The method includes the following steps:

[0064] Step 301: Receive audio data from the mobile terminal.

[0065] This step can be referred to in the detailed description of step 101, and will not be repeated here.

[0066] Step 302: In response to the audio data, control the vehicle's playback device to play the audio data.

[0067] This step can be referred to in the detailed description of step 102, and will not be repeated here.

[0068] Step 303: In response to the first target event being detected, obtain an audio file that matches both the song name and the artist name from a target data source other than the mobile terminal.

[0069] In this embodiment of the application, when the vehicle playback device plays audio data from the mobile terminal, if the vehicle controller detects the first target event, it will, in response to the detection of the first target event, query the target data source other than the mobile terminal for an audio file that has the same song name and artist name, and use it as the audio file that matches both the song name and artist name.

[0070] For example, see Figure 4 and Figure 5As shown, when the vehicle playback device plays audio data from the mobile terminal, if the vehicle controller detects the first target event (e.g., an incoming phone call) through the smart cockpit, it will respond to the first target event by first determining the target data source other than the mobile terminal, and then querying the target data source for audio files whose names are the song title and whose singer names are the singer names, as the audio files that match both the song title and the singer name.

[0071] This application embodiment, in response to the detection of a first target event, obtains an audio file that matches both the song name and the artist name from a target data source outside the mobile terminal. This ensures that once the vehicle controller detects the first event that interrupts the audio playback process of the mobile terminal, it can obtain an audio file identical to the audio data from the target data source outside the mobile terminal. This achieves seamless audio playback when the playback source indicated by the audio data is changed from the mobile terminal to a target data source outside the mobile terminal.

[0072] Optionally, step 303 may include:

[0073] Step A1: Check network status.

[0074] In this embodiment, the detection network may include normal and abnormal states, which can be determined according to actual needs and are not limited here.

[0075] In this embodiment of the application, the vehicle controller can determine the network status by detecting the gateway to determine whether the vehicle can connect to the network.

[0076] For example, if the vehicle controller detects the gateway and determines that it can connect to the network, then the network status is normal; if it determines that it cannot connect to the network, then the network status is abnormal.

[0077] Step A2: In response to the network status being normal, retrieve the audio file that matches both the song title and the artist name from the cloud server.

[0078] In this embodiment of the application, when the vehicle controller determines that it can connect to the network by detecting the gateway and then determines that the network status is normal, the vehicle controller can obtain an audio file from the cloud server that is identical to both the song name and the singer name, or an audio file with the same song name and a similar singer name, as an audio file that matches both the song name and the singer name.

[0079] For example, see Figure 4As shown, when the vehicle controller can detect the gateway and determine that it can connect to the network, and then confirm that the network status is normal, the vehicle controller can first identify the cloud server other than the mobile terminal, and then query any cloud server for an audio file whose name is the song title and whose singer name is the singer's name, as the audio file that matches both the song title and the singer's name.

[0080] Step A3: In response to an abnormal network status, retrieve the audio file that matches both the song title and the artist name from the local storage.

[0081] In this embodiment of the application, when the vehicle controller determines that it cannot connect to the network by detecting the gateway and then determines that the network status is abnormal, the vehicle controller can obtain an audio file that is the same as the song name and the singer name, or an audio file with the same song name and a similar singer name, from the local storage as the audio file that matches both the song name and the singer name.

[0082] For example, see Figure 4 As shown, when the vehicle controller detects that it cannot connect to the network through the gateway and determines that the network status is abnormal, the vehicle controller can first determine the local storage other than the mobile terminal, and then search for an audio file in any local storage that has the name of the song and the name of the singer as its own name, and use it as the audio file that matches both the song name and the singer's name.

[0083] Step 304: Obtain user location.

[0084] In this embodiment of the application, the user can be a passenger or a driver, and the user can include: a first user and a second user; correspondingly, the user location can be a passenger location or a driver location, and the user location can include: a first user location and a second user location, which can be determined according to actual needs and is not limited here.

[0085] In this embodiment of the application, after obtaining an audio file that matches both the song title and the artist's name, or before obtaining an audio file that matches both the song title and the artist's name, the vehicle controller can obtain the user's location through sensors, or determine the user's location through a camera and a human detection algorithm.

[0086] In this embodiment, the sensor may be a gravity sensor or a pressure sensor, which may be installed on the vehicle seat; the sensor may also be other sensors that can determine the user's position, which may be installed inside the vehicle, and the specific location may be determined according to actual needs, and is not limited here.

[0087] For example, a sensor is installed on the vehicle seat, and the vehicle controller is connected to the sensor. After acquiring an audio file that matches both the song title and the artist's name, or before acquiring an audio file that matches both the song title and the artist's name, the sensor signal can be acquired, and then the signal position of the sensor signal can be used as the user's position.

[0088] Optionally, step 304 may include:

[0089] Step B1: Obtain the sensor signal from the sensor.

[0090] In this embodiment, the pressure sensor can be installed on the vehicle seat, and the vehicle controller is connected to the pressure sensor. The specific location can be determined according to actual needs and is not limited here.

[0091] In this embodiment of the application, after obtaining an audio file that matches both the song title and the artist's name, or before obtaining an audio file that matches both the song title and the artist's name, the vehicle controller may obtain the sensor signal of the pressure sensor.

[0092] For example, after obtaining an audio file that matches both the song title and the artist's name, or before obtaining an audio file that matches both the song title and the artist's name, a regional passenger detection procedure can be initiated to obtain sensor signals from the pressure sensors on the vehicle seats.

[0093] Step B2: Use the sensor signal position as the user position.

[0094] In this embodiment of the application, after acquiring the sensor signal, the vehicle controller can use the signal position of the sensor signal as the user position.

[0095] For example, after acquiring the sensor signal, the vehicle controller can use the sensor signal to make a preliminary judgment as to whether there is a passenger in the area where the pressure sensor is located, and then use the signal position of the sensor signal as the user's position.

[0096] This application embodiment achieves the purpose of quickly determining the user's location by acquiring the sensor signal of the pressure sensor and then using the signal position of the sensor signal as the user's location.

[0097] Optionally, step B2 may include:

[0098] Step b1: In response to acquiring sensor signals, the location of a human body inside the vehicle is identified by a camera.

[0099] In this embodiment, the camera is installed inside the vehicle and is used to identify the user's location. The vehicle controller can be connected to the camera. The camera can be a 360-degree panoramic camera or multiple ordinary cameras installed at different locations on the top of the vehicle. The specific configuration can be determined according to actual needs and is not limited here.

[0100] In this embodiment, when a sensor signal is acquired, the vehicle controller responds to the acquisition of the sensor signal and can then automatically identify the location of a human body inside the vehicle through the camera and the human body detection algorithm set inside the camera.

[0101] For example, if the pressure sensor has data, that is, when the sensor signal is acquired, the vehicle controller responds by activating the camera to perform human body detection. Then, through the camera set inside the vehicle and the human body detection algorithm set inside the camera, the presence of people inside the vehicle can be automatically identified. Based on the presence of people inside the vehicle and the position of the seats in the vehicle, the position of the human body inside the vehicle can be determined.

[0102] Step b2: Obtain the recognition location based on the human body position and the preset driver position.

[0103] In this embodiment of the application, the preset driver position can be a default position preset in the system (e.g., the left side of the front row) or a default position preset in the vehicle controller (e.g., the right side of the front row). The specific position can be determined according to actual needs and is not limited here.

[0104] In this embodiment of the application, after the vehicle controller identifies the position of a person inside the vehicle through the camera, it can calculate the difference between the position of the person inside the vehicle and the preset driver position in the vehicle controller to obtain the identified position.

[0105] For example, after the vehicle controller identifies the position of a person inside the vehicle through the camera, the vehicle controller can obtain the built-in preset driver position, then exclude the preset driver position from the human body positions inside the vehicle, and then use the excluded human body position as the identification position.

[0106] Step b3: Obtain the user's location based on the identified location and signal location.

[0107] In this embodiment of the application, after the vehicle controller obtains the identification location, the vehicle controller can calculate the intersection of the identification location and the signal location to obtain the user location.

[0108] For example, after the vehicle controller obtains the identified location, the vehicle controller can use the location where both the identified location and the signal location exist simultaneously as the user location.

[0109] This application embodiment responds to the acquisition of sensor signals by using a camera to identify the position of a person inside the vehicle, then obtains the identified position based on the position of the person inside the vehicle and a preset driver position, and finally obtains the user's position based on the identified position and the signal position. This allows for a more accurate user position determination.

[0110] Step 305: Control the vehicle playback device at the user's location to play the audio file.

[0111] In this embodiment of the application, after the vehicle controller obtains the user's location and the audio file, it can control the vehicle playback device at the user's location to play the audio file.

[0112] For example, after the vehicle controller obtains the user's location and the audio file, the vehicle controller will search for currently available vehicle playback devices, then calculate the intersection of the available vehicle playback devices and the vehicle playback devices at the user's location, and then control the vehicle playback devices in the intersection to play the audio file.

[0113] This embodiment of the application obtains the user's location and then controls a vehicle playback device at the user's location to play an audio file. In this way, the vehicle playback device at the user's location can resume audio playback from interrupted audio input on the mobile terminal.

[0114] Optionally, step 305 may include:

[0115] Step C1: In response to the detected incoming phone call, control the vehicle's playback device at the user's location to play the audio file from the first playback progress point, decreasing the audio volume by a preset volume. This user's location is the location of the second user; the second user is any user inside the vehicle other than the first user; the first user is the owner of the mobile terminal.

[0116] In this embodiment of the application, the preset volume can be a default value preset in the system (e.g., 10% of the audio volume) or a default value preset in the vehicle controller (e.g., 20% of the audio volume). The specific value can be determined according to actual needs and is not limited here.

[0117] In this embodiment, after the vehicle controller obtains the user's location, when a phone call comes in from a mobile terminal that has established a Bluetooth connection with the vehicle, the vehicle controller listens to the call event (Hands-free Profile, HFP) through the audio playback module and checks whether the audio data transmitted via Bluetooth has been interrupted. If it has been interrupted, the vehicle controller can retrieve the information of the interrupted audio data from the playback media database. The audio playback module informs the Kuwo Music module of the information of the interrupted audio data through binder inter-process communication (IPC). The Kuwo Music module can search for the audio file corresponding to the information of the interrupted audio data from a target data source other than the mobile terminal, and then control the vehicle playback device at the user's location to play the audio file from the first playback progress point by decreasing the audio volume by a preset volume.

[0118] For example, see Figure 4 and Figure 5 As shown, when a mobile terminal connected to the vehicle via Bluetooth receives a phone call, if the first user of the mobile terminal answers the call, the audio data on the mobile terminal will automatically stop transmitting to the vehicle. Since the vehicle controller monitors the phone status through the smart cockpit, it will detect the incoming call event. In response to the incoming call event, the vehicle controller will trigger the audio relay module to work and start the area passenger detection program to obtain the location of the second user as the user's location. Then, it will control the vehicle's playback device at that user's location to reduce the audio volume by a preset volume from the first playback progress and continue playing the audio file at a lower volume.

[0119] Step C2: In response to a network interruption event, control the vehicle playback device at the user's location to play an audio file at the first playback progress point with the audio volume. The user's location may include: a first user location and a second user location. The first user location is the location of the first user, who is the owner of the mobile terminal. The second user location is the location of the second user, who is a user inside the vehicle other than the first user.

[0120] In this embodiment, after the vehicle controller obtains the user's location, when it cannot connect to the network with the mobile terminal, the vehicle controller checks whether the audio data transmitted via Bluetooth has been interrupted. If it has been interrupted, it can obtain the information of the interrupted audio data from the playback media database. The audio playback module informs the Kuwo Music module of the information of the interrupted audio data through binderIPC. The Kuwo Music module can search for the audio file corresponding to the information of the interrupted audio data from the target data source other than the mobile terminal, and then control the vehicle playback device at the user's location to play the audio file at the first playback progress at the audio volume.

[0121] For example, after the vehicle controller obtains the user's location, if the mobile terminal cannot connect to the network, the audio data being played on the mobile terminal will automatically stop being transmitted to the vehicle. At this time, the vehicle controller will detect the network interruption event through the smart cockpit. In response to the network interruption event, the vehicle controller will trigger the audio relay module to work, using the locations of the first user and the second user as the user locations, and then control the vehicle's playback device at that user location to continue playing the audio file that matches the stopped audio data from the first playback progress at the same audio volume.

[0122] In this embodiment of the application, in response to a detected incoming phone call, the vehicle's playback device at the user's location can be controlled to play an audio file at a preset volume, starting from the first playback progress point, so as not to disturb the phone call; in response to a detected network interruption event, the vehicle's playback device at the user's location can be controlled to play an audio file at the audio volume, starting from the first playback progress point, thus achieving seamless audio playback.

[0123] Step 306: In response to the second target event being detected, display a prompt message to the user.

[0124] This step can be referred to in the detailed description of step 205, and will not be repeated here.

[0125] Step 307: Obtain the second playback progress of the audio file on the vehicle's playback device.

[0126] In this embodiment of the application, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it can obtain the second playback progress of the audio file by the vehicle playback device.

[0127] For example, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it can obtain the second playback progress of the audio file from the vehicle's playback device.

[0128] Step 308: In response to the fact that the playback terminal is a mobile terminal, control the vehicle playback device to stop playing and send a playback command to the mobile terminal.

[0129] In this embodiment, the playback instruction includes: a second playback progress; the playback instruction is used to instruct the mobile terminal to continue playing audio data from the second playback progress.

[0130] In this embodiment of the application, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it obtains the playback terminal indicated by the continue playback operation. Then, if the playback terminal is a mobile terminal, it controls the vehicle playback device to stop playing and sends a playback command to the mobile terminal to instruct the mobile terminal to continue playing audio data from the second playback progress.

[0131] For example, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it will extract the user's selected playback source in response to the continue playback operation. When the user selects a mobile terminal to continue playback, and the playback terminal indicated by the continue playback operation is the mobile terminal, the mobile terminal will respond to the fact that the playback terminal is the mobile terminal. First, it will control the vehicle playback device to pause the current playback of the Kuwo Music module, and then send an AVRCP playback command to the mobile terminal to instruct the mobile terminal to continue playing the audio data from the second playback progress. The audio data will continue to be transmitted to the vehicle via Bluetooth connection.

[0132] Step 309: In response to the fact that the playback terminal is a vehicle, control the vehicle playback device to continue playing the audio file from the second playback progress position.

[0133] In this embodiment of the application, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it obtains the playback terminal indicated by the continue playback operation, and then, if the playback terminal is a vehicle, it controls the vehicle playback device to continue playing the audio file from the second playback progress position.

[0134] For example, after the vehicle controller displays a prompt message to the user, if it receives a continue playback operation in response to the prompt message, it will extract the user's selected playback source in response to the continue playback operation. When the user selects the vehicle to continue playback, the playback terminal indicated by the continue playback operation is the vehicle. At this time, the mobile terminal will respond to the playback terminal being the vehicle and control the vehicle playback device to continue playing the audio file from the second playback progress.

[0135] Another audio playback method provided in this application, by obtaining the second playback progress of an audio file on a vehicle playback device, can control the vehicle playback device to stop playback and send a playback command to the mobile terminal in response to the playback terminal being a mobile terminal, instructing the mobile terminal to continue playing the audio data from the second playback progress point. In this way, seamless audio playback can be achieved after changing the audio playback source to the user's desired playback terminal.

[0136] Reference Figure 6The structural block diagram of an electronic device provided in this application embodiment shows that the electronic device 400 is merely an example and should not impose any limitations on the function and scope of use of the embodiments of the present invention.

[0137] like Figure 6 As shown, the electronic device 400 is presented in the form of a general-purpose computing device. The components of the electronic device 400 may include, but are not limited to: one or more processors 401 or processing units, a memory 402, a pressure sensor 403 or a gravity sensor, a camera 404, and a bus 405 connecting different system components (including processor 401, memory 402, pressure sensor 403 and camera 404), as well as computer instructions stored in the memory 402 and executable on the processor 401. When the computer instructions are executed by the processor 401, the aforementioned audio playback method is implemented.

[0138] Pressure sensor 403 and camera 404 are respectively connected to processor 401. Pressure sensor 403 is installed on the vehicle seat, and camera 404 is installed inside the vehicle.

[0139] Bus 405 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. Examples of these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0140] Electronic device 400 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 400, including volatile and non-volatile media, removable and non-removable media.

[0141] Memory 402 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 4021 and / or cache memory 4022. Electronic device 400 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 4023 may be used to read and write non-removable, non-volatile magnetic media (… Figure 6 Not shown; usually referred to as a "hard drive"). Although Figure 6Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 405 via one or more data media interfaces. Memory 402 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0142] A program / utility 4024 having a set (at least one) of program modules 40241 may be stored, for example, in memory 402. Such program modules 40241 include—but are not limited to—an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 40241 typically perform the functions and / or methods described in the embodiments of the present invention.

[0143] Electronic device 400 can also communicate with one or more external devices 407 (e.g., keyboard, pointing device, display 408, etc.), and with one or more devices that enable a user to interact with electronic device 400, and / or with any device that enables electronic device 400 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (406). Furthermore, electronic device 400 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 409. As shown, network adapter 409 communicates with other modules of electronic device 400 via bus 405. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0144] This application provides an electronic device that receives audio data from a mobile terminal and then controls a vehicle playback device to play the audio data in response to the audio data. Once the vehicle controller detects a first event that interrupts the audio playback process of the mobile terminal, it can obtain an audio file matching the audio data from a target data source outside the mobile terminal. This changes the playback source of the audio indicated by the audio data from the mobile terminal to a target data source outside the mobile terminal, and then controls the vehicle playback device to play the audio file. This reduces the occurrence of interruptions to the audio data played by the vehicle playback device and provides users with a better music experience.

[0145] This application provides a readable storage medium storing computer instructions, which, when executed by a processor, implement the aforementioned audio playback method.

[0146] This application provides a readable storage medium that receives audio data from a mobile terminal and, in response to the audio data, controls a vehicle playback device to play the audio data. Once the vehicle controller detects a first event interrupting the audio playback process of the mobile terminal, it can obtain an audio file matching the audio data from a target data source outside the mobile terminal. This changes the playback source of the audio data from the mobile terminal to a target data source outside the mobile terminal, and then controls the vehicle playback device to play the audio file. This reduces the likelihood of interruptions to the audio data played by the vehicle playback device, providing users with a better music experience.

[0147] Those skilled in the art will understand that this application includes devices for performing one or more of the operations described in this application. These devices may be specifically designed and manufactured for the desired purpose, or may include known devices found in general-purpose computers. These devices have computer programs stored therein that can be selectively activated or reconfigured. Such computer programs may be stored in a storage medium of the device (e.g., a computer) or in any type of medium suitable for storing electronic instructions and coupled to a bus, including but not limited to any type of disk (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic cards, or optical cards. That is, the storage medium includes any medium by which a device (e.g., a computer) stores or transmits information in a readable form.

[0148] Those skilled in the art will understand that each block in these structural diagrams and / or block diagrams and / or flowcharts, as well as combinations of blocks in these structural diagrams and / or block diagrams and / or flowcharts, can be implemented using computer program instructions. Those skilled in the art will understand that these computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing method for implementation, thereby executing the schemes specified in the blocks or plurality of blocks of the structural diagrams and / or block diagrams and / or flowcharts disclosed in this application by the processor of the computer or other programmable data processing method.

[0149] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An audio playback method, characterized in that, Applied to a vehicle controller that is communicatively connected to a mobile terminal, the method includes the following steps: Receive audio data from the mobile terminal; In response to the audio data, control the vehicle playback device to play the audio data; In response to the detection of a first target event, an audio file matching the audio data is obtained from a target data source other than the mobile terminal; the first target event refers to an event that interrupts the audio playback process of the mobile terminal playing the audio data; the target data source includes local storage and a cloud server; the local storage includes a USB flash drive and the vehicle's local storage. Control the vehicle's playback device to play the audio file; The step of controlling the vehicle playback device to play the audio file includes the following steps: Obtain user location; Control the vehicle playback device at the user's location to play the audio file; The first target event includes at least: a telephone call event and a network interruption event; the audio data includes at least: audio volume and a first playback progress; controlling the vehicle playback device at the user's location to play the audio file includes the following steps: In response to the detected incoming phone call event, the system controls the vehicle playback device at the user's location to play the audio file from the first playback progress point by decreasing the audio volume by a preset volume; the user's location is the location of a second user; the second user is a user inside the vehicle other than the first user; the first user is the owner of the mobile terminal. In response to the network interruption event, the vehicle playback device at the user's location is controlled to play the audio file at the audio volume from the first playback progress position. The audio data further includes: song title and artist name; the step of obtaining an audio file matching the audio data from a target data source other than the mobile terminal in response to the detection of the first target event includes the following steps: In response to the detection of a first target event, an audio file matching both the song name and the singer name is obtained from a target data source other than the mobile terminal.

2. The method according to claim 1, wherein the vehicle controller is connected to a pressure sensor, and the pressure sensor is disposed on the vehicle seat; the step of obtaining the user's position includes the following steps: Acquire the sensor signal of the pressure sensor; The location of the sensor signal is taken as the user's location.

3. The method according to claim 2, wherein the vehicle controller is further connected to a camera, the camera being installed inside the vehicle, and the camera being used to identify the user's location; the step of using the signal location of the sensor signal as the user's location includes the following steps: In response to acquiring the sensor signal, the camera identifies the position of a human body inside the vehicle; The identification location is obtained based on the human body position and the preset driver position; The user's location is obtained based on the identified location and the signal location.

4. The method according to claim 1, wherein the vehicle controller is communicatively connected to the local storage and the cloud server; the step of obtaining an audio file that simultaneously matches the song title and the artist name from a target data source other than the mobile terminal includes the following steps: Check network status; In response to the network status being normal, an audio file matching both the song name and the singer name is retrieved from the cloud server. In response to the network status being abnormal, an audio file matching both the song name and the artist name is retrieved from the local storage.

5. The method according to claim 1, after controlling the vehicle playback device to play the audio file, the method further includes the following step: In response to the detection of a second target event, a prompt message is displayed to the user; the prompt message is used to prompt the user to select a playback terminal. The second target event refers to the event that resumes after the audio playback process has been interrupted; In response to the continued playback operation returned by the prompt information, the playback terminal indicated by the continued playback operation is determined, and the playback terminal is controlled to play the audio file.

6. The method according to claim 5, wherein in response to a continue playback operation returned in response to the prompt information, determining the playback terminal indicated by the continue playback operation and controlling the playback terminal to play the audio file includes the following steps: Obtain the second playback progress of the audio file on the vehicle playback device; In response to the fact that the playback terminal is the mobile terminal, the vehicle playback device is controlled to stop playing and a playback instruction is sent to the mobile terminal; the playback instruction includes: a second playback progress; the playback instruction is used to instruct the mobile terminal to continue playing the audio data from the second playback progress position; In response to the fact that the playback terminal is a vehicle, the vehicle playback device is controlled to continue playing the audio file from the second playback progress position.

7. An electronic device, characterized in that, It includes a processor, a memory, and computer instructions stored in the memory and executable on the processor, wherein the computer instructions, when executed by the processor, implement the audio playback method as described in any one of claims 1-6.

8. The electronic device according to claim 7, further comprising: A pressure sensor and a camera are respectively connected to the processor. The pressure sensor is installed on the vehicle seat, and the camera is installed inside the vehicle.

9. A readable storage medium, characterized in that, The readable storage medium stores computer instructions that, when executed by a processor, implement the audio playback method as described in any one of claims 1-6.

Images