Audio playback optimization method and electronic device
By generating a flush command after receiving the audio pause response information of the Bluetooth device, the audio abnormal interruption problem caused by the electronic device's inability to successfully send the audio pause command is solved, and normal Bluetooth device playback is achieved during the pause and replay of the audio, which improves the audio improvement. User experience.
Patent Information
- Application Number
- CN202311689030.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-08
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2043-12-08
AI Technical Summary
When listening to audio through Bluetooth headsets, when user operations cause the audio to be paused or answering calls, the electronic device cannot successfully send the audio pause command, resulting in abnormal audio interruption and no longer being played through Bluetooth devices, affecting the user experience.
After receiving the audio pause response information from the Bluetooth device, a flush command is generated to discard the audio information with the Bluetooth device, ensuring that the audio pause command is successfully sent and avoiding the audio connection interruption.
It solves the problem of abnormal audio interruption, ensures that the audio is played normally through Bluetooth devices during pause and replay, improving the user experience.
Smart Images

Figure CN117880885B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a method and electronic device for optimizing audio playback. Background Art
[0002] With the development of terminal technology, more and more users are accustomed to listening to audio on electronic devices such as mobile phones or tablets by wearing Bluetooth headphones. However, when listening to audio through Bluetooth headphones, the audio originally played by the Bluetooth headphones may be abnormally switched to the external speaker on the electronic device due to the user pausing the audio on the electronic device and then playing it again or interrupting the audio by answering a phone call, resulting in a poor user experience. Summary of the invention
[0003] The present application provides a method and electronic device for optimizing audio playback, which solves the problem of abnormal interruption of audio on the Bluetooth headset side by discarding the outgoing audio information according to the flush instruction after the electronic device receives a pause instruction response message replied by the Bluetooth headset.
[0004] In a first aspect, a method for optimizing audio playback is provided, which is applied to an electronic device, comprising:
[0005] Acquire a first operation input by a user, where the first operation is used to pause playing of a first audio, where the first audio is played through a Bluetooth device that is communicatively connected to the electronic device;
[0006] In response to the first operation, obtaining audio pause information;
[0007] Sending the audio pause information to the Bluetooth device;
[0008] After receiving the audio pause response information fed back by the Bluetooth device, in response to the audio information discarding information, the information related to the first audio exchanged between the electronic device and the Bluetooth device is discarded.
[0009] In one possible implementation, the first operation may be, for example, a user clicking a pause button in an audio playback app; or, the first operation may be a user pausing the audio by voice input to an electronic device; or, the first operation may be, for example, a user answering a call during audio playback.
[0010] It should be noted that pausing the playing of the first audio mentioned here may include: pausing the playing of the first audio without exiting the audio playing App; or directly exiting the audio playing App.
[0011] In a possible implementation, the audio pause information may be described as an audio pause instruction; the audio information discard information may be described as an audio information discard instruction, and the audio information discard information may specifically be a flush instruction.
[0012] According to the method for optimizing audio playback provided in an embodiment of the present application, by setting the timing for generating a flush instruction, that is, after the electronic device receives the audio pause response information fed back by the audio device, a flush instruction is generated, thereby solving the problem of abnormal audio playback caused by the electronic device's inability to successfully send an audio pause instruction.
[0013] In combination with the first aspect, in some implementations of the first aspect, in response to the first operation, obtaining audio pause information specifically includes:
[0014] In response to the first operation, the audio pause information is generated, and the audio information discard information is not generated.
[0015] In combination with the first aspect, in some implementations of the first aspect, the electronic device includes an audio module, a Bluetooth host and a Bluetooth chip; the method also includes: the audio module receives first information corresponding to the first operation; the audio module sends the first information to the Bluetooth host; in response to the first information, the Bluetooth host generates the audio pause information and does not generate the audio discard information; the Bluetooth host sends the audio pause information to the Bluetooth chip; the Bluetooth chip sends the audio pause information to the Bluetooth device.
[0016] In combination with the first aspect, in some implementations of the first aspect, the Bluetooth chip receives audio pause response information sent by the Bluetooth device;
[0017] The Bluetooth chip sends the audio pause response information to the Bluetooth host;
[0018] In response to the audio pause response information, the Bluetooth host generates the audio discard indication information;
[0019] The Bluetooth host sends the audio discard indication information to the Bluetooth chip;
[0020] In response to the audio discard indication information, the Bluetooth chip discards the information related to the first audio exchanged between the electronic device and the Bluetooth device.
[0021] In combination with the first aspect, in some implementations of the first aspect, the method further includes:
[0022] In response to the first operation, acquiring the audio pause information and the audio information discard information;
[0023] The audio pause information is sent to the Bluetooth device, and after receiving the audio pause response information fed back by the Bluetooth device, in response to the audio information discard information, the information related to the first audio exchanged between the electronic device and the Bluetooth device is discarded.
[0024] In combination with the first aspect, in some implementations of the first aspect, the electronic device includes an audio module, a Bluetooth host, and a Bluetooth chip; and the method further includes:
[0025] The audio module receives first information corresponding to the first operation;
[0026] The audio module sends the first information to the Bluetooth host;
[0027] In response to the first information, the Bluetooth host generates the audio pause information and the audio information discard information;
[0028] The Bluetooth host sends the audio pause information and the audio information discard information to the Bluetooth chip;
[0029] The Bluetooth chip sends the audio pause information to the Bluetooth device.
[0030] In a possible implementation manner, the first information may correspond to the audio pause operation information described below.
[0031] In combination with the first aspect, in some implementations of the first aspect, the method further includes:
[0032] The Bluetooth chip receives the audio pause response information fed back by the Bluetooth device;
[0033] In response to the audio pause response information, the Bluetooth chip discards information according to the audio information, and discards the information related to the first audio exchanged between the electronic device and the Bluetooth device.
[0034] In combination with the first aspect, in some implementations of the first aspect, the method further includes:
[0035] Obtaining a second operation input by a user, where the second operation is used to play the first audio again;
[0036] In response to the second operation, the first audio is sent to the Bluetooth device, so that the first audio is played through the Bluetooth device.
[0037] In a second aspect, an electronic device is provided, including:
[0038] one or more processors;
[0039] one or more memories;
[0040] The one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the electronic device executes the method described in any implementation of the first aspect above.
[0041] According to a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer-executable program, and when the computer-executable program is called by a computer, the computer executes the method described in any implementation method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 A schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application.
[0043] Figure 2 A software structure block diagram of the electronic device 100 provided in an embodiment of the present application.
[0044] Figure 3 A schematic flowchart of a method for optimizing audio playback provided in an embodiment of the present application.
[0045] Figure 4 A GUI schematic diagram that may be involved in the implementation of a method for optimizing audio playback provided in an embodiment of the present application.
[0046] Figure 5 A schematic flowchart of a method for optimizing audio playback provided in an embodiment of the present application.
[0047] Figure 6 A schematic flowchart of another method for optimizing audio playback provided in an embodiment of the present application.
[0048] Figure 7 A schematic flowchart of another method for optimizing audio playback provided in an embodiment of the present application.
[0049] Figure 8 A schematic flowchart of another method for optimizing audio playback provided in an embodiment of the present application. DETAILED DESCRIPTION
[0050] It should be noted that the terms used in the implementation method part of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated obstacles, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two, "at least one" and "one or more" mean one, two or more than two.
[0051] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, it is defined that the "first" and "second" features may explicitly or implicitly include one or more of the features.
[0052] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0053] When a user listens to audio on an electronic device (such as a mobile phone, tablet computer, etc.) through a Bluetooth headset (or other Bluetooth devices, such as a Bluetooth speaker, etc.), if the user frequently pauses and starts audio playback on the electronic device, it is likely that the audio on the electronic device will be played through the speaker instead of the Bluetooth device.
[0054] One possible reason for the above problem may be that before the electronic device sends an audio pause instruction to the Bluetooth audio device, when the electronic device discards the audio-related instructions between the Bluetooth audio device in response to the flush instruction, the audio pause instruction will be discarded, resulting in the electronic device actually not successfully sending the audio pause instruction, thereby causing the audio connection between the electronic device and the Bluetooth audio device to be abnormally interrupted.
[0055] Specifically, please refer to the HCI log example shown in Table 1 below. In one embodiment provided in the present application, when the electronic device (taking the electronic device as a mobile phone as an example) receives an operation of pausing audio playback input by the user, it will generate an audio pause instruction (such as the AVDTP suspend command (ACP=2) operation instruction shown in Table 1 below) in response to the operation, and generate a flush instruction (such as the HCI enhanced flush (Connection=0×0033, Type=Auto)>0×0033 instruction shown in Table 1 below) to instruct the mobile phone to discard the information sent by the mobile phone to the Bluetooth device (taking the Bluetooth device as a Bluetooth headset as an example). Afterwards, the mobile phone can respond to the flush instruction and discard the information sent by the mobile phone to the Bluetooth headset. If the mobile phone discards the audio pause instruction that has not been successfully sent out at this time, the Bluetooth headset will not be able to receive the audio pause instruction, and thus will not return a response message corresponding to the audio pause instruction to the mobile phone. When the preset time is reached, if the mobile phone has not received the response message sent by the Bluetooth headset, the mobile phone will respond to the audio interruption instruction on the mobile phone side (the AVDTP Close Command (ACP=2) instruction and / or the AVDTP Close Accept instruction shown in Table 1 below) to actively disconnect the Bluetooth audio transmission model protocol (Advanced Audio Distribution Profile, A2DP) between the Bluetooth headset and the mobile phone. At this time, when the mobile phone plays audio again, since the Bluetooth connection between it and the Bluetooth headset has been interrupted, the audio cannot be played through the Bluetooth headset, but the audio will be played through the speaker, resulting in abnormal audio playback.
[0056] Table 1
[0057]
[0058]
[0059]
[0060] Exemplarily, as shown in Table 2 below, an example of an air interface log when audio is played abnormally is provided in an embodiment of the present application.
[0061] Table 2
[0062]
[0063] Combined with Table 2 above, it can be known that the air interface log of the communication interaction between the mobile phone and the Bluetooth headset does not include the audio pause command (AVDTP suspend), which means that the mobile phone side did not successfully issue the audio pause command, and naturally, the Bluetooth headset did not receive the audio pause command. However, combined with the HCI log shown in Table 1 above, when the audio is paused, the mobile phone side issues a flush command instructing the mobile phone to discard the audio information between it and the Bluetooth headset (such as the HCI enhancedflush (Connection = 0×0033, Type = Auto) > 0×0033 command shown in Table 1 above). Therefore, combined with the type of command issued by the mobile phone side, a possible reason for the failure of the mobile phone side to successfully issue the audio pause command, thereby causing abnormal audio playback, is that when the mobile phone side has time to successfully issue the audio pause command in the future, it responds to the flush command and discards the interactive information between the mobile phone and the Bluetooth headset.
[0064] It should be further explained that, since the mobile phone side has not successfully sent the audio pause instruction to the Bluetooth headset, the Bluetooth headset will not respond to the audio pause instruction, that is, the Bluetooth headset will not return the audio pause response information to the mobile phone. In some embodiments, if the mobile phone does not receive the audio pause response information fed back by the Bluetooth headset within a preset time (such as 8s), the mobile phone will automatically interrupt the A2DP connection between it and the Bluetooth headset, so this will also result in that when the mobile phone plays audio next time, the audio cannot be played by the Bluetooth headset through the A2DP connection, but will most likely be played by the speaker of the mobile phone.
[0065] In order to solve the above problem, an embodiment of the present application provides a method for optimizing audio playback. When the audio is paused, the electronic device does not send a flush command temporarily, but waits until the Bluetooth device feeds back an audio pause response message, and then sends a flush command and discards the relevant interaction information with the Bluetooth device in response to the flush command. That is, by setting the sending and response sequence of the flush command to after receiving the audio pause response message returned by the Bluetooth device, it is ensured that the electronic device side will not discard the audio pause information that has not been successfully sent based on the flush command, so as to solve the problem of abnormal interruption between the audio and the Bluetooth device on the electronic device side, resulting in abnormal playback of the audio by the electronic device side.
[0066] For example, Figure 1 , which is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application.
[0067] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0068] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0069] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0070] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0071] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0072] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0073] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0074] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0075] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0076] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0077] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0078] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0079] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other terminals, such as AR devices, etc.
[0080] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0081] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the terminal through the power management module 141.
[0082] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0083] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0084] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0085] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0086] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0087] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0088] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The display screen 194 is used to display images, videos, and the like.
[0089] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0090] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy. The video codec is used to compress or decompress digital video. The NPU is a neural network (NN) computing processor that quickly processes input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.
[0091] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card. The internal memory 121 can be used to store computer executable program codes, which include instructions.
[0092] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0093] Exemplarily, the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100. Figure 2 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[0094] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0095] The application layer can include a series of application packages. Figure 2 As shown, the application package may include applications such as camera, calendar, map, WLAN, music, short message, gallery, call, navigation, Bluetooth, audio manager, etc.
[0096] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 2As shown, the application framework layer may include a window manager, a content provider, a phone manager, a resource manager, a notification manager, a view system, a Bluetooth framework, an audio framework, etc. Among them, the Bluetooth framework may be a Bluetooth protocol framework, including a host protocol, a host control interface (HCI), and a controller.
[0097] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0098] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0099] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0100] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0101] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0102] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal vibrates, the indicator light flashes, etc.
[0103] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0104] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0105] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as obstacle life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0106] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0107] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0108] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0109] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0110] A 2D graphics engine is a drawing engine for 2D drawings.
[0111] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0112] In order to better understand the method for optimizing audio playback provided in the embodiment of the present application, the specific implementation process of the method for optimizing audio playback is introduced below with reference to the accompanying drawings.
[0113] For example, Figure 3 FIG. 1 is a schematic flow chart of a method for optimizing audio playback provided by an embodiment of the present application. The method can be specifically executed by various functional modules in an electronic device, and can specifically include the following steps:
[0114] S301, the electronic device receives an audio pause operation input by a user through a display screen.
[0115] In some embodiments, the audio pause operation may be, for example, an operation in which a user clicks a pause button in an audio playback App (eg, Figure 4 The click operation 401 shown in the figure may also be an audio pause instruction input by the user through voice, etc., which is not limited in the embodiment of the present application.
[0116] S302, the display screen sends audio pause operation information to the audio module.
[0117] The audio module may correspond to Figure 2 The audio framework shown.
[0118] S303: The audio module sends audio pause operation information to the Bluetooth host.
[0119] Among them, the Bluetooth host can correspond to, for example Figure 2 The Bluetooth framework shown, or Bluetooth host may also be described as a Bluetooth module.
[0120] S304: The Bluetooth host generates an audio pause instruction and a flush instruction in response to the received audio pause operation information.
[0121] The audio pause instruction may correspond to the AVDTP suspend instruction in Table 1 above, for example; the flush instruction may correspond to the HCI enhanced flushed (connection=0×0033, Type=Auto)>0×0033 instruction in Table 1 above, for example.
[0122] In some embodiments, the Bluetooth host may generate an audio pause instruction in response to the received audio pause operation information, and then generate a flush instruction; or, the Bluetooth host may generate an audio pause instruction in response to the received audio pause operation information, and generate a flush instruction during the process of generating the audio pause instruction.
[0123] It should be noted that in the embodiment of the present application, the flush instruction is an example of an instruction for discarding audio information between it and the Bluetooth device. The embodiment of the present application does not specifically limit the type of instruction for executing the discarding of audio information between the electronic device and the Bluetooth device.
[0124] S305, the Bluetooth host sends an audio pause instruction and a flush instruction to the Bluetooth chip.
[0125] S306: Before sending the audio pause instruction to the Bluetooth device, the Bluetooth chip first discards the audio information between the electronic device and the Bluetooth device in response to the flush instruction.
[0126] It should be noted that, in the embodiment of the present application, the scene corresponding to S306 can be: before the Bluetooth chip successfully sends the audio pause instruction to the Bluetooth device, the Bluetooth chip first responds to the flush instruction to execute the operation of discarding the audio information between the electronic device and the Bluetooth device, that is, before successfully sending the audio pause instruction, the Bluetooth chip discards the audio pause instruction according to the flush instruction. This has led to the fact that the audio pause instruction is not actually sent to the Bluetooth device through the air interface, and the Bluetooth device will not feed back the audio pause response information (response) to the electronic device. When the electronic device generates the audio pause instruction, it will also start the timer. If the electronic device has not received the audio pause response information fed back by the Bluetooth device within the preset duration, then the electronic device will automatically interrupt the audio connection between it and the Bluetooth device when reaching the preset duration. In this case, if the user turns on the audio playback again, because the audio connection between the electronic device and the Bluetooth device has been interrupted, then the electronic device will select another channel (such as the speaker channel) to play the audio, resulting in that when the audio is played again, the original Bluetooth device cannot play the audio to the user, making the user feel that the audio playback is abnormal.
[0127] In order to optimize the audio playback effect, especially to avoid the problem that the audio is not played from the original Bluetooth device channel when it is replayed after the audio is paused, the audio playback optimization method provided in the embodiment of the present application sets the timing of generating a flush instruction, that is, after the electronic device receives the audio pause response information fed back by the audio device, the flush instruction is generated again, thereby solving the problem of abnormal audio playback caused by the electronic device's inability to successfully send the audio pause instruction.
[0128] The following is an introduction to the specific implementation process of the above method in conjunction with the accompanying drawings. Figure 5 , which is a schematic flow chart of a method for optimizing audio playback provided in an embodiment of the present application.
[0129] S501, the electronic device receives an audio pause operation input by a user.
[0130] In some embodiments, the audio pause operation may be, for example, an operation in which a user clicks a pause button in an audio playback App (eg, Figure 4 The click operation 401 shown in the figure may also be an audio pause instruction input by the user through voice, etc., which is not limited in the embodiment of the present application.
[0131] In some embodiments, the electronic device may receive the user's operation of the pause button in the audio playback App through a display screen; or the electronic device may also receive the user's audio playback pause voice command input through a microphone module, etc. For ease of understanding, the embodiment of the present application is only introduced by taking the electronic device receiving the user's audio pause operation through a display screen as an example, but in actual applications, it is not limited to this.
[0132] S502: The display screen of the electronic device sends audio pause operation information to the audio module.
[0133] The audio pause operation information may be information or information stream corresponding to the audio pause operation.
[0134] In some embodiments, after the display screen of the electronic device receives an audio pause operation input by the user, it can generate corresponding information (such as an electrical signal) in response to the audio pause operation; thereafter, the display screen can transmit the audio pause information to the display module, and the display module sends it to the audio module of the electronic device.
[0135] S503: The audio module of the electronic device sends audio pause operation information to a Bluetooth host.
[0136] Among them, the Bluetooth host can correspond to, for example Figure 2 The Bluetooth framework shown, or Bluetooth host may also be described as a Bluetooth module.
[0137] S504: The Bluetooth host of the electronic device generates an audio pause instruction in response to the audio pause operation information.
[0138] In some embodiments, when audio pause operation information is received, the Bluetooth host will generate an audio pause instruction in response to the audio pause operation information (for example, it may correspond to the AVDTP suspend instruction in Table 1 above), but at this time the Bluetooth host will not generate a flush instruction or other instructions for discarding audio-related information between the electronic device and the Bluetooth device.
[0139] S505, the Bluetooth host sends an audio pause instruction to the Bluetooth chip.
[0140] S506: The Bluetooth chip of the electronic device sends an audio pause instruction to the Bluetooth device.
[0141] In some embodiments, the Bluetooth chip of the electronic device may send an audio pause instruction to the Bluetooth device via the air interface.
[0142] It should be noted that, at this time, since the Bluetooth chip does not receive the flush command, the operation of discarding the audio temporary command will not be executed, so the Bluetooth chip can successfully send the audio pause command to the Bluetooth device. Different from the air interface log shown in Table 2 above, the corresponding air interface log in this scenario may include the audio pause command.
[0143] S507, the Bluetooth chip of the electronic device receives the audio pause response instruction sent by the Bluetooth device.
[0144] In some embodiments, after receiving the audio pause instruction, the Bluetooth device may generate an audio pause response instruction in response to the audio pause instruction, and feed back the audio pause response instruction to the electronic device through the air interface.
[0145] Specifically, the process of a Bluetooth device generating and sending an audio pause response instruction to an electronic device may include: the Bluetooth device receives an audio pause instruction sent by the electronic device through a communication module; thereafter, the communication module of the Bluetooth device sends the audio pause instruction to the Bluetooth chip of the Bluetooth device, and the Bluetooth chip sends the audio pause instruction to the Bluetooth host of the Bluetooth device; the Bluetooth host of the Bluetooth device generates an audio pause response instruction in response to the audio pause instruction, and sends it to the electronic device via a reverse path by the Bluetooth host, Bluetooth chip and communication module of the Bluetooth device.
[0146] S508, the Bluetooth chip of the electronic device sends an audio pause response instruction to the Bluetooth host of the electronic device.
[0147] S509: The Bluetooth host of the electronic device generates a flush instruction in response to the audio pause response instruction.
[0148] S510: The Bluetooth host of the electronic device sends a flush instruction to the Bluetooth chip of the electronic device.
[0149] S511: The Bluetooth chip of the electronic device discards the audio information between the electronic device and the audio device in response to the flush instruction.
[0150] Among them, the audio information here can correspond to the audio-related information interacted between the electronic device and the Bluetooth device mentioned above. The audio here can include any audio between the electronic device and the Bluetooth device, or the audio here can specifically refer to the audio currently played through the electronic device audio App.
[0151] According to the method for optimizing audio playback provided in an embodiment of the present application, by setting the timing for generating a flush instruction, that is, after the electronic device receives the audio pause response information fed back by the audio device, a flush instruction is generated, thereby solving the problem of abnormal audio playback caused by the electronic device's inability to successfully send an audio pause instruction.
[0152] For example, Figure 6 FIG. 1 is a schematic flow chart of another method for optimizing audio playback provided in an embodiment of the present application. Specifically, the method includes the following steps:
[0153] S601, the electronic device receives an audio pause operation input by a user.
[0154] S602: The display screen of the electronic device sends audio pause operation information to the audio module.
[0155] S603: The audio module of the electronic device sends audio pause operation information to a Bluetooth host.
[0156] S604: The Bluetooth host of the electronic device generates an audio pause instruction and a flush instruction in response to the audio pause operation information.
[0157] S605, the Bluetooth host sends an audio pause instruction and a flush instruction to the Bluetooth chip.
[0158] S606: The Bluetooth chip of the electronic device does not execute the operation of discarding the audio pause instruction in response to the flush instruction, and sends the audio pause instruction to the Bluetooth device.
[0159] S607, the Bluetooth chip of the electronic device receives the audio pause response instruction sent by the Bluetooth device.
[0160] S608: The Bluetooth chip of the electronic device discards the audio information between the electronic device and the audio device in response to the flush instruction.
[0161] For a detailed description of steps S601 to S608 in the embodiment of the present application, please refer to the above Figure 5 The corresponding introduction in the embodiments will not be repeated here.
[0162] According to the method for optimizing audio playback provided in an embodiment of the present application, by setting the timing for generating a flush instruction, that is, after the electronic device receives the audio pause response information fed back by the audio device, a flush instruction is generated, thereby solving the problem of abnormal audio playback caused by the electronic device's inability to successfully send an audio pause instruction.
[0163] For example, Figure 7 FIG. 1 is a schematic flow chart of another method for optimizing audio playback provided in an embodiment of the present application. Specifically, the method includes the following steps:
[0164] S701, the electronic device receives an audio pause operation input by a user.
[0165] S702: The display screen of the electronic device sends audio pause operation information to the audio module.
[0166] S703: The audio module of the electronic device sends audio pause operation information to a Bluetooth host.
[0167] S704: The Bluetooth host of the electronic device generates an audio pause instruction and a flush instruction in response to the audio pause operation information.
[0168] S705, the Bluetooth host sends an audio pause instruction and a flush instruction to the Bluetooth chip.
[0169] S706: The Bluetooth chip of the electronic device does not execute the operation of discarding the audio pause instruction in response to the flush instruction, and sends the audio pause instruction to the Bluetooth device.
[0170] S707, the Bluetooth chip of the electronic device receives the audio pause response instruction sent by the Bluetooth device.
[0171] S708, the Bluetooth chip of the electronic device sends an audio pause response instruction to the Bluetooth host of the electronic device.
[0172] S709, the Bluetooth host of the electronic device sends instruction information for executing a flush instruction to the Bluetooth chip in response to the audio pause response instruction.
[0173] S710: The Bluetooth chip of the electronic device responds to the instruction information of the flush instruction and discards the audio information between the electronic device and the audio device according to the flush instruction.
[0174] For a detailed description of steps S701 to S710 in the embodiment of the present application, please refer to the above Figure 5 The corresponding introduction in the embodiments will not be repeated here.
[0175] According to the method for optimizing audio playback provided in an embodiment of the present application, by setting the timing for generating a flush instruction, that is, after the electronic device receives the audio pause response information fed back by the audio device, a flush instruction is generated, thereby solving the problem of abnormal audio playback caused by the electronic device's inability to successfully send an audio pause instruction.
[0176] For example, Figure 8 As shown, it is a schematic flow chart of another method for optimizing audio playback provided in an embodiment of the present application.
[0177] S801, obtaining a first operation input by a user, where the first operation is used to pause a first audio, and the first audio is played through a Bluetooth device that is communicatively connected to the electronic device.
[0178] S802: In response to a first operation, obtain audio pause information.
[0179] S803: Send audio pause information to the Bluetooth device.
[0180] S804: After receiving the audio pause response information fed back by the Bluetooth device, in response to the audio information discarding information, discard the information related to the first audio that is exchanged between the electronic device and the Bluetooth device.
[0181] In one possible implementation, the first operation may be, for example, a user clicking a pause button in an audio playback app; or, the first operation may be a user pausing the audio by voice input to an electronic device; or, the first operation may be, for example, a user answering a call during audio playback.
[0182] It should be noted that pausing the playing of the first audio mentioned here may include: pausing the playing of the first audio without exiting the audio playing App; or directly exiting the audio playing App.
[0183] In a possible implementation, the audio pause information may be described as an audio pause instruction; the audio information discard information may be described as an audio information discard instruction, and the audio information discard information may specifically be a flush instruction.
[0184] In some embodiments, the acquiring the audio pause information in response to the first operation specifically includes: generating the audio pause information in response to the first operation, and not generating the audio information discarding information.
[0185] In some embodiments, the electronic device includes an audio module, a Bluetooth host and a Bluetooth chip; the method also includes: the audio module receives first information corresponding to the first operation; the audio module sends the first information to the Bluetooth host; in response to the first information, the Bluetooth host generates the audio pause information and does not generate the audio discard information; the Bluetooth host sends the audio pause information to the Bluetooth chip; the Bluetooth chip sends the audio pause information to the Bluetooth device.
[0186] In some embodiments, the Bluetooth chip receives audio pause response information sent by the Bluetooth device; the Bluetooth chip sends the audio pause response information to the Bluetooth host; in response to the audio pause response information, the Bluetooth host generates the audio discard indication information; the Bluetooth host sends the audio discard indication information to the Bluetooth chip; in response to the audio discard indication information, the Bluetooth chip discards the information related to the first audio exchanged between the electronic device and the Bluetooth device.
[0187] In some embodiments, the method also includes: in response to the first operation, obtaining the audio pause information and the audio information discard information; sending the audio pause information to the Bluetooth device, and after receiving the audio pause response information fed back by the Bluetooth device, in response to the audio information discard information, discarding the information related to the first audio exchanged between the electronic device and the Bluetooth device.
[0188] In some embodiments, the electronic device includes an audio module, a Bluetooth host and a Bluetooth chip; the method also includes: the audio module receives first information corresponding to the first operation; the audio module sends the first information to the Bluetooth host; in response to the first information, the Bluetooth host generates the audio pause information and the audio information discard information; the Bluetooth host sends the audio pause information and the audio information discard information to the Bluetooth chip; the Bluetooth chip sends the audio pause information to the Bluetooth device.
[0189] In some embodiments, the method also includes: the Bluetooth chip receives audio pause response information fed back by the Bluetooth device; in response to the audio pause response information, the Bluetooth chip discards information based on audio information, and discards information related to the first audio exchanged between the electronic device and the Bluetooth device.
[0190] In some embodiments, the method further includes: obtaining a second operation input by the user, the second operation being used to play the first audio again; and in response to the second operation, sending the first audio to the Bluetooth device so that the first audio is played through the Bluetooth device.
[0191] According to the method for optimizing audio playback provided in an embodiment of the present application, by setting the timing for generating a flush instruction, that is, after the electronic device receives the audio pause response information fed back by the audio device, a flush instruction is generated, thereby solving the problem of abnormal audio playback caused by the electronic device's inability to successfully send an audio pause instruction.
[0192] Based on the same technical concept, an embodiment of the present application also provides a terminal device, including: a display; one or more processors; one or more memories; the one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the terminal device executes one or more steps in any of the above methods.
[0193] Based on the same technical concept, an embodiment of the present application also provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is run on a computer or a processor, the computer or the processor executes one or more steps in any of the above methods.
[0194] Based on the same technical concept, the embodiment of the present application further provides a computer program product including instructions. When the computer program product is run on a computer or a processor, the computer or the processor executes one or more steps in any of the above methods.
[0195] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)), etc.
[0196] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
[0197] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.
Claims
1. A method for optimizing audio playback, characterized in that: Used in electronic equipment, including: Acquire a first operation input by a user, where the first operation is used to pause a first audio, and the first audio is played through a Bluetooth device that is communicatively connected to the electronic device; In response to the first operation, obtaining audio pause information; Sending the audio pause information to the Bluetooth device; After receiving the audio pause response information fed back by the Bluetooth device, in response to the audio information discard information, the information related to the first audio exchanged between the electronic device and the Bluetooth device is discarded, and the audio information discard information is generated by the Bluetooth host of the electronic device in response to the audio pause information after obtaining the audio pause information, and is sent by the Bluetooth host of the electronic device to the Bluetooth chip of the electronic device.
2. The method according to claim 1, characterized in that The acquiring audio pause information in response to the first operation specifically includes: In response to the first operation, the audio pause information is generated, and the audio information discard information is not generated.
3. The method according to claim 1 or 2, characterized in that: The electronic device comprises an audio module, a Bluetooth host and a Bluetooth chip; the method further comprises: The audio module receives first information corresponding to the first operation; The audio module sends the first information to the Bluetooth host; In response to the first information, the Bluetooth host generates the audio pause information and does not generate the audio discard information; The Bluetooth host sends the audio pause information to the Bluetooth chip; The Bluetooth chip sends the audio pause information to the Bluetooth device.
4. The method according to claim 3, characterized in that The method further comprises: The Bluetooth chip receives the audio pause response information sent by the Bluetooth device; The Bluetooth chip sends the audio pause response information to the Bluetooth host; In response to the audio pause response information, the Bluetooth host generates the audio discard indication information; The Bluetooth host sends the audio discard indication information to the Bluetooth chip; In response to the audio discard indication information, the Bluetooth chip discards the information related to the first audio exchanged between the electronic device and the Bluetooth device.
5. The method according to claim 1, characterized in that The method further comprises: In response to the first operation, acquiring the audio pause information and the audio information discard information; The audio pause information is sent to the Bluetooth device, and after receiving the audio pause response information fed back by the Bluetooth device, in response to the audio information discard information, the information related to the first audio exchanged between the electronic device and the Bluetooth device is discarded.
6. The method according to claim 5, characterized in that The electronic device comprises an audio module, a Bluetooth host and a Bluetooth chip; the method further comprises: The audio module receives first information corresponding to the first operation; The audio module sends the first information to the Bluetooth host; In response to the first information, the Bluetooth host generates the audio pause information and the audio information discard information; The Bluetooth host sends the audio pause information and the audio information discard information to the Bluetooth chip; The Bluetooth chip sends the audio pause information to the Bluetooth device.
7. The method according to claim 6, characterized in that The method further comprises: The Bluetooth chip receives the audio pause response information fed back by the Bluetooth device; In response to the audio pause response information, the Bluetooth chip discards information according to the audio information, and discards the information related to the first audio exchanged between the electronic device and the Bluetooth device.
8. The method according to claim 1 or 2, characterized in that: The method further comprises: Obtaining a second operation input by a user, where the second operation is used to play the first audio again; In response to the second operation, the first audio is sent to the Bluetooth device, so that the first audio is played through the Bluetooth device.
9. An electronic device, characterized in that: include: one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the electronic device performs the method according to any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer-executable program, and when the computer-executable program is called by a computer, the computer executes the method according to any one of claims 1 to 8.
