Sound effect switching method, electronic equipment and storage medium

Abstract

The invention provides a sound effect switching method, electronic equipment and a storage medium, and relates to the technical field of audio processing. A digital cinema system sound effect link is cascaded with other sound effect links to construct a plurality of links with different sound effects, that is, a plurality of sound effect modes are constructed. When a user uses a certain application software, the user can select one sound effect mode, and the electronic equipment can be set to be automatically switched to the sound effect mode corresponding to the application scene according to the application scene corresponding to the application. Therefore, a user can select different sound playing effects when using different application software; or when the user uses the same application software, various different sound playing effects can also be selected. Therefore, various requirements of the user on the sound playing effect are met.

Description

Sound effect switching method, electronic device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on December 19, 2022, with application number 202211634015.4 and invention name “A sound effect switching method, electronic device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of audio processing technology, and in particular to a sound effect switching method, electronic device, and storage medium. Background Art

[0003] Sound effects are artificially created or enhanced sounds used to enhance the sound processing of movies, video games, music, or other artistic or other content in other media. Different sound effects are processed specifically for different scenarios, and each has its own advantages and optimal application scenarios.

[0004] Most electronic devices in the prior art are single-sound effect devices. Since each sound effect has different characteristics, it is difficult for one sound effect to meet the sound effect requirements of different scenes, thereby resulting in a poor listening experience for users.

[0005] Summary of the Invention

[0006] The present application provides a sound effect switching method, an electronic device and a storage medium, which solves the problem in the prior art that electronic devices only have one sound effect and cannot meet the sound effect requirements of different application scenarios.

[0007] To achieve the above objectives, this application adopts the following technical solutions:

[0008] In a first aspect, the present application provides a method for switching sound effects, which is applied to an electronic device and includes:

[0009] An electronic device presents a sound effect switching interface to a user, the sound effect switching interface including a plurality of sound effect mode function options. When the user triggers a target mode function option among the plurality of sound effect mode function options, the electronic device, in response to the triggering operation on the target mode function option among the plurality of sound effect mode function options, obtains a target sound effect mode corresponding to the target mode function option; and switches the sound effect mode of the electronic device to the target sound effect mode.

[0010] By setting up a sound effect switching interface in the electronic device, users are supported to select the sound effect mode according to actual needs. The electronic device can switch the sound effect mode based on the user's selection, so that the electronic device can meet the user's different needs for sound effects in different application scenarios of the electronic device.

[0011] In some possible implementations, the sound effect switching interface further includes an intelligent sound effect mode function option. When a user triggers the intelligent sound effect mode option, the electronic device automatically identifies the application scenario of the electronic device in response to the user triggering the intelligent sound effect mode function option. After identifying the application scenario of the electronic device, the electronic device determines a target sound effect mode corresponding to the application scenario of the electronic device and switches the sound effect mode of the electronic device to the target sound effect mode.

[0012] In the intelligent sound effect mode, the electronic device can automatically identify the application scenario and automatically switch to the sound effect mode corresponding to the application scenario, which can further meet the user's different needs for sound effects in different application scenarios of the electronic device.

[0013] In some possible implementations, the application scenario of the electronic device may be identified in the following manner:

[0014] Acquire the operating status of the electronic device; and determine the application scenario of the electronic device according to the operating status of the electronic device.

[0015] In some possible implementations, the operating state of the electronic device includes applications running on the electronic device. The application scenario of the electronic device is determined based on the operating state of the electronic device. Specifically, the following methods may be used:

[0016] Based on the target identifier of the application running on the electronic device and the pre-set correspondence between the application identifier and the scene identifier, a target scene corresponding to the target identifier is determined; and the target scene is then used as the application scene of the electronic device. Thus, the present application can determine the target scene of the running application based on the identifier of the running application and the pre-set correspondence between the application identifier and the scene identifier.

[0017] In some possible implementations, switching the sound effect mode of the electronic device to the target sound effect mode specifically includes switching the sound effect link corresponding to the sound effect mode of the electronic device to the sound effect link corresponding to the target sound effect mode. Different sound effect modes can be implemented by different sound effect links, and thus switching the sound effect mode of the electronic device can be achieved by switching the sound effect link.

[0018] In some possible implementations, before switching the sound effect mode of the electronic device to the target sound effect mode, the method provided in this application further includes constructing sound effect links corresponding to each sound effect mode. That is, in this application, different sound effect modes are implemented by constructing different sound effect links.

[0019] In some possible implementations, the method for constructing the sound effect links corresponding to each sound effect mode can first obtain the configuration parameters corresponding to each sound effect mode, and then construct the sound effect links corresponding to the target sound effect mode based on the configuration parameters corresponding to each sound effect mode. Different sound effect modes have different configuration parameters, and different sound effect links can be constructed based on different configuration parameters.

[0020] In some possible implementations, based on the configuration parameters corresponding to each sound effect mode, sound effect chains corresponding to the target sound effect mode are constructed. Specifically, based on the configuration parameters corresponding to each sound effect mode, the sub-sound effect chains comprising each sound effect mode are cascaded to construct the sound effect chains corresponding to the target sound effect mode. Different sound effect chains correspond to different sound effects, and different sound effect modes can be implemented by cascading multiple sub-sound effect chains.

[0021] In a second aspect, the present application provides an electronic device comprising: a processor and a memory; one or more computer programs are stored in the memory, the one or more computer programs including instructions; when the instructions are executed by the processor, the electronic device executes the sound effect switching method described in any possible design of the first aspect. The electronic device supports users in selecting sound effect modes according to actual needs by providing a sound effect switching interface. The electronic device can switch sound effect modes based on the user's selection, thereby meeting the user's different needs for sound effects in different application scenarios of the electronic device.

[0022] In a third aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the sound effect switching method as described in any possible design in the first aspect above.

[0023] It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of a feature or beneficial effect means that a specific technical feature, technical solution or beneficial effect is included in at least one embodiment. Therefore, the description of a technical feature, technical solution or beneficial effect in this specification does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in the present embodiment can also be combined in any appropriate manner. Those skilled in the art will understand that the embodiment can be implemented without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in specific embodiments that do not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] FIG1 is a schematic diagram of an implementation process of an audio switching method provided in an embodiment of the present application;

[0025] FIG2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0026] FIG3 is a software structure block diagram of an electronic device according to an embodiment of the present application;

[0027] FIG4 is a schematic diagram of an interface for a user using an electronic device provided in an embodiment of the present application;

[0028] FIG5 is a flow chart of a single sound effect processing method in the prior art;

[0029] FIG6 is a flow chart of a multi-sound effect processing method provided in an embodiment of the present application;

[0030] FIG7 is a schematic diagram of a multi-sound effect parameter configuration process provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The terms "first", "second" and "third" in the specification, claims and drawings of this application are used to distinguish different objects rather than to limit a specific order.

[0032] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0033] To make the description of the following embodiments clear and concise, a brief introduction to the related technologies is first given:

[0034] Sound effects are artificially created or enhanced sounds used to enhance the sound of films, video games, music, or other artistic or other media. Different sound effects are used in different scenarios, and each has its own advantages and optimal application scenarios.

[0035] DTS stands for "Digital Theatre System." It's a high-quality, multi-track surround sound technology for movies and music. DTS uses sound correlation to efficiently compress data, achieving a sampling rate of 192 kHz at 24 bits. This compares to CDs, which use linear PCM encoding and a sampling rate of only 44.1 kHz at 16 bits.

[0036] There are three main feelings when listening to music with DTS sound effects: first, the sound feels stronger than before; second, the sound feels richer; and third, the sound feels more three-dimensional, with an enhanced sense of surround. Overall, DTS does not require users to use large music files, and does not care about lossy or lossless audio formats. As long as the audio file is an audio file, it can perfectly modify the sound, making the sound more pleasant and three-dimensional, with outstanding effects.

[0037] Most electronic devices in the prior art are single-sound effect devices. Since each scene has different requirements for sound effects, it is difficult for one sound effect to meet the requirements of different scenes, thereby resulting in a poor listening experience for users.

[0038] In view of this, an embodiment of the present application provides an audio switching method, which is applied to an electronic device. For a specific implementation process of the method, see Figure 1. Figure 1 is a schematic diagram of an implementation process of an audio switching method provided by an embodiment of the present application.

[0039] When developing electronic devices, several scenarios can be pre-set for differentiation based on usage. For example, in the embodiment of this application, five application scenarios are pre-set, namely, voice enhancement scenario, music scenario, game scenario, movie scenario, and other scenario. Among them, application scenarios that do not belong to the voice enhancement scenario, music scenario, game scenario, and movie scenario are all classified as other scenarios.

[0040] Users can select a sound effect mode based on the actual application scenario. For example, if the user's application scenario is a game scene, the sound effect mode can be selected as Game Mode; if the user's application scenario is a movie scene, the user can select Movie Mode. Users can select the corresponding sound effect mode for different scenarios, so that users can get a better listening experience.

[0041] Users can also select Smart Mode in the sound effect mode settings interface of the electronic device. In this mode, the electronic device automatically identifies the type of scenario the user's application scenario belongs to and then assigns the corresponding sound effect mode based on the identified application scenario type. For example, when the user is listening to music in Smart Mode, the electronic device will recognize that the user's application scenario belongs to music and then assign the corresponding sound effect mode to the application scenario, allowing the user to obtain a better listening experience.

[0042] In some possible implementations, the method for identifying application scenarios can be to pre-classify various software programs, that is, to assign each software program to a specific application scenario. When a user opens a certain software program, the user's application scenario can be automatically identified based on the opened software program.

[0043] The method for identifying the application scenario may also be implemented in other ways, and is not limited to the method for identifying the application scenario mentioned in the above embodiment.

[0044] Different sound effect modes can be achieved by cascading different sound effect processing modules behind the first sound effect processing module. It should be noted that the first sound effect processing module is usually used to perform DTS sound effect processing on audio data.

[0045] The specific implementation process of different sound effects is illustrated with examples. For example, vocal enhancement mode can be implemented by cascading the sound effect processing module corresponding to sound effect 1; music mode can be implemented by cascading the sound effect processing module corresponding to sound effect 2; game mode can be implemented by cascading the sound effect processing module corresponding to sound effect 2 and the sound effect processing module corresponding to sound effect N; movie mode can be implemented by cascading the sound effect processing module corresponding to sound effect 1, the sound effect processing module corresponding to sound effect 2, and the sound effect processing module corresponding to sound effect N; other modes can be implemented by cascading the sound effect processing module corresponding to sound effect 1 and the sound effect processing module corresponding to sound effect N.

[0046] In this way, by cascading other different sound effect processing modules after the first sound effect processing module, a variety of sound effects can be achieved. Different sound effects can be used in different application scenarios, and different sound effects can also be used in the same scenario. This can meet the diverse needs of users for sound effects and provide users with a better listening experience.

[0047] In some embodiments, the electronic device may be a mobile phone, tablet computer, desktop computer, laptop computer, notebook computer, ultra-mobile personal computer (UMPC), handheld computer, netbook computer, personal digital assistant (PDA), wearable electronic device, smart watch, etc. This application does not impose any special restrictions on the specific form of the above electronic devices. In this embodiment, the structure of the electronic device may be as shown in Figure 2, which is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0048] As shown in Figure 2, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a display screen 194, etc.

[0049] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0050] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. For example, in the present application, the processor 110 can obtain the target sound effect mode corresponding to the target application based on the sound effect mode function option set by the user; and switch the sound effect mode of the target application to the target sound effect mode.

[0051] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction operation codes and timing signals to complete the control of instruction fetching and execution.

[0052] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0053] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0054] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, processor 110 may include multiple I2C busses. Processor 110 may couple to sensors, a charger, a flash, camera 193, and the like in sensor 180 via different I2C bus interfaces. For example, processor 110 may couple to a touch sensor in touch sensor 180 via an I2C interface, enabling communication between processor 110 and the touch sensor via the I2C bus interface, thereby enabling touch functionality in the electronic device.

[0055] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0056] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0057] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0058] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the electronic device's camera function. The processor 110 and the display 194 communicate via the DSI interface to implement the electronic device's display function.

[0059] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0060] USB port 130 is an interface that complies with USB standards and may be a Mini USB port, a Micro USB port, a USB Type-C port, or the like. USB port 130 can be used to connect a charger to charge an electronic device, transfer data between the electronic device and peripherals, connect headphones to play audio, and connect other electronic devices, such as augmented reality devices.

[0061] It is understood that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0062] The electronic device implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0063] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device can include one or N display screens 194, where N is a positive integer greater than one.

[0064] A series of graphical user interfaces (GUIs) can be displayed on the display screen 194 of the electronic device. These GUIs are the main screen of the electronic device. Generally speaking, the size of the display screen 194 of the electronic device is fixed, and only a limited number of controls can be displayed on the display screen 194 of the electronic device. A control is a GUI element, which is a software component included in an application. It controls all data processed by the application and the interactive operations on this data. Users can interact with the control through direct manipulation to read or edit relevant information of the application. Generally speaking, controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0065] The electronic device can realize the shooting function through an ISP, a camera, a video codec, a GPU, a display 194 and an application processor.

[0066] The ISP processes data fed back by the camera. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimizations on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be integrated into the camera.

[0067] The camera is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device may include 1 or N cameras, where N is a positive integer greater than 1.

[0068] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when an electronic device selects a frequency, the DSP performs a Fourier transform on the frequency energy.

[0069] Video codecs are used to compress or decompress digital video. Electronic devices may support one or more video codecs. This allows them to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0070] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in electronic devices, such as image recognition, face recognition, speech recognition, and text comprehension.

[0071] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0072] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. For example, in this embodiment, the processor 110 can execute the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121, and / or the instructions stored in the memory provided in the processor.

[0073] The electronic device can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0074] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110. In the embodiment of the present application, the audio module 170 can also process audio data to obtain sound data with various effects.

[0075] Speaker 170A, also known as a "horn," converts electrical audio signals into sound signals. The electronic device can use speaker 170A to listen to music or make hands-free calls. When a user opens an application on the electronic device, speaker 170A plays the processed sound data from the application, based on the user's selected sound effect mode. The sound effects played correspond to the user's selected sound effect mode.

[0076] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device receives a call or voice message, the voice can be heard by placing the receiver 170B close to the human ear.

[0077] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device can be provided with at least one microphone 170C. In other embodiments, the electronic device can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device can also be provided with three, four or more microphones 170C to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.

[0078] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0079] Keys 190 include a power button, a volume button, and the like. Keys 190 may be mechanical keys or touch-sensitive keys. The electronic device may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.

[0080] The operating system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to illustrate the software structure of the electronic device.

[0081] FIG3 is a block diagram of the software structure of the electronic device according to an embodiment of the present application.

[0082] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, the hardware abstraction layer, and the kernel layer.

[0083] The application layer can include a series of application packages. As shown in Figure 3, the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, game, etc.

[0084] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 3, the application framework layer may include a window manager, content provider, view system, telephony manager, resource manager, notification manager, and audio hub system.

[0085] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0086] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0087] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0088] The phone manager is used to provide communication functions for electronic devices, such as call status management (including answering, hanging up, etc.).

[0089] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0090] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0091] The audio central system is used to configure the various parameters of the sound effect mode according to the mode selected by the user and the application scenario corresponding to the application selected by the user when the user opens an application with a sound playback function, and pass the various parameters corresponding to the configured sound effect mode to the audio hardware abstraction layer.

[0092] AndroidRuntime includes the core library and virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0093] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0094] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0095] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0096] The surface manager is used to manage the display subsystem and provide the fusion of two-dimensional and three-dimensional layers for multiple applications.

[0097] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0098] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0099] A 2D graphics engine is a drawing engine for 2D drawings.

[0100] The Hardware Abstraction Layer (HAL) is an interface layer between the operating system kernel and the hardware circuitry. Its purpose is to abstract the hardware, providing the operating system with a virtual hardware platform, making it hardware-independent and portable across multiple platforms. From the perspective of software and hardware testing, both hardware and software testing can be performed independently within the HAL, enabling parallel testing. This means that hardware control actions are placed within the HAL.

[0101] In the embodiment of the present application, the hardware abstraction layer specifically refers to an audio hardware abstraction layer, which is used to drive the hardware to produce sound using various parameters in the sound effect mode configured by the audio central system. The hardware here can be the speaker 170A.

[0102] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0103] It should be noted that although the embodiments of the present application are described using the Android system as an example, its basic principles are also applicable to electronic devices based on operating systems such as iOS and Windows.

[0104] See FIG4 , which is a schematic diagram of an interface for a user using an electronic device provided in an embodiment of the present application.

[0105] Users can set the sound effect mode on the electronic device's sound effect switching interface, which includes multiple sound effect mode function options and smart mode function options. The sound effect modes that users can set include: smart mode and custom mode; among them, the modes that users can select in custom mode include: vocal enhancement mode, music mode, game mode, movie mode, and other modes. For example, the user can select the sound effect mode as music mode. When the user opens a certain software, the sound effect played by the software will be based on the effect of music mode.

[0106] The user can also set the sound mode to smart mode in the sound mode setting interface of the electronic device. In this way, when the user clicks on an icon of the electronic device, for example, when the user clicks on the "video" icon, the electronic device will automatically identify which scenario the user's application scenario belongs to. The scenario in which the user plays the video is identified as "other scene", and the electronic device automatically assigns the sound mode of "other mode" to "other scene". In this way, the sound playback effect can be more in line with the user's application scenario, giving the user a better auditory experience.

[0107] Specifically, when the user sets the sound effect mode to smart mode, the electronic device first identifies the application scenario to which the electronic device currently belongs. Specifically, the electronic device can determine the application scenario corresponding to the target identifier based on the application running on the electronic device, using the target identifier of the application running on the electronic device and the pre-set correspondence between the application identifier and the scene identifier. The electronic device then switches the audio mode to the audio mode corresponding to the current application scenario of the electronic device.

[0108] The specific implementation process of the sound effect switching scheme provided by this application will be described in detail below with reference to the accompanying drawings.

[0109] Refer to FIG5 , which is a flow chart of a single sound effect processing method in the prior art.

[0110] The audio mix in the diagram can be understood as the raw sound data used to play audio in various applications. This sound data can be two-channel or multi-channel, including 5.1-channel and 7.1-channel data. Three cache modules are used to cache the audio mix data: the mixing cache, the effects cache, and the sink cache.

[0111] First, the mixing cache module stores data without sound effects. Then, the sound effects are added to the mixed data, and the cached data with the first sound effects added is stored in the effect cache module. Finally, the mixed data is stored in the sinking cache module, so that the sinking cache module can output the mixed data with the first sound effects added. The first sound effect is typically a DTS sound effect, meaning that in the prior art, only DTS sound effects are processed on the audio data.

[0112] It can be seen that in the prior art, only one sound effect can be added to the mixed data, so that the played sound data has a single effect and it is difficult to meet the user's demand for a variety of sound effects.

[0113] See FIG6 , which is a flowchart of a multi-sound effect processing method provided in an embodiment of the present application.

[0114] The main difference between the embodiment of the present application and the solution described in Figure 5 is the different sound effect processing process for sound data.

[0115] The audio mix in the embodiments of this application can also be understood as the original sound data used to play sound in various application software. This sound data can be dual-channel data or multi-channel data, including 5.1-channel data, 7.1-channel data, etc. The audio mix data is cached using three cache modules: a mixing cache module, an effects cache module, and a sink cache module.

[0116] S601: Mixing data.

[0117] Mixed audio data is data without sound effects added.

[0118] S602: Store the mixed audio data in a mixed buffer module.

[0119] First, the mixing cache module is used to store the data without sound effects added; then the sound effects are added to the mixed data.

[0120] S603: Store the audio data with the first sound effect added into the effect cache module.

[0121] First, the mixed audio data is processed by adding a first sound effect, which is generally a DTS sound effect, that is, adding a DTS sound effect to the mixed audio data.

[0122] S604: Storing the audio data with the first sound effect added in a sinking cache module.

[0123] The audio data with the first sound effect added is then stored in the sink cache module.

[0124] S605: Add a second sound effect to the audio data to which the first sound effect is added.

[0125] Specifically, a second sound effect can be added to the mixed audio data based on the user's actual needs. The second sound effect can be multiple sound effects. Multiple sound effect processing modules are cascaded to achieve different sound effect processing on the mixed audio data, resulting in different playback effects. For example, if the user selects game mode, the sound effects added to the mix are the first sound effect, sound effect 2, and sound effect N.

[0126] S606: Store the audio data with the second sound effect added into the effect cache module.

[0127] If the second sound effect selected by the user includes sound effect 2 and sound effect N, the sound data after adding the first sound effect, sound effect 2, and sound effect N will be stored in the effect cache module. If the user selects movie mode, the sound effects added to the mix are the first sound effect, sound effect 1, sound effect 2, and sound effect N; the sound data after adding the first sound effect, sound effect 1, sound effect 2, and sound effect N will be stored in the effect cache module.

[0128] S607: Storing the audio data with the second sound effect added in the sinking cache module.

[0129] Finally, the audio data with the corresponding sound effects added is stored in the sinking cache module so that the sinking cache module can output the mixed data with the corresponding sound effects added.

[0130] Figure 6 only shows the audio data processing process of the first sound effect processing module cascading one other sound effect processing module. If multiple other sound effect processing modules are cascaded, the audio data processing process is the same as the audio data processing process of cascading one other sound effect processing module.

[0131] From this, it can be seen that the solution provided in the embodiment of the present application supports the cascading of multiple sound effect processing modules. Through the cascading of multiple sound effect processing modules, a variety of different sound playback effects can be achieved, that is, a variety of sound effect modes are realized, so that users can choose the corresponding sound effect mode according to actual needs, thereby meeting the user's various needs for sound effects.

[0132] See FIG. 7 , which is a schematic diagram of a multi-sound effect parameter configuration process according to an embodiment of the present application.

[0133] The embodiments of the present application mainly introduce the implementation process of the multi-sound effect parameter configuration process at the software level.

[0134] The user opens an application software.

[0135] Before opening an application, users can set the sound effect mode on the electronic device's sound effect switching interface. They can select a specific sound effect mode. When the user opens the application, the sound effects played by the application will be the effects of the user-selected sound effect mode. Users can also select smart mode. In smart mode, when the user opens an application, the electronic device automatically identifies the application scenario of the user-selected application and automatically selects the target sound effect mode corresponding to the application scenario.

[0136] In some possible implementations, the application scenario of an electronic device can be identified by using a processor in the electronic device to obtain the operating status of the electronic device, which includes the applications running on the electronic device. That is, the usage scenario of the electronic device can be identified by identifying the applications running on the electronic device.

[0137] In some possible implementations, the target scene corresponding to the target identifier can be determined based on the target identifier of the application running on the electronic device and the pre-set correspondence between the application identifier and the scene identifier, and the target scene can be used as the application scene of the electronic device.

[0138] In some possible implementations, pre-set correspondences between application identifiers and scenario identifiers can be used to categorize applications, with the categorization corresponding to the scenario. Each application has a corresponding application identifier; each scenario also has a corresponding scenario identifier, thus achieving a one-to-one correspondence between applications and scenarios.

[0139] One thing that needs to be explained is that users do not need to select the sound mode every time they open the application. The sound mode needs to be set only when the user needs to adjust the sound mode.

[0140] The audio hub system obtains the audio stream of the target application.

[0141] In this embodiment of the application, a user selects smart mode as an example. When the user opens an application, the electronic device recognizes that the application scenario corresponding to the application is a movie scenario, and the sound effect mode corresponding to the movie scenario is movie mode. The application opened by the user is used as the target application. As a result, the audio center system in the application framework layer obtains the audio stream of the target application and then performs mixing processing on the audio stream.

[0142] The audio hub system mixes the audio streams.

[0143] Mixing is a step in music production, which is to integrate sounds from multiple sources into a stereo track or a mono track. The purpose of mixing the audio stream in the embodiment of the present application is to achieve matching between the audio stream and the channel link.

[0144] The processed audio stream is transmitted through the channel link.

[0145] After the audio stream is mixed and processed into an audio stream that matches the channel link, it is transmitted through the channel link.

[0146] The central audio system determines the sound effect parameters that need to be cascaded.

[0147] Since the application scenario corresponding to the target application is a movie scene, and the sound effect mode corresponding to the movie scene is movie sound effect, based on this, the audio central system determines that the sound effect parameters corresponding to the cascaded sound effect processing modules are sound effect 1, sound effect 2 and sound effect N, and cascades the sound effect modules corresponding to these three sound effect parameters to process the audio stream in turn.

[0148] The audio hub system obtains the configuration of sound effect parameters.

[0149] After the central audio system determines that the sound effect parameters that need to be cascaded include sound effect 1, sound effect 2, and sound effect N, it obtains the storage address of the sound effect parameters corresponding to sound effect 1 from the sound effect parameter address storage module corresponding to sound effect 1, and then sends the obtained storage address of the sound effect parameters corresponding to sound effect 1 to the central audio system extension module. Based on the received storage address of the sound effect parameters corresponding to sound effect 1, the central audio system extension module obtains the sound effect parameters corresponding to sound effect 1 from the sound effect parameter storage module based on the storage address, and returns the sound effect parameters corresponding to sound effect 1 to the central audio system.

[0150] The process for obtaining the sound effect parameters corresponding to Sound Effect 2 is similar. Specifically, the central audio system obtains the storage address of the sound effect parameters corresponding to Sound Effect 2 from the sound effect parameter address storage module, and then sends the obtained storage address of the sound effect parameters corresponding to Sound Effect 2 to the central audio system extension module. The central audio system extension module obtains the sound effect parameters corresponding to Sound Effect 2 from the sound effect parameter storage module based on the received storage address of the sound effect parameters corresponding to Sound Effect 2, and returns the sound effect parameters corresponding to Sound Effect 2 to the central audio system.

[0151] The process for obtaining the sound effect parameters corresponding to sound effect N is similar. Specifically, the central audio system obtains the storage address of the sound effect parameters corresponding to sound effect N from the sound effect parameter address storage module, and then sends the obtained storage address of the sound effect parameters corresponding to sound effect N to the central audio system extension module. The central audio system extension module obtains the sound effect parameters corresponding to sound effect N from the sound effect parameter storage module based on the received storage address of the sound effect parameters corresponding to sound effect N, and returns the sound effect parameters corresponding to sound effect N to the central audio system.

[0152] The audio hub system uses various sound effect parameters to construct sound effect processing modules and cascades these modules. The sound effect processing modules include sound effect links.

[0153] After obtaining the sound effect parameters corresponding to each sound effect, the audio central system constructs a sound effect processing module based on each sound effect parameter. The constructed sound effect processing modules are then cascaded with the DTS sound effect processing module to process the audio stream data.

[0154] Taking the movie mode as an example, after the audio central system obtains the sound effect parameters corresponding to sound effect 1, sound effect 2, and sound effect N, it constructs the sound effect links corresponding to sound effect 1, sound effect 2, and sound effect N respectively based on the sound effect parameters corresponding to sound effect 1, sound effect 2, and sound effect N. Since each sound effect mode can be composed of other sound effect links required by the DTS sound effect link cascade, the constructed sound effect links corresponding to sound effect 1, sound effect 2, and sound effect N are cascaded with the DTS sound effect link to form the sound effect link of the movie mode. Each sound effect link is encapsulated in each sound effect processing module, so cascading each sound effect link is equivalent to cascading each sound effect processing module.

[0155] The audio hub system uses cascaded sound processing modules to process audio stream data.

[0156] The audio center system uses cascaded sound effect processing modules to process the audio stream data to obtain processed audio data, which is audio data that conforms to movie sound effects.

[0157] After processing the audio data, the audio central system sends an instruction to the audio hardware abstraction layer, which instructs the audio hardware abstraction layer to drive the hardware to produce sound.

[0158] After the audio central system processes the audio stream data using the various sound effect cascades, it sends instructions to the audio hardware abstraction layer to instruct the audio hardware abstraction layer to drive the hardware to produce sound.

[0159] The audio hardware abstraction layer drives the hardware to produce sound.

[0160] After receiving the instruction from the audio central system, the audio hardware abstraction layer drives the hardware to produce sound. In the embodiment of the present application, the hardware can be a speaker. The sound effects produced by the hardware are movie sound effects.

[0161] In the embodiment of the present application, by cascading various sound effect processing modules and utilizing the cascaded multiple sound effect processing modules to process audio stream data, different sound effects of the audio stream in different application scenarios are achieved, thus satisfying users' various needs for sound effects.

[0162] In some possible implementations, if the sound effect mode selected by the user does not require the cascading of multiple sound effect processing modules, for example, if the sound effect mode selected by the user is music mode, only sound effect 2 is required to implement it. The specific implementation process is the same as the implementation process of the cascaded sound effect processing module, and will not be repeated here.

[0163] In some possible implementations, during the process of processing audio data by multiple cascaded sound effect processing modules, the audio data input into each sound effect parameter may be dual-channel data or multi-channel data.

[0164] In some possible implementations, multiple cascaded audio processing modules can process audio data in multiple formats, for example, audio data in formats such as 44.1K 32-bit float, 48K 32-bit float, and 48K 24-bit.

[0165] This embodiment also provides an electronic device, which includes: a processor and a memory;

[0166] One or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device executes the sound effect switching method described in the above embodiment.

[0167] This embodiment also provides a computer-readable storage medium, which includes instructions. When the above instructions are executed on an electronic device, the electronic device executes the relevant method steps described in the above embodiment to implement the sound effect switching method described in the above embodiment.

[0168] In the solution provided in the embodiment of the present application, the following steps are mainly used to implement the switching of sound effects:

[0169] Presenting a sound effect switching interface, wherein the sound effect switching interface includes multiple sound effect mode function options;

[0170] In response to a triggering operation on a target mode function option among the plurality of sound effect mode function options, acquiring a target sound effect mode corresponding to the target mode function option;

[0171] The sound effect mode of the electronic device is switched to the target sound effect mode.

[0172] When a user uses an application, they can select a sound effect mode on the electronic device's sound effect switching interface, or they can set the electronic device to automatically switch to the sound effect mode corresponding to the application scenario. This allows users to select different sound playback effects when using different application software, or they can select multiple different sound playback effects when using the same application software. This satisfies users' diverse needs for sound playback effects.

[0173] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0174] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0175] In the several embodiments provided in this embodiment, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0176] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0177] In addition, the functional units in each embodiment of the present invention may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0178] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment. The aforementioned storage medium includes: various media that can store program code, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.

[0179] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A sound effect switching method, characterized in that: Applied to electronic equipment, the method includes: Presenting a sound effect switching interface, wherein the sound effect switching interface includes multiple sound effect mode function options; In response to a triggering operation on a target mode function option among the plurality of sound effect mode function options, acquiring a target sound effect mode corresponding to the target mode function option; The sound effect mode of the electronic device is switched to the target sound effect mode.

2. The method according to claim 1, characterized in that The sound effect switching interface also includes an intelligent sound effect mode function option, and the method further includes: In response to a triggering operation on the smart sound effect mode function option, identifying an application scenario of the electronic device; Determining a target sound effect mode corresponding to an application scenario of the electronic device; The sound effect mode of the electronic device is switched to the target sound effect mode.

3. The method according to claim 2, characterized in that The identifying an application scenario of the electronic device includes: Obtaining the operating status of the electronic device; An application scenario of the electronic device is determined according to the operating status of the electronic device.

4. The method according to claim 3, characterized in that The operating state of the electronic device includes an application running on the electronic device; and determining the application scenario of the electronic device according to the operating state of the electronic device includes: Determining a target scene corresponding to the target identifier according to the target identifier of the application running on the electronic device and a preset correspondence between the application identifier and the scene identifier; The target scene is used as the application scene of the electronic device.

5. The method according to any one of claims 1 to 4, characterized in that The switching of the sound effect mode of the electronic device to the target sound effect mode specifically includes: The sound effect link corresponding to the sound effect mode of the electronic device is switched to the sound effect link corresponding to the target sound effect mode.

6. The method according to claim 5, characterized in that Before switching the sound effect mode of the electronic device to the target sound effect mode, the method further includes: Construct the sound effect chain corresponding to each sound effect mode.

7. The method according to claim 6, characterized in that The construction of the sound effect link corresponding to each sound effect mode specifically includes: Get the configuration parameters corresponding to each sound effect mode; According to the configuration parameters corresponding to each sound effect mode, the sound effect links corresponding to the target sound effect mode are constructed respectively.

8. The method according to claim 7, characterized in that The step of constructing the sound effect links corresponding to the target sound effect modes according to the configuration parameters corresponding to the respective sound effect modes specifically includes: According to the configuration parameters corresponding to each sound effect mode, the sub-sound effect chains constituting each sound effect mode are cascaded respectively to construct the sound effect chains corresponding to the target sound effect mode respectively.

9. An electronic device, characterized in that: include: processor and memory; One or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device executes any one of claims 1 to 8. Sound effect switching method.

10. A computer storage medium, characterized in that It includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the sound effect switching method as described in any one of claims 1 to 8.

Images