An audio playing method and related device

Abstract

The application discloses an audio playing method and related device. An electronic device includes one or more sound emitting units, which include one or more second partial side sound emitting units and one or more first partial side sound emitting units. When the sound effect mode of the electronic device is a first mode, the electronic device can receive an input of playing a specified audio. In response to the input, the audio data (also referred to as sound source data) of the specified audio of the electronic device is processed based on the first mode to obtain audio data corresponding to the plurality of sound emitting units of the electronic device. The plurality of sound emitting units of the electronic device simultaneously play the corresponding audio data. In this way, the electronic device can use the first partial side sound emitting units and the second partial side sound emitting units to cooperatively play the first audio, improve the surround feeling and immersion feeling of the sound field of the electronic device, and enhance the audio playing effect.

Description

TECHNICAL FIELD

[0001] The present application relates to the terminal field, and particularly to an audio playing method and related device. BACKGROUND

[0002] Currently, the distance between the display screen and the loudspeaker of some electronic devices is far, which causes the displayed picture and the sound source not to correspond when the electronic device plays a video, and the user's viewing effect is poor. SUMMARY

[0003] The present application provides an audio playing method and related device, which realizes that the electronic device cooperatively sounds by the sounding unit of the first part and the sounding unit of the second part, and provides the user with multiple audio playing effects, so that the user can experience different audio playing experiences.

[0004] In a first aspect, the present application provides an audio playing method applied to an electronic device, the electronic device comprising a first part and a second part, the first part and the second part rotating or unfolding around a central axis of the electronic device; the first part comprising one or more first sounding units, and the second part comprising one or more second sounding units; the method comprising:

[0005] The sound effect mode of the electronic device is a first mode, and the electronic device receives a first input of playing a first audio;

[0006] The electronic device controls the one or more first sounding units to play first audio data and controls the one or more second sounding units to play second audio data in response to the first input, the first audio data and the second audio data both comprising at least part of the content of the sound source data of the first audio;

[0007] The electronic device receives a second input;

[0008] The electronic device switches the sound effect mode of the electronic device from the first mode to a second mode in response to the second input;

[0009] The electronic device receives a third input of playing the first audio;

[0010] The electronic device controls the one or more first sounding units to play third audio data and controls the one or more second sounding units to play fourth audio data in response to the third input, the third audio data and the fourth audio data both comprising at least part of the content of the sound source data of the first audio, and the first audio data being different from the third audio data.

[0011] In this way, the electronic device can perform different processing on the same sound source data when in different sound effect modes, obtain different first audio data and third audio data, and play different audio data through the first sound production unit to achieve different playing effects. Moreover, because the sound production unit of the first part of the electronic device and the sound production unit of the second part jointly produce sound, the electronic device can improve the consistency of sound and picture when displaying a video picture through the first part, so that the user perceives that the sound source of the sound and the picture are in the same position, and the user's sense of immersion is improved.

[0012] In a possible implementation, the first audio data includes sound channels that are partially / entirely different from sound channels included in the third audio data. In this way, the data of different sound channels can achieve different playing effects.

[0013] In a possible implementation, the method further includes: when the first mode is any one of the low-frequency enhancement mode, the dialogue enhancement mode, and the surround enhancement mode, at least part of the sound channels included in the first audio data are different from at least part of the sound channels included in the second audio data; and / or,

[0014] When the first mode is the loudness enhancement mode, at least part of the sound channels of the first audio data are the same as at least part of the sound channels of the second audio data.

[0015] In a possible implementation, the electronic device includes one or more sound effect modes, and the one or more sound effect modes include the first mode and the second mode; before the electronic device receives the second input, the method further includes:

[0016] The electronic device displays one or more sound effect mode options, the one or more sound effect mode options correspond one-to-one to the one or more sound effect modes, the one or more sound effect mode options include a first mode option and a second mode option, the first mode option corresponds to the first mode, the second mode option corresponds to the second mode, and the first mode option is marked; wherein the second input is an input to the second mode option.

[0017] In response to the second input, the electronic device sets the sound effect mode of the electronic device to the second mode, specifically including:

[0018] In response to the second input, the electronic device switches the sound effect mode of the electronic device from the first mode to the second mode, and unmarks the first mode option and marks the second mode option.

[0019] In this way, the electronic device can provide different sound effect mode options for the user, so that the user can adjust the sound effect mode of the electronic device, and the electronic device can play audio in a specified sound effect mode.

[0020] In a possible implementation, the first mode option is a low-frequency enhancement mode option, the first mode is a low-frequency enhancement mode, the first audio data includes data of a low-frequency channel, and the second audio data includes data of a left channel and a right channel, data of a left surround channel and a right surround channel, and / or data of a center channel. In this way, in the low-frequency mode, the electronic device can use the first sound production unit to play the data of the low-frequency channel, thereby enhancing the low-frequency shock effect during audio playback.

[0021] In a possible implementation, the first mode option is a dialogue enhancement mode option, the first mode is a dialogue enhancement mode, the first audio data includes data of a center channel, and the second audio data includes data of a left channel and a right channel, data of a left surround channel and a right surround channel, and / or data of a low-frequency channel. In this way, the electronic device highlights the human voice during audio playback and highlights the dialogue of the characters during video playback.

[0022] In a possible implementation, the first mode option is a loudness enhancement mode option, the first mode is a loudness enhancement mode, the first audio data includes data of a left channel and a right channel, and the second audio data includes data of a left channel and a right channel. In this way, the electronic device can improve the clarity of the audio data played by the electronic device.

[0023] In a possible implementation, when the electronic device includes one first sound production unit, the electronic device uses the one first sound production unit to play the data of the left channel and the data of the right channel of the first audio data; or,

[0024] When the electronic device includes two first sound production units, the electronic device uses one first sound production unit to play the data of the left channel and uses the other first sound production unit to play the data of the right channel; or,

[0025] If the electronic device includes three or more first sound production units, the electronic device uses at least one first sound production unit to play the data of the left channel, uses at least one first sound production unit to play the data of the right channel, and uses at least one first sound production unit to play the data of the left channel and the data of the right channel of the second audio data. In this way, the first sound production units can be reasonably used to play the channel data of the first audio data based on the number of the first sound production units, and the sound production unit resources provided by the electronic device can be fully utilized.

[0026] In a possible implementation, the first mode option is a surround enhancement mode, the first mode is a surround enhancement mode, the first audio data includes data of a left surround channel and a right surround channel, and the second audio data includes data of a left channel and a right channel, data of a center channel, and / or data of a low-frequency channel. In this way, the surround effect of audio playback can be increased.

[0027] In a possible implementation, when the electronic device processes the sound source data, the loudness of the fine audio data of the sound source data is enhanced. In this way, the fine sound can be highlighted, and the sense of detail can be enhanced. The user can hear the fine sound when playing the game, and observe the movement of the game character, thereby improving the game experience. The user can hear the obvious background sound, such as wind, insects, and the like, when watching the movie, and the picture sense is improved.

[0028] In a possible implementation, when the electronic device displays the one or more sound effect mode options, the method further includes:

[0029] The electronic device displays a sliding bar;

[0030] If the first mode option is the loudness enhancement mode option, the low-frequency enhancement mode option, or the dialogue enhancement mode option, when the value of the sliding bar is the first value, the volume of the electronic device playing the first audio data is the third volume, and when the value of the sliding bar is the second value, the volume of the electronic device playing the first audio data is the fourth volume, the first value is less than the second value, and the third volume is lower than the fourth volume;

[0031] If the first mode option is the surround mode option, when the value of the sliding bar is the third value, the distance between the simulated sound source and the user when the electronic device plays the first audio data is the third distance, and when the value of the sliding bar is the fourth value, the distance between the simulated sound source and the user when the electronic device plays the first audio data is the fourth distance, the third value is less than the fourth value, and the third distance is less than the fourth distance. In this way, the effect of the sound effect mode can be set through the sliding bar, and the user can adjust the value of the sliding bar to select a suitable playing effect.

[0032] In a possible implementation, the method further includes:

[0033] The electronic device receives a fourth input of playing the first video;

[0034] The electronic device, in response to the fourth input, identifies one or more objects in a video frame of the first video, and identifies audio data of the one or more objects in an audio file of the first video, the one or more objects including a first object;

[0035] The electronic device plays the audio data of the first object using the sound emitting unit closest to the first object in the one or more first sound emitting units and / or the one or more second sound emitting units. In this way, the electronic device can play the sound of the first object using the sound emitting unit closest to the first object, so that the user can perceive the position of the first object in the frame by hearing, and the immersion of video playing is enhanced.

[0036] In a possible implementation, the first sound emitting unit located at the first position is used to play sky sound; and / or,

[0037] The first sound unit at the second position is configured to play ground sound, and the distance between the first position and the central axis is greater than the distance between the second position and the central axis; and / or,

[0038] The first sound unit at the third position is configured to play left channel data, and the first sound unit at the fourth position is configured to play right channel data, the third position is located on the left side of the first part, and the fourth position is located on the right side of the first part; and / or,

[0039] The first sound unit at the fifth position is configured to play left surround channel data, and the first sound unit at the sixth position is configured to play right surround channel data, the third position is located on the left side of the first part, and the fourth position is located on the right side of the first part.

[0040] In this way, the electronic device can play data of sound channels in different directions through sound units at different positions, thereby embodying the directionality of audio.

[0041] In a possible implementation, the electronic device is a notebook computer, the first part includes a display screen of the electronic device, and the second part includes a keyboard and / or a touchpad of the electronic device. In this way, the notebook computer can make the sound units in the first part and the second part sound simultaneously, thereby enhancing the audio playing effect.

[0042] In a possible implementation, the first part of the electronic device includes a first shell and a second shell, the first shell includes a display screen of the electronic device, the first mode is a surround enhancement mode, and the first sound unit at the first shell is configured to drive the first shell to play first audio data; or,

[0043] The first mode is a low-frequency enhancement mode, and the first sound unit at the second shell is configured to drive the second shell to play the first audio data.

[0044] In this way, the electronic device can drive the first shell or the second shell of the electronic device to sound, thereby making the sound range wider and the sounding effect better.

[0045] In a possible implementation, the electronic device is a foldable screen device, the first part includes a first screen, the second part includes a second screen, the electronic device includes a folding manner of left-right folding, and the electronic device includes a folded state and an unfolded state;

[0046] If the electronic device is in the folded state, the sound emitting units located on the first side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are used to play the data of the left sound channel, and the sound emitting units located on the second side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are used to play the data of the right sound channel; or, the sound emitting units located on the first side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are used to play the sky sound, and the sound emitting units located on the second side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are used to play the ground sound, the first side being different from the second side.

[0047] If the electronic device is in the unfolded state, the one or more first sound emitting units are used to play the data of the left sound channel, and the one or more second sound emitting units are used to play the data of the right sound channel, or, the one or more first sound emitting units are used to play the data of the left surround sound channel, and the one or more second sound emitting units are used to play the data of the right surround sound channel. In this way, the electronic device can use different sound emitting units in different folding modes to play data of different sound channels, thereby achieving a richer playing effect in combination with the folding mode of the electronic device.

[0048] In a possible implementation, the electronic device is a foldable screen device, the first part includes a first screen, the second part includes a second screen, the electronic device has a folding mode of up-down folding, and the electronic device includes a folded state and an unfolded state.

[0049] If the electronic device is in the folded state, the one or more first sound emitting units and the one or more second sound emitting units play the sound source data.

[0050] If the electronic device is in the unfolded state, the one or more first sound emitting units are used to play the data of the left sound channel, and the one or more second sound emitting units are used to play the data of the right sound channel; or, the one or more first sound emitting units are used to play the sky sound, and the one or more second sound emitting units are used to play the ground sound. In this way, the electronic device can use different sound emitting units in different folding modes to play data of different sound channels, thereby achieving a richer playing effect in combination with the folding mode of the electronic device.

[0051] In a possible implementation, the sky sound includes one or more of thunder, the sound of a flying object, and wind, and the ground sound includes one or more of footsteps, insect chirping, and rain. In this way, the electronic device can enhance the sound of a sky object and the sound of a ground object, thereby embodying the up-down orientation. When raindrops fall on a roof or a tree, the sound of the raindrops belongs to the sky sound, and when the raindrops fall on the ground or a lake, the sound of the raindrops belongs to the ground sound. Here, the rain sound refers to the sound of the raindrops falling on the ground.

[0052] In a possible implementation, the sound source data includes data of sound channels required by the first audio data in the first mode, and a number of sound channels in the sound source data other than the sound channels of the first audio data is a first number; the method further includes:

[0053] If the first number is less than the number of the second sound production units, the electronic device upmixes the sound source data, or duplicates data of sound channels in the sound source data other than the sound channels of the first audio data to obtain fifth audio data; the fifth audio data includes data of sound channels required by the first audio data, and a number of sound channels in the fifth audio data other than the sound channels of the first audio data is the same as the number of the second sound production units, and the second audio data includes data of sound channels other than the sound channels of the first audio data.

[0054] If the first number is greater than the number of the second sound production units, the electronic device downmixes the sound source data, or superimposes data of part of the sound channels in the sound source data to obtain sixth audio data; the sixth audio data includes data of sound channels required by the first audio data, and a number of sound channels in the sixth audio data other than the sound channels of the first audio data is the same as the number of the second sound production units, and the second audio data includes data of sound channels other than the sound channels of the first audio data.

[0055] In this way, the electronic device processes the sound source data based on the number of the second sound production units, fully utilizes the sound production unit resources of the electronic device, and implements playing of the audio data.

[0056] In a second aspect, an embodiment of the present application provides an electronic device, including a first part and a second part, the first part of the electronic device includes a display screen of the electronic device, and the second part of the electronic device includes a keyboard and / or a touchpad of the electronic device; the first part includes one or more first sound production units, the second part includes one or more second sound production units, and the electronic device includes one or more processors; wherein

[0057] The one or more processors are configured to, in response to an input of playing the first audio, obtain the first audio data and the second audio data based on sound source data of the first audio, and the first audio data and the second audio data each include at least part of content of the sound source data.

[0058] The one or more first sound production units are configured to play the first audio data.

[0059] The one or more second sound production units are configured to play the second audio data.

[0060] In this way, the electronic device can play the first audio through the first sound production units of the first part and the second sound production units of the second part, simultaneously produce sound through the sound production units in multiple positions, achieve a better audio playing effect, and improve the immersion of audio playing.

[0061] In a possible implementation, the electronic device is a notebook computer. In this way, the notebook computer can play the first audio through the sound emitting unit located near the display screen and the sound emitting unit located near the keyboard, so that the sound beam of the notebook computer is directed towards the direction of the user's ears, the sound is clearer, and the position of the simulated sound source when the notebook computer plays the audio data is near the display screen of the notebook computer, the sound and the picture are highly consistent, so that the notebook computer plays the video, the sound is synchronized with the picture.

[0062] In a possible implementation, the electronic device is configured to implement the audio playing method in any of the possible implementations of the first aspect.

[0063] In a third aspect, an embodiment of the present application provides an electronic device, including: one or more processors, one or more first sound emitting units, one or more second sound emitting units, and one or more memories; wherein the one or more memories, the one or more first sound emitting units, and the one or more second sound emitting units are coupled with the one or more processors respectively, the one or more memories are configured to store computer program codes, the computer program codes include computer instructions, when the one or more processors execute the computer instructions, the electronic device executes the audio playing method in any of the possible implementations of the first aspect.

[0064] In a fourth aspect, an embodiment of the present application provides a computer storage medium, including computer instructions, when the computer instructions run on a first electronic device, the first electronic device executes the audio playing method in any of the possible implementations of the first aspect.

[0065] In a fifth aspect, an embodiment of the present application provides a chip system, the chip system is applied to a first electronic device, the chip system includes one or more processors, the processor is configured to call computer instructions to make the first electronic device execute the audio playing method in any of the possible implementations of the first aspect.

[0066] In a sixth aspect, an embodiment of the present application provides a computer program product including instructions, when the computer program runs on a first electronic device, the first electronic device executes the audio playing method in any of the possible implementations of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0067] Figure 1 A structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0068] Figure 2A A sound emitting unit position schematic diagram of an electronic device provided by an embodiment of the present application;

[0069] Figure 2BA sound field schematic diagram of an electronic device provided by an embodiment of the present application;

[0070] Figure 2C Another sound field schematic diagram of an electronic device provided by an embodiment of the present application;

[0071] Figure 3A A sound unit position schematic diagram of another electronic device provided by an embodiment of the present application;

[0072] Figure 3B A first part side sound unit position schematic diagram of an electronic device provided by an embodiment of the present application;

[0073] Figure 3C A sound field schematic diagram of an electronic device provided by an embodiment of the present application;

[0074] Figure 3D Another sound field schematic diagram of an electronic device provided by an embodiment of the present application;

[0075] Figure 4 A flow schematic diagram of an audio playing method provided by an embodiment of the present application;

[0076] Figure 5 A flow schematic diagram of an electronic device processing sound source data provided by an embodiment of the present application;

[0077] Figures 6A-6E A group of interface schematic diagrams provided by an embodiment of the present application;

[0078] Figure 7 A first part side sound unit schematic diagram of an electronic device provided by an embodiment of the present application;

[0079] Figures 8A-8D A group of electronic device form schematic diagrams provided by an embodiment of the present application;

[0080] Figure 9 Another first part side sound unit schematic diagram of an electronic device provided by an embodiment of the present application;

[0081] Figures 10A-10D Another group of electronic device form schematic diagrams provided by an embodiment of the present application;

[0082] Figures 11A-11C Another group of electronic device form schematic diagrams provided by an embodiment of the present application;

[0083] Figures 12A-12C Another group of electronic device form schematic diagrams provided by an embodiment of the present application;

[0084] Figure 13 Another first part side sound unit schematic diagram of an electronic device provided by an embodiment of the present application;

[0085] Figure 14 A hardware structure schematic diagram of an electronic device is provided for the embodiments of the present application. DETAILED DESCRIPTION

[0086] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; the "and / or" in the text only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone.

[0087] Hereinafter, the terms "first" and "second" are only used for description purposes, and cannot be understood as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" can explicitly or implicitly include one or more features, and in the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" is two or more.

[0088] In the description of the embodiments of the present application, it should be noted that, unless otherwise explicitly specified and limited, the terms "mounting", "connecting" should be understood in a broad sense, for example, "connecting" can be detachably connected, or can be non-detachably connected; can be directly connected, or indirectly connected through an intermediate medium. The orientation terms mentioned in the embodiments of the present application, such as "top", "bottom", "upper", "lower", "left", "right", "inner", "outer", etc., are only the direction of the drawings, therefore, the orientation terms used are for better, clearer illustration and understanding of the embodiments of the present application, and are not intended to indicate or imply that the indicated device or element must have a particular orientation, be constructed and operated in a particular orientation, therefore, it cannot be understood as a limitation on the embodiments of the present application. "Multiple" means at least two.

[0089] The term "user interface (UI)" in the following embodiments of the present application is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes conversion between internal forms of information and forms acceptable by the user. The user interface is source code written in a specific computer language such as Java, extensible markup language (XML), and the like. The interface source code is parsed and rendered on an electronic device, and finally presented as content recognizable by the user. A commonly used form of the user interface is a graphic user interface (GUI), which refers to a user interface displayed in a graphical manner and related to computer operation. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, and the like displayed in the display screen of the electronic device.

[0090] Next, an electronic device provided by an embodiment of the present application is introduced.

[0091] In a possible implementation, the electronic device is a folding device including a first part and a second part. There is a central axis between the first part and the second part, and the first part and the second part can rotate (or unfold) around the central axis to change the degree of the angle between the first part and the second part. When the degree of the angle between the first part and the second part of the electronic device is different, the electronic device can be used in different forms.

[0092] In some embodiments, the electronic device is a folding screen device, the first part of the electronic device includes a first screen of the electronic device, and the second part includes a second screen of the electronic device. The first screen and the second screen can be different parts of the same screen. The folding mode of the electronic device can be left-right folding or up-down folding. When the folding mode of the electronic device is left-right folding, the first part can be located on the left side of the second part. When the folding mode of the electronic device is up-down folding, the first part can be located on the upper side of the second part.

[0093] The folding mode of the electronic device can be divided into two categories: one is an outward folding folding screen (referred to as an outward folding folding screen), and the other is an inward folding folding screen (referred to as an inward folding folding screen). When the outward folding folding screen is folded, the first screen and the second screen face away from each other. When the outward folding folding screen is unfolded, the first screen and the second screen form a third screen. In this way, when the outward folding folding screen is folded, the user can use the first screen or the second screen alone. When the outward folding folding screen is unfolded, the first screen and the second screen form a third screen with a larger screen area, which can provide a larger screen for the user and improve the user experience.

[0094] When the inner folding folding screen is folded, the first screen and the second screen are opposite. When the inner folding folding screen is unfolded, the first screen and the second screen form a third screen. In this way, when the inner folding folding screen is folded, it is convenient for the user to store and carry; when the inner folding folding screen is unfolded, it is convenient for the user to use.

[0095] In other embodiments, the electronic device is a notebook computer or the like, such as Figure 1 As shown in the front view, the first part of the electronic device is Figure 1 Part 11, the second part of the electronic device is Figure 1 Part 12, and the center axis of the electronic device is Figure 1 The center axis 13. Wherein, the part 11 and the part 12 of the electronic device can rotate and unfold around the center axis 13 to change the angle of the part 11 and the part 12 around the center axis 13. Wherein, the part 11 includes A shell and B shell. Part 12 includes C shell and D shell.

[0096] Specifically, the part 11 can be the screen part of the electronic device, and the part 12 can be the keyboard part of the electronic device. Wherein, the screen part of the electronic device can include a display screen for displaying a user interface. The keyboard part of the electronic device can include but not limited to a keyboard and / or a touchpad. The user can manipulate the electronic device through the touchpad and / or the keyboard, and the electronic device can make corresponding response according to the instructions input by the user through the touchpad and / or the keyboard.

[0097] The part 11 of the electronic device includes A shell and B shell. Wherein, the A shell is part of the outer shell of the electronic device, and the B shell is part of the inner shell of the electronic device, and the display screen of the electronic device is located at the center of the B shell. The keyboard part of the electronic device includes C shell and D shell, wherein the D shell is part of the outer shell of the electronic device, and the C shell includes the keyboard and / or the touchpad of the electronic device. As shown in the front view, Figure 1 As shown in the back view, the A shell of the electronic device is adjacent to the D shell. Figure 1

[0098] ​The electronic device can receive an input of a user flipping a screen portion, and change an angle between the B shell and the C shell. When the angle between the B shell and the C shell is 0 degree, the screen portion coincides with the keyboard portion, and the B shell and the C shell are shielded, facilitating the user to store and carry. When the angle between the B shell and the C shell is within a specified angle range (for example, 45 degrees to 145 degrees), the user can view the display content of the electronic device, such as a video, on the display screen of the screen portion. Instructions can also be input to the electronic device through the keyboard portion. In some examples, the angle between the B shell and the C shell of the electronic device can be 360 degrees, the A shell and the D shell of the electronic device overlap together, and the user can manipulate the screen portion of the electronic device alone. For example, the screen portion can include a touch screen, which can be used to receive the input of the user and trigger the screen portion to perform an operation corresponding to the input.

[0099] In some examples, the electronic device is not limited to being connected to the keyboard portion through the Figure 1 The screen portion and the keyboard portion can be two separate components, the screen portion includes a connecting structure 15, and the keyboard portion includes a connecting structure 16. The connecting structure 15 of the screen portion can be coupled with the connecting structure 16 of the keyboard portion and connected together. It should be noted that the coupling can include, but is not limited to, electrical connection, mechanical coupling, etc. The terms coupling and connecting in the embodiments of the present application can be considered equivalent in terms of electrical connection. Electrical connection includes connection between wires or indirect connection between devices through other devices to realize the intercommunication of electrical signals, and the embodiments are not limited to the specific electrical connection method.

[0100] In this way, when the screen portion and the keyboard portion are separated, the user can manipulate the screen portion alone. For example, the screen portion can include a touch screen, which can be used to receive the input of the user and trigger the screen portion to perform an operation corresponding to the input. When the screen portion and the keyboard portion are connected, the keyboard portion can receive the input of the user and send the input to the screen portion through the connecting structure 15 and the connecting structure 16, and the screen portion can perform an operation corresponding to the input.

[0101] Next, the electronic device shown in Figure 1 will be taken as an example to explain the subsequent embodiments.

[0102] In some embodiments, the second portion of the electronic device is provided with one or more speakers, and the electronic device can play audio through the one or more speakers. For example, the one or more speakers of the electronic device can push air to emit sound waves through vibration, and the sound waves can be output from the sound outlet (for example, the sound outlet located on the side of the second portion of the electronic device, the positive sound outlet located on the edge adjacent to the center axis of the second portion) or the gap of the keyboard of the second portion to the user's ears, so that the user can listen to the audio played by the electronic device.

[0103] All or part of the one or more speakers can be disposed on the inner surface of the C shell, the inner surface of the D shell, the gap between the C shell and the D shell, the joint of the C shell and the D shell (i.e., the side edge of the second part of the electronic device), and the like. The position of the one or more speakers in the second part is not limited in the embodiments of the present application. The speaker disposed in the second part of the electronic device can be referred to as a second-part-side sound production unit. The second-part-side sound production unit can be a moving coil speaker, a moving iron speaker, a piezoelectric speaker, a micro-electro-mechanical system (MEMS) speaker, a piezoelectric ceramic speaker, a magnetostrictive speaker, and the like.

[0104] As shown in Figure 2A , the surface of the C shell of the second part of the electronic device is taken as the XOY plane, and the direction perpendicular to the XOY plane and pointing from the D shell to the C shell is the Z axis. The origin O point can be located at the left edge of the central axis, the Y axis can coincide with the central axis and point to the right, the X axis is perpendicular to the Y axis and points from the O point to the edge of the C shell away from the central axis. Here, the second-part-side sound production unit of the electronic device is disposed on the side of the second part, wherein the second-part-side sound production unit of the electronic device includes a sound production unit 21 and a sound production unit 22, the sound production unit 21 is located on the left side of the second part, and the sound production unit 22 is located on the right side of the second part. Figure 2A In , the sound production unit 21 and the sound production unit 22 are represented in a horn shape, wherein the horn shape is only a schematic of the sound production unit, and the horn shape does not limit the shape of the sound production unit or the specific position of the sound production unit. Similarly, the horn in the following figures does not limit the shape of the sound production unit or the specific position of the sound production unit.

[0105] Specifically, Figure 2A , the sound field direction of the electronic device when playing audio is as shown in Figure 2B and Figure 2C . Among them, Figure 2B shows the sound pressure distribution of the YOZ plane of the electronic device, Figure 2C shows the sound pressure distribution of the XOZ plane of the electronic device. Figure 2B and Figure 2C , the deeper the color of the position shown, the stronger the sound pressure at the position, and the lighter the color of the position shown, the weaker the sound pressure at the position. Since the positions of the second-part-side sound production units are in the XOY plane, the closer to the XOY plane, the stronger the sound pressure. Moreover, the energy of the sound wave is concentrated near the XOY plane, and the beam direction of the sound wave with strong energy is the same as the direction of the Z axis.

[0106] As shown in Figure 2B and Figure 2CAs can be seen from the sound pressure image, when the electronic device plays audio through the second-part side sound emitting unit, the sound waves emitted by the second-part side sound emitting unit form an audio sound image near the keyboard part, and the overall audio sound image is highly limited and cannot fully restore the spatial stereo sound field. This will cause the sound heard by the user to be different from the screen picture, resulting in a deviation in the position of the sound and picture, and affecting the audio listening experience.

[0107] In addition, most of the energy of the second-part side sound emitting unit is concentrated in the keyboard part, and when the electronic device plays audio at a large volume, the vibration amplitude of the second-part side sound emitting unit is large, which easily causes the keyboard and other structural parts to resonate, produces noise, and affects the audio playing effect.

[0108] When the electronic device emits sound through the second-part side sound emitting unit, if the user uses the electronic device to play audio on a non-table surface, the audio external playing performance is poorer than that when the user uses the electronic device to play audio on a table surface, because the non-table surface has weak sound reflecting ability. Therefore, the electronic device has high requirements for the environment when using the second-part side sound emitting unit to emit sound, and the electronic device needs to be placed on a table surface that reflects sound, so that the user can hear the reflected audio energy, the sound is clearer, and the playing effect is better.

[0109] In the embodiments of the present application, the second part of the electronic device is provided with one or more loudspeakers, which are referred to as second-part side sound emitting units. The first part of the electronic device is also provided with one or more loudspeakers, which are referred to as first-part side sound emitting units. The electronic device can play audio through the second-part side sound emitting units and the first-part side sound emitting units.

[0110] For example, the description of the second-part side sound emitting units of the electronic device can be referred to the above description of the first-part side sound emitting units. Figure 2A The embodiments are not described here again. Among them, all or part of the first-part side sound emitting units in one or more of the electronic device can be arranged on the inner surface of the A shell or the B shell, or the first-part side sound emitting units can be arranged at the connection between the A shell and the B shell (the side edge of the screen part). The first-part side sound emitting units can be small loudspeakers, such as piezoelectric ceramic loudspeakers, magnetostrictive loudspeakers, etc.

[0111] For example, if the first part side sound unit is a piezoelectric ceramic speaker, the first part side sound unit can be arranged on the back of the display screen of the electronic device A shell, and the piezoelectric ceramic speaker can transmit its deformation to the display screen through torque action to make the display screen vibrate and sound. Wherein, the piezoelectric ceramic speaker can include multiple layers of piezoelectric ceramic sheets. When a piece of piezoelectric ceramic sheet expands and shrinks, it will drive the display screen to bend and deform, so that the whole display screen forms a bending vibration, so that the display screen can push the air and produce sound.

[0112] It should be noted that the first part side sound unit is a piezoelectric ceramic speaker, which is only an example, and the first part side sound unit can also be a moving coil speaker, a moving iron speaker, a piezoelectric speaker, and a MEMS speaker, etc. The embodiments of the present application are not limited to this.

[0113] For example, as shown in Figure 3A , the C shell surface of the second part of the electronic device is taken as the XOY plane, and the direction perpendicular to the XOY interface and pointing from the D shell to the C shell is the Z axis. Wherein, the origin O point is located on the left side of the central axis, the Y axis is located on the central axis and the direction is to the right, the X axis is perpendicular to the Y axis, and the direction is from the O point to the edge of the C shell away from the central axis.

[0114] For example, the electronic device includes 3 first part side sound units and 2 second part side sound units. The 2 second part side sound units of the electronic device can be arranged on the opposite sides of the keyboard part, for example, the second part side sound unit 31 is located on the left side of the second part, and the second part side sound unit 32 is located on the right side of the keyboard part. The first part side sound unit of the electronic device can be arranged in the middle and on both sides of the B shell of the first part, as shown in Figure 3B , the 3 first part side sound units are attached inside the B shell, and the 3 first part side sound units include the first part side sound unit 33, the first part side sound unit 34 and the first part side sound unit 35. Wherein, the first part side sound unit 35 is located on the vertical central axis of the first part. The first part side sound unit 33 is located on the left side of the vertical central axis of the first part, and the first part side sound unit 34 is located on the right side of the vertical central axis of the first part. The distance between the first part side sound unit 33 and the first part side sound unit 35 is the same as the distance between the first part side sound unit 34 and the first part side sound unit 35.

[0115] It should be noted that the 3 first part side sound units and 2 second part side sound units are only examples, and the number and composition of the sound units of the electronic device can not be limited to Figure 3AAs shown in the structure, for example, the electronic device can include 2 first-part side sound units and 2 second-part side sound units. The 2 first-part side sound units can be respectively located in the left and right regions of the first part, and symmetrical relative to the median plane of the central axis, the distance between the 2 first-part side sound units and the central axis is equal, and the distance between the 2 first-part side sound units and the center point of the first part is equal. Similarly, the 2 second-part side sound units can be respectively located in the left and right regions of the second part, and symmetrical relative to the median plane of the central axis, the distance between the 2 second-part side sound units and the central axis is equal, and the distance between the 2 second-part side sound units and the center point of the second part is equal. The electronic device can also include more or less number of first-part side sound units, more or less number of second-part side sound units, which are not limited in the embodiments of the present application.

[0116] It can be understood that when the first-part side sound unit (second-part side sound unit) of the electronic device is located at the first side (for example, the left side, the right side) of the first part (the second part), in order for the user to hear balanced sound, there must be a sound unit located at a position symmetrical relative to the median plane of the central axis of the sound unit.

[0117] It should also be noted that, Figure 3A The position of the first-part side sound unit 35 shown is only an example, not limited to Figure 3A The position shown, the first-part side sound unit 35 can be located at other positions of the first part. For example, the first-part side sound unit 35 can be located near the A shell of the first part, for example, the first-part side sound unit 35 can be attached to the inside of the A shell and vibrate the A shell to sound. For another example, the first-part side sound unit 35 can be located inside the first part and the direction of the loudspeaker is towards the A shell, and the corresponding position of the A shell is provided with a sound hole. So that the sound wave direction of the sound emitted by the first-part side sound unit 35 points from the B shell to the A shell. In this way, the first-part side sound unit 35 can be used to play background sound in audio, so that the sound source playing the background sound is farther away from the user, and the user has a better sense of immersion. The first-part side sound unit 35 can also be used to play the sound emitted by the object (for example, a person, an animal, an object, etc.) farther away from the user in the video picture, to represent the positional relationship of each object by sound, and to bring the user a better viewing experience.

[0118] Further, the first portion side sound emitting unit 35 can be located at the top of the side edge of the first portion, so that the sound wave direction of the sound emitted by the first portion side sound emitting unit 35 is upward. The first portion side sound emitting unit 35 can be used to play the sky sound in the audio. The sky sound is the sound emitted by the specified sky object in the audio. For example, the specified sky object can be a flying object (e.g., an airplane, a bird, etc.), a lightning, or the like. In this way, the user can perceive the height information of the specified sky object in the audio through hearing, and the immersion of the user in listening to the audio is increased. The first portion side sound emitting unit 35 can also be used to play the sound emitted by the object above the screen in the video, so as to represent the positional relationship of the objects through sound, and provide a better viewing experience for the user.

[0119] In some examples, when the first portion side sound emitting unit directly plays the audio source data, if the signal power of the audio to be played is low, the amplitude of the first portion side sound emitting unit is small, and the sound quality is poor. The first portion side sound emitting unit can be connected to the audio power amplifier chip through a sound emitting unit connection line. For example, the sound emitting unit connection line can be the sound emitting unit connection line 36, the sound emitting unit connection line 37, and the sound emitting unit connection line 38 shown in Figure 3B . The sound emitting unit connection line 36 can be used to connect the first portion side sound emitting unit 33 and the audio power amplifier chip, the sound emitting unit connection line 37 can be used to connect the first portion side sound emitting unit 34 and the audio power amplifier chip, and the sound emitting unit connection line 38 can be used to connect the first portion side sound emitting unit 35 and the audio power amplifier chip. It should be noted that Figure 3B only a part of the sound emitting unit connection line is shown, and the sound emitting unit connection line should not be limited. The audio power amplifier chip can amplify the analog audio signal, and then send the amplified analog audio signal to the first portion side sound emitting unit, so that the first portion side sound emitting unit can vibrate to emit sound based on the amplified analog audio signal. In this way, the power of the amplified analog audio signal is high, and the first portion side sound emitting unit can play the audio with higher sound quality by using the analog audio signal with higher power.

[0120] Similarly, the second portion side sound emitting unit can also be connected to the audio power amplifier chip through a sound emitting unit connection line to receive the amplified audio signal sent by the audio power amplifier chip.

[0121] Specifically, Figure 3A the sound field direction of the electronic device when playing the audio is shown in Figure 3C and Figure 3D . Among them, Figure 3C the sound pressure distribution of the YOZ plane of the electronic device is shown, Figure 3D the sound pressure distribution of the XOZ plane of the electronic device is shown. Figure 3C and Figure 3DThe darker the color shown, the stronger the sound pressure; the lighter the color shown, the weaker the sound pressure. Since the second part of the side-emitting unit and the first part of the side-emitting unit emit sound together, from... Figure 3D It can be seen that the beam direction of a high-energy sound wave is along the perpendicular bisector of the X and Z axes. Since the sound wave beam is directed towards the perpendicular bisector of the X and Z axes, which is typically the direction of the user's ears when using an electronic device, the sound can be better propagated to the vicinity of the user's ears, thus improving the user's audio listening experience.

[0122] Depend on Figure 3C and Figure 3D The sound pressure level images shown demonstrate that when the electronic device plays audio through both the second and first side-emitting units, the height of the audio image along the Z-axis is increased compared to when audio is played solely through the second side-emitting unit. Furthermore, the transformation from a sound field in the XOY plane to a vertical 3D sound field in the O-XYZ three-dimensional space creates a wider and higher stereo audio playback effect, making the audio and video appear more synchronized when the user is viewing the screen, thus enhancing the user's surround sound audio experience.

[0123] In some examples, such as Figure 2B As shown, the electronic device including only the second part of the side-emitting unit has a maximum sound pressure level of 101.395 dB in the YOZ plane. Figure 3C As shown, the electronic device, including the first and second side-emitting units, has a maximum sound pressure level of 103.513 dB in the YOZ plane. Figure 2C As shown, the electronic device, including only the second-part side-emitting unit, has a maximum sound pressure level of 115.276 dB in the XOZ plane. Figure 3D As shown, the electronic device, including the first and second side-emitting units, has a maximum sound pressure level of 118.504 dB in the XOZ plane. Due to... Figure 2B , Figure 2C , Figure 3C and Figure 3D It can be seen that the electronic device including both the first and second side-emitting units has a higher maximum sound pressure level than the electronic device including only the second side-emitting unit, and the sound beam is directed towards the user's ears. This provides the user with a better auditory experience.

[0124] And, in the same audio effect state, compared with the case that the second part side sound unit plays audio alone, the first part side sound unit undertakes part of the function of playing audio, so that the vibration amplitude of the second part side sound unit is reduced, and resonance of the keyboard and other structural members is not easily triggered, reducing the noise generated when the second part side sound unit plays audio. At the same time, the first part side sound unit does not need the desktop to reflect the sound wave, and the placement position of the electronic device reduces the influence on the audio playing effect.

[0125] It should be noted that when the first part side sound unit is attached only inside the B shell, the sound propagation effect of the forward direction facing the user can be improved, and the immersion of the user watching the video can be improved. When the first part side sound unit is attached only inside the A shell, the first part side sound unit can drive the A shell to sound. The first part side sound unit can be used to play low-frequency audio signals. In this way, since the directivity of the low-frequency audio signal is not strong, the vibration of the low-frequency audio signal can be improved, the atmosphere of playing the video can be enhanced, the timbre of the audio can be optimized, and the use effect of the screen will not be affected by the vibration of the B shell. At the same time, the low-frequency energy of the replaceable part keyboard side loudspeaker can be replaced, and the influence of the noise experience caused by the vibration of the keyboard side can be reduced.

[0126] Based on an electronic device including one or more sound units, wherein the one or more sound units include one or more second part side sound units and one or more first part side sound units. The embodiment of the present application provides an audio playing method. When the sound effect mode of the electronic device is the first mode, the electronic device can receive an input of playing a specified audio, and in response to the input, based on the first mode, process the audio data (also known as sound source data) of the specified audio of the electronic device to obtain the audio data corresponding to the plurality of sound units of the electronic device. The plurality of sound units of the electronic device simultaneously play the corresponding audio data. In this way, the first part side sound unit and the second part side sound unit of the electronic device can be used to cooperatively play the first audio, and based on the two-part joint sound emission mode, the surround and immersion of the sound field of the electronic device can be improved, and the audio playing effect can be enhanced.

[0127] Next, an audio playing method provided by an embodiment of the present application is introduced.

[0128] For example, as shown in Figure 4 The audio playing method includes the following steps:

[0129] S401. When the sound effect mode of the electronic device is the first mode, the electronic device receives an input of playing a specified audio.

[0130] The electronic device supports one or more sound effect modes, and the one or more sound effect modes include a first mode. The sound effect mode of the electronic device is the first mode. The first mode can be a sound effect mode that is set by default for the electronic device, or a sound effect mode that is selected by a user.

[0131] First, the following takes a plurality of channels in a 5.1 channel as an example to exemplarily introduce a plurality of sound effect modes provided by the embodiments of the present application, and channel data included in audio data played by each sound unit in the plurality of sound effect modes. In the embodiments of the present application, a channel refers to an audio signal collected independently of each other at different spatial positions when sound is recorded, and the number of channels can be understood as the number of sound sources when sound is recorded. The 5.1 channel includes a left channel, a right channel, a left surround channel, a right surround channel, a center channel, and a low-frequency channel. The data of the left channel includes sound data in the sound source data simulating the hearing range of the left ear of the user, and the data of the right channel includes sound data in the sound source data simulating the hearing range of the right ear of the user. Since the hearing range of the left ear and the hearing range of the right ear overlap, the data of the left channel and the data of the right channel have a part in common, and the part of the audio data in the data of the left channel and the data of the right channel that is common is referred to as the data of the center channel. The data of the center channel includes sound data in the sound source data simulating the range of the left ear of the user and the right ear of the user that overlaps, and in some embodiments, the center channel includes human voice dialogue. The data of the left surround channel can be used to represent the left ear lateral orientation, and the data of the left surround channel can include audio data in the data of the left channel that is different from the data of the center channel. The data of the right surround channel can be used to represent the right ear lateral orientation, and the data of the right surround channel can include audio data in the data of the right channel that is different from the data of the center channel. The data of the low-frequency channel includes audio data in the sound source data with a frequency lower than a specified frequency value (for example, 150 Hz). The frequency range of the left channel, the right channel, the left surround channel, the right surround channel, and the center channel is 20 Hz-200 KHz. In some examples, the electronic device can filter out audio data in the sound source data with a frequency greater than the specified frequency value through a low-pass filter to obtain the data of the low-frequency channel.

[0132] In a possible implementation, the sound effect mode supported by the electronic device can include, but is not limited to, a surround enhancement mode, a bass enhancement mode, a dialogue enhancement mode, and / or a loudness enhancement mode. In the surround enhancement mode, the electronic device plays audio data including left surround channels and right surround channels through the first part of the side sound emitting units, to enhance the surround sense of the audio played by the electronic device. In the bass enhancement mode, the electronic device plays audio data including bass channels through the first part of the side sound emitting units, to enhance the rhythm sense of the audio played by the electronic device. In the dialogue enhancement mode, the electronic device plays audio data including center channels through the first part of the side sound emitting units, to enhance the human voice of the audio played by the electronic device. In the loudness enhancement mode, the electronic device plays audio data including left channels and right channels through the first part of the side sound emitting units, to enhance the loudness of the audio played by the electronic device.

[0133] In the bass enhancement mode, the dialogue enhancement mode, or the surround enhancement mode, the audio data (also referred to as first audio data) played by the first part of the side sound emitting units of the electronic device includes different channels from the audio data (also referred to as second audio data) played by the second part of the side sound emitting units of the electronic device. It can be understood that, since the channels included in the second audio data are different from the channels included in the first audio data, one or more of the amplitude, the waveform, or the frequency of the second audio data and the first audio data are different.

[0134] In the loudness enhancement mode, the channels of the second audio data are the same as the channels of the first audio data. Optionally, in the loudness enhancement mode, the amplitude of the second audio data is different from the amplitude of the first audio data.

[0135] In some examples, in each sound effect mode, the channels included in the second audio data played by the electronic device, and the channels included in the first audio data played by the electronic device are as shown in Table 1:

[0136] Table 1

[0137]

[0138] In the surround enhancement mode, the second audio data obtained based on the sound source data includes data of left channels, right channels, center channels, and / or bass channels, as shown in Table 1. The first audio data obtained based on the sound source data includes data of left surround channels and right surround channels. In this way, in the surround enhancement mode, the data of the surround channels can be played through the first part of the side sound emitting units, so that the sound field of the electronic device has better surround sense.

[0139] In the dialogue enhancement mode, the second audio data obtained based on the sound source data includes a left channel, a right channel, a left surround channel, a right surround channel and / or a low frequency channel. The first audio data obtained based on the sound source data only includes a center channel. In this way, the intelligibility of the dialogue can be increased by the first partial side sound unit.

[0140] In the loudness enhancement mode, the second audio data obtained based on the sound source data includes a left channel and a right channel. The first audio data obtained based on the sound source data includes a left channel and a right channel. In this way, the loudness of the audio playback can be increased by the first partial side sound unit.

[0141] In the low frequency enhancement mode, the second audio data obtained based on the sound source data includes a left channel, a right channel, a left surround channel, a right surround channel and / or a center channel. The first audio data obtained based on the sound source data includes a low frequency channel. In this way, the low frequency rhythm signal, such as the sound signal of the drum, bass, snare drum and the like in the specified audio, can be played by the electronic device, so that the user can feel the power brought by the subwoofer.

[0142] It should be noted that when the electronic device includes only one first partial side sound unit, the electronic device supports the low frequency enhancement mode, the loudness enhancement mode and / or the dialogue enhancement mode. When the electronic device includes two or more first partial side sound units, the electronic device supports the low frequency enhancement mode, the loudness enhancement mode, the surround enhancement mode and / or the dialogue enhancement mode.

[0143] In the low frequency enhancement mode, the first partial side sound unit can play the data of the low frequency channel. In the dialogue enhancement mode, the first partial side sound unit can play the data of the center channel. In the loudness enhancement mode, the first partial side sound unit can simultaneously play the data of the left channel and the data of the right channel. Specifically, the electronic device can superimpose the data of the left channel and the data of the right channel together, and use the first partial side sound unit to play the superimposed data of the left channel and the right channel. Alternatively, the electronic device can downmix the data of the left channel and the data of the right channel to obtain data including only a single channel, and use the first partial side sound unit to play the data of the single channel. Wherein, after the electronic device performs the downmix operation on the audio data, the number of channels included in the audio data after the downmix is less than the number of channels included in the audio data before the downmix.

[0144] The first-part side sound emitting unit of the electronic device can be located on the A shell of the first part of the electronic device, or located on the B shell of the first part of the electronic device, or located in the cavity between the A shell and the B shell of the first part of the electronic device, or located at the connection between the A shell and the B shell of the first part of the electronic device. In some examples, the first-part side sound emitting unit of the electronic device is located on the A shell of the first part of the electronic device. In this way, the electronic device plays the data of the low-frequency channel through the first-part side sound emitting unit in the low-frequency enhancement mode, not only enhances the low-frequency vibration, but also reduces the noise generated by the second part shaking. In other examples, the first-part side sound emitting unit of the electronic device is located on the B shell of the first part of the electronic device. In this way, the electronic device plays the data of the center channel through the first-part side sound emitting unit in the dialogue enhancement mode, so that the sound source is located near the display screen when the electronic device plays the video, making the user feel that the sound comes from the picture, and enhancing the immersion of video playing.

[0145] If the electronic device includes two first-part side sound emitting units. In the low-frequency enhancement mode, the electronic device can use all the first-part side sound emitting units to play the data of the low-frequency channel. In the dialogue enhancement mode, the electronic device can use all the first-part side sound emitting units to play the data of the center channel. In the loudness enhancement mode, the electronic device uses the first-part side sound emitting unit located on the left side of the electronic device to play the data of the left channel, and uses the first-part side sound emitting unit located on the right side of the electronic device to play the data of the right channel. In the surround enhancement mode, the electronic device uses the first-part side sound emitting unit located on the left side of the electronic device to play the data of the left surround channel, and uses the first-part side sound emitting unit located on the right side of the electronic device to play the data of the right surround channel.

[0146] The first-part side sound emitting unit of the electronic device can be located on the A shell of the first part of the electronic device, or located on the B shell of the first part of the electronic device, or located in the cavity between the A shell and the B shell of the first part of the electronic device, or located at the connection between the A shell and the B shell of the first part of the electronic device. It should be noted that the two first-part side sound emitting units are respectively located on the left and right sides of the first part, and are symmetric with respect to the median plane of the central axis.

[0147] Similarly, in some examples, the first-part side sound emitting unit of the electronic device is located on the A shell of the first part of the electronic device. In other examples, the first-part side sound emitting unit of the electronic device is located on the B shell of the first part of the electronic device.

[0148] In the following embodiments, when one sound emitting unit is used to play the data of multiple sound channels, it can be understood that the sound emitting unit plays the data obtained by superimposing the multiple sound channels, or plays the data obtained by downmixing based on the multiple sound channels. In order to reduce repetitive description, the specific description of using one sound emitting unit to play the data of multiple sound channels will not be repeated below.

[0149] If the electronic device includes 3 first part side sound emitting units. In the low frequency enhancement mode, the electronic device can use all the first part side sound emitting units to play the data of the low frequency sound channel. In the dialogue enhancement mode, the electronic device can use all the first part side sound emitting units to play the data of the center sound channel. In the loudness enhancement mode, the electronic device can use the left first part side sound emitting unit to play the data of the left sound channel, the right first part side sound emitting unit to play the data of the right sound channel, and another first part side sound emitting unit to play the data of the left sound channel and the data of the right sound channel. In the surround enhancement mode, the electronic device uses the left first part side sound emitting unit to play the data of the left surround sound channel, the right speaker to play the data of the right surround sound channel, and another speaker to play the data of the left surround sound channel and the data of the right surround sound channel.

[0150] Among them, the first part side sound emitting unit of the electronic device can be located on the A shell of the first part of the electronic device, or located on the B shell of the first part of the electronic device, or located in the cavity between the A shell and the B shell of the first part of the electronic device, or located at the connection between the A shell and the B shell of the first part of the electronic device. It should be noted that the 1 first part side sound emitting unit of the electronic device is located in the middle of the first part and in the median plane of the central axis. The other 2 first part side sound emitting units of the electronic device are respectively located on the left and right sides of the first part and are symmetrical with respect to the median plane of the central axis.

[0151] In some examples, the first part side sound emitting unit of the electronic device is located on the A shell of the first part of the electronic device. In other examples, the first part side sound emitting unit of the electronic device is located on the B shell of the first part of the electronic device.

[0152] In some examples, the 1 first partial side sound unit is located at the A shell of the electronic device, and the other 2 first partial side sound units are located at the B shell of the electronic device. The electronic device can play the data of the low frequency channel through only the first partial side sound unit located at the A shell of the electronic device in the low frequency enhancement mode. The electronic device can play the data of the left channel through the left first partial side sound unit of the other 2 first partial side sound units and play the data of the right channel through the right first partial side sound unit, or play the data of the left surround channel through the left first partial side sound unit and play the data of the right surround channel through the right first partial side sound unit, or play the sound source data through the other 2 first partial side sound units, or not play the audio data through the 2 first partial side sound units. In this way, in the low frequency mode, the sound units of the B shell do not play the data of the low frequency channel, and the vibration amplitude of the B shell is weakened.

[0153] It should be noted that the 1 first partial side sound unit is located at the A shell of the electronic device, and the other 2 first partial side sound units are located at the B shell of the electronic device, which is only an example. The 1 first partial side sound unit can be located at any position of the median plane of the central axis of the first part, and the other 2 first partial side sound units are located at the A shell, the B shell, the cavity between the A shell and the B shell, or the connection between the A shell and the B shell of the first part, and the 2 first partial side sound units are symmetrical with respect to the median plane of the central axis.

[0154] By analogy, when the electronic device includes more first partial side sound units, the electronic device can play the data of the low frequency channel through all the first partial side sound units in the low frequency enhancement mode. In the center enhancement mode, the data of the center channel is played through all the first partial side sound units. In the loudness enhancement mode, the electronic device plays the data of the left channel through one or more first partial side sound units on the left side, and plays the data of the right channel through one or more first partial side sound units on the right side, and plays the data of the left channel and the right channel through other first partial side sound units. In the surround enhancement mode, the electronic device plays the data of the left surround channel through one or more first partial side sound units on the left side, and plays the data of the right surround channel through one or more first partial side sound units on the right side, and plays the data of the left surround channel and the right surround channel through other first partial side sound units.

[0155] It should be further noted that if the electronic device includes only one second-part side sound emitting unit. In the low frequency enhancement mode, the second-part side sound emitting unit can play the data of the sound channels other than the low frequency channel, for example, the second audio data can include the data of the left channel and the right channel, the left surround channel and the right surround channel and / or the center channel. In the dialogue enhancement mode, the second-part side sound emitting unit can play the data of the sound channels other than the center channel, for example, the second audio data can include the data of the left channel and the right channel, the left surround channel and the right surround channel and / or the center channel. In the loudness enhancement mode, the second-part side sound emitting unit can play the data of the left channel and the right channel at the same time. Specifically, the electronic device can superimpose the data of the left channel and the right channel together, and play the superimposed data of the left channel and the right channel using the second-part side sound emitting unit. Alternatively, the electronic device can downmix the data of the left channel and the right channel to obtain data of a single channel, and play the data of the single channel using the second-part side sound emitting unit.

[0156] In the following embodiments, when playing the data of multiple sound channels using one sound emitting unit, it can be understood that the sound emitting unit plays the data obtained by superimposing the multiple sound channels, or plays the data obtained by downmixing the multiple sound channels. In order to reduce repeated description, the specific description of playing the data of multiple sound channels using one sound emitting unit will not be repeated in the following.

[0157] The second-part side sound emitting unit can be located on the C shell of the second part of the electronic device, or located on the D shell of the second part of the electronic device, or located in the cavity between the C shell and the D shell of the second part of the electronic device, or located at the connection between the C shell and the D shell of the second part of the electronic device.

[0158] If the electronic device includes two second-part side sound emitting units. In the low frequency enhancement mode, the electronic device can use the second-part side sound emitting units to play the data of the sound channels other than the low frequency channel, for example, the second audio data can include the data of the left channel and the right channel, the left surround channel and the right surround channel and / or the center channel. It can be understood that when the second audio data includes the data of the left channel and the right channel, the electronic device uses the second-part side sound emitting unit located on the left side of the electronic device to play the data of the left channel and uses the second-part side sound emitting unit located on the right side of the electronic device to play the data of the right channel. When the second audio data includes the data of the left surround channel and the right surround channel, the electronic device uses the second-part side sound emitting unit located on the left side of the electronic device to play the data of the left surround channel and uses the second-part side sound emitting unit located on the right side of the electronic device to play the data of the right surround channel. When the second audio data includes the data of the center channel, the electronic device uses all the second-part side sound emitting units to play the data of the center channel.

[0159] In the center enhancement mode, the electronic device can use the second partial side sound emitting units to play data of sound channels other than the center channel. For example, the second audio data can include data of left and right channels, left and right surround channels, and / or a low frequency channel. It can be understood that when the second audio data includes data of left and right channels, the electronic device uses the second partial side sound emitting units located on the left side of the electronic device to play data of the left channel and uses the second partial side sound emitting units located on the right side of the electronic device to play data of the right channel. When the second audio data includes data of left and right surround channels, the electronic device uses the second partial side sound emitting units located on the left side of the electronic device to play data of the left surround channel and uses the second partial side sound emitting units located on the right side of the electronic device to play data of the right surround channel. When the second audio data includes data of a low frequency channel, the electronic device uses all the second partial side sound emitting units to play data of the low frequency channel.

[0160] In the loudness enhancement mode, the electronic device uses the second partial side sound emitting units located on the left side of the electronic device to play data of the left channel and uses the second partial side sound emitting units located on the right side of the electronic device to play data of the right channel.

[0161] In the surround enhancement mode, the electronic device can use the second partial side sound emitting units to play data of sound channels other than the left and right surround channels. For example, the second audio data can include data of left and right channels, a low frequency channel, and / or a center channel. It can be understood that when the second audio data includes data of left and right channels, the electronic device uses the second partial side sound emitting units located on the left side of the electronic device to play data of the left channel and uses the second partial side sound emitting units located on the right side of the electronic device to play data of the right channel. When the second audio data includes data of a low frequency channel, the electronic device uses all the second partial side sound emitting units to play data of the low frequency channel. When the second audio data includes data of a center channel, the electronic device uses all the second partial side sound emitting units to play data of the center channel.

[0162] The second partial side sound emitting units can be located on the C shell of the second part of the electronic device, or located on the D shell of the second part of the electronic device, or located in the cavity between the C shell and the D shell of the second part of the electronic device, or located at the connection between the C shell and the D shell of the second part of the electronic device. It should be noted that the two second partial side sound emitting units of the electronic device are respectively located on the left and right sides of the second part and are symmetrical with respect to the median plane of the central axis.

[0163] If the electronic device includes three second partial side sound emitting units, in the low frequency enhancement mode, the electronic device can play data of channels other than the low frequency channel using the second partial side sound emitting units, for example, the second audio data can include data of left and right channels, left and right surround channels, and / or center channel.

[0164] It can be understood that when the second audio data only includes data of left and right channels, the electronic device plays data of the left channel using the second partial side sound emitting unit located on the left side of the electronic device and plays data of the right channel using the second partial side sound emitting unit located on the right side of the electronic device. The electronic device can play data of the left channel and data of the right channel using the second partial side sound emitting unit located in the middle of the electronic device, or does not play audio data using the second partial side sound emitting unit located in the middle of the electronic device.

[0165] When the second audio data only includes data of left and right surround channels, the electronic device plays data of the left surround channel using the second partial side sound emitting unit located on the left side of the electronic device and plays data of the right surround channel using the second partial side sound emitting unit located on the right side of the electronic device. The electronic device can play data of the left surround channel and data of the right surround channel using the second partial side sound emitting unit located in the middle of the electronic device, or does not play audio data using the second partial side sound emitting unit located in the middle of the electronic device.

[0166] When the second audio data only includes data of the center channel, the electronic device plays data of the center channel using all the second partial side sound emitting units, or only uses the second partial side sound emitting unit located in the middle of the electronic device to play data of the center channel.

[0167] When the second audio data includes data of the left channel, data of the right channel, and data of the center channel, the electronic device can play data of the left channel using the second partial side sound emitting unit located on the left side of the electronic device, play data of the right channel using the second partial side sound emitting unit located on the right side of the electronic device, and play data of the center channel using the second partial side sound emitting unit located in the middle of the electronic device. Alternatively, the electronic device plays data of the left channel using the second partial side sound emitting unit located on the left side of the electronic device, plays data of the right channel using the second partial side sound emitting unit located on the right side of the electronic device, and plays data of the left channel, data of the right channel, and data of the center channel using the second partial side sound emitting unit located in the middle of the electronic device.

[0168] When the second audio data includes data of a left surround channel, data of a right surround channel, and data of a center channel, the electronic device plays the data of the left surround channel using the second partial side sound unit located at the left side of the electronic device, plays the data of the right surround channel using the second partial side sound unit located at the right side of the electronic device, and plays the data of the center channel using the second partial side sound unit located at the middle of the electronic device.

[0169] When the second audio data includes data of a left channel, data of a right channel, data of a left surround channel, and data of a right surround channel, the electronic device plays the data of the left channel and the data of the left surround channel using the second partial side sound unit located at the left side of the electronic device, plays the data of the right channel and the data of the right surround channel using the second partial side sound unit located at the right side of the electronic device, and plays the data of the left channel and the data of the right channel using the second partial side sound unit located at the middle of the electronic device.

[0170] When the second audio data includes data of a left channel, data of a right channel, data of a left surround channel, and data of a right surround channel, the electronic device plays the data of the left channel and the data of the left surround channel using the second partial side sound unit located at the left side of the electronic device, plays the data of the right channel and the data of the right surround channel using the second partial side sound unit located at the right side of the electronic device, and plays the data of the left channel and the data of the right channel using the second partial side sound unit located at the middle of the electronic device.

[0171] Likewise, in the dialogue enhancement mode, the electronic device can play data of channels other than the data of the center channel using the second partial side sound unit, for example, the second audio data can include data of left and right channels, left and right surround channels, and / or a low frequency channel. In the loudness enhancement mode, the electronic device can play the data of the left channel using the second partial side sound unit at the left side, the data of the right channel using the second partial side sound unit at the right side, and the data of the left channel and the data of the right channel using another second partial side sound unit. In the surround enhancement mode, the electronic device plays data of channels other than the data of the left and right surround channels using the second partial side sound unit, for example, the second audio data can include data of left and right channels, a low frequency channel, and / or a center channel.

[0172] The second-part side sound unit can be located on the C shell of the second part of the electronic device, or located on the D shell of the second part of the electronic device, or located in the cavity between the C shell and the D shell of the second part of the electronic device, or located at the connection between the C shell and the D shell of the second part of the electronic device. It should be noted that one second-part side sound unit of the electronic device is located in the middle of the second part and on the median plane of the central axis. The other two second-part side sound units of the electronic device are respectively located on the left and right sides of the second part and are symmetrical with respect to the median plane of the central axis.

[0173] By analogy, when the electronic device includes more second-part side sound units, the electronic device can use the second-part side sound units to play the data of the channels other than the low-frequency channel in the low-frequency enhancement mode. In the dialogue enhancement mode, the second-part side sound units are used to play the data of the channels other than the center channel. In the loudness enhancement mode, the electronic device uses one or more second-part side sound units on the left to play the data of the left channel, one or more second-part side sound units on the right to play the data of the right channel, and one or more second-part side sound units in the middle to play the data of the left channel and the right channel. In the surround enhancement mode, the electronic device uses the second-part side sound units to play the data of the channels other than the left surround channel and the right surround channel.

[0174] In some embodiments, the electronic device can use the second-part side sound units to play the data of the channels included in the first audio data in each sound effect mode, which can be referred to the description of Table 1. The second audio data of the electronic device can be sound source data. The second-part side sound units of the electronic device can collectively play the sound source data.

[0175] In other embodiments, the electronic device can use the second-part side sound units to play the data of the channels included in the first audio data in each sound effect mode, which can be referred to the description of Table 1. The electronic device can play the specified audio based on the configuration of the second-part side sound units.

[0176] For example, when the second portion side sound emitting unit of the electronic device supports playing monaural audio, the electronic device can play the sound source data through the second portion side sound emitting unit. When the second portion side sound emitting unit of the electronic device supports playing binaural audio, the electronic device can play data of a left channel obtained based on the sound source data through a part of the second portion side sound emitting unit, and play data of a right channel obtained based on the sound source data through another part of the second portion side sound emitting unit. When the second portion side sound emitting unit of the electronic device supports playing 5.1 channel audio, the electronic device can play data of each channel of 5.1 channels obtained based on the sound source data through different second portion side sound emitting units of the second portion side sound emitting unit, for example, the second portion side sound emitting unit is divided into a left channel sound emitting unit, a right channel sound emitting unit, a left surround channel sound emitting unit, a right surround channel sound emitting unit, a center channel sound emitting unit, and a low frequency channel sound emitting unit. The audio data including the left channel is played through the left channel sound emitting unit of the second portion, the audio data including the right channel is played through the right channel sound emitting unit of the second portion, the audio data including the left surround channel is played through the left surround channel sound emitting unit of the second portion, the audio data including the right surround channel is played through the right surround channel sound emitting unit of the second portion, the audio data including the center channel is played through the center channel sound emitting unit of the second portion, and the audio data including the low frequency channel is played through the low frequency channel sound emitting unit of the second portion. The same applies to other channels.

[0177] It should be noted that when the second portion side sound emitting unit of the electronic device supports playing monaural audio, binaural audio, and multi-channel audio, the second portion side sound emitting unit can play the specified audio in the form of audio with the maximum number of channels supported by the second portion side sound emitting unit, or the second portion side sound emitting unit can play the specified audio in the form of audio selected by the user.

[0178] In some embodiments, the sound effect mode supported by the electronic device includes an all-round enhancement mode. In the all-round enhancement mode, the second audio data obtained based on the sound source data includes a left channel, a right channel, and a center channel. The first audio data obtained based on the sound source data includes a left surround channel, a right surround channel, and a center channel. In this way, in the all-round enhancement mode, the audio data played through the first portion side sound emitting unit can achieve better surround sense of the sound field, and since the first audio data and the second audio data both include the center channel in the all-round enhancement mode, the center channel including the vocal in the audio data can be used to increase the clarity of the dialogue.

[0179] In some embodiments, each sound effect mode of the electronic device includes a original sound effect mode. In the original sound effect mode, the second portion side sound emitting unit and the first portion side sound emitting unit of the electronic device jointly play the audio data of the specified audio.

[0180] In a possible implementation, the electronic device can further provide a smart enhancement mode, when the electronic device does not receive an input of selecting any sound effect mode, the electronic device can set the sound effect mode as the smart enhancement mode. The smart enhancement mode is a combination of the electronic device and one or more of the sound effect modes supported by the electronic device. In this way, when the user does not select the sound effect mode, the electronic device can also process the played sound source data in the smart enhancement mode, so that the electronic device and the electronic device can jointly play the sound.

[0181] Specifically, when the sound effect mode supported by the electronic device and the electronic device includes a dialogue enhancement mode, a surround enhancement mode, a loudness enhancement mode, and a low-frequency enhancement mode. The electronic device can determine the smart enhancement mode based on whether the video is played. When the electronic device plays the video and the audio at the same time, the smart enhancement mode can be a combination of the surround enhancement mode and the dialogue enhancement mode, that is, the first audio data includes a left surround channel, a right surround channel, and a center channel. When the electronic device only plays the audio, the smart enhancement mode can be a combination of the loudness enhancement mode and the low-frequency enhancement mode, that is, the first audio data includes a left surround channel, a right surround channel, and a low-frequency channel.

[0182] When the sound effect mode supported by the electronic device and the electronic device is a dialogue enhancement mode, a low-frequency enhancement mode, or a loudness enhancement mode. The electronic device can set the smart enhancement mode to be a combination of the low-frequency enhancement mode and the loudness enhancement mode.

[0183] It should be noted that since the smart enhancement mode is obtained by the electronic device based on the sound effect mode supported by the electronic device and the electronic device, the one or more sound effect modes determined by the electronic device always include the smart enhancement mode.

[0184] In some embodiments, the data of the left surround channel is the same as the data of the left channel, and the data of the right surround channel is the same as the data of the right channel. When the electronic device plays the data of the left surround channel and the data of the right surround channel, the electronic device can adjust the loudness of playing the data of the left surround channel and the data of the right surround channel, for example, gradually increasing the loudness of playing the data of the left surround channel, and gradually reducing the loudness of playing the data of the right surround channel, and for another example, gradually increasing the loudness of playing the data of the right surround channel, and gradually reducing the loudness of playing the data of the left surround channel. In this way, the user can have a feeling that the simulated sound source of the left channel data and the right channel data moves around in front of the user.

[0185] In some embodiments, the electronic device can display sound effect mode options corresponding to one or more sound effect modes supported by the electronic device, the one or more sound effect mode options including a first mode option, the one or more sound effect modes including a first mode, and the first mode option corresponding to the first mode. When the electronic device displays the one or more sound effect mode options including the first mode option, the electronic device can receive a second input of selecting the first mode option, and determine the sound effect mode of the electronic device. For example, the first mode option is a loudness enhancement mode option, the first mode corresponding to the loudness enhancement mode. When the loudness enhancement mode option is selected, the electronic device sets the sound effect mode to the loudness enhancement mode.

[0186] S402. The electronic device processes the audio data of the specified audio based on the first mode to obtain audio data of each sound emitting unit.

[0187] In the embodiments of the present application, the audio data of the specified audio can be referred to as sound source data. When the electronic device only plays the audio, the sound source data is the data of the audio. When the electronic device plays the video, the sound source data is the audio data of the video, or the data of the audio corresponding to the video.

[0188] The electronic device can process the sound source data based on the first mode to obtain the audio data of each sound emitting unit.

[0189] In a possible implementation, the sound effect mode of the electronic device is the first mode. When the electronic device plays the specified audio, the electronic device can parse the audio file of the specified audio. The electronic device can obtain the sound channels included in the sound source data when parsing the audio file. The electronic device can process the data of each sound channel included in the sound source data based on the first mode to obtain the audio data required by each sound emitting unit in the first mode. In this way, the electronic device can obtain the audio data required by each sound emitting unit of the electronic device regardless of the sound channels included in the sound source data when the sound effect mode is the first mode.

[0190] In some embodiments, when the electronic device determines that the sound source data includes 1 sound channel, that is, the sound source is a mono sound source, the electronic device can obtain audio data including 2 sound channels (left and right sound channels) based on the sound source data. For example, the electronic device can obtain two pieces of mono sound data by directly copying the sound source data, and obtain the audio data including the left and right sound channels by taking one piece of mono sound data as the audio data of the left sound channel and the other piece of mono sound data as the audio data of the right sound channel, wherein the audio data of the left sound channel is the same as the audio data of the right sound channel. Alternatively, the electronic device can obtain two pieces of mono sound source data by copying, and then process the two pieces of mono sound source data by a specified algorithm to adjust one or more of the phase difference, amplitude and frequency of the two pieces of sound source data to obtain the audio data including the left and right sound channels.

[0191] Afterwards, if the sound effect mode of the electronic device is the loudness enhancement mode, the electronic device can obtain, as the first audio data and the second audio data, audio data including 2 channels (a left channel and a right channel) based on the sound source data.

[0192] If the sound effect mode of the electronic device is the low frequency enhancement mode, the surround enhancement mode, or the dialogue enhancement mode, the electronic device can perform upmixing on the audio data including 2 channels (a left channel and a right channel) to obtain audio data including 3 or more channels. The upmixing operation can be used to increase the number of channels included in the audio data. In the low frequency enhancement mode, the electronic device can obtain the first audio data including a low frequency channel and the second audio data including a left channel and a right channel, a left surround channel and a right surround channel, and / or a center channel. In the surround enhancement mode, the electronic device can obtain the first audio data including a left surround channel and a right surround channel and the second audio data including a left channel and a right channel, a low frequency channel, and / or a center channel. In the dialogue enhancement mode, the electronic device can obtain the first audio data including a center channel and the second audio data including a left channel and a right channel, a left surround channel and a right surround channel, and / or a low frequency channel.

[0193] The electronic device can determine that the sound source data includes 2 channels (a left channel and a right channel), i.e., the sound source is a 2-channel sound source, and if the sound effect mode of the electronic device is the loudness enhancement mode, the electronic device can directly obtain audio data including the left channel and the right channel.

[0194] If the sound effect mode of the electronic device is the low frequency enhancement mode, the surround enhancement mode, or the dialogue enhancement mode, the electronic device can perform upmixing on the audio data including 2 channels (a left channel and a right channel) to obtain audio data including 3 or more channels. In the low frequency enhancement mode, the electronic device can obtain the first audio data including a low frequency channel and the second audio data including a left channel and a right channel, a left surround channel and a right surround channel, and / or a center channel. In the surround enhancement mode, the electronic device can obtain the first audio data including a left surround channel and a right surround channel and the second audio data including a left channel and a right channel, a low frequency channel, and / or a center channel. In the dialogue enhancement mode, the electronic device can obtain the first audio data including a center channel and the second audio data including a left channel and a right channel, a left surround channel and a right surround channel, and / or a low frequency channel.

[0195] The electronic device can obtain the first audio data and the second audio data including the left channel and the right channel directly if the sound effect mode of the electronic device is the loudness enhancement mode when it is determined that the sound source data includes 3 or more channels including the left channel and the right channel, i.e., the sound source is a multi-channel sound source. Or, the electronic device can downmix the sound source data to obtain sound source data including only the left channel and the right channel, and use the downmixed sound source data as the first audio data and the second audio data. The downmixing operation can be used to reduce the number of channels included in the audio data.

[0196] If the sound effect mode of the electronic device is the low frequency enhancement mode, if the sound source data includes data of a low frequency channel, the electronic device can use the data of the low frequency channel as the first audio data, and use the data of other channels of the sound source data as the second audio data.

[0197] Or, the electronic device can upmix the sound source data to obtain sound source data including more channels, use the data of the low frequency channel of the upmixed sound source data as the first audio data, and use the data of other channels of the upmixed sound source data as the second audio data. In this way, when the number of the second part side sound emitting units of the electronic device is large, the second part side sound emitting units of the electronic device can play data of more channels.

[0198] If the sound source data does not include data of a low frequency channel, the electronic device can perform an upmixing operation on the sound source data to obtain sound source data including a low frequency channel, the number of channels of the upmixed sound source data being greater than the number of channels of the sound source data before upmixing. The electronic device can use the data of the low frequency channel as the first audio data, and use the data of other channels of the sound source data as the second audio data.

[0199] Similarly, if the sound effect mode of the electronic device is the dialogue enhancement mode, if the sound source data includes data of a center channel, the electronic device can use the data of the center channel as the first audio data, and use the data of other channels of the sound source data as the second audio data.

[0200] Or, the electronic device can upmix the sound source data to obtain sound source data including more channels, use the data of the center channel of the upmixed sound source data as the first audio data, and use the data of other channels of the upmixed sound source data as the second audio data. In this way, when the number of the second part side sound emitting units of the electronic device is large, the second part side sound emitting units of the electronic device can play data of more channels.

[0201] If the sound source data does not include data of a center channel, the electronic device can perform upmixing on the sound source data to obtain sound source data including a center channel, the sound source data after upmixing having a number of channels greater than the number of channels of the sound source data before upmixing. The electronic device can take the data of the center channel as the first audio data, and take the data of other channels of the sound source data as the second audio data.

[0202] If the sound effect mode of the electronic device is a dialogue enhancement mode, and if the sound source data includes data of left and right surround channels, the electronic device can take the data of the left and right surround channels as the first audio data, and take the data of other channels of the sound source data as the second audio data.

[0203] Alternatively, the electronic device can perform upmixing on the sound source data to obtain sound source data including more channels, take the data of the left and right surround channels of the sound source data after upmixing as the first audio data, and take the data of other channels of the sound source data after upmixing as the second audio data. In this way, when the number of second-part side sound units of the electronic device is large, the second-part side sound units of the electronic device can play data of more channels.

[0204] If the sound source data does not include data of left and right surround channels, the electronic device can perform upmixing on the sound source data to obtain sound source data including left and right surround channels, the sound source data after upmixing having a number of channels greater than the number of channels of the sound source data before upmixing. The electronic device can take the data of the left and right surround channels as the first audio data, and take the data of other channels of the sound source data as the second audio data.

[0205] It should be noted that when the number of second-part side sound units of the electronic device is less than the number of other channels of the sound source data, the electronic device can use one second-part side sound unit to play data of multiple channels, or perform downmixing on the data of other channels of the sound source data to obtain second audio data having a number of channels less than or equal to the number of second-part side sound units.

[0206] In some other embodiments, the electronic device can take the sound source data as the second audio data.

[0207] In some examples, the electronic device can determine whether to perform upmixing or downmixing on sound source data including 3 or more channels based on the number of second-part side sound units.

[0208] Specifically, when the sound source data includes data of the sound channels required by the first audio data in the first mode, the electronic device can perform upmixing on the sound source data when the number of other sound channels of the sound source data is less than the number of the second partial sound emitting units, or copy data of part of the sound channels to obtain sound source data including other sound channels whose number is the same as the number of the second partial sound emitting units, and play data of the other sound channels using the second partial sound emitting units. Alternatively, data of the same sound channel can be played using multiple second partial sound emitting units, or the electronic device can perform upmixing on the sound source data to obtain sound source data including other sound channels whose number is greater than the number of the second partial sound emitting units.

[0209] When the number of other sound channels of the sound source data is equal to the number of the second partial sound emitting units, the electronic device can not perform upmixing or downmixing on the sound source data.

[0210] When the number of other sound channels of the sound source data is greater than the number of the second partial sound emitting units, the electronic device can play data of multiple sound channels using one second partial sound emitting unit, or perform downmixing on data of other sound channels of the sound source data, or superimpose data of part of the sound channels to obtain second audio data whose number of sound channels is less than or equal to the number of the second partial sound emitting units.

[0211] It should be noted that when the sound source data does not include data of the sound channels required by the first audio data in the first mode, the electronic device must perform upmixing on the sound source data to obtain sound source data including the sound channels required by the first audio data in the first mode. Then, the electronic device can determine whether to perform further upmixing or downmixing on the sound source data based on the number of the second partial sound emitting units.

[0212] It should also be noted that the number of other sound channels of the sound source data is only an example as a judgment standard, and the number of all sound channels of the sound source data can also be used as a judgment standard, which is not limited in the embodiments of the application.

[0213] Finally, it should be noted that the description of the electronic device playing audio data in each sound effect mode can refer to the embodiments shown in Table 1 above, which will not be described here.

[0214] In other examples, the electronic device can determine whether to perform upmixing or downmixing on sound source data including 3 or more sound channels based on the number of sound emitting units of the electronic device.

[0215] In some examples, the electronic device obtains the audio data of each sound emitting unit based on the first mode in the low frequency enhancement mode, the surround enhancement mode and the dialogue enhancement mode. Taking the case of obtaining the audio data of the sound source data including 5.1 channels (left channel, right channel, left surround channel, right surround channel, low frequency channel and center channel) by up-mixing the sound source data as an example, the flow of the electronic device obtaining the audio data of each sound emitting unit based on the first mode is shown in FIG. 5. Figure 5

[0216] S501. The electronic device obtains the channel information of the sound source data.

[0217] The electronic device obtains the channels included in the sound source data. The electronic device can obtain which channels are included in the sound source data when decoding the audio file in the decoding format of the specified audio. It can be understood that when the electronic device obtains the channels included in the sound source data, the number of channels included in the sound source data can be obtained.

[0218] S502. Whether the number of channels of the sound source is less than 2.

[0219] The electronic device determines whether the number of channels of the sound source data is less than 2. When the electronic device determines that the number of channels of the sound source data is less than 2, step S504 is performed; when the electronic device determines that the number of channels of the sound source data is greater than or equal to 2, step S503 is performed.

[0220] S503. Whether the number of channels of the sound source data is greater than 2.

[0221] The electronic device determines whether the number of channels of the sound source data is greater than 2. When the electronic device determines that the number of channels of the sound source data is less than or equal to 2, step S505 can be performed; when the electronic device determines that the number of channels of the sound source data is greater than 2, step S506 can be performed.

[0222] S504. The electronic device processes the sound source data to obtain the included two-channel sound source data, and the two channels include a left channel and a right channel.

[0223] The electronic device determines that the sound source data is single-channel sound source data. The electronic device can copy the single-channel sound source data to obtain two-channel sound source data.

[0224] ​In some examples, the electronic device can directly copy the monaural sound source data to obtain two pieces of monaural sound source data, and take one piece of the monaural sound source data as the audio data of the left channel and the other piece as the audio data of the right channel to obtain the sound source data including the left channel and the right channel, where the audio data of the left channel is the same as the audio data of the right channel. Alternatively, after copying to obtain two pieces of monaural sound source data, the electronic device can process the two pieces of monaural sound source data through a specified algorithm to adjust one or more of the phase difference, amplitude and frequency of the two pieces of sound source data to obtain the sound source data including the left channel and the right channel.

[0225] S505. The electronic device processes the sound source data including the left channel and the right channel to obtain the audio data of each sound emitting unit based on the first mode.

[0226] If the first mode is the surround enhancement mode, the electronic device can process the two-channel sound source data through a related algorithm to obtain the first audio data including the left surround channel and the right surround channel. For example, when the electronic device includes the sound emitting unit as shown in FIG. 3, the electronic device can play the data of the left surround channel through the first part side sound emitting unit 33, play the data of the right surround channel through the first part side sound emitting unit 34, play the data of the left channel through the second part side sound emitting unit 31, and play the data of the right channel through the second part side sound emitting unit 32. In addition, since the electronic device includes the first part side sound emitting unit 35, the electronic device can control the first part side sound emitting unit 35 to play the data of the left surround channel and the right surround channel, or not use the first part side sound emitting unit 35 to play the audio data. Figure 3A

[0227] Optionally, the electronic device can play the sound source data through the first part side sound emitting unit 35.

[0228] If the first mode is the low frequency enhancement mode, the electronic device can extract the data of the low frequency channel in the two-channel sound source data to obtain the first audio data including the low frequency channel. For example, when the electronic device includes the sound emitting unit as shown in FIG. 3, the electronic device can play the data of the low frequency channel through the first part side sound emitting unit 33, the first part side sound emitting unit 34 and the first part side sound emitting unit 35, play the data of the left channel through the second part side sound emitting unit 31, and play the data of the right channel through the second part side sound emitting unit 32. Figure 3A

[0229] If the first mode is the dialogue enhancement mode, the electronic device can process the two-channel sound source data through a related algorithm to extract the data of the center channel in the two-channel sound source data to obtain the first audio data including the center channel. For example, when the electronic device includes the sound emitting unit as shown in FIG. 3, the electronic device can play the data of the center channel through the first part side sound emitting unit 33, the first part side sound emitting unit 34 and the first part side sound emitting unit 35, play the data of the left channel through the second part side sound emitting unit 31, and play the data of the right channel through the second part side sound emitting unit 32. Figure 3A ​​In the illustrated sound production unit, the electronic device can play the data of the center channel through the first partial side sound production unit 33, the first partial side sound production unit 34 and the first partial side sound production unit 35, play the data of the left channel through the second partial side sound production unit 31, and play the data of the right channel through the second partial side sound production unit 32.

[0230] If the first mode is the loudness enhancement mode, the electronic device can take the two-channel sound source data as the first audio data and the second audio data. For example, when the electronic device includes Figure 3A In the illustrated sound production unit, the electronic device can play the data of the left channel through the first partial side sound production unit 33, play the data of the right channel through the first partial side sound production unit 34, play the data of the left channel through the second partial side sound production unit 31, and play the data of the right channel through the second partial side sound production unit 32. Since the electronic device includes the first partial side sound production unit 35, the electronic device can control the first partial side sound production unit 35 to play the data of the left channel and the right channel, or not use the first partial side sound production unit 35 to play the audio data.

[0231] Optionally, if the first mode is the low frequency enhancement mode, the dialogue enhancement mode or the surround enhancement mode, the electronic device can perform upmix operation on the two-channel sound source data to obtain sound source data including 5.1 channels, and then obtain the first audio data and the second audio data. For details, please refer to steps S508 and S510.

[0232] It should be noted that in any audio mode, the electronic device can take the single-channel data or the two-channel data as the second audio data, or the electronic device can process the single-channel data or the two-channel data to obtain the second audio data including one or more channels.

[0233] S506. Whether the number of channels of the sound source data is less than or equal to 5.1, wherein the 5.1 channels include a left channel, a right channel, a center channel, a left surround channel, a right surround channel and a low frequency channel.

[0234] The electronic device can determine whether the number of channels of the sound source data is less than 5.1. When it is determined that the number of channels of the sound source data is less than or equal to 5.1, the electronic device can execute step S507; when it is determined that the number of channels of the sound source data is greater than 5.1, the electronic device can execute step S509.

[0235] The number of channels less than 5.1 can be understood as the number of channels included in the sound source data being less than the number of channels included in 5.1 channels. For example, when the sound source data is 4 channels, 4.1 channels, 3 channels, 3.1 channels or 2.1 channels, the number of channels is less than 5.1. Among them, 4 channels can be understood as the sound source data including a left channel, a right channel, a left surround channel and a right surround channel, 4.1 channels can be understood as the sound source data including a left channel, a right channel, a low frequency channel, a left surround channel and a right surround channel, and so on.

[0236] Similarly, the number of channels greater than 5.1 can be understood as the number of channels included in the sound source data being greater than the number of channels included in 5.1 channels. For example, when the sound source data is 7.1 channels, 10.1 channels, the number of channels is greater than 5.1. Among them, 7.1 channels can be understood as the sound source data including a left channel, a right channel, a left front surround channel, a right front surround channel, a left rear surround channel, a right rear surround channel, a center channel and a low frequency channel.

[0237] S507. Whether the number of channels of the sound source data is equal to 5.1.

[0238] The electronic device can determine whether the number of channels of the sound source data is equal to 5.1. The electronic device can execute step S510 when it is determined that the number of channels of the sound source data is equal to 5.1; the electronic device can execute step S508 when it is determined that the number of channels of the sound source data is not equal to 5.1.

[0239] S508. Up-mixing the sound source data to obtain sound source data including 5.1 channels.

[0240] The electronic device determines that the number of channels of the sound source data is less than 5.1, and can up-mix the sound source data to obtain 5.1 channel sound source data through a specified up-mixing algorithm.

[0241] S509. Down-mixing the sound source data to obtain sound source data including 5.1 channels.

[0242] The electronic device determines that the number of channels of the sound source data is greater than 5.1, and can down-mix the sound source data to obtain 5.1 channel sound source data through a specified down-mixing algorithm.

[0243] S510. The electronic device processes the 5.1 channel sound source data based on the first mode to obtain audio data of each sound emitting unit.

[0244] If the first mode is a surround enhancement mode, the electronic device can extract the data of the left surround channel and the data of the right surround channel in the 5.1 channel sound source data to obtain first audio data. For example, when the electronic device includes Figure 3AIn the illustrated sound emitting units, the electronic device can play the data of the left surround sound channel through the first partial side sound emitting unit 33, play the data of the right surround sound channel through the first partial side sound emitting unit 34, play the data of the left sound channel through the second partial side sound emitting unit 31, and play the data of the right sound channel through the second partial side sound emitting unit 32. Since the electronic device includes the first partial side sound emitting unit 35, the electronic device can control the first partial side sound emitting unit 35 to play the data of the low frequency sound channel and / or the center sound channel, or not use the first partial side sound emitting unit 35 to play the audio data. Alternatively, the electronic device can also play the data of the low frequency sound channel and / or the center sound channel through the second partial side sound emitting unit 31 and the second partial side sound emitting unit 32. Alternatively, if the unprocessed sound source data includes the left surround sound channel, the right surround sound channel, and other sound channels, the electronic device can directly extract the data of the corresponding sound channels of the sound source data to obtain the second audio data and the first audio data.

[0245] If the first mode is the low frequency enhancement mode, the electronic device can extract the data of the low frequency sound channel in the processed sound source data to obtain the first audio data including the low frequency sound channel. For example, when the electronic device includes Figure 3A In the illustrated sound emitting units, the electronic device can play the data of the low frequency sound channel through the first partial side sound emitting unit 33, the first partial side sound emitting unit 34, and the first partial side sound emitting unit 35, play the data of the left sound channel through the second partial side sound emitting unit 31 and play the data of the right sound channel through the second partial side sound emitting unit 32, and / or play the data of the left surround sound channel through the second partial side sound emitting unit 31 and play the data of the right surround sound channel through the second partial side sound emitting unit 32, and / or play the data of the center sound channel through the second partial side sound emitting unit 31 and the second partial side sound emitting unit 32. Alternatively, if the unprocessed sound source data includes the low frequency sound channel and other sound channels, the electronic device can directly extract the data of the corresponding sound channels of the sound source data to obtain the second audio data and the first audio data.

[0246] If the first mode is the dialogue enhancement mode, the electronic device can further extract the data of the center sound channel in the processed sound source data to obtain the first audio data including the center sound channel. For example, when the electronic device includes Figure 3AIn the illustrated sound emitting units, the electronic device can play the data of the center channel through the first partial side sound emitting unit 33, the first partial side sound emitting unit 34, and the first partial side sound emitting unit 35, play the data of the left channel through the second partial side sound emitting unit 31 and the data of the right channel through the second partial side sound emitting unit 32, and / or play the data of the left surround channel through the second partial side sound emitting unit 31 and the data of the right surround channel through the second partial side sound emitting unit 32, and / or play the data of the low frequency channel through the second partial side sound emitting unit 31 and the second partial side sound emitting unit 32. Alternatively, if the unprocessed sound source data includes the center channel and other channels, the second partial side sound emitting unit can directly extract the data of the corresponding channels of the sound source data to obtain the second audio data and the first audio data.

[0247] If the first mode is the loudness enhancement mode, the electronic device can process the 5.1 channel sound source data through a related downmix algorithm to obtain sound source data including only the left channel and the right channel. The electronic device can use the processed sound source data as the second audio data and the first audio data. For example, when the electronic device includes Figure 3A In the illustrated sound emitting units, the electronic device can play the data of the left channel through the first partial side sound emitting unit 33 and the data of the right channel through the first partial side sound emitting unit 34. The data of the left channel is played through the second partial side sound emitting unit 31 and the data of the right channel is played through the second partial side sound emitting unit 32. Since the electronic device includes the first partial side sound emitting unit 35, the electronic device can control the first partial side sound emitting unit 35 to play the data of the left channel and the right channel, or not use the first partial side sound emitting unit 35 to play the audio data. Alternatively, if the unprocessed sound source data includes the left channel and the right channel, the second partial side sound emitting unit can directly extract the data of the corresponding channels of the sound source data to obtain the second audio data and the first audio data.

[0248] Alternatively, in any audio mode, the electronic device can use the sound source data, the 5.1 channel data, or the data of the channels of the 5.1 channel data except the first audio data as the second audio data, or the electronic device can process the sound source data or the 5.1 channel data to obtain the second audio data including one or more channels.

[0249] In some embodiments, the electronic device can process the sound source data based on all the sound effect modes supported to obtain the data of all the channels of all the sound effect modes. The electronic device can use the first partial side sound emitting unit and the second partial side sound emitting unit to play the data of the corresponding channels based on the current sound effect mode. In this way, when the sound effect mode of the electronic device changes, the electronic device does not need to process the sound source data according to the modified sound effect mode, and the electronic device can directly play the audio data corresponding to the changed sound effect mode.

[0250] For example, if the electronic device supports sound effect modes including surround enhancement mode, dialogue enhancement mode, loudness enhancement mode, and low-frequency enhancement mode, the electronic device processes the audio source data to obtain data for the left channel, right channel, left surround channel, right surround channel, center channel, and low-frequency channel. When the electronic device is in surround enhancement mode, it plays the data for the left and right surround channels through the first part of the side-emitting unit. When the electronic device is in low-frequency enhancement mode, it plays the data for the low-frequency channel using the first part of the side-emitting unit.

[0251] It should be noted that the audio data of each sound-generating unit includes at least a portion of the source data. This "at least a portion" includes both a partial portion and the entirety of the source data. A partial portion can be data from a certain channel and / or a certain frequency band. It is understood that "partial" here can include not only a portion but also the entirety of the data.

[0252] It should be noted that it is not limited to Figure 5 In the illustrated embodiment, the electronic device can also directly extract the channel data required by each sound-producing unit in the sound effect mode from the sound source data. For example, in loudness enhancement mode, the electronic device can process the sound source data through a specified algorithm to obtain the data of the left channel and the data of the right channel, etc., which is not limited in this embodiment of the application.

[0253] S403. Each sound-producing unit of the electronic device simultaneously plays its own audio data.

[0254] After obtaining the audio data from each sound-producing unit, the electronic device can use all the sound-producing units to play their respective audio data.

[0255] Specifically, electronic devices can employ specified algorithms (e.g., Figure 5 The multi-channel algorithm shown processes the audio source data and sends the resulting audio data from each speaker unit to the audio driver. The audio driver converts the digital signal mode audio data into analog signal mode audio data, and then sends the analog signal mode audio data to the audio amplifier chip of each speaker unit. The audio amplifier chip of each speaker unit amplifies the analog signal mode audio data and plays the amplified analog signal mode audio data through each speaker unit. In some examples, the audio driver can send audio data to the audio amplifier chip through the integrated circuit's built-in audio bus (inter-ICsound, I2S).

[0256] It should be noted that one sound emitting unit can be composed of one or more loudspeakers. One sound emitting unit can be controlled by one audio drive, or multiple sound emitting units can be controlled by one audio drive, and the embodiments of the present application do not make any limitation in this regard.

[0257] It should be noted that in the process of playing the specified audio by the electronic device, the electronic device can receive an input of selecting the second sound effect mode by the user. In response to the input, the audio data of the specified audio is processed based on the second sound effect mode to obtain the audio data played by each sound emitting unit of the electronic device, and the multiple sound emitting units are controlled to play the respective audio data simultaneously to realize the playing operation of the specified audio.

[0258] In this way, the electronic device adopts the multi-channel algorithm to process the audio data of different sound emitting units, and combines the sound emitting unit combination mode of different positions (for example, the first part of the side sound emitting unit and the second part of the side sound emitting unit) to be sounded jointly, and then is amplified by the audio power amplifier chip and transmitted to each sound emitting unit independently, which can significantly improve the sound field surround and immersion of the electronic device playing the audio.

[0259] In some embodiments, after the electronic device obtains the first audio data, the electronic device can also perform an audio processing operation on the first audio data, and then play the processed first audio data. For example, the audio processing operation can be to adjust the loudness of the first audio data.

[0260] In some examples, the electronic device can identify a small signal audio in the first audio data based on the amplitude of the first audio data, and increase the loudness of the small signal audio. The small signal audio is an audio signal in the first audio data whose loudness is in the range of -35dB and below. In this way, since the loudness of the small signal audio is small and not obvious to the human ear, increasing the loudness of the small signal audio is beneficial to the user to listen to the small signal audio more clearly and to strengthen the user's perception of audio details. For example, if the first audio data is audio data of a game application, the small signal audio can be the sound of the game character triggering the environmental change in the game scene (for example, the rustling sound of the game character passing through the grass, the footsteps of the game character, the sound of the car passing by, etc.). The electronic device can increase the volume of the small signal audio to enhance the immersion of the game and improve the user's game experience. For another example, if the first audio data is audio data provided by a video application, the small signal audio can be the environmental sound in the video (for example, insect chirping, bird chirping, wind sound, etc.). In the preferred scheme of the present application, the electronic device performs the audio processing operation on the first audio data in the loudness enhancement mode. It should be noted that the audio data other than the small signal audio in the first audio data remains unchanged.

[0261] In some embodiments, the electronic device can identify the positions of a plurality of objects (e.g., persons, animals, or articles, etc.) in a video frame by a video recognition algorithm when playing the video, and can extract the sound data of the objects at the positions from the sound source data of the video. The electronic device can play the sound of the objects using one or more sound production units closest to the objects in the video frame. In this way, the sounds of different objects in the video frame can be played using sound production units at different positions, enhancing the immersion of the video.

[0262] In some examples, the electronic device can obtain, based on the positions of the objects in the video frame and the sound data of the objects, first audio data including the sound data of one or more objects farther away from the display screen in the video frame, and second audio data including the vocal data (i.e., the data of the center channel) of one or more objects closer to the display screen in the video frame. In this way, the electronic device can play the vocal data of the objects farther away from the display screen through the first part of the side sound production units, and play the vocal data of the objects closer to the display screen through the second part of the side sound production units, so that the user can perceive the vocal data at different positions, improving the immersion of the user watching the video. Similarly, the electronic device can obtain, based on the positions of the objects in the video frame and the sound data of the objects, first audio data including the sound data of one or more objects above the video frame, and second audio data including the sound data of one or more objects below the video frame. In this way, the electronic device can play the sound of the objects above the video frame through the first part of the side sound production units, and play the sound of the objects below the video frame through the second part of the side sound production units, so that the user can perceive the difference between the positions above and below, improving the immersion of the user watching the video.

[0263] It should be noted that the second audio data includes the sound data of at least one object, and the first audio data includes the sound data of all objects except the objects corresponding to the sound data of the second audio data. For example, if the video frame includes three objects, the electronic device can put the sound data of the object closest to the display screen into the second audio data, and put the sound data of the other two objects into the first audio data. Alternatively, the electronic device can put the sound data of the two objects closest to the display screen into the second audio data, and put the sound data of the other object into the first audio data, and the embodiments of the present application are not limited in this regard.

[0264] In some examples, the sound source data includes a plurality of mid channels, and the plurality of mid channels correspond to objects in the video picture one by one. The data of one mid channel is the sound data of one object in the video picture. The electronic device can identify the positions of the objects in the video picture, obtain first audio data including the sound data (i.e., the data of the mid channel) of one or more objects far from the display screen in the video picture, and obtain second audio data including the sound data (i.e., the data of the mid channel) of one or more objects close to the display screen in the video picture.

[0265] In some examples, the electronic device can determine whether the played video is related to a music scene when playing the sound source data of the video. The music scene can include, but is not limited to, a concert scene, a music video (MV) scene, a singing competition scene, a performance scene, and the like. The electronic device can set the sound effect mode to a low frequency enhancement mode or a loudness enhancement mode when it is determined that the video is related to the music scene. The electronic device can set the smart enhancement mode to a dialogue enhancement mode or a surround enhancement mode when it is determined that the video is not related to the music scene.

[0266] In some examples, the electronic device can determine whether the video is related to a music scene based on the name of the video. For example, when the name of the video includes, but is not limited to, words related to music such as "sing", "music", "play", "song", and the like, it is determined that the video is related to the music scene. In other examples, the electronic device can identify whether a person in the video picture is singing or playing an instrument by using an image recognition algorithm. The electronic device can determine that the video is related to the music scene when it is identified that the person in the video picture is playing or singing.

[0267] It should be noted that the sound source data can be audio data in a video file, and the sound source data can also be audio data in an audio file corresponding to the video file.

[0268] It should also be noted that the sound source data can be stored in the memory of the electronic device, or the sound source data can be obtained by the electronic device from other electronic devices (e.g., a server, etc.).

[0269] In some embodiments, the top of the first part of the electronic device includes one or more top sound emitting units. The electronic device can play sky sound through the one or more top sound emitting units. The sky sound is the sound emitted by a specified sky object in the audio. For example, the specified sky object can be an airplane, a bird, lightning, and the like. In this way, the user can perceive the height information of the specified sky object in the audio through hearing, such as the sound of an airplane flying in the sky, the sound of thunder, and the like, thereby increasing the immersion of the user in listening to the audio.

[0270] In some embodiments, the first part of the electronic device includes one or more bottom sound emitting units below. The electronic device can play ground sound through the one or more bottom sound emitting units. Wherein, the ground sound is the sound emitted by the specified ground object in the audio. For example, the specified ground object can be an object such as insects, shrubs, and objects in contact with the ground. In this way, the user can perceive the height information of the specified ground object in the audio through hearing, such as insect chirping, footsteps, rain, etc., increasing the user's immersion in listening to the audio.

[0271] In a possible implementation, the electronic device displays one or more sound effect mode options, and the one or more sound effect mode options correspond one-to-one to one or more sound effect modes of the electronic device. Wherein, the one or more sound effect mode options include a first mode option, and the one or more sound effect modes include a first mode. The first mode option corresponds to the first mode. The electronic device can receive an input of the user for the first mode option, and in response to the input, set the sound effect mode of the electronic device to the first mode. In this way, the electronic device can receive the input of the user, select different sound effect modes, and when playing the audio, process the audio data of the audio based on the sound effect mode of the electronic device.

[0272] As shown in Figure 6A , the electronic device displays a desktop 601. The desktop 601 can include but is not limited to one or more application icons (for example, a music icon 602). The one or more application icons are also displayed with a taskbar below. The taskbar can include one or more function controls, and the function controls can be used to trigger the electronic device to display the corresponding function window. The one or more function controls include a function control 603.

[0273] The electronic device can receive an input of the user for the function control 603, and in response to the input, display a function window 611 as shown in Figure 6B .

[0274] As shown in Figure 6B , the function window 611 can include but is not limited to a sound effect mode icon 612, a volume adjustment bar, etc. Wherein, the sound effect mode icon 612 can be used to trigger the electronic device to display the sound effect mode options corresponding to the sound effect modes supported by the electronic device. The volume adjustment bar can be used to adjust the volume of the audio played by the electronic device.

[0275] The electronic device can receive an input of the user for the sound effect mode icon 612, and in response to the input, display a sound effect mode selection window 621 as shown in Figure 6C .

[0276] As shown in Figure 6C , the sound effect mode selection window 621 can include but is not limited to one or more sound effect mode options. The one or more sound effect mode options can be used to trigger the electronic device to set the sound effect mode of the electronic device to the corresponding sound effect mode.As shown, the sound effect mode selection window 621 includes one or more sound effect mode options. The one or more sound effect mode options can include, but are not limited to, the sound effect mode option 622, the sound effect mode option 623, the sound effect mode option 624, and the sound effect mode option 625.

[0277] The sound effect mode option 622 can be used to trigger the electronic device to set the sound effect mode to the loudness enhancement mode. The sound effect mode option 623 can be used to trigger the electronic device to set the sound effect mode to the surround enhancement mode. The sound effect mode option 624 can be used to trigger the electronic device to set the sound effect mode to the dialogue enhancement mode. The sound effect mode option 625 can be used to trigger the electronic device to set the sound effect mode to the rhythm enhancement mode.

[0278] The one or more sound effect mode options can include the name of the corresponding sound effect mode. The description of each sound effect mode can be referred to Figure 4 As shown in the embodiments, the description is not repeated here. Here, the sound effect mode option 622 is in the selected state, and the sound effect mode of the electronic device is the loudness enhancement mode.

[0279] Optionally, the electronic device can receive the input of the user for the function control 603, and display the sound effect mode selection window 621 as shown. Figure 6C

[0280] Here, taking the electronic device including the first partial side sound emitting unit 33 located on the left side of the display screen, the first partial side sound emitting unit 34 located on the right side of the display screen, the second partial side sound emitting unit 31 located on the left side of the keyboard, and the second partial side sound emitting unit 32 located on the left side of the keyboard as an example, the process of the electronic device playing a song is described.

[0281] Illustratively, the electronic device can receive the input for the music icon 602, and display the music playing interface 630. The music playing interface 630 can include, but is not limited to, the song name, the play control, etc. The play control can be used to trigger the electronic device to play the song indicated by the song name.

[0282] After the electronic device receives the input for the play control, in response to the input, the electronic device processes the sound source data (i.e., the audio data of the song) based on the loudness enhancement mode to obtain the audio data of each sound emitting unit. The description of the electronic device processing the sound source data based on the sound effect mode can be referred to Figure 4 As shown in the embodiments, the description is not repeated here.

[0283] After the electronic device obtains the audio data of each sound emitting unit, the electronic device can use each sound emitting unit to start playing the respective audio data at the same time, as shown in Figure 6D ​As shown. The electronic device plays the left channel audio data through the first partial side sound unit 33 and the second partial side sound unit 31, and the first partial side sound unit B and the second partial side sound unit B play the right channel audio data. It can be understood that the electronic device is playing a song, and the electronic device cancels the display of the play control and displays the pause control, and the pause control can be used to trigger the electronic device and the electronic device to stop playing the audio data.

[0284] In this way, the electronic device can provide the user with multiple sound effect modes, achieve different audio playing effects, and improve the user experience.

[0285] In some embodiments, if the electronic device only includes one first partial side sound unit, the sound effect modes supported by the electronic device include but are not limited to the dialogue enhancement mode and / or the low-frequency enhancement mode. The electronic device can only display the sound effect mode options corresponding to the dialogue enhancement mode and / or the low-frequency enhancement mode.

[0286] In another embodiment, if the electronic device includes at least two first partial side sound units, the at least two first partial side sound units include the first partial side sound unit 33 and the first partial side sound unit 34, and the two first partial side sound units can be located on the left and right sides of the display screen of the electronic device. The sound effect modes supported by the electronic device can include but are not limited to the loudness enhancement mode, the low-frequency enhancement mode, the surround enhancement mode, and / or the dialogue enhancement mode. The electronic device can display the sound effect mode options corresponding to the sound effect modes supported by the electronic device.

[0287] In some examples, when the sound effect mode of the electronic device is the surround enhancement mode, the electronic device can play the left channel data obtained by the audio data of the specified audio through the first partial side sound unit located on the left side of the display screen, and play the right channel data obtained by the audio data of the specified audio through the first partial side sound unit located on the right side of the display screen.

[0288] In a possible implementation, when the electronic device displays one or more sound effect mode options, the electronic device can also display a sliding bar, which can be used to control the electronic device to adjust the first audio data based on the value of the sliding bar when the electronic device processes the audio source data to obtain the first audio data. In this way, the electronic device can receive the user's adjustment of the sliding bar, set the implementation effect of the sound effect mode, and select the sound effect mode with the appropriate implementation effect.

[0289] For example, in the loudness enhancement mode, the value of the loudness factor in the multi-channel processing algorithm can be changed by changing the value of the slider bar, so as to change the amplitude of the first audio data of the electronic device, so as to adjust the volume of the electronic device playing the first audio data. The value of the slider bar of the loudness enhancement mode can be the loudness factor. Wherein, the larger the value of the slider bar (the value of the loudness factor), the higher the volume of the electronic device playing the first audio data, and the smaller the value of the slider bar (the value of the loudness factor), the lower the volume of the electronic device playing the first audio data.

[0290] In the surround mode, the value of the surround factor in the multi-channel processing algorithm can be changed by changing the value of the slider bar, so as to adjust the playing effect of the surround sound effect of the first part of the side sound unit. Wherein, the larger the value of the surround factor, the farther the position of the virtual sound source simulated by the surround channel data from the user, and the more obvious the surround effect. That is, as the surround factor increases, the user perceives that the distance between himself and the sound source also increases when listening to the electronic device playing the data of the surround channel. Wherein, the larger the value of the slider bar, the larger the value of the surround factor, and the more obvious the surround effect. The smaller the value of the slider bar, the smaller the value of the surround factor, and the less obvious the surround effect.

[0291] In the dialogue enhancement mode, the value of the vocal factor in the multi-channel processing algorithm can be changed by changing the value of the slider bar, so as to change the amplitude of the first audio data of the electronic device, so as to adjust the volume of the electronic device playing the first audio data. Wherein, the larger the value of the slider bar (the value of the vocal factor), the higher the volume of the electronic device playing the first audio data, and the more prominent the vocal. The smaller the value of the slider bar (the value of the vocal factor), the lower the volume of the electronic device playing the first audio data, and the less obvious the vocal.

[0292] In the low frequency enhancement mode, the value of the low frequency factor in the multi-channel processing algorithm can be changed by changing the value of the slider bar, so as to change the amplitude of the first audio data of the electronic device, so as to adjust the volume of the electronic device playing the first audio data. Wherein, the larger the value of the slider bar (the value of the low frequency factor), the higher the volume of the electronic device playing the first audio data, and the more obvious the low frequency. The smaller the value of the slider bar (the value of the low frequency factor), the lower the volume of the electronic device playing the first audio data, and the less obvious the low frequency.

[0293] In this way, the loudness, surround sound range, shock intensity, etc. of the first audio data played by the electronic device can be adjusted according to the percentage value.

[0294] It should be noted that the value of the slider bar is always greater than zero, and the electronic device processes the sound source data according to the sound effect mode and the value of the corresponding slider bar.

[0295] In some examples, the slide bar of the electronic device is divided into ten equal parts, and the electronic device can set the initial value of the slide bar of each sound effect mode to 50%. If the value of the slide bar is adjusted to be greater than 50%, the sound channel mode processed in the corresponding sound effect mode is increased according to the influence factor, and if the value of the slide bar is adjusted to be less than 50%, the sound channel mode processed in the corresponding sound effect mode is decreased according to the influence factor.

[0296] For example, in the surround sound field mode, the influence factor can be understood as a surround factor in the surround sound channel processing algorithm. When the value of the slide bar is 50%, when the value of the slide bar is adjusted to 100%, the value of the surround factor in the surround sound channel processing algorithm can be increased according to the pre-set corresponding relationship, and the expansion effect of the surround sound channel is strengthened, which is stronger than the effect of the sound effect mode when the value of the slide bar is 50%. When the value of the slide bar is adjusted to 10%, the value of the surround factor in the surround sound channel processing algorithm can be decreased according to the pre-set corresponding relationship, and the expansion effect of the surround sound channel is weakened, which is weaker than the effect of the sound effect mode when the value of the slide bar is 50%.

[0297] In this way, when the value of the slide bar is the minimum value of the current sound effect mode, that is, 10%. Relative to the case where the cooperative sound mode is not turned on, even if the surround effect of the surround sound effect is weaker than the effect of the sound effect mode when the value of the slide bar is 50%, the electronic device and the electronic device jointly playing the audio data can bring a better experience to the user than the single electronic device playing the audio data alone. For example, when the value of the slide bar is a preset value 1, the distance between the simulated sound source and the user when the first part of the electronic device plays the first audio data is a preset distance 1, and when the value of the slide bar is a preset value 2, the distance between the simulated sound source and the user when the first part of the electronic device plays the first audio data is a preset distance 2, the preset value 1 is less than the preset value 2, and the preset distance 1 is less than the preset distance 2.

[0298] For another example, in the loudness enhancement mode, when the value of the slide bar is 50%, the loudness of the first audio data is 5dB. When the value of the slide bar is adjusted to be less than 50%, for example, adjusted to 20%, the loudness of the first audio data is adjusted to 2dB, and here the influence factor can be regarded as a loudness factor, and when the value of the slide bar is 20%, the value of the loudness factor is 0.4. Similarly, the description of the dialogue enhancement mode and the low frequency enhancement mode can refer to the description of the loudness enhancement mode, which will not be repeated here.

[0299] For example, the electronic device can display the sound effect mode selection window 631 as shown in FIG. 6B when receiving the input of the user to the function control 603 as shown in FIG. 6A or the sound effect mode icon 612 as shown in FIG. 6A. Figure 6A For example, the electronic device can display the sound effect mode selection window 631 as shown in FIG. 6B when receiving the input of the user to the function control 603 as shown in FIG. 6A or the sound effect mode icon 612 as shown in FIG. 6A. Figure 6B For example, the electronic device can display the sound effect mode selection window 631 as shown in FIG. 6B when receiving the input of the user to the function control 603 as shown in FIG. 6A or the sound effect mode icon 612 as shown in FIG. 6A. Figure 6E For example, the electronic device can display the sound effect mode selection window 631 as shown in FIG. 6B when receiving the input of the user to the function control 603 as shown in FIG. 6A or the sound effect mode icon 612 as shown in FIG. 6A.

[0300] For example, the electronic device can display the sound effect mode selection window 631 as shown in FIG. 6B when receiving the input of the user to the function control 603 as shown in FIG. 6A or the sound effect mode icon 612 as shown in FIG. 6A. Figure 6EAs shown, the sound effect mode selection window 631 includes one or more sound effect mode options. The one or more sound effect mode options can include, but are not limited to, a sound effect mode option 632, a sound effect mode option 633, a sound effect mode option 634, and a sound effect mode option 635.

[0301] The sound effect mode option 632 can be used to trigger the electronic device to set the sound effect mode to the loudness enhancement mode. The sound effect mode option 633 can be used to trigger the electronic device to set the sound effect mode to the surround enhancement mode. The sound effect mode option 634 can be used to trigger the electronic device to set the sound effect mode to the dialogue enhancement mode. The sound effect mode option 635 can be used to trigger the electronic device to set the sound effect mode to the rhythm enhancement mode. The one or more sound effect mode options can include the name of the corresponding sound effect mode.

[0302] The one or more sound effect mode options all include a corresponding sliding bar, such as Figure 6E As shown, the sound effect mode option 632 includes a sliding bar 641, which includes a minimum value, a maximum value, and a slider 642. The minimum value can be used to represent the minimum value of the sliding bar 641 of the loudness enhancement mode, which is 1, i.e., 10%. The maximum value can be used to represent the maximum value of the sliding bar 641 of the loudness enhancement mode, which is 10, i.e., 100%. The slider 642 can be used to change the value of the sliding bar 641. The vicinity of the slider 642 can also display the value of the sliding bar 641 when the slider 642 is at a certain position of the sliding bar 641, which is 5, i.e., 50%. The description of the sliding bar of each sound effect mode can refer to the above-mentioned embodiments, which will not be described here.

[0303] The electronic device can receive an input of dragging the slider 642 to the left to reduce the value of the sliding bar 641, for example, the value of the sliding bar 641 is reduced to 20%. The electronic device can process the sound source data based on the value of the sliding bar to obtain first audio data. The electronic device can play the first audio data.

[0304] It can be understood that the effect of the surround sound effect in the scenario where the value of the sliding bar is 50% is stronger than the effect of the surround sound effect in the scenario where the value of the bar is 20%. For example, Figure 6DIn the scenario shown, the distance between the simulated virtual sound source and the user can be 20 centimeters, making the user perceive the width of the sound source's sound as extending 0.2 meters to the left and right of the central axis of the electronic device. After the slider value is reduced from 50% to 20%, the distance between the simulated virtual sound source and the user, played by the first part of the side-emitting unit, can be 50 centimeters, making the user perceive the width of the sound source's sound as extending 0.5 meters to the left and right of the central axis of the electronic device. The farther the virtual sound source is from the user, the more obvious the surround effect. It is understood that the above correspondence between the slider value and the distance is only an example, and in a specific implementation, this distance can be other values, which are not limited in this embodiment.

[0305] In some applications, the first-part sound-emitting unit of an electronic device is deployed in the B-shell. When the angle between the B-shell and the C-shell is within different ranges, it can provide users with different auditory experiences.

[0306] For example, such as Figure 7 As shown, when the first part of the sound-emitting unit of the electronic device is deployed in shell B, the sound wave direction of the first part of the sound-emitting unit is from shell A to shell B.

[0307] When the angle α between shell B and shell C of the electronic device is at Figure 8A When the angle range of 81 is shown, the sound is clearer because the sound waves emitted by the first part of the side sound unit are directed toward the user's ear.

[0308] When the angle α between shell B and shell C of the electronic device is at Figure 8B When the angle range of 82° is shown, the local cavity formed between shell B and shell C can reflect the sound waves emitted by the first part of the side sound unit back and forth, enhancing the reverberation of the sound and making the sound fuller.

[0309] When the angle α between shell B and shell C of the electronic device is at Figure 8C When the angle range shown is 83 degrees, shell B is closer to the desktop, and more sound waves are reflected from the desktop, resulting in stronger sound energy and louder sound.

[0310] When the angle α between shell B and shell C of the electronic device is at Figure 8D When the angle range of 84 degrees is shown, shells A and D coincide, allowing the electronic device to play images and sound through shell B. This makes it convenient for users to hold the electronic device and play audio and video. When the electronic device plays video, it can be considered a handheld cinema, with more synchronized sound and picture and a stronger sense of immersion. The electronic device can also be placed on an electronic device stand, making it easy for users to adjust its position.

[0311] The maximum value of the angle range 81 is less than or equal to the minimum value of the angle range 83. The minimum value of the angle range 81 is greater than or equal to the maximum value of the angle range 82, and the minimum value of the angle range 84 is greater than or equal to the maximum value of the angle range 83. For example, the angle range 82 is 0 degrees to 45 degrees, the angle range 81 is 45 degrees to 135 degrees, the angle range 83 is 135 degrees to 180 degrees, and the angle range 84 is 180 degrees to 360 degrees.

[0312] The description of the sound generating unit located at the B shell can refer to the description of the first partial side sound generating unit shown in Figure 3A The description of the electronic device controlling the sound generating unit of the B shell to play the audio data can refer to the description of the first partial side sound generating unit shown in Figure 4 The description of the electronic device controlling the sound generating unit of the B shell to play the audio data can refer to the description of the first partial side sound generating unit shown in Figure 5 The description of the electronic device controlling the sound generating unit of the B shell to play the audio data can refer to the description of the first partial side sound generating unit shown in

[0313] In a possible implementation, the first partial side sound generating unit of the electronic device is disposed at the B shell. The electronic device can detect the angle between the B shell and the C shell of the electronic device, and adjust the loudness of the audio data of the first partial side sound generating unit and / or the second partial side sound generating unit. In this way, when the angle between the B shell and the C shell is different, the loudness of the audio data of the sound generating unit can be adjusted to provide better playing effect for the user.

[0314] For example, as shown in Figure 7 When the first partial side sound generating unit of the electronic device is disposed at the B shell, the sound wave direction of the first partial side sound generating unit is directed from the A shell to the B shell. When the angle a between the B shell and the C shell of the electronic device is in the angle range 81 shown in Figure 8A The electronic device can directly use the sound generating unit to play the respective audio data, wherein the volume of the audio data played by the first partial side sound generating unit of the electronic device is the specified volume value 80. In some examples, since the sound of the B shell is directly emitted, the sound wave direction is towards the user, and the sound sharpness is improved, the electronic device can reduce the frequency of the high frequency audio data to reduce the sharpness of the sound.

[0315] When the angle a between the B shell and the C shell of the electronic device is in the angle range 82 shown in Figure 8B The electronic device can adjust the loudness of the audio data of each sound generating unit based on the angle a, for example, reduce the volume of the first partial side sound generating unit, or reduce the volume of the first partial side sound generating unit and increase the volume of the second partial side sound generating unit. Here, the volume of the audio data played by the first partial side sound generating unit of the electronic device is less than the specified volume value 80. In this way, the reverberation effect caused by the sound waves emitted by the first partial side sound generating unit reflecting back and forth in the local cavity formed between the screen part and the keyboard part can be reduced, so that the sound is clearer.

[0316] When the angle α between shell B and shell C of the electronic device is at Figure 8C When the angle range of 83 is shown, the electronic device can adjust the loudness of the audio data of each sound unit based on angle α. For example, it can increase the volume of the first-side sound unit, or increase the volume of the first-side sound unit and decrease the volume of the second-side sound unit. Here, the volume of the audio data played by the first-side sound unit of the electronic device is greater than a specified volume value of 80. In this way, because the distance between the first-side sound unit and the user is increased, the electronic device can increase the volume of the first-side sound unit, so that the user can hear the sound of the first-side sound unit clearly.

[0317] When the angle α between shell B and shell C of the electronic device is at Figure 8D When the angle range of 84 is shown, the electronic device can adjust the loudness of the audio data of each sound unit based on angle α. For example, it can increase the volume of the second-side sound unit, or decrease the volume of the first-side sound unit and increase the volume of the second-side sound unit. Here, the volume of the audio data played by the first-side sound unit of the electronic device is less than or equal to a specified volume value of 80. In this way, since the second-side sound unit is located on the back of the B-shell, the volume of the second-side sound unit can be increased, so that the user can hear the sound of the second-side sound unit more clearly.

[0318] In this range, the minimum value of angle range 81 is greater than or equal to the maximum value of angle range 82. The maximum value of angle range 81 is less than or equal to the minimum value of angle range 83. The maximum value of angle range 83 is less than or equal to the minimum value of angle range 84. For example, angle range 82 is 0 degrees to 45 degrees, angle range 81 is 45 degrees to 135 degrees, angle range 83 is 135 degrees to 180 degrees, and angle range 84 is 180 degrees to 360 degrees.

[0319] In some embodiments, when the first part of the side-emitting unit of the electronic device is deployed in the B-shell, the electronic device may only provide a surround enhancement mode, or the initial sound effect mode of the electronic device may be set to surround enhancement mode. The initial sound effect mode is the sound effect mode of the electronic device after it is powered on. In this way, the electronic device can use the second part of the side-emitting unit and the first part of the side-emitting unit to simultaneously play specified audio, aiming to bring the audio image and the picture at the same height, while simultaneously enhancing the surround effect.

[0320] In some embodiments, the first portion of the side sound units has a large vibration amplitude in the low-frequency enhancement mode. In order to avoid affecting the display effect of the display screen, the electronic device can set the low-frequency enhancement mode to be unselectable during the process of playing the video. When the low-frequency enhancement mode is set to be unselectable, the electronic device does not display the low-frequency enhancement mode option corresponding to the low-frequency enhancement mode, or the electronic device displays the low-frequency enhancement mode option that cannot be selected.

[0321] In some embodiments, the first portion of the side sound units is arranged on the B shell of the electronic device. The electronic device can directly not display the low-frequency enhancement mode option corresponding to the low-frequency enhancement mode.

[0322] In some application scenarios, the first portion of the side sound units is arranged on the A shell of the electronic device. When the angle between the B shell and the C shell is in different angle ranges, different auditory experiences can be brought to the user.

[0323] As shown in FIG. 9A, when the first portion of the side sound units is arranged on the A shell of the electronic device, the sound wave direction of the first portion of the side sound units is directed from the B shell to the A shell. Figure 9 When the angle a between the B shell and the C shell of the electronic device is in the angle range 91 as shown in FIG. 9B, because the sound wave emitted by the first portion of the side sound units is directed towards the direction away from the user, the sound is more open.

[0324] Figure 10A When the angle a between the B shell and the C shell of the electronic device is in the angle range 92 as shown in FIG. 9C, the A shell is closer to the user, and the sound is clearer.

[0325] When the angle a between the B shell and the C shell of the electronic device is in the angle range 93 as shown in FIG. 9D, the A shell is closer to the desktop, and the sound wave reflected by the desktop is more, so that the sound energy is stronger and the sound loudness is larger. Figure 10B When the angle a between the B shell and the C shell of the electronic device is in the angle range 94 as shown in FIG. 9E, the A shell coincides with the D shell. In this way, it is convenient for the user to hold the electronic device. When the electronic device plays audio, the vibration sound of the A shell brings stronger low-frequency vibration sensation.

[0326] Figure 10C

[0327] Figure 10D

[0328] ​​​​​The maximum value of the angle range 91 is less than or equal to the minimum value of the angle range 93. The minimum value of the angle range 91 is greater than or equal to the maximum value of the angle range 92, and the minimum value of the angle range 94 is greater than or equal to the maximum value of the angle range 93. For example, the angle range 92 is 0 degrees to 45 degrees, the angle range 91 is 45 degrees to 135 degrees, the angle range 93 is 135 degrees to 190 degrees, and the angle range 94 is 190 degrees to 360 degrees.

[0329] The description that the electronic device controls the sound production unit of the A shell to play the audio data can be referred to Figure 4 and Figure 5 The embodiments shown in the drawings are not described here again.

[0330] In another possible implementation, the first partial side sound production unit of the electronic device is arranged in the A shell. The electronic device can detect the angle between the B shell and the C shell of the electronic device, and adjust the loudness of the audio data of the first partial side sound production unit and the second partial side sound production unit.

[0331] For example, as Figure 9 shown, when the first partial side sound production unit of the electronic device is arranged in the A shell, the sound wave direction of the first partial side sound production unit is pointed from the B shell to the A shell.

[0332] When the angle a between the B shell and the C shell of the electronic device is in the angle range 91 shown in Figure 10A , the electronic device can directly use the sound production unit to play the respective audio data, wherein the volume of the audio data played by the first partial side sound production unit of the electronic device is the specified volume value 90.

[0333] When the angle a between the B shell and the C shell of the electronic device is in the angle range 92 shown in Figure 10B , the electronic device can adjust the loudness of the audio data of each sound production unit based on the angle a, for example, increase the volume of the first partial side sound production unit, or increase the volume of the first partial side sound production unit and decrease the volume of the second partial side sound production unit. Here, the volume of the audio data played by the first partial side sound production unit of the electronic device is greater than the specified volume value 90. In this way, since the sound wave direction of the first partial side sound production unit is away from the user, increasing the volume of the first partial side sound production unit can enhance the clarity of the user listening to the audio.

[0334] When the angle a between the B shell and the C shell of the electronic device is in the angle range 94 shown in Figure 10CWhen the angle a between the B shell and the C shell of the electronic device is in the angle range 93, the electronic device can adjust the loudness of the audio data of each sound unit based on the angle a, for example, reduce the volume of the first part side sound unit, or reduce the volume of the first part side sound unit and increase the volume of the second part side sound unit. Here, the volume of the first part side sound unit of the electronic device playing the audio data is less than the specified volume value 90. In this way, the high frequency energy enhancement caused by the table reflection between the screen part and the table can be reduced, and the sharpness of the sound can be reduced. For another example, the volume of the first part side sound unit is increased, or the volume of the first part side sound unit is increased and the volume of the second part side sound unit is reduced. Here, the volume of the first part side sound unit of the electronic device playing the audio data is greater than the specified volume value 90. In this way, the table reflection between the screen part and the table can be enhanced, the reverberation can be increased, the volume of the first part side screen sound unit farther away from the user can be increased, so that the user can listen to the sound of the first part side sound unit and the second part side sound unit at the same time. That is, the situation that the user cannot hear the sound of the first part side sound unit due to the too large volume of the second part side sound unit closer to the user can be avoided.

[0335] When the angle a between the B shell and the C shell of the electronic device is in the angle range 93, the electronic device can adjust the loudness of the audio data of each sound unit based on the angle a, for example, reduce the volume of the first part side sound unit, or reduce the volume of the first part side sound unit and increase the volume of the second part side sound unit. Here, the volume of the first part side sound unit of the electronic device playing the audio data is less than the specified volume value 90. In this way, the high frequency energy enhancement caused by the table reflection between the screen part and the table can be reduced, and the sharpness of the sound can be reduced. For another example, the volume of the first part side sound unit is increased, or the volume of the first part side sound unit is increased and the volume of the second part side sound unit is reduced. Here, the volume of the first part side sound unit of the electronic device playing the audio data is greater than the specified volume value 90. In this way, the table reflection between the screen part and the table can be enhanced, the reverberation can be increased, the volume of the first part side screen sound unit farther away from the user can be increased, so that the user can listen to the sound of the first part side sound unit and the second part side sound unit at the same time. That is, the situation that the user cannot hear the sound of the first part side sound unit due to the too large volume of the second part side sound unit closer to the user can be avoided. Figure 10D When the angle a between the B shell and the C shell of the electronic device is in the angle range 93, the electronic device can adjust the loudness of the audio data of each sound unit based on the angle a, for example, reduce the volume of the first part side sound unit, or reduce the volume of the first part side sound unit and increase the volume of the second part side sound unit. Here, the volume of the first part side sound unit of the electronic device playing the audio data is less than the specified volume value 90. In this way, the high frequency energy enhancement caused by the table reflection between the screen part and the table can be reduced, and the sharpness of the sound can be reduced. For another example, the volume of the first part side sound unit is increased, or the volume of the first part side sound unit is increased and the volume of the second part side sound unit is reduced. Here, the volume of the first part side sound unit of the electronic device playing the audio data is greater than the specified volume value 90. In this way, the table reflection between the screen part and the table can be enhanced, the reverberation can be increased, the volume of the first part side screen sound unit farther away from the user can be increased, so that the user can listen to the sound of the first part side sound unit and the second part side sound unit at the same time. That is, the situation that the user cannot hear the sound of the first part side sound unit due to the too large volume of the second part side sound unit closer to the user can be avoided.

[0336] Optionally, due to the coincidence of the A shell and the D shell, in order to reduce the vibration of the A shell causing the vibration of the electronic device, the electronic device can not play the data of the low frequency channel through the first part side sound unit.

[0337] The maximum value of the angle range 91 is less than or equal to the minimum value of the angle range 93. The minimum value of the angle range 91 is greater than or equal to the maximum value of the angle range 92, and the minimum value of the angle range 94 is greater than or equal to the maximum value of the angle range 93. For example, the angle range 92 is 0 degrees to 45 degrees, the angle range 91 is 45 degrees to 135 degrees, the angle range 93 is 135 degrees to 190 degrees, and the angle range 94 is 190 degrees to 360 degrees.

[0338] In some embodiments, when the first partial side sound unit of the electronic device is disposed in the A shell, the electronic device can only provide a low-frequency enhancement mode, or set the initial sound effect mode of the electronic device to the low-frequency enhancement mode. Wherein, the initial sound effect mode is the sound effect mode of the electronic device after the electronic device is powered on. In this way, the electronic device can play low-frequency signals using the first partial side sound unit, enhancing the low-frequency atmosphere. Moreover, the first partial side sound unit is responsible for playing low-frequency signals, which can avoid the problem of keyboard noise caused by the second partial side sound unit playing low-frequency signals.

[0339] In a possible implementation, the electronic device includes a plurality of first partial side sound units, part of the first partial side sound units are disposed in the A shell of the electronic device, and the other part of the first partial side sound units are disposed in the B shell of the electronic device. Wherein, the electronic device can achieve different playing effects when the angle between the B shell and the C shell of the electronic device is different, and the specific description can be referred to Figures 7-10D the description of the embodiments shown in the description, which will not be repeated here. Similarly, the description of adjusting the loudness of the first partial side sound unit located in the A shell and adjusting the loudness of the first partial side sound unit in the B shell of the electronic device based on the angle between the B shell and the C shell of the electronic device can also be referred to Figures 7-10D the description of the embodiments shown in the description, which will not be repeated here.

[0340] In some embodiments, when the sound effect mode of the electronic device is a surround enhancement mode, the electronic device can use the first partial side sound unit located in the B shell to play data of left and right surround channels, use the first partial side sound unit located in the A shell to play data of other channels, or control the first partial side sound unit located in the A shell not to play audio data.

[0341] In some embodiments, when the sound effect mode of the electronic device is a low-frequency enhancement mode, the electronic device can use the first partial side sound unit located in the A shell to play data of low-frequency channels, use the first partial side sound unit located in the B shell to play data of other channels, or control the first partial side sound unit located in the B shell not to play audio data.

[0342] In a possible implementation, the electronic device can adjust the channels played by each sound unit based on the angle between the B shell and the C shell of the electronic device.

[0343] For example, when the electronic device is a folding screen device, the description of the first partial side sound unit of the electronic device located in the A shell or the B shell can be referred to Figures 7-10D the description of the embodiments shown in the description, which will not be repeated here.

[0344] For another example, when the electronic device is a folding screen device, and the folding mode of the electronic device is left-right folding, if the electronic device is in a folded state, such as Figure 11AAs shown, the electronic device includes sound emitting unit 1001, sound emitting unit 1002, sound emitting unit 1003 and sound emitting unit 1004. Among them, sound emitting unit 1003 and sound emitting unit 1004 are located in the second part, which is blocked by the first part, so Figure 11A Sound emitting unit 1003 and sound emitting unit 1004 are not shown in the middle. Sound emitting unit 1001 and sound emitting unit 1002 are located in the first part of the electronic device.

[0345] Among them, sound emitting unit 1002 and sound emitting unit 1004 are located at the top of the electronic device, and sound emitting unit 1001 and sound emitting unit 1003 are located at the bottom of the electronic device. The sound emitting unit located at the top of the electronic device can be used to play sky sound, and the sound emitting unit located at the bottom of the electronic device can be used to play ground sound. It should be noted that all sound emitting units of the electronic device can play left and right channel data, and / or left and right surround channel data, and / or center channel data, and / or low frequency channel data.

[0346] In some examples, when the electronic device plays a video, the sound emitting unit located at the top of the electronic device can be used to play the sound of the object in the video picture that is closer to the sound emitting unit at the top, and the sound emitting unit located at the bottom of the electronic device can be used to play the sound of the object in the video picture that is closer to the sound emitting unit at the bottom.

[0347] When the electronic device is in a horizontal screen state (i.e., the sound emitting unit at the top of the electronic device is rotated to Figure 11A The left side of the electronic device display picture), the sound emitting unit located on the left side of the electronic device display picture can be used to play left channel data, and the sound emitting unit located on the right side of the electronic device display picture can be used to play right channel data, and / or the sound emitting unit located on the left side of the electronic device display picture can be used to play left surround channel data, and the sound emitting unit located on the right side of the electronic device display picture can be used to play right surround channel data.

[0348] If the electronic device is in a half-folded state, as Figure 11B As shown, the electronic device can play the sound of the object in the video picture that is farther away from the display screen through the second part side sound emitting unit, and play the sound of the object in the video picture that is closer to the display screen through the first part side sound emitting unit. In some examples, the description of each sound emitting unit of the electronic device in a half-folded state playing audio can refer to Figure 4 And Figure 5 The embodiments shown in the foregoing description, which will not be repeated here.

[0349] If the electronic device is in an unfolded state, as Figure 11C As shown, the electronic device can play the sound of the object in the video picture that is farther away from the display screen through the second part side sound emitting unit, and play the sound of the object in the video picture that is closer to the display screen through the first part side sound emitting unit. In some examples, the description of each sound emitting unit of the electronic device in a half-folded state playing audio can refer to Figure 11CThe sound unit 1002 shown plays data of a left sound channel with the sound unit 1001, and the electronic device can play data of a right sound channel with the sound unit located on the right side, for example Figure 11C The sound unit 1003 shown plays data of a right sound channel with the sound unit 1004, and / or plays data of a left surround sound channel with the sound unit located on the left side and plays data of a right surround sound channel with the sound unit located on the right side. Optionally, the sound unit of the electronic device can also play data of a low frequency sound channel or a center sound channel. It should be noted that when the angle of the electronic device changes, for example, the central axis of the electronic device rotates from Figure 11C up and down to left and right, the sound unit located on the left side of the electronic device and the sound unit located on the right side play data of Figure 11C different sound channels.

[0350] It should be noted that Figures 11A-11C The folding screen device shown includes a folding screen folded outwardly, when the folding screen device includes a folding screen folded inwardly, the A shell or the D shell of the electronic device also includes a display screen, and the description of the sound units playing audio data when the electronic device is in the unfolded state and the half-folded state can be referred to Figures 11A-11C the embodiments shown, which will not be repeated here. When the electronic device is in the folded state, the B shell or the C shell in Figure 11A can be regarded as the A shell or the D shell of the electronic device, and the description of the sound units playing audio data in Figure 11A can be referred to.

[0351] For another example, when the electronic device is a folding screen device and the folding manner of the electronic device is up and down folding, if the electronic device is in the unfolded state, as shown in Figure 12A , the electronic device includes a sound unit 1051 and a sound unit 1052. Among them, the sound unit 1051 is located on the first part, and the sound unit 1052 is located on the second part of the electronic device.

[0352] Among them, the sound unit 1051 is located on the top of the electronic device, and the sound unit 1052 is located on the bottom of the electronic device. The sound unit located on the top of the electronic device can be used to play sky sound, and the sound unit located on the bottom of the electronic device can be used to play ground sound. It should be noted that all sound units of the electronic device can play data of left and right sound channels, and / or data of left and right surround sound channels, and / or data of a center sound channel, and / or data of a low frequency sound channel.

[0353] In some examples, when the electronic device plays a video, the sound unit located on the top of the electronic device can be used to play the sound of the object in the video picture closer to the sound unit on the top, and the sound unit located on the bottom of the electronic device can be used to play the sound of the object in the video picture closer to the sound unit on the bottom.

[0354] When the electronic device is in a landscape state (i.e., the sound emitting units at the top of the electronic device are rotated to the left side or the right side as shown) Figure 12A When the electronic device is in a landscape state (i.e., the sound emitting units at the top of the electronic device are rotated to the left side or the right side as shown)

[0355] When the electronic device is in a half-folded state, the electronic device can play the sound of the object far from the display screen in the video picture through the second part side sound emitting unit and play the sound of the object close to the display screen in the video picture through the first part side sound emitting unit, as shown in Figure 12B Figure 4 Figure 5

[0356] When the electronic device is in a folded state, the electronic device can play the sound source data through the sound emitting units, as shown in Figure 12C

[0357] In a possible implementation, the first part side sound emitting units of the electronic device are arranged at the connection between the A shell and the B shell (which can be understood as being arranged at the side of the screen part). In this way, the first part side sound emitting units can improve the surround sense in different directions through the first part side sound emitting units.

[0358] As an example, as shown in Figure 13 The electronic device includes one or more first part side sound emitting units, which include the first part side sound emitting unit 1101, the first part side sound emitting unit 1102, and the first part side sound emitting unit 1103. The first part side sound emitting unit 1101 is located at the left side of the screen part, and the beam direction of the sound wave of the first part side sound emitting unit 1101 is directed from the center of the display screen to the left side of the display screen. The first part side sound emitting unit 1102 is located at the right side of the screen part, and the beam direction of the sound wave of the first part side sound emitting unit 1102 is directed from the center of the display screen to the right side of the display screen. The first part side sound emitting unit 1103 is located at the upper side of the screen part, and the beam direction of the sound wave of the first part side sound emitting unit 1103 is directed from the center of the display screen to the upper side of the display screen. In some examples, the first part side sound emitting unit 11003 can be used to play sky sound. For details, please refer to the above embodiments, which will not be described here. ​​​​

[0359] In a possible implementation, the electronic device can identify a specified object in a video frame when playing the video, and identify audio data of the specified object in audio source data of the video. The electronic device can play the audio data of the specified object using one or more sound-emitting units closest to the specified object based on a position of the specified object on the display screen. In this way, the electronic device can play the audio data of the specified object according to a motion track of the specified object in the video frame, achieve a playing effect of sound changing with the specified object, and bring the user an audio-visual experience of the specified object emitting sound, thereby enhancing video immersion.

[0360] The electronic device can identify all sounds of the specified object in the audio source data through a sound feature of the specified object. The electronic device can also identify the specified object in the video frame and the audio data of the specified object in real time.

[0361] In some examples, the specified object is a vehicle, for example, an airplane, a train, a car, a ship, or the like. The electronic device can play the audio data of the specified object through the first partial side sound-emitting unit 1101, the first partial side sound-emitting unit 1103, and the first partial side sound-emitting unit 1102 in sequence when the specified object moves from the left side of the video frame to the right side of the video frame. For example, when an airplane in the video takes off, the airplane moves from the lower left corner of the video frame to the upper left corner of the video frame, the electronic device can play the sound of the airplane through the first partial side sound-emitting unit 1101 when the airplane is located at the lower left corner of the video frame, and play the sound of the airplane through the first partial side sound-emitting unit 1103 when the airplane is located at the middle of the video frame. The electronic device can play the sound of the airplane through the first partial side sound-emitting unit 1102 and the first partial side sound-emitting unit 1103 when the airplane is located at the upper right corner of the video frame. In this way, the process of the airplane taking off can be reflected from the sound.

[0362] It should be noted that the specified object is not limited to a vehicle, but can also be a certain role, a certain object, or the like in the video, which is not limited in the embodiments of the present application.

[0363] Optionally, the first portion side sound unit and the second portion side sound unit of the electronic device can jointly implement the playing operation of the audio data of the specified object. For example, when the movement track of the specified object in the video picture is from bottom to top, when the specified object is at the bottommost, the electronic device can use the second portion side sound unit to play the audio data of the specified object. When the specified object moves upwards, the electronic device can use the first portion side sound unit to play the audio data of the specified object. For another example, when the movement track of the specified object in the video picture is from far to near, when the specified object is at the farthest, the electronic device can use the first portion side sound unit to play the audio data of the specified object. When the specified object moves towards the near, the electronic device can use the second portion side sound unit to play the audio data of the specified object. In some examples, the movement of the specified object from far to near on the video picture can be embodied as the gradual increase of the volume of the specified object. In this way, when the specified object moves upwards and downwards, the relative positions of the first portion side sound unit and the second portion side sound unit can better embody the movement of the specified object in the up-down direction, because the first portion side sound unit is located above the second portion side sound unit. When the specified object moves from far to near, the relative positions of the first portion side sound unit and the second portion side sound unit can better embody the far-near relationship of the specified object, because the first portion side sound unit is farther away from the user than the second portion side sound unit.

[0364] It should be noted that when the sound unit is playing the audio data of the specified object, the electronic device can pause playing the audio data of the sound unit based on the first mode and the sound source data, or the sound unit can simultaneously play the audio data of the specified object and the audio data of the sound unit based on the first mode and the sound source data.

[0365] In a possible implementation, the electronic device includes one or more sound units, and the one or more sound units include one or more first portion side sound units. A part of the one or more first portion side sound units is located in the A shell, a part of the one or more first portion side sound units is located in the B shell, and a part of the one or more first portion side sound units is located at the connection between the A shell and the B shell. The first portion side sound unit located in the A shell can be used to play the data of the low-frequency channel, the first portion side sound unit located in the B shell can be used to play the data of the left surround channel and the right surround channel, and the first portion side sound unit located at the connection between the A shell and the B shell can be divided into a top sound unit and a bottom sound unit. The position of the top sound unit in the first portion is higher than the position of the bottom sound unit in the first portion, the top sound unit can be used to play the audio data of the specified sky object, and the bottom sound unit can be used to play the audio data of the specified ground object.

[0366] The following describes the hardware structure diagram of the electronic device provided in the embodiments of this application.

[0367] The electronic device can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, as well as cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, mixed reality (MR) device, artificial intelligence (AI) device, wearable device, in-vehicle device, smart home device and / or smart city device. The embodiments of this application do not impose any special restrictions on the specific type of the electronic device.

[0368] Optionally, in some embodiments of this application, the electronic device may be a desktop computer, a laptop computer, a handheld computer, a notebook computer, or a tablet computer connected to a keyboard.

[0369] like Figure 14 As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, and a display screen 194, etc. The sensor module 180 may include, but is not limited to, a pressure sensor 180A, a fingerprint sensor 180B, a temperature sensor 180C, a touch sensor 180D, an ambient light sensor 180E, etc.

[0370] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0371] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0372] The controller can generate operation control signals according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions.

[0373] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or are used repeatedly by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0374] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0375] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. In some embodiments, the processor 110 can contain multiple sets of I2S bus. The processor 110 can be coupled with the audio module 170 through the I2S bus, realizing the communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface, realizing the function of answering the phone through the Bluetooth earphone.

[0376] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled through the PCM bus interface. In some embodiments, the audio module 170 can also deliver audio signals to the wireless communication module 160 through the PCM interface, realizing the function of answering the phone through the Bluetooth earphone. Both the I2S interface and the PCM interface can be used for audio communication.

[0377] The UART interface is a universal serial data bus, used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface, realizing the Bluetooth function. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the UART interface, realizing the function of playing music through the Bluetooth earphone.

[0378] The MIPI interface can be used to connect the processor 110 and the display screen 194, camera 193 and other peripheral devices. The MIPI interface includes camera serial interface (CSI), display serial interface (DSI) and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface, realizing the shooting function of the electronic device. The processor 110 and the display screen 194 communicate through the DSI interface, realizing the display function of the electronic device.

[0379] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

[0380] The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device, and can also be used to transmit data between the electronic device and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0381] It can be understood that the interface connection relationship between the modules shown in the embodiments is only illustrative and does not limit the structure of the electronic device. In other embodiments of the present application, the electronic device can also use different interface connection methods or combinations of multiple interface connection methods.

[0382] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the electronic device. The charging management module 140 can charge the battery 142 while also providing power to the electronic device through the power management module 141.

[0383] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0384] The wireless communication function of the electronic device can be realized through an antenna, a wireless communication module 160, a modem processor, and a baseband processor, etc.

[0385] Antennas are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas.

[0386] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is transmitted to the application processor after being processed by the baseband processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a microphone 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110 and be disposed in the same device as the mobile communication module 150 or other functional modules.

[0387] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to electronic devices. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, modulate them, amplify them, and radiate them as electromagnetic waves via an antenna.

[0388] The electronic device implements display functions through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0389] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include one or N displays 194, where N is a positive integer greater than 1.

[0390] Electronic devices can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0391] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0392] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device may include one or N cameras 193, where N is a positive integer greater than 1.

[0393] A digital signal processor is used to process digital signals, which can process not only digital image signals but also other digital signals. For example, when the electronic device selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0394] A video codec is used to compress or decompress digital video. The electronic device can support one or more video codecs. In this way, the electronic device can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0395] An NPU is a neural-network (NN) computing processor, which can quickly process input information by learning from the structure of a biological neural network, such as the transmission mode between human brain neurons, and can also continuously self-learn. Through the NPU, the electronic device can realize intelligent cognition applications, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0396] The external memory interface 120 can be used to connect an external non-volatile memory to expand the storage capacity of the electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, files such as music and videos are saved in the external non-volatile memory.

[0397] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various function applications and data processing of the electronic device by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0398] The electronic device can realize audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, an application processor, etc. For example, music playing, recording, etc.

[0399] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functions of the audio module 170 can be disposed in the processor 110.

[0400] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device can listen to music or listen to a hands-free call through the speaker 170A. In the embodiments of the present application, the speaker 170A can play audio data.

[0401] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device receives a call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.

[0402] The microphone 170C, also referred to as a "microphone", "sound transducer", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak into the microphone 170C by holding the mouth close to the microphone 170C, and the sound signal is input into the microphone 170C. The electronic device can be provided with at least one microphone 170C. In other embodiments, the electronic device can be provided with two microphones 170C, in addition to collecting sound signals, noise reduction functions can also be achieved. In other embodiments, the electronic device can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, and can also identify the source of the sound, and realize the function of directional recording, etc.

[0403] The earphone interface 170D is configured to connect a wired earphone.

[0404] The pressure sensor 180A is configured to sense a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed in the display screen 194. The fingerprint sensor 180B is configured to collect a fingerprint. The temperature sensor 180C is configured to detect temperature. The touch sensor 180D, also referred to as a "touch device". The touch sensor 180D can be disposed in the display screen 194, and the touch sensor 180D and the display screen 194 form a touch screen, also referred to as a "touch screen". The touch sensor 180D is configured to detect a touch operation acting on or near the touch sensor 180D. The ambient light sensor 180E is configured to sense ambient light brightness.

[0405] The keys 190 include a power key, a keyboard, a touchpad, etc. The keys 190 can be mechanical keys. They can also be touch keys.

[0406] The above-described embodiments are only used to illustrate the technical solutions of the present application, but not limit the present application; although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An audio playback method, characterized by, The method is applied to an electronic device, the electronic device comprising a first part and a second part, the first part and the second part rotating or unfolding around a central axis of the electronic device; the first part comprising one or more first sound emitting units, and the second part comprising one or more second sound emitting units; the method comprising: The sound effect mode of the electronic device is a first mode, and the electronic device receives a first input of playing a first audio; The electronic device controls the one or more first sound emitting units to play first audio data and controls the one or more second sound emitting units to play second audio data in response to the first input, the first audio data and the second audio data each comprising at least part of content of sound source data of the first audio; The electronic device receives a second input; The electronic device switches the sound effect mode of the electronic device from the first mode to a second mode in response to the second input; The electronic device receives a third input of playing the first audio; The electronic device controls the one or more first sound emitting units to play third audio data and controls the one or more second sound emitting units to play fourth audio data in response to the third input, the third audio data and the fourth audio data each comprising at least part of content of sound source data of the first audio, and the first audio data being different from the third audio data.

2. The method of claim 1, wherein, The sound channels included in the first audio data are partially / entirely different from the sound channels included in the third audio data.

3. The method of claim 2, wherein, The method further comprises: When the first mode is any one of a low frequency enhancement mode, a dialogue enhancement mode, and a surround enhancement mode, at least part of the sound channels included in the first audio data are different from at least part of the sound channels included in the second audio data; and / or, When the first mode is a loudness enhancement mode, at least part of the sound channels of the first audio data are the same as at least part of the sound channels of the second audio data.

4. The method of claim 1, wherein, The electronic device comprises one or more sound effect modes, the one or more sound effect modes comprising the first mode and the second mode; before the electronic device receives the second input, the method further comprises: The electronic device displays one or more sound effect mode options, the one or more sound effect mode options corresponding one-to-one to the one or more sound effect modes, the one or more sound effect mode options comprising a first mode option and a second mode option, the first mode option corresponding to the first mode, and the second mode option corresponding to the second mode, the first mode option being marked; wherein the second input is an input directed to the second mode option; The response to the second input sets the sound effect mode of the electronic device to the second mode specifically comprises: The electronic device switches the sound effect mode of the electronic device from the first mode to the second mode in response to the second input, and unmarks the first mode option and marks the second mode option.

5. The method of claim 4, wherein, The first mode option is a low frequency enhancement mode option, the first mode is a low frequency enhancement mode, the first audio data comprises data of a low frequency channel, and the second audio data comprises data of a left channel and a right channel, data of a left surround channel and a right surround channel, and / or data of a center channel.

6. The method of claim 4, wherein, The first mode option is a dialogue enhancement mode option, the first mode is a dialogue enhancement mode, the first audio data comprises data of a center channel, and the second audio data comprises data of a left channel and a right channel, data of a left surround channel and a right surround channel, and / or data of a low frequency channel.

7. The method of claim 4, wherein, The first mode option is a loudness enhancement mode option, the first mode is a loudness enhancement mode, the first audio data comprises data of a left channel and a right channel, and the second audio data comprises data of a left channel and a right channel.

8. The method of claim 7, wherein, When the electronic device comprises one first sound unit, the electronic device plays the data of a left channel and the data of a right channel of the first audio data using the one first sound unit; or, When the electronic device comprises two first sound units, the electronic device plays the data of the left channel using one first sound unit and plays the data of the right channel using the other first sound unit; or, When the electronic device comprises three or more first sound units, the electronic device plays the data of the left channel using at least one first sound unit, plays the data of the right channel using at least one first sound unit, and plays the data of the left channel and the data of the right channel of the second audio data using at least one first sound unit.

9. The method of claim 4, wherein, The first mode option is a surround enhancement mode, the first mode is a surround enhancement mode, the first audio data comprises data of a left surround channel and a right surround channel, and the second audio data comprises data of a left channel and a right channel, data of a center channel, and / or data of a low frequency channel.

10. The method of claim 4, wherein, When the electronic device displays one or more sound effect mode options, the method further comprises: The electronic device displays a sliding bar; When the first mode option is a loudness enhancement mode option, a low frequency enhancement mode option, or a dialogue enhancement mode option, the value of the sliding bar is a first value, the electronic device plays the first audio data at a third volume, the value of the sliding bar is a second value, the electronic device plays the first audio data at a fourth volume, the first value is less than the second value, and the third volume is lower than the fourth volume; When the first mode option is a surround mode option, the value of the sliding bar is a third value, the electronic device plays the first audio data to simulate a third distance between a sound source and a user, the value of the sliding bar is a fourth value, the electronic device plays the first audio data to simulate a fourth distance between a sound source and a user, the third value is less than the fourth value, and the third distance is less than the fourth distance.

11. The method of claim 1, wherein, The method further comprises: The electronic device receives a fourth input to play a first video; The electronic device identifies one or more objects in a video frame of the first video and identifies audio data of the one or more objects in an audio file of the first video in response to the fourth input, the one or more objects including a first object; The electronic device plays the audio data of the first object using a sound emitting unit closest to the first object among the one or more first sound emitting units and / or the one or more second sound emitting units.

12. The method of claim 1, wherein, The first sound emitting unit located at the first position is configured to play sky sound; and / or, The first sound emitting unit located at the second position is configured to play ground sound, the distance between the first position and the central axis being greater than the distance between the second position and the central axis; and / or, The first sound emitting unit located at the third position is configured to play left channel data, and the first sound emitting unit located at the fourth position is configured to play right channel data, the third position being located on the left side of the first part, and the fourth position being located on the right side of the first part; and / or, The first sound emitting unit located at the fifth position is configured to play left surround channel data, and the first sound emitting unit located at the sixth position is configured to play right surround channel data, the fifth position being located on the left side of the first part, and the sixth position being located on the right side of the first part.

13. The method according to any one of claims 1-12, characterized in that, The electronic device is a notebook computer, the first part includes a display screen of the electronic device, and the second part includes a keyboard and / or a touchpad of the electronic device.

14. The method of claim 13, wherein, The first part of the electronic device includes a first shell and a second shell, the first shell includes a display screen of the electronic device; the first mode is a surround enhancement mode, and the first sound emitting unit located at the first shell is configured to drive the first shell to play the first audio data; or, The first mode is a low frequency enhancement mode, and the first sound emitting unit located at the second shell is configured to drive the second shell to play the first audio data.

15. The method of any one of claims 1-12, wherein, The electronic device is a folding screen device, the first part includes a first screen, the second part includes a second screen, the folding manner of the electronic device is left-right folding, and the electronic device includes a folded state and an unfolded state; If the electronic device is in the folded state, the sound emitting units located on the first side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are configured to play left channel data, and the sound emitting units located on the second side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are configured to play right channel data; or, the sound emitting units located on the first side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are configured to play sky sound, and the sound emitting units located on the second side of the electronic device among the one or more first sound emitting units and the one or more second sound emitting units are configured to play ground sound, the first side being different from the second side. If the electronic device is in the unfolded state, the one or more first sound emitting units are configured to play data of a left sound channel, and the one or more second sound emitting units are configured to play data of a right sound channel, or the one or more first sound emitting units are configured to play data of a left surround sound channel, and the one or more second sound emitting units are configured to play data of a right surround sound channel.

16. The method of any one of claims 1-12, wherein, The electronic device is a foldable screen device, the first part includes a first screen, the second part includes a second screen, the electronic device is folded in an up-down manner, and the electronic device includes a folded state and an unfolded state. If the electronic device is in the folded state, the one or more first sound emitting units and the one or more second sound emitting units play the sound source data. If the electronic device is in the unfolded state, the one or more first sound emitting units are configured to play data of a left sound channel, and the one or more second sound emitting units are configured to play data of a right sound channel, or the one or more first sound emitting units are configured to play data of a left surround sound channel, and the one or more second sound emitting units are configured to play data of a right surround sound channel.

17. The method of claim 12, wherein, The sky sound includes one or more of thunder, the sound of a flying object, and wind, and the ground sound includes one or more of footsteps, insect chirping, and rain.

18. The method of claim 1, wherein, The sound source data includes data of sound channels required by the first audio data in the first mode, and the number of sound channels in the sound source data other than the sound channels of the first audio data is a first number; the method further includes: If the first number is less than the number of second sound emitting units, the electronic device upmixes the sound source data or duplicates data of sound channels other than the first audio data in the sound source data to obtain fifth audio data; wherein the fifth audio data includes data of sound channels required by the first audio data, and the number of sound channels in the fifth audio data other than the sound channels of the first audio data is the same as the number of second sound emitting units, and the second audio data includes data of sound channels other than the sound channels of the first audio data in the fifth audio data; If the first number is greater than the number of second sound emitting units, the electronic device downmixes the sound source data or superimposes data of part of the sound channels in the sound source data to obtain sixth audio data; wherein the sixth audio data includes data of sound channels required by the first audio data, and the number of sound channels in the sixth audio data other than the sound channels of the first audio data is the same as the number of second sound emitting units, and the second audio data includes data of sound channels other than the sound channels of the first audio data in the sixth audio data.

19. An electronic device, comprising: including: One or more processors, one or more first sound emitting units, one or more second sound emitting units, and one or more memories; wherein the one or more memories, the one or more first sound emitting units, the one or more second sound emitting units are coupled with the one or more processors respectively, the one or more memories are configured to store computer program codes, the computer program codes comprise computer instructions, when the one or more processors execute the computer instructions, the electronic device is caused to perform the method in any one of claims 1-18.

20. A computer-readable storage medium, characterized in that, Computer instructions are included, when the computer instructions run on an electronic device, the electronic device is caused to perform the method in any one of claims 1-18.

21. A chip system, characterized by The chip system is applied to an electronic device, and the chip system comprises one or more processors configured to invoke computer instructions, so that the electronic device performs the method in any one of claims 1-18.

Images