Audio and video processing method of folding screen equipment and related device

Abstract

The embodiment of the invention discloses an audio and video processing method of folding screen equipment and a related device, and the method comprises the steps: in a semi-folding state, electronic equipment displays first content on a first screen, outputs the audio of the first content through first audio output equipment, and displays second content on a second screen, the first audio output device is a first directional sound production unit or a first earphone, the second audio output device is a second directional sound production unit or a second earphone, the first directional sound production unit is used for directionally producing sound in a first direction, and the second directional sound production unit is used for directionally producing sound in a second direction. The second directional sound production unit is used for directionally producing sound in a second direction, the first direction is the direction towards which the light-emitting surface of the first screen faces, and the second direction is the direction towards which the light-emitting surface of the second screen faces. In this way, a plurality of users can watch the content at the same time without interfering with each other, and the user interaction experience is higher.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to an audio and video processing method and related apparatus for a folding screen device. Background Art

[0002] With the continuous development of electronic device technology, electronic devices with foldable screens (such as foldable screen mobile phones) are becoming more and more widely used in people's daily life and work.

[0003] Electronic devices with foldable screens usually have fully folded, semi-folded and fully unfolded forms, and when the foldable screen is in the fully folded and semi-folded forms, the foldable screen can be folded into at least two screens. At present, when the foldable screen is in the unfolded state, due to factors such as the large screen size, the foldable screen can give users a good content viewing experience. However, when the foldable screen is in the fully folded and semi-folded forms, the foldable screen can usually only display content on one of the at least two screens formed by the folding, and cannot give users a better interactive experience. Summary of the invention

[0004] The embodiments of the present application provide an audio and video processing method and related apparatus for a folding screen device, which can solve the problem of poor user interaction experience in audio and video scenarios of existing folding screens.

[0005] In the first aspect, an embodiment of the present application provides an audio and video processing method for a folding screen device, which is applied to an electronic device including a folding screen, where the folding screen can be folded into at least two screens, and the at least two screens include a first screen and a second screen. In the audio and video processing method for the folding screen device, when the folding screen is in a semi-folded state, the electronic device displays a first content on the first screen and outputs the audio of the first content through a first audio output device, and displays a second content on the second screen and outputs the audio of the second content through a second audio output device.

[0006] Among them, the first audio output device is a first directional sound unit or a first earphone, and the second audio output device is a second directional sound unit or a second earphone; the first directional sound unit is used to direct sound in a first direction, and the second directional sound unit is used to direct sound in a second direction, the first direction is the direction in which the light emitting surface of the first screen is facing, and the second direction is the direction in which the light emitting surface of the second screen is facing.

[0007] As can be seen from the above, in the embodiment of the present application, when the folding screen is in a semi-folded state, content is displayed on the first screen and the second screen respectively, that is, at least two screens formed by folding display content simultaneously, so that the first user can watch the content displayed on the first screen while the second user can also watch the video content displayed on the second screen, which meets the needs of multiple users to watch content at the same time and improves the user interaction experience; in addition, the audio of the first screen is output by the first audio output device, and the audio of the second screen is output by the second audio output device, so that the audio of the first screen and the second screen do not affect each other, thereby allowing the first user and the second user to watch the content at the same time without disturbing each other, etc., while satisfying the need for multiple people to watch content, the user audio interaction experience is improved.

[0008] Specifically, when the first audio output device and the second audio output device are both directional sound-emitting units, since the first direction is the direction in which the light-emitting surface of the first screen faces, and the second direction is the direction in which the light-emitting surface of the second screen faces, the two sound-emitting directions are different, so the audio of the first content and the second content do not interfere with each other; when the first audio output device and the second audio output device are both headphones, since the headphones are worn by the first user and the second user respectively, when the audio is output through the headphones, the audio of the first content and the second content do not interfere with each other. The first user may refer to the user of the first screen, and the second user may refer to the user of the second screen; when one of the first audio output device and the second audio output device is a headphone and the other is a directional sound-emitting unit, since the sound-emitting direction of the directional sound-emitting unit is the direction in which the light-emitting surface of the screen faces, the directional sound will not cause audio interference to the other user wearing the headphones, that is, the audio of the first content and the second content do not interfere with each other. That is, the first user and the second user can watch the content without audio interference.

[0009] For example, when a user takes a child out to play, the user can conduct a video conference call on the first screen and play cartoons, movies or TV series on the second screen. In addition, the first screen uses a directional audio playback method, and the second screen uses a headphone audio playback method. In this way, the user and the child can conduct a video conference and watch a video at the same time without interfering with each other, thereby improving the user interaction experience of the folding screen in audio and video scenarios.

[0010] In a possible implementation of the first aspect, in addition to outputting audio through the first audio output device and the second audio output device, the electronic device can also pick up the voice of the first user through the first sound pickup device and / or pick up the voice of the second user through the second sound pickup device; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone. In this way, not only can the audio of the first content and the second content be output without interfering with each other, but also when picking up sound, through directional sound pickup or earphone sound pickup, the interference of other users on the sound pickup can be minimized, that is, in the scenario where multiple people are watching content, the interference of other users is further reduced, thereby further improving the user interaction experience of the folding screen in the scenario where multiple people are watching content.

[0011] In a possible implementation manner of the first aspect, the first content is a first video content and / or the second content is a second video content.

[0012] In a possible implementation manner of the first aspect, the electronic device being in a semi-folded state means that the electronic device is in a tent mode.

[0013] In a possible implementation manner of the first aspect, the first audio output device is a first directional sound-emitting unit or a first earphone, and the second audio output device is a second directional sound-emitting unit or a second earphone; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone.

[0014] Exemplarily, the sound emission mode and sound pickup mode of the first screen are directional sound emission and directional sound pickup, respectively, while the sound emission mode and sound pickup mode of the second screen are headphone playback and headphone collection. The headphone can be a wired or wireless headphone, the wireless headphone can be, for example, a Bluetooth headphone, the directional sound emission unit can be, for example, a directional speaker or screen, and the directional sound pickup unit can be, for example, a directional sound pickup microphone.

[0015] In a possible implementation of the first aspect, when outputting audio, the electronic device may output the audio of the first content through the first audio output device according to the audio setting information of the first screen, and output the audio of the second content through the second audio output device according to the audio setting information of the second screen. That is, the audio output settings of the first screen and the second screen may be set in advance, and the audio output may be performed according to the audio output settings.

[0016] In a possible implementation manner of the first aspect, outputting audio of first content through a first audio output device, picking up a voice of a first user through a first sound pickup device, outputting audio of second content through a second audio output device, and picking up a voice of a second user through a second sound pickup device include:

[0017] If it is determined according to the audio setting information of the first screen that the sound emission mode of the first screen is directional sound emission and the sound pickup mode of the first screen is directional sound pickup, the sound emission direction is determined, the first directional sound emission unit is controlled to output the audio of the first content in the sound emission direction, the sound source direction of the first user's voice is determined, and the first directional sound pickup unit is controlled to collect the sound data to be processed, enhance the target sound signal in the sound source direction of the sound data to be processed, and remove or suppress the sound signal in the non-sound source direction; if it is determined according to the audio setting information of the second screen that the sound emission mode and the sound pickup mode of the second screen are headphones, the audio of the second content is output and the voice of the second user is picked up through the second headphones; wherein the first audio output device is the first directional sound emission unit, the first sound pickup device is the first directional sound pickup unit, and the second audio output device and the second sound pickup device are the second headphones.

[0018] In a possible implementation of the first aspect, the electronic device may further display a setting interface, the setting interface including an audio setting option of the first screen and an audio setting option of the second screen; in response to a setting operation, the audio output mode and / or sound pickup mode of the first screen is set, and the audio output mode and / or sound pickup mode of the second screen is set, and the audio setting information of the first screen and the audio setting information of the second screen are obtained, and the setting operation is an operation for the audio setting option of the first screen and the audio setting option of the second screen. In this way, the user can set the sound emission mode and / or sound pickup mode of each screen as needed, thereby improving the user experience.

[0019] Among them, the setting interface is an interface displayed when the electronic device is in an unfolded form, or an interface displayed on at least one of the first screen and the second screen when the electronic device is in a semi-folded form or a fully folded form, that is, when the electronic device displays the setting interface, the folding screen can be in an unfolded form, at which time the setting interface can be displayed in full screen, and the folding screen can also be in a semi-folded form or a fully folded form, at which time the setting interface can be displayed on one screen.

[0020] In a possible implementation of the first aspect, after the first content is displayed on the first screen and the second content is displayed on the second screen, the electronic device can also respond to the first operation to display the audio setting options of the target screen on the first screen, and in response to the operation on the audio setting options of the target screen, adjust the audio output mode and / or sound pickup mode of the target screen, where the first operation is an operation for calling up the audio setting options of the target screen, and the target screen is at least one of the first screen and the second screen.

[0021] And / or, in response to the second operation, the audio setting options of the target screen are displayed on the second screen, and in response to the operation on the audio setting options of the target screen, the audio output mode and / or sound pickup mode of the target screen are adjusted, and the second operation is an operation for calling the audio setting options of the target screen. That is, the user can adjust the audio output mode and / or sound pickup mode of the current screen through the audio setting options displayed on the first screen and the second screen respectively; can adjust the audio output mode and / or sound pickup mode of another screen through the audio setting options displayed on one screen; can also adjust the audio output mode and / or sound pickup mode of both screens through the audio setting options displayed on one screen.

[0022] In this way, users can quickly and easily adjust the audio setting options of the first and second screens.

[0023] In a possible implementation of the first aspect, before the first content is displayed on the first screen and the second content is displayed on the second screen, the electronic device can also, when the folding screen is in the unfolded form, respond to a split-screen operation and display a first interface in the first screen area of ​​the folding screen and a second interface in the second screen area of ​​the folding screen, wherein the first interface and the second interface are interfaces of different applications or different interfaces of the same application.

[0024] After the split screen operation, the electronic device can also respond to the play operation to display the first content on the first interface and the second content on the second interface. If the folding screen is converted from the unfolded state to the semi-folded state, the following steps are performed: the first content is displayed on the first screen, and the audio of the first content is output through the first audio output device, and the second content is displayed on the second screen, and the audio of the second content is output through the second audio output device.

[0025] In this implementation, when switching to the semi-folded state, the audio of the two videos is output and the voices of the two users are picked up without interfering with each other according to the audio setting information of the first screen and the second screen, thereby realizing the combination of the semi-folded form and the multi-person audio and video scene, and improving the user experience of the multi-person audio and video scene.

[0026] In a possible implementation of the first aspect, a naked-eye 3D display prompt can also be performed through a folding screen. Specifically, if the folding screen is in a naked-eye 3D display mode, the electronic device obtains the angle between the first screen and the second screen. If it is detected that the angle does not fall within the preset angle range, a first prompt operation is performed, and the first prompt operation is used to prompt the user to adjust the angle; in the process of the user adjusting the angle according to the first prompt operation, if it is detected that the angle falls within the preset angle range, a second prompt operation is performed, and the second prompt operation is used to prompt that the angle has fallen into the preset angle range; wherein the preset angle range is the visible angle range of the naked-eye 3D image.

[0027] In this implementation, the user is constantly prompted to adjust the folding angle of the folding screen through prompting operations, which can easily and quickly help the user find the viewing angle range of the naked-eye 3D image, thereby improving the user interaction experience in audio and video scenarios.

[0028] In a possible implementation manner of the first aspect, if it is detected that the angle does not fall within the preset angle range, performing a first prompt operation includes:

[0029] If it is detected that the angle does not fall within the preset angle range, the first prompt sound is played, and the shape corresponding to the current angle of the visible pattern is displayed on the first screen or the second screen. The first prompt sound is used to prompt the user to adjust the angle so that the visible pattern is displayed in the target shape. At this time, the first prompt operation includes playing the first prompt sound and displaying the corresponding shape of the visible pattern.

[0030] When the user adjusts the angle according to the first prompt operation and before the second prompt operation is performed, the folding screen can also display the corresponding form of the visible pattern on the first screen or the second screen according to the real-time angle, wherein the corresponding form of the visible pattern is different for different angles. In this way, different forms of the visual pattern are displayed during the user's adjustment of the folding angle, further improving the user interaction experience in audio and video scenes.

[0031] If the detected angle falls within the preset angle range, a second prompt operation is performed, including:

[0032] If it is detected that the angle falls within the preset angle range, at least one of the following prompt operations is performed: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen, wherein the second prompt sound is used to prompt that the angle has fallen within the preset angle range, and the target form is used to indicate that the angle has fallen within the preset angle range. At this time, the second prompt operation may include at least one of the following: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen.

[0033] In this implementation, a variety of prompting methods such as sound, vibration, and vision can be combined to better prompt the user to adjust the folding angle to the viewing angle range of the naked eye 3D image.

[0034] In a possible implementation of the first aspect, the electronic device may also determine the relative position and relative distance between the user and the folding screen; if the relative position and / or relative distance does not fall within a preset range, a third prompt operation is performed, and the third prompt operation is used to prompt the user to adjust the relative position and relative distance between the user and the folding screen, and the preset range is used to characterize the visible range of the naked-eye 3D image. In this way, the user can be prompted to adjust the relative distance and relative position between the user and the folding screen through the prompt operation, so that the relative distance and relative position fall within the visible range that can realize the naked-eye 3D image, thereby realizing the naked-eye 3D effect.

[0035] In a second aspect, an embodiment of the present application provides an electronic device, including a folding screen, a processor, and a memory, wherein the folding screen can be folded into at least two screens, the at least two screens include a first screen and a second screen, and the memory is used to store a computer program that can be run on the processor;

[0036] When a processor executes a computer program, it performs the following steps:

[0037] When the folding screen is in a semi-folded state, the first content is displayed on the first screen, and the audio of the first content is output through the first audio output device, and the second content is displayed on the second screen, and the audio of the second content is output through the second audio output device;

[0038] The first audio output device is a first directional sound unit or a first earphone, and the second audio output device is a second directional sound unit or a second earphone;

[0039] The first directional sound emitting unit is used for emitting sound in a first direction, and the second directional sound emitting unit is used for emitting sound in a second direction. The first direction is the direction in which the light emitting surface of the first screen faces, and the second direction is the direction in which the light emitting surface of the second screen faces.

[0040] In a possible implementation manner of the second aspect, when the processor executes the computer program, the following steps are specifically implemented: picking up the voice of the first user through the first sound pickup device and / or picking up the voice of the second user through the second sound pickup device; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone.

[0041] In a possible implementation of the second aspect, the first audio output device is a first directional sound-emitting unit or a first earphone, and the second audio output device is a second directional sound-emitting unit or a second earphone; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone.

[0042] In a possible implementation manner of the second aspect, the first content is a first video content and / or the second content is a second video content.

[0043] In a possible implementation manner of the second aspect, when the processor executes the computer program, the following steps are specifically implemented: according to the audio setting information of the first screen, the audio of the first content is output through the first audio output device; according to the audio setting information of the second screen, the audio of the second content is output through the second audio output device.

[0044] In a possible implementation manner of the second aspect, when the processor executes the computer program, the following steps are specifically implemented:

[0045] If it is determined according to the audio setting information of the first screen that the sound emission mode of the first screen is directional sound emission and the sound pickup mode of the first screen is directional sound pickup, the sound emission direction is determined, the first directional sound emission unit is controlled to output the audio of the first content in the sound emission direction, the sound source direction of the first user's voice is determined, and the first directional sound pickup unit is controlled to collect the sound data to be processed, enhance the target sound signal in the sound source direction of the sound data to be processed, and remove or suppress the sound signal in the non-sound source direction; if it is determined according to the audio setting information of the second screen that the sound emission mode and the sound pickup mode of the second screen are headphones, the audio of the second content is output and the voice of the second user is picked up through the second headphones.

[0046] Among them, the first audio output device is a first directional sound-emitting unit, the first sound pickup device is a first directional sound pickup unit, and the second audio output device and the second sound pickup device are second headphones.

[0047] In a possible implementation manner of the second aspect, when the processor executes the computer program, the processor further implements the following steps:

[0048] Display the setting interface, which includes audio setting options on the first screen and audio setting options on the second screen;

[0049] In response to the setting operation, the audio output mode and / or sound pickup mode of the first screen is set, and the audio output mode and / or sound pickup mode of the second screen is set, and the audio setting information of the first screen and the audio setting information of the second screen are obtained. The setting operation is an operation for the audio setting options of the first screen and the audio setting options of the second screen.

[0050] In a possible implementation of the second aspect, the processor further implements the following steps when executing the computer program: in response to a first operation, displaying the audio setting options of the target screen on the first screen, and in response to the operation on the audio setting options of the target screen, adjusting the audio output mode and / or sound pickup mode of the target screen, the first operation is an operation for calling up the audio setting options of the target screen, and the target screen is at least one of the first screen and the second screen; and / or, in response to a second operation, displaying the audio setting options of the target screen on the second screen, and in response to the operation on the audio setting options of the target screen, adjusting the audio output mode and / or sound pickup mode of the target screen, the second operation is an operation for calling up the audio setting options of the target screen.

[0051] In a possible implementation manner of the second aspect, when the processor executes the computer program, the processor further implements the following steps:

[0052] When the folding screen is in the unfolded state, in response to the split-screen operation, a first interface is displayed in a first screen area of ​​the folding screen, and a second interface is displayed in a second screen area of ​​the folding screen, wherein the first interface and the second interface are interfaces of different applications or different interfaces of the same application;

[0053] In response to the play operation, display the first content on the first interface and display the second content on the second interface respectively;

[0054] If the folding screen is converted from the unfolded state to the semi-folded state, the following steps are performed: the first content is displayed on the first screen, and the audio of the first content is output through the first audio output device, and the second content is displayed on the second screen, and the audio of the second content is output through the second audio output device.

[0055] In a possible implementation manner of the second aspect, when the processor executes the computer program, the processor further implements the following steps:

[0056] If the folding screen is in the naked eye 3D display mode, obtain the angle between the first screen and the second screen;

[0057] If it is detected that the angle does not fall within the preset angle range, a first prompt operation is performed, and the first prompt operation is used to prompt the user to adjust the angle;

[0058] During the process of the user adjusting the angle according to the first prompt operation, if it is detected that the angle falls within the preset angle range, a second prompt operation is performed, and the second prompt operation is used to prompt that the angle has fallen within the preset angle range;

[0059] The preset angle range is the viewing angle range of the naked eye 3D image.

[0060] In a possible implementation manner of the second aspect, when the processor executes the computer program, the following steps are specifically implemented:

[0061] If it is detected that the angle does not fall within the preset angle range, a first prompt sound is played, and the shape corresponding to the current angle of the visible pattern is displayed on the first screen or the second screen. The first prompt sound is used to prompt the user to adjust the angle so that the visible pattern is displayed in the target shape; at this time, the first prompt operation includes playing the first prompt sound and displaying the corresponding shape of the visible pattern.

[0062] When the user adjusts the angle according to the first prompt operation and before performing the second prompt operation, the corresponding form of the visible pattern is displayed on the first screen or the second screen according to the real-time angle, wherein the corresponding form of the visible pattern is different for different angles.

[0063] If it is detected that the angle falls within the preset angle range, at least one of the following prompt operations is performed: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen, wherein the second prompt sound is used to prompt that the angle has fallen within the preset angle range, and the target form is used to indicate that the angle has fallen within the preset angle range. At this time, the second prompt operation includes at least one of the following: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen.

[0064] In a possible implementation manner of the second aspect, the processor specifically implements the following steps when executing the computer program: determining the relative orientation and relative distance between the user and the folding screen; if the relative orientation and / or relative distance does not fall within a preset range, performing a third prompt operation, the third prompt operation being used to prompt the user to adjust the relative orientation and relative distance between the user and the folding screen, and the preset range is used to characterize the visible range of the naked-eye 3D image.

[0065] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements any method as described in the first aspect above.

[0066] In a fourth aspect, an embodiment of the present application provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement any method as described in any one of the first aspects above. The chip system can be a single chip, or a chip module composed of multiple chips.

[0067] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the method described in the first aspect above.

[0068] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] Figure 1A A schematic diagram of folding the outward-folding folding screen provided in an embodiment of the present application;

[0070] Figure 1B A schematic diagram of folding the inward folding screen provided in an embodiment of the present application;

[0071] Figure 1C A schematic diagram of a semi-folded form provided in an embodiment of the present application;

[0072] Figure 1D Another schematic diagram of a semi-folded form provided in an embodiment of the present application;

[0073] Figure 1E A schematic diagram of angle calculation provided in an embodiment of the present application;

[0074] Figure 2 A schematic block diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application;

[0075] Figure 3 A software structure block diagram of the electronic device 100 provided in an embodiment of the present application;

[0076] Figure 4A A schematic diagram of a multi-person audio and video scene provided in an embodiment of the present application;

[0077] Figure 4B A schematic diagram of a multi-person audio and video scene provided in an embodiment of the present application;

[0078] Figure 4C A schematic diagram of a multi-person audio and video scene provided in an embodiment of the present application;

[0079] Figure 5A A schematic diagram of the screen setting interface provided in an embodiment of the present application;

[0080] Figure 5B A schematic diagram of another setting interface provided in an embodiment of the present application;

[0081] Fig. 6A A schematic diagram of a two-person audio and video scene operation process provided in an embodiment of the present application;

[0082] Figure 6B A schematic diagram of another two-person audio and video scene operation process provided in an embodiment of the present application;

[0083] Fig. 7A A schematic diagram of a prompt for naked-eye 3D display provided in an embodiment of the present application;

[0084] Figure 7B A schematic diagram of a prompt for naked-eye 3D display provided in an embodiment of the present application;

[0085] Figure 8 This is a structural block diagram of an electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0086] In the following description, for the purpose of explanation rather than limitation, specific details such as specific system structures and technologies are provided to facilitate a thorough understanding of the embodiments of the present application.

[0087] The electronic device with a foldable screen can be folded along a folding edge or a folding axis to fold the foldable screen into at least two screens. For the convenience of description, the following description is made by taking the foldable screen folded into a first screen and a second screen as an example.

[0088] According to different folding methods, folding screens can be divided into inward-folding folding screens and outward-folding folding screens. An outward-folding folding screen refers to a folding screen that can be folded outward (i.e., folded outward), and an inward-folding folding screen refers to a folding screen that can be folded inward (i.e., folded inward). Exemplarily, the folding screen can be folded into a first screen and a second screen, and the first screen and the second screen formed after the outward-folding folding screen is folded are opposite to each other, while the first screen and the second screen formed after the inward-folding folding screen is folded are opposite to each other.

[0089] For example, see Figure 1A The folding diagram of the outward folding screen is shown. When the electronic device 100 with the folding screen is in a fully unfolded state, the user can follow the folding edge to Figure 1A Folding in the direction 11 shown, you can form Figure 1A The electronic device 100 shown on the right is in a semi-folded state. In the semi-folded state, the folding screen is folded to form a first screen 101 and a second screen 102, and the light emitting surface of the first screen 101 and the light emitting surface of the second screen 102 are opposite to each other.

[0090] After folding the electronic device 100 from the fully unfolded state to the half-folded state, the user can continue to fold it in direction 11 to fold the foldable screen from the half-folded state to the fully folded state. After the foldable screen of the electronic device 100 is fully folded, the first screen 101 and the second screen 102 are visible to the user.

[0091] It can be understood that when the electronic device 100 is in a fully unfolded state, the content is displayed on the full screen of the folded screen, and when the electronic device 100 is in a semi-folded state and a fully folded state, the content can be displayed on the first screen 101 or the second screen 102 formed by the folding.

[0092] For example, see Figure 1B The schematic diagram of folding the inward folding screen is shown. When the electronic device 100 with the folding screen is in a fully unfolded state, the user can follow the folding edge to Figure 1A Folding in the direction 12 shown, you can form Figure 1B The electronic device 100 shown on the right is in a semi-folded state. In the semi-folded state, the light emitting surface of the first screen 101 and the light emitting surface of the second screen 102 are partially opposite, and the first screen 101 and the second screen 102 are accommodated in the folding space.

[0093] After folding the electronic device 100 from the fully unfolded state to the half-folded state, the user can continue to fold it in direction 12 to fold the foldable screen from the half-folded state to the fully folded state. After the foldable screen of the electronic device 100 is fully folded, the light emitting surface of the first screen 101 and the light emitting surface of the second screen 102 are opposite.

[0094] In some embodiments, after the electronic device 100 adopting the inward folding solution is completely folded, the first screen 101 and the second screen 102 are not visible to the user. Therefore, in addition to the folding screen, the electronic device 100 adopting the inward folding solution usually has another screen. The screen and the folding screen are respectively arranged on two sides of the electronic device 100, and the size of the screen is usually smaller than the size of the folding screen. The screen is visible to the user after the folding screen of the electronic device 100 is completely folded. For example, Figure 1BAs shown, the electronic device 100 in the semi-folded state further includes a third screen 103, and the light emitting surface of the third screen 103 is arranged opposite to the light emitting surface of the second screen 102. When the folding screen of the electronic device 100 is completely folded, the light emitting surface of the third screen 103 is visible to the user and is used to display content.

[0095] In the embodiment of the present application, the value range of the angle α between the first screen 101 and the second screen 102 is [0°, 180°]. When α∈[0°, P1], the electronic device 100 can determine that the folding screen is in a fully folded state; when α∈[P1, P2], the electronic device 100 can determine that the folding screen is in a semi-folded state; when α∈[P2, 180°], the electronic device 100 can determine that the folding screen is in a fully unfolded state. Among them, 0°∠P1∠P2∠180°, P1 and P2 are pre-set angle thresholds.

[0096] In some embodiments, if the angle α between the first screen and the second screen is greater than 150°, it indicates that the user wants to use the folding screen as a complete display screen to display content; if the angle α between the first screen and the second screen is less than 30°, it indicates that the user wants to use the first screen or the second screen alone to display content. Based on this, the value range of P1 can be, for example, [0°, 30°], and the value range of P2 can be, for example, [150°, 180°]. For example, P1 can be 5°, 10° or 15°, etc., and P2 can be 160°, 165° or 170°, etc. Of course, the values ​​of P1 and P2 can also be other values, and the embodiments of the present application do not limit the values ​​of P1 and P2.

[0097] For example, see Figure 1C A schematic diagram of a semi-folded state is shown, after the user folds the electronic device 100 outward, a Figure 1C In the semi-folded state shown, the angle α between the first screen 101 and the second screen 102 is greater than P1 and less than P2. Figure 1D Another schematic diagram of the semi-folded state is shown, after the user folds the electronic device 100 inwards, a Figure 1D In the semi-folded form shown, the angle α between the first screen 101 and the second screen 102 is greater than P1 and less than P2.

[0098] It should be pointed out that the semi-folded form refers to an intermediate form between the fully expanded form and the fully folded form.

[0099] The electronic device 100 can determine whether it is currently in a semi-folded state or in another state by obtaining the angle between the first screen and the second screen and determining the angle interval into which the current angle falls. In some embodiments, the electronic device 100 can determine the angle between the first screen and the second screen by using a gyroscope sensor or an acceleration sensor. Of course, the electronic device 100 can also determine the angle between the first screen and the second screen by other means, which are not limited here.

[0100] For example, see Figure 1E The angle calculation schematic diagram shown in FIG. 1 shows that the folding screen of the electronic device 100 is folded to form a Figure 1E In the form shown, the gyro sensor of the first screen 101 is set in the first middle frame (not shown in the figure), and the first middle frame and the first screen 101 are fixedly set; the gyro sensor of the second screen 102 is set in the second middle frame (not shown in the figure), and the second middle frame and the second screen 102 are fixedly set. The gyro sensors of the first screen 101 and the second screen 102 are used to obtain a direction vector that can characterize the orientation of the screen. At this time, the gyro sensor in the first middle frame is used to detect the vector Z1 of the screen orientation of the first screen 101, and the gyro sensor in the second middle frame is used to detect the vector Z2 of the screen orientation of the second screen 102.

[0101] The directions and magnitudes of vector Z1 and vector Z2 are known. According to the trigonometric function relationship, the angle θ between the two vectors can be calculated based on vector Z1 and vector Z2; then, according to α=180°-θ, the angle between the first screen 101 and the second screen 102 can be calculated. α .

[0102] Of course, the electronic device 100 can also determine the angle between the first screen 101 and the second screen 102 through an acceleration sensor. At this time, the acceleration sensor of the first screen 101 can be set in the first middle frame, and the first middle frame and the first screen 101 are fixedly set, and the acceleration sensor of the second screen 102 can be set in the second middle frame, and the second middle frame and the second screen 102 are fixedly set. The acceleration sensor of each screen can measure the motion acceleration of each screen when it is rotated. The electronic device 100 can determine the angle of rotation of one screen relative to the other screen based on the motion acceleration measured by the acceleration sensor, and then obtain the angle between the first screen 101 and the second screen 102.

[0103] It should be noted that in the embodiment of the present application, the folding screen can be a multi-screen folding screen. The multi-screen folding screen includes at least two separate screens, and the at least two separate screens can be connected in sequence through a folding axis, and each screen can rotate around the folding axis connected thereto to achieve the folding of the multi-screen folding screen. At this time, at least two screens formed by folding the multi-screen folding screen are multiple independent screens. In other words, the first screen 101 and the second screen 102 can be different display screens.

[0104] Of course, the folding screen can also be a flexible folding screen. After the flexible folding screen is folded, at least two screens are formed, which are complete screens of an integrated structure, but are folded to form at least two screen areas. For example, Figure 1A , Figure 1B and Figure 1C The electronic device 100 has a flexible folding screen, which can be folded along the folding edge, and the folding edge is usually made of a flexible material. At this time, the first screen 101 and the second screen 102 can be different display areas of the same flexible folding screen. When the electronic device is in a semi-folded state or a folded state, the first screen 101 and the second screen 102 are different display areas at a bending angle. For the convenience of description, the following description takes the flexible folding screen as an example.

[0105] In the embodiment of the present application, the electronic device 100 with a folding screen may be a folding screen mobile phone or a folding screen tablet computer, etc. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device.

[0106] For example, see Figure 2 The hardware structure schematic block diagram of the electronic device 100 shown in the figure may include, but is not limited to, a processor 110, a memory 120, an audio module 130, a speaker 130A, a receiver 130B, a microphone 130C, an earphone interface 130D, a sensor module 140, a motor 150, and a display screen 160, etc. Among them, the sensor module 140 may include, but is not limited to, a gyroscope sensor 140A and an acceleration sensor 140B, etc.

[0107] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0108] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a graphics processing unit (GPU), and a controller, etc. Different processing units may be independent devices or integrated into one or more processors.

[0109] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0110] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, and a mobile industry processor interface (MIPI). Among them, the I2S interface and the PCM interface can be used for audio communication. For example, the I2S interface is coupled with the audio module 130 to realize the communication between the processor 110 and the audio module 130. The function of Bluetooth headset calling can be realized through the PCM interface and the I2S interface. The UART interface can realize the function of Bluetooth headset playing music by connecting the audio module 130 and the wireless communication module. The MIPI interface is used to connect the processor 110 with peripheral devices such as the display screen 160, thereby realizing the display function of the electronic device 100.

[0111] The electronic device 100 implements the display function through a GPU, a display screen 160, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 160 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0112] The display screen 160 is used to display images, videos, etc. The display screen 160 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 160, where N is a positive integer greater than 1.

[0113] In the embodiment of the present application, the display screen 160 can be a multi-screen folding screen or a flexible folding screen, and the folding method can be inward folding or outward folding.

[0114] The memory 120 can be used to store computer executable program codes, which include instructions. The memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the memory 120, and / or instructions stored in a memory provided in the processor.

[0115] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 130 , the speaker 130A, the receiver 130B, the microphone 130C, the headphone jack 130D, and the application processor.

[0116] The audio module 130 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 130 can also be used to encode and decode audio signals. In some embodiments, the audio module 130 can be arranged in the processor 110, or some functional modules of the audio module 130 can be arranged in the processor 110.

[0117] The speaker 130A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 130A. In the embodiment of the present application, the speaker 130A can be a speaker with a directional sound function, and the electronic device 100 can achieve directional sound based on the speaker 130A.

[0118] In some embodiments of the present application, the electronic device 100 can also realize screen sound based on the audio module 130 and the display screen 160, that is, the screen sound is used instead of the speaker 130A. Further, the electronic device 100 can also realize directional sound through the audio module 130 and the display screen 160.

[0119] It is understandable that directional sound generation can modulate the audio signal onto an ultrasonic carrier, and utilize the directional propagation characteristics of ultrasonic waves and the nonlinear effect of air to form directional propagation of audible sound. Specifically, after the audio signal is processed, an ultrasonic signal containing the audio signal information is formed, and the ultrasonic wave is emitted into the air by the audio directional transducer, and then the ultrasonic wave automatically modulates the audio signal contained therein in the air, forming an audible sound signal with strong directivity.

[0120] The receiver 130B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 130B close to the human ear.

[0121] Microphone 130C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 130C with his mouth to input the sound signal into the microphone 130C. The electronic device 100 can be provided with at least one microphone 130C. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 130C to collect sound signals and identify the source of sound, thereby realizing functions such as directional sound pickup. Among them, in the directional sound pickup process, the electronic device 100 can first identify the direction of the sound source, and then pick up the target signal from the mixed signal according to the direction of the sound source, that is, only pick up the sound signal propagated from a specific direction, while the noise and interference signals from other directions are not picked up but attenuated or shielded, thereby achieving the effect of enhancing the target voice.

[0122] The earphone interface 130D is used to connect a wired earphone and can be a Universal Serial Bus (USB) interface, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0123] The gyro sensor 140A may be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor 140A.

[0124] In the embodiment of the present application, the display screen 160 can be folded to form at least two screens, and a gyroscope sensor 140A can be set in the middle frame of each screen to detect the orientation vector of the screen. After the electronic device 100 obtains the screen orientation information fed back by the gyroscope sensor 140A, it can determine the angle between the first screen and the second screen according to the screen orientation information.

[0125] The acceleration sensor 140B can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). In the embodiment of the present application, the display screen 160 can be folded to form at least two screens, and an acceleration sensor 140B can be set in the middle frame of each screen to measure the orientation information of the screen. The electronic device 100 can determine the angle between the first screen and the second screen based on the screen orientation information fed back by the acceleration sensor 140B.

[0126] The motor 150 can generate a vibration prompt. In the embodiment of the present application, the electronic device 100 can realize a naked eye three-dimensional (3D) display prompt through a motor. For example, when the user adjusts the angle between the first screen and the second screen according to the prompt information, when the electronic device 100 determines that the current angle falls within the naked eye 3D viewing angle range, the motor is controlled to vibrate to prompt the user that the current angle is a viewing angle.

[0127] After the hardware structure of the electronic device 100 is introduced in an exemplary manner, the software system structure of the electronic device is introduced and explained in an exemplary manner as follows.

[0128] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes a layered architecture system as an example to exemplify the software structure of the electronic device 100.

[0129] Figure 3 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the layered architecture system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the kernel layer (also called the driver layer) and the hardware platform.

[0130] The application layer may include a series of application packages. Figure 3 As shown, the application layer exemplarily includes video applications and audio applications. Video applications can be, for example, video applications such as Huawei Video, instant messaging applications such as Changlian Call, or video conferencing applications. Instant messaging applications such as Changlian Call can support video calls and voice calls. Audio applications can be, for example, music applications such as Huawei Music.

[0131] The application framework layer provides the required programming framework and application programming interface (API) for the applications in the application layer. The application framework layer includes some predefined functions. Figure 3 As shown, the application framework layer may exemplarily include a data reporting module, a data processing module, a pattern recognition module, an event generation module, an activity manager, and a window manager. Optionally, the application framework layer may also include a content provider, a view system, a phone manager, a resource manager, and a notification manager.

[0132] Among them, the window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The activity manager is responsible for managing the activity, and is responsible for the startup, switching, scheduling of each group in the system and the management and scheduling of applications. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions for the electronic device 100. For example, the management of call status (including connected, hung up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

[0133] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver and sensor driver, etc. Figure 3 The hardware platform may include a gyroscope sensor, a sound pickup device, an audio output device, and a display screen. The sound pickup device is used to pick up the user's voice, and may specifically be, for example, a microphone. The audio output device is used to output audio, and may specifically be, for example, a speaker and a headset.

[0134] like Figure 3 As shown, when the user performs input operations on the electronic device 100 (such as folding operations and inputting user voice, etc.), the gyroscope sensor and sound pickup device of the hardware platform will report the collected data to the data reporting module, and the data reporting module will upload the relevant data to the data processing module, and the data processing module will then process the relevant data accordingly. For example, the relevant data includes the data collected by the gyroscope sensor and the user voice data collected by the sound pickup device. The data processing module processes the gyroscope sensor data to obtain the angle between the first screen and the second screen (i.e., the folding angle), performs voice enhancement processing in the target direction on the user voice data, or packages the user voice data into a data packet to be transmitted, etc. The data processing module uploads the obtained folding angle, etc. to the pattern recognition module, and the pattern recognition module determines the current folding form (such as the unfolded state, the fully folded form, and the half-folded form, etc.) by judging the angle interval into which the folding angle falls, and reports the identified folding form to the event generation module, and the event generation module then reports the corresponding event to the application layer according to the current folding form.

[0135] The video application or music application at the application layer calls the start Activity interface and sets the window display position and size in the current folded state through the activity manager. The window manager at the application framework layer draws the window according to the settings of the activity manager and sends the window data to the display driver at the kernel layer, which displays the corresponding interface content on the folded screen.

[0136] Similarly, video applications or music applications can also obtain audio and video in the media library, output the corresponding audio on the audio output device through the audio driver, and display the corresponding video content on the display screen through the display driver. Among them, the media library supports a variety of commonly used audio and video format playback and recording, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG and PNG, etc. For example, when the folding screen is in a semi-folded form and the folding method is outward folding, the first video content is displayed on the first screen, and the second video content is displayed on the second screen synchronously, and the audio is output and picked up through different devices.

[0137] In addition, when in naked-eye 3D display mode, video applications can use the 3D graphics processing library to implement 3D graphics drawing, image rendering, synthesis, and layer processing, and display the properly processed 3D images on the display. The hardware platform can also include motors, and video applications and music applications can use motor drivers to control motors for vibration prompts.

[0138] After the hardware structure and software structure of the electronic device 100 are exemplarily introduced, the electronic device 100 will be taken as an example for description.

[0139] In the audio and video processing solution of the folding screen device provided in the embodiment of the present application, when the folding screen is in a semi-folded state, the electronic device 100 displays the first content on the first screen and outputs the audio of the first content through the first audio output device, and displays the second content on the second screen and outputs the audio of the second content through the second audio output device. In this way, the user interaction experience of the folding screen in the scenario where multiple people watch content is improved.

[0140] It should be noted that the first content and the second content may be the same or different, that is, the content played on the first screen and the content played on the second screen may be the same or different.

[0141] The first content may be a first video content or an audio content (eg, a music song playback interface), etc., and the second content may also be a second video content or an audio content (eg, a music song playback interface), etc.

[0142] The first video content and the second video content may be videos (such as movies, TV series, cartoons, short videos and long videos, etc.), video calls or video conferences, etc.

[0143] When the first content or the second content is a video conference or a video call, the electronic device 100 usually needs to pick up the user's voice data, while when the first content or the second content is music songs, movies, TV series, cartoons, and short videos, the electronic device 100 usually does not need to pick up the user's voice data. In other words, whether it is necessary to pick up the user's voice through the sound pickup device is usually determined by the actual scene.

[0144] In order to prevent the sound of the first content from affecting the second user and the sound of the second content from affecting the first user, and to improve the user audio interaction experience, when outputting audio, the electronic device 100 can output the audio of the first content through a first audio output device and output the audio of the second content through a second audio output device.

[0145] Among them, the first audio output device is a first directional sound unit or a first earphone, and the second audio output device is a second directional sound unit or a second earphone; the first directional sound unit is used to direct sound in a first direction, and the second directional sound unit is used to direct sound in a second direction, the first direction is the direction in which the light emitting surface of the first screen is facing, and the second direction is the direction in which the light emitting surface of the second screen is facing.

[0146] Typically, the first earphone can be worn by a first user, and the second earphone can be worn by a second user.

[0147] The first user refers to the user facing the first screen, that is, the first user views the first content displayed on the first screen. The second user refers to the user facing the second screen, that is, the second user views the second content displayed on the second screen. It is understandable that the first user can generally be understood as the user using the first screen, and the second user can be understood as the user using the second screen. In some cases, the first user and the second user may or may not face the screen when using the screen (for example, not facing the screen when listening to music with headphones).

[0148] When the first audio output device and the second audio output device are both directional sound emitting units, since the first direction is the direction in which the light emitting surface of the first screen faces, and the second direction is the direction in which the light emitting surface of the second screen faces, the two directional sound emitting directions are different. Therefore, when the electronic device 100 outputs the audio of the first content through the first audio output device and outputs the audio of the second content through the second audio output device, the first user can receive the audio of the first content but cannot receive the audio of the second content, that is, unless there are some extremely special circumstances (for example, the second user walks into the direction range of the first screen), the audio of the second content will not interfere with the first user with a high probability; similarly, the second user can receive the audio of the second content but cannot receive the audio of the first content, that is, the audio of the first content will not interfere with the second user with a high probability.

[0149] When the first audio output device and the second audio output device are both headphones, since the first headphone and the second headphone are worn by the first user and the second user respectively, when the audio of the first content is output through the first headphone and the audio of the second content is output through the second headphone, the first user can receive the audio of the first content but cannot receive the audio of the second content, and the second user can receive the audio of the second content but cannot receive the audio of the first content. In this way, the audio of the first content will not interfere with the second user, and the audio of the second content will not interfere with the first user.

[0150] When one of the first audio output device and the second audio output device is an earphone and the other is a directional sound unit, since the sound emission direction of the directional sound unit is the direction in which the light emitting surface of the screen is facing, the audio of the directional sound usually does not cause audio interference to another user wearing earphones, that is, the audio of the first content and the second content do not interfere with each other.

[0151] The first earphone and the second earphone may be wired or wireless earphones, the wireless earphones may be, for example, Bluetooth earphones, and the first directional sound emitting unit and the second directional sound emitting unit may be, for example, directional speakers or screens.

[0152] In addition to outputting the audio of two contents through the first audio output device and the second audio output device respectively so that the audio of the first content and the audio of the second content do not interfere with each other, the electronic device can also pick up the voice of the first user through the first sound pickup device and / or pick up the voice of the second user through the second sound pickup device when picking up user voices in order to avoid the voices of each user from affecting each other. The first sound pickup device can be a first directional sound pickup unit or a first earphone, and the second sound pickup device can be a second directional sound pickup unit or a second earphone. The directional sound pickup unit can be, for example, a directional sound pickup microphone.

[0153] It is understandable that directional sound pickup can only pick up sound from a specific source, so the sound interference of other users can be reduced by directional sound pickup. Wireless headphones and wired headphones can collect the voice of the user wearing the headphones and suppress or reduce the sound interference of other users.

[0154] In a possible implementation, the first audio output device is a first directional sound-emitting unit or a first earphone, and the second audio output device is a second directional sound-emitting unit or a second earphone; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone. The first earphone and the second earphone can be wireless earphones or wired earphones. The first directional sound-emitting unit and the second directional sound-emitting unit can be screen directional sound-emitting units or speaker directional sound-emitting units. Exemplarily, the sound emission mode and sound pickup mode of the first screen can be directional sound emission and directional sound pickup, respectively, while the sound emission mode and sound pickup mode of the second screen can be Bluetooth earphone playback and Bluetooth earphone collection. The directional sound pickup unit is, for example, a directional sound pickup microphone.

[0155] It is understandable that wireless headphones and wired headphones are usually integrated with both speakers and microphones, so audio can be output through the headphones and user voice can be picked up through the headphones. In addition, the electronic device 100 can be connected to two wireless headphones at the same time, and each wireless headset uses an independent wireless channel, so that different audio can be output through two different wireless headphones at the same time. For example, the electronic device 100 has two Bluetooth chips and can be connected to two Bluetooth headsets at the same time.

[0156] When the electronic device 100 is in a semi-folded state, the angle between the first screen and the second screen is greater than a first threshold and less than a second threshold, and the first threshold is less than the second threshold. The introduction to the folding state of the electronic device can be found above and will not be repeated here.

[0157] In order to better introduce the technical solution provided by the embodiment of the present application, Figure 4A The specific scenario shown is introduced for exemplary purposes.

[0158] See also Figure 4A The schematic diagram of the multi-person audio and video scene is shown, where the electronic device 100 may be an outward folding screen electronic device in a semi-folded state. After the electronic device 100 is folded outward, the user can place the folded electronic device on a table or other carrier, and the folded first screen 101 and the second screen 102 face outward and are visible to the user. The first user 106 watches the first screen 101, and the second user 104 watches the second screen 102. The sound emission mode of the first screen 101 is directional sound emission, Figure 4AThe dotted line at the first screen 101 in the figure represents the directional sound emission direction range, and the sound emission direction is the direction toward which the light emitting surface of the first screen 101 is facing. At this time, the direction toward which the light emitting surface of the first screen is facing can be as shown in FIG. Figure 4A As shown. When the electronic device 100 performs directional sound in the direction of the light-emitting surface of the first screen 101, since the first user 106 is facing the light-emitting surface of the first screen 101 and is within the range of the directional sound, the first user 106 can receive the audio output using the directional sound. The second user 104 wears a Bluetooth headset 105, and the electronic device 100 can output audio to the second user 104 through the Bluetooth headset 105 and pick up the voice of the second user 104. The second user 104 does not fall within the range of the directional sound, so the audio of the first screen 101 cannot be received. In addition, the sound pickup method of the first screen 101 can be directional sound pickup, Figure 4A The solid line in front of the first user 106 in the figure represents a directional sound pickup range, which directionally picks up the voice of the first user 106.

[0159] See also Figure 4B A schematic diagram of a multi-person audio and video scene is shown, in which the first content displayed on the first screen 101 of the electronic device 100 can be a movie or a TV series, and the second content displayed on the second screen 102 can be a video call or a video conference. At this time, the electronic device 100 is in a semi-folded form and the dual screens are placed in a horizontal standing form. The electronic device 100 can control the first audio output device (for example, the first screen 101) to directional sound toward the sound direction range according to the sound direction range. At this time, since the first content displayed on the first screen 101 can be a movie or a TV series, it is not necessary to pick up the user's voice, so there is no need to control the first sound pickup device to pick up the user's voice.

[0160] Among them, when directional sound is emitted, it is usually directional to a certain sound emission direction range. The sound emission direction range can be preset, or it can be determined in real time by the electronic device 100 through sensor data. Usually, the user will watch video content in front of the screen, so the sound emission direction range can be preset as follows: facing the positive direction of the screen, the angle between the leftmost and rightmost sound emission directions is 120 degrees.

[0161] The electronic device 100 can obtain the relative position between the user and the screen in real time through the image sensor and the infrared sensor, and make a directional sound in the direction of the user according to the determined relative position. For example, the electronic device 100 can take a picture of the image in front of the screen in real time through the image sensor, identify whether there is a portrait in the image, and when there is a portrait, identify the position of the portrait in the image, and finally determine the relative position between the user and the screen according to the position of the portrait in the image, and then determine the sound direction range of the directional sound according to the relative position.

[0162] After the electronic device 100 is connected to the Bluetooth headset 105, when the second screen 102 displays content such as a video conference or a video call, the audio corresponding to the video content of the second screen 102 is output to the Bluetooth headset 105; in addition, the Bluetooth headset 105 can also pick up the user voice data of the second user 104, and transmit the voice data to the electronic device 100 through the Bluetooth channel. After the electronic device 100 receives the voice data collected by the Bluetooth headset 105, it can package the voice data into a voice data packet to be transmitted, and send the voice data packet to the other end of the video conference or video call through the communication module.

[0163] It should be noted that, in addition to displaying video content, the first screen 101 and the second screen 102 can also display an interface corresponding to audio, such as a music playback interface. At this time, the electronic device 100 can still use the audio output method of the embodiment of the present application to prevent the audio corresponding to each screen from affecting each other, thereby improving the user's interactive experience.

[0164] For example, see Figure 4C A schematic diagram of a multi-person audio and video scene is shown, based on Figure 4A In the scenario, the first screen 101 of the electronic device 100 displays the song playing interface, and the second screen 102 displays the video call interface or the video conference interface. At this time, the electronic device 100 controls the first audio output device to play the song by directional sound emission; and collects the voice of the second user 104 through the Bluetooth headset 105, and outputs the audio data corresponding to the video conference or video call. In this way, the song sound played by the first user 106 and the call sound of the second user 104 do not affect or interfere with each other, realizing audio and video interaction in multi-person scenarios and improving the user interaction experience.

[0165] Understandably, Figure 4C The second screen 102 can also display a song playing interface. At this time, the electronic device 100 can play different audios or the same audio at the same time, and the audios do not affect each other, so the user interaction experience is higher.

[0166] As can be seen from the above, compared with the solution in which the folding screen cannot display content on two screens at the same time, in the embodiment of the present application, when the folding screen is in a semi-folded state, the electronic device 100 displays content on the first screen 101 and the second screen 102 respectively, that is, at least two screens formed by folding display content at the same time, so that the first user can watch the content displayed on the first screen while the second user can also watch the content displayed on the second screen, which meets the needs of multiple users to watch content at the same time and improves the user interaction experience.

[0167] In addition, based on the simultaneous display of content on the first screen 101 and the second screen 102, the electronic device 100 plays the audio of the first screen through the first audio output device and plays the audio of the second screen through the second audio output device in order to further improve the interactive experience in the scenario where multiple people watch the content. In this way, the audio of the first screen and the second screen do not affect each other, and the first user and the second user can watch the content at the same time without disturbing each other, which satisfies the scenario where multiple people watch the content and improves the audio interactive experience in the scenario where multiple people watch the content.

[0168] In a possible implementation, the sound emission mode and sound pickup mode of the first screen 101 and the second screen 102 of the electronic device 100 may be pre-set. After setting at least one of the sound emission mode and sound pickup mode of the first screen 101 and the second screen 102, the electronic device 100 may generate audio setting information of the first screen 101 and the audio setting information of the second screen, and when subsequently outputting audio and / or picking up user voice, audio output and sound pickup may be performed according to the audio setting information of the first screen 101 and the audio setting information of the second screen. At this time, the electronic device 100 may provide a setting interface for the user to set.

[0169] For example, see Figure 5A The schematic diagram of the screen setting interface is shown, and the electronic device 100 displays the setting interface 107 in full screen in the expanded form. The setting interface 107 includes multiple setting items such as WLAN, Bluetooth, mobile network and two-person video scene setting. The user can enter the two-person video scene setting interface by clicking the two-person video scene setting item. In response to the click operation of the two-person video scene setting item, the electronic device 100 displays the two-person video scene setting interface 1081. The two-person video scene setting interface 1081 includes two parts, one part is the first screen setting, and the other part is the second screen setting. The first screen setting and the second screen setting both include downlink playback settings and uplink call settings. The downlink playback setting is used to set the sound mode, and the uplink call setting user sets the pickup mode.

[0170] The user can perform setting operations on the two-person video scene setting interface 1081 as needed, and the electronic device 100 responds to the setting operation to obtain the setting information of the first screen and the setting information of the second screen. The setting information of the first screen and the setting information of the second screen both include audio setting information. Figure 5A As shown, the sound emission mode of the first screen is directional sound emission, and the sound pickup mode is directional sound pickup; the sound emission mode of the second screen is Bluetooth headset sound emission, and the sound pickup mode is Bluetooth headset sound pickup.

[0171] That is, the electronic device 100 may display a setting interface, which includes an audio setting option on the first screen and an audio setting option on the second screen. The audio setting option is, for example, Figure 5AThe downlink playback setting options and uplink call setting options in the video are displayed. In response to the setting operation, the electronic device 100 sets the audio output mode and / or sound pickup mode of the first screen, sets the audio output mode and / or sound pickup mode of the second screen, and obtains the audio setting information of the first screen and the audio setting information of the second screen. The setting operation is an operation for the audio setting options of the first screen and the audio setting options of the second screen. For example, the setting operation can be a click operation for the downlink playback option. The electronic device 100 provides a setting interface for the user to set the sound emission mode and sound pickup mode of each screen as needed, thereby improving the user experience.

[0172] It is understandable that if the user does not Figure 5A According to the settings shown, the electronic device 100 can output and pick up audio according to the default audio settings. For example, the default audio output mode of the first screen 101 is directional sound, and the audio output mode of the second screen 102 is headphone output.

[0173] In addition, in the above Figure 4A In the Figure 5A In the manner shown, the audio output mode and sound pickup mode of the first screen 101 and the second screen 102 are pre-set. For example, the audio output mode of the second screen 102 is set to a Bluetooth headset, at which time the audio of the second screen 102 is output to the Bluetooth headset 105; the audio output mode of the first screen 101 is set to directional sound.

[0174] It should be noted that the setting interface (such as Figure 5A The interface shown in the figure can be displayed in the unfolded state of the electronic device 100, or in the half-folded state or the fully folded state. When displayed in the half-folded state or the fully folded state, the setting interface can be displayed on one of the first screen 101 and the second screen 102.

[0175] The electronic device 100 can display a setting interface on one screen, and the audio setting options of the first screen 101 and the second screen 102 can be set simultaneously through this setting interface. In addition, the electronic device 100 can also display setting interfaces on the first screen 101 and the second screen 102 respectively, so as to set the audio setting options of different screens through different setting interfaces. At this time, in a possible implementation, when in a semi-folded form or a fully folded form, the electronic device 100 can display an audio setting option interface on the first screen 101 and the second screen 102, and the user can set the audio output mode and sound pickup mode of the first screen 101 and the second screen 102 according to the displayed audio setting option interface.

[0176] For example, see Figure 5BAnother setting interface schematic diagram is shown, when the electronic device 100 is in a semi-folded state, an audio setting interface 1082 is displayed on the second screen 102. The audio setting interface 1082 includes sound emission options and sound pickup options of the second screen 102. The sound emission options include options such as whether to emit sound, audio output mode and sound emission volume, and the sound pickup options include options such as whether to pick up sound and sound pickup mode. After the electronic device 100 displays the audio setting interface 1082 on the second screen 102, the user can set the audio output mode and sound pickup mode of the second screen 102 through the audio setting interface 1082.

[0177] It is understandable that in the semi-folded form or the fully folded form, the electronic device 100 may also display an interface (not shown in the figure) similar to the audio setting interface 1082 on the first screen 101, for the user to set the audio output mode and sound pickup mode of the first screen 101. In this way, the user can set the audio output mode and sound pickup mode of the first screen 101 through the setting interface displayed on the first screen 101, and set the audio output mode and sound pickup mode of the second screen 102 through the setting interface displayed on the second screen 102.

[0178] It should be noted that before the user sets the audio output mode and sound pickup mode of the first screen 101 and the second screen 102 through the audio setting interface displayed when the electronic device 100 is in a semi-folded state or a fully folded state, the audio output mode and sound pickup mode of the first screen 101 and the second screen 102 may have been set (for example, by Figure 5A In the former case, the user has set the audio settings of each screen when the electronic device 100 is in the fully unfolded state, but considering that the user does not necessarily use the same audio output mode and sound pickup mode every time when the electronic device 100 is in the semi-folded state, the electronic device 100 can still continue to display the audio setting interface in the semi-folded state for the user to set the audio of each screen.

[0179] It should also be pointed out that, when the electronic device 100 detects a transition from a fully unfolded state to a semi-folded state, it can trigger at least one of the first screen 101 and the second screen 102 to display an audio setting option interface for the user to select an audio setting option; or when the first screen 101 and the second screen 102 are playing content, a control of the audio setting option interface can be displayed on the content interface, and the user can conveniently call up the audio setting option interface through the control, or the user can conveniently call up the display on the content interface through the calling operation. Figure 5BThe audio setting option interface of the electronic device 100 may be, for example, a sliding operation. That is, when the electronic device 100 detects a sliding operation input by the user on the first screen 101 or the second screen 102, the electronic device 100 displays, in response to the sliding operation, Figure 5B In this way, regardless of whether the user has previously set the audio options of the first screen 101 and the second screen 102, when the electronic device 100 is in a semi-folded state or a fully folded state, the user can conveniently set, adjust or modify the audio options of the first screen 101 and the second screen 102, and the user experience is improved.

[0180] Exemplarily, after the electronic device 100 displays the first content on the first screen and displays the second content on the second screen, it can also respond to the first operation and display the audio setting options (eg, Figure 5B The first operation is an operation for calling out the audio setting options of the target screen, such as a sliding operation, or an operation on a control, which is a control corresponding to the audio setting options and is used to conveniently call out the audio setting options. Similarly, the electronic device 100 can also respond to the second operation by displaying the audio setting options of the target screen on the second screen (such as Figure 5B The first operation is an operation for calling out the audio setting options of the target screen (for example, a sliding operation).

[0181] The target screen is at least one of the first screen and the second screen. That is, the electronic device 100 can display the audio setting options of the first screen and the second screen on one screen at the same time, so that the user can adjust the audio setting options of the two screens on one screen at the same time; or the audio setting options of the two screens can be displayed on two screens respectively, for example, the audio setting options of the second screen or the first screen are displayed on the first screen.

[0182] In a possible implementation, the electronic device 100 may output and pick up audio according to the audio setting information of the first screen and the second screen.

[0183] In a specific application, when the electronic device 100 displays the first content on the first screen and the second content on the second screen, the sound emission mode and sound pickup mode of the first screen and the second screen can be determined according to the audio setting information of the first screen and the second screen. Figure 5AAs shown, according to the audio setting information of the first screen, it is determined that the sound of the first screen is directional sound, and the sound pickup mode of the first screen is directional sound pickup; according to the audio setting information of the second screen, it is determined that the sound mode and sound pickup mode of the second screen are headphones. At this time, since the sound emission mode of the first screen can be directional sound emission, the electronic device 100 first determines the sound emission direction, and then controls the first directional sound emission unit to output the audio of the first content in the sound emission direction. Since the sound pickup mode of the first screen is directional sound pickup, the electronic device 100 first determines the sound source direction of the first user's voice, and then controls the first directional sound pickup unit to collect the sound data to be processed, and then enhances the target sound signal in the sound source direction in the sound data to be processed, removes or suppresses the sound signal in the non-sound source direction, so as to enhance the sound signal in the sound source direction and achieve the purpose of directional sound pickup.

[0184] The second screen can emit sound and pick up sound by earphones, and the electronic device 100 outputs the audio of the second content and picks up the voice of the second user through the earphones. At this time, the first audio output device is a first directional sound unit (such as a screen directional sound unit), the first sound pickup device is a first directional sound pickup unit, and the second audio output device and the second sound pickup device are earphones (such as Bluetooth earphones).

[0185] In a possible implementation, when the electronic device 100 is in the unfolded form, if a split-screen operation is detected, in response to the split-screen operation, a first interface is displayed in the first screen area of ​​the folding screen, and a second interface is displayed in the second screen area of ​​the folding screen, and the first interface and the second interface are interfaces of different applications or different interfaces of the same application. In a specific application, the split-screen operation can be implemented based on the split-screen function. In this case, the electronic device 100 supports the split-screen function, and responds to the split-screen operation through the split-screen function, displays the first interface in the first screen area, and displays the second interface in the second screen area. The first interface and the second interface can be different interfaces of the same application or interfaces of different applications. Of course, the split-screen operation can also be implemented based on the parallel horizon function. In this case, the electronic device 100 supports the parallel horizon function, and responds to the split-screen operation through the parallel horizon function, displays the first interface in the first screen area, and displays the second interface in the second screen area, but at this time, the first interface and the second interface are different interfaces of the same application.

[0186] After the split screen display, if the electronic device 100 detects a play operation, in response to the play operation, the first content is displayed on the first interface and the second content is displayed on the second interface. At this time, the electronic device 100 can play the audio of the first content through the default speaker, and not play the audio of the second content.

[0187] Of course, when the electronic device 100 is in the unfolded state, the first content is displayed on the first interface, and the second content is displayed on the second interface, the audio of the first content and the second content can be played simultaneously, or only the audio of the second content can be played. However, if the audio of the first content and the second content are played at the same time, the audio of the two contents played at the same time will cause noise and affect the user experience. In order to reduce the noise at this time, when the embodiment of the present application detects that the folding screen is in the unfolded state, even if the first content and the second content are played at the same time, only the audio of one of the contents can be played by default.

[0188] After the electronic device 100 displays the first content on the first interface and displays the second content on the second interface, if it is detected that the electronic device 100 is converted from the unfolded form to the semi-folded form, the first content can be displayed on the first screen and the second content can be displayed on the second screen; and the audio of the first video content is output through the first audio output device, and the audio of the second video content is output through the second audio output device. That is, when the electronic device 100 detects that the electronic device 100 is converted from the unfolded form to the semi-folded form, the audio is output through different audio output devices according to the audio setting information of the first screen and the second screen. Of course, in some other embodiments, the electronic device 100 is in the unfolded form, and the first video content is displayed on the first interface, and the second video content is displayed on the second interface, the audio is output through different audio output devices and pickup devices according to the audio setting information of the first screen and the second screen, that is, the electronic device 100 can also play the audio of the first content according to the audio setting information of the first screen, and play the audio of the second content according to the audio setting information of the second screen, so that even in the unfolded form, the effect of non-interference of audio can be achieved, and the user experience is higher.

[0189] For example, see Fig. 6A The schematic diagram of the operation process of a two-person audio and video scene is shown, in which the electronic device 100 displays the main interface in the expanded form, and the main interface includes applications such as video application 109, continuous call 111, music 112 and settings 113. At this time, the user inputs a split-screen operation to the electronic device 100, and the electronic device 100 performs a split-screen display; then, the user inputs a play operation to the electronic device 100, and the play operation is used to display the interface of continuous call 111 on the second interface 114 and the interface of video application 109 on the first interface 115 ( Fig. 6A The complete operation process is not shown in FIG. Fig. 6A As shown, when the electronic device 100 is in the unfolded state, the video call interface (i.e., the second content) is displayed on the second interface 114, and the video playback interface (i.e., the first content) is displayed on the first interface 115. Of course, in some other embodiments, the second interface 114 and the first interface 115 of the electronic device 100 can also display the interface of the same application, for example, both display the interface of the video application 109.

[0190] After the electronic device 100 displays the first content on the first interface 115 and displays the second content on the second interface 114, the user inputs a folding operation to the electronic device 100 and folds it to a semi-folded state. At this time, the electronic device 100 detects the transition from the unfolded state to the semi-folded state, and can display the video call interface on the second screen 102, display the video playback interface on the first screen 101, and perform audio output and / or sound pickup according to the audio setting information of the first screen 101 and the second screen 102. That is, the folding operation can be used as a triggering operation to trigger the electronic device 100 to display the first content on the first screen 101, display the second content on the second screen 102, and perform audio output and sound pickup according to the audio setting information of the first screen 101 and the second screen 102.

[0191] In this implementation, when the folding screen is converted from an unfolded form to a semi-folded form, the audio of the two contents is output without interfering with each other according to the audio setting information of the first screen and the second screen, thereby realizing the combination of the semi-folded form of the folding screen and the scene of multiple people watching content, thereby improving the user experience of the scene of multiple people watching content.

[0192] In one possible implementation, after detecting a folding operation, electronic device 100 displays at least one application icon on the first screen and the second screen, respectively. A user of the first screen can select a desired application icon from at least one application icon displayed on the first screen, and electronic device 100 runs a corresponding application and displays a corresponding application interface in response to the user operation. Similarly, a user of second screen 102 can select a desired application icon from at least one application icon displayed on the second screen, and electronic device 100 runs a corresponding application and displays a corresponding application interface in response to the user operation, so as to display first video content on first screen 101 and second video content on second screen 102, and perform audio output and / or sound pickup according to audio setting information of first screen 101 and second screen 102.

[0193] For example, see Figure 6B Another schematic diagram of the operation process of a two-person audio and video scene is shown, and Fig. 6ASimilarly, the electronic device 100 displays a main interface in the expanded state, and the main interface includes application icons such as video application 109, smooth call 111, music 112 and setting 113. The user inputs a folding operation to the electronic device 100 to convert the electronic device 100 from the expanded state to the semi-folded state. When the electronic device 100 detects the conversion from the expanded state to the semi-folded state, the application icons such as video application 109, smooth call 111 and music 112 are displayed on the first screen 101, and the application icons such as video application 109, smooth call 111, music 112 and setting 113 are displayed on the second screen 102. Optionally, the application icons displayed on the first screen 101 and the second screen 102 are associated with the user account, and the user can pre-set the displayed application icons.

[0194] A user of the first screen 101 can select a desired application icon from at least one application icon displayed on the first screen 101, and the electronic device 100 runs the corresponding application and displays the corresponding application interface in response to the user operation; similarly, a user of the second screen 102 can select a desired application icon from at least one application icon displayed on the second screen 102, and the electronic device 100 runs the corresponding application and displays the corresponding application interface in response to the user operation.

[0195] In a two-person audio and video scenario, the first user inputs a play operation to the first screen 101, which is a series of operations for the video application 109, for example, clicking the application icon of the video application 109 to open the interface of the video application 109, and then selecting the video to be played in the interface of the video application 109. The electronic device 100 displays the video play interface on the first screen 101 in response to the play operation input by the user on the first screen 101. Similarly, the second user inputs a play operation to the second screen 102, which is a series of operations for the smooth call 111. The electronic device 100 displays the video call interface on the second screen 102 in response to the play operation input by the user on the second screen 102. In addition, when the electronic device 100 displays video content on the first screen 101 and the second screen 102 respectively, it can perform audio output and sound pickup according to the audio setting information of the first screen 101 and the second screen 102.

[0196] It is understandable that the user can preset whether to enter the hover space mode in the semi-folded state. In the hover space mode, the electronic device 100 displays at least one application icon on the first screen 101 and at least one application icon on the second screen 102 .

[0197] In one possible implementation, the electronic device 100 supports the naked-eye 3D viewing function, can play naked-eye 3D movies, and achieve the naked-eye 3D effect. In order to better allow the user to determine the naked-eye 3D viewing angle, the electronic device 100 can also provide naked-eye 3D display prompts through the folding screen, allowing the user to quickly fold the folding screen to the naked-eye 3D viewing angle. Specifically, if the folding screen is in the naked-eye 3D display mode, the electronic device 100 obtains the angle between the first screen and the second screen. If it is determined that the current angle does not fall within the preset angle range, a first prompt operation is performed. The first prompt operation is used to prompt the user to continue the folding operation to adjust the angle between the first screen and the second screen. Among them, the folding operation can be an inward folding or an outward folding.

[0198] When the user adjusts the angle according to the first prompt operation, if the electronic device 100 detects that the angle falls within the preset angle range, the second prompt operation is performed, and the second prompt operation is used to prompt that the angle has fallen within the preset angle range. The preset angle range is the visible angle range of the naked eye 3D image, and the naked eye 3D visible angle range is pre-set.

[0199] The first prompt operation may include at least one of the following: playing a prompt tone, a visual prompt, and a vibration prompt. Playing a prompt tone refers to playing a corresponding prompt tone through the speaker of the electronic device 100. For example, when the electronic device 100 detects that the current angle does not fall within the preset angle range, it outputs a prompt tone "Please change the folding angle". The visual prompt may refer to the electronic device 100 displaying a visible pattern on the interface, and displaying the visible pattern in different forms according to different angles, that is, different angles correspond to different visible pattern forms, so as to prompt the user of the current angle through different visible pattern forms. The vibration prompt may refer to the electronic device 100 controlling the motor to perform different vibrations according to the angle, so as to represent different angles through different vibration feedback.

[0200] Similarly, the second prompt operation may also include at least one of the following: playing a prompt sound, a visual prompt, and a vibration prompt.

[0201] It can be seen that the electronic device 100 continuously prompts the user to adjust the folding angle of the folding screen through prompting operations, which can conveniently and quickly help the user find the viewing angle range of the naked-eye 3D image, thereby improving the user interaction experience in audio and video scenarios.

[0202] In a possible implementation, while the user is adjusting the angle according to the first prompt operation and before performing the second prompt operation, the electronic device 100 can also display the corresponding form of the visible pattern on the first screen or the second screen according to the real-time angle, wherein the corresponding form of the visible pattern is different for different angles. In other words, the embodiment of the present application can provide real-time visual prompts during the user's adjustment of the angle, so as to display different forms of the visual pattern during the user's adjustment of the folding angle, further improving the user interaction experience in the audio and video scene.

[0203] In some embodiments, if the electronic device 100 detects that the angle between the first screen and the second screen does not fall within the preset angle range, it plays a first prompt sound and displays the shape corresponding to the current angle of the visible pattern on the first screen or the second screen. The first prompt sound is used to prompt the user to adjust the angle so that the visible pattern is displayed in the target shape.

[0204] If the electronic device 100 detects that the angle between the first screen and the second screen falls within the preset angle range, it performs at least one of the following prompt operations: playing a second prompt sound, vibrating, and displaying a target form of a visible pattern on the first screen or the second screen, wherein the second prompt sound is used to prompt that the angle has fallen within the preset angle range, and the target form is used to indicate that the angle has fallen within the preset angle range. In this way, a combination of multiple prompt methods such as sound, vibration, and vision can better prompt the user to adjust the folding angle to the visible angle range of the naked eye 3D image.

[0205] For example, see Fig. 7A A prompt schematic diagram of naked-eye 3D display is shown, in which the electronic device 100 is folded inward. At this time, the electronic device 100 detects that the current angle between the first screen 101 and the second screen is 60°, which does not fall within the preset angle range, and displays the visible pattern 116 on the first screen, and outputs the first prompt sound "Please change the folding angle so that the sphere is full of blue". The sphere refers to the visible pattern 116, and the shaded part of the sphere refers to the blue part. Among them, different angles correspond to different proportions of blue parts. When the naked-eye 3D viewing angle is reached, the entire sphere is shaded, that is, the sphere is full of blue.

[0206] After the user continues to fold the electronic device 100, the electronic device 100 detects that the current angle is 90°, which falls within the preset viewing angle range, and outputs a second prompt tone "The 3D viewing angle has been reached, and you can watch the 3D movie", and displays the target form of the visible pattern 116 on the first screen 101. At this time, the target form of the visible pattern is a sphere filled with shadows.

[0207] For example, see Figure 7BA prompt schematic diagram of naked-eye 3D display is shown, in which the electronic device 100 is folded in an outward folding manner. At this time, the electronic device 100 detects that the current angle between the first screen 101 and the second screen is 60°, which does not fall within the preset angle range, and displays the visible pattern 116 on the first screen, and outputs the first prompt tone "Please change the folding angle so that the sphere is full of blue". After the user continues to fold the electronic device 100, the electronic device 100 detects that the current angle is 90°, which falls within the preset viewing angle range, and outputs the second prompt tone "The 3D viewing angle has been reached, and you can watch 3D movies", and displays the target form of the visible pattern 116 on the first screen 101. At this time, the target form of the visible pattern is a sphere full of shadows.

[0208] In a possible implementation, in order for the electronic device 100 to achieve the naked-eye 3D effect, in addition to adjusting the folding angle of the folding screen to a preset angle range, the relative position and relative distance between the user and the folding screen must be within a reasonable range, so that the user can view the naked-eye 3D image. In some embodiments, the relative position and relative distance between the user and the folding screen both fall within the preset range, and at this time the user can only adjust the folding angle of the folding screen without adjusting the relative position and relative distance; in other embodiments, if at least one of the relative position and relative distance between the user and the folding screen does not fall within the preset range, in addition to adjusting the folding screen angle of the folding screen, at least one of the relative position and relative distance may also need to be adjusted.

[0209] The preset range is used to characterize the visible range of naked-eye 3D images. Generally, the preset range includes a preset azimuth range and a preset distance range. When the relative azimuth between the user and the folding screen falls within the preset azimuth range, the relative distance between the user and the folding screen falls within the preset distance range, and the folding screen angle of the folding screen is within the preset angle range, the user can view the naked-eye 3D image.

[0210] At this time, the electronic device 100 first determines the relative position and relative distance between the user and the folding screen, and then determines whether the relative position falls within the preset position range and whether the relative distance falls within the preset distance range. If the current relative position does not fall within the preset position range, the user is prompted to move in a certain direction based on the difference between the preset position range and the current relative position; if the current relative distance does not fall within the preset distance range, the user is prompted to move closer to or farther from the folding screen based on the difference between the preset distance range and the relative distance. For example, the folding screen can prompt the user to move a corresponding distance in a certain direction by playing a prompt voice.

[0211] In some embodiments, the electronic device 100 can capture user images through a camera, process the user images, and identify the relative position and relative distance between the user in the image and the folding screen.

[0212] When prompting the user to adjust the orientation and distance, the electronic device 100 can prompt in at least one of the following ways: voice prompt, visual prompt and vibration prompt. The voice prompt can be, for example, playing a prompt voice, and the prompt voice can be, for example, "Please rotate the folding screen to the right or left, or tilt the folding screen forward or backward", or "Please move left or right". The visual prompt can be, for example, displaying prompt text, etc.

[0213] It is understandable that when adjusting the relative position and distance between the user and the folding screen, the user can remain still and adjust the relative position and distance by adjusting the position and angle of the folding screen. Of course, the position and angle of the folding screen can also remain unchanged, and the user can adjust his or her position and angle to adjust the relative position and distance.

[0214] Typically, prompting the user to adjust the folding angle of the folding screen and prompting the user to adjust the relative position and relative distance are performed in steps. For example, you can first prompt the user to adjust the folding angle, and then prompt the user to adjust the relative position and relative distance.

[0215] After the electronic device 100 is folded to the naked-eye 3D viewing angle range and the relative orientation and relative distance between the user and the folding screen are within the preset range, the user can play the corresponding 3D video at the folding angle and watch the naked-eye 3D image on the folding screen, thus achieving the naked-eye 3D effect.

[0216] Corresponding to the audio and video processing method of the folding screen device described in the above embodiment, Figure 8 The structure block diagram of the electronic device 100 provided by the embodiment of the present application is shown. For the convenience of description, only the parts related to the embodiment of the present application are shown.

[0217] Reference Figure 8 The electronic device provided in the embodiment of the present application may include but is not limited to: a folding screen 81, an angle detection sensor 82, a processor 83 and a memory 84. The folding screen 81 can be folded into at least two screens, the at least two screens include a first screen and a second screen, the memory 84 is used to store a computer program that can be run on the processor; the angle detection sensor 82 is used to detect the angle between the first screen and the second screen.

[0218] When the processor 83 executes the computer program, the following steps are implemented: when the folding screen is in a semi-folded state, the first content is displayed on the first screen, and the audio of the first content is output through the first audio output device, and the second content is displayed on the second screen, and the audio of the second content is output through the second audio output device.

[0219] Among them, the first audio output device is a first directional sound unit or a first earphone, and the second audio output device is a second directional sound unit or a second earphone; the first directional sound unit is used to direct sound in a first direction, and the second directional sound unit is used to direct sound in a second direction, the first direction is the direction in which the light emitting surface of the first screen is facing, and the second direction is the direction in which the light emitting surface of the second screen is facing.

[0220] In one possible implementation, the processor 83 specifically implements the following steps when executing the computer program: picking up the voice of the first user through the first sound pickup device and / or picking up the voice of the second user through the second sound pickup device; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone.

[0221] In a possible implementation, the first audio output device is a first directional sound-emitting unit or a first earphone, and the second audio output device is a second directional sound-emitting unit or a second earphone; the first sound pickup device is a first directional sound pickup unit or a first earphone, and the second sound pickup device is a second directional sound pickup unit or a second earphone.

[0222] In a possible implementation manner, the first content is a first video content and / or the second content is a second video content.

[0223] In a possible implementation, the processor 83 specifically implements the following steps when executing the computer program: outputting the audio of the first content through the first audio output device according to the audio setting information of the first screen; and outputting the audio of the second content through the second audio output device according to the audio setting information of the second screen.

[0224] In a possible implementation, the processor 83 specifically implements the following steps when executing the computer program:

[0225] If it is determined according to the audio setting information of the first screen that the sound emission mode of the first screen is directional sound emission and the sound pickup mode of the first screen is directional sound pickup, the sound emission direction is determined, the first directional sound emission unit is controlled to output the audio of the first content in the sound emission direction, the sound source direction of the first user's voice is determined, and the first directional sound pickup unit is controlled to collect the sound data to be processed, enhance the target sound signal in the sound source direction of the sound data to be processed, and remove or suppress the sound signal in the non-sound source direction; if it is determined according to the audio setting information of the second screen that the sound emission mode and the sound pickup mode of the second screen are headphones, the audio of the second content is output and the voice of the second user is picked up through the second headphones.

[0226] Among them, the first audio output device is a first directional sound-emitting unit, the first sound pickup device is a first directional sound pickup unit, and the second audio output device and the second sound pickup device are second headphones.

[0227] In a possible implementation, the processor 83 further implements the following steps when executing the computer program:

[0228] Display the setting interface, which includes audio setting options on the first screen and audio setting options on the second screen;

[0229] In response to the setting operation, the audio output mode and / or sound pickup mode of the first screen is set, and the audio output mode and / or sound pickup mode of the second screen is set, and the audio setting information of the first screen and the audio setting information of the second screen are obtained. The setting operation is an operation for the audio setting options of the first screen and the audio setting options of the second screen.

[0230] In a possible implementation, the processor 83 further implements the following steps when executing the computer program: in response to a first operation, the audio setting options of the target screen are displayed on the first screen, and in response to the operation on the audio setting options of the target screen, the audio output mode and / or the sound pickup mode of the target screen are adjusted, and the first operation is an operation for calling out the audio setting options of the target screen; and / or, in response to a second operation, the audio setting options of the target screen are displayed on the second screen, and in response to the operation on the audio setting options of the target screen, the audio output mode and / or the sound pickup mode of the target screen are adjusted, and the second operation is an operation for calling out the audio setting options of the target screen. The target screen is at least one of the first screen and the second screen.

[0231] In a possible implementation, the processor 83 further implements the following steps when executing the computer program:

[0232] When the folding screen is in the unfolded state, in response to the split-screen operation, a first interface is displayed in a first screen area of ​​the folding screen, and a second interface is displayed in a second screen area of ​​the folding screen, wherein the first interface and the second interface are interfaces of different applications or different interfaces of the same application;

[0233] In response to the play operation, display the first content on the first interface and display the second content on the second interface respectively;

[0234] If the folding screen is converted from the unfolded state to the semi-folded state, the following steps are performed: the first content is displayed on the first screen, and the audio of the first content is output through the first audio output device, and the second content is displayed on the second screen, and the audio of the second content is output through the second audio output device.

[0235] In a possible implementation, the processor 83 further implements the following steps when executing the computer program:

[0236] If the folding screen is in the naked eye 3D display mode, obtain the angle between the first screen and the second screen;

[0237] If it is detected that the angle does not fall within the preset angle range, a first prompt operation is performed, and the first prompt operation is used to prompt the user to adjust the angle;

[0238] During the process of the user adjusting the angle according to the first prompt operation, if it is detected that the angle falls within the preset angle range, a second prompt operation is performed, and the second prompt operation is used to prompt that the angle has fallen within the preset angle range;

[0239] The preset angle range is the visible angle range of the naked eye 3D image.

[0240] In a possible implementation, the processor 83 specifically implements the following steps when executing the computer program:

[0241] If it is detected that the angle does not fall within the preset angle range, a first prompt sound is played, and the shape corresponding to the current angle of the visible pattern is displayed on the first screen or the second screen. The first prompt sound is used to prompt the user to adjust the angle so that the visible pattern is displayed in the target shape; at this time, the first prompt operation includes playing the first prompt sound and displaying the corresponding shape of the visible pattern.

[0242] When the user adjusts the angle according to the first prompt operation and before performing the second prompt operation, the corresponding form of the visible pattern is displayed on the first screen or the second screen according to the real-time angle, wherein the corresponding form of the visible pattern is different for different angles.

[0243] If it is detected that the angle falls within the preset angle range, at least one of the following prompt operations is performed: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen, wherein the second prompt sound is used to prompt that the angle has fallen within the preset angle range, and the target form is used to indicate that the angle has fallen within the preset angle range. At this time, the second prompt operation includes at least one of the following: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen.

[0244] In one possible implementation, the processor 83 specifically implements the following steps when executing the computer program: determining the relative orientation and relative distance between the user and the folding screen; if the relative orientation and / or relative distance does not fall within a preset range, performing a third prompt operation, the third prompt operation being used to prompt the user to adjust the relative orientation and relative distance between the user and the folding screen, and the preset range is used to characterize the visible range of the naked-eye 3D image.

[0245] It should be noted that the above Figure 8 As the related contents are based on the same concept as the method embodiments of the present application, their specific functions and technical effects can be found in the method embodiments section and will not be described in detail here.

[0246] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0247] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to an electronic device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0248] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0249] In the embodiments provided in the present application, it should be understood that the disclosed devices, electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0250] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0251] The electronic device provided in the embodiments of the present application may include a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a method as described in any one of the above method embodiments is implemented.

[0252] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0253] An embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0254] The present application also provides a chip system, which includes a processor coupled to a memory, and the processor executes a computer program stored in the memory to implement the methods described in the above method embodiments. The chip system can be a single chip or a chip module composed of multiple chips.

[0255] In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For the part that is not described or recorded in detail in a certain embodiment, please refer to the relevant description of other embodiments. It should be understood that the size of the sequence number of each step in the above-mentioned embodiment does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. In addition, in the description of the present application specification and the attached claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance. The reference "one embodiment" or "some embodiments" described in the present application specification means that one or more embodiments of the present application include specific features, structures or characteristics described in combination with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in the different places in this specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.

[0256] Among them, "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" refers to two or more than two.

[0257] Finally, it should be noted that the above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for processing audio and video of a folding screen device, characterized in that: Applied to an electronic device including a folding screen, the folding screen can be folded into at least two screens, the at least two screens include a first screen and a second screen, the method includes: When the folding screen is in a half-folded state, first content is displayed on the first screen, and audio of the first content is output through a first audio output device, and second content is displayed on the second screen, and audio of the second content is output through a second audio output device; Wherein, the first audio output device is a first directional sound unit or a first earphone, and the second audio output device is a second directional sound unit or a second earphone; The first directional sound emitting unit is used for emitting sound in a first direction, and the second directional sound emitting unit is used for emitting sound in a second direction. The first direction is the direction in which the light emitting surface of the first screen faces, and the second direction is the direction in which the light emitting surface of the second screen faces.

2. The method according to claim 1, characterized in that The method further comprises: Picking up the voice of the first user through the first sound pickup device and / or picking up the voice of the second user through the second sound pickup device; The first sound pickup device is a first directional sound pickup unit or the first earphone, and the second sound pickup device is a second directional sound pickup unit or the second earphone.

3. The method according to claim 1, characterized in that The first content is a first video content and / or the second content is a second video content.

4. The method according to claim 1, characterized in that: Outputting the audio of the first content through a first audio output device, and outputting the audio of the second content through a second audio output device, comprises: outputting the audio of the first content through the first audio output device according to the audio setting information of the first screen; According to the audio setting information of the second screen, the audio of the second content is output through the second audio output device.

5. The method according to claim 4, characterized in that The method further comprises: Displaying a setting interface, the setting interface including the audio setting options of the first screen and the audio setting options of the second screen; In response to a setting operation, the audio output mode and / or sound pickup mode of the first screen is set, and the audio output mode and / or sound pickup mode of the second screen is set, and the audio setting information of the first screen and the audio setting information of the second screen are obtained. The setting operation is an operation for the audio setting options of the first screen and the audio setting options of the second screen.

6. The method according to claim 1, characterized in that After the first content is displayed on the first screen and the second content is displayed on the second screen, the method further includes: In response to a first operation, an audio setting option of a target screen is displayed on the first screen, and in response to an operation on the audio setting option of the target screen, an audio output mode and / or a sound pickup mode of the target screen is adjusted, wherein the first operation is an operation for calling out the audio setting option of the target screen, and the target screen is at least one of the first screen and the second screen; And / or, in response to a second operation, the audio setting options of the target screen are displayed on the second screen, and in response to the operation on the audio setting options of the target screen, the audio output mode and / or pickup mode of the target screen is adjusted, and the second operation is an operation for calling up the audio setting options of the target screen.

7. The method according to any one of claims 1 to 6, characterized in that: Before displaying the first content on the first screen and displaying the second content on the second screen, the method further includes: When the folding screen is in the unfolded state, in response to a split-screen operation, a first interface is displayed in a first screen area of ​​the folding screen, and a second interface is displayed in a second screen area of ​​the folding screen, wherein the first interface and the second interface are interfaces of different applications or different interfaces of the same application; In response to a play operation, displaying the first content on the first interface and displaying the second content on the second interface respectively; If the folding screen is converted from the unfolded form to the semi-folded form, the following steps are performed: displaying the first content on the first screen and outputting the audio of the first content through a first audio output device, and displaying the second content on the second screen and outputting the audio of the second content through a second audio output device.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: If the folding screen is in the naked eye 3D display mode, obtaining an angle between the first screen and the second screen; If it is detected that the angle does not fall within the preset angle range, a first prompt operation is performed, where the first prompt operation is used to prompt the user to adjust the angle; During the process of the user adjusting the angle according to the first prompt operation, if it is detected that the angle falls within the preset angle range, a second prompt operation is performed, wherein the second prompt operation is used to prompt that the angle has fallen within the preset angle range; The preset angle range is the visible angle range of the naked eye 3D image.

9. The method according to claim 8, characterized in that If it is detected that the angle does not fall within the preset angle range, a first prompt operation is performed, including: If it is detected that the angle does not fall within the preset angle range, a first prompt sound is played, and a shape corresponding to the current angle of the visible pattern is displayed on the first screen or the second screen, wherein the first prompt sound is used to prompt the user to adjust the angle so that the visible pattern is displayed in a target shape, and the first prompt operation includes playing the first prompt sound and displaying the corresponding shape of the visible pattern; During the process of the user adjusting the angle according to the first prompt operation and before performing the second prompt operation, the method further includes: According to the real-time angle, displaying a corresponding form of the visible pattern on the first screen or the second screen, wherein the corresponding form of the visible pattern is different when the angle is different; If it is detected that the angle falls within the preset angle range, a second prompt operation is performed, including: If it is detected that the angle falls within the preset angle range, at least one of the following prompt operations is performed: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen, wherein the second prompt sound is used to prompt that the angle has fallen within the preset angle range, and the target form is used to characterize that the angle has fallen within the preset angle range, and the second prompt operation includes at least one of the following: playing the second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: Determining the relative position and relative distance between the user and the folding screen; If the relative position and / or the relative distance does not fall within the preset range, a third prompt operation is performed, wherein the third prompt operation is used to prompt the user to adjust the relative position and relative distance between the user and the folding screen, and the preset range is used to characterize the visible range of the naked-eye 3D image.

11. An electronic device, characterized in that: The invention comprises a folding screen, a processor and a memory, wherein the folding screen can be folded into at least two screens, wherein the at least two screens include a first screen and a second screen, and the memory is used to store a computer program that can be run on the processor; When the processor executes the computer program, the following steps are implemented: When the folding screen is in a half-folded state, the first screen displays first content, and the audio of the first content is output through the first audio output device, and the second screen displays second content, and the audio of the second content is output through the second audio output device; Wherein, the first audio output device is a first directional sound unit or a first earphone, and the second audio output device is a second directional sound unit or a second earphone; The first directional sound emitting unit is used for emitting sound in a first direction, and the second directional sound emitting unit is used for emitting sound in a second direction. The first direction is the direction in which the light emitting surface of the first screen faces, and the second direction is the direction in which the light emitting surface of the second screen faces.

12. The electronic device according to claim 11, characterized in that: When the processor executes the computer program, the following steps are specifically implemented: Picking up the voice of the first user through the first sound pickup device and / or picking up the voice of the second user through the second sound pickup device; The first sound pickup device is a first directional sound pickup unit or the first earphone, and the second sound pickup device is a second directional sound pickup unit or the second earphone.

13. The electronic device according to claim 11, characterized in that: The first content is a first video content and / or the second content is a second video content.

14. The electronic device according to claim 11, characterized in that: When the processor executes the computer program, the following steps are specifically implemented: outputting the audio of the first content through the first audio output device according to the audio setting information of the first screen; According to the audio setting information of the second screen, the audio of the second content is output through the second audio output device.

15. The electronic device according to claim 14, characterized in that: When the processor executes the computer program, the following steps are also implemented: Displaying a setting interface, the setting interface including the audio setting options of the first screen and the audio setting options of the second screen; In response to a setting operation, the audio output mode and / or sound pickup mode of the first screen is set, and the audio output mode and / or sound pickup mode of the second screen is set, and the audio setting information of the first screen and the audio setting information of the second screen are obtained. The setting operation is an operation for the audio setting options of the first screen and the audio setting options of the second screen.

16. The electronic device according to claim 11, characterized in that: When the processor executes the computer program, the following steps are also implemented: In response to a first operation, an audio setting option of a target screen is displayed on the first screen, and in response to an operation on the audio setting option of the target screen, an audio output mode and / or a sound pickup mode of the target screen is adjusted, wherein the first operation is an operation for calling out the audio setting option of the target screen, and the target screen is at least one of the first screen and the second screen; And / or, in response to a second operation, the audio setting options of the target screen are displayed on the second screen, and in response to the operation on the audio setting options of the target screen, the audio output mode and / or pickup mode of the target screen is adjusted, and the second operation is an operation for calling up the audio setting options of the target screen.

17. The electronic device according to any one of claims 11 to 16, characterized in that: When the processor executes the computer program, the following steps are also implemented: When the folding screen is in the unfolded state, in response to a split-screen operation, a first interface is displayed in a first screen area of ​​the folding screen, and a second interface is displayed in a second screen area of ​​the folding screen, wherein the first interface and the second interface are interfaces of different applications or different interfaces of the same application; In response to a play operation, displaying the first content on the first interface and displaying the second content on the second interface respectively; If the folding screen is converted from the unfolded form to the semi-folded form, the following steps are performed: displaying the first content on the first screen and outputting the audio of the first content through a first audio output device, and displaying the second content on the second screen and outputting the audio of the second content through a second audio output device.

18. The electronic device according to any one of claims 11 to 17, characterized in that: When the processor executes the computer program, the following steps are also implemented: If the folding screen is in the naked eye 3D display mode, obtaining an angle between the first screen and the second screen; If it is detected that the angle does not fall within the preset angle range, a first prompt operation is performed, where the first prompt operation is used to prompt the user to adjust the angle; During the process of the user adjusting the angle according to the first prompt operation, if it is detected that the angle falls within the preset angle range, a second prompt operation is performed, wherein the second prompt operation is used to prompt that the angle has fallen within the preset angle range; The preset angle range is the visible angle range of the naked eye 3D image.

19. The electronic device according to claim 18, characterized in that: When the processor executes the computer program, the following steps are specifically implemented: If it is detected that the angle does not fall within the preset angle range, a first prompt sound is played, and a shape corresponding to the current angle of the visible pattern is displayed on the first screen or the second screen, wherein the first prompt sound is used to prompt the user to adjust the angle so that the visible pattern is displayed in a target shape, and the first prompt operation includes playing the first prompt sound and displaying the corresponding shape of the visible pattern; When the user adjusts the angle according to the first prompt operation and before performing the second prompt operation, a corresponding form of the visible pattern is displayed on the first screen or the second screen according to the real-time angle, wherein the corresponding form of the visible pattern is different when the angle is different; If it is detected that the angle falls within the preset angle range, at least one of the following prompt operations is performed: playing a second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen, wherein the second prompt sound is used to prompt that the angle has fallen within the preset angle range, and the target form is used to characterize that the angle has fallen within the preset angle range, and the second prompt operation includes at least one of the following: playing the second prompt sound, vibrating, and displaying the target form of the visible pattern on the first screen or the second screen.

20. The electronic device according to any one of claims 11 to 18, characterized in that: When the processor executes the computer program, the following steps are also implemented: Determining the relative position and relative distance between the user and the folding screen; If the relative position and / or the relative distance does not fall within the preset range, a third prompt operation is performed, wherein the third prompt operation is used to prompt the user to adjust the relative position and relative distance between the user and the folding screen, and the preset range is used to characterize the visible range of the naked-eye 3D image.

21. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images