Control method and media output device

Abstract

The present application discloses a control method and a media output device. The method comprises: if a media output device is in a first spatial attitude, outputting first display content corresponding to the first spatial attitude, and by means of a first audio parameter, outputting first audio content corresponding to the first display content; obtaining parameter information representing the spatial attitude of the media output device; and if the parameter information represents that the media output device switches from the first spatial attitude to a second spatial attitude, at least on the basis of the parameter information, enabling the media output device to output second display content corresponding to the second spatial attitude, and outputting the first audio content by means of a second audio parameter, wherein the first display content is different from the second display content, and the first audio parameter is more significant than the second audio parameter.

Description

A control method and media output device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on July 31, 2023, with application number 202310953231.3 and invention name “A Control Method and Media Output Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and more particularly to a control method and a media output device. Background Art

[0003] When a media output device outputs multiple display contents with audio, it is difficult for a user to quickly distinguish the audio corresponding to a specific display content, which reduces the user experience.

[0004] Summary of the Invention

[0005] In view of this, this application provides the following technical solutions:

[0006] A control method, comprising:

[0007] If the media output device is in a first spatial posture, outputting first display content corresponding to the first spatial posture, and outputting first audio content corresponding to the first display content with first audio parameters;

[0008] Obtaining parameter information representing the spatial posture of the media output device;

[0009] If the parameter information indicates that the media output device switches from the first spatial posture to the second spatial posture, causing the media output device to output second display content corresponding to the second spatial posture and output the first audio content using second audio parameters at least based on the parameter information;

[0010] The first display content is different from the second display content, and the first audio parameter is more significant than the second audio parameter.

[0011] Optionally, causing the media output device to output second display content corresponding to the second spatial posture at least according to the parameter information includes:

[0012] At least based on the parameter information, the media output device outputs the second display content corresponding to the second spatial posture, and outputs the second audio content corresponding to the second display content with a fourth audio parameter, wherein the fourth audio parameter is more significant than the third audio parameter, and the third audio parameter represents the audio parameter of the second audio content corresponding to the second display content when the media output device is in the first spatial posture.

[0013] Optionally, it also includes:

[0014] In response to the media output device being in a second spatial posture, simultaneously outputting at least the first audio content and the second audio content;

[0015] The at least simultaneously outputting the first audio content and the second audio content includes:

[0016] In response to at least the first audio content and the second audio content being simultaneously output, the first audio content of the second audio parameter and the second audio content of the fourth audio parameter are mixed, and the mixed first audio content and second audio content are output.

[0017] Optionally, outputting the first audio content using the second audio parameter includes:

[0018] Based on a spatial posture relationship between the first spatial posture and the second spatial posture, a second audio parameter is determined, and the first audio content is output with the second audio parameter.

[0019] Optionally, determining the second audio parameter based on the spatial posture relationship between the first spatial posture and the second spatial posture includes:

[0020] determining, based on a spatial posture relationship between the first spatial posture and the second spatial posture, an association relationship between a first display area for outputting the first display content and a second display area for outputting the second display content;

[0021] Based on the association relationship, a second audio parameter is determined.

[0022] Optionally, the association relationship includes a positional relationship between the first display area and the second display area, and determining the second audio parameter based on the association relationship includes:

[0023] If the positional relationship indicates that the distance between the first display area and the second display area is within a first range, determining a second audio parameter based on the first audio parameter range, wherein, when the media output device outputs second display content corresponding to the second spatial posture, an audio parameter of second audio content corresponding to the second display content is significantly greater than any audio parameter within the first audio parameter range, and a magnitude of the second audio parameter matches a magnitude of the distance;

[0024] If the positional relationship indicates that the distance between the first display area and the second display area is within a second range, a second audio parameter is determined, where the second audio parameter indicates an audio parameter for not outputting the first audio content.

[0025] Optionally, outputting the second audio content corresponding to the second display content using the fourth audio parameter includes:

[0026] If the second display content corresponding to the second spatial posture output by the media output device is a partial content of the second content, determining the fourth audio parameter based on a proportion of the second display content in the second content;

[0027] The second audio content corresponding to the second display content is output using the fourth audio parameter.

[0028] Optionally, outputting the second audio content corresponding to the second display content using the fourth audio parameter includes:

[0029] In response to the second display content corresponding to the second spatial gesture output by the media output device including at least partial content of third content and at least partial content of fourth content, determining, based on the proportion information corresponding to the at least partial content of the third content and the at least partial content of the fourth content, a fifth audio parameter of third audio content corresponding to the third content and a sixth audio parameter of fourth audio content corresponding to the fourth content, respectively;

[0030] The third audio content of the fifth audio parameter and the fourth audio content of the sixth audio parameter are output simultaneously.

[0031] Optionally, causing the media output device to output second display content corresponding to the second spatial posture and output the first audio content using second audio parameters at least according to the parameter information includes:

[0032] The media output device is enabled to output second display content corresponding to the second spatial posture according to the parameter information and the identification information, and to output the first audio content using second audio parameters.

[0033] Optionally, the identification information includes an audio output identification, wherein outputting the first audio content using the second audio parameter includes:

[0034] If there is a first audio output identifier corresponding to the first audio content, output the first audio content using the first audio parameter;

[0035] If there is no first audio output identifier corresponding to the first audio content, the first audio content is output using a second audio frequency parameter.

[0036] Optionally, the identification information includes a display output identifier, wherein causing the media output device to output second display content corresponding to the second spatial posture and output the first audio content using second audio parameters based on the parameter information and the identification information includes:

[0037] If there is a first display output identifier corresponding to the first display content, the media output device is enabled to output second display content corresponding to the second spatial gesture according to the parameter information and the first display output identifier, wherein the second display content includes at least partial content of the first display content.

[0038] A media output device, comprising:

[0039] an obtaining device for obtaining parameter information, wherein the parameter information is capable of determining a spatial posture related to the media output device;

[0040] an output device for outputting display content corresponding to the spatial posture and audio content corresponding to the display content;

[0041] a processing device configured to generate a first processing signal corresponding to a first spatial posture and a second processing signal corresponding to a second spatial posture, wherein the first processing signal is configured to control the output device to output first display content corresponding to the first spatial posture and to output first audio content corresponding to the first display content using first audio parameters; and the second processing signal is configured to control the output device to output second display content corresponding to the second spatial posture and to output the first audio content using second audio parameters;

[0042] The first display content is different from the second display content, and the first audio parameter is more significant than the second audio parameter.

[0043] Optionally, it also includes:

[0044] a wearable component for maintaining a relative positional relationship between the media output device and at least a portion of a user's body;

[0045] Wherein, the obtaining device includes a collecting sub-device, and the collecting sub-device is used to collect parameter information representing the spatial posture of the media output device;

[0046] The output device includes a display sub-device and a speaker, wherein the display sub-device is used to display display content corresponding to the spatial posture, and the speaker is used to play audio content corresponding to the display content;

[0047] Among them, the first processing signal generated by the processing device is used to control the display sub-device to display the first display content corresponding to the first spatial posture, and control the speaker to play the first audio content corresponding to the first display content with first audio parameters; the second processing signal generated by the processing device is used to control the display sub-device to display the second display content corresponding to the second spatial posture, and control the speaker to play the first audio content with second audio parameters.

[0048] Optionally, it also includes:

[0049] A communication device for communicating with a wearable device;

[0050] The obtaining device includes a receiving sub-device, and the receiving sub-device is used to receive parameter information representing the spatial posture of the wearable device;

[0051] The output device includes a transmission sub-device, and the transmission sub-device is used to transmit display content corresponding to the spatial posture and audio content corresponding to the display content to the wearable device;

[0052] Among them, the first processing signal generated by the processing device is used to control the transmission sub-device to transmit the first display content corresponding to the first spatial posture to the wearable device, and to transmit the first audio content corresponding to the first display content to the wearable device with the first audio parameter; the second processing signal generated by the processing device is used to control the transmission sub-device to transmit the second display content corresponding to the second spatial posture to the wearable device, and to transmit the first audio content to the wearable device with the second audio parameter. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without any creative work.

[0054] FIG1 is a flow chart of a control method provided in an embodiment of the present application;

[0055] FIG2 is a schematic diagram of a virtual display area corresponding to an AR / VR head-mounted display device provided in an embodiment of the present application;

[0056] FIG3 is a schematic diagram of a display area of ​​an AR / VR head-mounted display device provided in an embodiment of the present application;

[0057] FIG4 is a schematic diagram of a second display content provided in an embodiment of the present application;

[0058] FIG5 is a schematic diagram of another second display content provided in an embodiment of the present application;

[0059] FIG6 is a schematic diagram of a scenario provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0061] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In addition, the terms "including" and "having" and any variations thereof mentioned in the description of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not limited to the listed steps or modules, but may optionally include other steps or modules that are not listed, or may optionally include other steps or modules that are inherent to these processes, methods, products or devices.

[0062] In application scenarios that utilize media data, the media data may include image data, audio data, text data, or combined data, such as video data including images and audio. Correspondingly, the media data can be output through a media output device. Since the media output device can have multiple functions, it can match a variety of application scenarios. For example, in general application scenarios, the media output device can be an electronic device with a physical display screen and speakers, such as a laptop. In application scenarios that require specific displays, the media output device can be a projection device that can achieve large-screen display, or a VR (Virtual Reality) device or AR (Augmented Reality) device that allows users to experience three-dimensional display effects. The media output device in the embodiment of the present application may include a device whose own spatial posture can be changed, or it may refer to a device connected to the media output device that can have different spatial postures. For example, if the media output device is a laptop, when the spatial posture of a wearable device that is in communication with the laptop changes, it can also be understood as a spatial posture related to the laptop. The change in spatial posture may include a change in spatial coordinate position, a change in spatial angle, a change in the spatial orientation of a specific component, or a change resulting from a combination of the above information. The change in the spatial posture of the media output device may be caused by a control operation, or by a change in the posture of an object on which the media output device is mounted. For example, if the media output device is a head-mounted device, the spatial posture of the head-mounted device may also change when the posture of the user wearing the head-mounted device changes.

[0063] When the media output device is a projection device with an adjustable three-dimensional position, the three-dimensional position refers to the spatial position of the projection device. For example, the projection device is installed at a certain position in space through a movable component, and the user can control the movement position of the movable component through a remote control or other sensor component, thereby changing the position of the projection device in space. When the user changes the spatial position of the projection device through the operating component of the projection device, the spatial posture of the projection device will also change. For example, when the user controls the size of the screen by adjusting the front and back distance of the projection device, and controls the position of the screen by adjusting the top, bottom, left and right distances of the projection device, the spatial posture of the projection device relative to the initial position will change. Specifically, when the projection device is projected onto a screen or a blank wall, and the projected content is at least one content displayed in a split screen, the user can adjust the position of the screen that the user is currently focusing on by adjusting the spatial position of the projection position, which is similar to dragging and adjusting the screen content.

[0064] When the spatial posture corresponding to the media output device changes, the display content that the user is paying attention to may also change. However, when the audio output mode of the corresponding display content remains unchanged, the user may not be able to quickly distinguish the current display content and the corresponding audio content, that is, the user cannot achieve an approximate visual and auditory experience. For example, when the audio content corresponding to the picture that the user is paying attention to is output at a lower volume, the user may not be able to fully immerse himself in the picture and the corresponding audio content, and will be disturbed by the current louder audio volume, thereby reducing the experience effect of the audio of the current picture of interest. Therefore, to solve this problem, an embodiment of the present application provides a control method, which can be applied to a media output device, and can also be applied to a device with a control function connected to a media output device. Referring to Figure 1, there is a flow chart of a control method provided in an embodiment of the present application. The method may include the following steps:

[0065] S101: If the media output device is in a first spatial posture, output first display content corresponding to the first spatial posture, and output first audio content corresponding to the first display content using first audio parameters.

[0066] S102: Obtain parameter information representing the spatial posture of the media output device.

[0067] S103: If the parameter information indicates that the media output device switches from the first spatial posture to the second spatial posture, at least according to the parameter information, enable the media output device to output second display content corresponding to the second spatial posture and output the first audio content with the second audio parameter.

[0068] Taking AR / VR 3D display applications as an example, communication between a PC (Personal Computer) and an AR / VR headset is typically established, with the user experiencing 3D visual effects through the PC-side AR / VR application. The PC-side AR / VR application can interact with and transmit commands to the AR / VR headset. For example, the application can control the number of display areas in the AR / VR headset and the output of corresponding display content. Correspondingly, the PC can also receive data transmitted by the AR / VR headset using its own sensors or data acquisition components, and process and analyze this data to determine information such as the AR / VR headset's posture, status, and applicable display modes.

[0069] In the embodiments of the present application, a wearable head-mounted display (HMD) is used as an example of a media output device. Specifically, it can be an AR HMD or a VR HMD. For ease of description, an AR / VR HMD is used for illustration. In a virtual reality interactive application, the AR / VR HMD can output at least one virtual display area in a three-dimensional space. The display effect of each virtual display area is similar to that of a physical screen commonly used in electronic devices. That is, each virtual display area is treated as a virtual display screen. This display mode can be referred to as a virtual multi-screen display mode. Specifically, the AR / VR HMD can create virtual display hardware information corresponding to physical display hardware information, such as at least one virtual graphics card and a virtual display screen. The created virtual display hardware information, such as the virtual graphics card and virtual display screen, can be sent to an operating system via its display driver, allowing the operating system to recognize the virtual display hardware information and create at least one virtual display area based on the virtual display hardware information, so that corresponding content can be output on these virtual display areas.

[0070] These virtual display areas can be placed in a spatial environment that the user can perceive through the AR / VR head-mounted display device through spatial placement. When the user wearing the AR / VR head-mounted display device moves, the position of these virtual display areas in the spatial area remains unchanged, but the virtual display areas that appear within the user's optimal field of view may be different. These virtual display areas can be distributed side by side in a spatial area within a 180-degree range, or they can be distributed in a 360-degree spatial area through a stereo surround method. Referring to Figure 2, which is a schematic diagram of the virtual display areas corresponding to an AR / VR head-mounted display device provided in an embodiment of the present application, after the user wears the AR / VR head-mounted display device, they can obtain a spatial display area corresponding to the arc area in Figure 2. The spatial display area can be arranged in a specific distribution method with multiple virtual display areas, such as virtual display area A and virtual display area B. When the user wearing the AR / VR head-mounted display device is at the position shown in the upper half of Figure 2, the virtual display area B mainly appears in their field of view. When the user moves to the position shown in the lower half of Figure 2, the virtual display area A mainly appears in their field of view.

[0071] When corresponding content is output in all of these virtual display areas, for example, each virtual screen outputs the content of the corresponding application, specifically, the video content of the video application can be output in one virtual display area, and the monitoring content of the video monitoring application can be output in another virtual display area. However, when most of the content output by these virtual display areas has audio, when these contents are output simultaneously, it will be difficult for the user to distinguish the audio of the current corresponding display content, or it will be difficult to distinguish the picture corresponding to each audio, etc. Therefore, in the embodiment of the present application, when outputting display content corresponding to the spatial posture of the media output device, the audio content corresponding to the display content is output with specific audio output parameters. For example, if the display content is no longer the first display content, the audio does not need to be output with the audio output effect that matches the display effect of the first display content, so that the user's experience mode of the visual effect of the display content and the auditory effect of the audio content is similar and more consistent, further allowing the user to match the display content with the corresponding audio content faster and more conveniently.

[0072] If the media output device is in a first spatial posture, as shown in the upper image in Figure 2, at this time, the first display content corresponding to the first spatial posture can be output through the first interface of the media output device (such as the display content output interface), such as outputting the display content of the display area B in Figure 2, and outputting the first audio content corresponding to the first display content with the first audio parameters, that is, outputting the audio content corresponding to the display content of the area B in Figure 2 with the first audio parameters.

[0073] Taking a wearable media output device as an example, the spatial posture of the media output device can be determined using parameter information representing the spatial posture of the media output device. This parameter information can be determined by the media output device itself or by the user of the media output device. For example, this parameter information can include user operation information on the media output device, spatial posture parameters of the media output device, including its spatial position parameters and spatial posture parameters, or interaction information between the user and the media output device. When the parameter information includes spatial posture parameters of the media output device and the media output device is an AR / VR headset, the spatial posture parameters of the AR / VR headset can be determined based on whether the user has generated position movement information and / or whether the user's head has rotated, as the user is wearing the AR / VR headset. For example, in Figure 2, as the user wearing the AR / VR headset moves to a different position, the spatial coordinates of the AR / VR headset change, thereby changing the spatial posture of the AR / VR headset. For example, when a user wearing an AR / VR headset rotates his head, the orientation of the AR / VR headset or the angle of a certain reference frame changes, thereby changing the spatial posture of the AR / VR headset.

[0074] If the parameter information represents that the media output device switches from a first spatial posture to a second spatial posture, at least according to the parameter information, the media output device outputs the second display content corresponding to the second spatial posture, and outputs the first audio content with the second audio parameter, wherein the first display content is different from the second display content, and the first audio parameter is significantly greater than the second audio parameter. When the display content corresponding to the spatial posture of the media output device is determined by the parameter information, it is applied in a scenario without specialized settings. In the case where a special processing mode is pre-set, it is necessary to determine the corresponding display content and the audio parameters of the corresponding audio content according to the actual setting requirements and in combination with the parameter information, such as simultaneously determining the display content and the audio parameters of the corresponding audio content according to the corresponding identification information and parameter information. The specific implementation method will be described in conjunction with specific application scenarios in the subsequent embodiments of this application. Correspondingly, parameter information characterizing the spatial posture of the media output device can be obtained through the parameter acquisition device of the media output device (such as a sensor, a gaze tracking module or a positioning module), and then the parameter information can be identified and processed by the processing device of the media output device to determine the spatial information of the media output device corresponding to the current parameter information; or the acquisition device can transmit the collected parameter information to the control device (such as a PC device connected to the media output device for communication data, etc.) through the data transmission interface of the media output device, and the control device identifies and processes the parameter information to obtain the spatial posture information of the media output device, and transmits the information to the media output device, so that the media output device obtains its current spatial posture. Referring to FIG. 2 , the upper image in FIG. 2 can represent the first spatial posture corresponding to the AR / VR headset device. At this time, the AR / VR headset device outputs at least the content of display area B, i.e., the current user primarily sees the content of display area B through the AR / VR headset device. The AR / VR headset device can directly output the audio content of the content of display area B using the first audio parameters, or the AR / VR headset device can output the audio content having the first audio parameters to an external speaker device connected to the AR / VR headset device via a second interface (e.g., an audio information output interface), causing the speaker device to output the audio content using the first audio parameters. The lower image in FIG. 2 can represent the second spatial posture corresponding to the AR / VR headset device. At this time, the AR / VR headset device outputs at least the content of display area A, i.e., the current user primarily sees the content of display area A through the AR / VR headset device, and outputs the audio content corresponding to the previous content of display area B using the second audio parameters. For example, when the first displayed content is the content of display area B, it can be video content, and when the second displayed content is the content of display area A, it can be the content of an audiobook.Since the first audio parameter is more significant than the second audio parameter, when the user is mainly focused on the content of display area A, the audio content corresponding to the content of the original display area B can be output with the second audio parameter at a lower volume. In this way, when the user is focused on the content of display area A, there is less interference from the audio content of the content of display area B. Specifically, when determining the first audio parameter and the second audio parameter of the first audio content, it can be determined based on the volume of the audio content playback, or it can be determined based on parameters such as the sound quality and sound effects when the audio content is played. For example, when the media output device is in a first spatial posture, the user can see the first display content and obtain the first audio content output at a higher volume. When the media output device is in a second spatial posture, the user can see the second display content, and the output volume of the first audio content is smaller or zero. It should be noted that the display content seen by the user matches the spatial posture of the media output device, and the corresponding other display content may also be output and displayed all the time, but it does not appear in the user's current field of view.

[0075] In an embodiment of the present application, when outputting display content corresponding to the spatial posture of the media output device, audio content corresponding to the display content is also output with corresponding audio parameters, allowing the user to obtain a similar visual and auditory experience. That is, if the display content no longer matches the target content, the audio content or the audio parameter effect of the audio content no longer matches the audio content of the target content. Furthermore, it can also enable the user to quickly match the display content they are looking at with the audio content they are hearing, avoiding the problem of being unable to distinguish the sound corresponding to the picture or the picture corresponding to the sound, thereby improving the user experience.

[0076] In an embodiment of the present application, the user experience can be improved by adjusting the audio output parameters of the audio content corresponding to the display content that does not match the current spatial posture of the media output device, or by adjusting the audio output parameters of the audio content corresponding to the display content that does not match the current spatial posture, and at the same time adjusting the audio output parameters of the audio content corresponding to the display content that matches the current spatial posture. For example, when the media output device is in the second posture, the volume of the first audio content is lowered and the volume of the second audio content is increased. In one embodiment, the method of causing the media output device to output the second display content corresponding to the second spatial posture at least based on the parameter information includes: causing the media output device to output the second display content corresponding to the second spatial posture at least based on the parameter information, and outputting the second audio content corresponding to the second display content with a fourth audio parameter. The fourth audio parameter is significantly greater than the third audio parameter, and the third audio parameter represents the audio parameter of the second audio content corresponding to the second display content when the media output device is in the first spatial posture. In this embodiment, after the spatial posture of the media output device is switched, switching between different display contents is achieved. In order to enhance the user experience, switching between corresponding different audio contents is also achieved. Specifically, when switching the audio content, the audio parameters of the display content are switched using audio parameters with better salience. For example, in the first spatial posture, the first display content is output, and the first audio content is output using the first audio parameters. Correspondingly, the second audio content may also be output at this time, but the audio parameters of the second audio content are less significant than the first audio parameters. After determining the second display content corresponding to the second spatial posture of the media output device, the audio parameters of the second audio content corresponding to the second display content can be adjusted to fourth audio parameters, that is, the second audio content is output using an audio parameter with less audio effect, so that the user can quickly and easily distinguish the audio content corresponding to the current display content. Furthermore, the fourth audio parameter can be the audio parameter with the best audio salience when the media output device is in the second spatial posture. The fourth audio parameter can be determined based on the audio characteristics of the second audio content, or based on the display characteristics of the second display content corresponding to the second spatial posture, or based on the proportion of the second display content in the corresponding content. Correspondingly, in order to achieve the best user experience, that is, to reduce the jumpiness of the user's audio experience, the audio content of the display content corresponding to the current spatial posture of the media output device can be output with specific audio parameters that have a more significant audio effect than other audio content, for example, all are output at a volume of 90%. In this way, even if the spatial posture of the media output device changes, the audio content corresponding to the display content that the user is concerned about is output at this volume, that is, the audio with the highest current volume is the audio of the display content that the user is concerned about, so that the user experience is better.

[0077] When the spatial posture of the media output device is switched from the first spatial posture to the second spatial posture, the first audio content of the first display content corresponding to the original first spatial posture may no longer be output, that is, the second audio parameter includes an audio parameter representing that the first audio content is not input. For example, the audio parameter is volume, and the volume corresponding to the second audio parameter is zero, and the first audio content is muted. Correspondingly, if the second audio parameter is a volume parameter, it can also be a smaller volume, that is, much smaller than the volume corresponding to the current fourth audio parameter. At this time, in response to the media output device being in the second spatial posture, at least the first audio content and the second audio content are output simultaneously. Further, all audio content corresponding to the media output device can also be output simultaneously, that is, the audio content of the display content corresponding to the current spatial posture, and the audio content of the display content not corresponding to the current spatial posture.

[0078] Taking the example of a media output device simultaneously outputting first and second audio content in a second spatial posture, specifically, when simultaneously outputting the first and second audio content, the audio parameters corresponding to the first audio content are the second audio parameters, and the audio parameters corresponding to the second audio content are the fourth audio parameters. When simultaneously outputting these two audio contents, the first audio content may be output using the audio track corresponding to the first audio content, and the second audio content may be output using the audio track corresponding to the second audio content. For example, when simultaneously outputting the first and second audio contents, the first audio content may be output by a first speaker array, and the second audio content may be output by a second speaker array. Furthermore, the first and second audio contents may be mixed and output. Specifically, the simultaneous output of at least the first and second audio contents includes: in response to at least the simultaneous output of the first and second audio contents, mixing the first audio content of the second audio parameters with the second audio content of the fourth audio parameters, and outputting the mixed first and second audio contents. In this embodiment, the first and second audio contents are mixed before being output. Mixing can be understood as integrating sounds from multiple sources into a single stereo or mono track and processing them into mixed audio content for output. Specifically, mixing will adjust and balance the relative levels (i.e., volume) of different audio contents and usually perform various audio processing such as equalization and compression on a single audio track, a group of audio tracks, and the overall mix. In an embodiment of the present application, the volume value of the first audio content and the second audio content when mixing can be determined based on the second audio parameter and the fourth audio parameter, and then the mixing process is performed and output based on the volume value. Specifically, it can also be determined based on the characteristics of the audio content whether to output the current audio content simultaneously or to output it in a mixed manner. For example, if the sound effect is required to be high in the scene, the current different audio contents can be mixed and output. This is because the main function of mixing is to adjust the frequency response curve and perform different attenuation on different audio frequencies to adjust the timbre effect of the audio signal, so that the audio output effect is better.

[0079] Taking the application scenario of a PC connected to an AR / VR head-mounted display device as an example, the audio output of the PC's sound mixer interface can be controlled through the PC operating system. Specifically, the process that outputs audio to the sound mixer interface when the AR / VR head-mounted display device is in a first spatial posture (such as an initial state) is first determined (the process represents an execution unit that generates an application for outputting audio, and the application is an application that generates the audio, specifically an application that can generate display content and audio content corresponding to the display content). Then, the window corresponding to the process is determined, wherein the window represents an interface for the application to run, corresponding to the content output by the application, which may include display content for display on the corresponding display screen, and audio content output through the sound output device. After all the windows are determined, the position of the display content corresponding to each window in the display area corresponding to the AR / VR head display device can be determined, where the display area may include multiple virtual display screens, and each virtual display screen can be used to display a window corresponding to an application. When the user wears the AR / VR head display device, the acquisition device in the device will track the user's line of sight or head posture to determine the virtual display screen currently seen by the user and record the position of the virtual display screen. Correspondingly, at least two virtual display screens can be presented within the user's field of view. Furthermore, some virtual display screens may only appear partially. At this time, the proportion information of each virtual display screen within the current field of view can be recorded.

[0080] Determine the window corresponding to each virtual display screen that appears in the user's field of view, so that the display content corresponding to each virtual display screen can be determined, and then the display content and the audio content corresponding to the audio process are intersected, that is, the display content corresponding to each virtual display screen and the audio content corresponding to the display content are determined, so that the audio content corresponding to the display content within the current user's field of view can be determined, and a control instruction that can control the audio output of the sound mixer interface is generated, so that the sound mixer interface outputs the audio content corresponding to the control instruction. Specifically, the sound mixer interface outputs the audio content corresponding to the control instruction, and can only allow the audio content of the display content corresponding to the virtual display screen in the user's field of view to output sound. It can also be based on the proportion information of each virtual display screen in the current user's field of view, and the audio parameters (such as volume) of the audio content of the display content corresponding to these virtual display screens are set to 100% or a specific ratio, and the audio content sound of the other display content corresponding to the field of view is set to 0%. It can also allow the audio content corresponding to other output display content applications outside the user's field of view to be output at a lower volume. Further, the sound mixing ratio of the audio content corresponding to other output display content applications outside the user's field of view can also be set to a predetermined ratio.

[0081] On the basis of satisfying the requirement that the user of the media output device can quickly distinguish the audio content corresponding to the display content of interest, or the display content corresponding to the current audio content, it is also possible to implement differentiated changes in audio parameters within a specific range, so that the user can switch the spatial posture of the media output device to change the display content or audio content currently being paid attention to, and also make the user experience better. Specifically, by differentiating the changes in audio parameters within different ranges, the user can experience stereo surround sound effects. If the display content output by the current media output device can be distributed around the user in a stereo surround manner (i.e., the display space is 360 degrees), the audio parameters of the audio content corresponding to the display content within the user's current field of view can be made most significant, such as the volume is the largest. When the audio parameters of the audio content corresponding to other display contents are set, the user can get the experience effect that the volume is larger when near and smaller when far, that is, the volume of the audio content corresponding to the display area closer to the user can be louder, and vice versa. Furthermore, the audio parameters can be determined based on the distance relationship or sequence relationship between the spatial display area that the user is paying attention to and other spatial display areas. Specifically, different audio parameter range settings can be presented, such as the audio parameters of the audio content in the display area that is closer to the display area of ​​the display content corresponding to the current spatial posture are significantly higher than the audio parameters of the audio content in the display area that is relatively farther away.

[0082] In one implementation of the embodiment of the present application, the outputting of the first audio content with the second audio parameter includes: determining the second audio parameter based on the spatial posture relationship between the first spatial posture and the second spatial posture, and outputting the first audio content with the second audio parameter. The spatial posture relationship can characterize the degree of posture change corresponding to the first spatial posture and the second spatial posture. Specifically, it can be determined by parameters such as the rotation angle, position coordinates and orientation angle of the media output device. Through the spatial posture relationship, the relationship between the first display content and the second display content is determined, such as the display position relationship between the two, so that the corresponding audio parameters can be set differently.

[0083] Furthermore, determining the second audio parameter based on the spatial posture relationship between the first spatial posture and the second spatial posture includes: determining an association between a first display area that outputs the first display content and a second display area that outputs the second display content based on the spatial posture relationship between the first spatial posture and the second spatial posture; and determining the second audio parameter based on the association. Each display area can display corresponding display content. Referring to FIG2 , assuming the media output device is an AR / VR headset, there can be multiple display areas within the corresponding spatial range, such as display area B that displays display content B, display area A that displays display content A, and so on. The association between the display areas before and after the AR / VR headset's spatial posture switch can be determined based on the display areas within the user's field of view corresponding to the current spatial posture. Specifically, the association between the display areas can include positional relationships and sequence relationships. Positional relationships refer to the relationship between the positions of the display areas within the spatial range, such as the distance and relative angle between the two display areas. The corresponding display content can be output in a positional distribution order, or the display content can be randomly displayed in each display area. Sequential relationships refer to the sequence order of each display area set in the configuration file of the media output device. Furthermore, the display area in which each display content is output can be set. For example, the display areas arranged side by side within a spatial range can be numbered 1 to 4 in order from left to right. When outputting display content, each display content can also be output in this order, such as outputting the display content of the first application opened by the user in the display area numbered 1.

[0084] Specifically, when the association relationship includes the positional relationship between the first display area and the second display area, determining the second audio parameter based on the association relationship includes: if the positional relationship indicates that the distance between the first display area and the second display area is within a first range, determining the second audio parameter based on the first audio range, wherein, when the media outputs the second display content corresponding to the second spatial posture, the audio parameter of the second audio content corresponding to the second display content is significantly greater than any audio parameter within the first audio parameter range, and the size of the second audio parameter matches the size of the distance between them. If the positional relationship indicates that the distance between the first display area and the second display area is within a second range, determining the second audio parameter, the second audio parameter indicating that the first audio content is not output.

[0085] Specifically, the interval distance of the first display area can be represented by the distance between the center point of the first display area and the center point of the second display area, or by the absolute distance between the two display areas. The parameter ranges corresponding to the first range and the second range can be determined by the actual application scenario, for example, the size of the spatial range of the display area output by the media output device can be determined. The first range represents a display area that is closer to the display area corresponding to the current spatial posture, and the second range represents a display area that is farther from the display area corresponding to the current spatial posture, wherein the display area corresponding to the current spatial posture is the main display area, that is, when the current spatial posture corresponds to at least one display area, the display area with a larger proportion is the main display area. Any audio parameter within the first audio parameter range can be an audio parameter with a smaller volume, and the audio parameter corresponding to the second range can be an audio parameter with a volume of zero.

[0086] For example, when the media output device is an AR / VR headset, the display areas of its corresponding display space are shown in FIG3 . In FIG3 , the display areas are arranged side by side, including display area 01, display area 02, display area 03, display area 04, and display area 05. Display area 01 displays content a, display area 02 displays content b, display area 03 displays content c, display area 04 displays content d, and display area 05 displays content e. Based on the current spatial posture of the AR / VR headset, the display area visible within the user's field of view is display area 02. That is, by analyzing the user's line of sight parameters, it can be determined that the user is focusing on display area 02. Because display areas 01, 03, and 04 are relatively close to display area 02, the audio content corresponding to display content a, c, and d can be output at a lower volume. However, because display area 05 is farther from display area 02, the audio content corresponding to display content e can be output in muted mode. Furthermore, the distance between display area 04 and display area 02 is farther than the distance between display area 03 and display area 02, and the volume of the audio content corresponding to display content d can be set to be lower than the volume of the audio content corresponding to display content c.

[0087] Correspondingly, the audio content of the display content corresponding to the current spatial posture of the media output device can be output with audio parameters with better audio effects, such as output at a higher volume, but not appearing within the user's field of view, that is, the audio content corresponding to other content that is not the display content corresponding to the current spatial posture is played in silent mode.

[0088] In another embodiment, an audio parameter can also be determined based on the proportion of the displayed content. When the media output device is in a second spatial posture and the output display content is the second display content, in this embodiment of the present application, the second audio content corresponding to the second display content is outputted using a fourth audio parameter, including: if the second display content corresponding to the second spatial posture outputted by the media output device is a partial content of the second content, based on the proportion of the second display content in the second content, determining the fourth audio parameter, and outputting the second audio content corresponding to the second display content using the fourth audio parameter. The second content can represent the complete content corresponding to the second display content. When the user views the display content within the dotted line range of FIG4 when the media output device is in the second posture, that is, the user can see a larger portion of the display content b within the current field of view. If the display content b is displayed normally in its entirety, the corresponding complete second content should be the display content of the entire rectangular frame. The fourth audio parameter can be determined by calculating the proportion of the range area of ​​the display content b within the current field of view to the area corresponding to the rectangular frame on the right. For example, if the proportion is 80%, the fourth audio parameter can be the audio parameter corresponding to the 80% proportion.

[0089] In the above embodiment, when determining the audio parameters that match the display content, the description is mainly based on the case where the display content corresponding to the current spatial posture of the media output device is one, that is, the display content is the content output by an application. The following description is based on the case where the display content corresponding to the current spatial posture is not unique.

[0090] Still taking the example of determining the fourth audio parameter of the second audio content for description, in one embodiment, outputting the second audio content corresponding to the second display content using the fourth audio parameter includes:

[0091] In response to the second display content corresponding to the second spatial gesture output by the media output device including at least partial content of third content and at least partial content of fourth content, determining, based on the proportion information corresponding to the at least partial content of the third content and the at least partial content of the fourth content, a fifth audio parameter of third audio content corresponding to the third content and a sixth audio parameter of fourth audio content corresponding to the fourth content, respectively;

[0092] The third audio content of the fifth audio parameter and the fourth audio content of the sixth audio parameter are output simultaneously.

[0093] In this embodiment, the second display content includes at least partial content of the third content and at least partial content of the fourth content. The proportion information may refer to the first proportion parameter of the third content occupied by the partial content of the third content and the second proportion parameter of the fourth content occupied by the partial content of the fourth content; it may also be the proportion parameter of the sum of the partial content of the third content and the partial content of the fourth content respectively. Furthermore, the second display content may also include other content, such as at least partial content of the fifth content, or the second display content may include all the content of the third content and at least partial content of the fourth content. Referring to Figure 5, when the media output device is in the second spatial posture, the second display content within the user's field of view includes partial content of the third content (i.e., the content in the partial A display area), partial content of the fourth content (i.e., the content in the partial C display area) and all the content of the fifth content (i.e., the content in the B display area). Then, the percentage of each portion of content within the current field of view can be calculated. Based on this percentage information, the audio parameters for outputting the audio content corresponding to the aforementioned content can be determined. Taking the audio output parameter as volume as an example, if the content in display area B is entirely within the current field of view, its percentage is the largest, and the corresponding volume can be set to the highest. However, if the content in display area A and display area C account for a relatively small percentage of the field of view, a volume smaller than that of display area B can be set. Furthermore, if the content in display area A and display area C account for the same percentage of the field of view, the output volume can be set to the same level, or the corresponding volume can be determined based on the content characteristics of each display content. For example, if the content displayed in display area A is a voice call, the content displayed in display area B is a video display, and the content displayed in display area C is the text content of an audiobook. By analyzing the content of each display area, since the call application only generates audio when a user is calling, the audio parameter for the audio content in display area A can be set to the second highest. For audiobooks, users can access their content through text, so the corresponding audio parameter can be set to the lowest. Furthermore, if the proportions within the visual field are the same, the audio parameters corresponding to the various content features may also be determined based on the frequency of user application of various types of displayed content.

[0094] In this embodiment, the displayed content corresponding to the current spatial posture of the media output device includes partial content of a certain content, or partial content of certain content. This situation may occur when the user needs to view different content or when the user is determining the displayed content they want to focus on. When the user determines the displayed content they want to focus on by adjusting the spatial posture of the media output device, in order to improve the user experience, the audio parameters of the audio content corresponding to the displayed content can be determined in real time based on the ratio of the current displayed content to the complete content corresponding to the displayed content. Taking the audio parameter as an example, if the currently displayed content is a video screen, and when the media output device is in a first spatial posture, the current video screen occupies 70% of the original complete video screen, the audio corresponding to the video is output at a volume of 70 (the volume adjustment range is 0-100); then if the user moves so that the media output device is in a second spatial posture, the current video screen occupies 85% of the original complete video screen, the audio corresponding to the video is output at a volume of 85 (the volume adjustment range is 0-100); then if the user moves so that the media output device is in a third spatial posture, the current video screen occupies 95% of the original complete video screen, the audio corresponding to the video is output at a volume of 95 (the volume adjustment range is 0-100). In this way, the volume can be gradually switched according to the proportion, making the audio parameter switching process more natural and smooth, thereby improving the user experience.

[0095] Correspondingly, in order to avoid repeatedly adjusting audio parameters to increase the occupation of processing resources, when the user determines the display content he wants to pay attention to by adjusting the spatial posture of the media output device, if the current display content is the complete content of the corresponding content, the audio content of the display content will not be output until the spatial posture of the media output device remains unchanged for a certain period of time, or the current display content is the complete content of the corresponding content, and then the audio content of the display content will be output with the corresponding audio parameters.

[0096] The above embodiments illustrate the process of processing various display contents and corresponding audio contents in common application scenarios. The embodiments of the present application also include processing methods for special scenarios. For example, when identification information of certain content is pre-set, when the above method is used for processing, the processing of the content corresponding to this identification information also needs to be considered, so that the control method provided by the present application has a wider scope of application.

[0097] In one embodiment of the present application, causing the media output device to output second display content corresponding to the second spatial posture and output first audio content with second audio parameters based at least on parameter information includes: causing the media output device to output second display content corresponding to the second spatial posture and output first audio content with second audio parameters based on parameter information and identification information. The identification information may represent relevant information for identifying the display content, or may represent relevant information for identifying the audio content. When obtaining the identification information, configuration information for the application corresponding to each display content may be obtained through an application configuration file, thereby determining the corresponding identification information. The identification information may also be determined by analyzing the current display content or audio content. If the identification information is determined by an audio output identifier, when the audio output identifier has a higher priority, the audio content corresponding to the audio output identifier will be output with more prominent audio parameters, such as at a higher volume, regardless of whether the display content corresponding to the audio output identifier is within the display range corresponding to the current posture of the media output device. If the identification information is determined by a display output identifier, the display content corresponding to the display output identifier with a higher priority will always be displayed within the display range corresponding to the current spatial posture of the media output device.

[0098] Specifically, in one embodiment, the identification information includes an audio output identifier, wherein outputting the first audio content with the second audio parameters includes: if the first audio output identifier corresponding to the first audio content exists, outputting the first audio content with the first audio parameters; if the first audio output identifier corresponding to the first audio content does not exist, outputting the first audio content with the second audio parameters. For example, if the first audio content is background music, its audio output identifier has a higher priority, meaning that the background music is output with more prominent audio parameters regardless of the spatial posture of the media output device. Specifically, the audio parameters can be determined based on configuration information corresponding to the audio output identifier. For example, if the configuration information indicates a higher priority, the audio parameters can always be output with fixed, higher-salience audio parameters, such as the first audio parameters. Furthermore, the audio parameters of the first audio content with the first audio output identifier can be determined based on the audio parameters of the audio content of the displayed content corresponding to the current spatial posture of the media output device. For example, when the media output device is in the second spatial posture, the volume corresponding to the audio parameters of the first audio content can be slightly lower than the volume corresponding to the audio parameters of the second audio content, but the volume corresponding to the audio parameters of the first audio content can be higher than the volume corresponding to the audio parameters of other audio content. If there is no first audio output identifier corresponding to the first audio content, processing is performed according to the control method provided in the embodiment of the present application, that is, the spatial posture of the media output device is determined based on the parameter information, and then the display content and the audio parameters of the audio content corresponding to the display content are determined based on the spatial posture. For example, if there is no first audio output identifier for the first audio content, the first audio content is output using the second audio parameters.

[0099] In another embodiment, the identification information includes a display output identifier, wherein causing the media output device to output second display content corresponding to the second spatial posture and output the first audio content using second audio parameters based on the parameter information and the identification information includes:

[0100] If there is a first display output identifier corresponding to the first display content, the media output device is enabled to output second display content corresponding to the second spatial gesture according to the parameter information and the first display output identifier, wherein the second display content includes at least partial content of the first display content.

[0101] The display output identifier can indicate that the corresponding display content follows the spatial posture of the media output device. That is, the display content with this display output identifier will always be displayed within the display range corresponding to the current spatial posture of the media output device. In this case, the second display content is the screen content within the display range corresponding to the current spatial posture. This screen content can include content from a specific application or content from different applications. For example, the second display content can include only the video screen of a video application, or it can include a portion of the video screen of a video application and a book screen of an audiobook application. Because the first display content has the first display output identifier, at least a portion of the first display content will always be the portion of the display screen corresponding to the current spatial posture of the media output device. In this embodiment, since at least a portion of the first display content is a portion of the second display content, when the media output device is in the second spatial posture, if there is no display output identifier at this time, the display content determined based on the second spatial posture is the second content. Furthermore, if the first display content has a corresponding first display output identifier, at least a portion of the first display content will be determined as part of the second display content based on the configuration information, that is, at least a portion of the first display content and the second content will be combined into the second display content, and then the second display content will be output. In this way, when the second display content is displayed, it is equivalent to outputting the first display content as well, so the first audio content is always output with audio parameters of higher significance. Specifically, at least a portion of the first display content can be partial information of the first display content, such as the title bar information of the first display content, etc., or it can be processing the first display content in a specific display format, such as displaying the first display content in a small window, a floating window, or other manner.

[0102] In the above embodiment, parameter information and identification information are used to determine the current spatial posture of the media output device and the display content and audio content corresponding to the identification information. This processing mode can be applied to scenarios where the audio does not need to be output synchronously with the picture in real time. For example, an audio output identifier can be set for the audio content corresponding to the communication application. In this way, when the user is making a voice call, the voice call interface content can no longer be displayed within the current field of view, but the voice call content can always be output with audio parameters with better sound effects. This avoids the problem of missing the voice call when the audio of the display content that does not correspond to the current spatial posture is played in silence when the display content is determined only by parameter information. Correspondingly, this implementation method can also be used to implement background audio playback. For example, an audio output identifier is set for a certain audio content, which can output the audio content in real time with more significant audio parameters. However, the application or applet that generates the audio content does not need to be displayed in the corresponding display area, but can be run in the background and output the audio content.

[0103] The display output identifier can be obtained through configuration information, or it can be determined by analyzing the current display content and the corresponding audio content. In this embodiment, it also includes: obtaining the association information between the first display content and the first audio content; if the association information meets the target condition, generating the display output identifier of the first display content, and the target condition indicates that the first display content does not change with the change of the first audio content. In this embodiment, the picture of the first display content may not change in real time. Real-time change means that each video frame changes relative to the output of a similar video stream picture. For example, the first display content is the interface content of the browser, and the first audio content is the music playback content obtained by searching in the browser. At this time, the display output identifier of the browser can be set, and its corresponding identifier can be output as part of the display content corresponding to the current spatial posture of the media output device. At this time, the corresponding music playback content can always be output with more significant audio parameters.

[0104] In an embodiment of the present application, a media output device is further provided, including:

[0105] an obtaining device for obtaining parameter information, wherein the parameter information is capable of determining a spatial posture related to the media output device;

[0106] an output device for outputting display content corresponding to the spatial posture and audio content corresponding to the display content;

[0107] a processing device configured to generate a first processing signal corresponding to a first spatial posture and a second processing signal corresponding to a second spatial posture, wherein the first processing signal is configured to control the output device to output first display content corresponding to the first spatial posture and to output first audio content corresponding to the first display content using first audio parameters; and the second processing signal is configured to control the output device to output second display content corresponding to the second spatial posture and to output the first audio content using second audio parameters;

[0108] The first display content is different from the second display content, and the first audio parameter is more significant than the second audio parameter.

[0109] Specifically, the media output device may be a wearable device, such as a VR head-mounted display device or an AR head-mounted display device. Correspondingly, the media output device may further include:

[0110] a wearable component for maintaining a relative positional relationship between the media output device and at least a portion of a user's body;

[0111] Wherein, the obtaining device includes a collecting sub-device, and the collecting sub-device is used to collect parameter information representing the spatial posture of the media output device;

[0112] The output device includes a display sub-device and a speaker, wherein the display sub-device is used to display display content corresponding to the spatial posture, and the speaker is used to play audio content corresponding to the display content;

[0113] Among them, the first processing signal generated by the processing device is used to control the display sub-device to display the first display content corresponding to the first spatial posture, and control the speaker to play the first audio content corresponding to the first display content with first audio parameters; the second processing signal generated by the processing device is used to control the display sub-device to display the second display content corresponding to the second spatial posture, and control the speaker to play the first audio content with second audio parameters.

[0114] In another embodiment, the media output device may also be a processing device having processing functions as well as data transmission and communication functions, such as a laptop computer. In this case, the media output device may be communicatively connected with the wearable device. Referring to FIG6 , a schematic diagram of a scenario provided in an embodiment of the present application is shown. In FIG6 , the media output device is a laptop computer, and the wearable device is AR / VR glasses. In this case, the media output device further includes:

[0115] A communication device for communicating with a wearable device;

[0116] The obtaining device includes a receiving sub-device, and the receiving sub-device is used to receive parameter information representing the spatial posture of the wearable device;

[0117] The output device includes a transmission sub-device, and the transmission sub-device is used to transmit display content corresponding to the spatial posture and audio content corresponding to the display content to the wearable device;

[0118] Among them, the first processing signal generated by the processing device is used to control the transmission sub-device to transmit the first display content corresponding to the first spatial posture to the wearable device, and to transmit the first audio content corresponding to the first display content to the wearable device with the first audio parameter; the second processing signal generated by the processing device is used to control the transmission sub-device to transmit the second display content corresponding to the second spatial posture to the wearable device, and to transmit the first audio content to the wearable device with the second audio parameter.

[0119] Specifically, the processing flow of the processing device of the media output device can refer to the relevant process of determining the display content and audio parameters in the control method provided in the embodiment of the present application, which will not be described in detail here.

[0120] In another embodiment of the present application, a readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the control method as described in any one of the above items is implemented.

[0121] In another embodiment of the present application, an electronic device is provided, which may include:

[0122] A memory, used to store applications and data generated by the execution of the applications;

[0123] A processor is used to execute the application program to implement any of the control methods described above.

[0124] It should be noted that the specific implementation of the processor in this embodiment can refer to the corresponding content in the previous text and will not be described in detail here.

[0125] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Reference can be made to the common and similar parts between the various embodiments. For the devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method description.

[0126] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0127] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0128] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A control method, comprising: If the media output device is in a first spatial posture, outputting first display content corresponding to the first spatial posture, and outputting first audio content corresponding to the first display content with first audio parameters; Obtaining parameter information representing the spatial posture of the media output device; If the parameter information indicates that the media output device switches from the first spatial posture to the second spatial posture, at least according to the parameter information, the media output device outputs the second display content corresponding to the second spatial posture, and outputs the first audio content with the second audio parameter; The first display content is different from the second display content, and the first audio parameter is more significant than the second audio parameter.

2. The method according to claim 1, wherein the step of causing the media output device to output the second display content corresponding to the second spatial posture at least according to the parameter information comprises: At least based on the parameter information, the media output device outputs the second display content corresponding to the second spatial posture, and outputs the second audio content corresponding to the second display content with a fourth audio parameter, wherein the fourth audio parameter is more significant than the third audio parameter, and the third audio parameter represents the audio parameter of the second audio content corresponding to the second display content when the media output device is in the first spatial posture.

3. The method according to claim 2, further comprising: In response to the media output device being in a second spatial posture, outputting at least the first audio content and the second audio content simultaneously; The at least simultaneously outputting the first audio content and the second audio content includes: In response to at least simultaneously outputting the first audio content and the second audio content, the first audio content of the second audio parameter and the second audio content of the fourth audio parameter are mixed, and the mixed first audio content and the second audio content are output.

4. The method according to claim 1, wherein outputting the first audio content with a second audio parameter comprises: Based on a spatial posture relationship between the first spatial posture and the second spatial posture, a second audio parameter is determined, and the first audio content is output with the second audio parameter.

5. The method according to claim 4, wherein determining the second audio parameter based on the spatial posture relationship between the first spatial posture and the second spatial posture comprises: Determining, based on a spatial posture relationship between the first spatial posture and the second spatial posture, an association relationship between a first display area for outputting the first display content and a second display area for outputting the second display content; Based on the association relationship, a second audio parameter is determined.

6. The method according to claim 5, wherein the association relationship comprises a positional relationship between the first display area and the second display area, and determining the second audio parameter based on the association relationship comprises: If the positional relationship represents that the distance between the first display area and the second display area is within a first range, determining a second audio parameter based on the first audio parameter range, wherein when the media output device outputs the second display content corresponding to the second spatial posture, an audio parameter of a second audio content corresponding to the second display content is significantly greater than any audio parameter within the first audio parameter range, and a size of the second audio parameter matches a size of the distance; If the position relationship indicates that the distance between the first display area and the second display area is within a second range, a second audio parameter is determined, where the second audio parameter indicates an audio parameter for not outputting the first audio content.

7. The method according to claim 2, wherein the step of outputting the second audio content corresponding to the second display content using the fourth audio parameter comprises: If the second display content corresponding to the second spatial posture output by the media output device is a partial content of the second content, determining the fourth audio parameter based on a proportion of the second display content in the second content; The second audio content corresponding to the second display content is outputted using the fourth audio parameter.

8. The method according to claim 2, wherein the step of outputting the second audio content corresponding to the second display content using the fourth audio parameter comprises: In response to the second display content corresponding to the second spatial gesture output by the media output device including at least partial content of third content and at least partial content of fourth content, based on the proportion information corresponding to the at least partial content of the third content and the at least partial content of the fourth content, respectively determine a fifth audio parameter of a third audio content corresponding to the third content and a sixth audio parameter of a fourth audio content corresponding to the fourth content; The third audio content of the fifth audio parameter and the sixth audio parameter are simultaneously output the fourth audio content.

9. The method according to claim 1, wherein at least according to the parameter information, the media output device is caused to output the second display content corresponding to the second spatial posture, and the first audio content is output with the second audio parameter, comprising: The media output device is enabled to output second display content corresponding to the second spatial posture according to the parameter information and the identification information, and to output the first audio content with a second audio parameter.

10. The method according to claim 9, wherein the identification information comprises an audio output identification, wherein: The step of outputting the first audio content using the second audio parameter comprises: If there is a first audio output identifier corresponding to the first audio content, output the first audio content with the first audio parameter; If there is no first audio output identifier corresponding to the first audio content, the first audio content is output with a second audio frequency parameter.

11. The method according to claim 9, wherein the identification information comprises a display output identification, wherein: The step of causing the media output device to output the second display content corresponding to the second spatial posture and outputting the first audio content with the second audio parameter according to the parameter information and the identification information includes: If there is a first display output identifier corresponding to the first display content, the media output device is enabled to output second display content corresponding to the second spatial gesture according to the parameter information and the first display output identifier, wherein the second display content includes at least partial content of the first display content.

12. A media output device, comprising: An obtaining device, for obtaining parameter information, wherein the parameter information can determine a spatial posture related to the media output device; An output device, configured to output display content corresponding to the spatial posture and audio content corresponding to the display content; a processing device, configured to generate a first processing signal corresponding to a first spatial posture, and to generate a second processing signal corresponding to a second spatial posture, wherein the first processing signal is used to control the output device to output first display content corresponding to the first spatial posture, and to output first audio content corresponding to the first display content with a first audio parameter; The second processed signal is used to control the output device to output the second display content corresponding to the second spatial posture, and to output the first audio with the second audio parameter. content; The first display content is different from the second display content, and the first audio parameter is more significant than the second audio parameter.

13. The media output device of claim 12, further comprising: A wearable component, used to maintain a relative positional relationship between the media output device and at least a part of a user's body; Wherein, the acquisition device includes a collection sub-device, and the collection sub-device is used to collect parameter information representing the spatial posture of the media output device; The output device includes a display sub-device and a speaker, wherein the display sub-device is used to display display content corresponding to the spatial posture, and the speaker is used to play audio content corresponding to the display content; Among them, the first processing signal generated by the processing device is used to control the display sub-device to display the first display content corresponding to the first spatial posture, and control the speaker to play the first audio content corresponding to the first display content with first audio parameters; the second processing signal generated by the processing device is used to control the display sub-device to display the second display content corresponding to the second spatial posture, and control the speaker to play the first audio content with second audio parameters.

14. The media output device of claim 12, further comprising: A communication device, used for communicating with the wearable device; The obtaining device includes a receiving sub-device, and the receiving sub-device is used to receive parameter information representing the spatial posture of the wearable device; The output device includes a transmission sub-device, and the transmission sub-device is used to transmit display content corresponding to the spatial posture and audio content corresponding to the display content to the wearable device; Among them, the first processing signal generated by the processing device is used to control the transmission sub-device to transmit the first display content corresponding to the first spatial posture to the wearable device, and to transmit the first audio content corresponding to the first display content to the wearable device with the first audio parameter; the second processing signal generated by the processing device is used to control the transmission sub-device to transmit the second display content corresponding to the second spatial posture to the wearable device, and to transmit the first audio content to the wearable device with the second audio parameter.

Images