Display device and sound effect configuration method

Abstract

Some embodiments of the invention provide a display device and a sound effect configuration method, and the sound effect configuration method can analyze a first sound effect option of first media asset data when the first media asset data is played, and control a display to display a sound effect selection interface including the first sound effect option. And in response to a sound effect selection instruction of the user based on the sound effect selection interface, controlling the audio output device to play the first audio data according to the target sound effect option. Analyzing a second sound effect option of the second media asset data, if the second sound effect option comprises a target sound effect option, controlling the audio output device to play second audio data according to the target sound effect option, if the second sound effect option does not comprise the target sound effect option, updating a sound effect selection interface according to the second sound effect option, and if the second sound effect option does not comprise the target sound effect option, updating the sound effect selection interface. And controlling the display to display the updated sound effect selection interface.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a sound effect configuration method. Background Art

[0002] When playing media data, the display device can analyze the sound effect options that can be played by the media data and generate a sound effect interface according to the sound effect options. The user can select at least one sound effect option in the sound effect interface to control the display device to play the media data with the selected sound effect.

[0003] After the current media asset data is played, the display device will automatically switch to the next media asset data located in the current media asset data for playback. When switching to play the next media asset data, since the sound effect options supported by the media asset data are uncertain, the display device will play according to the initial sound effect options of the next media asset data, resulting in the user needing to manually adjust the sound effect options, which reduces the user experience. Summary of the invention

[0004] The present application provides a display device and a sound effect configuration method to solve the problem that the sound effect needs to be readjusted when the display device switches to play media data.

[0005] In a first aspect, some embodiments of the present application provide a display device, the display device comprising a display, an audio output device, and a controller, wherein the display is configured to display a user interface, the audio output device is configured to play audio data, and the controller is configured to:

[0006] When playing the first media asset data, parsing the first sound effect option of the first media asset data, and controlling the display to display a sound effect selection interface, the sound effect selection interface including the first sound effect option, and the first media asset data including the first audio data;

[0007] In response to a sound effect selection instruction input by a user based on the sound effect selection interface, controlling the audio output device to play the first audio data with a target sound effect option, where the target sound effect option is a first sound effect option specified by the sound effect selection instruction;

[0008] Parsing a second sound effect option of second media asset data, where the second media asset data is the next media asset data adjacent to the first media asset data in the media asset playlist, and the second media asset data includes second audio data;

[0009] If the second sound effect option includes the target sound effect option, controlling the audio output device to play the second audio data with the target sound effect option;

[0010] If the second sound effect option does not include the target sound effect option, the sound effect selection interface is updated according to the second sound effect option, and the display is controlled to display the updated sound effect selection interface.

[0011] In some embodiments, the controller performs parsing of the first sound effect option of the first media asset data, and is configured to:

[0012] Decoding the first media asset code to obtain first media asset data;

[0013] Parsing the first media asset data to obtain sound effect scene information of the first media asset data;

[0014] The first sound effect option is generated according to the sound effect scene information.

[0015] In some embodiments, before the controller executes the step of controlling the display to display the sound effect selection interface, the controller is further configured to:

[0016] Based on the first sound effect option, parsing sound effect configuration information in the sound effect scene information, the sound effect configuration information including current configuration information and optional configuration information;

[0017] A sound effect selection interface is generated according to the current configuration information and the optional configuration information.

[0018] In some embodiments, the first media asset data further includes first subtitle data, and the controller controls the audio output device to play the first audio data with a target sound effect option, specifically configured as follows:

[0019] Parsing the target sound effect option to obtain target language information;

[0020] Acquire target subtitle data according to the target language information, and update the first audio data according to the target language information;

[0021] Aligning the timing relationship between the target subtitle data and the updated first audio data;

[0022] According to the timing relationship, the audio output device is controlled to play the first audio data, and the display is controlled to display the target subtitle data.

[0023] In some embodiments, the controller controls the audio output device to play the first audio data with a target sound effect option, and is specifically configured to:

[0024] Parsing the target sound effect option at the application layer to obtain target configuration information;

[0025] sending the target configuration information to the middleware layer via a first interface, wherein the first interface is used to connect the application layer and the middleware layer;

[0026] Sending the target configuration information to the kernel layer through the second interface;

[0027] At the kernel layer, updating the sound effect scene information of the first media asset data based on the target configuration information;

[0028] The updated sound effect scene information is sent from the kernel layer to the application layer to obtain updated first audio data.

[0029] In some embodiments, the controller controls the audio output device to play the second audio data with the target sound effect option, and is configured to:

[0030] Acquire the second audio data;

[0031] parsing the sound effect scene information of the second audio data;

[0032] configuring the sound effect scene information of the second audio data according to the target configuration information;

[0033] The second audio data is updated according to the configured sound effect scene information, and the audio output device is controlled to play the updated second audio data.

[0034] In some embodiments, the controller executes sending the updated sound effect scene information from the kernel layer to the application layer, and is configured to:

[0035] Obtaining configuration parameters of the sound effect scene information;

[0036] Sending the configuration parameters to the application layer;

[0037] The sound effect configuration information of the first audio data is generated according to the configuration parameters to update the first audio data.

[0038] In some embodiments, the initial position of the sound effect scene information is the kernel layer, and the controller performs parsing of the sound effect configuration information in the sound effect scene information, and is configured to:

[0039] Acquiring the information format of the sound effect scene information at the kernel layer;

[0040] Sending the sound effect scene information to the application layer;

[0041] At the application layer, the sound effect scene information is parsed according to a parsing format corresponding to the information format to obtain sound effect configuration information.

[0042] In some embodiments, the controller executes updating the sound effect selection interface according to the second sound effect option, and is configured to:

[0043] Traversing the second sound effect options to obtain the sound effect options to be deleted and the newly added sound effect options, wherein the newly added sound effect options are sound effect options other than the first sound effect options in the second sound effect options; and the sound effect options to be deleted are the first sound effect options included in the second sound effect options;

[0044] The sound effect selection interface is updated according to the sound effect option to be deleted and the newly added sound effect option.

[0045] In a second aspect, the present application provides a sound effect configuration method, which is applied to the display device described in the first aspect, and the method includes:

[0046] When playing the first media asset data, parsing the first sound effect option of the first media asset data, and controlling the display to display a sound effect selection interface, the sound effect selection interface including the first sound effect option, and the first media asset data including the first audio data;

[0047] In response to a sound effect selection instruction input by a user based on the sound effect selection interface, controlling the audio output device to play the first audio data with a target sound effect option, where the target sound effect option is a first sound effect option specified by the sound effect selection instruction;

[0048] Parsing a second sound effect option of second media asset data, where the second media asset data is the next media asset data adjacent to the first media asset data in the media asset playlist, and the second media asset data includes second audio data;

[0049] If the second sound effect option includes the target sound effect option, controlling the audio output device to play the second audio data with the target sound effect option;

[0050] If the second sound effect option does not include the target sound effect option, the sound effect selection interface is updated according to the second sound effect option, and the display is controlled to display the updated sound effect selection interface.

[0051] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a sound effect configuration method, wherein the sound effect configuration method can parse the first sound effect option of the first media asset data when playing the first media asset data, and control the display to display a sound effect selection interface including the first sound effect option. And in response to the sound effect selection instruction of the user based on the sound effect selection interface, control the audio output device to play the first audio data with the target sound effect option. Parse the second sound effect option of the second media asset data, if the second sound effect option includes the target sound effect option, control the audio output device to play the second audio data with the target sound effect option, if the second sound effect option does not include the target sound effect option, update the sound effect selection interface according to the second sound effect option, and control the display to display the updated sound effect selection interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0054] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0055] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0056] Figure 4 A flowchart of a display device continuing to play with default sound effect options provided in some embodiments of the present application;

[0057] Figure 5 A flowchart of performing sound effect configuration on a display device provided in some embodiments of the present application;

[0058] Figure 6 A flowchart of performing sound effect configuration on a display device provided in some embodiments of the present application;

[0059] Figure 7 A flow chart of a display device determining a language option according to a language track provided in some embodiments of the present application;

[0060] Figure 8 A flowchart of a display device that continues to play with a target sound effect option in some embodiments of the present application;

[0061] Fig. 9 A flowchart of a display device updating a sound effect selection interface provided in some embodiments of the present application;

[0062] Fig.10 An underlying logic diagram for generating a sound effect selection interface for a display device provided in some embodiments of the present application;

[0063] Fig.11 A flowchart of a display device generating a sound effect selection interface according to sound effect configuration information in some embodiments of the present application;

[0064] Fig.12 A flowchart of replacing subtitle data for a display device in some embodiments of the present application;

[0065] Fig.13 This is an underlying logic diagram of a display device updating audio scene information in some embodiments of the present application. DETAILED DESCRIPTION

[0066] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0067] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0068] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0069] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0070] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0071] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0072] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0073] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0074] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0075] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0076] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0077] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0078] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0079] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0080] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0081] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0082] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0083] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0084] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0085] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0086] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0087] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0088] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0089] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0090] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0091] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0092] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0093] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0094] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0095] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0096] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0097] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0098] In some embodiments, the display device 200 may display a user interface in response to an interactive instruction input by a user. The user interface may include multiple application controls, such as a media asset playback control, a game control, a browser control, etc. The user may input a startup instruction based on the multiple application asset controls in the user interface, thereby controlling the display device 200 to start the corresponding application. Taking the startup of the media asset playback control as an example, the display device 200 may display a media asset playback interface, which includes a media asset list, so as to provide the user with playable media asset data.

[0099] When playing media data, the display device 200 can parse the media data to obtain configuration options of the media data, including media clarity, sound effect options or play options, etc. The display device 200 can generate a configuration interface based on the configuration options. Taking the sound effect option as an example, the display device 200 can obtain the sound effect options that can be played by the media data through parsing, and generate a sound effect interface based on the sound effect option to provide the user with the sound effect options that can be played by the current media data. The user can select the sound effect option in the sound effect interface and control the display device 200 to play the media data with the selected sound effect.

[0100] In some embodiments, Figure 4 As shown, the media asset playback control may include an automatic playback function, that is, after the display device 200 finishes playing the current media asset data, it automatically switches to the media asset data that is next to the current media asset data to continuously play the media asset data.

[0101] However, since different media asset data support different sound effect options, when the display device 200 switches to play the continued media asset data, the sound effect options supported by the continued media asset data are not determined, so the display device plays according to the initial sound effect options of the continued media asset data. If the initial sound effect options of the continued media asset data are different from the sound effect options selected by the user based on the sound effect interface, the user needs to manually adjust the sound effect options to switch the initial sound effect options back to the selected sound effect options.

[0102] In addition, if the resumed media data does not support the selected media option, the user needs to re-enter instructions to control the display device 200 to display the sound effect selection interface and select a new sound effect option based on the sound effect selection interface, resulting in a more cumbersome process of adjusting the sound effect option during the switching of media data, thereby reducing the user experience.

[0103] In some embodiments, the display device 200 can perform sound effect configuration when switching to play media asset data, that is, some embodiments of the present application provide a display device 200, the display device 200 includes a display 260, an audio output device 270 and a controller 250. The display 260 is configured to display a user interface. The audio output device 270 is configured to play audio data. The controller 250 is configured to execute a sound effect configuration method, Figure 5 A flowchart of sound effect configuration performed by a display device in some embodiments of the present application. Figure 6 The timing diagram of the display device executing the sound effect configuration in some embodiments of the present application. Figure 6 The timing relationships shown implement the sound effect configuration. Figure 5 and Figure 6 , the method comprises the following contents:

[0104] S100: When playing first media asset data, parsing a first sound effect option of the first media asset data, and controlling the display to display a sound effect selection interface.

[0105] The first media asset data is the media asset data currently being played by the display device. When the display 260 displays the media asset playing interface, the display device 200 can respond to the selection instruction input by the user based on the media asset list to determine the first media asset data. The media asset list may include multiple media asset data items for the user to select and watch. For example, when the media asset list includes media asset data A, media asset data B, and media asset data C, the selection instruction selects media asset A for playback, and media asset A is the first media asset data.

[0106] For video media, the first media data may include audio data, i.e., first audio data, and video data, i.e., first media video. For audio media, the first media data may also include only first audio data. During the process of the display device 200 playing the media data, the controller 250 may control the audio output device 270 to play the first audio data, and may also synchronize with the playing progress of the first audio data to control the display 260 to display the media picture corresponding to the first media video, thereby achieving the effect of playing the first media data synchronously with audio and video.

[0107] When playing the first media asset data, the controller 250 can parse the first sound effect option of the first media asset data, and the first sound effect option is the audio playback effect currently supported by the first media asset data, that is, the display device 200 can play the first media asset data according to at least one first sound effect option, so as to control the audio output device 270 to play the audio part of the first media asset data with the audio playback effect corresponding to the first sound effect option. The first sound effect option may include a language option, an ambient sound option, a channel playback option, or a characteristic sound option. When the display device 200 plays the first media asset data, the controller 250 can generate a sound effect control and control the display 260 to display the sound effect control in a designated area of ​​the media asset screen. The display device 200 can respond to a response event from the sound effect control and control the display 260 to display a sound effect selection interface. The sound effect selection interface can be generated according to the first sound effect option obtained by the analysis, so that the sound effect selection interface includes all the first sound effect options obtained by the analysis, so as to prompt the user of the sound effect options supported by the first media asset data.

[0108] S200: In response to a sound effect selection instruction input by a user based on the sound effect selection interface, controlling the audio output device to play the first audio data with a target sound effect option.

[0109] After the display 260 displays the sound effect selection interface, the user can input a sound effect selection instruction based on the sound effect selection interface to select a target sound effect option from the first sound effect option in the sound effect selection interface. The display device 200 can control the audio output device to play the first audio data with the target sound effect option in response to the sound effect selection instruction. For example, if the target sound effect option is the left channel playback mode, the controller 250 plays the first audio data in the left channel playback mode.

[0110] S300: parsing a second sound effect option of the second media asset data.

[0111] The second media data is the next media data adjacent to the first media data in the media playlist. For example, when the media list includes media data A, media data B, and media data C, without responding to other control instructions, the display device 200 should play the three media data in sequence according to media data A, media data B, and media data C. After the media data A is played, the display device 200 will automatically play the media data B, and after the media data B is played, the display device 200 will automatically play the media data C. When the first media data is media data A, the second media data is media data B.

[0112] After the display device 200 finishes playing the first media data, the controller 250 can parse the second sound effect option of the second media data to perform subsequent sound effect configuration on the second media data according to the second sound effect option, so as to continue playing the second media data according to the second sound effect option after the first media data is finished playing.

[0113] In some embodiments, the first sound effect option and the second sound effect option may include a language option, respectively, and the language option is used to indicate the language information that the media asset data can switch to. Taking the language option of the second sound effect option as an example, the controller 250 can determine the language option of the second media asset data by parsing the language track of the second media asset data. Figure 7 As shown, when parsing the second media data, the second media data can be parsed to include a Chinese language track, an English language track, and a Spanish language track. The language track corresponds to a language type of the second media data, and the controller 250 can determine the language options of the second media data as a Chinese option, an English option, and a Spanish option according to the media track.

[0114] Corresponding to the language track, the second media data should at least include media data in Chinese, media data in English, and media data in Spanish. The controller 250 can decode the media data in the corresponding language according to the language track, and control the audio output device 270 to play the audio data in the decoded media data. For example, when the target sound effect option is the Chinese language option, the controller 250 can decode the media data in Chinese through the Chinese language track, and control the audio output device 270 to play the decoded media data in Chinese.

[0115] S400: If the second sound effect option includes the target sound effect option, control the audio output device to play the second audio data with the target sound effect option.

[0116] When parsing the second sound effect option, such as Figure 8As shown, the controller 250 can traverse the second sound effect options according to the target sound effect options. The option type of the second sound effect option can be the same as the option type of the first sound effect option, for example, the second sound effect option can include a language option, an ambient sound option, a channel playback option or a characteristic sound option.

[0117] When the second sound effect option includes a target sound effect option, the display device 200 can directly control the audio output device 270 to play the second audio data according to the target sound effect option. For example, when the target sound effect option is a stereo surround sound option. After the audio output device 270 finishes playing the first audio data with the stereo surround sound option, when the display device 200 switches to playing the second media asset data, the controller 250 analyzes and obtains that the second sound effect option includes a stereo surround sound option, and the controller 250 directly controls the audio output device 270 to play the second audio data according to the stereo surround sound option, so as to reduce the need for the user to manually switch back to the target sound effect option, thereby improving the sound effect configuration efficiency of the media asset data.

[0118] S500: If the second sound effect option does not include the target sound effect option, updating a sound effect selection interface according to the second sound effect option, and controlling the display to display the updated sound effect selection interface.

[0119] If the second sound effect option does not include the target sound effect option, it means that the second audio data does not support the target sound effect option, and the display device 200 needs to update the sound effect selection interface according to the second sound effect option to prompt the user that the current display device 200 cannot play the target sound effect option with the target sound effect option, so that the user can change other sound effect options according to the sound effect selection interface. Fig. 9 As shown, when the first media data only supports playback in the Spanish language option, at this time, the target sound effect option is the Spanish language option, and correspondingly, the sound effect selection interface also only includes the Spanish language option. When the first audio data is played, the display device 200 switches to playing the second audio data according to the playback order of the media data. At this time, the controller 250 parses and obtains that the second sound effect option of the second media data only includes the Chinese language option. Therefore, the display device 200 cannot continue to play the second audio data in the Spanish language option. The controller 250 needs to update the sound effect selection interface according to the second sound effect option to cancel the original Spanish language option, and according to the second sound effect option, add a Chinese language option to the sound effect selection interface to prompt the user that the second media data can be played in the Chinese language option.

[0120] It should be noted that, in the process of the controller 250 executing the update of the sound effect selection interface, only one sound effect option is included in the sound effect selection interface as an example for explanation. It should be understood that in actual application scenarios, the sound effect selection interface may include multiple sound effect options. Moreover, the sound effect options may include different types at the same time, for example, language options, ambient sound options, channel playback options, or characteristic sound options.

[0121] After updating the sound effect selection interface, the controller 250 may control the display 260 to display the updated sound effect selection interface, so as to prompt the user to reselect a target sound effect option from the second sound effect options based on the updated sound effect selection interface.

[0122] In some embodiments, the display device 200 can respond to the target option sound effect through the operating system so that the display device 200 plays the first audio data according to the target option sound effect. The operating system includes four layers, namely, the application layer, the framework layer, the system library layer and the kernel layer. Among them, the framework layer may include a middleware layer, and the middleware layer includes a device middleware, and the device middleware is used to transmit the configuration information and data of the media asset data when switching different sound effect options so that the sound effect option takes effect. In the process of executing the sound effect configuration, only the application layer, the middleware layer and the application layer may be involved. Therefore, the embodiment of the present application only describes the sound effect configuration in detail with the application layer, the middleware layer and the application layer.

[0123] Before the display device 200 plays the first media data, the local media data can be traversed in the memory to detect the first media code in the local media data. The first media code is the encoded first media data, and the encoding format can improve data transmission efficiency and save storage space. When the local media data includes the first media code, the controller 250 can decode the first media code to obtain the first media data.

[0124] If the first media code is not detected in the local media data, the controller 250 can establish a communication connection with the server 400 through the communication device 220, and send a media request to the server 400, so that the server 400 responds to the media request and feeds back the URL link of the first media code to perform online decoding on the first media code to obtain the first media data.

[0125] Fig.10 The underlying logic diagram of the display device provided in the embodiment of the present application to generate a sound effect selection interface. Fig.10After decoding, the first media data is located at the kernel layer. The controller 250 can perform audio parsing on the first media data at the kernel layer to obtain audio scene information (Audio Scene Information, ASI) of the first media data, that is, ASI information, which is a metadata information used to describe audio scenes and audio objects.

[0126] The audio scene information may include the sound effect scenes that the first media asset data can support, for example, language scenes, ambient sound scenes, channel scenes, etc. Such as surround sound scenes, stereo sound scenes, etc., wherein the language scenes may include Chinese scenes, English scenes, etc., the ambient sound scenes may include surround sound scenes, stereo sound scenes, etc., and the channel scenes may include left channel, right channel, and dual channel, etc.

[0127] The controller 250 can generate a first sound effect option of the first media asset data according to the audio scene information, and send the first sound effect option to the device middleware in an information format. The device middleware generates sound effect status information according to the first sound effect option, and sends the sound effect status information to the application layer, so that the application layer generates a sound effect selection interface according to the sound effect status information, and displays the sound effect selection interface on the user interface.

[0128] In some embodiments, the first sound effect option may include multiple options, wherein each option may further include multiple sub-options. Taking the language option as an example, the language option may include multiple sub-options, such as the Chinese language option, the English language option, etc., which may all be referred to as sub-options of the language option. The first sound effect option may further include an initial sound effect option. When the display device 200 plays the first media asset data, if no sound effect selection instruction is received, the controller 250 may play the first audio data according to the initial sound effect option.

[0129] In the sound effect selection interface, the initial sound effect option is selected by default. The controller 250 can move the focus according to the target sound effect option when responding to the sound effect selection instruction, so that the focus is on the target sound effect option. When generating the sound effect selection interface, the controller 250 can parse the sound effect configuration information in the sound effect scene information based on the first sound effect option. The sound effect configuration information includes the current configuration information and the optional configuration information. The current configuration information is used to represent the sound effect options when the first media asset data is being played, for example, Fig.11 As shown, when the display device 200 is playing the first audio data in the Chinese language option, the current configuration information of the language option is the Chinese sound effect option. The optional configuration information is used to represent other sound effect options of the media asset data in addition to the current configuration information. For example, the first media asset data can also support the English language option and the Spanish language option in addition to the Chinese sound effect option. In this case, the optional configuration information can include the English language option and the Spanish language option.

[0130] After acquiring the current configuration information and the optional configuration information, the controller 250 can generate a sound effect selection interface according to the current configuration information and the optional configuration information. Among them, the initial sound effect option can be generated according to the current configuration information, and other first sound effect options other than the initial sound effect option can be generated according to the optional configuration information. At this time, the focus is on the initial sound effect option to prompt the user that the display device 200 is playing the first media data with the initial sound effect option. The user can enter a sound effect selection instruction and select a target sound effect option in other first sound effect options to change the sound effect option. The user can also enter a sound effect determination instruction to control the display device 200 to continue playing the first media data with the initial sound effect option.

[0131] In some embodiments, the first media data includes first subtitle data, and the controller 250 can synchronously display the first subtitle data when controlling the display 260 to display the media screen corresponding to the media data, so that the user can watch the media screen and the first subtitle data at the same time. Therefore, when the controller 250 controls the audio output device 270 to play the first audio data with the target sound effect option, the subtitle data can also be replaced according to the target sound effect option.

[0132] In the process of replacing the subtitle data, the controller 250 can detect the target sound effect option. If the target sound effect option is a language option, the controller 250 can parse the target language information in the target sound effect option. After obtaining the target language information, the controller 250 can obtain the target subtitle data according to the target language information. For example, if the target language information is Chinese language information, the controller 250 can obtain Chinese subtitle data according to the target language information. If the target language information is English language information, the controller 250 can obtain English subtitle data according to the target language information.

[0133] Before responding to the sound effect selection instruction, the controller 250 controls the display 260 to display the subtitle data of the initial language information in the initial sound effect option. At this time, the first subtitle data is the subtitle data of the initial language information. Fig.12 As shown, after obtaining the target subtitle data, the controller 250 can replace the subtitle data of the initial language information with the target subtitle data, so that the display 260 displays the target subtitle data and synchronizes the language of the first subtitle data with the first audio data.

[0134] While replacing the subtitle data, the controller 250 may also obtain corresponding audio data according to the target language information. For example, when the target language information is Chinese, the controller 250 may retrieve the first audio data in Chinese according to the Chinese language information, and replace the first audio data in the initial language information with the first audio data in Chinese to update the first audio data.

[0135] After updating the subtitle data and the first audio data according to the target sound effect option, in order to alleviate the problem that the playback timing of the first audio data does not match the display timing of the target subtitle data, the controller 250 can align the timing relationship between the target subtitle data and the updated first audio data after obtaining the target subtitle data and updating the first audio data, and synchronously control the audio output device 270 to play the first audio data and control the display 260 to display the target subtitle data according to the timing relationship, so as to improve the audio and video synchronization of the display device 200 in playing the first media data.

[0136] In some embodiments, Fig.13 As shown, after responding to the sound effect selection instruction, the controller 250 can parse the target sound effect option at the application layer to obtain the target configuration information. After obtaining the target configuration information, the controller 250 needs to send the target configuration information to the kernel layer to perform configuration update according to the target sound effect option.

[0137] To this end, the controller 250 can send the target configuration information to the middleware layer through the first interface. The first interface is used to connect the application layer and the middleware layer. After the target configuration information is sent to the middleware layer, the configuration information can be sent to the kernel layer through the second interface, and the sound effect scene information of the first media asset data is updated at the kernel layer based on the target configuration information.

[0138] For example, when the display device 200 is playing the first media asset data with a surround sound option, the sound effect selection instruction selects the target sound effect option as a stereo sound option, and the controller 250 can change the current configuration information from the surround sound option to the stereo sound option at the kernel layer to update the sound effect scene information of the first media asset data. After completing the update, the controller 250 can send the sound effect scene information from the kernel layer to the application layer to obtain the updated first audio data.

[0139] In the process of updating the sound effect scene information, the controller 250 can obtain the target configuration information for parsing, and the target configuration information includes a behavior event. The behavior event includes event parameters for updating the sound effect scene information, for example, five parameters, uuid, Version, actionType, paramInt, and paramFloat, where uuid is an identification parameter of the media data, used to identify the media data. Version is the version information parameter of the sound effect option. ActionType is an action value parameter, which can be changed according to the sound effect type, and different sound effect types have different action value parameters. ParamInt and paramFloat are used to represent the sound effect parameters, where paramInt represents the expected value of the sound effect parameter, and paramFloat is used to represent the floating value of the sound effect parameter. For example, when the stereo sound effect parameter is set from 50 to 80, paramInt is 80, and the sound effect parameter floats up by 30, and at this time paramFloat is "+30". Similarly, if the sound effect parameter floats down by 30, paramFloat is "-30".

[0140] The controller 250 can configure the configuration parameters of the sound effect scene information according to the target configuration information, and the configuration parameters are the sound effect parameters after the target sound effect option takes effect. The controller 250 can send the configuration parameters to the application layer to generate the sound effect configuration information of the first sound effect data according to the configuration parameters, thereby configuring the first audio data according to the sound effect configuration information and completing the update of the first audio data.

[0141] In some embodiments, when the controller 250 parses the sound effect scene information at the kernel layer, it can obtain the information format of the sound effect scene information. In order to facilitate information transmission, the sound effect scene information can be in XML format. The controller 250 can send the sound effect scene information to the application layer, and parse the sound effect scene information at the application layer according to the parsing format corresponding to the XML format, such as the DOM parsing format, to filter out redundant data in the sound effect scene information and obtain the sound effect configuration information.

[0142] In some embodiments, after the display device 200 finishes playing the first media asset data, if the second sound effect option includes a target sound effect option, the controller 250 can obtain the second audio data and parse the sound effect scene information of the second audio data. At this time, the sound effect scene information of the second audio data is the sound effect scene information of the initial sound effect option. In order to control the audio output device 270 to continue playing the second audio data with the target sound effect option, the controller 250 can configure the sound effect scene information of the second audio data according to the target configuration information, and update the second audio data according to the configured sound effect scene information, so that the audio output device 270 plays the updated second audio data with the target sound effect option. If the sound effect scene information is the same as the target configuration information, it means that the initial sound effect option of the second audio data is the same as the target sound effect option, and the controller 250 can directly control the audio output device 270 to play the second audio data.

[0143] In some embodiments, the user may input a sound effect selection instruction while the display device 200 is playing the first media asset data or the second media asset data. In order to adjust the sound effect according to the playing progress, taking the first media asset data as an example, the controller 250 may obtain the playing progress of the first media asset data. When the sound effect scene information configuration of the first media asset data is completed according to the sound effect configuration information, the audio output device 270 may be controlled to continue playing the first media asset data with the target sound effect option based on the playing progress.

[0144] In some embodiments, when updating the sound effect selection interface, since the first media asset data and the second media asset data may have the same sound effect options, the controller 250 may traverse the second sound effect options to obtain the sound effect options to be deleted and the newly added sound effect options. The newly added sound effect options are sound effect options other than the first sound effect options in the second sound effect options, and the sound effect options to be deleted are the first sound effect options included in the second sound effect options. The controller 250 may update the sound effect selection interface according to the sound effect options to be deleted and the newly added sound effect options.

[0145] Exemplarily, when the first sound effect option is a Chinese language option, an English language option, and a stereo option, the sound effect selection interface may include three sound effect options: a Chinese language option, an English language option, and a stereo option. If the second sound effect option is a Chinese language option, a Spanish language option, and a surround sound option, the first sound effect option and the second sound effect option both include the same Chinese language option, and the Chinese language option is the reserved sound effect option. In the first sound effect option, the sound effect options to be deleted are the English language option and the stereo option, and in the second sound effect option, the newly added sound effect options are the Spanish language option and the surround sound option. When updating the sound effect selection interface, the controller 250 may delete the English language option and the stereo option in the sound effect selection interface, and add the Spanish language option and the surround sound option in the sound effect selection interface to complete the update of the sound effect selection interface.

[0146] Some embodiments of the present application also provide a method for configuring sound effects, which is applied to the display device 200 provided in the above embodiment, and the display device 200 should at least include a display 260, an audio output device 270 and a controller 250. The display 260 is configured to display a user interface. The audio output device 270 is configured to play audio data. The method includes:

[0147] S100: When playing first media asset data, parsing a first sound effect option of the first media asset data, and controlling the display to display a sound effect selection interface.

[0148] The sound effect selection interface includes the first sound effect option, and the first media asset data includes first audio data.

[0149] S200: In response to a sound effect selection instruction input by a user based on the sound effect selection interface, controlling the audio output device to play the first audio data with a target sound effect option.

[0150] The target sound effect option is the first sound effect option specified by the sound effect selection instruction.

[0151] S300: parsing a second sound effect option of the second media asset data.

[0152] The second media asset data is the next media asset data adjacent to the first media asset data in the media asset playlist, and the second media asset data includes second audio data.

[0153] S400: If the second sound effect option includes the target sound effect option, control the audio output device to play the second audio data with the target sound effect option.

[0154] S500: If the second sound effect option does not include the target sound effect option, updating a sound effect selection interface according to the second sound effect option, and controlling the display to display the updated sound effect selection interface.

[0155] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a sound effect configuration method, wherein the sound effect configuration method can parse the first sound effect option of the first media asset data when playing the first media asset data, and control the display to display a sound effect selection interface including the first sound effect option. And in response to the sound effect selection instruction of the user based on the sound effect selection interface, control the audio output device to play the first audio data with the target sound effect option. Parse the second sound effect option of the second media asset data, if the second sound effect option includes the target sound effect option, control the audio output device to play the second audio data with the target sound effect option, if the second sound effect option does not include the target sound effect option, update the sound effect selection interface according to the second sound effect option, and control the display to display the updated sound effect selection interface.

[0156] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0157] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0158] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; an audio output device configured to play audio data; The controller is configured as: When playing the first media asset data, parsing the first sound effect option of the first media asset data, and controlling the display to display a sound effect selection interface, the sound effect selection interface including the first sound effect option, and the first media asset data including the first audio data; In response to a sound effect selection instruction input by a user based on the sound effect selection interface, controlling the audio output device to play the first audio data with a target sound effect option, where the target sound effect option is a first sound effect option specified by the sound effect selection instruction; Parsing a second sound effect option of second media asset data, where the second media asset data is the next media asset data adjacent to the first media asset data in the media asset playlist, and the second media asset data includes second audio data; If the second sound effect option includes the target sound effect option, controlling the audio output device to play the second audio data with the target sound effect option; If the second sound effect option does not include the target sound effect option, the sound effect selection interface is updated according to the second sound effect option, and the display is controlled to display the updated sound effect selection interface.

2. The display device according to claim 1, characterized in that The controller executes parsing of the first sound effect option of the first media asset data, and is specifically configured as follows: Decoding the first media asset code to obtain first media asset data; Parsing the first media asset data to obtain sound effect scene information of the first media asset data; The first sound effect option is generated according to the sound effect scene information.

3. The display device according to claim 2, characterized in that Before the controller executes the step of controlling the display to display the sound effect selection interface, the controller is further configured to: Based on the first sound effect option, parsing sound effect configuration information in the sound effect scene information, the sound effect configuration information including current configuration information and optional configuration information; A sound effect selection interface is generated according to the current configuration information and the optional configuration information.

4. The display device according to claim 1, characterized in that The first media asset data also includes first subtitle data, and the controller controls the audio output device to play the first audio data with a target sound effect option, which is specifically configured as follows: Parsing the target sound effect option to obtain target language information; Acquire target subtitle data according to the target language information, and update the first audio data according to the target language information; Aligning the timing relationship between the target subtitle data and the updated first audio data; According to the timing relationship, the audio output device is controlled to play the first audio data, and the display is controlled to display the target subtitle data.

5. The display device according to claim 1, characterized in that The controller controls the audio output device to play the first audio data with a target sound effect option, and is specifically configured to: Parsing the target sound effect option at the application layer to obtain target configuration information; sending the target configuration information to the middleware layer via a first interface, wherein the first interface is used to connect the application layer and the middleware layer; Sending the target configuration information to the kernel layer through the second interface; At the kernel layer, updating the sound effect scene information of the first media asset data based on the target configuration information; The updated sound effect scene information is sent from the kernel layer to the application layer to obtain updated first audio data.

6. The display device according to claim 5, characterized in that The controller controls the audio output device to play the second audio data with the target sound effect option, and is specifically configured to: Acquire the second audio data; parsing the sound effect scene information of the second audio data; configuring the sound effect scene information of the second audio data according to the target configuration information; The second audio data is updated according to the configured sound effect scene information, and the audio output device is controlled to play the updated second audio data.

7. The display device according to claim 5, characterized in that The controller executes sending the updated sound effect scene information from the kernel layer to the application layer, and is specifically configured as follows: Obtaining configuration parameters of the sound effect scene information; Sending the configuration parameters to the application layer; The sound effect configuration information of the first audio data is generated according to the configuration parameters to update the first audio data.

8. The display device according to claim 3, characterized in that The initial position of the sound effect scene information is the kernel layer, and the controller performs parsing of the sound effect configuration information in the sound effect scene information, which is specifically configured as follows: Acquiring the information format of the sound effect scene information at the kernel layer; Sending the sound effect scene information to the application layer; At the application layer, the sound effect scene information is parsed according to a parsing format corresponding to the information format to obtain sound effect configuration information.

9. The display device according to claim 1, characterized in that: The controller executes updating the sound effect selection interface according to the second sound effect option, and is specifically configured as follows: Traversing the second sound effect options to obtain the sound effect options to be deleted and the newly added sound effect options, wherein the newly added sound effect options are sound effect options other than the first sound effect options in the second sound effect options; and the sound effect options to be deleted are the first sound effect options included in the second sound effect options; The sound effect selection interface is updated according to the sound effect option to be deleted and the newly added sound effect option.

10. A sound effect configuration method, characterized in that: The display device according to any one of claims 1 to 9, wherein the display device comprises a display, an audio output device and a controller, the display is configured to display a user interface, the audio output device is configured to play audio data, and the method comprises: When playing the first media asset data, parsing the first sound effect option of the first media asset data, and controlling the display to display a sound effect selection interface, the sound effect selection interface including the first sound effect option, and the first media asset data including the first audio data; In response to a sound effect selection instruction input by a user based on the sound effect selection interface, controlling the audio output device to play the first audio data with a target sound effect option, where the target sound effect option is a first sound effect option specified by the sound effect selection instruction; Parsing a second sound effect option of second media asset data, where the second media asset data is the next media asset data adjacent to the first media asset data in the media asset playlist, and the second media asset data includes second audio data; If the second sound effect option includes the target sound effect option, controlling the audio output device to play the second audio data with the target sound effect option; If the second sound effect option does not include the target sound effect option, the sound effect selection interface is updated according to the second sound effect option, and the display is controlled to display the updated sound effect selection interface.

Images