Display devices and volume adjustment methods
By receiving volume adjustment commands from the display device, calculating the target gain value, and adjusting the audio stream or device port gain, the problem of the optical fiber interface being unable to transmit control commands is solved, resulting in simplified volume control and improved user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- QINGDAO HISENSE MEDIA NETWORKS CO LTD
- Filing Date
- 2023-11-28
- Publication Date
- 2026-07-31
AI Technical Summary
Because the fiber optic interface cannot transmit control commands, users need to adjust the volume using the amplifier's remote control, which makes the operation cumbersome and results in a poor user experience.
The display device is connected to the audio output device via optical fiber. After receiving the volume adjustment command, it calculates the target gain value and determines the audio strategy according to the audio format and output mode, adjusting the audio stream track gain or device port gain to achieve volume control.
Users can directly control the volume of the sound output device by inputting volume adjustment commands through the display device, which simplifies the operation process and improves the user experience.
Smart Images

Figure CN117812314B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of volume adjustment technology, and in particular to a display device and a volume adjustment method. Background Technology
[0002] Power amplifiers, due to their advantages such as clear sound quality and outstanding multi-channel capabilities, are often connected to display devices and other terminals to replace the terminal's own speakers for playing audio streams. Power amplifiers typically connect to terminals using four connection modes: HDMI (High Definition Multimedia Interface), Bluetooth, coaxial, and optical fiber. Among these, connecting to terminals via optical fiber offers strong anti-interference capabilities and is widely used in home theaters or larger spaces. However, because optical fiber can only transmit audio stream data and not control commands, volume adjustment commands input by the user to the terminal cannot be transmitted to the power amplifier via optical fiber for CEC (Consumer Electronics Control) control. Users must then use the power amplifier's remote control to input volume adjustment commands, which is cumbersome and results in a poor user experience. Summary of the Invention
[0003] To improve the user experience of volume adjustment, this application provides a display device and a volume adjustment method.
[0004] In a first aspect, this application provides a display device, which includes:
[0005] monitor;
[0006] A controller, connected to the display and via an optical fiber to the sound output device, is configured to:
[0007] Receive volume adjustment commands;
[0008] In response to the volume adjustment command, the target gain value of the display device is calculated based on the volume adjustment command;
[0009] An audio strategy is determined based on the audio format of the audio stream output from the display device to the sound output device and the audio output mode of the display device;
[0010] According to the audio strategy, the gain of the audio stream track or the gain of the port of the display device connected to the sound output device is updated to the target gain value.
[0011] In some embodiments, the controller is configured to: determine an audio strategy based on the audio format and audio output mode of the audio stream, including:
[0012] Based on the fact that the audio stream's audio format is non-PCM and the display device's audio output mode is pass-through, the audio strategy is determined to be the first strategy, which is used to update the audio stream's track gain.
[0013] Based on the fact that the audio stream is in PCM format or the audio output mode of the display device is non-pass-through, the audio strategy is determined to be the second strategy. The second strategy is used to update the gain of the port of the display device connected to the sound output device to the target gain value.
[0014] In some embodiments, the controller is configured to: update the track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value according to the audio strategy, including:
[0015] When the audio strategy is the first strategy, the audio track gain of the audio stream is updated to the target gain value through the audio playback service, so that the volume of the sound output device changes with the gain update of the input audio stream.
[0016] In some embodiments, the controller is configured to update the track gain of the audio stream to the target gain value via an audio playback service when the audio policy is a first policy, and is further configured to determine whether the audio stream is active.
[0017] In some embodiments, the controller is configured to update the track gain of the audio stream to the target gain value via an audio playback service when the audio policy is a first policy, and is further configured to determine whether the track gain of the audio stream is a variable gain.
[0018] In some embodiments, the controller is configured to: update the track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value according to the audio strategy, including:
[0019] When the audio strategy is the second strategy, the gain of the port of the display device connected to the sound output device is updated to the target gain value through the audio hardware interface layer, so that the volume of the sound output device changes with the gain update of the port connected to the display device.
[0020] Secondly, this application provides a volume adjustment method, the method comprising:
[0021] Receive volume adjustment commands input to a display device, wherein the display device is connected to a sound output device via an optical fiber;
[0022] In response to the volume adjustment command, the target gain value of the display device is calculated based on the volume adjustment command;
[0023] An audio strategy is determined based on the audio format of the audio stream output from the display device to the sound output device and the audio output mode of the display device;
[0024] According to the audio strategy, the gain of the audio stream track or the gain of the port of the display device connected to the sound output device is updated to the target gain value.
[0025] In some embodiments, determining an audio strategy based on the audio format and audio output mode of the audio stream includes:
[0026] Based on the fact that the audio stream's audio format is non-PCM and the display device's audio output mode is pass-through, the audio strategy is determined to be the first strategy, which is used to update the audio stream's track gain.
[0027] Based on the fact that the audio stream is in PCM format or the audio output mode of the display device is non-pass-through, the audio strategy is determined to be the second strategy. The second strategy is used to update the gain of the port of the display device connected to the sound output device to the target gain value.
[0028] In some embodiments, updating the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value according to the audio strategy includes:
[0029] When the audio strategy is the first strategy, the audio track gain of the audio stream is updated to the target gain value through the audio playback service, so that the volume of the sound output device changes with the gain update of the input audio stream.
[0030] In some embodiments, updating the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value according to the audio strategy includes:
[0031] When the audio strategy is the second strategy, the gain of the port of the display device connected to the sound output device is updated to the target gain value through the audio hardware interface layer, so that the volume of the sound output device changes with the gain update of the port connected to the display device.
[0032] The beneficial effects of the display device and volume adjustment method provided in this application include:
[0033] This embodiment of the application, upon receiving a volume adjustment command input by a user to the display device, adjusts the gain of the audio track or the port of the audio output device connected to the display device. This causes the volume of the audio output device to change in accordance with the gain update of the input audio stream or the gain update of the port connected to the display device. It eliminates the need for the audio output device itself to update its gain. This solves the problem that when the audio output device is connected to the display device via optical fiber, the display device cannot transmit volume adjustment commands to the audio output device to adjust its volume gain. Users can control the volume of the audio output device simply by inputting a volume adjustment command into the display device, simplifying the user experience and improving the volume adjustment experience. Attached Figure Description
[0034] To more clearly illustrate the implementation methods in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.
[0035] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to some embodiments;
[0036] Figure 2 The diagram illustrates, by way of example, a hardware configuration block diagram of a control device 100 according to some embodiments;
[0037] Figure 3 The diagram illustrates, by way of example, a hardware configuration block diagram of a display device 200 according to some embodiments;
[0038] Figure 4 The diagram illustrates, by way of example, a software configuration schematic of a display device 200 according to some embodiments;
[0039] Figure 5 The diagram illustrates a flow chart of a volume adjustment method according to some embodiments;
[0040] Figure 6 The diagram illustrates a flowchart of an audio stream playback method according to some embodiments;
[0041] Figure 7 The diagram illustrates, by way of example, a flow chart of audio stream processing by a display device according to some embodiments;
[0042] Figure 8 The diagram illustrates, by way of example, a method for a display device to respond to a volume adjustment command according to some embodiments;
[0043] Figure 9The diagram illustrates a flow chart of volume adjustment according to a first or second strategy based on some embodiments.
[0044] Figure 10 The diagram illustrates, according to some embodiments, the interactions at various levels within the operating system of a display device. Detailed Implementation
[0045] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.
[0046] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0047] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.
[0048] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0049] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 and Figure 2 This is one specific embodiment of the display device of this application.
[0050] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control unit according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control device 100.
[0051] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.
[0052] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.
[0053] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.
[0054] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.
[0055] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
[0056] In some embodiments, the display device 200 also communicates with the power amplifier 500 via data communication. The display device 200 can be connected to the power amplifier 500 via optical fiber. The display device 200 can send an audio stream to the power amplifier 500, which then plays the audio stream.
[0057] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.
[0058] like Figure 3The display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0059] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.
[0060] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.
[0061] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.
[0062] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.
[0063] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).
[0064] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.
[0065] External device interface 240 may include, but is not limited to, one or more of the following: optical fiber interface, high-definition multimedia interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces. The optical fiber interface connects to an audio output device, such as amplifier 500, via optical fiber.
[0066] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.
[0067] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0068] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.
[0069] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first to an nth interface for input / output, a communication bus, etc.
[0070] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0071] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0072] See Figure 4In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.
[0073] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.
[0074] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.
[0075] like Figure 4 As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0076] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).
[0077] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.
[0078] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.
[0079] In some embodiments, the hardware or software architecture can be based on the description in the above embodiments, and in some embodiments it can be based on other similar hardware or software architectures, as long as the technical solution of this application can be implemented.
[0080] In some embodiments, after the display device 200 and the power amplifier 500 are connected via optical fiber, the audio stream of the media played on the display device 200 can be transmitted to the power amplifier 500 for playback, achieving excellent sound playback effects. However, since optical fiber cannot transmit control commands, the volume adjustment commands input by the user to the display device 200 cannot be transmitted to the power amplifier 500. The user needs to input volume adjustment commands to the power amplifier 500 through the power amplifier 500's remote control to adjust the volume, or adjust the volume of the power amplifier 500 through the volume adjustment buttons provided on the power amplifier 500. When the user needs to control the display device 200, such as switching the played media, they also need to control the display device 200 through its remote control, such as the control device 100. During the use of the display device 200, the user needs to switch back and forth between the display device 200's remote control and the power amplifier 500's remote control, which is cumbersome and results in a poor user experience.
[0081] To address the aforementioned technical problems and improve the volume adjustment experience, this application proposes a volume adjustment method, see below. Figure 5 This method, used for display devices, may include the following steps:
[0082] Step S101: Receive a volume adjustment command input to the display device, wherein the display device is connected to the sound output device via an optical fiber.
[0083] In some embodiments, when the display device and an audio output device, such as a power amplifier, are connected via optical fiber, the audio stream of the media being played on the display device can be played through the power amplifier. If the user needs to adjust the volume of the power amplifier, they can input a volume adjustment command to the display device.
[0084] In some embodiments, the user may input volume adjustment commands to the display device via the volume up and volume down buttons on a remote control, voice input, or input via a mobile terminal, etc. This application does not specifically limit this method.
[0085] Step S102: In response to the volume adjustment command, calculate the target gain value of the display device according to the volume adjustment command.
[0086] In some embodiments, after receiving a voice adjustment command input by the user, the display device can calculate a target gain value for the display device based on the volume adjustment command and the current volume. For example, if the volume adjustment command is a volume increase command with an adjustment step of 1, and the current volume gain value is 15, then the target gain value is calculated to be 16.
[0087] Step S103: Determine an audio strategy based on the audio format of the audio stream output from the display device to the sound output device and the audio output mode of the display device.
[0088] In some embodiments, the audio format of the audio stream output by the display device to the power amplifier may include PCM (Pulse Code Modulation) format and non-PCM format, and the audio output mode of the audio stream output by the display device may include pass-through and non-pass-through, wherein, for non-PCM format audio streams, the audio output mode is typically pass-through.
[0089] When the audio stream is in a non-PCM format and the audio output mode of the display device is pass-through, the audio strategy can be determined as the first strategy, which means adjusting the audio track gain of the audio stream.
[0090] When the audio stream is in PCM format or the audio output mode of the display device is non-pass-through, the audio strategy can be determined as the second strategy, which means adjusting the gain of the display device's output port.
[0091] Step S104: According to the audio strategy, update the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value.
[0092] In some embodiments, when the audio strategy is the first strategy, the track gain of the audio stream can be updated to a target gain value, so that the volume of the sound output device changes in accordance with the gain update of the input audio stream.
[0093] In some embodiments, when the audio strategy is the second strategy, the gain of the port of the display device connected to the power amplifier can be updated to the target gain value, so that the volume of the sound output device changes with the gain update of the port connected to the display device.
[0094] As can be seen from the above embodiments, after receiving a volume adjustment command input by the user to the display device, the present application embodiments adjust the gain of the audio stream track or the gain of the port connected to the display device to the power amplifier, so that the volume of the power amplifier changes with the gain update of the input audio stream or the gain update of the port connected to the display device. It is not necessary to update the gain of the power amplifier itself, which solves the problem that when the power amplifier is connected to the display device through an optical fiber, the display device cannot transmit a volume adjustment command to the power amplifier to adjust the volume gain. The user can control the volume of the power amplifier by inputting a volume adjustment command to the display device, which is simple for the user and improves the volume adjustment experience.
[0095] To further illustrate the volume adjustment method provided in the embodiments of this application, the process of a display device playing an audio stream is described below.
[0096] See Figure 6 This is a flowchart illustrating an audio stream playback method according to some embodiments, such as... Figure 6 As shown, the method may include the following steps:
[0097] Step S201: In response to the media asset playback command, determine the current audio output device.
[0098] In some embodiments, after the user connects the display device and the amplifier via optical fiber, they can open the display device's settings interface. The settings interface includes audio settings controls. When the user triggers these controls, they can enter the audio settings interface. The audio settings interface also includes sound output device controls. When the user triggers these controls, the display device can display a list of sound output devices, which may include smart TV controls and amplifier controls. If the user triggers the amplifier controls, the display device sets the audio parameters corresponding to the current sound output device to those of the amplifier.
[0099] In some embodiments, the audio settings interface includes an audio output mode control. When a user triggers the audio output mode control, the display device can display a list of audio output modes, which may include an automatic control, a pass-through control, and a PCM control. If the user triggers the pass-through control, the display device sets the audio parameters corresponding to the current audio output mode to pass-through; if the user triggers the PCM control, the display device sets the audio parameters corresponding to the current audio output mode to PCM; and if the user triggers the automatic control, the display device sets the audio parameters corresponding to the current audio output mode to automatic.
[0100] In some embodiments, the user inputs a media playback command on the display device, such as requesting a movie. The display device then starts a player to play the video stream of the media and determines the current audio output device based on the audio parameters corresponding to the current audio output device. For example, if the current audio output device is an amplifier based on the audio parameters corresponding to the current audio output device, the current audio output device is determined to be an amplifier.
[0101] Step S202: Obtain the audio playback capability parameters of the sound output device.
[0102] In some embodiments, after determining the current audio output device, the display device obtains the audio playback capability parameters of the audio output device, which may include the audio formats and audio output modes supported by the audio output device.
[0103] Step S203: Determine whether the sound output device supports playing the current audio stream.
[0104] In some embodiments, the display device compares the audio formats supported by the sound output device with the audio format of the audio stream to determine whether the audio formats supported by the sound output device include the audio format of the audio stream. If they do, the sound output device is determined to support playing the current audio stream; if they do not, the sound output device is determined to not support playing the current audio stream.
[0105] Step S204: If not supported, exit the playback process.
[0106] In some embodiments, if the sound output device does not support playing the current audio stream, the audio stream playback process is terminated.
[0107] Step S205: If supported, determine the audio output mode of the audio stream.
[0108] In some embodiments, if the audio parameters corresponding to the audio output mode are pass-through, then the audio output mode of the audio stream is determined to be pass-through.
[0109] In some embodiments, if the audio parameter corresponding to the audio output mode is PCM, then the audio output mode of the audio stream is determined to be PCM.
[0110] In some embodiments, if the audio parameters corresponding to the audio output mode are automatic, the display device can automatically determine whether the audio output mode of the audio stream is pass-through or PCM based on the audio parameters of the audio stream.
[0111] Step S206: Open the output path of the audio stream.
[0112] In some embodiments, after the audio output mode of the audio stream is determined, the output path of the audio stream of AudioTrack (audio player) can be opened.
[0113] Step S207: Obtain the size of the minimum buffer.
[0114] In some embodiments, the minimum buffer size of AudioTrack can be obtained using the getMinBufferSize function.
[0115] Step S208: Set the buffer size for the audio playback service.
[0116] In some embodiments, after obtaining the minimum buffer size of AudioTrack, the size of the buffer for the audio playback service can be set to that minimum buffer size.
[0117] Step S209: Start playing the audio stream.
[0118] In some embodiments, after setting the buffer size of the audio playback service, a playback function can be executed to start playing the audio stream.
[0119] In some embodiments, by Figure 6 After the method shown initiates audio stream playback, the display device's processing flow for the audio stream can be found in [reference needed]. Figure 7 .
[0120] like Figure 7 As shown, streaming media applications on display devices, such as video-on-demand programs playing non-PCM format audio streams, reach the audio hardware interface layer through the audio playback service. The audio hardware interface layer sends the audio stream to the decoder. For non-PCM format audio streams with pass-through audio output mode, the decoder directly sends the audio stream to the digital audio processor unit. The digital audio processor unit has a mixer that can mix multiple audio streams and output the mixed audio stream to either an SPDIF (Digital Audio Interface) interface or an ARC (Audio Return Channel) interface. The SPDIF interface includes an optical fiber interface, which can be connected to an amplifier via optical fiber. The ARC interface can be connected to an ARC device via an HDMI cable. This ARC device can be an amplifier connected to the display device via an HDMI cable.
[0121] like Figure 7As shown, the PCM format audio stream played by the streaming media application of the display device goes through the audio playback service, the audio hardware interface layer, and the decoder for mixing. The processed audio stream is then sent to the digital audio processor unit for further processing. After that, it goes through processes such as sound effect preprocessing and output gain processing. Finally, it is integrated by the encoder and returned to the digital frequency processor unit. After being processed by the mixer of the digital frequency processor unit, it is output to the I2S (Inter-IC Sound, serial interface) interface or the DAC (Direct Attach Cable, direct connection cable) interface.
[0122] In some embodiments, by Figure 7 The process shown involves the display device sending the audio stream to a hardware interface, such as an optical interface. If it receives a volume adjustment command from the user, the display device's response method can be found in [reference needed]. Figure 8 .
[0123] like Figure 8 As shown, the method by which a display device responds to a volume adjustment command may include the following steps:
[0124] Step S301: The audio service agent receives the volume adjustment event.
[0125] In some embodiments, after a user inputs a volume adjustment command, the display device generates a volume adjustment event and sends the volume adjustment event to the audio service agent for processing.
[0126] Step S302: Determine whether you have volume adjustment permission.
[0127] In some embodiments, the audio service agent, upon receiving a volume adjustment event, determines whether it has volume adjustment permission.
[0128] Step S303: If you do not have volume adjustment permission, exit the volume adjustment process.
[0129] In some embodiments, if the audio service agent determines that it does not have volume adjustment permission, it exits the volume adjustment process and does not execute subsequent volume adjustment steps.
[0130] Step S304: If volume adjustment permission is granted, the volume adjustment event is passed to the audio service for processing.
[0131] In some embodiments, if the audio service agent determines that it has volume adjustment permission, it will pass the volume adjustment event to the audio service for processing.
[0132] Step S305: The audio service calculates the target gain value for the volume.
[0133] In some embodiments, after receiving a volume adjustment event, the audio service obtains the current index (gain) value of the sound output device of the display device and the adjustment step size, and calculates the adjusted index value, i.e., the target gain value, based on the current gain value and the adjustment step size.
[0134] Step S306: The audio service determines whether the sound output device is a Bluetooth device or an ARC device.
[0135] In some embodiments, the audio service executes a corresponding volume adjustment procedure based on the type of the sound output device. When the sound output device is a Bluetooth device or an ARC device, the volume of the sound output device can be adjusted to the target gain value through the corresponding driver. When the sound output device is not a Bluetooth device or an ARC device, the volume of the sound output device cannot usually be adjusted to the target gain value through the corresponding driver. Therefore, the audio service can determine whether the sound output device is a Bluetooth device or an ARC device.
[0136] Step S307: If it is not a Bluetooth device or an ARC device, the audio service starts the audio policy service.
[0137] In some embodiments, if the audio output device is not a Bluetooth device or an ARC device, the audio service initiates an audio policy service. The audio policy service can determine an audio policy based on the audio output format and audio output mode.
[0138] Step S308: When the audio policy is the first policy, the audio policy service determines whether the audio stream is active.
[0139] In some embodiments, if the audio policy service determines that the audio policy is the first policy, it can determine whether the audio stream is active, that is, whether the display device is currently outputting an audio stream to the sound output device. If it is outputting an audio stream, the audio stream is active; if it is not outputting an audio stream, the audio stream is inactive. Specifically, if the display device is playing media, it outputs an audio stream to the sound output device; if the display device is not playing media, for example, if the current display interface is a settings interface, it does not output an audio stream to the sound output device.
[0140] Step S309: If the state is active, update the track gain to the target gain value.
[0141] In some embodiments, if the audio policy is a first policy and the audio stream is active, the audio policy service can update the track gain of the audio stream to a target gain value.
[0142] In some embodiments, if the audio policy is the first policy and the audio stream is inactive, the process jumps to step S303 and exits the volume adjustment process.
[0143] Step S310: When the audio policy is the second policy, the audio policy service updates the target gain value to the audio hardware interface layer.
[0144] In some embodiments, if the audio policy service determines that the audio policy is the second policy, the target gain value can be updated to the audio hardware interface layer.
[0145] Step S311: The audio hardware interface layer updates the target gain value to the port corresponding to the current sound output device.
[0146] In some embodiments, the audio hardware interface layer can determine the port of the display device to which the current sound output device is connected, such as an optical fiber interface, and update the gain value of that port to the target gain value.
[0147] Step S312: The audio driver layer plays the audio stream.
[0148] In some embodiments, after updating the gain of the port corresponding to the audio output device to the target gain value, a gain update of the display device at the device level is achieved, thereby updating the gain of the audio stream output by the display device. The display device transmits the audio stream to the audio driver layer, and the audio driver layer transmits the audio stream to the audio output device for playback, thus realizing volume adjustment of the audio output device.
[0149] Step S313: If it is a Bluetooth device or an ARC device, the audio service will pass the target gain value to the Bluetooth service layer or the HDMI CEC service layer.
[0150] In some embodiments, if the audio output device is a Bluetooth device, the audio service passes the target gain value to the Bluetooth service layer; if the audio output device is an ARC device, the audio service passes the target gain value to the HDMI CEC service layer.
[0151] Step S314: The Bluetooth service layer passes the target gain value to the Bluetooth hardware interface layer.
[0152] In some embodiments, after receiving the target gain value, the Bluetooth service layer passes the target gain value to the Bluetooth hardware interface layer for processing.
[0153] Step S315: The Bluetooth hardware interface layer passes the target gain value to the Bluetooth driver.
[0154] In some embodiments, after receiving the target gain value, the Bluetooth hardware interface layer passes the target gain value to the Bluetooth driver for processing.
[0155] Step S316: The Bluetooth driver adjusts the volume of the Bluetooth device according to the target gain value.
[0156] In some embodiments, after receiving the target gain value, the Bluetooth driver sends the target gain value to the Bluetooth device connected to the display device, and the Bluetooth device adjusts the volume to the target gain value according to the target gain value.
[0157] Step S317: The HDMI CEC service layer passes the target gain value to the HDMI CEC hardware interface layer.
[0158] In some embodiments, after receiving the target gain value, the HDMI CEC service layer passes the target gain value to the HDMI CEC hardware interface layer for processing.
[0159] Step S318: The HDMI CEC hardware interface layer passes the target gain value to the HDMI driver.
[0160] In some embodiments, after receiving the target gain value, the HDMI CEC hardware interface layer passes the target gain value to the HDMI driver for processing.
[0161] Step S319: The HDMI driver adjusts the volume of the ARC device according to the target gain value.
[0162] In some embodiments, after receiving the target gain value, the HDMI driver sends the target gain value to the ARC device connected to the display device, and the ARC device adjusts the volume to the target gain value according to the target gain value.
[0163] To Figure 8 The first and second strategies of the mid-audio strategy service will be further explained. Figure 9 A schematic diagram of a volume adjustment process based on a first strategy or a second strategy is shown, such as... Figure 9 As shown, the volume adjustment may include the following steps:
[0164] Step S401: The audio policy service obtains the target gain value.
[0165] In some embodiments, after calculating the target gain value of the audio stream, the audio service sends the target gain value to the audio policy service.
[0166] Step S402: The audio policy service determines whether the audio format is non-PCM and whether the output mode is pass-through.
[0167] In some embodiments, after receiving the target gain value, the audio policy service can determine whether the audio format is non-PCM and the output mode is pass-through in order to determine the audio policy.
[0168] Step S403: If the audio format is not PCM and the output mode is pass-through, the audio policy service determines whether the audio stream is active.
[0169] In some embodiments, if the audio format is non-PCM and the output mode is pass-through, the audio strategy is determined to be the first strategy. Since the first strategy updates the audio stream track gain in real time, it is necessary to determine whether the audio stream is active.
[0170] Step S404: If not active, exit the volume adjustment process.
[0171] In some embodiments, if the audio stream is not active, i.e., the display device is not currently transmitting an audio stream to the sound output device, the volume adjustment process is exited.
[0172] Step S405: If the state is active, the audio policy service determines whether the audio stream is variable gain.
[0173] In some embodiments, if the audio stream is active, i.e., the display device is currently transmitting an audio stream to the sound output device, it can be determined whether the audio stream has variable gain. Since the audio stream has fixed gain, it is impossible to adjust the track gain when it has fixed gain. Therefore, it can be determined whether the audio stream has variable gain first, and then the track gain can be adjusted if it does.
[0174] Step S406: If it is a variable gain, the audio policy service sets the audio stream gain to the target value.
[0175] In some embodiments, if the gain is variable, the audio policy service can set the audio stream gain to the target gain.
[0176] Step S407: The audio policy service sends the audio stream gain to the audio playback service.
[0177] In some embodiments, after the audio policy service sets the audio stream gain, it can send the audio stream gain to the audio playback service for processing.
[0178] Step S408: The audio playback service updates the audio stream gain.
[0179] In some embodiments, the audio playback service can further apply the track gain of the audio stream to the audiotrack to achieve changes in the audio stream gain.
[0180] Step S409: If the gain is immutable, the audio policy service sets the audio stream gain to 0dB.
[0181] In some embodiments, if the gain is immutable, the audio policy service can set the audio stream gain to 0dB, that is, not adjust the audio stream gain, and then jump to step S407. After executing steps S407 and S408 in sequence, the updated audio stream gain is the same as before the update.
[0182] Step S410: If the audio format is PCM or the output mode is non-pass-through, the audio policy service updates the target gain value to the audio hardware interface layer.
[0183] In some embodiments, if the audio format is PCM or the output mode is non-pass-through, the audio policy is determined to be a second-side policy. Based on this second policy, the audio policy service updates the target gain value to the audio hardware interface layer.
[0184] Step S411: The audio hardware interface layer updates the target gain value to the port corresponding to the current sound output device.
[0185] In some embodiments, the audio hardware interface layer may determine the port of the display device to which the current sound output device is connected and update the gain value of that port to the target gain value.
[0186] Step S412: The audio driver layer plays the audio stream.
[0187] In some embodiments, after updating the gain of the port corresponding to the audio output device to the target gain value, a gain update of the display device at the device level is achieved, thereby updating the gain of the audio stream output by the display device. The display device transmits the audio stream to the audio driver layer, and the audio driver layer transmits the audio stream to the audio output device for playback, thus realizing volume adjustment of the audio output device.
[0188] To further illustrate the volume adjustment method provided in the embodiments of this application, Figure 10 This diagram illustrates the interactions between different layers within the operating system of a display device.
[0189] like Figure 10 As shown, streaming media applications at the application layer, such as video-on-demand programs, can play media assets requested by the user. After a user requests a media asset, the streaming media application launches the player through the framework layer. The player starts the audio playback service, which transmits the audio stream to the audio hardware interface layer. The audio hardware interface layer, based on the audio output device connected to the display device, transmits the audio stream through the audio driver layer to the audio output device for playback.
[0190] After the user inputs a volume adjustment command, the application layer receives the volume adjustment event and passes it to the audio service in the framework layer for processing. The audio service can start an audio policy service, which determines whether the audio policy is a first policy or a second policy. When the audio policy is the first policy, the target gain value is applied to the audiotrack through the audio playback service to adjust the gain of the audio stream. When the audio policy is the second policy, the target gain value is updated to the audio hardware interface layer to update the gain of the entire display device. Finally, the audio stream with the updated gain is transmitted to the volume output device for playback through the audio driver layer.
[0191] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0192] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.
Claims
1. A display device, characterized by comprising: include: monitor; A controller, connected to the display and via an optical fiber to the sound output device, is configured to: Receive volume adjustment commands; In response to the volume adjustment command, the target gain value of the display device is calculated based on the volume adjustment command; An audio strategy is determined based on the audio format of the audio stream output from the display device to the sound output device and the audio output mode of the display device; wherein... If the audio stream is in a non-PCM format and the audio output mode of the display device is pass-through, then the audio strategy is determined to be the first strategy, which is used to update the audio track gain of the audio stream. If the audio stream is in PCM format, or the audio output mode of the display device is non-pass-through, then the audio strategy is determined to be the second strategy. The second strategy is used to update the gain of the port of the display device connected to the sound output device to the target gain value. According to the audio strategy, the gain of the audio stream track or the gain of the port of the display device connected to the sound output device is updated to the target gain value.
2. The display device of claim 1, wherein, The controller is configured to: update the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value according to the audio strategy, including: When the audio strategy is the first strategy, the audio track gain of the audio stream is updated to the target gain value through the audio playback service, so that the volume of the sound output device changes with the gain update of the input audio stream.
3. The display device of claim 2, wherein, The controller is configured to update the audio track gain of the audio stream to the target gain value through the audio playback service when the audio policy is the first policy. It is also previously configured to determine whether the audio stream is active.
4. The display device of claim 2, wherein, The controller is configured to update the audio stream track gain to the target gain value via an audio playback service when the audio policy is the first policy. It is also previously configured to determine whether the audio stream track gain is a variable gain.
5. The display device of claim 1, wherein, The controller is configured to: update the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value according to the audio strategy, including: When the audio strategy is the second strategy, the gain of the port of the display device connected to the sound output device is updated to the target gain value through the audio hardware interface layer, so that the volume of the sound output device changes with the gain update of the port connected to the display device.
6. A method of adjusting the volume, characterized by include: Receive volume adjustment commands input to a display device, wherein the display device is connected to a sound output device via an optical fiber; In response to the volume adjustment command, the target gain value of the display device is calculated based on the volume adjustment command; An audio strategy is determined based on the audio format of the audio stream output from the display device to the sound output device and the audio output mode of the display device; wherein... If the audio stream is in a non-PCM format and the audio output mode of the display device is pass-through, then the audio strategy is determined to be the first strategy, which is used to update the audio track gain of the audio stream. If the audio stream is in PCM format, or the audio output mode of the display device is non-pass-through, then the audio strategy is determined to be the second strategy. The second strategy is used to update the gain of the port of the display device connected to the sound output device to the target gain value. According to the audio strategy, the gain of the audio stream track or the gain of the port of the display device connected to the sound output device is updated to the target gain value.
7. The volume adjustment method of claim 6, wherein, According to the audio strategy, updating the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value includes: When the audio strategy is the first strategy, the audio track gain of the audio stream is updated to the target gain value through the audio playback service, so that the volume of the sound output device changes with the gain update of the input audio stream.
8. The volume adjustment method of claim 6, wherein, According to the audio strategy, updating the audio track gain of the audio stream or the gain of the port of the display device connected to the sound output device to the target gain value includes: When the audio strategy is the second strategy, the gain of the port of the display device connected to the sound output device is updated to the target gain value through the audio hardware interface layer, so that the volume of the sound output device changes with the gain update of the port connected to the display device.