Display device and audio-visual synchronization method
By detecting and processing the audio and video synchronization values of different audio devices in the display device, the problem of inaccurate audio and video synchronization during multi-window display is solved, and the user experience is improved.
Patent Information
- Application Number
- CN202110481408.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-30
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-04-30
AI Technical Summary
When existing display devices display screens in multiple windows, the audio and video synchronization processing is inaccurate, resulting in poor user experience.
Design a display device and audio and video synchronization method, detect the user-controlled focus window and its corresponding audio equipment through a display, an audio processor, an audio output interface and a controller, obtain the audio and video synchronization values of different types of audio equipment, and according to These values set the playback parameters of the audio signal to ensure that the screen information of each window is synchronized with the audio information.
It realizes accurate audio and video synchronization processing of the windows selected by the user, improves user experience, and ensures the consistency and accuracy of audio and video synchronization between multiple windows.
Smart Images

Figure CN114302021B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for synchronizing audio and video. Background Art
[0002] With the rapid development of intelligent display devices, the functions of display devices will become more and more abundant, and the performance will become more and more powerful. They can realize two-way human-computer interaction, integrate multiple functions such as audio and video, entertainment, and data, and meet the diverse and personalized needs of users. As users' requirements for the functions or services that display devices can provide are getting higher and higher, split-screen display has gradually become a function that users often use.
[0003] For some display devices, the picture displayed on the monitor can also be split into multiple windows, each window showing different picture content, so that users can watch different program pictures at the same time.
[0004] Since the display device takes a different amount of time to process the image part than the audio part, the display device usually performs audio and video synchronization processing on the played program. However, the inventor of the present application found that when the existing display device uses multiple windows to display the screen, if audio and video synchronization is required, the multiple windows are usually synchronized together, and the adjustment amount of audio and video synchronization is the same. Multiple windows are usually in independent playback processes. If audio and video synchronization is performed on all windows at the same time, it is easy to cause inaccurate audio and video synchronization in some windows, resulting in a poor user experience. Summary of the invention
[0005] The present invention provides a display device and a method for synchronizing audio and video, so as to solve the problem that in the existing display device, the audio and video synchronization is inaccurate, resulting in poor user experience.
[0006] In the first aspect, the present application provides a display device, which includes a display, an audio processor, an audio output interface, and a controller. The display is used to display a user interface, wherein the user interface includes multiple windows; the audio processor is used to generate an audio signal; there are multiple audio output interfaces for connecting multiple types of audio devices; the controller is configured to perform the following steps: in response to a display instruction input by a user indicating that multiple windows are displayed, the display is controlled to display multiple windows; the focus window where the focus controlled by the user is located is detected; in response to an audio-visual synchronization instruction input by the user, the audio device corresponding to the focus window is detected; when the audio device corresponding to the focus window is a first type of audio device, a first audio-visual synchronization value is obtained; when the audio device corresponding to the focus window is a second type of audio device, a second audio-visual synchronization value is obtained; and the audio playback parameters corresponding to the audio signal are set according to the audio-visual synchronization value, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window.
[0007] In some implementations, in executing the step of obtaining the first audio-visual synchronization value, the controller is further configured to: obtain the image quality processing delay parameters and the sound effect processing delay parameters of the focus window, and calculate the first audio-visual synchronization value based on the image quality processing delay parameters and the sound effect processing delay parameters.
[0008] In some implementations, in executing the step of acquiring the second audio-visual synchronization value, the controller is further configured to: set the second audio-visual synchronization value to a preset value.
[0009] In some implementations, in executing the step of setting the audio playback parameters corresponding to the audio signal according to the audio-visual synchronization value, the controller is further configured to: obtain the audio-visual synchronization adjustment parameters set by the user; calculate the audio-visual synchronization adjustment time according to the audio-visual synchronization adjustment parameters, so as to calculate the audio playback parameters corresponding to the audio signal according to the audio-visual synchronization adjustment time and the audio-visual synchronization value.
[0010] In some implementations, the controller is further configured to: in response to a switching instruction input by a user indicating switching of the audio device corresponding to the focus window, switch the audio device corresponding to the focus window, and adjust the audio-visual synchronization value to reset the audio playback parameters according to the adjusted audio-visual synchronization value.
[0011] In some implementations, when it is detected that the audio device corresponding to the focus window switches from a first type of audio device to a second type of audio device, in executing the step of adjusting the audio and video synchronization value, the controller is further configured to: close the sound effect processing process corresponding to the focus window, and set the audio and video synchronization value to 0.
[0012] In some implementations, when it is detected that the audio device corresponding to the focus window switches from the second category audio device to the first category audio device, in executing the step of adjusting the audio and video synchronization value, the controller is further configured to: obtain the resolution information and frame rate information and the sound effect processing type corresponding to the focus window; obtain the image quality processing delay parameter according to the resolution information and the frame rate information; obtain the sound effect processing delay parameter according to the sound effect processing type; subtract the sound effect processing delay parameter from the image quality processing delay parameter to obtain the current audio and video synchronization value of the focus window.
[0013] In some implementations, the controller is further configured to: when it is detected that the switching instruction indicates that the audio device corresponding to the focus window is switched from the second category audio device to the first category audio device, determine the usage status of the first category audio device; when the first category audio device is in an unused state, switch the audio device corresponding to the focus window to the first category audio device; when the first category audio device is in use, determine the switching window currently corresponding to the first category audio device; switch the audio device corresponding to the switching window to the second category audio device, close the sound effect processing process corresponding to the switching window, and set the audio and video synchronization value of the switching window to 0.
[0014] In some implementations, the controller is further configured to: in response to a query instruction input by a user indicating the audio and video synchronization adjustment parameters corresponding to the focus window, control the display to display the audio and video synchronization adjustment status, so that the user can reset the audio and video synchronization adjustment parameters according to the audio and video synchronization adjustment status; the audio and video synchronization adjustment status includes the current audio and video synchronization adjustment parameters of the focus window and the adjustment range of the audio and video synchronization adjustment parameters.
[0015] In a second aspect, the present application further provides a display device, comprising a display, an audio processor, an audio output interface, and a controller. The display is used to display a user interface, wherein the user interface includes multiple windows; the audio processor is used to generate an audio signal; the audio output interface is used to connect multiple types of audio devices; and the controller is configured to:
[0016] In response to a display instruction input by a user indicating to display multiple windows, the display is controlled to display multiple windows; the focus window where the focus controlled by the user is located is detected; in response to an audio and video synchronization query instruction input by the user, the display is controlled to display the audio and video synchronization activation status; so that the user can choose to turn on the audio and video synchronization of the focus window, or turn off the audio and video synchronization of the focus window according to the audio and video synchronization activation status; in response to the audio and video synchronization instruction input by the user, the audio playback parameters corresponding to the audio signal are set, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window.
[0017] In a third aspect, the present application further provides a display device, comprising a display, an audio processor, an audio output interface, and a controller. The display is used to display a user interface, wherein the user interface includes multiple windows; the audio processor is used to generate an audio signal; the audio output interface is used to connect multiple types of audio devices; and the controller is configured to:
[0018] In response to a display instruction input by a user indicating displaying multiple windows, the display is controlled to display multiple windows; in response to an audio-visual synchronization instruction input by a user, the display is controlled to display a window selection interface so that the user can select a target window in the window selection interface, and an audio device corresponding to the target window is detected; when the audio device corresponding to the focus window is a first type of audio device, a first audio-visual synchronization value is obtained; when the audio device corresponding to the focus window is a second type of audio device, a second audio-visual synchronization value is obtained; and audio playback parameters corresponding to the audio signal are set according to the audio-visual synchronization value so that the picture information presented by the target window is synchronized with the audio information played by the audio device corresponding to the target window.
[0019] In a fourth aspect, the present application also provides an audio-visual synchronization method, which is applied to a display device, the method comprising: controlling the display to display multiple windows in response to a display instruction input by a user; detecting a focus window where the focus controlled by the user is located; detecting an audio device corresponding to the focus window in response to an audio-visual synchronization instruction input by the user; when the audio device corresponding to the focus window is a first type of audio device, obtaining a first audio-visual synchronization value; when the audio device corresponding to the focus window is a second type of audio device, obtaining a second audio-visual synchronization value; and setting an audio playback parameter corresponding to the audio signal according to the audio-visual synchronization value to synchronize the picture information presented by the focus window with the audio information played by the audio device corresponding to the focus window.
[0020] It can be seen from the above technical solutions that the present application provides a display device and an audio-visual synchronization method, which can control the display to display multiple windows, and detect the focus window where the focus controlled by the user is located and the audio device corresponding to the focus window. When the audio device corresponding to the focus window is a first-category audio device, a first audio-visual synchronization value is obtained; when the audio device corresponding to the focus window is a second-category audio device, a second audio-visual synchronization value is obtained. Thus, the audio playback parameters corresponding to the audio signal are set according to the audio-visual synchronization value, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window, so that the window selected by the user can be accurately processed for audio-visual synchronization, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0022] Figure 1 shows a usage scenario of a display device according to some embodiments;
[0023] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;
[0024] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;
[0025] Figure 4 shows a software configuration diagram in a display device 200 according to some embodiments;
[0026] Figure 5 A flowchart of the interaction between components of a display device in some embodiments is shown;
[0027] Figure 6 A schematic diagram of a screen in a display in a multi-window mode in a feasible embodiment is shown;
[0028] Figure 7 A schematic diagram showing a multi-window mode in a feasible embodiment is shown;
[0029] Figure 8 A schematic diagram showing an audio output method in a multi-window mode in a feasible embodiment;
[0030] Fig. 9 A schematic diagram of a focus window in a feasible embodiment is shown;
[0031] Fig.10 A flowchart of the interaction between components of a display device in some embodiments is shown;
[0032] Fig.11 A schematic diagram showing a situation where audio and video synchronization is turned on in a focus window in a feasible embodiment;
[0033] Fig.12 A flowchart of the interaction between components of a display device in some embodiments is shown;
[0034] Fig.13 A schematic diagram showing the adjustment of audio and video synchronization in a focus window in a feasible embodiment is shown;
[0035] Fig.14 A schematic diagram of a window selection interface in a feasible embodiment is shown;
[0036] Fig.15 A flow chart of an embodiment of a method for synchronizing audio and video is shown. DETAILED DESCRIPTION
[0037] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.
[0038] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0039] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0040] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0041] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0042] Figure 1 Schematic diagram of a usage scenario of a display device according to an embodiment. Figure 1 As shown, the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .
[0043] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and at least one of other short-range communication methods, to control the display device 200 wirelessly or wired. The user may control the display device 200 by inputting user commands through at least one of buttons on the remote controller, voice input, and control panel input.
[0044] In some embodiments, the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a laptop computer, an AR / VR device, etc.
[0045] In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 may be controlled using an application running on the smart device.
[0046] In some embodiments, the smart device 300 and the display device may also be used to communicate data.
[0047] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.
[0048] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.
[0049] In some embodiments, the software steps executed by a step execution subject can be migrated to another step execution subject in data communication with it as needed for execution. Exemplarily, the software steps executed by a server can be migrated to a display device in data communication with it as needed for execution, and vice versa.
[0050] Figure 2 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200.
[0051] In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
[0052] In some embodiments, the user input / output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button, or alternative modules.
[0053] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.
[0054] In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0055] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.
[0056] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.
[0057] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
[0058] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
[0059] In some embodiments, the communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
[0060] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0061] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.
[0062] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0063] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.
[0064] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink, an icon or other operable controls. Operations related to the selected object include: displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon.
[0065] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.
[0066] CPU processor. Used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video content. CPU processor may include multiple processors. For example, it includes a main processor and one or more sub-processors.
[0067] In some embodiments, the graphics processor is used to generate various graphic objects, such as at least one of icons, operation menus, and user input command display graphics. The graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes; and a renderer, which renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.
[0068] In some embodiments, the video processor is used to receive an external video signal and perform at least one of the following video processing operations, such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis, according to a standard codec protocol of the input signal, to obtain a signal that can be directly displayed or played on the display device 200.
[0069] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, and a display formatting module. The demultiplexing module is used to demultiplex the input audio and video data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to receive the video output signal after frame rate conversion and change the signal to conform to the display format signal, such as outputting an RGB data signal.
[0070] In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
[0071] In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
[0072] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on a display screen of an electronic device, wherein a control may include at least one of icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.
[0073] In some embodiments, the user interface 280 is an interface that can be used to receive control input (such as a physical button on the display device body, or other interfaces).
[0074] In some embodiments, the system of the display device may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together constitute the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.
[0075] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0076] In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.
[0077] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.
[0078] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.
[0079] In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).
[0080] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0081] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0082] Since the display device takes different time to process the image part and the audio part, the display device usually synchronizes the audio and video of the program being played. When existing display devices use multiple windows to display images, if audio and video synchronization is required, audio and video synchronization is usually performed on multiple windows together, and the adjustment amount of audio and video synchronization is the same. Multiple windows are usually in independent playback processes. If audio and video synchronization is performed on all windows at the same time, it is easy to cause inaccurate audio and video synchronization in some windows, resulting in a poor user experience.
[0083] In order to solve the above technical problems, the present application provides a display device, including a display, an audio processor, an audio output interface and a controller. The display is used to display a user interface; the audio processor is used to generate an audio signal; and the audio output interface includes multiple types of audio interfaces, which are respectively used to connect multiple types of audio devices.
[0084] In an embodiment of the present application, the audio output interface in the display device may include a first-class audio interface and a second-class audio interface, wherein the first-class audio interface is used to connect to a first-class audio device, and the second-class audio interface is used to connect to a second-class audio device. The first-class audio device may be an audio device such as a speaker or a sound box built into the display device. The second-class audio device may be a Bluetooth speaker, a USB speaker, or a soundbar speaker connected to the display device.
[0085] In some embodiments, the display device may be provided with a first-class audio interface and multiple second-class audio interfaces. That is, the display device may be connected to a first-class audio device and multiple second-class audio devices, and play audio content. For example, the display device may have a built-in speaker and two external Bluetooth speakers.
[0086] In some embodiments, the display device has a split screen function, which can divide the user interface displayed in the display into multiple windows, and each window can display different screen contents, that is, the display device has a multi-window mode. In the multi-window mode, the display device can display multiple windows at the same time, so that the user can view different screen contents in one display device.
[0087] Figure 5 The following is a flowchart of the interaction between the components of the display device in some embodiments. When the display device displays a user screen and there is only one window in the user screen, the user can input a display instruction to display multiple windows, i.e., a multi-window mode instruction, to the display device. When the controller receives the multi-window mode instruction, it can control the display to change from displaying one window to displaying multiple windows.
[0088] In some embodiments, the user can send a multi-window mode instruction to the display device by operating a designated button of the remote control. In the actual application process, the correspondence between the multi-window mode instruction and the remote control button is pre-bound. For example, a multi-window mode button is set on the remote control. When the user touches the button, the remote control sends a multi-window mode instruction to the controller. At this time, the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows. When the user touches the button again, the controller can control the display device to exit the multi-window mode.
[0089] In some embodiments, the correspondence between the multi-window mode command and multiple remote control buttons can also be pre-bound. When the user touches multiple buttons bound to the multi-window mode command, the remote control issues the multi-window mode command. In a feasible embodiment, the buttons bound to the multi-window mode command are the direction keys (left, down, left, down) in sequence, that is, when the user touches the buttons (left, down, left, down) continuously within a preset time, the remote control sends the multi-window mode command to the controller. The above binding method can be used to avoid the multi-window mode command being issued due to user misoperation. The embodiments of the present application only provide several exemplary binding relationships between multi-window mode commands and buttons. In actual application, the binding relationship between the multi-window mode command and the button can be set according to the user's habits, and no excessive restrictions are made here.
[0090] In some embodiments, when a user uses a smart device to control a display device, such as a mobile phone, a multi-window mode instruction can also be sent to the display device. In actual application, a split-screen control can be set in the mobile phone, and the split-screen control can be used to select whether to enter the multi-window mode and set the number of windows, thereby sending a multi-window mode instruction to the controller, and the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows.
[0091] In some embodiments, when a user uses a mobile phone to control a display device, a continuous click instruction can be issued to the mobile phone. A continuous click instruction means that within a preset period, the number of times the user clicks on the same area of the mobile phone touch screen exceeds a preset threshold. For example, when a user clicks on a certain area of the mobile phone touch screen three times in a row within 1 second, it is regarded as a continuous click instruction. After receiving the continuous click instruction, the mobile phone can send a multi-window mode instruction to the display device so that the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows.
[0092] In some embodiments, when a user uses a mobile phone to control a display device, it can also be set as follows: when it is detected that the touch pressure value of a certain area of the mobile phone touch screen by the user exceeds a preset pressure threshold, the mobile phone can send a multi-window mode instruction to the display device.
[0093] A multi-window mode switching option may also be set in the UI interface of the display device. When the user clicks the switching option, the display device may be controlled to enter or exit the multi-window mode.
[0094] In some embodiments, two windows may be displayed in the multi-window mode, or more than two windows may be displayed. Figure 6 A schematic diagram of a screen in a display in a multi-window mode in a feasible embodiment is shown. After the display device enters the multi-window mode, a first window and a second window are simultaneously displayed in the display, wherein the first window and the second window can respectively display different screen contents, the first window displays the screen content of the first media resource, and the second window displays the screen content of the second media resource.
[0095] In some embodiments, when the screen contents displayed in multiple windows are different, the screen types displayed in the multiple windows can be the same. For example, when the screen contents of the first media resource are displayed in the first window, the screen contents of the second media resource can be displayed in the second window. At this time, the screen types displayed in the two windows are the same, both of which are media resources. It can also be set that the screen types displayed in multiple windows are different in different usage scenarios. For example, when the screen contents of the media resource are displayed in the first window, the UI interface or the game interface is displayed in the second window. At this time, the screen types displayed in the two windows are different. Thereby, different needs of users can be met and the user experience is enhanced.
[0096] In some embodiments, the multi-window mode can be set according to the user's usage status. When it is detected that the user turns on the display device, the display device defaults to single-window mode, that is, only the first window is displayed in the display, and the first window can be displayed in full screen or in windowed mode. The display device can play the first media resource in the first window.
[0097] When the first media resource is played in the first window, if the user sends a multi-window mode instruction to the display device, the program recommendation interface can be entered first. Figure 7 A schematic diagram of a multi-window mode in a feasible embodiment is shown, in which a media resource recommendation list is displayed on the right side of the first window, including multiple recommended program options. If the user selects the recommended program 2 option and confirms it, the display device can be controlled to enter the multi-window mode. At this time, the first media resource is still displayed through the first window, while the second window displays the recommended program 2 selected by the user.
[0098] In some embodiments, when the display device is in multi-window mode, while multiple windows simultaneously display different screen contents, the audio content corresponding to each screen can also be output separately. The display device can use a first-class audio device and multiple second-class audio devices to play audio at the same time. For example, the display device is connected to a built-in speaker and two external Bluetooth speakers at the same time. At this time, the display device can use these three audio devices to output the audio content of the three windows respectively. At the same time, each window can output audio to the audio device corresponding to each window through its own audio channel, and play the audio content through the audio device.
[0099] In some embodiments, the display device can be set to two audio device modes. One is that the display device uses the first type of audio device to play audio content, which can be named as a built-in playback mode. The other is that the display device uses the second type of audio device to play audio content, such as a Bluetooth speaker, etc., which can be named as an external playback mode.
[0100] Figure 8 A schematic diagram of an audio output method in a multi-window mode in a feasible embodiment is shown. In which, the display device is in a multi-window mode, in which a first media resource is played in a first window, and a first type of audio device is used to output audio; a second media resource is played in a second window, and a second type of audio device is used to output audio.
[0101] Alternatively, both the first window and the second window may use the second type of audio device to output audio, that is, the first window uses the first second type of audio device to output audio, and the second window uses the second second type of audio device to output audio. It should be noted that since each window plays audio through a different audio device, the audio of each screen in the multi-window mode can be played independently to achieve the purpose of non-interference.
[0102] Therefore, to ensure that the audio of all windows in multi-window mode can be played normally, it can be set as follows: when the audio device corresponding to the first window is a first-class audio device, the audio device corresponding to the second window is a second-class audio device. When the audio device corresponding to the first window is a second-class audio device, the audio device corresponding to the second window is a first-class audio device or the remaining second-class audio device. This ensures that the audio devices used by each window are different.
[0103] The display device can respond to various user operations in a timely manner by detecting the focus window in real time. The controller can receive various control instructions input by the user during the user's use, and perform corresponding interactive actions according to these control instructions, thereby controlling each window, such as image quality control and sound control.
[0104] In some embodiments, the display device can detect the focus window in real time. The focus window refers to the window where the focus controlled by the user is located. Focus refers to a sign used by the display device to assist users in human-computer interaction, which can highlight the user's current selection. For example, the focus can be a selection box, which displays the content selected by the user through methods such as "deepening display" and "highlighting display". The user can control the selection box through the "up, down, left, right" direction keys on the remote control to select different options. The focus can be on a certain option in the window, or on the entire window. As long as the focus is within the overall range of a window, the window is the focus window. Fig. 9 A schematic diagram of a focus window in a feasible embodiment is shown, wherein the user interface includes a first window and a second window, wherein the focus is in the form of a selection box. At this time, the selection box selects an option in the first window, so the first window is the focus window, and the user can also select other options in the first window to adjust the first window.
[0105] The display device can respond to various user operations in a timely manner by detecting the focus window in real time. Fig.10 The present invention is a flowchart showing the interaction between the components of the display device in some embodiments.
[0106] In some embodiments, the display device has an audio and video synchronization function. While the display device detects the focus window in real time, it can display the current audio and video synchronization status of the focus window to the user, so that the user can control whether to turn on audio and video synchronization for the focus window. The user can send an audio and video synchronization query instruction to the display device by operating the designated button of the remote control. In the actual application process, the correspondence between the audio and video synchronization query instruction and the remote control button is pre-bound. For example, an audio and video synchronization query button is set on the remote control. When the user touches the button, the remote control sends an audio and video synchronization query instruction to the controller. At this time, the controller controls the display to display the audio and video synchronization status of the focus window, so that the user can control the focus window to turn on or off audio and video synchronization. Fig.11 A schematic diagram showing the opening of audio and video synchronization in the focus window in a feasible embodiment is shown, wherein the user interface includes a first window and a second window, wherein the first window is the focus window, and the first window is in the audio and video synchronization opening state. The user can choose to close the audio and video synchronization of the first window, or do nothing.
[0107] Alternatively, the user may call up a setting key UI menu, and the controller may control the OSD layer menu to display the audio and video synchronization activation status corresponding to the current window.
[0108] In some embodiments, the user may send an audio-visual synchronization instruction to the display device. In the embodiment of the present application, the audio-visual synchronization instruction refers to a control instruction for turning on audio-visual synchronization. When the audio-visual synchronization instruction input by the user is detected, the display device may respond to the instruction and detect the audio device currently corresponding to the focus window. The focus window may use the first type of audio device or the second type of audio device.
[0109] When the focus window uses different types of audio devices, that is, the display device is in different audio device modes, the controller can set different audio-visual synchronization values. When the audio device corresponding to the focus window is a first type of audio device, the controller can obtain a first audio-visual synchronization value; when the audio device corresponding to the focus window is a second type of audio device, the controller can obtain a second audio-visual synchronization value.
[0110] Then, the audio playback parameters corresponding to the audio signal are set according to the current audio-visual synchronization value of the focus window, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window. Considering that the sound effect processing flow of the display device for the first type of audio device and the second type of audio device may be different, resulting in different sound effect processing delay parameters in the two audio device modes, different audio-visual synchronization values can be set for the two audio device modes in the embodiment of the present application, so as to achieve better audio-visual synchronization effect of the display device and enhance the user experience.
[0111] In some embodiments, when it is detected that the audio device corresponding to the focus window is a first type of audio device, the controller can obtain a first audio-visual synchronization value. At this time, the controller first obtains the image quality processing delay parameter and the sound effect processing delay parameter of the focus window. Among them, the image quality processing delay parameter refers to the time consumed by the display device to perform image quality processing (pq) on the picture content to be displayed in the window, and the sound effect processing delay parameter refers to the time consumed by the display device to perform sound effect processing (aq) in the process of transmitting the audio content to be played in the window to the first type of audio device. It should be noted that when the display device uses the first type of audio device to play audio, the display device is required to perform sound effect processing on the audio signal and send it to the first type of audio device. Generally speaking, the process of image quality processing by the display device is more complicated than the process of sound effect processing, so the image quality processing delay parameter will be greater than the sound effect processing delay parameter.
[0112] When the controller obtains the image quality processing delay parameter of the focus window, the resolution information and frame rate information corresponding to the focus window can be queried in the database. The database may record the current setting parameters of the display device, including the playback volume, playback brightness, contrast, color mode, image quality processing parameters, resolution and frame rate. For example, the resolution of the picture played in the focus window is 1080i and the frame rate is 60HZ.
[0113] The controller can query the database for all the processes of image quality processing at the file resolution according to the resolution information, as well as the number of frames that need to be processed in each process. For example, when the resolution is 1080i, the image quality processing processes are: IP SCALER (scaling), TNR (dynamic image noise reduction), DEI (deinterlacing), AR (still image noise reduction) and Scaler (image amplification), and the number of frames that need to be processed in each processing process is obtained.
[0114] The controller can calculate the time T required to process one frame of data based on the frame rate information. For example, when the frame rate is 60HZ, the time to process one frame of data is 1 / 60s. The processing time of each processing flow can be calculated based on the time T required to process one frame of data and the number of frames that each processing flow needs to process, thereby obtaining the total image quality processing delay time of all flows, that is, the image quality processing delay parameter. Generally speaking, the image quality processing delay parameter is 200 to 500ms.
[0115] When the controller obtains the audio processing delay parameter of the focus window, the audio processing type corresponding to the focus window can be queried in the database, such as Dolby audio or DTS audio. It should be noted that the audio processing delay parameter corresponding to each audio processing type is fixed. Therefore, the audio processing delay parameter of the focus window can be directly obtained according to the current audio processing type. Generally speaking, the audio processing delay parameter is 50 to 100 ms.
[0116] The image quality processing delay parameter will be greater than the sound effect processing delay parameter. When calculating the audio-video synchronization value, the audio-video synchronization value can be obtained by subtracting the audio effect processing delay parameter from the image quality processing delay parameter. For example, in some embodiments, the image quality processing delay parameter is 300ms and the sound effect processing delay parameter is 70ms. Then the audio-video synchronization value is 230ms.
[0117] In some embodiments, when it is detected that the audio device corresponding to the focus window is a second-class audio device, the controller can obtain a second audio-visual synchronization value. At this time, the controller can set the audio-visual synchronization value to a preset value. It should be noted that when the display device uses a second-class audio device, such as a Bluetooth speaker, the second-class audio device can be selected to perform sound effect processing by itself. The display device needs to send the audio signal to the second-class audio device, and then the second-class audio device plays the audio. Compared to using the first-class audio device, the sound delay of these second-class audio devices will be much greater than the image quality processing delay parameter, so it is necessary to advance the audio playback time as much as possible and set the audio-visual synchronization value to a smaller value.
[0118] In some embodiments, when it is detected that the audio device corresponding to the focus window is a second-category audio device, such as a Bluetooth speaker, the controller may close the sound effect processing flow corresponding to the focus window and set the audio-visual synchronization value to 0.
[0119] In some embodiments, the controller can directly set the audio playback parameters corresponding to the audio signal according to the audio-visual synchronization value. For example, if the audio-visual synchronization value is Nms, it means that the display device plays the audio Nms earlier than the display screen. At this time, an audio playback parameter can be set so that the audio signal can be played after a delay of Nms.
[0120] In some embodiments, considering the different perception sensitivities of users to audio and picture, the degree of synchronization between audio and picture can be adjusted by the user, that is, the user can set the audio and picture synchronization adjustment parameters by himself.
[0121] Fig.12 The interactive flow chart of the components of the display device in some embodiments. The display device can display the current audio and video synchronization adjustment status of the focus window to the user, wherein the audio and video synchronization adjustment status includes the current audio and video synchronization adjustment parameters of the focus window and the adjustment range of the audio and video synchronization adjustment parameters. For example, the adjustment range can be -10 to 10, and the default audio and video synchronization adjustment parameter of the display device is 0. Fig.13 A schematic diagram showing the audio and video synchronization adjustment status in the focus window in a feasible embodiment is shown.
[0122] The user can send a query command to the display device by operating the designated button of the remote control. In the actual application process, the correspondence between the query command and the remote control button is pre-bound. For example, a query button is set on the remote control. When the user touches the button, the remote control sends a query command to the controller. At this time, the controller controls the display to display the audio and video synchronization adjustment status corresponding to the current focus window, so that the user can set the audio and video synchronization adjustment parameters according to the audio and video synchronization adjustment status. The user can also call up the setting key UI menu, and the controller controls the OSD layer menu to display the audio and video synchronization adjustment status corresponding to the current window. The user can set the audio and video synchronization adjustment parameters according to the audio and video synchronization adjustment status.
[0123] After obtaining the audio-visual synchronization adjustment parameter, the controller can further calculate the audio-visual synchronization adjustment time. A step value can be pre-set, and the step value represents: the audio-visual synchronization adjustment time when the audio-visual synchronization adjustment parameter is 1. The audio-visual synchronization adjustment time can be obtained by multiplying the currently set audio-visual synchronization adjustment parameter and the step value.
[0124] In some embodiments, after obtaining the audio-visual synchronization value of the focus window and the current audio-visual synchronization adjustment time, the controller can further set the audio playback parameters corresponding to the audio signal. For example, the audio-visual synchronization value is Nms, and the audio-visual synchronization adjustment time is Mms. This indicates that the display device plays audio Nms earlier than the display screen, and the user expects the audio to be Mms earlier than the display screen. At this time, an audio playback parameter can be set so that the audio signal can be played after a delay of (N+M)ms.
[0125] In some embodiments, the display device can display the audio device currently corresponding to the focus window and the switchable audio device modes to the user, so that the user can switch the audio device mode of the focus window. The user can send a display instruction to the display device by operating a designated button of the remote control. In the actual application process, the correspondence between the display instruction and the remote control button is pre-bound. For example, a display button is set on the remote control. When the user touches the button, the remote control sends a display instruction to the controller. At this time, the controller controls the display to display the audio device currently corresponding to the focus window, as well as the switchable audio device mode.
[0126] When a switching instruction indicating switching the audio device corresponding to the focus window is detected, the controller switches the audio device corresponding to the focus window in response to the switching instruction input by the user. At the same time, the controller can adjust the audio-visual synchronization value and reset the audio playback parameters according to the adjusted audio-visual synchronization value.
[0127] In some embodiments, when the audio device corresponding to the focus window switches from the first type of audio device to the second type of audio device, the controller can close the sound effect processing flow corresponding to the focus window and set the audio-visual synchronization value to 0. Since the sound delay will be large when the focus window uses the second type of audio device, the audio-visual synchronization value needs to be set to 0 to ensure audio-visual synchronization.
[0128] In some embodiments, when the audio device corresponding to the focus window is switched from the second type of audio device to the first type of audio device, the controller may first determine the usage status of the first type of audio device.
[0129] When the first type of audio device is not in use, the controller switches the audio device corresponding to the focus window to the first type of audio device, and can reset the audio and video synchronization value. The controller first obtains the resolution information and frame rate information and the sound effect processing type corresponding to the focus window. Then, the image quality processing delay parameter is obtained according to the resolution information and frame rate information, and the sound effect processing delay parameter is obtained according to the sound effect processing type. By subtracting the sound effect processing delay parameter from the image quality processing delay parameter, the current audio and video synchronization value of the focus window can be obtained.
[0130] When the first type of audio device is in use, the controller can first determine the switching window currently corresponding to the first type of audio device. At this time, the audio devices of the switching window and the focus window need to be exchanged. For the switching window, since the audio device after the switching window is switched is switched to the second type of audio device, it is necessary to close the sound effect processing flow corresponding to the switching window, and set the audio and video synchronization value of the switching window to 0. For the focus window, the audio device of the focus window is the first type of audio device at this time, so the audio and video synchronization value of the focus window needs to be recalculated. The specific calculation method can refer to the above embodiment, which will not be repeated here.
[0131] After the user inputs the audio and video synchronization instruction, the display device can also allow the user to select which window to perform audio and video synchronization through the window, and perform audio and video synchronization processing on the target window selected by the user. Fig.14 A schematic diagram of a window selection interface in a feasible embodiment is shown, the display device is in multi-window mode, and can display a first window and a second window. When the user inputs an audio and video synchronization instruction, the display displays a window selection interface for the user to select a target window.
[0132] In some embodiments, the controller controls the display to display a window selection interface in response to the audio-visual synchronization instruction. After the user selects a window in the window selection interface, the controller detects the audio device corresponding to the target window selected by the user and sets the audio-visual synchronization value. The audio playback parameters corresponding to the audio signal are set according to the audio-visual synchronization value so that the picture information presented by the target window is synchronized with the audio information played by the audio device corresponding to the target window.
[0133] It should be noted that the multiple windows in the multi-window mode described in the embodiment of the present application can be displayed on the same display of the display device, or on different multiple displays. For example, the display device can be a dual-screen smart point TV, that is, it can include a first display and a second display. Among them, the first display is the main screen that can display a specific user interface, and the second display is the sub-screen that can display a specific interface. After entering the multi-window mode, the display device can control the display of different windows in the first display and the second display, respectively, so as to output specific display screen content at the same time. For the case where multiple windows are displayed on different displays, the display device can also complete the audio and video synchronization of the display device by running the above-mentioned multi-window audio and video synchronization method, thereby improving the user experience.
[0134] The present application also provides an audio output method, which is applied to a display device, such as Fig.15 As shown, the method includes:
[0135] S1501, in response to a display instruction input by a user to display multiple windows, controlling a display to display multiple windows;
[0136] S1502, detecting a focus window where the focus controlled by the user is located;
[0137] S1503, in response to an audio and video synchronization instruction input by a user, detecting an audio device corresponding to the focus window;
[0138] S1504: when the audio device corresponding to the focus window is a first type of audio device, obtain a first audio-visual synchronization value; when the audio device corresponding to the focus window is a second type of audio device, obtain a second audio-visual synchronization value;
[0139] S1505: Setting an audio playback parameter corresponding to the audio signal according to the audio-visual synchronization value, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window.
[0140] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.
[0141] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.
[0142] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0143] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A display device, characterized in that: include: A display, used to display a user interface, wherein the user interface includes a plurality of windows; An audio processor for generating an audio signal; An audio output interface, wherein the audio output interface is multiple and is used to connect multiple types of audio devices; the audio devices include a first type of audio device and a second type of audio device; the first type of audio device is an audio device built into the display device, and the second type of audio device is an audio device externally connected to the display device through the audio output interface; The controller is configured as: In response to a display instruction input by a user indicating to display a plurality of windows, controlling the display to display the plurality of windows; Detect the focused window where the user control has focus; In response to an audio-visual synchronization instruction input by a user, detecting an audio device corresponding to the focus window; When the audio device corresponding to the focus window is a first type of audio device, a first audio-visual synchronization value is obtained; when the audio device corresponding to the focus window is a second type of audio device, a second audio-visual synchronization value is obtained; Setting the audio playback parameter corresponding to the audio signal according to the audio-visual synchronization value, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window; In response to a switching instruction input by a user indicating switching of the audio device corresponding to the focus window, the audio device corresponding to the focus window is switched, and the audio-visual synchronization value is adjusted to reset the audio playback parameters according to the adjusted audio-visual synchronization value.
2. The display device according to claim 1, characterized in that In executing the step of acquiring the first audio-visual synchronization value, the controller is further configured to: Acquire a picture quality processing delay parameter and a sound effect processing delay parameter of the focus window, and calculate a first audio-visual synchronization value according to the picture quality processing delay parameter and the sound effect processing delay parameter; In executing the step of acquiring the second audio-visual synchronization value, the controller is further configured to: The second audio-video synchronization value is set to a preset value.
3. The display device according to claim 1, characterized in that In executing the step of setting the audio playback parameter corresponding to the audio signal according to the audio-visual synchronization value, the controller is further configured to: Get the audio and video synchronization adjustment parameters set by the user; The audio-video synchronization adjustment time is calculated according to the audio-video synchronization adjustment parameter, so as to calculate the audio playback parameter corresponding to the audio signal according to the audio-video synchronization adjustment time and the audio-video synchronization value.
4. The display device according to claim 1, characterized in that When it is detected that the audio device corresponding to the focus window is switched from the first type of audio device to the second type of audio device, in the step of adjusting the audio and video synchronization value, the controller is further configured to: Close the sound effect processing flow corresponding to the focus window and set the audio and video synchronization value to 0; When it is detected that the audio device corresponding to the focus window is switched from the second type of audio device to the first type of audio device, in the step of adjusting the audio and video synchronization value, the controller is further configured to: Obtaining resolution information, frame rate information, and sound effect processing type corresponding to the focus window; Acquire a picture quality processing delay parameter according to the resolution information and the frame rate information; acquire a sound effect processing delay parameter according to the sound effect processing type; The audio and video synchronization value of the focus window is obtained by subtracting the audio and video processing delay parameter from the image quality processing delay parameter.
5. The display device according to claim 1, characterized in that The controller is also configured to: When it is detected that the switching instruction indicates that the audio device corresponding to the focus window is switched from the second type of audio device to the first type of audio device, determining the usage status of the first type of audio device; When the first-category audio device is not in use, switching the audio device corresponding to the focus window to the first-category audio device; When the first-category audio device is in use, determining a switching window currently corresponding to the first-category audio device; The audio device corresponding to the switching window is switched to a second type of audio device, the sound effect processing flow corresponding to the switching window is closed, and the audio and video synchronization value of the switching window is set to 0.
6. The display device according to claim 3, characterized in that The controller is also configured to: In response to a query instruction input by the user to query the audio and video synchronization adjustment parameters corresponding to the focus window, the display is controlled to display the audio and video synchronization adjustment status, so that the user can reset the audio and video synchronization adjustment parameters according to the audio and video synchronization adjustment status; the audio and video synchronization adjustment status includes the current audio and video synchronization adjustment parameters of the focus window and the adjustment range of the audio and video synchronization adjustment parameters.
7. A display device, characterized in that: include: A display, used to display a user interface, wherein the user interface includes a plurality of windows; An audio processor for generating an audio signal; An audio output interface, the audio output interface is used to connect multiple types of audio devices; the audio devices include a first type of audio device and a second type of audio device; the first type of audio device is an audio device built into the display device, and the second type of audio device is an audio device externally connected to the display device through the audio output interface; The controller is configured as: In response to a display instruction input by a user indicating to display a plurality of windows, controlling the display to display the plurality of windows; Detect the focused window where the user control has focus; In response to the audio-visual synchronization query instruction input by the user, the display is controlled to display the audio-visual synchronization activation status; so that the user can choose to enable the audio-visual synchronization of the focus window or disable the audio-visual synchronization of the focus window according to the audio-visual synchronization activation status; In response to an audio-visual synchronization instruction input by a user, an audio playback parameter corresponding to the audio signal is set so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window; In response to a switching instruction input by a user indicating switching of the audio device corresponding to the focus window, the audio device corresponding to the focus window is switched, and the audio-visual synchronization value is adjusted to reset the audio playback parameters according to the adjusted audio-visual synchronization value.
8. A display device, characterized in that: include: A display, used to display a user interface, wherein the user interface includes a plurality of windows; An audio processor for generating an audio signal; An audio output interface, the audio output interface is used to connect multiple types of audio devices; the audio devices include a first type of audio device and a second type of audio device; the first type of audio device is an audio device built into the display device, and the second type of audio device is an audio device externally connected to the display device through the audio output interface; The controller is configured as: In response to a display instruction input by a user indicating to display a plurality of windows, controlling the display to display the plurality of windows; In response to an audio-visual synchronization instruction input by a user, controlling the display to display a window selection interface so that the user can select a target window in the window selection interface, and detecting an audio device corresponding to the target window; When the audio device corresponding to the target window is a first type of audio device, a first audio-visual synchronization value is obtained; when the audio device corresponding to the target window is a second type of audio device, a second audio-visual synchronization value is obtained; Setting the audio playback parameter corresponding to the audio signal according to the audio-visual synchronization value, so that the picture information presented by the target window is synchronized with the audio information played by the audio device corresponding to the target window; In response to a switching instruction input by a user indicating switching of the audio device corresponding to the target window, the audio device corresponding to the target window is switched, and the audio-visual synchronization value is adjusted to reset the audio playback parameters according to the adjusted audio-visual synchronization value.
9. A method for synchronizing audio and video, applied to a display device, characterized in that: The method comprises: In response to a display instruction input by a user indicating to display a plurality of windows, controlling the display to display the plurality of windows; Detect the focused window where the user control has focus; In response to an audio-visual synchronization instruction input by a user, an audio device corresponding to the focus window is detected; the audio device includes a first type of audio device and a second type of audio device; the first type of audio device is an audio device built into the display device, and the second type of audio device is an audio device externally connected to the display device through the audio output interface; When the audio device corresponding to the focus window is a first type of audio device, a first audio-visual synchronization value is obtained; when the audio device corresponding to the focus window is a second type of audio device, a second audio-visual synchronization value is obtained; Setting an audio playback parameter corresponding to the audio signal according to the audio-visual synchronization value, so that the picture information presented by the focus window is synchronized with the audio information played by the audio device corresponding to the focus window; In response to a switching instruction input by a user indicating switching of the audio device corresponding to the focus window, the audio device corresponding to the focus window is switched, and the audio-visual synchronization value is adjusted to reset the audio playback parameters according to the adjusted audio-visual synchronization value.
