Display device and graphical interactive menu control method

Abstract

The application provides a display device and a graphical interactive menu control method. After a user inputs a control instruction for displaying an interactive menu, the method detects a current output parameter of an external device and sets display content of a graphical menu item in the interactive menu according to the current output parameter, so as to display the interactive menu with the graphical menu item in the display for the user to perform an interactive action for setting the output parameter of the external device. The method can display a graphical interactive menu of the external device through the display device, so that the display process of the interactive menu is more accurate and intuitive. The graphical interactive menu displayed through the display device can break through the hardware display of the external device and provide more graphical menu items for the user to adjust, so as to meet the more personalized adjustment requirements of the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a graphical interactive menu control method. BACKGROUND

[0002] A display device refers to a terminal device capable of outputting a specific display picture, such as a smart television, a mobile terminal, a smart advertising screen, a projector, etc. The display device can be provided with an external device interface, and the smart television and other display devices can connect an external device capable of outputting audio or video through the external device interface, so as to output the sound or picture played by the display device through the external device. For example, in order to improve the output sound quality of the smart television, a sound equipment can be connected to the smart television. When the smart television plays audio data or video data with sound, the smart television can send the parsed sound signal to the sound equipment, so as to output the specific sound through the sound equipment.

[0003] During the output of the sound, the external device can also change the output effect by adjusting the output parameter. For example, the external sound equipment can adjust the intensity of each part of the audio signal by adjusting the audio output gain, so as to realize sound quality adjustment. Generally, the adjustment of the output parameter of the external device is mainly completed through the adjustment component such as a button on the external device or a remote controller matched with the external device. Due to the limitation of the functions of the adjustment component and the remote controller, the output parameter adjustment mode of the external device is single, and part of the output parameters cannot be adjusted. SUMMARY

[0004] The present application provides a display device and a graphical interactive menu control method to solve the problem of single output parameter adjustment mode of the conventional external device.

[0005] In one aspect, the present application provides a display device, comprising a display, an external device interface and a controller, wherein the display is configured to display a user interface, the external device interface is configured to connect an external device, and the controller is configured to execute the following program steps:

[0006] obtaining a control instruction input by a user for displaying an interactive menu, wherein the interactive menu comprises at least one graphical menu item for setting an output parameter of the external device;

[0007] detecting a current output parameter of the external device in response to the control instruction, wherein the current output parameter comprises an output parameter corresponding to the graphical menu item;

[0008] setting display content of the graphical menu item according to the current output parameter, and controlling the display to display the interactive menu.

[0009] In another aspect, the application also provides a graphical interactive menu control method, which can be applied to the display device provided in the first aspect, and comprises the following steps:

[0010] obtaining a control instruction input by a user for displaying an interactive menu, wherein the interactive menu comprises at least one graphical menu item for setting an output parameter of an external device;

[0011] detecting a current output parameter of the external device in response to the control instruction, wherein the current output parameter comprises an output parameter corresponding to the graphical menu item;

[0012] setting display content of the graphical menu item according to the current output parameter, and controlling the display to display the interactive menu.

[0013] According to the above technical solution, the display device and the graphical interactive menu control method provided by the application can detect the current output parameter of the external device after the user inputs the control instruction for displaying the interactive menu, set the display content of the graphical menu item in the interactive menu according to the current output parameter, and display the interactive menu with the graphical menu item in the display to enable the user to perform an interactive action for setting the output parameter of the external device. The method can display the graphical interactive menu of the external device through the display device, make the display process of the interactive menu more precise and intuitive, and provide more abundant graphical menu items for the user to adjust through the graphical interactive menu displayed by the display device, thereby meeting the more personalized adjustment requirements of the user. BRIEF DESCRIPTION OF DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the application, the drawings required in the embodiments will be briefly introduced as follows. Obviously, other drawings can also be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0015] Figure 1 The use scenario of the display device in the embodiments of the application;

[0016] Figure 2 The hardware configuration block diagram of the control device in the embodiments of the application;

[0017] Figure 3 The hardware configuration diagram of the display device in the embodiments of the application;

[0018] Figure 4 The software configuration diagram of the display device in the embodiments of the application;

[0019] Figure 5 The connection schematic diagram of the external device in the embodiments of the application;

[0020] Figure 6 Fig. 2 is a schematic diagram of a GEQ menu on an external device in an embodiment of the present application;

[0021] Figure 7 Fig. 3 is a schematic diagram of a GEQ menu displayed by a display device in an embodiment of the present application;

[0022] Figure 8 Fig. 4 is a flowchart of a method of controlling a graphical interactive menu in an embodiment of the present application;

[0023] Figure 9 Fig. 5 is a schematic diagram of a channel mode menu in an embodiment of the present application;

[0024] Figure 10 Fig. 6 is a schematic diagram of a music style mode menu in an embodiment of the present application;

[0025] Figure 11 Fig. 7 is a schematic diagram of a custom mode menu in an embodiment of the present application;

[0026] Figure 12 Fig. 8 is a schematic diagram of a mode selection interface in an embodiment of the present application;

[0027] Figure 13 Fig. 9 is a flowchart of a method of triggering a graphical menu to be displayed by a display device in an embodiment of the present application;

[0028] Figure 14 Fig. 10 is a signaling relationship diagram of a graphical interactive menu control in an embodiment of the present application;

[0029] Figure 15 Fig. 11 is a flowchart of a method of determining whether a setting instruction can be completed by an external device alone in an embodiment of the present application;

[0030] Figure 16 Fig. 12 is a flowchart of a method of updating an interactive menu in an embodiment of the present application;

[0031] Figure 17 Fig. 13 is a flowchart of a method of backing up output parameters in an embodiment of the present application. DETAILED DESCRIPTION

[0032] The embodiments will be described in detail with reference to the drawings, wherein like reference numerals refer to like elements throughout. The following detailed description is not intended to represent all embodiments in accordance with the present application. Rather, the following description is intended only to describe some embodiments in accordance with the present application as detailed in the claims.

[0033] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described next, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0034] The terms "first", "second", "third" and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0035] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not have to be limited to all components listed clearly, but can include other components not listed clearly or inherent to these products or devices.

[0036] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or / and software code capable of performing functions associated with the element.

[0037] Figure 1 The figure shows the use scenario of the display device in the embodiments. As shown in the figure, the display device 200 also communicates data with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100. Figure 1

[0038] In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, to control the display device 200 by wireless or wired means. The user can input user instructions through at least one of the keys on the remote controller, voice input, control panel input, etc. to control the display device 200.

[0039] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 400 can provide various content and interaction to the display device 200. The server 400 can be a cluster or multiple clusters, and can include one or more types of servers.

[0040] In some embodiments, a software step performed by one step execution subject can be migrated to another step execution subject in data communication therewith for execution as needed. For example, a software step performed by the server can be migrated to the display device in data communication therewith for execution as needed, and vice versa.​

[0041] Figure 2 An exemplary configuration block diagram of the control device 100 according to an exemplary embodiment is shown. As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, a power supply. The control device 100 can receive a user's input operation command, and convert the operation command into a command that the display device 200 can recognize and respond to, playing a mediating role in the interaction between the user and the display device 200. Figure 2

[0042] Figure 3 An exemplary hardware configuration block diagram of the display device 200 according to an exemplary embodiment is shown.

[0043] In some embodiments, the display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

[0044] In some embodiments, the communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example, the communicator can include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0045] In some embodiments, the external device interface 240 can include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by a plurality of the above interfaces.

[0046] In some embodiments, the controller 250 and the tuner and demodulator 210 can be located in different split devices, i.e., the tuner and demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0047] In some embodiments, the controller 250 controls the operation of the display device and responds to the user's operation by storing various software control programs on the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command. ​

[0048] In some embodiments, the user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0049] In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the conversion between the internal form of information and the form that the user can accept. The commonly used form of a user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an icon, a window, a control, etc. displayed on the display screen of an electronic device, wherein the control can include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, etc.

[0050] Referring to Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, an applications layer (referred to as "application layer"), an application framework layer (referred to as "framework layer"), an Android runtime and system library layer (referred to as "system runtime library layer"), and a kernel layer.

[0051] In some embodiments, at least one application program is running in the application layer, which can be a window (Window) program, a system setting program or a clock program provided by the operating system, or an application program developed by a third-party developer. In specific implementation, the application program package in the application layer is not limited to the above examples.

[0052] The framework layer provides an application programming interface (API) and a programming framework for the application programs in the application layer. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center that decides the actions of the application programs in the application layer. The application programs can access the resources in the system and obtain the services of the system through the API interface in execution.

[0053] As Figure 4As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0054] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0055] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0056] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0057] The external device interface 240 of the display device 200 can connect to various external devices 500, including audio output devices, video output devices, and input devices. For example, the external device 500 can be an external speaker device with audio output functionality. Figure 5As shown, the external device 500 can access the external device interface 240 through a specific interface specification, such as HDMI, USB, etc. For example, when the external sound equipment has an HDMI ARC interface, the display device 200 and the external sound equipment can interact through the CEC protocol. That is, the display device 200 communicates with the external sound equipment through the Vendor Command With ID command in the HDMI CEC protocol. When the display device 200 needs to output audio, the audio data can be sent to the external sound equipment through the HDMI ARC interface, and the external sound equipment converts the audio data into a sound signal to realize audio output.

[0058] The display device 200 and the external device 500 can also support a wireless connection mode. That is, the display device 200 can establish a connection between the display device 200 and the external device 500 through the built-in communicator 220 or by connecting a wireless communication device on the external device interface 240. The wireless connection mode can be a wireless local area network, infrared, Bluetooth, etc. Taking the Bluetooth connection mode as an example, the display device 200 and the external device 500 can each be provided with a Bluetooth connection module, and the display device 200 can send audio data and / or video data to the external device 500 through the Bluetooth connection module. Control instructions can also be transmitted between the display device 200 and the external device 500 through the Bluetooth connection module to achieve mutual control between the display device 200 and the external device 500.

[0059] In some embodiments, the external device 500 can have a certain data processing function in addition to the output function, for controlling the output process of audio and video. For example, for the external sound equipment, the audio transmitted by the display device 200 can also be subjected to sound quality processing to play the audio data in a specific output mode and obtain a corresponding sound quality effect. Therefore, the user can control the data processing function through an interactive action, that is, set the output mode. For example, the settings supported by the external sound equipment include sound effect mode, surround switch, treble adjustment, bass adjustment, display screen brightness adjustment, factory reset, etc. These setting functions can be completed through the setting interaction mode built in the external device 500. For example, the external sound equipment is provided with buttons, knobs, switches, etc. The user can adjust the interactive components on the external sound equipment through pressing, rotating, etc. to complete the corresponding setting process.

[0060] In some embodiments, the external device 500 can also support remote control settings, that is, the external device 500 can also be equipped with a remote control device. The remote control device is provided with function keys and is connected to the external device 500 through wireless transmission such as infrared or Bluetooth. During the setting process, the user can input the interactive action corresponding to the function to be set through the keys on the remote control device, so that the remote control device sends a wireless signal to the external device 500. After receiving the wireless signal, the external device 500 can complete the corresponding setting according to the interactive action.

[0061] In order to improve the output effect of audio and video data, the user can obtain different audio-visual feelings by adjusting the output mode of the external device. For example, in the interactive control of the external sound equipment, the sound effect modes of "music", "movie", "night", "sports", and "news" can be provided, and the user can select any one of the sound effect modes through the remote control or device keys of the external sound equipment, and control the external sound equipment to output audio according to the output parameters in the selected mode to obtain the sound quality effect in the mode.

[0062] For the above adjustment process, the external device can display the adjustment state through the light effect or the display screen to obtain the prompt effect. For example, some external devices can be provided with indicator lights, which can indicate different sound effect modes by lighting, color or extinguishing the indicator lights. Some external devices can be provided with a display screen, which can display the sound effect mode. However, since the indicator light or the display screen is arranged on the external device, the size of the indicator light and the display screen is small, and the prompt effect is not obvious, which is not conducive to the execution of the related interactive operation.

[0063] For some setting functions of the external device 500, the interactive components on the external device 500 are needed to cooperate to realize the display of the setting items and the setting results. For example, as shown in FIG. 1, in the sound quality adjustment process, the external device 500 can display a graphic equalizer (GEQ) through the indicator light, the liquid crystal screen, etc. to display the intensity of the bass, the medium tone and the treble in the audio through the GEQ menu. When the user adjusts the sound quality, the GEQ menu can indicate the output gain of the corresponding channel by changing the position of the floating mark on the scroll bar. Figure 6

[0064] However, the display of the GEQ menu through the indicator light is to display the channel gain on multiple gradients through multiple indicator lights, the display effect is single, and the linear and continuous adjustment process cannot be accurately displayed. In addition, the arrangement of the liquid crystal screen on the external sound equipment not only increases the manufacturing cost of the external sound equipment, but also due to the limitation of the overall size of the external sound equipment, the size of the liquid crystal screen is small, and the user cannot clearly see the content displayed on the liquid crystal screen when the user is far away from the external sound equipment, which is not convenient for the user to perform the interactive operation.​

[0065] In order to facilitate the user to perform the interactive operation, in some embodiments, the display device 200 can be used to display the interactive menu of the external device 500, as shown in the following figure. Figure 7 That is, by establishing a communication connection between the external device 500 and the display device 200, and configuring a graphical interactive menu control method for the display device 200, the running data and the interactive data related to the external device 500 can be obtained, and the graphical interactive menu can be displayed and presented according to the running data and the interactive data. As shown in the following figure, it specifically includes the following contents. Figure 8

[0066] The control instruction input by the user for displaying the interactive menu is obtained. The interactive menu includes at least one graphical menu item for setting the output parameter of the external device 500. The graphical menu item refers to a specific display graph, and an item for controlling one or more parameters. The graphical menu item can be presented in different forms according to the type of the corresponding controlled parameter. For example, for the parameters such as bass, midrange, treble channel gain, which can be adjusted by specific numerical values, the graphical menu item can be in the form of a scroll bar, that is, including a travel bar and an active marker graph. Different positions on the travel bar are used to represent different channel gain values, and the active marker at different positions on the travel bar can represent the channel gain in the current output condition. For example, when the active marker is located at the midpoint position of the bass travel bar, it indicates that the current bass channel gain is 50%. The user can input instructions on the graphical menu item by inputting directional key operations, selection operations, and drag operations, and the like, to control and adjust the corresponding parameter value.

[0067] In order to enable the user to input the interactive instruction based on the graphical option, the user can input the control instruction for displaying the interactive menu. The specific interactive action form corresponding to the control instruction can be determined according to different operating systems and display device 200 types. For example, as shown in the following figure, for the display device 200 such as a smart TV, the user can input the interactive action through the control device 100, control the focus cursor to select the "Settings"-"Connection Settings"-"External Device Control" options in the user interface in turn, and trigger the display of the interactive menu in the user interface. That is, the interactive action corresponding to the control instruction is to select the "Settings"-"Connection Settings"-"External Device Control" options once. Figure 8

[0068] A shortcut operation strategy can also be set in the display device 200, so that the user can quickly trigger the display of the interactive menu in the user interface. For example, the control device 100 matched with the display device 200 can be provided with an interactive menu button, and when the user presses the interactive menu button, the display device 200 can be directly controlled to display the interactive menu. That is, the interactive action corresponding to the control instruction is the pressing operation of the interactive menu button.​​

[0069] For the display device 200 supporting other interaction modes, the control instruction can also be completed by the supported interaction mode. For example, for the display device 200 supporting touch operation, the user can click the touch control corresponding to the "Settings"-"Connection Settings"-"External Device Control" option in the user interface in sequence by touch operation, so as to control the display device 200 to display the interaction menu. For the display device 200 supporting intelligent voice interaction, the user can also input voice "display × × interaction menu", "I want to control × ×" and the like through the intelligent voice system, so as to control the display device 200 to display the interaction menu. Wherein, "× ×" can be the specific name of the external device 500 or the type name of the external device 500.

[0070] After obtaining the control instruction for displaying the interaction menu, the display device 200 can detect the current output parameter of the external device 500 in response to the control instruction. Wherein, the current output parameter includes the output parameter corresponding to the graphical menu item. For example, when the interaction menu displayed by the display device 200 includes graphical options of the output intensity of the low, medium and high channels, the display device 200 can detect the current output intensity of the low, medium and high channels from the external device 500 in response to the control instruction.

[0071] The current output parameter obtained by the display device 200 detecting the external device 500 can include all the output parameters of the external device 500, or only include part of the output parameters of the external device 500. For example, when the display device 200 and the external device 500 are products of the same manufacturer, according to the factory setting, all the running parameters of the external device 500 can be controlled through the display device 200, so the display device 200 can obtain all the current output parameters of the external device 500 at one time in response to the control instruction input by the user. When the display device 200 and the external device 500 are not products of the same manufacturer, limited by the data acquisition authority of the display device 200, the display device 200 can only obtain the current output parameters of the external device 500 within the authority, that is, the display device 200 can only obtain part of the output parameters of the external device 500.

[0072] It should be noted that, in order to enable the display device 200 to detect the current output parameter of the external device 500, corresponding functional modules can be configured in the display device 200 and the external device 500 respectively, for example, a menu control module is configured in the display device 200, and a menu response module is configured in the external device 500. The menu control module can generate a detection command according to the user control instruction, and send the detection command to the external device 500 through the external device interface 240.

[0073] The menu response module in external device 500 can obtain the current output parameters based on the detection command after receiving it. The menu response module then converts and packages the operating parameters to generate a data packet conforming to the transmission protocol specification corresponding to external device interface 240. Finally, the generated data packet is fed back to display device 200, where the menu control module parses the fed-back data packet to enable display device 200 to detect the current output parameters of external device 500.

[0074] By detecting the current output parameters of the external device 500, the display device 200 can present different display content in the interactive menu according to the different current output parameters. That is, the display device 200 can set the display content of the graphical menu items according to the current output parameters. For example, such as... Figure 9 As shown, for the GEQ menus corresponding to the bass, midrange, and treble channels, the display device 200 can extract the output gain values ​​of the three channels from the detected current output parameters, such as 50% for bass, 60% for midrange, and 40% for treble. Then, based on the extracted output gain values, it sets the position of the activity marker for each channel in the GEQ menu on the travel bar: the bass channel activity marker is at the midpoint of the travel bar; the midrange channel activity marker is slightly to the right of the midpoint; and the treble channel activity marker is slightly to the left of the midpoint.

[0075] After setting the display content in the interactive menu, the display device 200 can also control the monitor 260 to display the final interactive menu. Therefore, in this embodiment, after obtaining the control command input by the user, the display device 200 sets the display content of the graphical menu items in the interactive menu by detecting the current output parameters of the external device 500. Through this menu control method, graphical interactive menus that cannot be displayed on the external device 500 can be presented through the display device 200. This allows the user's control of the external device 500 to be not limited to the hardware support of the external device 500 itself, and can present the user with a clearer graphical interactive menu to facilitate interactive operations.

[0076] The interactive menu displayed on display device 200 can contain settings that are compatible with the interactive interface of external device 500. For example, if the output intensity of the bass, midrange, and treble channels in audio data can be set on external device 500 via an LCD screen or indicator lights, the interactive menu displayed on display device 200 can also include graphical options for the bass, midrange, and treble channels to achieve the same setting process as when controlled independently by external device 500.

[0077] In some embodiments, the interactive menu content displayed by the display device 200 may not be limited to the original interactive form of the external device 500. For example, such as Figure 9 As shown, the graphical menu items for adjusting sound quality in the interactive menu can include three display modes. The first mode includes graphical options for the bass, midrange, and treble channels, allowing users to set the bass, midrange, and treble channels in the audio data separately. The second mode features preset GEQ menu items according to music genres, such as jazz, classical, and rock, allowing users to select one of these menu items. Figure 10 As shown. The third mode is a custom mode, where users can freely set the GEQ. In this mode, the frequency response curve of the external audio device is normalized to 0dB at 1kHz, and the highest and lowest gains across the entire frequency range are limited to ±10dB. Users can adjust the EQ curve to set their preferred mode, such as... Figure 11 As shown.

[0078] Different display modes offer different adjustment effects. For example, the custom mode includes multiple bar charts, each with an adjustable point for gain adjustment of a specific frequency band. When the user selects the custom mode, the display device 200 first acquires the output parameters of the external audio device and plots an EQ curve based on these parameters. Then, it divides the current output parameters of the external device into parameter ranges. The number of parameter ranges can be determined by the number of bar charts in the custom mode menu.

[0079] Next, the average parameter value within each range is calculated to set the display content of the graphical menu items. This means setting the position of the adjustment point within the bar area based on the average parameter value. When displaying graphical menu items in custom mode, the position of the adjustment point can be set according to the average parameter value corresponding to the audio signal frequency range. Users can adjust the EQ curve at different adjustment points. For example, moving the adjustment point on the leftmost bar upwards increases the gain in the 47Hz band, improving the bass effect of the output audio; moving the adjustment point on the rightmost bar downwards decreases the gain in the 19688Hz band, reducing the treble effect of the output audio.

[0080] For interactive menus with different modes, users can specify the specific mode to be presented through control instructions used to display the interactive menu, or they can specify the specific mode to be presented through a mode selection interface before displaying the interactive menu. Therefore, in some embodiments, when the display device 200 detects the current output parameters of the external device 500, it can parse the item mode input by the user and obtain the execution subset of the current item mode.

[0081] The item mode input by the user is used to indicate the specific form presented by the interactive menu to the user. After the user inputs the item mode, the interactive menu can display the specific setting item of the external device 500 in the form specified by the item mode. After the display device 200 detects the current output parameter of the external device 500, the display device 200 can first display a mode selection interface, and the user can select any mode option in the mode selection interface to input the item mode.

[0082] In some embodiments, in order to be able to parse the item mode input by the user, the display device 200 can control the display 260 to display a mode selection sub-menu in the interactive menu, and the mode selection sub-menu includes options of each item mode. After displaying the mode selection sub-menu, the display device 200 can receive the selection instruction input by the user through the mode selection interface. For example, as shown in FIG. 3, the mode selection interface can include three mode options: channel mode, music style mode, and custom (professional) mode. When the music style mode option is selected, the item mode input by the user is the music style mode. Figure 12

[0083] The display device 200 extracts the mode ID selected by the user according to the position of the selection instruction, and queries the item mode in the ID full set according to the mode ID. For example, the display device 200 can take the ID numbers of the channel mode, the music style mode, and the custom mode as 0, 1, and 2 respectively, and store a GEQ menu ID full set by using the storage advantage of the display device 200. In the menu ID full set, all graphical menu items that can be displayed through the interactive menu can be included. When the user selects any item mode, the display device 200 can match in the ID full set based on the item mode ID, so as to determine the specific item mode and the corresponding execution subset.

[0084] The display device 200 extracts the corresponding execution subset according to the item mode input by the user. The execution subset refers to the graphical menu items that can be displayed under each item mode. For example, when the user selects the channel mode, the corresponding execution subset includes three graphical menu items: bass channel, midrange channel, and treble channel; when the user selects the music style mode, the corresponding execution subset includes graphical menu items such as standard, jazz, classical, and rock; and when the user selects the custom mode, the corresponding execution subset includes three variables related to the GEQ, i.e., frequency, gain, and Q value, which can be set as parameters (Fre, Gain, Q) respectively.

[0085] ​The display device 200 then extracts the output parameters corresponding to the graphical menu items from the current output parameters based on the acquired execution subset. For example, when the user selects a channel mode, the display device 200 can extract the bass gain, midrange gain, and treble gain from the current output parameters based on the bass channel, midrange channel, and treble channel in the channel mode, respectively. When the user selects a music style mode, the current music style can be determined based on the gains of multiple channels in the current output parameters.

[0086] By extracting the output parameters corresponding to the graphical menu items from the current output parameters, the display device 200 can set the specific display content of the graphical menu items according to the extracted parameters, so as to present an interactive menu that conforms to the current output parameters. For example, for the music style mode, when it is determined that the current output parameters belong to the rock style based on the output gain of each channel, the display device 200 can set the rock option to the selected state in the displayed interactive menu.

[0087] Based on the above mode selection operation, such as Figure 13 , Figure 14 As shown, the specific interaction method in this embodiment is as follows: After the user presses the control device 100 of the display device 200 or the remote control of the external device 500 to input a sound effect command, the visual interactive menu in the display device 200 is activated, and the sound effect command is transmitted to the digital signal processing (DSP) module of the display device 200, and the GEQ option in the interactive menu is brought up for the user to select. After the user selects any mode, the command for that mode is first transmitted to the UI layer of the display device 200. The UI layer recognizes the ITEM and value of the mode selected by the user, and then transmits it to the business logic layer Framework, then to the hardware abstraction layer (HAL), then to the driver layer, and finally to the soundbar DSP of the external device 500 to generate a GEQ response event for that mode. After the response is generated, the data is reported layer by layer, and finally reaches the UI layer to store the data in the database for backup.

[0088] Since the current output parameters detected in the external device 500 can generally be in the form of fixed data packets, the display device 200 can parse the specific parameters from the data packets. However, the parameters directly parsed from the data packets often cannot be directly applied to the user-input item mode. Therefore, in some embodiments, the display device 200 needs to calculate based on the current output parameters to obtain parameters that can be applied to the current item mode.

[0089] In order to adapt to different project modes, the project modes can be classified according to the interactive menu graphical types that can be presented in the display device 200, i.e. the project modes include fixed parameter modes and variable function modes. By detecting the project mode classification selected by the user, the corresponding parameter values in the current output parameter can be obtained in different ways. If the project mode is a fixed parameter mode, the display device 200 can determine the parameter form required by the current project mode by traversing the parameter items in the fixed parameter mode, and then calculate the parameter values corresponding to the parameter items according to the current output parameter.

[0090] For example, when the user selects the channel mode or the music style mode, since these two modes indicate different output modes according to fixed parameter combinations, it is determined that the project mode input by the user is a fixed parameter mode. At this time, the display device 200 can traverse the parameter items in the fixed parameter mode, i.e. for the channel mode, the parameter items are the low, medium and high projects, and for the music style mode, the corresponding parameter items are the standard, jazz, classical, rock, etc. If the current output parameter detected by the display device 200 from the external device 500 is the final output signal information, the signal information needs to be converted and calculated to determine the parameter values corresponding to the current output signal. For example, the real-time parameter values of each frequency signal in the output signal can be extracted, and the parameter values corresponding to each frequency are converted and calculated to determine the conversion results of the low, medium and high parts.

[0091] If the project mode is a variable function mode, the display device 200 can obtain the variable quantities in the variable function mode, and extract the parameter values corresponding to the variable quantities from the current output parameter. For example, when the user selects the custom mode, since there is no specific fixed parameter combination, the current project mode is a variable function mode. At this time, the display device 200 can determine that the variable quantities of the variable function are frequency, gain and Q value. Based on this, the display device 200 can directly obtain the frequency, gain and Q value from the output signal, i.e. the display device 200 can execute the following command Request_SubMenu(Fre, Gain, Q) to extract the parameter values corresponding to the variable quantities from the current output parameter.

[0092] In the above embodiment, the user can realize a series of setting functions of the external device 500 through the graphical menu items in the interactive menu. Among these setting functions, part of the setting functions can be completed independently by the external device 500, such as the conventional setting functions of turning on / off the device, controlling the volume of the device, etc.; and part of the setting functions cannot be completed independently by the external device 500, such as the channel gain effect linear adjustment function depending on the graphical options. In order to quickly complete the settings, the display device 200 can provide the user with a series of setting functions in the interactive menu, and the user can select the setting function according to the actual needs. Figure 15As shown, in some embodiments, the display device 200 can also receive a setting instruction input by the user for setting the output parameter of the external device 500 before the step of obtaining the control instruction input by the user for displaying the interactive menu.

[0093] The setting instruction is used to change the output parameter of the external device 500. For example, turning on the external device, turning off the external device, increasing the output volume, decreasing the output volume, changing the music style to "rock", etc. In this embodiment, the display device 200 can receive the setting instruction input by the user when the interactive menu is not displayed. The display device 200 then parses the setting content in the setting instruction and controls the external device 500 in a manner suitable for the setting content.

[0094] If the setting content of the setting instruction can be set by the external device 500 alone, the display device 200 can send the setting instruction to the external device 500 so that the external device 500 directly adjusts the output parameter according to the setting instruction. For example, when the user inputs a setting instruction for increasing the volume of the external audio device by 10% through the control device 100 such as a mobile phone, the display device 200 can obtain the setting instruction. At this time, the display device 200 can obtain the setting content of the setting instruction, i.e., increasing the volume by 10%. Obviously, the setting content can be completed by the external audio device alone, so the display device 200 can directly pass the setting instruction to the external audio device to control the change of the output volume of the external audio device.

[0095] If the setting content of the setting instruction cannot be set by the external device alone, a control instruction for displaying an interactive menu is generated to control the display device 200 to display an interactive menu with graphical menu items for the user to realize the setting function. For example, when the user inputs a setting instruction for displaying a GEQ menu of a custom sound effect through the control device 100, it can be determined that the external audio device cannot complete the setting content alone since the external audio device does not have a display component such as a liquid crystal screen. At this time, the display device 200 can automatically generate a control instruction for displaying an interactive menu, and in the manner described in the above embodiments, detect the current output parameter of the external audio device and set the display content of the GEQ menu in the interactive menu according to the current output parameter to display the interactive menu to complete the setting function that the external audio device cannot complete alone.

[0096] To determine whether a setting command can be executed independently by the external device 500, in some embodiments, the display device 200 can parse the adjustment parameters specified in the setting command and obtain the set of setting items supported by the external device 500. Specifically, the set of setting items supported by the external device 500 can be reported to the display device 200 along with its device ID and supported setting items when the external device 500 first connects to the display device 200, and the reported set of setting items is stored in the display device 200.

[0097] In determining whether a setting command can be completed by the external device 500 alone, the display device 200 can extract the specified adjustment parameter from the setting command and simultaneously call the stored set of setting items. Then, using the adjustment parameter as an index, it performs a match within the set of setting items. If the adjustment parameter matches any parameter in the set of setting items, it is determined that the setting can be completed by the external device alone; if the adjustment parameter differs from all parameters in the set of setting items, it is determined that the setting cannot be completed by the external device alone.

[0098] For example, when a user inputs a setting command to turn on an external audio device, the display device 200 can extract the adjustment parameter "power=1" from the setting command and simultaneously retrieve the set of setting items corresponding to the current external audio device from its memory. Then, using this adjustment parameter as an index, it matches the settings within the set of setting items. If the set of setting items includes an item that sets the adjustment parameter "power" to 1, it is determined that the current setting command can be completed independently by the external audio device.

[0099] like Figure 16 As shown, after the display device 200 displays the interactive menu, the user can perform further interactive control based on the interactive menu. That is, the display device 200 can receive setting commands input by the user through the interactive menu. In actual use, the setting commands can be input by the control device 100 of the display device 200 or by the remote control of the external device 500. When the setting command is input by the control device 100, the display device 200 can directly obtain the setting command; when the setting command is input by the remote control of the external device 500, the external device 500 directly obtains the setting command and then transmits the setting command to the display device 200 through the external device 500.

[0100] After obtaining the setting instruction, the display device 200 can calculate the adjusted parameter in response to the setting instruction. Since the setting instruction is based on the interactive menu, i.e., the user can adjust the change of the figure in the figure menu item through the interactive action, the display device 200 can calculate the adjusted parameter according to the change of the figure in the figure menu item in the interactive menu. For example, when the user inputs the setting instruction of adjusting the active marker corresponding to the bass channel to move 10% of the distance to the right, the user inputs the setting instruction of increasing the gain of the bass channel by 10%. At this time, the display device 200 can combine the current gain of the bass channel of 50% to calculate the adjusted gain of the bass channel as 60%.

[0101] After calculating the adjusted parameter, the display device 200 can send the adjusted parameter to the external device 500, so that the external device 500 outputs the audio and video data according to the adjusted parameter. It can be seen that in the embodiment, the user can control the output parameter of the external device 500 based on the interactive menu. Since the interactive menu includes the figure menu item, the setting mode that cannot be realized by the external device 500 alone can be realized, and the user can have the experience of more convenient interaction, more intuitive and fine display, and more diverse modes.

[0102] It should be noted that, in order to enable the display device 200 to continuously control the external device 500, the display device 200 can receive the feedback of the execution result of the external device 500 after executing the setting instruction each time, as shown in FIG. 6. Figure 17 After sending the adjusted parameter to the external device 500, the display device 200 can receive the response data of the external device 500 to the adjusted parameter, and backup the adjusted parameter in the database to update the running state of the external device 500 in the database.

[0103] In some embodiments, if the setting instruction is input by the remote controller of the external device 500, the display device 200 can further analyze the control mode of the setting instruction. The control mode includes direct control and menu control. If the control mode is direct control, the display device 200 modifies the display screen of the menu item in the interactive menu according to the adjusted parameter to refresh the display content of the interactive menu; if the control mode is menu control, the display device 200 calculates the adjusted parameter according to the adjusted parameter and the current running parameter, and modifies the display screen of the menu item in the interactive menu according to the adjusted parameter, and sends the adjusted parameter to the external device 500.

[0104] For example, when the user inputs a setting instruction through the remote controller of the external sound equipment, the external sound equipment can first detect the control mode of the setting instruction. If the setting instruction is a direct setting instruction such as turning off the equipment, the external sound equipment can directly execute the setting instruction, turn off the equipment, and pass the setting instruction to the display equipment 200 before turning off, so that the display equipment 200 can modify the switch option in the interactive menu to the off state according to the setting instruction.

[0105] If the setting instruction is a menu setting instruction such as the "left" direction key or the "right" direction key, the external sound equipment can not execute the setting instruction, but pass the setting instruction to the display equipment 200. The display equipment 200 modifies the display content of the interactive menu according to the setting instruction. At the same time, the adjusted parameter is calculated, such as increasing the gain of the bass channel by 10%, and the overall gain of the bass channel is 60%, and the calculated gain value is sent to the external sound equipment, so that the external sound equipment can play sound according to the bass channel output gain of 60%.

[0106] Based on the display equipment 200 described above, the application further provides a graphic interactive menu control method in some embodiments, which includes: obtaining a control instruction input by a user for displaying an interactive menu, the interactive menu including at least one graphic menu item for setting an output parameter of an external device; in response to the control instruction, detecting a current output parameter of the external device, the current output parameter including an output parameter corresponding to the graphic menu item; setting display content of the graphic menu item according to the current output parameter; and controlling the display to display the interactive menu.

[0107] As can be seen from the above technical solutions, the graphic interactive menu control method provided by the embodiments of the application can detect the current output parameter of the external device after the user inputs the control instruction for displaying the interactive menu, and set the display content of the graphic menu item in the interactive menu according to the current output parameter, so as to display the interactive menu with the graphic menu item in the display for the user to perform an interactive action for setting the output parameter of the external device. The method can display the graphic interactive menu of the external device through the display equipment, so that the display process of the interactive menu is more delicate and intuitive, and the graphic interactive menu displayed through the display equipment can break through the hardware display of the external device, provide more rich graphic menu items for the user to adjust, and meet the more personalized adjustment needs of the user.

[0108] The similar parts among the embodiments provided by the application can be referred to each other, and the specific embodiments provided above are only some examples under the general concept of the application, and do not limit the protection scope of the application. Any other embodiments extended according to the application solutions by those skilled in the art without creative labor are within the protection scope of the application.

Claims

1. A display device, characterized in that, include: monitor; The external device interface is configured to connect to external devices; The controller is configured as follows: Receive user input of setting instructions for configuring the output parameters of the external device; Parse the adjustment parameters specified in the setting command; Obtain the set of settings items supported by the external device; If the adjustment parameter is different from all parameters in the set of settings, a control instruction for displaying an interactive menu is generated. The interactive menu includes at least one graphical menu item for setting the output parameters of an external device. The at least one graphical menu item includes graphical menu items corresponding to at least one sound effect mode. In response to the control command, the user-inputted project mode is parsed to obtain the execution subset of the current project mode; According to the execution subset, extract the output parameters corresponding to the graphical menu items from the current output parameters of the external device; The display content of the graphical menu item is set according to the output parameters corresponding to the graphical menu item, and the display is controlled to show the interactive menu; The system receives a setting command input by the user through the interactive menu. The setting command is input by the control device of the display device and is used to change the sound effect mode of the external device. In response to the setting command, the sound effect mode of the external device is changed; wherein the external device is equipped with an indicator light, and the display state of the indicator light changes accordingly when the sound effect mode of the external device is changed.

2. The display device according to claim 1, characterized in that, The at least one graphical menu item includes a graphical menu item with at least one sound effect mode selected from Standard Mode, Jazz Mode, Classical Mode, Rock Mode, Music Mode, Movie Mode, Night Mode, Sports Mode, and News Mode.

3. The display device according to claim 2, characterized in that, The project modes include a fixed parameter mode and a variable function mode, and the controller is further configured as follows: If the project mode is a fixed parameter mode, iterate through the parameter items in the fixed parameter mode and calculate the parameter value corresponding to the parameter item based on the current output parameter; If the project mode is a variable function mode, obtain the variable variables in the variable function mode, and extract the parameter values ​​corresponding to the variable variables from the current output parameters.

4. The display device according to claim 2, characterized in that, The controller is further configured to: In the step of parsing the project mode input by the user, the display is controlled to show a mode selection submenu in the interactive menu, which includes options for each project mode; Receive the selection command input by the user through the mode selection interface; Extract the user-selected pattern ID based on the location of the selected instruction; Based on the pattern ID, query the project pattern in the entire set of IDs.

5. The display device according to claim 1, characterized in that, The controller is further configured to: If the adjustment parameter is the same as any parameter in the set of settings, the setting command is sent to the external device.

6. The display device according to claim 5, characterized in that, The controller is further configured to: If the adjustment parameter is different from all parameters in the set of settings, perform parameter range division on the current output parameter of the external device; Calculate the average value of the parameters within each parameter interval; The display content of the graphical menu items is set according to the average value of the parameters.

7. The display device according to claim 1, characterized in that, The controller is further configured to: After controlling the display to show the interactive menu, a setting command input by the user through the interactive menu is received. The setting command is input by the control device of the display device or by the remote control of the external device. In response to the setting instruction, extract the setting parameter values ​​from the setting instruction; Calculate the adjusted parameters based on the set parameter values ​​and the current parameter values; The adjusted parameters are sent to the external device so that the external device outputs audio and video data according to the adjusted parameters.

8. The display device according to claim 7, characterized in that, The controller is further configured to: After the step of sending the adjusted parameters to the external device, the response data fed back by the external device in response to the adjusted parameters is received; The adjusted parameters are backed up in the database to update the operating status of external devices in the database.

9. The display device according to claim 7, characterized in that, The controller is further configured to: If the setting command is input by the remote control of the external device, the control method for parsing the setting command includes direct control and menu control; If the control method is direct control, the pattern of the menu item in the interactive menu is modified according to the set parameter amount to refresh the display content of the interactive menu; If the control method is menu control, the adjusted parameters are calculated based on the set parameter values ​​and the current operating parameters; Modify the pattern of the menu item in the interactive menu according to the adjusted parameters, and send the adjusted parameters to the external device.

10. A graphical interactive menu control method, characterized in that, Applied to a display device, wherein the display device is connected to an external device; The graphical interactive menu control method includes: Receive user input of setting instructions for configuring the output parameters of the external device; Parse the adjustment parameters specified in the setting command; Obtain the set of settings items supported by the external device; If the adjustment parameter is different from all parameters in the set of settings, a control instruction for displaying an interactive menu is generated. The interactive menu includes at least one graphical menu item for setting the output parameters of an external device. The at least one graphical menu item includes graphical menu items corresponding to at least one sound effect mode. In response to the control command, the user-inputted project mode is parsed to obtain the execution subset of the current project mode; According to the execution subset, extract the output parameters corresponding to the graphical menu items from the current output parameters of the external device; The display content of the graphical menu item is set according to the output parameters corresponding to the graphical menu item, and the display is controlled to show the interactive menu. The system receives a setting command input by the user through the interactive menu. The setting command is input by the control device of the display device and is used to change the sound effect mode of the external device. In response to the setting command, the sound effect mode of the external device is changed; wherein the external device is equipped with an indicator light, and the display state of the indicator light changes accordingly when the sound effect mode of the external device is changed.

Images