Display device and method for controlling light effect based on audio signal

Abstract

The invention provides a display device and a method for controlling a light effect based on an audio signal. The display equipment can control and change the light characteristics of at least one light emitting device in communication connection based on the acquired audio signal under the condition of supporting and starting the lighting effect control function. If the display device collects multiple groups of audio signals, the multiple groups of audio signals can be processed to obtain a group of effective signals used for controlling the lighting effect. Moreover, the display equipment can generate a control instruction corresponding to the light-emitting device based on the energy value corresponding to the effective signal in each preset frequency band, the control instruction comprises a target parameter of the light characteristic, and the target parameter can be used for representing the energy value corresponding to the preset frequency band bound with the light-emitting device. After the light emitting device responds to the control instruction and adjusts the light characteristics according to the target parameters, the energy characteristics of the effective signal in the corresponding preset frequency band can be displayed. Therefore, the display device not only can effectively solve the conflict among multiple groups of audio signals, but also can display the energy characteristics of the audio signals on each frequency band.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for controlling lighting effects based on an audio signal. Background Art

[0002] Display devices refer to terminal devices that can output specific display images, which can be terminal devices such as smart TVs, mobile terminals, smart advertising screens, projectors, etc. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] The display device can be connected to the light-emitting device, and after the audio signal is collected, a control instruction to change the light characteristics is generated based on the audio signal, and the light-emitting device changes the light characteristics in response to the control instruction, thereby changing the overall light effect. Thus, the display device can show the change of the audio signal by changing the light effect of the light-emitting device.

[0004] The light-emitting device can only display the lighting characteristics corresponding to one set of audio signals at each moment. When the display device collects multiple sets of audio signals at the same time, the display device can generate control instructions corresponding to each of the multiple sets of audio signals. However, the light-emitting device will not be able to respond to the multiple control instructions at the same time, resulting in the inability to change the lighting characteristics normally. Alternatively, the display device can generate a control instruction, and include control parameters corresponding to each of the multiple sets of audio signals in the control instruction. However, the light-emitting device will not be able to change the lighting characteristics according to the multiple control parameters at the same time. In other words, if the display device collects multiple sets of audio signals at the same time, the lighting characteristics corresponding to the multiple sets of audio signals will conflict in display, and the light-emitting device will not be able to display the lighting characteristics corresponding to the multiple sets of audio signals. Summary of the invention

[0005] The present application provides a display device and a method for controlling lighting effects based on audio signals. When the display device simultaneously collects multiple groups of audio signals, it can control a light-emitting device to display the lighting effects corresponding to the multiple groups of audio signals.

[0006] In a first aspect, the present application provides a display device, including:

[0007] A communication device, configured to: communicate with at least one light-emitting device, wherein each of the light-emitting devices supports at least one adjustable light feature, and the at least one light-emitting device is respectively bound to different preset frequency bands;

[0008] The controller is configured to: when the light effect control function is turned on, if multiple groups of audio signals are obtained, mix the multiple groups of audio signals to obtain a group of effective signals for controlling the light effect; calculate the energy value of the effective signal corresponding to each of the preset frequency bands; generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band, the control instruction including the target parameter of the light characteristic, the target parameter being used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; send the corresponding control instruction to the light-emitting device, the control instruction being used to instruct the light-emitting device to adjust the light characteristic according to the target parameter.

[0009] The above technical solution has the following beneficial effects or advantages:

[0010] When the display device supports and turns on the light effect control function, it can control and change the light characteristics of at least one light-emitting device in communication connection based on the acquired audio signal. If the display device collects multiple groups of audio signals, it can automatically mix the multiple groups of audio signals to obtain a group of effective signals for controlling the light effect. Since the light-emitting device has a binding relationship with the preset frequency band, it is possible to generate a control instruction corresponding to each light-emitting device based on the energy value corresponding to the effective signal in each preset frequency band. The control instruction includes a target parameter of the light characteristic, and the target parameter can be used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device. After the light-emitting device responds to the control instruction and adjusts the light characteristic according to the target parameter, it can display the energy characteristics of the effective signal in the corresponding preset frequency band. In this way, the display device can not only effectively resolve the conflict between multiple groups of audio signals, control the light-emitting device to display the light characteristics that can reflect multiple groups of audio signals, but also display the energy characteristics of the audio signal in each frequency band.

[0011] In some embodiments of the present application, the controller executes calculation of the energy value corresponding to the effective signal in each of the preset frequency bands, and is specifically configured as: taking the first time length as a time unit, converting each of the effective signals of the first time length into corresponding frequency domain data in turn; obtaining the frequency domain data corresponding to each of the preset frequency bands; and calculating the energy value corresponding to the effective signal in the preset frequency band based on the frequency domain data corresponding to the preset frequency band.

[0012] The above technical solution has the following beneficial effects or advantages:

[0013] The display device can convert the corresponding audio signal into frequency domain data according to time units. Since the frequency domain data includes information for calculating the energy value of each frequency point, the energy value of the corresponding audio signal in each preset frequency band can be accurately calculated based on the frequency domain data.

[0014] In some embodiments of the present application, the controller executes to generate control instructions corresponding to the light-emitting devices according to the energy values ​​corresponding to each of the preset frequency bands and the binding relationship between the light-emitting devices and the preset frequency bands, and is specifically configured as follows: according to the first relationship and the energy values ​​corresponding to each of the preset frequency bands, the first target parameters of the light characteristics in each of the preset frequency bands are obtained, wherein the first relationship refers to the mapping relationship between the parameters of the light characteristics and the energy value range; according to the binding relationship between the light-emitting devices and the preset frequency bands, the control instructions corresponding to each of the light-emitting devices are generated, and the control instructions include the first target parameters of the light characteristics in the corresponding preset frequency bands.

[0015] The above technical solution has the following beneficial effects or advantages:

[0016] The display device can obtain the first target parameter corresponding to each preset frequency band according to the first relationship, and can obtain the first target parameter corresponding to the light-emitting device according to the binding relationship between the light-emitting device and the preset frequency band, that is, the parameter to be used by the light-emitting device to display the light characteristics. The display device can generate a control instruction corresponding to each light-emitting device, and the control instruction includes the first target parameter of the light characteristics under the corresponding preset frequency band, that is, the parameter to be used by the corresponding light-emitting device to display the light characteristics. In this way, the display device can control the corresponding light-emitting device in a targeted manner through each control instruction, thereby ensuring the accuracy of the control.

[0017] In some embodiments of the present application, after the controller executes the frequency domain data corresponding to the preset frequency band and calculates the energy value of the valid signal corresponding to the preset frequency band, the controller is also configured to: obtain a system volume range, the minimum value of the system volume range is the minimum system volume value, and the maximum value of the system volume range is the current system volume value; set an energy value range according to the system volume range, the minimum value of the energy value range is the energy value corresponding to the minimum system volume value, and the maximum value of the energy value range is the energy value corresponding to the current system volume value; convert the energy value corresponding to the preset frequency band into a relative energy value according to the system volume range, the energy value range and the energy conversion relationship, the energy conversion relationship is used to convert the energy value to a preset relative energy value range; generate a control instruction corresponding to the light-emitting device according to the relative energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band.

[0018] The above technical solution has the following beneficial effects or advantages:

[0019] The display device can convert the energy value corresponding to each preset frequency band into a relative energy value according to the energy conversion relationship. Since the relative energy value belongs to the preset relative energy value range, this conversion can correspond the energy value to the relative energy value range more evenly and dispersedly. Therefore, when the energy value is generally high or generally low due to the influence of the current system volume, and the light characteristics do not change significantly or do not change, the energy conversion can be used to make the converted relative energy value more evenly and dispersedly distributed within the relative energy value range, so that it can correspond to the light characteristics with changes, and the changes in the light characteristics are more obvious.

[0020] In some embodiments of the present application, the controller generates a control instruction corresponding to the light-emitting device based on the relative energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band, and is specifically configured as follows: according to the second relationship and the relative energy value corresponding to each of the preset frequency bands, the second target parameter of the light characteristic under each of the preset frequency bands is obtained, wherein the second relationship refers to the mapping relationship between the parameters of the light characteristic and the relative energy value range; according to the binding relationship between the light-emitting device and the preset frequency band, a control instruction corresponding to each of the light-emitting devices is generated, and the control instruction includes the second target parameter of the light characteristic under the corresponding preset frequency band.

[0021] The above technical solution has the following beneficial effects or advantages:

[0022] The display device can obtain the second target parameter corresponding to each preset frequency band according to the second relationship, and can obtain the second target parameter corresponding to the light-emitting device according to the binding relationship between the light-emitting device and the preset frequency band, that is, the parameter to be used by the light-emitting device to display the light characteristics. The display device can generate a control instruction corresponding to each light-emitting device, and the control instruction includes the second target parameter of the light characteristics under the corresponding preset frequency band, that is, the parameter to be used by the corresponding light-emitting device to display the light characteristics. In this way, the display device can control the corresponding light-emitting device in a targeted manner through each control instruction, thereby ensuring the accuracy of the control.

[0023] In some embodiments of the present application, the display device also includes: a memory, configured to store a communication address corresponding to each of the light-emitting devices; the controller executes sending the corresponding control instruction to the light-emitting device, and is specifically configured to: read the communication address corresponding to the light-emitting device from the memory; and send the corresponding control instruction to the light-emitting device according to the communication address corresponding to the light-emitting device.

[0024] The above technical solution has the following beneficial effects or advantages:

[0025] The display device can pre-store the communication address corresponding to each light-emitting device, and when the light-emitting device needs to be controlled, it can send control instructions to the corresponding light-emitting device according to the communication address, thereby ensuring the accuracy of sending the control instructions, and then ensuring the accuracy of controlling the light-emitting device, and ensuring that the light-emitting device can accurately display the corresponding lighting characteristics.

[0026] In a second aspect, the present application further provides a display device, comprising: a communication device, configured to: communicate with at least one light-emitting device, wherein each of the light-emitting devices supports at least one adjustable light feature, and the at least one light-emitting device is respectively bound to different preset frequency bands;

[0027] The controller is configured to: when the light effect control function is turned on, if multiple groups of audio signals are obtained, obtain a first parameter set by the user, the first parameter indicating a valid signal for controlling the light effect; based on the first parameter, filter out a group of the valid signals from the multiple groups of audio signals; calculate the energy value corresponding to the valid signal in each of the preset frequency bands; based on the energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band, generate a control instruction corresponding to the light-emitting device, the control instruction including a target parameter of the light characteristic, the target parameter being used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; send the corresponding control instruction to the light-emitting device, the control instruction being used to instruct to adjust the light characteristic according to the target parameter.

[0028] The above technical solution has the following beneficial effects or advantages:

[0029] When the display device supports and turns on the light effect control function, it can control and change the light characteristics of at least one light-emitting device in communication connection based on the acquired audio signal. If the display device collects multiple groups of audio signals, it can obtain the first parameter set by the user, and filter out the effective signal for controlling the light effect from the multiple groups of audio signals based on the first parameter. Since the light-emitting device has a binding relationship with the preset frequency band, it is possible to generate a control instruction corresponding to each light-emitting device based on the energy value corresponding to the effective signal in each preset frequency band. The control instruction includes a target parameter of the light characteristic, and the target parameter can be used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device. After the light-emitting device adjusts the light characteristic according to the target parameter in response to the control instruction, it can display the energy characteristics of the effective signal in the corresponding preset frequency band. In this way, the display device can control the light-emitting device to display the light characteristics that can reflect the audio signal selected by the user, and can also display the energy characteristics of the audio signal in each frequency band when there is a conflict between multiple groups of audio signals.

[0030] In some embodiments of the present application, when the light effect control function is turned on, the controller executes, if multiple groups of audio signals are obtained, to obtain the first parameter set by the user, and is specifically configured to: obtain the first parameter pre-set by the user from the memory; or control the display to display the setting page; obtain the first parameter set by the user based on the setting page.

[0031] The above technical solution has the following beneficial effects or advantages:

[0032] The display device supports the user to set the first parameter in various scenarios. For example, the display device supports the user to set the first parameter in advance, and when multiple groups of audio signals are acquired, supports displaying a setting page to the user, and supports the user to set the first parameter on the setting page. In this way, the user can set the first parameter in a more flexible manner according to needs.

[0033] In a third aspect, the present application provides a method for controlling lighting effects based on an audio signal, which is applied to a display device as described in any one of the first aspects, wherein the display device is communicatively connected to at least one light-emitting device, wherein each of the light-emitting devices supports at least one adjustable lighting feature, and the at least one light-emitting device is respectively bound to different preset frequency bands;

[0034] The method includes: when a light effect control function is turned on, if multiple groups of audio signals are obtained, mixing the multiple groups of audio signals to obtain a group of effective signals for controlling the light effect; calculating the energy value of the effective signal corresponding to each of the preset frequency bands; generating a control instruction corresponding to the light-emitting device according to the energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band, the control instruction including a target parameter of the light characteristic, the target parameter being used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; and sending the corresponding control instruction to the light-emitting device, the control instruction being used to instruct the light-emitting device to adjust the light characteristic according to the target parameter.

[0035] The above technical solution has the following beneficial effects or advantages:

[0036] When the display device supports and turns on the light effect control function, it can control and change the light characteristics of at least one light-emitting device in communication connection based on the acquired audio signal. If the display device collects multiple groups of audio signals, it can automatically mix the multiple groups of audio signals to obtain a group of effective signals for controlling the light effect. Since the light-emitting device has a binding relationship with the preset frequency band, it is possible to generate a control instruction corresponding to each light-emitting device based on the energy value corresponding to the effective signal in each preset frequency band. The control instruction includes a target parameter of the light characteristic, and the target parameter can be used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device. After the light-emitting device responds to the control instruction and adjusts the light characteristic according to the target parameter, it can display the energy characteristics of the effective signal in the corresponding preset frequency band. In this way, the display device can not only effectively resolve the conflict between multiple groups of audio signals, control the light-emitting device to display the light characteristics that can reflect multiple groups of audio signals, but also display the energy characteristics of the audio signal in each frequency band.

[0037] In a fourth aspect, applied to a display device as described in any one of the second aspects, the display device is communicatively connected to at least one light-emitting device, wherein each of the light-emitting devices supports at least one adjustable light feature, and the at least one light-emitting device is respectively bound to different preset frequency bands;

[0038] The method includes: when a light effect control function is turned on, if multiple groups of audio signals are obtained, obtaining a first parameter set by a user, the first parameter indicating a valid signal for controlling the light effect; based on the first parameter, screening out a group of the valid signals from the multiple groups of audio signals; calculating the energy value corresponding to the valid signal in each of the preset frequency bands; generating a control instruction corresponding to the light-emitting device based on the energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band, the control instruction including a target parameter of a light feature, the target parameter being used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; and sending the corresponding control instruction to the light-emitting device, the control instruction being used to instruct to adjust the light feature according to the target parameter.

[0039] The above technical solution has the following beneficial effects or advantages:

[0040] When the display device supports and turns on the light effect control function, it can control and change the light characteristics of at least one light-emitting device in communication connection based on the acquired audio signal. If the display device collects multiple groups of audio signals, it can obtain the first parameter set by the user, and filter out the effective signal for controlling the light effect from the multiple groups of audio signals based on the first parameter. Since the light-emitting device has a binding relationship with the preset frequency band, it is possible to generate a control instruction corresponding to each light-emitting device based on the energy value corresponding to the effective signal in each preset frequency band. The control instruction includes a target parameter of the light characteristic, and the target parameter can be used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device. After the light-emitting device adjusts the light characteristic according to the target parameter in response to the control instruction, it can display the energy characteristics of the effective signal in the corresponding preset frequency band. In this way, the display device can control the light-emitting device to display the light characteristics that can reflect the audio signal selected by the user, and can also display the energy characteristics of the audio signal in each frequency band when there is a conflict between multiple groups of audio signals. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0042] Figure 1 A schematic diagram of an operation scenario between a display device 200 and a control device 100 in an embodiment of the present application;

[0043] Figure 2 It is a hardware configuration block diagram of the display device 200 in the embodiment of the present application;

[0044] Figure 3 This is a configuration diagram of an operating system of a display device 200 in an embodiment of the present application;

[0045] Figure 4A-4D A schematic diagram of a setting page related to a light effect control function provided in an embodiment of the present application;

[0046] Figure 5 A flow chart of a display device 200 provided in an embodiment of the present application controlling a lighting effect based on an audio signal;

[0047] Figure 6 A timing diagram of the display device 200 provided in an embodiment of the present application controlling the lighting effect based on an audio signal;

[0048] Figure 7 A flow chart of the display device 200 provided in an embodiment of the present application calculating the energy value corresponding to the effective signal in each preset frequency band;

[0049] Figure 8 A flow chart of generating control instructions for the display device 200 provided in an embodiment of the present application;

[0050] Fig. 9 Another flow chart of generating control instructions for the display device 200 provided in an embodiment of the present application;

[0051] Fig.10 Another flow chart of generating control instructions for the display device 200 provided in the embodiment of the present application;

[0052] Fig.11 Another timing diagram of the display device 200 provided in the embodiment of the present application controlling the lighting effect based on the audio signal;

[0053] Fig.12 A flow chart of the display device 200 sending a control instruction to the light emitting device 500 provided in an embodiment of the present application;

[0054] Fig.13 A schematic diagram of the display effect of the light-emitting device provided in an embodiment of the present application;

[0055] Fig.14 Another flow chart of the display device 200 controlling the lighting effect based on the audio signal provided in the embodiment of the present application;

[0056] Fig.15 A schematic diagram of a parameter setting page for a first parameter provided in an embodiment of the present application;

[0057] Fig.16 A schematic diagram of a settings page provided in an embodiment of the present application;

[0058] Fig.17 Another timing diagram of the display device 200 provided in the embodiment of the present application controlling the lighting effect based on the audio signal;

[0059] Fig.18 This is another timing diagram of the display device 200 provided in the embodiment of the present application controlling the lighting effect based on the audio signal. DETAILED DESCRIPTION

[0060] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0061] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0062] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0063] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0064] In the embodiments of the present application, the display device generally refers to a device with image display and data processing capabilities. For example, the display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0065] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, voice, mobile terminal 300 and control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0066] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0067] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0068] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0069] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, and a power supply.

[0070] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. The communication device 220 may enable the display device 200 to communicate with an external device or server 400 by wireless or wired connection.

[0071] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0072] In some embodiments, the device interface 240 is used to access an external device.

[0073] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory.

[0074] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0075] In some embodiments, the display 260 is used to receive and display image signals outputted from the controller 250. The display 260 may include a display function component for presenting images, and a driving component for driving image display.

[0076] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface 280 may receive the user command through the GUI.

[0077] In some embodiments, the audio output device 270 may be a local speaker of the display device 200 , or may be an external audio output device of the display device 200 .

[0078] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0079] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0080] The operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200 .

[0081] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system can be divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system runtime layer and the kernel layer.

[0082] In some embodiments, the application layer is used to provide services and interfaces for the application so that the display device 200 can run the application and interact with the user based on the application. For example, the application layer may include a voice assistant, which provides a voice interaction function, and the user can interact with the display device through the voice assistant in a voice manner.

[0083] The framework layer can provide application programming interfaces (API) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which determines the actions of applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0084] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0085] In some embodiments, the kernel layer is a functional level between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management.

[0086] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0087] The display device 200 can be connected to a light emitting device, combined with Figure 1 , the display device 200 can be communicatively connected with at least one light emitting device 500 through a communication device.

[0088] In some embodiments, the communication device may be a communication device 220, and the display device 200 may be connected to the light-emitting device 500 through the communication device 220. For example, the display device 200 may establish a WiFi connection with the light-emitting device 500 through a WiFi module. Alternatively, the display device 200 may establish a Bluetooth connection with the light-emitting device 500 through a Bluetooth module.

[0089] In one example, the display device 200 can configure the light-emitting device 500 based on an Internet of Things protocol (such as the matter protocol) through a WiFi module and / or a Bluetooth module to add the light-emitting device 500 to the control range of the display device 200. The display device 200 will serve as the master control device and the light-emitting device 500 will serve as the controlled device. The display device 200 has control authority over the light-emitting device 500.

[0090] In some embodiments, the communication device may be a device interface 240, and the display device 200 may be communicatively connected to the light emitting device 500 via the device interface 240. For example, the display device 200 may be connected to the light emitting device 500 via a USB interface.

[0091] After the display device 200 is connected to the light-emitting device 500 through communication, the display device 200 can send control instructions, control messages, etc. to the light-emitting device 500 through the communication connection, so as to control the light-emitting device 500 through these control instructions and control messages. For example, the working state of the light-emitting device 500 (such as turning on and off) and the light characteristics of the light-emitting device 500 can be controlled.

[0092] In some embodiments, the light-emitting device 500 may include various types of lamps (such as lamp posts, light strips, etc.), and the light-emitting device 500 may also include equipment with a light-emitting function (such as a speaker with a light-emitting function, etc.).

[0093] In some embodiments, the light characteristics may include light color, light brightness, light emission height (for light emitting devices 500 that support emission in a partial height range from bottom to top, such as lamp posts), etc.

[0094] The adjustable light feature refers to the light feature that the light emitting device 500 supports using different parameters. For example, if the adjustable light feature is light color, it means that the light emitting device 500 supports displaying at least two light colors. For another example, if the adjustable light feature is light height, it means that the light emitting device 500 supports displaying at least two light heights.

[0095] In some embodiments, lighting device 500 supports at least one adjustable lighting feature.

[0096] For example, the lighting device 500 may support adjustable light color. For another example, the lighting device 500 may support adjustable light color and light height.

[0097] After the display device 200 is in communication connection with the light-emitting device 500, it can obtain the adjustable light features supported by the light-emitting device 500. For example, the light-emitting device 500 actively sends a message to the display device 200, and the message includes the adjustable light features. For another example, the display device 200 can send a request to the light-emitting device 500 to request the adjustable light features of the light-emitting device 500. After the display device 200 obtains the adjustable light features supported by the light-emitting device 500, it can store the adjustable light features supported by the light-emitting device 500 in the memory.

[0098] In some embodiments, after the display device 200 is communicatively connected with the light-emitting devices 500 , it can obtain the communication address of each light-emitting device 500 and store the communication address of the light-emitting device 500 in the memory.

[0099] The frequency range of the audio signal can be 0 to 15000 Hz, and the frequency range can be divided into multiple frequency bands (ie, preset frequency bands in the embodiment of the present application), the preset frequency bands do not overlap, and the preset frequency bands can constitute a complete frequency range.

[0100] In an example, the frequency range can be divided into 15 preset frequency bands, including the first band 0-46 Hz, the second band 46-93 Hz, the third band 93-187 Hz, the fourth band 187-234 Hz, the fifth band 234-375 Hz, the sixth band 375-562 Hz, the seventh band 562-750 Hz, the eighth band 750-1171 Hz, the ninth band 1171-1500 Hz, the tenth band 1500-2343 Hz, the eleventh band 2343-3000 Hz, the twelfth band 3000-4687 Hz, the thirteenth band 4687-6000 Hz, the fourteenth band 6000-12000 Hz, and the fifteenth band 12000-15000 Hz.

[0101] In this way, the audio signal can be divided into different preset frequency bands to obtain the audio characteristics of the audio signal in each preset frequency band.

[0102] In some embodiments, the display device 200 can configure a corresponding preset frequency band for the light-emitting device 500. That is, the display device 200 establishes a binding relationship between the light-emitting device 500 and the preset frequency band. It can also be said that the light-emitting device 500 is used to display the audio characteristics of the audio signal in the preset frequency band to which it is bound. Based on the binding relationship, the display device 200 can quickly and accurately determine the light-emitting device 500 corresponding to the preset frequency band, and control the light-emitting device 500 to display the audio characteristics of the audio signal in the preset frequency band.

[0103] In some embodiments, the display device 200 configures different preset frequency bands for different light-emitting devices 500 , wherein the display device 200 can configure at least one preset frequency band for the same light-emitting device 500 , and the at least one preset frequency band is a continuous frequency band.

[0104] In some embodiments, after configuring the corresponding preset frequency band for the light-emitting device 500, the display device 200 stores the binding relationship between the light-emitting device 500 and the preset frequency band in the memory. For example, the device identification of the light-emitting device 500 and the preset frequency band with the binding relationship are stored in the form of a key-value pair. The device identification of the light-emitting device 500 can be a device name, number, etc.

[0105] In some embodiments, the display device 200 may be configured with a light effect control function. The display device 200 may be configured with a switch for the light effect control function.

[0106] In some embodiments, the display device 200 may configure the switch of the light effect control function in a system menu, such as a main menu. For example, the display device 200 may display a main menu in response to an instruction input by a user based on a setting key on the control device 100, and the main menu includes the switch of the light effect control function. The display device 200 may turn on the light effect control function in response to the user turning on the switch of the light effect control function in the main menu.

[0107] In some embodiments, the display device 200 can configure the switch of the light effect control function in the shortcut menu. For example, in response to the instruction input by the user based on the designated key, the display device 200 displays the shortcut menu on the designated page when recognizing that the current page is a designated page, and the shortcut menu may include the switch of the light effect control function.

[0108] The designated buttons may include menu keys, direction keys, light keys, etc. The designated pages may include home pages, application pages of designated applications (such as media playback applications, karaoke applications, communication applications, conference applications, live broadcast applications, etc.), etc.

[0109] In one example, the display device 200 can respond to the user's instruction input based on the menu key, and when it is recognized that the application page is currently in the karaoke application, that is, in the scenario of the user singing karaoke, display a shortcut menu on the application page, and the shortcut menu includes a switch for the light effect control function. In this way, the user can quickly call up the switch for the light effect control function and turn on the light effect control function without exiting the karaoke application in the scenario of singing karaoke.

[0110] In another example, the display device 200 can respond to the user's instruction input based on the direction key, and when it is recognized that the application page of the media player application is currently in place, that is, in the scenario where the user is watching / listening to the media, display a shortcut menu on the application page, and the shortcut menu includes a switch for the light effect control function. In this way, the user can quickly call up the switch for the light effect control function and turn on the light effect control function without exiting the media player application in the scenario of watching / listening to the media.

[0111] In some embodiments, the display device 200 may also be configured with an entrance to the light effect control function, which may be configured in the main menu and / or shortcut menu, or the entrance may be configured as a designated key on the control device 100, such as a light key. The display device 200 displays a setting page for the light effect control function in response to the user selecting the instruction of the entrance. The setting page for the light effect control function may include a switch for the light effect control function, and may also include other setting items, which are used to set parameters related to the light effect control function.

[0112] Figure 4A-4DA schematic diagram of a setting page related to the light effect control function provided in an embodiment of the present application.

[0113] like Figure 4A As shown, the display device 200 displays a setting page of the light effect control function, such as My Station, in response to the user selecting the entry of the light effect control function. The setting page may include a color play setting item, a music flow setting item, a device management setting item, and a setting option (Set Up). Based on the setting page, the user can enter the corresponding parameter setting page by selecting a setting item.

[0114] In response to the user's instruction to select the color playback setting item, the display device 200 displays the following Figure 4B The parameter setting page shown in FIG. The parameter setting page includes setting items for setting the light color, such as color selection settings options, color smoothing options, and rate adjustment options.

[0115] The color selection setting option is used to set the screen effect of the light emitting device 500 displaying colors, and the color selection setting option may include a full screen setting item and a not full screen setting item.

[0116] The color smoothing option is used to set the degree of smoothness between the colors displayed by the lighting device 500. The color smoothing option may include an Enable Smooth setting item and a Disable Smooth setting item.

[0117] The rate adjustment option is used to set the rate at which the light emitting device 500 changes color, and the rate adjustment option may include a gentle setting item, a standard setting item, and an agile setting item.

[0118] The display device 200 displays the following information in response to the user selecting the music stream setting item: Figure 4C The parameter setting page shown in FIG. The parameter setting page includes setting items for setting the music rhythm and light color, such as a rhythm mode option, a rhythm speed option, and a rhythm color option.

[0119] Among them, the rhythm mode option is used to set the mode used to display the audio signal, and the rhythm mode option may include a breath setting item, a blossom setting item, a spectrum setting item, and an aggregate setting item.

[0120] The rhythm speed option is used to set the rhythm speed of playing the audio signal. The rhythm speed option may include a gentle setting item, a standard setting item, and an agile setting item.

[0121] The rhythm color option is used to set the light color of the lighting device 500 used under different music rhythms. The rhythm color option may include setting items for light colors corresponding to Popular, setting items for light colors corresponding to Volcanic cave, setting items for light colors corresponding to Peaceful, setting items for light colors corresponding to Tropical island, setting items for light colors corresponding to Electronic, and setting items for light colors corresponding to Cheerful.

[0122] The display device 200 responds to the user's instruction to select a setting item, sets the corresponding parameters, and adds a selection mark (such as Figure 4B There are non-full screen settings, disabled smoothing settings, and standard settings, such as Figure 4C The medium spectrum setting items, standard setting items and popular corresponding light color setting items are marked with a check mark).

[0123] The display device 200 responds to the user's instruction to select the device management setting item, and displays the following Figure 4D The parameter setting page shown in FIG. The parameter setting page includes setting items of the light-emitting device 500 connected in communication, and the setting items of the light-emitting device 500 are used to set the main light-emitting device. Figure 4D As shown, in response to the user selecting the setting item of the light emitting device 500 with the device identification of Right, the display device 200 sets the light emitting device 500 as the master light emitting device. The other unselected light emitting devices 500 are slave light emitting devices.

[0124] In some embodiments, the display device 200 may be configured such that the light effect control function is in a default off state after power-on. If the user needs to use the light effect control function, the user may turn on the switch of the light effect control function, and the display device 200 will respond to the on-operation and turn on the light effect control function. The user may control the display device 200 to turn on the light effect control function at any node, including but not limited to after power-on, before entering a specified application, after entering a specified application, etc.

[0125] In some embodiments, the display device 200 may be configured to automatically enable the light effect control function after being powered on.

[0126] In other embodiments, the display device 200 may be configured to automatically turn on the light effect control function when specified conditions are met. The specified conditions may include the display device 200 entering a specified application, accessing a specified device, turning on a specified function / mode, etc., or any combination thereof. The specified application may include a media playback application, a karaoke application, a communication application, a conference application, a live broadcast application, and other applications that generate audio signals. The specified device may include a microphone, a music player, a speaker, etc. The specified function / mode may include an audio acquisition function, a speaker mode, etc.

[0127] When the light effect control function is turned on, the display device 200 can generate a control instruction to change the light characteristics based on the acquired audio signal, and the light emitting device 500 changes the light characteristics in response to the control instruction, thereby changing the overall light effect. Thus, the display device 200 can display the change of the audio signal by changing the light effect of the light emitting device 500.

[0128] In some embodiments, the display device 200 is configured to support the acquisition of two types of audio signals, including a first audio signal played by the system and a second audio signal input externally. In other words, the display device 200 supports capturing audio signals corresponding to audio data played by the local device, and also supports the acquisition of audio signals corresponding to audio data input externally.

[0129] The first audio signal played by the system may include an audio signal provided by an application installed on the machine. The display device 200 may collect an external input audio signal through a sound collector, which may be a microphone configured by the display device 200 itself or a microphone connected to the display device 200 through the device interface 240.

[0130] Combination Figure 3 The display device 200 may be configured with an audio acquisition module at the system runtime layer, and the audio acquisition module is used to acquire audio signals.

[0131] In some embodiments, the audio acquisition module may route and capture the audio signal played by the system through the AudioPlaybackCapture class.

[0132] In some embodiments, the audio acquisition module can capture external input audio signals through the AudioRecord class.

[0133] In some embodiments, audio signals corresponding to the same audio may be referred to as a group of audio signals.

[0134] For example, if the audio signal is a first audio signal played by the system, the audio signals played by the same application are a group of audio signals.

[0135] For example, if the audio signal is a second audio signal input externally, the audio signals collected by the same sound collector are a group of audio signals.

[0136] In other embodiments, after obtaining the audio signal of the same audio, the audio signals of each audio can be processed according to a preset audio processing strategy, and the processed audio signals can include at least one group of audio signals. The preset audio processing strategy is configured for the display device 200 to reduce or avoid interference problems that occur when multiple groups of audio signals are played simultaneously. The preset audio processing strategy can be mixing audio signals of multiple audios, audio signals of some audios in the audio signals of multiple audios, or selecting at least one audio signal from the audio signals of multiple audios. The preset audio processing strategy can be executed between each first audio signal; the preset audio processing strategy can be executed between each second audio signal; and the preset audio processing strategy can be executed between each first audio signal and the second audio signal.

[0137] In combination with the following exemplary scenarios, the audio signals acquired by the display device 200 are described by taking the audio signals corresponding to the same audio as a group of audio signals as an example.

[0138] In the first exemplary scenario, such as a scenario of playing a media asset, the display device 200 may obtain a group of audio signals corresponding to the audio played by the media asset playing application.

[0139] In the second exemplary scenario, such as a scenario of playing multiple media assets, the display device 200 may obtain multiple groups of audio signals corresponding to multiple audios played by multiple media asset applications.

[0140] In the third exemplary scenario, such as a scenario where a user speaks, the display device 200 can collect a group of audio signals corresponding to the voice input by the user through a microphone.

[0141] In the fourth exemplary scenario, such as a scenario where a user plays music through other devices and sings through a microphone, the display device 200 can collect a set of audio signals corresponding to the music played in the external environment through the microphone configured by itself, and collect a set of audio signals corresponding to the voice input by the user through the external microphone.

[0142] In the fifth exemplary scenario, such as a scenario where a user plays accompaniment through a karaoke application and sings through a microphone, the display device 200 can obtain a set of audio signals corresponding to the audio played by the karaoke application; the display device 200 can collect a set of audio signals corresponding to the voice input by the user through an external microphone.

[0143] In the sixth exemplary scenario, such as a scenario where a user plays an accompaniment through a karaoke application, plays another accompaniment through other devices, and sings through a microphone. The display device 200 can obtain a set of audio signals corresponding to the audio played by the karaoke application; the display device 200 can also collect a set of audio signals corresponding to the music played in the external environment through the microphone configured by itself, and collect a set of audio signals corresponding to the voice input by the user through an external microphone.

[0144] In this way, the display device 200 can support the acquisition of audio signals in richer scenarios while supporting the acquisition of different types of audio signals, and control the light-emitting device 500 to display the lighting characteristics of the audio signals acquired in each scenario.

[0145] The light-emitting device 500 can only display the light characteristics corresponding to one set of audio signals at each moment. When the display device 200 simultaneously acquires multiple sets of audio signals (such as the audio signals acquired in the second, fourth to sixth exemplary scenarios mentioned above), there is a conflict when the display device 200 controls the light-emitting device 500 to display the light characteristics of the multiple sets of audio signals. For example, the display device 200 can generate a control instruction corresponding to each of the multiple sets of audio signals, but the light-emitting device 500 cannot respond to the multiple control instructions at the same time, resulting in the inability to change the light characteristics normally. Alternatively, the display device 200 can generate a control instruction, and the control instruction includes the control parameters corresponding to each of the multiple sets of audio signals, but the light-emitting device 500 cannot change the light characteristics according to the multiple control parameters at the same time. In other words, if the display device 200 acquires multiple sets of audio signals at the same time, since the light characteristics corresponding to the multiple sets of audio signals conflict in display, the display device 200 cannot display the light characteristics corresponding to the multiple sets of audio signals through the light-emitting device 500.

[0146] The display device 200 provided in the present application is configured to process the acquired multiple groups of audio signals to resolve conflicts existing when displaying the lighting characteristics of the multiple groups of audio signals, thereby ensuring that the lighting characteristics corresponding to the audio signals can be displayed normally through the light-emitting device 500.

[0147] The process of the display device 200 controlling the light emitting device 500 to display the light characteristics corresponding to the audio signal is described in conjunction with the following embodiments.

[0148] Example 1

[0149] Figure 5 The flowchart of the display device 200 provided in the embodiment of the present application controlling the lighting effect based on the audio signal, the specific steps are as follows:

[0150] Step S501: if multiple groups of audio signals are obtained, the multiple groups of audio signals are mixed to obtain a group of effective signals for controlling light effects.

[0151] When the light effect control function is turned on, the display device 200 controls the light characteristics of the light emitting device 500 based on the acquired audio signal. Among them, a group of audio signals used to control the light characteristics of the light emitting device 500 is a valid signal.

[0152] In some embodiments, if the display device 200 obtains a group of audio signals, such as a group of first audio signals or a group of second audio signals, the display device 200 may directly use the group of audio signals as valid signals.

[0153] In some embodiments, the display device 200 can determine whether the audio signal played by the system is acquired according to the state of the audio stream.

[0154] In one example, the display device 200 may use the MediaController class to provide an interface for interacting with a session of a specified application, which may be used to query information of the currently playing media, control playback, etc. If the query finds that the currently playing media is being played, the audio signal played by the system is obtained.

[0155] In another example, the display device 200 is configured to query the status of each audio stream in the audio HAL layer. For example, the interface function of the audio HAL layer can be extended so that the interface can query the status of a specified audio stream in a specified header file. The status of the audio stream may include turning on and off the audio device, volume control, audio stream management, etc. If the display device 200 finds that the status of the audio stream is that the audio device is turned on, the volume is greater than 0, etc., the audio signal played by the system is obtained.

[0156] In other embodiments, the display device 200 may determine whether an external input audio signal is obtained according to whether there is sound input from the microphone.

[0157] In one example, the display device 200 can obtain whether there is an available microphone. For example, the display device 200 can monitor whether a microphone has been inserted. If it is monitored that there is an inserted microphone, it means that there is an available microphone. If there is currently an available microphone in the display device 200, the display device 200 determines whether the microphone is muted. For example, the audio manager (AudioManager) class can be used to manage and query the status of the audio device (including the microphone), such as muted or unmuted. When the microphone of the display device 200 is in an unmuted state, the audio recording (AudioRecord) class can be used to record. If the volume value of the audio signal obtained by the recording is greater than a threshold value, it means that the microphone has sound input, that is, the external input audio signal is obtained.

[0158] In some embodiments, if the display device 200 obtains multiple groups of audio signals, such as multiple groups of first audio signals, multiple groups of second audio signals, or a combination of at least one group of first audio signals and at least one group of second audio signals. The display device 200 automatically performs mixing processing on the multiple groups of audio signals to obtain a group of mixed audio signals, and uses the group of audio signals as valid signals. In this way, when the display device 200 obtains multiple groups of audio signals, it can obtain a group of valid signals by mixing the multiple groups of audio signals to resolve the conflict caused by the lighting characteristics of the multiple groups of audio signals. Moreover, the valid signals obtained by mixing can effectively reflect the audio characteristics of the multiple groups of audio signals. Therefore, the lighting characteristics displayed by the light-emitting device 500 can be controlled based on the valid signals obtained by mixing, which can reflect the audio characteristics of the multiple groups of audio signals.

[0159] Combination Figure 6 The timing diagram of the display device 200 controlling the lighting effect based on the audio signal. The display device 200 is connected to the light-emitting device 1 to the light-emitting device N through the communication device, where N is a positive integer greater than or equal to 1. The light-emitting device 1 to the light-emitting device N can refer to the light-emitting device 500, which is not described here. Each light-emitting device is bound to a preset frequency band, for example, the light-emitting device 1 to the light-emitting device N are respectively bound to the preset frequency band 1 to the preset frequency band n.

[0160] Taking the example of a user controlling the display device 200 to turn on the light effect control function, the display device 200 responds to the user's operation of turning on the switch of the light effect control function on the user interface through the application layer, and turns on the light effect control function.

[0161] The display device 200 can obtain audio signals through the audio acquisition module. If the audio acquisition module obtains a group of audio signals, the group of audio signals is used as a valid signal and the valid signal is stored in a corresponding audio buffer; if the audio acquisition module obtains multiple groups of audio signals, the multiple groups of audio signals are mixed to obtain a group of valid signals, and the valid signals are stored in a corresponding audio buffer.

[0162] Step S502: Calculate the energy value of the effective signal corresponding to each preset frequency band.

[0163] The unit of the energy value is dB, which is used to reflect the strength or energy of the audio signal. The energy value is a value less than or equal to 0 dB, and the closer the energy value is to 0 dB, the higher the strength or energy of the audio signal.

[0164] Figure 7 The flowchart of the display device 200 provided in the embodiment of the present application for calculating the energy value corresponding to the effective signal in each preset frequency band is as follows:

[0165] Step S701: taking the first time length as a time unit, converting each valid signal of the first time length into corresponding frequency domain data in sequence.

[0166] The audio signal is a group of signals that are continuous in the time dimension, that is, an audio stream. In some embodiments, the first time length can be used as a time unit, and each valid signal of the first time length can be converted into corresponding frequency domain data in sequence.

[0167] For example, if the first time length is 10ms, after obtaining the valid signal, the valid signal corresponding to 0-10ms, the valid signal corresponding to 10-20ms, the valid signal corresponding to 20-30ms, etc. are converted into corresponding frequency domain data in sequence.

[0168] In this way, a longer group of valid signals can be split into valid signals of shorter duration (first duration), thereby reducing the amount of data involved in calculating the energy value each time.

[0169] Furthermore, the energy values ​​corresponding to the preset frequency bands to be calculated are used to control and update the light characteristics displayed by the light-emitting device 500. Therefore, after a longer set of valid signals are split into valid signals with shorter time lengths, the energy values ​​are calculated based on the valid signals with shorter time lengths, which is equivalent to obtaining a set of energy values ​​at each first time interval. It can be seen that the shorter the first time length, the shorter the time interval for obtaining a set of energy values. Based on this, sufficient data basis can be provided for the display device 200 to control the light-emitting device 500 to update the light characteristics with higher update efficiency.

[0170] Of course, it is understandable that the first duration needs to be greater than or equal to a certain duration threshold, that is, the first duration should not be too short, to ensure that there is enough data to calculate the energy value, thereby ensuring the accuracy of the calculation result and controlling the number of groups of calculated energy values ​​within a reasonable range.

[0171] In some embodiments, a preset time-domain-frequency domain conversion algorithm may be used to convert the effective signal from time-domain data to frequency-domain data. In one example, a Fast Fourier Transform (FFT) algorithm may be used to convert the effective signal to frequency-domain data.

[0172] Combination Figure 3 The display device 200 may configure a spectrum analysis module at the system runtime layer, and the spectrum analysis module is used to analyze the audio signal, for example, to calculate the energy value of the audio signal in a preset frequency band.

[0173] Combination Figure 3 The display device 200 can configure a thread management module at the kernel layer, and the thread management module is used to schedule and run threads such as audio signal acquisition, storage, and reading.

[0174] Combination Figure 6 The display device 200 can manage the thread of the spectrum analysis module reading the valid signal through the thread management module, so that the spectrum analysis module reads the valid signal from the audio buffer with the first time length as the time unit, and the spectrum analysis module converts each valid signal of the first time length into corresponding frequency domain data.

[0175] Step S702: Obtain frequency domain data corresponding to each preset frequency band.

[0176] The frequency domain data after the audio signal conversion corresponds to a complete frequency range, and the frequency domain data corresponding to each preset frequency band can be obtained by taking the start frequency and the end frequency corresponding to the preset frequency band as indexes.

[0177] The frequency domain data corresponding to each preset frequency band includes information used to calculate the energy value, such as amplitude information of the audio signal at each frequency component.

[0178] Step S703: Calculate the energy value of the effective signal corresponding to the preset frequency band according to the frequency domain data corresponding to the preset frequency band.

[0179] In some embodiments, the display device 200 may calculate the energy value according to the following formula:

[0180] energy+=fftData[i×2]*fftData[i×2]+fftData[i×2+1]×fftData[i×2+1]

[0181] Among them, energy represents the energy value of the preset frequency band, fftData represents the frequency domain data corresponding to the preset frequency band, and i represents the frequency point / data point in the preset frequency band.

[0182] Combination Figure 6 The spectrum analysis module calculates the corresponding energy value based on the frequency domain data corresponding to the preset frequency band. The energy value can represent the strength or energy of the effective signal in the corresponding preset frequency band. For example, the energy value corresponding to preset frequency band 1 is -2dB; the energy value corresponding to preset frequency band 2 is -5dB; and the energy value corresponding to preset frequency band n is -8dB.

[0183] Step S503: Generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band.

[0184] The display device 200 can pre-store a mapping relationship between energy values ​​and parameters of light characteristics in a memory, so that a target energy value matching the energy value corresponding to the preset frequency band can be obtained by comparing the energy value corresponding to the preset frequency band with the energy value in the mapping relationship, and then based on the mapping relationship, the target parameters of the light characteristics corresponding to the target energy value can be obtained.

[0185] Based on the above, the display device 200 stores the binding relationship between the light-emitting device 500 and the preset frequency band in the memory, so that based on the preset frequency band and the binding relationship, the target light-emitting device corresponding to the preset frequency band can be obtained. Therefore, with the preset frequency band as the associated parameter, the target parameter can be associated with the target light-emitting device, that is, the target parameter is the parameter to be used when the target light-emitting device displays the light characteristics.

[0186] The display device 200 generates a control instruction according to the target parameter of the light characteristic, where the control instruction includes the target parameter of the light characteristic, and the target parameter is used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device.

[0187] In some embodiments, the control instruction generated by the display device 200 complies with the communication protocol between the display device 200 and the light-emitting device 500, such as the User Datagram Protocol (UDP).

[0188] Figure 8 The flowchart of the display device 200 generating a control instruction provided in the embodiment of the present application has the following specific steps:

[0189] Step S801: acquiring first target parameters of light characteristics in each preset frequency band according to the first relationship and the energy values ​​corresponding to each preset frequency band.

[0190] In some embodiments, the display device 200 may pre-store a first relationship in a memory, where the first relationship refers to a mapping relationship between a parameter of a light feature and an energy value range, wherein the mapping relationship may be represented in the form of an array.

[0191] In one example, taking the light feature as light color, the mapping relationship may include: -3dB to 0dB - red; -6dB to -3dB - orange; -12dB to -6dB - yellow; -∞dB to -12dB - blue or no light.

[0192] In another example, taking the light characteristic as the luminous height as an example, the mapping relationship may include: -3dB~0dB-total height; -6dB~-3dB-two-thirds of the total height; -12dB~-6dB-one-third of the total height; -∞dB~-12dB-0 (that is, no light at all heights).

[0193] Based on the first relationship, the display device 200 can map the energy value of the preset frequency band to the corresponding target energy value range, and further obtain the parameters of the light characteristics corresponding to the target energy value range, that is, the first target parameters.

[0194] Step S802: Generate a control instruction corresponding to each light-emitting device according to the binding relationship between the light-emitting device and the preset frequency band.

[0195] The display device 200 can obtain the light emitting device 500 corresponding to the preset frequency band according to the binding relationship between the light emitting device 500 and the preset frequency band. For example, the display device 200 can obtain the light emitting device 1-light emitting device N corresponding to the preset frequency band 1-preset frequency band n respectively.

[0196] The display device 200 uses the preset frequency band as associated data to obtain the first target parameter corresponding to each light emitting device 500. The display device 200 can generate a control instruction for the corresponding light emitting device 500 according to the first target parameter, and the control instruction includes the first target parameter.

[0197] Combination Figure 3 The display device 200 may be configured with a light control module at the framework layer, and the light control module is used to generate control instructions corresponding to the light-emitting device 500.

[0198] Combination Figure 6, the spectrum analysis module transmits the energy value corresponding to each preset frequency band to the light control module, and the light control module generates the control instructions corresponding to each light-emitting device 500 based on the first relationship and the binding relationship. For example, if the energy value corresponding to the preset frequency band 1 is -2dB, the first target parameters included in the control instruction a1 corresponding to the light-emitting device 1 are red and total height; if the energy value corresponding to the preset frequency band 2 is -5dB, the first target parameters included in the control instruction a2 corresponding to the light-emitting device 2 are orange and two-thirds of the total height; if the energy value corresponding to the preset frequency band n is -8dB, the first target parameters included in the control instruction an corresponding to the light-emitting device 3 are no light and 0.

[0199] The system volume value currently used by the display device 200 will affect the energy value of the audio signal in each preset frequency band. For the same audio signal, the higher the system volume value currently used by the display device 200, the higher the energy value corresponding to the audio signal in the same preset frequency band, and the lower the system volume value currently used by the display device 200, the lower the energy value corresponding to the audio signal in the same preset frequency band.

[0200] This may result in the following: when using different system volume values, the energy values ​​corresponding to the same audio signal in the same preset frequency band are different. Correspondingly, the parameters of the lighting characteristics corresponding to the same audio signal in the same preset frequency band are different. Therefore, the lighting characteristics of the same audio signal displayed by the light-emitting device 500 in the same preset frequency band are also different. Due to the inconsistency in the displayed lighting effects, users may easily be confused.

[0201] Furthermore, after increasing the system volume value, the energy value corresponding to the audio signal in each preset frequency band will increase accordingly, thereby causing the energy value corresponding to each preset frequency band to change from the energy value range to which it originally belongs to to an energy value range corresponding to a higher energy value, resulting in the number of energy value ranges to which the energy values ​​corresponding to each preset frequency band belong becoming fewer and more concentrated in the energy value range with a higher energy value, that is, the range of variation of the parameters of the lighting characteristics becomes narrower.

[0202] Furthermore, if the system volume value is higher than a certain threshold (that is, the system volume value is too high), the variation range of the energy value corresponding to the same preset frequency band of the audio signal may belong to the energy value range with the same higher energy value, that is, the parameters of the lighting characteristics corresponding to the preset frequency band do not change, resulting in no change in the lighting characteristics of the corresponding light-emitting device 500; and, the energy values ​​corresponding to the audio signal in each preset frequency band (or most of the preset frequency bands) may all belong to the energy value range with the same higher energy value, that is, the parameters of the lighting characteristics corresponding to each preset frequency band are the same, resulting in the lighting characteristics of each light-emitting device 500 being the same.

[0203] Alternatively, after lowering the system volume value, the energy value corresponding to the audio signal in each preset frequency band will be reduced accordingly, thereby causing the energy value corresponding to each preset frequency band to change from the energy value range to which it originally belongs to to an energy value range corresponding to a lower energy value, resulting in the number of energy value ranges to which the energy values ​​corresponding to each preset frequency band belong becoming fewer and more concentrated in the energy value range with a lower energy value, that is, the range of variation of the parameters of the lighting characteristics becomes narrower.

[0204] Furthermore, if the system volume value is lower than a certain threshold (that is, the system volume value is too low), the variation range of the energy value corresponding to the same preset frequency band of the audio signal may belong to the same energy value range with a lower energy value, that is, the parameters of the lighting characteristics corresponding to the preset frequency band do not change, resulting in no change in the lighting characteristics of the corresponding light-emitting device 500; and, the energy values ​​corresponding to the audio signal in each preset frequency band (or most of the preset frequency bands) may all belong to the same energy value range with a lower energy value, that is, the parameters of the lighting characteristics corresponding to each preset frequency band are the same, resulting in the lighting characteristics of each light-emitting device 500 being the same.

[0205] In order to optimize the display effect of the light-emitting device 500, the embodiment of the present application introduces a relative energy value based on the energy value. The relative energy value is a relative value of the energy value corresponding to each preset frequency band. The relative energy value takes into account the influence of the current system volume value on the energy value. By representing the corresponding energy value with the relative energy value, the influence of the system volume value can be effectively reduced, making the result more stable and objective.

[0206] In some embodiments, the display device 200 can control the light emitting device 500 to display light characteristics based on the relative energy value corresponding to the preset frequency band.

[0207] Fig. 9 Another flow chart of generating a control instruction for the display device 200 provided in an embodiment of the present application, the specific steps are as follows:

[0208] Step S901: obtaining a system volume range, wherein the minimum value of the system volume range is the minimum system volume value, and the maximum value of the system volume range is the current system volume value.

[0209] Based on step S703, after calculating the energy value corresponding to each preset frequency band, the display device 200 can obtain the current system volume value and the minimum system volume value by reading the system parameters. The minimum system volume value and the current system volume value form the current system volume range.

[0210] For example, if the current system volume value is 20, the minimum system volume value is 0, and the system volume range is 0-20.

[0211] Step S902: according to the system volume range, an energy value range is set, wherein the minimum value of the energy value range is the energy value corresponding to the minimum system volume value, and the maximum value of the energy value range is the energy value corresponding to the current system volume value.

[0212] In some embodiments, the energy value corresponding to the minimum system volume value and the energy value corresponding to the current system volume value may be empirical values. For example, the empirical value may be obtained by statistically analyzing historical energy values ​​corresponding to the same system volume value and the same preset frequency band of the audio signal acquired in history.

[0213] Step S903: converting the energy value corresponding to the preset frequency band into a relative energy value according to the system volume range, the energy value range and the energy conversion relationship.

[0214] In some embodiments, the energy conversion relationship may be a proportional relationship. For example, the display device 200 may calculate the relative energy value according to the following formula:

[0215] Relative energy value = (dbValue-minDb) / (maxDb-minDb).

[0216] Among them, dbValue represents the energy value of the preset frequency band under the current system volume value, minDb represents the minimum value of the energy value range, and maxDb represents the maximum value of the energy value range.

[0217] The energy conversion relationship is used to convert the energy value to a preset relative energy value range. In one example, if the energy value corresponding to the preset frequency band is less than or equal to the maximum value of the set energy value range, the relative energy value range is 0-1.

[0218] By converting the energy value into a relative energy value and performing proportional calculation, the numerical change of the energy value caused by the system volume value can be reduced, so that the relative energy value corresponding to the same audio signal in the same preset frequency band can be more stable, and the parameters of the lighting characteristics obtained based on the relative energy value are also more stable and unified.

[0219] And, the energy value is converted into a relative energy value. After proportional calculation, the relative energy value of each preset frequency band can reflect the relationship between the energy value of the preset frequency band and the current variable energy value range. Since the relative energy value is less affected by the current system volume value, the relative energy value will not be affected by the system volume value and concentrated in a part of the energy value range, but can be dispersed in the relative energy value range, so that it can correspond to richer parameters of lighting characteristics, that is, the range of variation of the parameters of lighting characteristics is larger.

[0220] Furthermore, even when the system volume value is too high or too low, the energy value can be converted into a relative energy value so that the relative energy values ​​corresponding to different energy values ​​can belong to more energy value ranges, thereby corresponding to different parameters of the lighting characteristics, so that the light-emitting device 500 can display different lighting characteristics.

[0221] Step S904: Generate a control instruction corresponding to the light-emitting device according to the relative energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band.

[0222] Fig.10 Another flow chart of the display device 200 generating a control instruction provided in an embodiment of the present application, the specific steps are as follows:

[0223] Step S1001: acquiring a second target parameter of the light feature in each preset frequency band according to the second relationship and the relative energy value corresponding to each preset frequency band.

[0224] In some embodiments, the display device 200 may pre-store a second relationship in a memory, where the second relationship refers to a mapping relationship between a parameter of a light feature and a relative energy value, wherein the mapping relationship may be represented in the form of an array.

[0225] In one example, taking the light feature as light color as an example, the mapping relationship may include: 0.7~1-red; 0.5~0.7-orange; 0.2~0.5-yellow; 0~0.2-blue or no light.

[0226] In another example, taking the light characteristic as the luminous height as an example, the mapping relationship may include: 0.7~1-total height; 0.5~0.7-two-thirds of the total height; 0.2~0.5-one-third of the total height; 0~0.2-0 (that is, no light at all).

[0227] Based on the second relationship, the display device 200 can map the relative energy value of the preset frequency band to the corresponding target relative energy value range, and further obtain the parameters of the light characteristics corresponding to the target relative energy value range, that is, the second target parameters.

[0228] Step S1002: Generate a control instruction corresponding to each light-emitting device according to the binding relationship between the light-emitting device and the preset frequency band.

[0229] The control instruction includes the second target parameter of the light characteristic in the corresponding preset frequency band. Step S1002 can refer to step S802, which is not described here.

[0230] Combination Fig.11 Another timing diagram of the display device 200 controlling the lighting effect based on the audio signal is shown in FIG. Figure 6 compared to, Fig.11 The main difference is that after the spectrum analysis module calculates the energy value corresponding to each preset frequency band, it also converts the energy value into a relative energy value, and transmits the relative energy value of each preset frequency band to the lighting control module. The lighting control module generates control instructions corresponding to each light-emitting device 500 based on the second relationship and the binding relationship. For example, if the relative energy value of the preset frequency band 1 is 0.8, the second target parameters included in the control instruction a1 corresponding to the light-emitting device 1 are red and the total height; if the relative energy value of the preset frequency band 2 is 0.65, the second target parameters included in the control instruction a2 corresponding to the light-emitting device 2 are orange and two-thirds of the total height; if the energy value corresponding to the preset frequency band n is 0.43, the second target parameters included in the control instruction an corresponding to the light-emitting device 3 are yellow and one-third of the total height.

[0231] Step S504: Send corresponding control instructions to the light emitting device.

[0232] The display device 200 sends control instructions to the corresponding light-emitting devices 500 respectively, and the control instructions are used to instruct the light-emitting devices 500 to adjust the lighting characteristics according to the target parameters.

[0233] Fig.12 The flowchart of the display device 200 sending a control instruction to the light-emitting device 500 provided in the embodiment of the present application, the specific steps are as follows:

[0234] Step S1201: Read the communication address corresponding to the light-emitting device from the memory.

[0235] From the above process of establishing the communication address between the display device 200 and the light-emitting device 500, it can be known that after the display device 200 establishes a communication connection with the light-emitting device 500, the communication address of the light-emitting device 500 is obtained and stored in the memory. Therefore, when the display device 200 needs to send a control instruction to the light-emitting device 500 to control the light-emitting device 500, the communication address of the light-emitting device 500 can be read from the memory.

[0236] Step S1202: sending a corresponding control instruction to the light-emitting device according to the communication address corresponding to the light-emitting device.

[0237] The display device 200 can accurately send corresponding control instructions to the light-emitting device 500 according to the communication address to ensure the accuracy of controlling the light-emitting device 500.

[0238] Combination Figure 6 and Fig.11, the light control module reads the communication address of each light emitting device from the memory. For example, the communication address of light emitting device 1 is add_1, the communication address of light emitting device 2 is add_2, and the communication address of light emitting device N is add_N. The light control module sends corresponding control instructions to the light emitting devices according to the communication addresses. For example, according to add_1, control instruction a1 is sent to light emitting device 1; according to add_2, control instruction a2 is sent to light emitting device 2; according to add_N, control instruction an is sent to light emitting device N.

[0239] The lighting device 500 responds to the control instruction and displays the corresponding lighting characteristics according to the target parameters carried in the control instruction. Fig.13 The schematic diagram of the display effect of the light-emitting device shown is, taking the above-mentioned light-emitting device 1, light-emitting device 2 and light-emitting device N as examples, light-emitting device 1, light-emitting device 2 and light-emitting device N are all lamp posts, if the control instruction a1 includes red and the total height; the control instruction a2 includes orange and two-thirds of the total height; the control instruction an includes no light and 0, the light-emitting device 1 displays red (shown in a darker grayscale) light and emits light in the full height range; the light-emitting device 2 displays orange (shown in a lighter grayscale) light and emits light in the range of two-thirds of the total height from bottom to top; the light-emitting device N does not emit light (shown as no fill).

[0240] The display device 200 may control the light emitting device 500 to update the light characteristics according to the refresh rate. In particular, the display device 200 may control the light emitting device 500 to update the light characteristics at a time interval of the second duration.

[0241] The second duration is related to the refresh rate supported by the client, the settings of the application, etc. In some embodiments, the second duration may be equal to the first duration; the second duration may also be greater than the first duration.

[0242] In some embodiments, the display device 200 may generate a control instruction at a second time interval, and send the control instruction to the light emitting device 500 after generating the control instruction.

[0243] In some embodiments, the display device 200 may generate a control instruction after acquiring the audio signal, and send the generated control instruction to the light emitting device 500 at a second time interval. The display device 200 may send the most recently generated control instruction among the generated control instructions to the light emitting device 500 to avoid response conflicts in the light emitting device 500.

[0244] In some embodiments, the display device 200 may generate a control instruction after acquiring the audio signal, and after generating the control instruction, send the control instruction to the light emitting device 500. After receiving the control instruction, the light emitting device 500 may respond to the received control instruction at a second time interval. The light emitting device 500 may respond to the most recently received control instruction among the received control instructions to avoid response conflicts of the light emitting device 500.

[0245] Example 2

[0246] In some embodiments, a first parameter may be set by a user, and the first parameter indicates a valid signal for controlling a light effect. The valid signal indicated by the first parameter may include a group of first audio signals, a group of second audio signals, or a group of audio signals obtained by mixing multiple groups of audio signals. In this way, the display device 200 may filter valid signals from the acquired audio signals based on the first parameter set by the user.

[0247] Fig.14 Another flowchart of the display device 200 provided in the embodiment of the present application controlling the lighting effect based on the audio signal, the specific steps are as follows:

[0248] Step S1401: if multiple groups of audio signals are obtained, obtain a first parameter set by the user.

[0249] Step S1402: selecting a group of valid signals from multiple groups of audio signals according to the first parameter.

[0250] The process of the display device 200 acquiring the audio signal may refer to step S501 in Embodiment 1, which will not be described in detail here.

[0251] If the display device 200 obtains multiple groups of audio signals, the display device 200 can obtain the first parameter set by the user, and based on the valid signal indicated by the first parameter, filter out a group of valid signals from the obtained multiple groups of audio signals. In this way, the filtered valid signal better meets the needs of the user, so that the lighting characteristics displayed by the lighting device 500 based on the subsequent valid signal control can reflect the audio signal of interest to the user.

[0252] In some embodiments, the display device 200 may obtain the first parameter preset by the user from the memory.

[0253] The display device 200 can configure the setting items of the first parameter in the setting page of the light effect control function. Figure 4A The setting page of the light effect control function shown includes setting items of the first parameter, such as audio settings.

[0254] In response to an instruction from a user to select a setting item of a first parameter, the display device 200 may display a parameter setting page of the first parameter, where the parameter setting page of the first parameter may include setting items of various types of valid signals.

[0255] In some embodiments, the setting items of the effective signal may include setting items of the first audio signal, setting items of the second audio signal, and setting items of mixing.

[0256] Among them, the setting item of the first audio signal is an entry for indicating that a group of first audio signals is set as a valid signal; the setting item of the second audio signal is an entry for indicating that a group of second audio signals is set as a valid signal; the setting item of the mixing is an entry for indicating that multiple groups of audio signals are mixed to obtain a valid signal.

[0257] You can refer to Fig.15 The parameter setting page of the first parameter shown includes setting items of the first audio signal (such as setting items of the system sound), setting items of the second audio signal (such as setting items of the microphone sound), and setting items of the mixing.

[0258] In response to the user selecting the target setting item in the parameter setting page of the first parameter, the display device 200 can set the parameter corresponding to the target setting item to the first parameter to be used currently, that is, the first parameter preset by the user. The display device 200 can store the first parameter preset by the user in the memory for subsequent reading and use.

[0259] In other embodiments, if the display device 200 obtains multiple groups of audio signals, a setting page may be displayed. For example, the setting page may be displayed in the form of a pop-up window. The setting page is used to set the first parameter. For example, the setting page may include setting items for various types of valid signals. These setting items may refer to the setting items in the parameter setting page of the first parameter, which will not be described in detail here.

[0260] You can refer to Fig.16 As shown in the setting page, if the display device 200 obtains multiple groups of audio signals, the setting page is displayed in the form of a pop-up window 1601, and the setting page includes setting items for system sound, setting items for microphone sound, and setting items for mixing.

[0261] In response to the user's instruction to select a target setting item in the setting page, the display device 200 may set the parameter corresponding to the target setting item as the first parameter to be currently used.

[0262] The process of the display device 200 screening valid signals based on the first parameter is described with reference to the following examples.

[0263] Example 1: If the first parameter indicates that a group of first audio signals is set as a valid signal, when the multiple groups of audio signals include a group of first audio signals, the display device 200 can filter out the group of first audio signals from the multiple groups of audio signals and set them as valid signals; or, when the multiple groups of audio signals include multiple groups of first audio signals, the display device 200 can filter out a group of first audio signals from the multiple groups of first audio signals and set them as valid signals, or, mix the multiple groups of first audio signals and set the mixed audio signals as valid signals. When the multiple groups of audio signals do not include the first audio signal, the display device 200 may not filter the valid signal, that is, not control the light-emitting device 500 to change the lighting characteristics; or, mix the multiple groups of audio signals (second audio signals) and set the mixed audio signals as valid signals, or, filter out a group of audio signals from the multiple groups of audio signals (second audio signals) and set them as valid signals.

[0264] Example 2: If the first parameter indicates that a group of second audio signals is set as a valid signal, when the multiple groups of audio signals include a group of second audio signals, the display device 200 can filter out the group of second audio signals from the multiple groups of audio signals and set them as valid signals; or, when the multiple groups of audio signals include multiple groups of second audio signals, the display device 200 can filter out a group of second audio signals from the multiple groups of second audio signals and set them as valid signals, or, mix the multiple groups of second audio signals and set the mixed audio signals as valid signals. When the multiple groups of audio signals do not include the second audio signals, the display device 200 may not filter the valid signals, that is, not control the light-emitting device 500 to change the lighting characteristics; or, mix the multiple groups of audio signals (first audio signals) and set the mixed audio signals as valid signals, or, filter out a group of audio signals from the multiple groups of audio signals (first audio signals) and set them as valid signals.

[0265] Example 3: If the first parameter indicates that a plurality of audio signals are mixed to obtain a valid signal, the display device 200 may mix the plurality of audio signals and set the mixed audio signal as a valid signal.

[0266] In some embodiments, if the display device 200 obtains a group of audio signals, the group of audio signals is directly used as valid signals for subsequent processing.

[0267] Step S1403: Calculate the energy value of the effective signal corresponding to each preset frequency band.

[0268] Step S1404: Generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band.

[0269] The control instruction includes a target parameter of a light characteristic, and the target parameter is used to characterize an energy value corresponding to a preset frequency band bound to the light-emitting device.

[0270] Step S1405: Send corresponding control instructions to the light-emitting device.

[0271] The control instruction is used to instruct to adjust the lighting characteristics according to the target parameters.

[0272] Steps S1403 to S1405 may refer to steps S502 to S504 in Example 1, and are not described in detail here.

[0273] Combination Fig.17 Another timing diagram of the display device 200 controlling the lighting effect based on the audio signal is shown in FIG. Figure 6 compared to, Fig.17 The main difference is that after the audio acquisition module obtains multiple groups of audio signals, the audio acquisition module obtains the first parameter set by the user, and filters out valid signals from the multiple groups of audio signals based on the first parameter. The audio acquisition module can read the first parameter preset by the user from the memory; or the audio acquisition module can send a pop-up message to the application layer, and the application layer displays the setting page of the first parameter in response to the pop-up message. The application layer responds to the first parameter set by the user based on the setting page and passes the first parameter to the audio acquisition module.

[0274] Combination Fig.18 Another timing diagram of the display device 200 controlling the lighting effect based on the audio signal is shown in FIG. Fig.11 compared to, Fig.18 The main difference is that after the audio acquisition module obtains multiple groups of audio signals, the audio acquisition module obtains the first parameter set by the user, and filters out valid signals from the multiple groups of audio signals based on the first parameter. The process of the audio acquisition module obtaining the first parameter can be referred to Fig.17 The corresponding instructions are not repeated here.

[0275] In some embodiments, a method for controlling lighting effects based on audio signals is also provided, which can be applied to the display device 200 provided in the embodiment of the present application, wherein the display device 200 is in communication connection with at least one light-emitting device 500, wherein each light-emitting device 500 supports at least one adjustable lighting feature, and the at least one light-emitting device 500 is respectively bound to different preset frequency bands. The method includes: when the light effect control function is turned on, if multiple groups of audio signals are obtained, the multiple groups of audio signals are mixed to obtain a group of effective signals for controlling the light effect; the energy value corresponding to each preset frequency band of the effective signal is calculated; according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band, a control instruction corresponding to the light-emitting device is generated, the control instruction includes a target parameter of the lighting feature, and the target parameter is used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; and a corresponding control instruction is sent to the light-emitting device, and the control instruction is used to instruct to adjust the lighting feature according to the target parameter.

[0276] The above technical solution has the following beneficial effects or advantages:

[0277] When the display device 200 supports and turns on the light effect control function, it can control and change the light characteristics of at least one light-emitting device 500 in communication connection based on the acquired audio signal. If the display device 200 collects multiple groups of audio signals, it can automatically mix the multiple groups of audio signals to obtain a group of effective signals for controlling the light effect. Since the light-emitting device 500 has a binding relationship with the preset frequency band, it can generate a control instruction corresponding to each light-emitting device 500 based on the energy value corresponding to the effective signal in each preset frequency band. The control instruction includes a target parameter of the light characteristic, and the target parameter can be used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device 500. After the light-emitting device 500 adjusts the light characteristic according to the target parameter in response to the control instruction, it can display the energy characteristics of the effective signal in the corresponding preset frequency band. In this way, the display device 200 can not only effectively resolve the conflict between multiple groups of audio signals, control the light-emitting device 500 to display the light characteristics that can reflect multiple groups of audio signals, but also display the energy characteristics of the audio signal in each frequency band.

[0278] In other embodiments, a method for controlling lighting effects based on audio signals is also provided, which can be applied to the display device 200 provided in the embodiment of the present application, wherein the display device 200 is in communication connection with at least one light-emitting device 500, wherein each light-emitting device 500 supports at least one adjustable lighting feature, and the at least one light-emitting device 500 is respectively bound to different preset frequency bands. The method includes: when the light effect control function is turned on, if multiple groups of audio signals are obtained, obtaining a first parameter set by the user, the first parameter indicating a valid signal for controlling the light effect; according to the first parameter, selecting a group of valid signals from the multiple groups of audio signals; calculating the energy value corresponding to the valid signal in each preset frequency band; according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device 500 and the preset frequency band, generating a control instruction corresponding to the light-emitting device, the control instruction including the target parameter of the lighting feature, the target parameter being used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device 500; sending a corresponding control instruction to the light-emitting device 500, the control instruction being used to instruct to adjust the lighting feature according to the target parameter.

[0279] The above technical solution has the following beneficial effects or advantages:

[0280] When the display device 200 supports and turns on the light effect control function, it can control and change the light characteristics of at least one light-emitting device 500 in communication connection based on the acquired audio signal. If the display device 200 collects multiple groups of audio signals, it can obtain the first parameter set by the user, and filter out the effective signal for controlling the light effect from the multiple groups of audio signals based on the first parameter. Since the light-emitting device 500 has a binding relationship with the preset frequency band, it can generate a control instruction corresponding to each light-emitting device 500 based on the energy value corresponding to the effective signal in each preset frequency band. The control instruction includes a target parameter of the light characteristic, and the target parameter can be used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device 500. After the light-emitting device 500 adjusts the light characteristic according to the target parameter in response to the control instruction, it can display the energy characteristics of the effective signal in the corresponding preset frequency band. In this way, the display device 200 can control the light-emitting device 500 to display the light characteristics that can reflect the audio signal selected by the user, and can also display the energy characteristics of the audio signal in each frequency band when there is a conflict between multiple groups of audio signals.

[0281] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of this disclosure, so that those skilled in the art can better use the embodiments.

Claims

1. A display device, characterized in that: include: A communication device, configured to: communicate with at least one light-emitting device, wherein each of the light-emitting devices supports at least one adjustable light feature, and the at least one light-emitting device is respectively bound to different preset frequency bands; The controller is configured as: When the light effect control function is turned on, if multiple groups of audio signals are obtained, the multiple groups of audio signals are mixed to obtain a group of effective signals for controlling the light effect; Calculating the energy value of the effective signal corresponding to each of the preset frequency bands; Generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band, wherein the control instruction includes a target parameter of a light characteristic, and the target parameter is used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; The corresponding control instruction is sent to the light-emitting device, where the control instruction is used to instruct the light-emitting device to adjust the light characteristics according to the target parameter.

2. The display device according to claim 1, characterized in that The controller calculates the energy value of the effective signal corresponding to each of the preset frequency bands, and is specifically configured as follows: Taking a first time length as a time unit, sequentially converting each of the valid signals of the first time length into corresponding frequency domain data; Acquire the frequency domain data corresponding to each of the preset frequency bands; According to the frequency domain data corresponding to the preset frequency band, an energy value of the effective signal corresponding to the preset frequency band is calculated.

3. The display device according to claim 2, characterized in that The controller generates a control instruction corresponding to the light emitting device according to the energy value corresponding to each of the preset frequency bands and the binding relationship between the light emitting device and the preset frequency band, and is specifically configured as follows: According to the first relationship and the energy values ​​corresponding to the preset frequency bands, obtaining the first target parameters of the light feature in each of the preset frequency bands, wherein the first relationship refers to a mapping relationship between the parameters of the light feature and the energy value range; According to the binding relationship between the light-emitting device and the preset frequency band, a control instruction corresponding to each of the light-emitting devices is generated, and the control instruction includes the first target parameter of the light feature under the corresponding preset frequency band.

4. The display device according to claim 2, characterized in that After the controller calculates the energy value of the effective signal corresponding to the preset frequency band according to the frequency domain data corresponding to the preset frequency band, the controller is further configured to: Get the system volume range, the minimum value of the system volume range is the minimum system volume value, and the maximum value of the system volume range is the current system volume value; According to the system volume range, an energy value range is set, wherein the minimum value of the energy value range is the energy value corresponding to the minimum system volume value, and the maximum value of the energy value range is the energy value corresponding to the current system volume value; According to the system volume range, the energy value range and the energy conversion relationship, the energy value corresponding to the preset frequency band is converted into a relative energy value, and the energy conversion relationship is used to convert the energy value into a preset relative energy value range; According to the relative energy value corresponding to each of the preset frequency bands and the binding relationship between the light-emitting device and the preset frequency band, a control instruction corresponding to the light-emitting device is generated.

5. The display device according to claim 4, characterized in that The controller generates a control instruction corresponding to the light emitting device according to the relative energy value corresponding to each of the preset frequency bands and the binding relationship between the light emitting device and the preset frequency band, and is specifically configured as follows: According to the second relationship and the relative energy values ​​corresponding to the preset frequency bands, obtaining the second target parameters of the light feature in each of the preset frequency bands, wherein the second relationship refers to a mapping relationship between the parameters of the light feature and the relative energy value range; According to the binding relationship between the light-emitting device and the preset frequency band, a control instruction corresponding to each of the light-emitting devices is generated, and the control instruction includes the second target parameter of the light feature under the corresponding preset frequency band.

6. The display device according to claim 1, characterized in that Also includes: A memory configured to store a communication address corresponding to each of the light-emitting devices; The controller executes sending the corresponding control instruction to the light emitting device, and is specifically configured as follows: Reading a communication address corresponding to the light emitting device from the memory; According to the communication address corresponding to the light-emitting device, the corresponding control instruction is sent to the light-emitting device.

7. A display device, characterized in that: include: A communication device, configured to: communicate with at least one light-emitting device, wherein each of the light-emitting devices supports at least one adjustable light feature, and the at least one light-emitting device is respectively bound to different preset frequency bands; The controller is configured as: When the light effect control function is turned on, if multiple groups of audio signals are obtained, a first parameter set by the user is obtained, where the first parameter indicates a valid signal for controlling the light effect; According to the first parameter, selecting a group of valid signals from the multiple groups of audio signals; Calculating the energy value of the effective signal corresponding to each of the preset frequency bands; Generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band, wherein the control instruction includes a target parameter of a light characteristic, and the target parameter is used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; The corresponding control instruction is sent to the light emitting device, where the control instruction is used to instruct to adjust the light characteristic according to the target parameter.

8. The display device according to claim 7, characterized in that When the light effect control function is turned on, the controller executes, if multiple groups of audio signals are obtained, obtaining the first parameter set by the user, and is specifically configured as follows: Acquire the first parameter preset by the user from the memory; Alternatively, control the display to display the setting page; The first parameter set by the user based on the setting page is obtained.

9. A method for controlling lighting effects based on audio signals, characterized in that: Applied to a display device, the display device is communicatively connected to at least one light emitting device, wherein each of the light emitting devices supports at least one adjustable light feature, and the at least one light emitting device is respectively bound to different preset frequency bands; The method comprises: When the light effect control function is turned on, if multiple groups of audio signals are obtained, the multiple groups of audio signals are mixed to obtain a group of effective signals for controlling the light effect; Calculating the energy value of the effective signal corresponding to each of the preset frequency bands; Generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band, wherein the control instruction includes a target parameter of a light characteristic, and the target parameter is used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; The corresponding control instruction is sent to the light-emitting device, where the control instruction is used to instruct the light-emitting device to adjust the light characteristics according to the target parameter.

10. A method for controlling lighting effects based on audio signals, characterized in that: Applied to a display device, the display device is communicatively connected to at least one light emitting device, wherein each of the light emitting devices supports at least one adjustable light feature, and the at least one light emitting device is respectively bound to different preset frequency bands; The method comprises: When the light effect control function is turned on, if multiple groups of audio signals are obtained, a first parameter set by the user is obtained, where the first parameter indicates a valid signal for controlling the light effect; According to the first parameter, selecting a group of valid signals from the multiple groups of audio signals; Calculating the energy value of the effective signal corresponding to each of the preset frequency bands; Generate a control instruction corresponding to the light-emitting device according to the energy value corresponding to each preset frequency band and the binding relationship between the light-emitting device and the preset frequency band, wherein the control instruction includes a target parameter of a light characteristic, and the target parameter is used to characterize the energy value corresponding to the preset frequency band bound to the light-emitting device; The corresponding control instruction is sent to the light emitting device, where the control instruction is used to instruct to adjust the light characteristic according to the target parameter.

Images