Display device and user sound playing method

Abstract

The embodiment of the invention provides a display device and a user sound playing method. The display device can divide collected user audio data into monaural audio data corresponding to a plurality of sound channels, and performs sound gain processing and noise reduction processing on the monaural audio data. And the display equipment generates multi-channel audio data from the processed audio data, so that the multi-channel audio data is directly played to a user. Therefore, the display equipment can realize the processes of audio acquisition, sound effect processing, volume amplification, audio playing and the like, and the audio effect which can be played by the karaoke system is realized. A user can use the display device to perform a karaoke function.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for playing user sounds. Background Art

[0002] Display devices are intelligent devices that can present user interfaces and support user interaction. Taking smart TV as an example, smart TV is based on Internet application technology, has an open operating system and chip, has an open application platform, can realize two-way human-computer interaction, and integrates multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] With the development of intelligence and the improvement of living standards, more and more consumers may choose to sing karaoke at home. To achieve the karaoke function, the display device can be combined with some professional karaoke equipment to form a system with karaoke function, including broadcast control equipment, sound effect processing equipment, power amplifier equipment, speakers and microphones. Users can connect these devices to form a karaoke system, so as to achieve activities such as karaoke at home.

[0004] However, in order to realize the karaoke function of the display device, the user also needs to purchase these karaoke devices, which greatly increases the user cost. The display device cannot realize the karaoke function independently, which seriously affects the user experience. Summary of the invention

[0005] The present application provides a display device and a user sound playback method to solve the problem in the related art that in order to realize the karaoke function of the display device, the user needs to purchase other karaoke devices, which greatly increases the user cost and the display device cannot independently realize the karaoke function.

[0006] In a first aspect, some embodiments of the present application provide a display device, including a display, a sound collector, an audio output device, and a controller. The sound collector is configured to collect audio data; the audio output device is configured to play audio; and the controller is configured to:

[0007] Acquire user audio data collected by the sound collector;

[0008] Acquire a plurality of mono audio data corresponding to a plurality of channels according to the user audio data;

[0009] Performing sound gain processing on the mono audio data to obtain amplified audio data;

[0010] Performing noise reduction processing on the amplified audio data to obtain noise-reduced audio data;

[0011] Generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data.

[0012] The above technical solution has the following beneficial effects:

[0013] The display device can divide the collected user audio data into mono audio data corresponding to multiple channels, and perform sound gain processing and noise reduction processing on the mono audio data. The display device generates multi-channel audio data from the processed audio data, and then plays the multi-channel audio data directly to the user. Therefore, the display device can realize the processes of audio collection, sound effect processing, volume amplification and audio playback, and realize the audio effects that can be played by the karaoke system. Users can use the display device to perform karaoke functions.

[0014] In some embodiments, the user audio data includes a plurality of audio data arranged alternately according to channels.

[0015] The controller executes acquiring a plurality of mono audio data corresponding to a plurality of channels according to the user audio data, and is specifically configured as follows:

[0016] Get the audio data block frequency;

[0017] Based on the audio data block frequency, the user audio data is processed in blocks to obtain a plurality of multi-channel block audio data; the number of audio data in the multi-channel block audio data is the audio data block frequency, and the multi-channel block audio data is marked with channel information corresponding to the audio data;

[0018] A plurality of multi-channel block audio data are read respectively and audio data in the multi-channel block audio data are extracted according to the channel information to obtain mono audio data corresponding to the plurality of channels.

[0019] The above technical solution has the following beneficial effects: the display device can process multi-channel user audio data in blocks, and simultaneously separate the channels of all audio data in each block of data, thereby improving the audio data processing speed and reducing the delay of audio playback.

[0020] In some embodiments, the controller executes obtaining the audio data block frequency, and is specifically configured to:

[0021] Acquire audio acquisition parameters of a sound collector; the audio acquisition parameters include an audio format;

[0022] Calculating the number of bytes occupied by the audio data according to the audio format;

[0023] The audio data blocking frequency is set according to the byte quantity.

[0024] The above technical solution has the following beneficial effects: the display device sets the amount of data in the block data through the audio format, thereby performing block processing on the multi-channel audio data.

[0025] In some embodiments, the controller performs sound gain processing on the mono audio data, and is specifically configured as follows:

[0026] Get the audio data block frequency;

[0027] Based on the audio data block frequency, the mono audio data is processed in blocks to obtain a plurality of mono block audio data; the number of audio data in the mono block audio data is the audio data block frequency;

[0028] Perform sound gain processing on multiple mono-channel block audio data respectively.

[0029] The above technical solution has the following beneficial effects: the display device can process mono audio data in blocks, so that all audio data in each block data can be gain processed simultaneously, thereby improving the audio data processing speed and reducing the delay of audio playback.

[0030] In some embodiments, the controller performs sound gain processing on a plurality of mono-channel block audio data respectively, and is specifically configured as follows:

[0031] Obtaining an initial amplitude value of audio data in the monophonic block audio data;

[0032] Calculating a gain amplitude value of the audio data based on a preset gain coefficient and the initial amplitude value;

[0033] The initial amplitude value of the audio data is updated to the gain amplitude value.

[0034] The above technical solution has the following beneficial effects: the display device simultaneously amplifies the amplitude of the audio data by the same multiple, thereby achieving volume amplification.

[0035] In some embodiments, the controller performs noise reduction processing on the amplified audio data, and is specifically configured as follows:

[0036] Reading a gain amplitude value of audio data in the monophonic block audio data in the amplified audio data;

[0037] Detecting noise audio data; the gain amplitude value of the noise audio data is less than a preset amplitude threshold;

[0038] Calculating a noise reduction amplitude value according to the gain amplitude value and the noise reduction coefficient of the noise audio data;

[0039] The gain amplitude value of the noise audio data is updated to the noise reduction amplitude value.

[0040] The above technical solution has the following beneficial effects: the display device can simultaneously perform noise reduction processing on all audio data in each block of data, thereby improving the audio data processing speed and reducing the delay of audio playback.

[0041] In some embodiments, after the controller executes the acquisition of the user audio data collected by the sound collector, the controller is further configured to:

[0042] Detecting channel information of the user audio data;

[0043] If the user audio data is multi-channel audio data, performing a step of acquiring mono audio data corresponding to multiple channels according to the user audio data;

[0044] If the user audio data is mono audio data, sound gain processing and noise reduction processing are performed on the user audio data to obtain noise-reduced audio data, and the audio output device is controlled to play the noise-reduced audio data.

[0045] The above technical solution has the following beneficial effects: for the collected mono audio data, there is no need to perform channel synthesis or channel separation, and gain and noise reduction processing can be directly performed to reduce the delay of audio playback.

[0046] In some embodiments, after the controller executes the acquisition of the user audio data collected by the sound collector, the controller is further configured to:

[0047] Detect the status of the preset sound playing switch in the display device;

[0048] If the sound playing switch is in the on state, the voice recognition function of the display device is turned off, and a step of acquiring mono audio data corresponding to multiple channels according to the user audio data is performed;

[0049] If the sound playing switch is in the off state, the voice recognition function of the display device is turned on, and the user instruction is recognized according to the user audio data; based on the detected user instruction, the operation corresponding to the user instruction is executed.

[0050] The above technical solution has the following beneficial effects: the voice recognition function and the sound playback function are set to a mutually exclusive state, ensuring that the voice recognition function does not affect the karaoke function.

[0051] In some embodiments, the controller is further configured to:

[0052] In response to an instruction to start a singing function, controlling the display to display a singing application page, wherein the singing application page includes at least one song control;

[0053] In response to the selection operation of the target song control, detecting the state of a preset sound playing switch in the display device;

[0054] If the sound play switch is in the off state, controlling the display to display a prompt message, wherein the prompt message is used to prompt to turn on the sound play switch;

[0055] If the sound playing switch is in the on state, the song audio data of the target song corresponding to the target song control is obtained; the audio output device is controlled to play the song audio data, and the step of obtaining mono audio data corresponding to multiple channels according to the user audio data is executed.

[0056] The above technical solution has the following beneficial effects: when a user selects a song to indicate karaoke, the user is prompted to turn on the sound playback function to achieve an audio karaoke effect.

[0057] In a second aspect, some embodiments of the present application provide a method for playing user sound, characterized in that it is applied to the above-mentioned display device, and the method includes:

[0058] Get the user audio data collected by the sound collector;

[0059] Acquire a plurality of mono audio data corresponding to a plurality of channels according to the user audio data;

[0060] Performing sound gain processing on the mono audio data to obtain amplified audio data;

[0061] Performing noise reduction processing on the amplified audio data to obtain noise-reduced audio data;

[0062] Generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0064] Figure 1 A schematic diagram showing an operation scenario between a display device and a control device provided in some embodiments;

[0065] Figure 2A hardware configuration block diagram of a display device in some embodiments is shown;

[0066] Figure 3 shows a software configuration diagram of a display device in some embodiments;

[0067] Figure 4 A schematic diagram of a voice interaction network architecture in some embodiments is shown;

[0068] Figure 5 A schematic diagram showing the connection between a display device and an external device in some embodiments is shown;

[0069] Figure 6 A schematic diagram of a karaoke system in some embodiments is shown;

[0070] Figure 7 A flowchart of the interaction between components of a display device in some embodiments is shown;

[0071] Figure 8 A schematic diagram of an application list interface in some embodiments is shown;

[0072] Fig. 9 A schematic diagram showing the application home page of a karaoke application in some embodiments;

[0073] Fig.10 A schematic diagram showing the interaction between a display device and a server in some embodiments is shown;

[0074] Fig.11 An audio settings page for a song in some embodiments is shown;

[0075] Fig.12 A schematic diagram showing audio data separation in some embodiments;

[0076] Fig.13 A schematic diagram showing audio data separation in some embodiments;

[0077] Fig.14 A schematic diagram showing the segmentation of mono audio data in some embodiments is shown;

[0078] Fig.15 A scene diagram showing a user voice controlling a display device in some embodiments;

[0079] Fig.16 A schematic diagram of a system setting interface in some embodiments is shown. DETAILED DESCRIPTION

[0080] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0081] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0082] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0083] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0084] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0085] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0086] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments is shown. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0087] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0088] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0089] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0090] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0091] Figure 2 A hardware configuration block diagram of a display device in some embodiments is shown.

[0092] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0093] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0094] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0095] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0096] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0097] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0098] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0099] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0100] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0101] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0102] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0103] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0104] The operating system can be divided into different modules or layers according to the functions implemented. Figure 3 FIG. 4 shows a software configuration diagram of a display device in some embodiments, such as Figure 3 As shown, in some embodiments, the system of the display device 200 can be divided into three layers, namely, an application layer, a middleware layer, and a hardware layer from top to bottom.

[0105] The application layer mainly includes applications on the TV and the application framework. Among them, applications are mainly applications developed based on the browser, such as HTML5 APPs and native applications.

[0106] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0107] Native apps can support online or offline, message push or local resource access.

[0108] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0109] The hardware layer mainly includes HAL interface, hardware and driver. Among them, HAL interface is the unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0110] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0111] Figure 4 Schematic diagram of voice interaction network architecture in some embodiments is shown. Figure 4 As shown, the display device 200 can collect the source audio data input by the user through the detector 230 to generate the corresponding voice interaction instruction. Then, in response to the voice interaction instruction, the source audio data corresponding to the voice interaction instruction is obtained, and then the source audio data is converted into recognized text through ASR, and semantic understanding is performed on the recognized text based on NLU (Natural Language Understanding) technology. For example, the display device 200 can respond to the voice interaction instruction and perform noise reduction processing and feature extraction on the source audio data of the voice interaction instruction, wherein the noise reduction processing may include steps such as removing echoes and removing environmental noise; then, the recognized candidate text and the associated context information are subjected to natural language understanding, and the text is parsed into structured, machine-readable information, and executable intent is obtained through information such as business fields, intents, and word slots in the readable information to determine the intent confidence score, and the semantic understanding module selects one or more candidate executable intents based on the determined intent confidence score.

[0112] In some embodiments, the display device 200 can send a query instruction to the corresponding business management module according to the determined executable intent to obtain the query result given by the business service, and execute the action required by the user's final request, and feedback the device execution instruction corresponding to the query result. For example, the display device 200 can send a corresponding query instruction to the DM (Dialog Management) configured by the server 400 according to the selected executable intent to obtain the query result of the voice interaction instruction.

[0113] In order to respond to the voice interaction instructions, in some embodiments, the display device 200 can also generate language text through NLG (Natural Language Generation), and respond to the voice interaction instructions through the generated language text. Among them, the types of responses can be specifically divided into dialogue type, task type, knowledge question and answer type and recommendation type. The NLG in the dialogue type response dialogue is to perform intention recognition, sentiment analysis, etc. according to the context, and then generate an open reply; in the task type dialogue, the dialogue reply needs to be generated according to the learned strategy, and the general reply includes clarifying the needs, guiding the user, asking, confirming, and concluding the dialogue; in the knowledge question and answer dialogue, the knowledge (knowledge, entity, fragment, etc.) required by the user is generated according to the identification and classification of the question type, information retrieval or text matching; in the recommendation dialogue system, the result matching and candidate recommendation content sorting are performed according to the user's input history, and then the content recommended to the user is generated.

[0114] In some embodiments, the display device 200 can synthesize the corresponding response audio data through TTS according to the language text generated by NLG, and control the audio output device 270 to play the response audio data to output the sound formed by the response audio data to the user. For example, the generated language text can be in the form of a text string, and the display device 200 can convert the text string into playable response audio data.

[0115] The display device 200 may have multiple functions, such as browsing web pages, playing media resources, entertainment games, screen projection, voice interaction, etc., so as to provide users with a variety of services.

[0116] In some embodiments, the display device 200 can be connected to an external device through the device interface 240 to play the content provided by the external device. The external device can be a set-top box, a media device, etc. The display device 200 and the external device that establish a communication connection serve as a receiving end (Sink end) and a sending end (source end) respectively. The external device can perform a data transmission process with the device interface 240 and the display device 200 to send media data to the display device 200. Different external devices can support different functions. For example, a media device can provide various media data, and a set-top box can provide media channel content.

[0117] The display device 200 and the external device are provided with data interfaces having the same interface specification and function. Figure 5 Schematic diagrams showing connections between display devices and external devices in some embodiments are shown. Figure 5As shown, the display device 200 and the external device may be provided with HDMI (High Definition Multimedia Interface). The user may plug the two ends of the HDMI interface data cable into the display device 200 and the external device respectively, thereby realizing data transmission between the display device 200 and the external device.

[0118] In order to realize the communication connection between the display device 200 and the external device, other connection methods may be used between the display device 200 and the external device, such as DVI (Digital Visual Interface), VGA (Video Graphics Array), USB (Universal Serial Bus), etc.; wireless connection methods may also be used, such as wireless LAN, Bluetooth connection, infrared connection, etc. Different communication connection methods may use different information transmission protocols. For example, when the HDMI interface is used to realize the connection, the HDMI transmission protocol may be used for data transmission.

[0119] With the development of intelligence and the improvement of living standards, users may choose to perform karaoke at home. The display device 200 can be connected to some professional karaoke devices to form a karaoke system with karaoke function.

[0120] Figure 6 Schematic diagrams of karaoke systems in some embodiments are shown. Figure 6 As shown, the karaoke system may include a display device 200, a broadcast control device, an audio processing device, a power amplifier device, a speaker, a microphone, etc. The broadcast control device is connected to the display device 200 and the audio processing device, the audio processing device is also connected to the microphone and the power amplifier device respectively, and the power amplifier device is connected to the speaker, thereby forming a karaoke system.

[0121] The playback control device is used to control the playback process of media assets such as songs. The playback control device can be a tablet computer, PC, etc. The user can select songs through the playback control device and control the playback of songs. After the user instructs to play a song, the playback device can obtain the media asset data corresponding to the song and parse the video data and audio data. The playback device sends the video data to the display device 200, and the playback device sends the audio data to the sound effect processing device.

[0122] The display device 200 can analyze the video data to display the video screen corresponding to the song. The microphone can collect the user audio and send the user audio to the sound effect processing device.

[0123] The audio processing device can receive user audio sent by the microphone, and can also receive song audio data sent by the broadcast control device. The audio processing device can perform audio processing on both audio, and the audio processing can include reverberation processing, echo gain processing, noise reduction processing, etc.

[0124] The sound effect processing device can send the audio data after the sound effect processing to the power amplification device, and the power amplification device can perform gain processing on the audio to amplify the volume of the audio. The power amplification device sends the amplified audio to the speaker, and the speaker can play the audio.

[0125] In some embodiments, some of the above devices can be integrated together to form a device that realizes multiple functions. For example, a speaker device can have a power amplification function, so that the power amplification device and the speaker are integrated into one device. For a karaoke system, it only needs to maintain the six functions of broadcast control + audio acquisition + sound effect processing + power amplification + audio output + video display to realize the karaoke function.

[0126] However, the display device cannot independently realize the karaoke function. To realize the karaoke function of the display device, if a karaoke system is built, users need to purchase the above karaoke devices, which greatly increases the user cost and seriously affects the user experience. In addition, when users use the karaoke system, they need to start and control each device, which is cumbersome and does not meet the user's convenience needs for karaoke at home.

[0127] In some embodiments, in order to enable users to use the display device 200 to directly perform activities such as karaoke, the display device is provided with a user sound playback function, which can play the user audio with the effect of karaoke. The display device can collect user audio through a sound collector and obtain user audio data collected by the sound collector. According to the user audio data, the display device can obtain mono audio data corresponding to multiple channels, and perform sound gain processing on the mono audio data to obtain amplified audio data. The display device performs noise reduction processing on the amplified audio data and generates multi-channel audio data, thereby playing the multi-channel audio data to the user. Therefore, the display device can amplify the volume and reduce the noise of the user audio, so as to play the audio effect that the karaoke system can play, so that the user can use the display device to perform karaoke.

[0128] Figure 7 A flowchart of the interaction between components of a display device in some embodiments is shown, including the following steps:

[0129] S701, obtaining user audio data collected by the sound collector;

[0130] S702, acquiring a plurality of mono audio data corresponding to a plurality of channels according to the user audio data;

[0131] S703, performing sound gain processing on the mono audio data to obtain amplified audio data;

[0132] S704, performing noise reduction processing on the amplified audio data to obtain noise-reduced audio data;

[0133] S705: Generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data.

[0134] In some embodiments, in order to enable the user to directly perform activities such as karaoke using the display device 200, an application program for performing karaoke activities may be installed in the display device 200, which is referred to as a karaoke application in the embodiments of the present application.

[0135] When the user controls the display device to start up, the controller 250 can control the display 260 to display a user interface. The user interface can be a specific target image, such as various media resources obtained from a network signal source, including videos, pictures and other content. The user interface can also be some UI interfaces of the display device 200, such as the system main interface, various control interfaces of applications installed in the display device 200, etc.

[0136] The display device 200 can display the application list interface to the user, receive the application startup instruction input by the user based on the application list interface, and then run the corresponding application in response to the startup instruction, so that the display device 200 supports the application function. It should be noted that the application installed in the display device 200 can be a system application or a third-party application. The user controls the display device 200 to implement the corresponding function of an application by opening an application.

[0137] Figure 8 Schematic diagrams of application list interfaces in some embodiments are shown. Figure 8 As shown, the application list interface includes three controls: "Cable TV", "Online Media" and "Music Karaoke". The display device 200 implements different functions by detecting the user's touch operation. In response to the user's touch operation on the "Cable TV" control, the display device 200 can display the media channel interface so that the user can select a media channel to play. In response to the user's touch operation on the "Online Media" control, the display device 200 can start the online media application to play various online media. In response to the user's touch operation on the "Music Karaoke" control, the display device 200 starts the Karaoke application to turn on the Karaoke function.

[0138] Fig. 9 Schematic diagram of the application home page of the karaoke application in some embodiments is shown. Fig. 9As shown, the main application page of the karaoke application includes multiple song controls 91. After receiving an instruction from a user to select a song control 91, the controller 250 can control the playback process of the song media asset corresponding to the song control through the karaoke application. The karaoke application can obtain the media asset data of the song media asset, and the controller 250 can control the display device 200 to play the media asset data.

[0139] In some embodiments, during use, the display device 200 can communicate with the server 400 to implement data interaction, including receiving various data sent by the server 400. For example, the display device 200 can obtain media asset data in the network through the server 400.

[0140] In order to realize data interaction between the display device 200 and the server 400, the display device 200 needs to establish a communication connection with the server 400. For example, the display device 200 and the server 400 can both be connected to the Internet, and the interactive data is transmitted between the display device 200 and the server 400 through the Internet transmission protocol. When the display device 200 receives the interactive data transmitted by the server 400, it first obtains the instructions or notifications contained in the interactive data, and then obtains other data to execute the corresponding interactive logic.

[0141] Fig.10 Schematic diagram showing the interaction between a display device and a server in some embodiments. Fig.10 As shown, components for establishing a communication connection need to be provided on the display device 200 and the server 400, respectively. A communication device 220 is provided in the display device 200, and a communication module 410 may be provided in the server 400. The communication device 220 and the communication module 410 may support at least one of the same communication modes at the same time to establish a communication connection relationship. For example, the communication device 220 on the display device 200 includes an optical fiber interface for connecting to a network; at the same time, the communication module 410 of the server 400 also includes an optical fiber interface to realize a communication connection between the display device 200 and the server 400.

[0142] It should be noted that the display device 200 and the server 400 may also establish a communication connection relationship by other connection methods, such as wired network, wireless local area network, cellular network, Bluetooth, infrared, radio frequency communication, etc.

[0143] In some embodiments, after the user selects a target song, the controller 250 can download the media data of the target song from the server 400 through the karaoke application. The server can be provided with a media library, which stores a large amount of media resources, including media data of multiple songs provided by the karaoke application.

[0144] The controller 250 can parse the media data to obtain video data and audio data. The controller 250 can control the display 260 to display the video data and control the audio output device 270 to play the audio data so that the user can view the relevant content of the target song.

[0145] Taking the example of a user instructing to play song AAA, the display device 200 can play the media data of song AAA to allow the user to perform karaoke activities. The user can also control the playing process of the song. Fig.11 The audio setting page of a song in some embodiments is shown, such as Fig.11 The audio setting page includes a console control 111, a sound effect mode setting control 112, a song request station control 113, a clarity control 114, and an automatic recording control 115. After the user clicks the sound effect mode setting control, the audio setting page can display a sound effect mode setting box for displaying the currently configurable sound effect modes, including a KTV control 1121, a concert control 1122, a recording studio control 1123, a theater control 1124, and a professional sound effect control 1125.

[0146] In some embodiments, by playing the media data of the song, the user can watch the song content. In order to realize the karaoke function, the display device 200 can also collect the user audio and process it to play the user audio with karaoke effect.

[0147] The display device 200 may be provided with a sound collector, which is used to collect audio data. The sound collector may be a device built into the display device 200, but in order to improve the sound collection effect during audio collection and ensure the clarity of the collected user audio, the display device 200 may be connected to an external sound collector. The external sound collector may be a microphone, and the user may hold the microphone and input audio into the microphone, and the microphone may collect the user audio and send it to the display device 200.

[0148] The display device 200 may support various types of microphones, such as AV (Audio Video Microphone) microphones, USB (Universal Serial Bus) microphones, and Bluetooth microphones, etc. It should be noted that the display device 200 provided in the embodiment of the present application may also support more types of microphones, which are not limited in the embodiment of the present application.

[0149] In some embodiments, the controller 250 may obtain user audio data collected by a sound collector.

[0150] The display device 200 may be connected to a plurality of sound collectors. For example, each of a plurality of users may hold a microphone to input sound, and each sound collector may send the collected user audio data to the display device 200 .

[0151] It should be noted that, affected by the type of the sound collector, the sound collector can collect mono audio or multi-channel audio. If the sound collector collects mono audio, after multiple sound collectors send multiple mono audio to the display device 200, the multiple mono audio can also be synthesized into multi-channel audio.

[0152] In multi-channel audio, audio data is arranged alternately in the order of multiple channels. Taking dual-channel audio as an example, dual-channel audio data contains data of channel 1 and channel 2, and the data is arranged in the order of channel 1 and channel 2 alternating, forming the form of "channel 1-channel 2-channel 1-channel 2".

[0153] Different sound collectors can collect audio inputs in different formats, including but not limited to 8KHz, 16KHz, 32KHz, and 48KHz, and the display device 200 can process a variety of audio formats accordingly.

[0154] In order to ensure the sound effect of karaoke, 48KHz dual-channel data format can be collected, so as to effectively take into account both sound effect and device performance. In addition, too high a sampling rate will consume a higher processor speed, thereby affecting the karaoke effect. For this reason, in the embodiment of the present application, the user audio is sampled in units of 10ms, and the controller 250 can process 10ms of user audio data each time.

[0155] In some embodiments, after collecting the user audio data, the controller 250 can obtain multiple mono audio data corresponding to multiple channels according to the user audio data. Each channel corresponds to a mono audio data, and the mono audio data is a segment of audio data, that is, the mono audio data contains multiple audio data arranged in time order.

[0156] It should be noted that the user audio data may be multi-channel audio data. Considering that audio effect processing and other processes may be performed on mono-channel data, the controller 250 may split the user audio data into mono-channel audio data.

[0157] The user audio data includes a plurality of audio data alternately arranged in a channel sequence, and the controller 250 may separate the audio data of the plurality of channels to obtain mono audio data corresponding to each channel.

[0158] In some embodiments, the controller 250 may sequentially read each audio data in the user audio data in a front-to-back order to identify a channel of the audio data, and separate the audio data according to the channel.

[0159] Fig.12Schematic diagram of audio data separation in some embodiments is shown. Fig.12 As shown, the mixed channel includes audio data of channel 1 and channel 2, where a represents the audio data of channel 1 and b represents the audio data of channel 2. The controller 250 can read one audio data at a time, and after reading the audio data, mark the sequence number of the audio data (such as 1-11 in the figure). The controller 250 can detect the channel of the audio data and copy it to the audio data queue of the corresponding channel according to the channel of the audio data to generate mono audio data. After processing the current audio data, the controller 250 can continue to read the next audio data and process it according to the marked sequence number.

[0160] It should be noted that the display device 200 has a large workload when performing channel separation of audio data in the above manner. Taking 10ms of user audio data as an example, the collected audio format is 16bit, and the length of a 10ms data packet in this format is 1920 bytes. One 16bit audio data occupies two bytes, so a 10ms dual-channel data packet contains 960 audio data.

[0161] If one audio data is read and marked each time, the controller 250 needs to mark and repeat the processing of the single audio data 959 times. The display device 200 has a large amount of data processing, resulting in a long time spent on processing audio data, and the delay in subsequent audio playback may be high, which gives the user a poor experience.

[0162] To this end, the audio data can be processed using block technology to reduce the amount of data processing.

[0163] In some embodiments, the controller 250 may first obtain the audio data block frequency. The audio data block frequency is used to limit the amount of audio data in each block area during block division.

[0164] When obtaining the audio data block frequency, the controller 250 may first obtain the audio acquisition parameters of the sound collector, including the audio format, such as 16 bits.

[0165] The controller 250 can calculate the number of bytes occupied by the audio data according to the audio format. One byte is 8 bits, and the controller 250 can calculate the ratio of the audio format and the size of each byte, and obtain that the number of bytes occupied by the audio data is 16 / 8=2.

[0166] The controller 250 can set the audio data block frequency according to the number of bytes. It should be noted that the display device 200 has limited computing power and can process 8 bytes of data at a time, so the audio data block frequency can be calculated as 8 / 2=4, that is, the audio data block frequency is set to 4.

[0167] In some embodiments, after obtaining the audio data block frequency, the controller 250 may perform block processing on the user audio data based on the audio data block frequency to obtain a plurality of user audio data after block processing, which is referred to as multi-channel block audio data in the embodiment of the present application. The number of audio data in the multi-channel block audio data is the audio data block frequency, and the multi-channel block audio data is marked with channel information corresponding to each audio data.

[0168] The controller 250 may perform block processing on the multi-channel user audio data. The block processing may use a chunk to divide the entire data into a plurality of chunks. Fig.13 Schematic diagram of audio data separation in some embodiments is shown. Fig.13 As shown, multi-channel user audio data (ie, mixed channels in the figure) is divided into multiple chunks, and the number of audio data contained in each chunk is 4.

[0169] The number of data and data arrangement in each chunk are the same. Taking two-channel audio as an example, each chunk contains 4 audio data, and the audio data is arranged in the order of "channel 1-channel 2-channel 1-channel 2". If it is four-channel audio, the audio data is arranged in the order of "channel 1-channel 2-channel 3-channel 4".

[0170] After dividing the user audio data into blocks, the controller 250 may read a plurality of multi-channel block audio data respectively and extract audio data from the multi-channel block audio data according to the channel information to obtain mono audio data corresponding to the plurality of channels.

[0171] It should be noted that the controller 250 can process one multi-channel block audio data (chunk) each time. After reading the chunk, the controller 250 marks the sequence number of the chunk (such as 1 and 2 in the figure) and performs channel separation on the chunk.

[0172] For each chunk, the controller 250 can directly read the multiple audio data therein. Since the arrangement order of the audio data in each chunk has been determined, that is, the channel information of the audio data at each position is determined. Fig.13 As shown, each chunk includes 4 audio data positions, and the first and third positions are channel 1, and the second and fourth positions are channel 2. The controller 250 can directly copy multiple audio data in the chunk to the audio data queue of the corresponding channel to generate mono audio data. Fig.13 The first and third audio data in each chunk are copied directly to channel 1 queue, and the second and fourth are copied directly to channel 2 queue.

[0173] After processing the chunk, the controller 250 may continue to read and process the next chunk.

[0174] It should be noted that the controller 250 can process all the audio data in one chunk at a time, that is, process 4 audio data at the same time. For 10ms of user audio data, which contains 960 audio data, the controller 250 only needs to process 960 / 4=240 times, which reduces the data processing amount of the display device 200, improves the audio processing speed, and reduces the delay of audio playback.

[0175] In some embodiments, after dividing the user audio data into mono audio data, the controller 250 may perform sound gain processing on the mono audio data to obtain amplified audio data, thereby amplifying the user audio volume.

[0176] The controller 250 may first obtain the audio data block frequency.

[0177] Based on the audio data block frequency, the controller 250 can block the mono audio data to obtain multiple mono block audio data. The number of audio data in the mono block audio data is the audio data block frequency. The controller 250 can divide the mono audio data into multiple chunks, each chunk being a mono block audio data.

[0178] Fig.14 FIG. 4 is a schematic diagram showing the block division of mono audio data in some embodiments. Fig.14 As shown, the mono audio data corresponding to channel 1 and channel 2 are divided into blocks, and each channel obtains multiple chunks, and each chunk can contain 4 audio data. For example, chunk0 in channel 1 contains 4 audio data a0-a3.

[0179] The controller 250 can perform sound gain processing on multiple mono-channel block audio data respectively. Considering that the controller 250 can read one chunk for processing at a time, the controller 250 can first process one mono-channel audio data, and then read each chunk in sequence for sound gain processing. After the current mono-channel audio data is processed, the next mono-channel audio data is processed.

[0180] In some embodiments, when performing sound gain processing on mono-channel block audio data, the controller 250 may first obtain the initial amplitude value of the audio data in the mono-channel block audio data. A segment of audio data may be understood as a segment of waveform, wherein each audio data corresponds to an amplitude value, indicating the volume (decibel) of the audio data.

[0181] The controller 250 may calculate the gain amplitude value of the audio data based on a preset gain coefficient and an initial amplitude value. The preset gain coefficient may be 1.5, 3, 5, or 7. The controller 250 may calculate the product of the gain coefficient and the initial amplitude value as the gain amplitude value.

[0182] The controller 250 may update the initial amplitude value of the audio data to a gain amplitude value to achieve gain of the audio data, that is, to amplify the volume of the audio data.

[0183] It should be noted that the controller 250 can simultaneously perform sound gain processing on multiple audio data in a chunk, thereby improving the audio processing speed and reducing the delay of audio playback.

[0184] In some embodiments, after gaining the audio data, the controller 250 may perform noise reduction processing on the amplified audio data to obtain noise-reduced audio data.

[0185] The controller 250 may read one chunk at a time and perform noise reduction processing on multiple audio data in the chunk simultaneously.

[0186] The controller 250 may first read the gain amplitude value of the audio data in the mono-channel block audio data in the amplified audio data, that is, read the current amplitude value of each audio data in the chunk.

[0187] The controller 250 can detect noise audio data, and the gain amplitude value of the noise audio data is less than the preset amplitude threshold. Corresponding to a chunk, the controller 250 can detect whether the multiple audio data therein are noise audio data, that is, whether the current amplitude is less than the preset amplitude threshold. The audio data queue after gain can also be regarded as a waveform, and the part with a smaller amplitude value in the waveform can be regarded as noise, and this part of the noise is subjected to noise reduction processing.

[0188] If it is detected that the audio data is noise audio data, the controller 250 can calculate the noise reduction amplitude value according to the gain amplitude value and the noise reduction coefficient of the noise audio data. The ratio of the gain amplitude value and the noise reduction coefficient can be calculated as the noise reduction amplitude value. For example, when the amplitude threshold is set to 7 decibels, the noise reduction coefficient can be set to 2.8; when the amplitude threshold is set to 11 decibels, the noise reduction coefficient can be set to 3.5.

[0189] The controller 250 may update the gain amplitude value of the noise audio data to the noise reduction amplitude value. After performing noise reduction processing on all chunks, noise reduction audio data corresponding to each channel may be obtained.

[0190] In some embodiments, the controller 250 may generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data.

[0191] The controller 250 may synthesize the noise reduction audio data corresponding to each channel to obtain multi-channel audio data. The audio data in the multi-channel audio data is alternately arranged according to the channel order, that is, the audio data of multiple channels are arranged in the order of "channel 1-channel 2-channel 1-channel 2" to obtain the multi-channel audio data.

[0192] The controller 250 may control the audio output device to play multi-channel audio data.

[0193] In some embodiments, considering that the sound collector may collect monophonic data, channel separation processing is not required. Therefore, after acquiring the user audio data collected by the sound collector, the controller 250 can detect the channel information of the user audio data.

[0194] If the user audio data is multi-channel audio data, the controller 250 may execute a step of acquiring mono audio data corresponding to multiple channels according to the user audio data, and process it according to the above scheme.

[0195] If the user audio data is mono audio data, the controller 250 can perform sound gain processing and noise reduction processing on the user audio data to obtain noise reduction audio data, and control the audio output device to play the noise reduction audio data. The sound gain processing and noise reduction processing schemes can refer to the above content and will not be repeated here.

[0196] In some embodiments, in order to improve the user experience, the display device 200 may have a voice recognition function so that the user can control the display device 200 by voice. Fig.15 2 shows a scene diagram of a user voice controlling a display device 200 in some embodiments. Fig.15 As shown, the user can input a wake-up word such as "Hi! Xiaox" through the audio input device, and the display device 200 can play a voice response of "I am here" through the audio output device to guide the user to complete the subsequent voice input. The user can then input a voice command to realize voice control of the display device 200.

[0197] In some embodiments, a sound playing switch is provided in the display device 200 to control the opening and closing of the sound playing function. The user can set the state of the sound playing switch through the system setting of the display device 200. Fig.16 Schematic diagrams of system setting interfaces in some embodiments are shown. Fig.16As shown, the system setting interface includes a "mode" control for setting the display device 200 to a standard mode or a sound playing mode. When the user sets the display device 200 to the standard mode, the sound playing switch is turned off; when the user sets the display device 200 to the sound playing mode, the sound playing switch is turned on.

[0198] It should be noted that the sound playback function can amplify the user audio to achieve a karaoke effect, and the display device 200 can directly play the user audio. However, the voice recognition function will affect the process of playing the user audio, so the voice recognition function and the sound playback function can be set to a mutually exclusive state. That is, when the sound playback function is turned on, the voice recognition function is turned off.

[0199] After acquiring the user audio data collected by the sound collector, the controller 250 may detect the state of a sound playing switch preset in the display device 200 .

[0200] If the sound playing switch is in the on state, it means that the sound playing function of the display device 200 is currently turned on. The controller 250 can then turn off the voice recognition function of the display device 200 and execute the step of obtaining mono audio data corresponding to multiple channels based on the user audio data, thereby achieving the effect of amplifying the user audio volume.

[0201] If the sound play switch is in the off state, the controller 250 can turn on the voice recognition function of the display device 200 and recognize the user instruction according to the user audio data. Based on the detection of the user instruction, the controller 250 can perform the operation corresponding to the user instruction.

[0202] In some embodiments, in response to an instruction to turn on the singing function, the display 260 is controlled to display a singing application page, which includes at least one song control. The singing application page can be Fig. 9 The interface shown.

[0203] In response to the selection operation of the target song control, the controller 250 may detect the state of a sound playing switch preset in the display device 200 .

[0204] If the sound play switch is in the off state, the controller 250 can control the display 260 to display a prompt message, which is used to prompt the user to turn on the sound play switch. At this time, the display device 200 does not turn on the sound play function, so the controller 250 can prompt the user to turn on the sound play switch to turn on the sound play function of the display device 200.

[0205] If the sound play switch is turned on, the controller 250 can obtain the song audio data of the target song corresponding to the target song control, and control the audio output device to play the song audio data. The controller 250 can also perform the step of obtaining the mono audio data corresponding to the multiple channels according to the user audio data, so as to amplify the user audio to achieve the effect of karaoke.

[0206] The present application also provides a method for playing user sound, which is applied to a display device, and the method includes:

[0207] Step 701: Acquire user audio data collected by the sound collector;

[0208] Step 702: Acquire a plurality of mono audio data corresponding to a plurality of channels according to the user audio data;

[0209] Step 703: Perform sound gain processing on the mono audio data to obtain amplified audio data;

[0210] Step 704: performing noise reduction processing on the amplified audio data to obtain noise-reduced audio data;

[0211] Step 705: Generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data.

[0212] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0213] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0214] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0215] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: monitor; A sound collector is configured to collect audio data; an audio output device configured to play audio; The controller is configured as: Acquire user audio data collected by the sound collector; Acquire a plurality of mono audio data corresponding to a plurality of channels according to the user audio data; Performing sound gain processing on the mono audio data to obtain amplified audio data; Performing noise reduction processing on the amplified audio data to obtain noise-reduced audio data; Generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data.

2. The display device according to claim 1, characterized in that The user audio data includes a plurality of audio data alternately arranged according to channels; the controller executes to obtain a plurality of mono audio data corresponding to the plurality of channels according to the user audio data, and is specifically configured as follows: Get the audio data block frequency; Based on the audio data block frequency, the user audio data is processed in blocks to obtain a plurality of multi-channel block audio data; the number of audio data in the multi-channel block audio data is the audio data block frequency, and the multi-channel block audio data is marked with channel information corresponding to the audio data; A plurality of multi-channel block audio data are read respectively and audio data in the multi-channel block audio data are extracted according to the channel information to obtain a plurality of mono-channel audio data corresponding to the plurality of channels.

3. The display device according to claim 2, characterized in that The controller executes obtaining the audio data block frequency, and is specifically configured as follows: Acquire audio acquisition parameters of a sound collector; the audio acquisition parameters include an audio format; Calculating the number of bytes occupied by the audio data according to the audio format; The audio data blocking frequency is set according to the byte quantity.

4. The display device according to claim 1, characterized in that The controller performs sound gain processing on the mono audio data, and is specifically configured as follows: Get the audio data block frequency; Based on the audio data block frequency, the mono audio data is processed in blocks to obtain a plurality of mono block audio data; The number of audio data in the monophonic block audio data is the audio data block frequency; Perform sound gain processing on multiple mono-channel block audio data respectively.

5. The display device according to claim 4, characterized in that The controller performs sound gain processing on a plurality of mono-channel block audio data respectively, and is specifically configured as follows: Obtaining an initial amplitude value of audio data in the monophonic block audio data; Calculating a gain amplitude value of the audio data based on a preset gain coefficient and the initial amplitude value; The initial amplitude value of the audio data is updated to the gain amplitude value.

6. The display device according to claim 5, characterized in that The controller performs noise reduction processing on the amplified audio data, and is specifically configured as follows: Reading a gain amplitude value of audio data in the monophonic block audio data in the amplified audio data; Detecting noise audio data; the gain amplitude value of the noise audio data is less than a preset amplitude threshold; Calculating a noise reduction amplitude value according to the gain amplitude value and the noise reduction coefficient of the noise audio data; The gain amplitude value of the noise audio data is updated to the noise reduction amplitude value.

7. The display device according to claim 1, characterized in that After the controller executes the acquisition of the user audio data collected by the sound collector, the controller is further configured to: Detecting channel information of the user audio data; If the user audio data is multi-channel audio data, performing a step of acquiring mono audio data corresponding to multiple channels according to the user audio data; If the user audio data is mono audio data, sound gain processing and noise reduction processing are performed on the user audio data to obtain noise-reduced audio data, and the audio output device is controlled to play the noise-reduced audio data.

8. The display device according to claim 1, characterized in that After the controller executes the acquisition of the user audio data collected by the sound collector, the controller is further configured to: Detect the status of the preset sound playing switch in the display device; If the sound playing switch is in the on state, the voice recognition function of the display device is turned off, and a step of acquiring mono audio data corresponding to multiple channels according to the user audio data is performed; If the sound playing switch is in the off state, the voice recognition function of the display device is turned on, and the user command is recognized according to the user audio data; Based on the detected user instruction, an operation corresponding to the user instruction is executed.

9. The display device according to claim 1, characterized in that: The controller is also configured to: In response to an instruction to start a singing function, controlling the display to display a singing application page, wherein the singing application page includes at least one song control; In response to the selection operation of the target song control, detecting the state of a preset sound playing switch in the display device; If the sound play switch is in the off state, controlling the display to display a prompt message, wherein the prompt message is used to prompt to turn on the sound play switch; If the sound playing switch is in the on state, the song audio data of the target song corresponding to the target song control is obtained; the audio output device is controlled to play the song audio data, and the step of obtaining mono audio data corresponding to multiple channels according to the user audio data is executed.

10. A method for playing user voice, characterized in that: Applied to the display device according to any one of claims 1 to 9, the method comprising: Get the user audio data collected by the sound collector; Acquire a plurality of mono audio data corresponding to a plurality of channels according to the user audio data; Performing sound gain processing on the mono audio data to obtain amplified audio data; Performing noise reduction processing on the amplified audio data to obtain noise-reduced audio data; Generate multi-channel audio data according to the noise reduction audio data, and control the audio output device to play the multi-channel audio data.

Images