Projection display device and control method

Abstract

The embodiment of the invention provides projection display equipment and a control method, and the projection display equipment comprises at least one audio output device, a sampling device electrically connected with the audio output device, and a main controller electrically connected with the audio output device and the sampling device. The sampling device samples the played data to obtain sampled audio data so as to monitor whether there is a deviation between the audio data output by the main controller to the at least one sound channel and the audio data actually played by the audio output device, and when the difference error between the sampled audio data and the initial audio data is out of a preset correction error range, the audio output device outputs the audio data. And outputting the target audio data to the audio output device, thereby enabling the audio output device to correctly play the audio data of the corresponding sound channel, and improving the audio-visual effect of the user.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of projection display technology, and in particular, to a projection display device and a control method. Background Art

[0002] As users' demands for functions such as sound frequency, sound loudness, and directional sound of sound-emitting devices are increasing, the audio playback component in the projection display device is equipped with speakers corresponding to multiple channels, and each channel corresponds to sub-data with different playback attributes in the audio data. When the projection display device plays audio data, the main controller of the projection display device splits the audio data into sub-data with different playback attributes, and transmits each sub-data to the speaker of the corresponding channel for playback, so as to present a more dynamic and three-dimensional sound effect, show more sound details, and help improve the user's audio-visual experience.

[0003] However, due to the processing error of the projection display device, the preset playback attributes of the sound-emitting speaker and the played sub-data are inconsistent, resulting in errors in the sound effects played by the projection display device, which reduces the user's audio-visual effect.

[0004] Therefore, how to improve the consistency of the playback attributes of the speaker and the playback attributes of the sub-data it plays and improve the user's audio-visual effect has become a research focus. Summary of the invention

[0005] The present application provides a projection display device and a control method, which are used to solve the technical problem that the playback attributes of a speaker and the playback attributes of sub-data played by the speaker are poorly consistent.

[0006] In a first aspect, an embodiment of the present application provides a projection display device, the projection display device comprising:

[0007] A main controller, configured to generate initial audio data of at least one channel;

[0008] At least one audio output device, corresponding to each channel one by one, and configured to play the initial audio data of the corresponding channel;

[0009] a sampling device, electrically connected to the audio output device, configured to sample the initial audio data played by the audio output device and output the sampled audio data;

[0010] The main controller is electrically connected to the sampling device and is further configured to output target audio data to the audio output device when an error between the sampled audio data and the initial audio data is outside a preset correction error range;

[0011] The audio output device is further configured to play the target audio data.

[0012] In the above technical solution, when the projection display device uses the audio outputter to play the initial audio data output by the main controller, the played data is sampled to obtain sampled audio data to monitor whether there is a deviation between the audio data output by the main controller to at least one channel and the audio data actually played by the audio outputter. When the error between the sampled audio data and the initial audio data is outside the preset correction error range, the target audio data is output to the audio outputter, so that the audio outputter can correctly play the audio data of the corresponding channel, thereby improving the user's audio-visual effect.

[0013] In a feasible implementation manner, the preset correction error range includes an amplitude correction threshold range;

[0014] When the error between the sampled audio data and the initial audio data is outside a preset correction error range, outputting target audio data to the audio output device specifically includes:

[0015] When the difference between the amplitude information of the sampled audio data and the amplitude information of the initial audio data is outside the amplitude correction threshold range, the initial audio data of the channel corresponding to the sampled audio data is determined as the target audio data and transmitted to the audio output device of the channel corresponding to the sampled audio data.

[0016] In a feasible implementation manner, the preset correction error range includes a frequency correction threshold range;

[0017] When the error between the sampled audio data and the initial audio data is outside a preset correction error range, outputting target audio data to the audio output device specifically includes:

[0018] When the difference between the frequency information of the sampled audio data and the frequency information of the initial audio data is outside the frequency correction threshold range, the initial audio data of the channel corresponding to the sampled audio data is determined as the target audio data and transmitted to the audio output device of the channel corresponding to the sampled audio data.

[0019] In the above technical solution, the main controller compares the frequency information and the amplitude information respectively during the process of comparing the sampled audio data with the initial audio data of the corresponding channel. When the difference between the frequency information and / or the amplitude information is outside the corresponding correction threshold range, it is determined that the audio output device erroneously plays the audio data of other channels. The main controller determines the initial audio data of the channel corresponding to the sampled audio data as the target audio data, and transmits it to the audio output device of the channel corresponding to the sampled audio data, so as to correct the errors generated during the audio data playback process, so as to ensure that each audio output device can accurately play the audio data of its corresponding channel and improve the user's audio-visual effect.

[0020] In a feasible implementation manner, the main controller is provided with at least one sampling signal input terminal and at least one control signal output terminal, the sampling device is provided with a plurality of output terminals, and the projection display device further comprises at least one audio signal switching switch;

[0021] Each of the audio signal switching switches is provided with a plurality of sampling audio data input terminals, at least one control signal input terminal and an output terminal, wherein the sampling audio data input terminal is electrically connected to the output terminal of the sampling device, the control signal input terminal is electrically connected to the control signal output terminal of the main controller, and the output terminal is electrically connected to the sampling signal input terminal, and is configured as follows:

[0022] A control signal is obtained from the control signal input end, and the sampled audio data input end and the output end are connected according to the control signal control to obtain the sampled audio data, and the sampled audio data of the sampled audio data input end is transmitted to the output end.

[0023] In the above technical solution, when the input end of the main controller for obtaining sampled audio data is less than the number of channels, at least one audio signal switching switch is electrically connected between the sampled audio data input end of the main controller and the sampling device, and each audio signal switching switch obtains sampled audio data from the sampling device, and outputs the sampled audio data from its output end to the sampling signal input end of the main controller, so that the main controller can obtain the sampled audio data obtained after sampling at least one channel using fewer sampling signal input ends, which not only ensures the accuracy of subsequent audio signal output correction, but also improves the utilization rate of the sampling signal input end of the main controller.

[0024] In a feasible implementation manner, the main controller includes a first CPU core and a second CPU core;

[0025] The first CPU core is configured to perform echo cancellation on the far-field voice, obtain target voice data, perform semantic recognition on the target voice data, obtain instruction information, and control the projection display device to perform an operation corresponding to the instruction information;

[0026] The second CPU core is configured to perform audio correction;

[0027] The first CPU core and the second CPU core are processed in parallel.

[0028] In the above technical solution, the main controller is configured to use two CPU cores to perform audio correction and far-field voice processing respectively. Since the two CPU cores can process in parallel, the main controller can perform audio correction and far-field voice processing at the same time, and real-time response of the two functions can be achieved.

[0029] In a feasible implementation manner, the main controller includes a first CPU core, the first CPU core includes a first thread and a second thread, and the processing priority of the first thread is higher than that of the second thread;

[0030] The main controller is also configured to:

[0031] When the second thread performs audio correction, the first thread obtains the far-field voice and controls the second thread to interrupt the audio correction;

[0032] Using the first thread to perform echo cancellation on the far-field voice, obtain target voice data, perform semantic recognition on the target voice data, obtain instruction information, and control the projection display device to perform an operation corresponding to the instruction information;

[0033] After the first thread completes its operation, the second thread is controlled to continue audio correction.

[0034] In the above technical solution, the main controller is configured to use two threads of a CPU core to perform audio correction and far-field voice processing respectively, and configure the priority of the first thread to be higher than the priority of the second thread. When the second thread performs audio correction and the first thread obtains far-field voice, the main controller interrupts the processing process of the second thread according to the priority, immediately processes the far-field voice of the first thread, and responds to the processing result, thereby ensuring the timeliness of the projection display device's response to the far-field voice.

[0035] In a feasible implementation manner, the projection display device further includes a far-field voice DSP processing chip and an AD converter;

[0036] The input end of the AD converter is electrically connected to the input end of the sampling device, and is configured to obtain sampled audio data of at least one channel and convert the sampled audio data into digital audio data; wherein the sampled audio data is analog audio data;

[0037] The main controller is also provided with a far-field voice data input terminal and a first interactive terminal, and is configured to obtain far-field voice from the far-field voice data input terminal when at least one audio output device plays audio data, and output the far-field voice from the first interactive terminal; the far-field voice includes the played audio data, the target voice data emitted by the user, and the ambient sound;

[0038] The input end of the far-field voice DSP processing chip is electrically connected to the output end of the AD converter, and the second interactive end is electrically connected to the first interactive end of the main controller, and is configured to simultaneously obtain digital audio data corresponding to each channel from the input end, obtain the far-field voice from the first interactive end, perform echo cancellation on the far-field voice according to the digital audio data, obtain target voice data, perform semantic recognition on the target voice data, obtain instruction information, and transmit the instruction information to the first interactive end;

[0039] The main controller is further configured to obtain the instruction information and control the projection display device to perform an operation corresponding to the instruction information.

[0040] In the above technical solution, a far-field voice DSP processing chip is provided in the projection display device to process far-field voice, which not only saves CPU computing power, but also enables the projection display device to perform far-field voice processing and audio correction at the same time, thereby realizing multi-demand and multi-task concurrent processing, and achieving the effect that both applications can respond in real time. In addition, when processing far-field voice in a scenario where the audio output device outputs multi-channel audio data in the human voice frequency band, the digital signals sampled for each channel can be simultaneously obtained through the input end of the far-field voice DSP processing chip to ensure the accuracy of far-field voice processing.

[0041] In a second aspect, the present application provides a control method for a projection display device, which is used for the projection display device involved in the first aspect, and the method includes:

[0042] When the audio output device plays the initial audio data, the initial audio data is sampled by the sampling device to obtain sampled audio data;

[0043] When the difference between the sampled audio data and the initial audio data of the corresponding channel is outside the preset correction threshold range, the target audio data is output to the corresponding audio outputter, so that the audio outputter outputs the target audio data.

[0044] In the above technical solution, when the projection display device uses the audio output device to play the initial audio data, it samples the played audio data, and monitors whether the data played by the audio output device is correct by comparing it with the initial audio data of the corresponding channel. When the difference between the sampled audio data and the initial audio data of the corresponding channel is outside the preset correction threshold range, it is determined that the audio output device has a playback error, and the target audio data is transmitted to the audio output device, so that the audio output device can correctly play the audio data of the corresponding channel, thereby improving the user's audio-visual effect.

[0045] The embodiment of the present application provides a projection display device and a control method. The projection display device includes: at least one audio outputter, a sampling device electrically connected to the audio outputter, and a main controller electrically connected to the audio outputter and the sampling device. When the audio outputter plays the initial audio data output by the main controller, the sampling device samples the played data to obtain sampled audio data. The main controller compares the sampled audio data with the initial audio data of the corresponding channel to monitor whether there is a deviation between the audio data output by the main controller for at least one channel and the audio data actually played by the audio outputter. When the difference between the sampled audio data and the initial audio data is outside a preset correction threshold range, the target audio data is output to the audio outputter, so that the audio outputter correctly plays the audio data of the corresponding channel to improve the user's audio-visual effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0047] Figure 1 This is an application scenario diagram of a projection display device provided by the present application according to an exemplary embodiment;

[0048] Figure 2 A schematic structural diagram of a conventional projection display device provided by the present application according to an exemplary embodiment;

[0049] Figure 3 A schematic diagram of a conventional playback process of three-channel audio data provided by the present application according to an exemplary embodiment;

[0050] Figure 4 A schematic diagram of a conventional playback process of two-channel audio data is provided for the present application according to an exemplary embodiment;

[0051] Figure 5 A schematic diagram of the structure of a projection display device provided by the present application according to an exemplary embodiment;

[0052] Figure 6 A schematic structural diagram of a projection display device provided according to another exemplary embodiment of the present application;

[0053] Figure 7 A schematic diagram of a playback process of multi-channel audio data provided by the present application according to an exemplary embodiment;

[0054] Figure 8 A schematic diagram of a playback process of two-channel audio data provided by the present application according to an exemplary embodiment;

[0055] Fig. 9A schematic diagram of a playback process of three-channel audio data provided by the present application according to another exemplary embodiment;

[0056] Fig.10 A schematic diagram of a far-field speech processing flow provided by the present application according to an exemplary embodiment;

[0057] Fig.11 It is a schematic structural diagram of a projection display device provided in accordance with another exemplary embodiment of the present application.

[0058] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0059] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0060] It should be noted that, in this article, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of more restrictions, the elements defined by the sentence "include one..." do not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, the parts, features, and elements with the same names in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context in the specific embodiment. It should be further understood that the terms "include", "comprise" indicate the existence of features, steps, operations, elements, components, projects, types, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, types, and / or groups.

[0061] In the description of the present disclosure, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present disclosure, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined. The terms "or" and "and / or" are interpreted as inclusive, or mean any one or any combination. Therefore, "A, B or C" or "A, B and / or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C". Exceptions to this definition will only occur when the combination of elements, functions, steps or operations is inherently mutually exclusive in some way.

[0062] In the description of the present disclosure, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.

[0063] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0064] Figure 1 The application scenario diagram of the projection display device provided in this application, such as Figure 1 As shown, the user can operate the projection display device 500 through the smart device 300 or the control apparatus 100 so that the projection display device 500 projects an image or video onto the screen 200 .

[0065] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the projection display device 500 includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the projection display device 500 is controlled wirelessly or wired. The user can input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the projection display device 500.

[0066] In some embodiments, a smart device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) may also be used to control the projection display device 500. For example, the projection display device 500 is controlled using an application running on the smart device.

[0067] In some embodiments, the projection display device 500 may not use the above-mentioned smart device or control device to receive instructions, but may receive user control through gestures or the like.

[0068] In some embodiments, the projection display device 500 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the projection display device 500, or the user's voice command control can be received through a voice control device set outside the projection display device 500.

[0069] In some embodiments, the projection display device 500 also communicates data with the server 400. The projection display device 400 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the projection display device 500. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0070] Figure 2 FIG. 1 is a schematic diagram of a conventional projection display device provided by the present application according to an exemplary embodiment. Figure 2 As shown, the projection display device 500 includes at least one of a main control circuit board 10, a detector 20, an audio output interface 30, an external device interface 40, a power supply unit 50, a display unit 60, a communicator 70, a memory, and a user interface.

[0071] In some embodiments, the power supply unit 50 is configured to provide power to the entire projection system, generally outputting DC 36V, 12V, 18V, etc., wherein the power supply unit 50 provides a DC 36V electrical signal to the light source driving unit 602, provides a DC 12V electrical signal to the main control circuit board 10 and the display driving and control unit 601, and provides a DC 18V electrical signal to each power amplifier in the audio input interface 30.

[0072] In some embodiments, the main control circuit board 10 includes a main controller 101 , a power DCDC conversion unit 102 , and a storage unit 103 .

[0073] The power DCDC conversion unit 102 is configured to perform level conversion on the direct current signal obtained by the main control circuit board 10 , so as to provide the required electrical signal to the circuit structure corresponding to each unit.

[0074] The main controller 101 is configured to decode various input signal sources, and use the video signal processing unit 1011 to extract, sample, process brightness, clarity, color, etc. on the image, and finally generate the video timing signal required by the display driver and control unit.

[0075] The main controller 101 is further configured to perform sound effect processing on the input audio signal and output the processed audio signal through the audio output interface 30 .

[0076] The main controller 101 is also configured to control the operation of the projection display device and respond to user operations through various software control programs stored in the memory. The controller 101 controls the overall operation of the projection display device 500. For example, in response to receiving a user command for displaying a UI object on the screen 200 using the display unit 60, the main controller 101 can perform operations related to the object selected by the user command.

[0077] In some embodiments, the main controller includes a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0078] The user can input user commands through a graphical user interface (GUI) displayed on the display of the control apparatus 100 or the smart device 300, or the user can input user commands by inputting specific sounds or gestures, and the user input interface recognizes the sounds or gestures through sensors to receive the user input commands.

[0079] "User interface" is the medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of user interface is the Graphical User Interface (GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0080] The display unit includes a display screen component for presenting images and a driving component for driving image display, which is used to receive image signals output from the controller and display video content, image content, menu control interface components and user control UI interface.

[0081] The display unit may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0082] When the display unit is a projection display, the display unit 60 includes a display driving and control unit 601 , a light source driving unit 602 , an optical machine unit 603 , a light source unit 604 , and a lens unit 605 .

[0083] The display driver and control unit 601 is configured to receive the video timing signal output by the main control circuit board 10 and perform decoding and format conversion, perform brightness processing, clarity processing, color processing on the image, perform geometric correction, drive the galvanometer action to improve the resolution, and finally perform format conversion to output the video timing signal and DMD control signal required by the DMD; it is also configured to drive the cooling fan, detect the temperature of the laser of the light source unit and the ambient temperature through the NTC, control the enablement of the light source unit, etc.

[0084] The light source driving unit 602 is configured to receive the light source brightness signal and the enable signal from the display driving and control unit 601 to drive the light source unit 604 to operate.

[0085] The light source unit 604 is configured to convert the current signal input by the light source driving unit 602 into a light source signal of the projection display system, and perform light combining and light homogenization processing on the light source signal.

[0086] The optical-mechanical unit 603 is configured to receive the white light signal from the light source unit 604 , and after the white light signal is irradiated to the DMD (Digital Micromirror Device), an image is formed.

[0087] The DMD 6031 is electrically connected to the display driving and control unit 601 through a DMD socket and a DMD adapter board, and is configured to receive a video timing signal and a DMD control signal, and adjust the angle of the optical mirror according to the obtained signal.

[0088] The lens unit 605 is configured to receive the image from the optical unit 603, magnify it, and finally project it onto a target object, which may be a screen, a wall, or the like.

[0089] The detector 20 is configured to collect signals of the external environment or the external interaction. For example, the detector 20 includes an ambient light collector, a sensor for collecting the intensity of ambient light; or, the detector 20 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 20 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0090] The external device interface 40 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces, or a key for controlling the power-on or standby state of the projection display device.

[0091] The communicator 70 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The projection display device 500 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 70.

[0092] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote controller, etc.).

[0093] The audio output interface 30 is configured to output the audio signal output by the main control circuit board 10, including an optical fiber digital audio output 301, which is configured to be electrically connected to a speaker that can perform digital decoding and use the speaker to play the audio signal; or, includes multiple power amplifiers 302 and multiple channel speakers, which are used to receive audio data of each channel and play the audio data after power amplification.

[0094] More specifically, each power amplifier 302 is electrically connected to the main control circuit board 10 via an I2C (Inter-Integrated Circuit) bus and an I2S (Inter-IC Sound) bus, receives a control signal via the I2C bus, receives an audio signal via the I2S bus, and amplifies the audio signal under the control of the control signal. Each power amplifier 302 corresponds to a different channel.

[0095] Each channel speaker 303 and each power amplifier 302 are electrically connected one by one, and are configured to play the audio signal after the corresponding channel power is amplified to present a more dynamic and three-dimensional sound effect, show more sound details, and help improve the user's audio-visual experience.

[0096] The main controller 101 processes the audio data as follows: Figure 3 and Figure 4 shown.

[0097] exist Figure 3 and Figure 4In the embodiment, the main controller 101 receives signals transmitted by multiple signal sources, including ATV signal source, AV signal source, DTV signal source, HDMI signal source, DMP, and network signal source. Among them, the ATV signal is an analog TV broadcast signal, the AV signal is a composite video signal CVBS, the DTV signal is a digital TV broadcast signal, the HDMI signal is an HDMI high-definition digital audio and video signal, the DMP signal is an audio and video signal of a USB device (such as a USB flash drive), and the network signal source is an audio and video signal obtained through a wired or wireless network connection.

[0098] Among them, the signals obtained by the ATV signal source and the AV signal source are analog signals, which are converted into digital signals through the digital-to-analog converter ADC. The digital signals are original audio signals. The encoding forms of the DTV signal source, HDMI signal source, OMP and network signal source cannot be directly processed by the main controller 101. The audio demodulator decodes the audio signals of various encoding formats in the signal source, generates a signal in a unified encoding form, and determines the signal as an original audio file. After the data of each signal source is processed, it is delayed and waits for the signal source switch to call the original audio file.

[0099] The signal source switching switch is provided with a plurality of input terminals and an output terminal. Each input terminal obtains the original audio file of each signal source. By connecting the input terminal with the output terminal respectively, the original audio file obtained by the input terminal is transmitted to the output terminal.

[0100] The main controller 101 is configured to perform pre-frequency division processing according to the file frequency after obtaining the original audio file, and obtain multiple original audio sub-files, each of which is located in a different frequency band. Figure 3 In the embodiment shown, the frequency bands are divided according to three channels. Figure 4 In the illustrated embodiment, frequency band division is performed according to two channels.

[0101] For each original audio sub-file, volume curve adjustment, automatic volume control, sound mode GEQ processing and sound balance processing are performed in sequence. Among them, volume curve adjustment is to adjust the volume of the audio sub-file to form different volume curves; automatic volume control is due to the unfixed audio level in the signal source, and the output volume level is automatically adjusted to maintain the stability of the sound, reduce or eliminate popping sounds, and amplify smaller sounds to an appropriate range; sound mode GEQ processing is used to adjust the volume of different frequency ranges and the volume ratio of different frequencies of the sound, which can modify the timbre and make the sound have different textures; sound balance processing is to adjust the balance of the left and right channels, that is, to adjust the volume of the left and right channels.

[0102] The main controller 101 is also configured to perform sound effect processing on each audio sub-file to enhance the sound effect. The sound effect processing includes: bass enhancement, virtual surround, dialogue enhancement, etc.

[0103] After the sound effect processing is completed, the main controller 101 transmits each audio sub-file to the corresponding power amplifier according to the frequency band and volume amplitude of each audio sub-file. After power amplification, it is transmitted to the corresponding speaker for playback to present a more dynamic and three-dimensional sound effect and show more sound details, which helps to improve the user's audio-visual experience.

[0104] However, due to the processing error of the projection display device, the preset playback properties of the sound speaker and the sub-data being played are inconsistent, resulting in errors in the sound effects played by the projection display device, which reduces the user's audio-visual effect. For example: when "people talking" appears in the program source, the main channel and the sky sound channel speakers sound together, and the surround sound channel emits "human voices". There will be a mismatch between the frequency of the sound device and the program source, resulting in errors in the sound effect, thereby affecting the user's audio-visual effect. Another example: when the program source is "high-frequency sounds emitted by musical instruments, etc.", only the surround sound channel speakers sound. If the main channel also emits "high-frequency sounds emitted by musical instruments, etc." at this time, it is also a phenomenon of error in the sound effect, thereby affecting the user's audio-visual effect.

[0105] Therefore, how to improve the consistency of the playback attributes of the speaker and the playback attributes of the sub-data it plays and improve the user's audio-visual effect has become a research focus.

[0106] In order to solve the above problems, the present application provides a projection display device and a control method. The technical concept of the present application is: sampling the playback audio data during the audio playback of the speaker, comparing the sampled data with the audio data output by the main controller to determine whether each speaker correctly plays the corresponding audio, and correcting it when it is determined that there is a problem, so as to ensure the consistency of the playback attributes of the speaker and the playback attributes of the sub-data it plays.

[0107] Figure 5 FIG. 1 is a schematic diagram of a projection display device according to an exemplary embodiment of the present application. Figure 5 As shown, the projection display device includes a main control circuit board 10, a detector 20, an audio output interface 30, an external device interface 40, a power supply unit 50, a display unit 60, a communicator 70, a memory, a user interface and a sampling device 80. The audio output interface 30 includes a plurality of audio outputters and a plurality of power amplifiers.

[0108] The main control circuit board 10 includes a main controller 101, which is configured to perform sound effect processing on the obtained original audio data, obtain initial audio data of each channel, and transmit each initial audio data to a power amplifier corresponding to the channel.

[0109] The power amplifier is configured to obtain initial audio data, amplify the power of the initial audio data, and then output the amplified audio data.

[0110] Each audio output device is electrically connected to each power amplifier, corresponds to a channel one by one, and is configured to obtain and play the power-amplified initial audio data from the power amplifier. In one embodiment, the audio output device includes a speaker.

[0111] The sampling device is electrically connected to the audio output device, and is configured to sample the initial audio data played by the audio output device and output the sampled audio data.

[0112] More specifically, the input end of the audio outputter serves as a sampling end and is electrically connected to the input end of the sampling device. The sampling device is configured to sample the audio data actually played from the input end of the audio outputter when the audio outputter plays the audio data.

[0113] The main controller 101 is electrically connected to the output end of the sampling device 80 and is configured to obtain sampled audio data from the sampling device and output target audio data to the audio outputter when the error between the sampled audio data and the initial audio data is outside a preset correction error range.

[0114] The errors between the sampled audio data and the original audio data include but are not limited to: audio amplitude error and audio frequency error.

[0115] The audio outputter is also configured to play the target audio data.

[0116] In one embodiment, when the level standard of the audio data obtained at the input end of the sampling device is inconsistent with the level standard of the input end of the main controller for obtaining the sampled data, the sampling device performs level matching on the sampled audio data, adjusts the level of the audio data obtained at its input end, and then transmits it to the main controller 101.

[0117] In the above technical solution, when the projection display device uses the audio outputter to play the initial audio data output by the main controller, the played data is sampled to obtain sampled audio data to monitor whether there is a deviation between the audio data output by the main controller to at least one channel and the audio data actually played by the audio outputter. When the error between the sampled audio data and the initial audio data is outside the preset correction error range, the target audio data is output to the audio outputter, so that the audio outputter can correctly play the audio data of the corresponding channel, thereby improving the user's audio-visual effect.

[0118] The following is a detailed explanation of the process in which the main controller 101 compares the sampled audio data with the initial audio data of the corresponding channel and processes the comparison result.

[0119] The main controller 101 is configured to obtain the amplitude information and frequency information of the sampled audio data and the amplitude information and frequency information of the initial audio data when comparing the sampled audio data with the initial audio data of the corresponding channel.

[0120] The main controller 101 compares the amplitude information of the sampled audio data with the amplitude information of the initial audio data. When the difference between the amplitude information of the sampled audio data and the amplitude information of the initial audio data is outside the amplitude correction threshold range, it is determined that the error between the sampled audio data and the initial audio data is outside the preset correction error range, and the audio output device has a playback error. In one embodiment, it indicates that the balance processing of the left and right speakers is reversed, and the audio data of the left channel is erroneously transmitted to the right speaker, and the audio data of the right speaker is erroneously transmitted to the left speaker.

[0121] The main controller 101 compares the frequency information of the sampled audio data with the frequency information of the initial audio data. When the difference between the frequency information of the sampled audio data and the frequency information of the initial audio data is outside the frequency correction threshold range, it is determined that the error between the sampled audio data and the initial audio data is outside the preset correction error range, and the audio output device has a playback error. In one embodiment, the frequency of the sound played by the audio output device of the channel is not within the frequency band corresponding to the channel, and the sound played by the audio output device is wrong.

[0122] When the main controller 101 determines that the error between the sampled audio data and the initial audio data is outside the preset correction error range, it performs audio correction and outputs the corrected target audio data to the audio output device that determines that there is a playback error. That is, the initial audio data of the channel corresponding to the sampled audio data is determined as the target audio data and transmitted to the audio output device of the channel corresponding to the sampled audio data.

[0123] In one embodiment, the frequency of the sampled audio data sampled by the audio output device is within the frequency correction threshold range of the frequency of the initial audio data, but the amplitude thereof is outside the amplitude correction threshold range of the amplitude of the initial audio data, then the main controller 101 re-determines the audio amplitude of the audio data to be played by the corresponding channel of the audio output device, and transmits the audio data with the determined audio amplitude as the target audio data to the audio output device for playback.

[0124] In one embodiment, the frequency of the sampled audio data sampled by the audio outputter and the frequency of the initial audio data are outside the frequency correction threshold range, and the frequency of the audio data that the audio outputter should play in the current time period is greater than 0, then the main controller 101 re-determines the audio data corresponding to the frequency band that the corresponding channel of the audio outputter should play, and transmits the audio data as the target audio data to the audio outputter for playback.

[0125] In one embodiment, the frequency of the sampled audio data sampled by the audio outputter and the frequency of the initial audio data are outside the frequency correction threshold range, and the audio outputter does not play audio data in the current time period, that is, the audio outputter erroneously plays audio data that is not within its corresponding frequency band, then the main controller 101 determines the empty audio data as the target audio data, and the audio player stops playing based on the empty audio data.

[0126] In the case where the number of input terminals for obtaining sampled audio data by the main controller 101 is less than the number of sampled audio data generated by the sampling device 80 after sampling the audio output device, the structural diagram of the projection display device is as follows: Figure 6 shown.

[0127] Compared to Figure 5 The circuit structure shown, Figure 6 The circuit structure shown also includes at least one audio signal switching switch 90, each audio signal switching switch 90 is provided with a plurality of sampling audio data input terminals, at least one control signal input terminal and an output terminal, the sampling audio data input terminal is electrically connected to the output terminal of the sampling device, the control signal input terminal is electrically connected to the control signal output terminal of the main controller, and the output terminal is electrically connected to the sampling signal input terminal of the main controller.

[0128] The audio signal switching switch 90 is configured to obtain a control signal GPIO from a control signal input terminal, and control the sampling audio data input terminal to be connected to the output terminal respectively according to the control signal GPIO, and transmit the sampled audio data obtained by the sampled audio data input terminal to the output terminal, so that the main controller 101 can obtain the sampled audio data obtained by the audio signal switching switch 90, and perform data correction on the audio data played by the channel speaker corresponding to the sampled audio data.

[0129] In one embodiment, the audio signal switching switch 90 is configured to control each sampled audio data input terminal to be connected to the output terminal in turn in each polling cycle according to the control signal GPIO, and transmit the sampled audio data obtained by the sampled audio data input terminal to the output terminal, so that the main controller 101 can obtain all the sampled audio data from each sampled audio data input terminal in each polling cycle, and compare the sampled audio data with the initial audio data of the corresponding channel in the order in which the sampled audio data is obtained, and perform audio correction when a playback error is determined.

[0130] For each audio signal control switch, the playback process diagram of the main controller is as follows: Figure 7As shown, the signal source switching switch selects a target signal source from multiple signal sources, and transmits the audio data of the target signal source to the main controller 101. After the main controller performs pre-frequency division processing, volume curve adjustment, automatic volume control, sound mode GEQ processing, sound balance processing and sound effect processing on the audio data, the audio data is transmitted to the power amplifier 302 of at least one corresponding target channel according to the frequency of the audio data. After power amplification by the power amplifier 302, the audio data is played using the channel speaker 303, wherein the frequency of each audio data after frequency division is within the frequency band of each target channel.

[0131] The sampling device 80 samples the audio data being played, obtains sampling signals REF1-REFN, and transmits the sampling signals to the sampling audio data input terminal of the audio signal switching switch 90 after level adjustment. The audio signal switching switch 90 obtains a plurality of control signals GPIO1-GPIOM from the main controller 101, determines the address of each sampling audio data input terminal in the audio signal switching switch 90 in sequence according to the plurality of control signals, and transmits the sampling audio data obtained by the sampling audio data input terminal of the address to the main controller 101 through the output terminal, so that the main controller 101 uses the sampling audio data to perform playback audio correction on the channel that samples the sampling audio data.

[0132] In order to ensure that M control signals can control the N input terminals of the audio signal switching switch, 2 M ≥N, M and N are both positive integers.

[0133] In one embodiment, the number of channels sampled by each audio signal switching switch 90 is 2, and the schematic diagram of the playback process of two-channel audio data is as follows: Figure 8 As shown. Figure 8 In the embodiment, the main controller 101 transmits a control signal GPIO to each audio signal switching switch. The level state of the control signal includes two states: high level and low level. By adjusting the level state of each control signal, the address of the input terminal connected to the output terminal is determined, so as to sequentially obtain the sampled audio data obtained by the two sampled audio data input terminals. Table 1 is a control truth table of the audio signal switching switch 90 for two channels. In each polling cycle, the main controller 101 adjusts the level state of the control signal GPIO according to the truth table to obtain the sampled audio data of the two channels.

[0134] Table 1 Two-channel control truth table

[0135] GPIO The sampled audio data obtained from the sampled audio data input terminal of the main controller Low level REF1 High level REF2

[0136] In another embodiment, the number of channels sampled by each audio signal switching switch 90 is 3, and the playback process diagram of the three-channel audio data is as follows: Fig. 9 As shown. Fig. 9In the embodiment, the main controller 101 transmits two control signals GPIO1 and GPIO2 to each audio signal switching switch. The two control signals can determine that the maximum number of input terminals connected to the output terminal of the audio signal switching switch is 4. For the transmission of sampled audio data of three channels, any three input terminals can be electrically connected to the audio output devices corresponding to the three channels, and the sampled audio data can be obtained from the above three input terminals. Table 2 is a control truth table of the audio signal switching switch 90 for three channels. In each polling cycle, the main controller 101 transmits each control signal in sequence according to the truth table to obtain sampled audio data of two channels.

[0137] Table 2 Three-channel control truth table

[0138] GPIO1 GPIO2 The sampled audio data obtained from the sampling signal input of the main controller Low level Low level REF1 Low level High level REF2 High level Low level REF3 High level High level Not used

[0139] In the above technical solution, when the input end of the main controller for obtaining sampled audio data is less than the number of channels, at least one audio signal switching switch is electrically connected between the sampled audio data input end of the main controller and the sampling device, and each audio signal switching switch obtains sampled audio data from the sampling device, and outputs the sampled audio data from its output end to the sampling signal input end of the main controller, so that the main controller can obtain the sampled audio data obtained after sampling at least one channel using fewer sampling signal input ends, which not only ensures the accuracy of subsequent audio signal output correction, but also improves the utilization rate of the sampling signal input end of the main controller.

[0140] In some embodiments, the main controller 101 is further provided with a far-field voice signal input terminal so that the projection display device can perform far-field voice processing to provide the user with a far-field voice function. The far-field voice function refers to the function that the user can control the projection display device by voice without the aid of a control device.

[0141] When the user calls the far-field voice function, the far-field voice is obtained from the far-field voice mic. After filtering out the target voice data from the far-field voice, semantic recognition is performed on the target voice data to obtain command information. In response to the command information, the projection display device is controlled to perform corresponding operations.

[0142] Fig.10 The present application provides a schematic diagram of a far-field speech processing flow in a speaker playback scenario according to an exemplary embodiment. Fig.10 As shown, when at least one audio output device plays audio data, the main controller 101 obtains far-field voice from the far-field voice signal input terminal (far-field voice mic), and the far-field voice includes the audio data played by the first channel speaker, the target voice data emitted by the user, and the ambient sound.

[0143] The sampling device obtains the audio data being played and amplified from the input end of the first channel speaker, and after level adjustment, outputs the sampled audio data in the same level range as the output signal of the main controller 10. Since the sampled audio data is analog audio data, and the signal processed by the main controller 101 is digital audio data, the sampling device transmits the sampled audio data to the AD converter for electrical signal conversion, and outputs the sampled audio data in the form of digital audio data to the main controller.

[0144] The main controller 101 performs echo cancellation on the far-field voice according to the sampled audio data to obtain the target voice signal. That is to say, the ambient sound and the sound played by the first channel speaker are removed from the far-field voice. The main controller 101 uses the semantic analysis model trained locally, or calls the semantic analysis model in the server, to perform semantic recognition on the target voice signal, obtain the instruction information, and respond to the instruction information to control the projection display device to perform the corresponding operation.

[0145] It is worth noting that the sound played by the first channel speaker is in the human voice frequency band.

[0146] The echo cancellation algorithm AEC, speech recognition algorithm and audio correction algorithm of far-field speech are all implemented by the main controller. The following explains the processing process of the projection display device when obtaining far-field speech during audio correction.

[0147] In one embodiment, the master controller includes a first CPU core and a second CPU core.

[0148] The first CPU core is configured to process far-field speech. When processing the far-field speech, the first CPU core performs echo cancellation on the far-field speech, obtains target speech data, performs semantic recognition on the target speech data, obtains instruction information, and controls the projection display device to perform operations corresponding to the instruction information.

[0149] The second CPU core is configured to perform audio correction, wherein the process of audio correction has been explained in detail in the above embodiments and will not be repeated here.

[0150] In the above technical solution, the main controller is configured to use two CPU cores to correct the audio data and process the far-field voice respectively. Since the two CPU cores can process in parallel, the main controller can correct the audio data and process the far-field voice at the same time, and the two functions can be responded to in real time.

[0151] In another embodiment, the main controller includes a first CPU core, the first CPU core includes a first thread and a second thread, and the processing priority of the first thread is higher than that of the second thread.

[0152] The main controller 101 is configured to, when the second thread processes the audio data for correction, obtain the far-field voice by the first thread, control the second thread to interrupt the correction process of the audio data, use the first thread to perform echo elimination on the far-field voice, obtain the target voice data, perform semantic recognition on the target voice data, obtain the instruction information, control the projection display device to perform the operation corresponding to the instruction information, and after the operation of the first thread is completed, control the second thread to continue the audio correction.

[0153] In one embodiment, during the process of far-field speech processing by the main controller, if the main controller has only one sampling signal input terminal, then in the processing process of the above two embodiments, the main controller can only obtain sampled audio data sampled for one channel at the same time. In order to ensure the accuracy of echo cancellation of far-field speech, the above method can only be applied to the processing of far-field speech generated in a scenario where only one channel outputs audio data within the human voice frequency band.

[0154] In other embodiments, the audio correction algorithm is implemented by the main controller, and the far-field voice echo cancellation algorithm AEC and the voice recognition algorithm are implemented by the far-field voice DSP processing chip electrically connected to the main controller 101. The circuit connection relationship of the far-field voice DSP processing chip in the projection display device is as follows: Fig.11 shown.

[0155] exist Fig.11 In the circuit connection relationship shown, the projection display device also includes a far-field voice DSP processing chip 94 and an AD converter 93.

[0156] The input end of the AD converter 93 is electrically connected to the input end of the sampling device 80, and is configured to obtain sampled audio data of each channel and convert the sampled audio data into a digital signal; wherein the sampled audio data is an analog signal.

[0157] The main controller 101 is also provided with a far-field voice signal input terminal and a first interaction terminal, and is configured to obtain far-field voice from the far-field voice signal input terminal and output the far-field voice from the first interaction terminal when at least one audio output device plays audio data; the far-field voice includes the played audio data, the target voice data emitted by the user, and the ambient sound.

[0158] The input end of the far-field voice DSP processing chip 94 is electrically connected to the output end of the AD converter 93, and its second interactive end is electrically connected to the first interactive end of the main controller, and is configured to simultaneously obtain digital voice data corresponding to each channel from the input end, obtain far-field voice from the first interactive end, perform echo elimination on the far-field voice according to the digital signal, obtain target voice data, perform semantic recognition on the target voice data, obtain command information, and transmit the command information to the first interactive end.

[0159] The main controller 101 is also configured to obtain instruction information and control the projection display device to perform operations corresponding to the instruction information.

[0160] In some embodiments, a far-field voice application layer function is provided in the main controller. When this function is turned on, the main controller can receive the command information obtained after the far-field voice DSP chip processes the far-field voice, and respond to the command information; when this function is turned off, the main controller cannot receive the command information obtained after the far-field voice DSP chip processes the far-field voice, nor can it respond to the command information.

[0161] In the above technical solution, a far-field voice DSP processing chip is provided in the projection display device to process the far-field voice, which not only saves CPU computing power, but also enables the projection display device to simultaneously perform the far-field voice processing process and the audio data correction process, thereby realizing multi-demand and multi-task concurrent processing, and achieving the effect that both applications can respond in real time. In addition, when processing the far-field voice in a scenario where the audio output device outputs multi-channel audio data in the human voice frequency band, the digital signals sampled for each channel can be simultaneously obtained through the input end of the far-field voice DSP processing chip to ensure the accuracy of the far-field voice processing.

[0162] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0163] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A projection display device, characterized in that: The projection display device comprises: A main controller, configured to generate initial audio data of at least one channel; At least one audio output device, corresponding to each channel one by one, and configured to play the initial audio data of the corresponding channel; a sampling device, electrically connected to the audio output device, configured to sample the initial audio data played by the audio output device and output the sampled audio data; The main controller is electrically connected to the sampling device and is further configured to output target audio data to the audio output device when an error between the sampled audio data and the initial audio data is outside a preset correction error range; The audio output device is further configured to play the target audio data.

2. The projection display device according to claim 1, characterized in that: The preset correction error range includes an amplitude correction threshold range; When the error between the sampled audio data and the initial audio data is outside a preset correction error range, outputting target audio data to the audio output device specifically includes: When the difference between the amplitude information of the sampled audio data and the amplitude information of the initial audio data is outside the amplitude correction threshold range, the initial audio data of the channel corresponding to the sampled audio data is determined as the target audio data and transmitted to the audio output device of the channel corresponding to the sampled audio data.

3. The projection display device according to claim 1 or 2, characterized in that: The preset correction error range includes a frequency correction threshold range; When the error between the sampled audio data and the initial audio data is outside a preset correction error range, outputting target audio data to the audio output device specifically includes: When the difference between the frequency information of the sampled audio data and the frequency information of the initial audio data is outside the frequency correction threshold range, the initial audio data of the channel corresponding to the sampled audio data is determined as the target audio data and transmitted to the audio output device of the channel corresponding to the sampled audio data.

4. The projection display device according to claim 1, characterized in that: The main controller is provided with at least one sampling signal input terminal and at least one control signal output terminal, the sampling device is provided with a plurality of output terminals, and the projection display device further comprises at least one audio signal switching switch; Each of the audio signal switching switches is provided with a plurality of sampling audio data input terminals, at least one control signal input terminal and an output terminal, wherein the sampling audio data input terminal is electrically connected to the output terminal of the sampling device, the control signal input terminal is electrically connected to the control signal output terminal of the main controller, and the output terminal is electrically connected to the sampling signal input terminal, and is configured as follows: A control signal is obtained from the control signal input end, and the sampled audio data input end and the output end are connected according to the control signal control to obtain the sampled audio data, and the sampled audio data of the sampled audio data input end is transmitted to the output end.

5. The projection display device according to claim 4, characterized in that: For each of the audio signal switching switches, when there are M control signal input terminals and N sampled audio data input terminals, 2 M ≥N, M and N are both positive integers.

6. The projection display device according to claim 1, characterized in that: The main controller is also provided with a far-field voice signal input terminal, and is further configured as follows: When at least one audio output device plays audio data, obtaining far-field voice from the far-field voice signal input terminal, the far-field voice including the played audio data, target voice data emitted by the user, and ambient sound; Acquire the sampled audio data of the channel corresponding to the played audio data from the sampling device; According to the sampled audio data, echo cancellation is performed on the far-field voice to obtain target voice data; Performing semantic recognition on the target voice data to obtain instruction information; In response to the instruction information, the projection display device is controlled to perform a corresponding operation.

7. The projection display device according to claim 6, characterized in that: The main controller includes a first CPU core and a second CPU core; The first CPU core is configured to perform echo cancellation on the far-field voice, obtain target voice data, perform semantic recognition on the target voice data, obtain instruction information, and control the projection display device to perform an operation corresponding to the instruction information; The second CPU core is configured to perform audio correction; The first CPU core and the second CPU core are processed in parallel.

8. The projection display device according to claim 7, characterized in that: The main controller includes a first CPU core, the first CPU core includes a first thread and a second thread, and the processing priority of the first thread is higher than that of the second thread; The main controller is also configured to: When the second thread performs audio correction, the first thread obtains the far-field voice and controls the second thread to interrupt the audio correction; Using the first thread to perform echo cancellation on the far-field voice, obtain target voice data, perform semantic recognition on the target voice data, obtain instruction information, and control the projection display device to perform an operation corresponding to the instruction information; After the first thread completes its operation, the second thread is controlled to continue audio correction.

9. The projection display device according to claim 1, characterized in that: The projection display device also includes a far-field voice DSP processing chip and an AD converter; The input end of the AD converter is electrically connected to the input end of the sampling device, and is configured to obtain sampled audio data of at least one channel and convert the sampled audio data into digital audio data; wherein the sampled audio data is analog audio data; The main controller is also provided with a far-field voice data input terminal and a first interactive terminal, and is configured to obtain far-field voice from the far-field voice data input terminal when at least one audio output device plays audio data, and output the far-field voice from the first interactive terminal; the far-field voice includes the played audio data, the target voice data emitted by the user, and the ambient sound; The input end of the far-field voice DSP processing chip is electrically connected to the output end of the AD converter, and the second interactive end is electrically connected to the first interactive end of the main controller, and is configured to simultaneously obtain digital audio data corresponding to each channel from the input end, obtain the far-field voice from the first interactive end, perform echo cancellation on the far-field voice according to the digital audio data, obtain target voice data, perform semantic recognition on the target voice data, obtain instruction information, and transmit the instruction information to the first interactive end; The main controller is further configured to obtain the instruction information and control the projection display device to perform an operation corresponding to the instruction information.

10. A method for controlling a projection display device, used for the projection display device according to any one of claims 1 to 9, characterized in that: The method comprises: When the audio output device plays the initial audio data, the initial audio data is sampled by the sampling device to obtain sampled audio data; When the error between the sampled audio data and the initial audio data of the corresponding channel is outside a preset correction error range, the target audio data is output to the corresponding audio outputter, so that the audio outputter outputs the target audio data.

Images