Display device and audio playback method based on position detection

By using position detection technology, smart TVs play test audio using both the built-in speaker and external speakers, collect sound signals, locate the speaker positions, and set the output paths. This solves the problem of speakers and external audio devices not being able to output simultaneously, thus improving audio playback quality.

CN115866501BActive Publication Date: 2025-11-28SHENZHEN XINYANG CHUANGZHI TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111127662.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-26
Publication Date
2025-11-28
Estimated Expiration
2041-09-26

AI Technical Summary

Technical Problem

The audio link of smart TVs does not support simultaneous output from speakers and external audio devices, which means that the audio output quality depends on the hardware configuration of the external devices and cannot meet users' needs for high-quality audio output.

Method used

By using position detection technology, the system acquires user-input control commands, plays test audio using the local speaker and external speakers, collects sound signals, locates the speaker positions based on the measurement results, and sets the audio data output path to achieve matched audio data output.

Benefits of technology

It enables simultaneous output from both the built-in speaker and external speakers, improving audio playback quality and meeting users' needs for high-quality audio output.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115866501B_ABST
    Figure CN115866501B_ABST
Patent Text Reader

Abstract

The application provides a display device and an audio playing method based on position detection. After a user inputs a control instruction for setting an audio output path, the method can play test audio through a local speaker and an external speaker respectively, and collect a test result signal of the test audio through a sound collector, so as to locate the positions of the speakers according to the test result signal and set the output path of audio data according to the speaker positions. The method can make the audio data output through the local speaker and the external speaker simultaneously, set the output path according to the speaker positions by detecting the speaker positions, match the audio output channel with the speaker positions, and improve the audio playing effect.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent display devices, and in particular to a display device and an audio playing method based on position detection. BACKGROUND

[0002] A display device refers to a terminal device capable of outputting a specific display picture, which can be a smart television, a mobile terminal, a smart advertising screen, a projector, or the like. Taking a smart television as an example, a smart television is based on Internet application technology, has an open operating system and a chip, has an open application platform, and has a bidirectional man-machine interaction function, and integrates a variety of functions such as audio, entertainment, and data into one, for meeting the diversified and personalized needs of users.

[0003] The smart television is also provided with an external device interface, and the smart television can connect an external device capable of outputting audio or video through the external device interface, so as to output the sound or picture played by the smart television through the external device. For example, in order to improve the output sound quality of the smart television, a bar-shaped sound equipment can be connected to the smart television. When the smart television plays audio data or video data with sound, the smart television can send the sound signal obtained by parsing to the bar-shaped sound equipment, so as to output the specific sound through the bar-shaped sound equipment.

[0004] Since the smart television audio link does not support the simultaneous output of signals by the audio output interface and the built-in loudspeaker system, the built-in loudspeaker of the smart television and the external sound equipment are mutually exclusive and cannot support simultaneous sound emission. After the external sound equipment is connected to the smart television, the built-in loudspeaker of the smart television is always in a non-use state, and the audio output effect of the smart television only depends on the hardware configuration of the external sound equipment, which cannot meet the needs of some users for high-quality audio output effect. SUMMARY

[0005] The present application provides a display device and an audio playing method based on position detection, to solve the problem of mismatch between the audio output channel and the position of the conventional display device.

[0006] In one aspect, the present application provides a display device, comprising a display, a local loudspeaker, an external device interface, a sound collector, and a controller. The display is configured to display a user interface. The local loudspeaker is configured to play audio data and test audio. The external device interface is configured to connect an external device, the external device comprising at least one external loudspeaker, the external loudspeaker also being configured to play audio data and test audio. The sound collector is configured to detect a sound signal. The controller is configured to perform the following program steps:

[0007] obtaining a control instruction input by a user for setting an output path;

[0008] in response to the control instruction, playing test audio through the native speaker and the external speaker, the test audio comprising a plurality of audio signals, each of the audio signals being output through a separate audio output channel;

[0009] receiving a measurement result signal collected by the sound collector for the test audio;

[0010] locating a speaker position according to the measurement result signal, and setting an output path of the audio data according to the speaker position.

[0011] In another aspect, the application also provides an audio playing method based on position detection, applied to the display device provided in the first aspect, and the method comprises the following steps:

[0012] obtaining a control instruction for setting an output path input by a user;

[0013] in response to the control instruction, playing test audio through the native speaker and the external speaker, the test audio comprising a plurality of audio signals, each of the audio signals being output through a separate audio output channel;

[0014] receiving a measurement result signal collected by the sound collector for the test audio;

[0015] locating a speaker position according to the measurement result signal, and setting an output path of the audio data according to the speaker position.

[0016] According to the above technical solution, the display device and the audio playing method based on position detection provided by the application can play test audio through the native speaker and the external speaker respectively after the user inputs a control instruction for setting an audio output path, and collect a test result signal for the test audio through the sound collector, so as to locate the positions of the speakers according to the test result signal, and set the output path of the audio data according to the speaker positions. The method can make the audio data output through the native speaker and the external speaker simultaneously, and set an output path suitable for the speaker positions by detecting the speaker positions, so as to match the audio output channel with the speaker positions, and improve the audio playing effect. BRIEF DESCRIPTION OF DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the application, the following will briefly introduce the drawings needed to be used in the embodiments. Obviously, for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0018] Figure 1A use scenario of a display device in an embodiment of the present application;

[0019] Figure 2 A hardware configuration block diagram of a control device in an embodiment of the present application;

[0020] Figure 3 A hardware configuration diagram of a display device in an embodiment of the present application;

[0021] Figure 4 A software configuration diagram of a display device in an embodiment of the present application;

[0022] Figure 5 A connection diagram of an external device in an embodiment of the present application;

[0023] Figure 6 An interactive menu interface diagram in an embodiment of the present application;

[0024] Figure 7 A fusion mode audio system diagram in an embodiment of the present application;

[0025] Figure 8 An audio playing method flowchart based on position detection in an embodiment of the present application;

[0026] Figure 9 A setting menu diagram in an embodiment of the present application;

[0027] Figure 10 A flowchart of generating a measurement result signal in an embodiment of the present application;

[0028] Figure 11 A positioning loudspeaker position diagram in an embodiment of the present application;

[0029] Figure 12 An effect diagram of setting an external device as a front path in an embodiment of the present application;

[0030] Figure 13 An effect diagram of setting an external device as a middle path in an embodiment of the present application;

[0031] Figure 14 A playing test audio flowchart in an embodiment of the present application;

[0032] Figure 15 A first prompt interface diagram in an embodiment of the present application;

[0033] Figure 16 A second prompt interface diagram in an embodiment of the present application;

[0034] Figure 17 A flowchart of setting an output path according to a sound pressure difference in an embodiment of the present application;

[0035] Figure 18 This is a schematic diagram of the process of setting the output path based on the sound pressure judgment value in the embodiments of this application;

[0036] Figure 19 This is a schematic diagram illustrating the audio flow in the embodiments of this application;

[0037] Figure 20 This is a timing diagram of the location-detection-based audio playback method in the embodiments of this application. Detailed Implementation

[0038] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0039] Figure 1 This is a schematic diagram illustrating a usage scenario of the display device according to an embodiment. For example... Figure 1 As shown, the display device 200 also communicates with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100.

[0040] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via a wired connection. Users can control the display device 200 by inputting user commands through at least one method, such as buttons on the remote control, voice input, or control panel input.

[0041] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0042] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0043] Figure 3 A hardware configuration block diagram of the display device 200 according to an exemplary embodiment is shown.

[0044] In some embodiments, the display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a storage, a power supply, a user interface.

[0045] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an n-th interface for input / output.

[0046] In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving the image display, a component for receiving an image signal originated from the controller output, and performing a display video content, an image content, and a menu manipulation interface, and a user manipulation UI interface, etc.

[0047] In some embodiments, the display 260 can be at least one of a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.

[0048] In some embodiments, the tuner and demodulator 210 receives a broadcast television signal through a wired or wireless reception method, and demodulates an audio and video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals.

[0049] In some embodiments, the external device interface 240 can include, but is not limited to, any one or more of a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by a plurality of the above interfaces.

[0050] In some embodiments, the controller 250 controls the operation of the display device and responds to the user's operation by storing various software control programs on the storage. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command.

[0051] In some embodiments, the user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0052] In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the conversion between the internal form of information and the form that the user can accept. The commonly used form of the user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an icon, a window, a control, etc. displayed on the display screen of an electronic device, wherein the control can include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, etc.

[0053] In some embodiments, the system of the display device can include a kernel, a shell, a file system, and an application program. The kernel, the shell, and the file system together form a basic operating system structure, which allows the user to manage files, run programs, and use the system. After power-on, the kernel is started, the kernel space is activated, the hardware is abstracted, the hardware parameters are initialized, the virtual memory is run and maintained, the scheduler, the signal, and the inter-process communication (IPC) are maintained. After the kernel is started, the shell and the user application program are loaded. The application program is compiled into machine code after being started, forming a process.

[0054] Referring to Figure 4 In some embodiments, the system is divided into four layers from top to bottom, namely, an application (Applications) layer (referred to as "application layer"), an application framework (Application Framework) layer (referred to as "framework layer"), an Android runtime and system library layer (referred to as "system runtime library layer"), and a kernel layer.

[0055] In some embodiments, at least one application program is run in the application layer, which can be a window (Window) program, a system setting program, or a clock program, etc. provided by the operating system; or an application program developed by a third-party developer. In a specific implementation, the application program package in the application layer is not limited to the above examples.

[0056] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center that decides which application in the application layer to act. The application accesses resources in the system and obtains services of the system in execution through the API interface.

[0057] As shown in Figure 4 In the embodiment of the present application, the application framework layer includes managers (Managers) and content providers (Content Provider), wherein the managers include at least one of the following modules: an activity manager (ActivityManager) for interacting with all activities running in the system; a location manager (Location Manager) for providing access to system location services for system services or applications; a package manager (Package Manager) for retrieving various information related to application packages currently installed on the device; a notification manager (NotificationManager) for controlling the display and clearing of notification messages; and a window manager (Window Manager) for managing icons, windows, toolbars, wallpapers and desktop components on the user interface.

[0058] As shown in Figure 5 Based on the display device 200, the user can connect the external device 500 through the external device interface 240. The external device 500 can have audio and video output functions, i.e., can output sound and pictures. For example, the external device 500 can be a bar-shaped sound device with audio output function. The external device 500 can be connected to the external device interface 240 through a specific interface specification, such as a high-definition multimedia interface (HDMI), a universal serial bus (USB), etc. For example, the bar-shaped sound device can be connected to the display device 200 through a USB interface. When the display device 200 needs to output audio, the audio data can be sent to the bar-shaped sound device through the USB interface, and the bar-shaped sound device converts the audio data into a sound signal to realize audio output.

[0059] In some embodiments, the external device 500 can have a data processing function in addition to the output function, for controlling the output process of audio and video. For example, for a bar-shaped sound device, the audio transmitted by the display device 200 can be processed in terms of sound quality, so as to play the audio data in a specific output mode and obtain a corresponding sound quality effect. Therefore, the user can control the data processing function through an interactive action, i.e., set the output mode. For example, the bar-shaped sound device can support setting contents including sound effect mode, surround switch, treble adjustment, bass adjustment, display screen brightness adjustment, and factory reset.

[0060] The external device 500 can have a built-in local matching setting interactive mode, for example, buttons, knobs, switches, and other interactive components are provided on the bar-shaped sound device, and the user can adjust the interactive components on the bar-shaped sound device through pressing, rotating, and other operations, so as to complete the setting process. In some embodiments, the external device 500 can also support remote control setting, i.e., the external device 500 can be equipped with a remote control device. The remote control device is provided with function keys and is connected to the external device 500 through infrared, Bluetooth, and other wireless transmission modes. In the setting process, the user can input an interactive action corresponding to a function to be set through the keys on the remote control device, so as to send a wireless signal from the remote control device to the external device 500. After receiving the wireless signal, the external device 500 can complete the corresponding setting according to the interactive action.

[0061] In some embodiments, the setting function of the external device 500 can also be completed through the display device 200 after the external device 500 is connected to the display device 200, i.e., the user can input an interactive action based on the interactive mode of the display device 200. The display device 200 generates a setting instruction according to the interactive action and sends the setting instruction to the external device 500, so that the external device 500 can implement the corresponding setting according to the setting instruction after receiving the setting instruction.

[0062] In order to control the external device 500 through the display device 200, the display device 200 needs to establish a communication connection with the external device 500. The specific communication connection mode can be based on the external device interface 240. For example, the bar-shaped sound device can be connected to the display device 200 through an HDMI interface. When the display device 200 needs to output sound, the display device 200 can transmit audio data to the bar-shaped sound device through the time minimized differential signal (TMDS) pin of the HDMI interface. Furthermore, when the display device 200 needs to send a setting instruction to the bar-shaped sound device, the setting instruction can be transmitted to the bar-shaped sound device through the consumer electronic control (CEC) pin in the HDMI interface.

[0063] The display device 200 can also establish a communication connection with the external device 500 based on the communicator 220, for transmitting various instructions and / or audio / video data. The communicator 220 can implement wired or wireless connection modes based on different communication protocols. For example, the communicator 220 of the display device 200 can be built-in with a Bluetooth module, while the bar-shaped sound box is also provided with a Bluetooth module, and then the display device 200 can establish a communication connection with the bar-shaped sound box through Bluetooth connection.

[0064] Based on this, when the display device 200 needs to send a setting instruction to the bar-shaped sound box, the setting instruction can be sent to the external device 500 through the communicator 220. For example, as shown in FIG. 6, when the volume needs to be adjusted, the user can enter an interactive menu interface related to the external sound box through the control device 100, and select a volume option in the interactive menu to input a setting instruction for increasing or decreasing the volume. The display device 200 then sends the setting instruction to the bar-shaped sound box through the Bluetooth module in the communicator 220. The bar-shaped sound box can then increase the gain of the audio output channel according to the setting instruction to increase or decrease the output volume after receiving the setting instruction. Figure 6

[0065] For different types of external devices 500, the communication modes supported by them are also different. Some external devices 500 can support multiple communication modes, while some external devices 500 only support one communication mode. For example, for some high-end bar-shaped sound boxes, analog, optical fiber or coaxial cable interfaces can be supported for transmitting audio data, and Bluetooth, ARC (Audio Return Channel), HDMI IN interfaces and the like can be supported for transmitting instructions related to audio. While for some low-end bar-shaped sound boxes, only analog signal interfaces can be supported for transmitting audio data, and Bluetooth communication can be supported for transmitting instructions.

[0066] Different data / instruction transmission modes can also be used to achieve audio / video output and control functions for different types of external devices 500. For example, for a low-end bar-shaped sound box, the external device interface 240 of the display device 200 can be connected through an analog signal line to obtain audio data from the display device 200 through analog signals. At the same time, the bar-shaped sound box can also establish a communication connection with the display device 200 through Bluetooth. Then during use, the display device 200 can send audio data to the bar-shaped sound box through the external device interface 240. At the same time, when it is necessary to control and adjust the volume, sound quality and other operating parameters of the bar-shaped sound box, a setting instruction can be sent to the bar-shaped sound box through the Bluetooth module of the communicator 220.

[0067] ​In some embodiments, audio data and setting instructions can be obtained from the display device 200 simultaneously through the HDMI interface without connecting the Bluetooth module additionally. In addition, for the external device 500 supporting wireless playing function such as Bluetooth speaker, audio data and setting instructions can also be transmitted simultaneously through Bluetooth connection to output audio through the Bluetooth speaker and perform setting on the external device 500 through the display device 200.

[0068] In order to consider various types of external devices 500, in some embodiments of the present application, the display device 200 connects the external device 500 through the external device interface 240 to transmit audio and video data; at the same time, the display device 200 also establishes a communication connection with the external device 500 through the communicator 220 to transmit setting instructions. Such data / instruction transmission mode can not only consider various types of external devices 500, but also reduce the delay and lag of audio and video output process by using the transmission timeliness of the external device interface 240.

[0069] After the display device 200 connects the external device 500, the original audio and video data output mode will be changed. For example, when the display device 200 connects the sound equipment, the audio signal generated by the display device 200 when playing the media data will be output by the connected sound equipment, and the local speaker of the display device 200 will stop working. Such audio output mode can make the display device 200 obtain the audio output effect of the external sound equipment and improve the audio output quality.

[0070] However, with the continuous upgrading of hardware facilities of the display device 200, the local speaker built-in the display device 200 also has good sound quality effect. Therefore, in order to meet the needs of users for better sound quality effect, in some embodiments, the display device 200 can provide a sound quality fusion mode, that is, after the display device 200 enables the sound quality fusion mode, audio can be output through the local speaker of the display device 200 and the external speaker of the external device 500 at the same time, and better audio output effect can be obtained through reasonable switching and path planning.

[0071] For example, as shown in FIG. 6, when the display device 200 is connected to the external device 500, the display device 200 can provide a sound quality fusion mode, that is, the display device 200 can output audio through the local speaker and the external speaker of the external device 500 at the same time. Figure 7As shown, the display device 200 can be connected with the sound bar through the external device interface 240, and after the connection, the display device 200 and the sound bar can provide an audio playing system including five speakers. That is, the audio playing system includes the left channel speaker, the bass speaker and the right channel speaker in the native speakers of the display device 200, and the left channel speaker and the right channel speaker in the external speakers of the sound bar. When the display device 200 uses the sound quality fusion mode to play audio, the center path audio can be played through the bass speaker in the native speakers, the front path audio can be played through the left channel speaker and the right channel speaker in the native speakers, and the surround path audio can be played through the left channel speaker and the right channel speaker in the external speakers, so as to obtain the triple sound effect of center, front and surround, and improve the playing sound quality.

[0072] Obviously, in order to obtain better playing sound quality, the output path of each speaker should be adapted to the position of the speaker. For example, the speaker set to output the center path should be located in the middle position in front of the user's viewing area, the speaker set to output the front path should be located in front of the user's viewing area, and the speaker set to output the surround path should be located around the user's viewing area. However, due to the influence of the user's placement position, the specific position of the speaker is variable, and therefore in actual use, the problem of mismatch between the audio output path and the position of the speaker is prone to occur. For example, when the external device 500 connected with the display device 200 is a sound bar device with close distance between the left channel speaker and the right channel speaker, if the output path set for it is the surround path, the surround sound will be emitted in a concentrated area, and good surround sound effect cannot be obtained.

[0073] Therefore, in order to improve the audio output effect, audio playing can be performed based on the position detection of the speaker, that is, in some embodiments of the present application, an audio playing method based on position detection is provided. The audio playing method can be applied to the display device 200, and in order to meet the implementation of the audio playing method, the display device 200 should at least include a display 260, native speakers, an external device interface 240, a sound collector and a controller 250. The display 260 is configured to display a user interface. The native speakers are configured to play audio data and test audio. The external device interface 240 is configured to connect with the external device 500, and the external device 500 includes at least one external speaker, which is also configured to play audio data and test audio. The sound collector is configured to detect a sound signal. The controller 250 is configured to execute the control program corresponding to the audio playing method, such as Figure 8 As shown, the audio playing method based on position detection specifically includes the following contents:

[0074] The control instruction for setting the output path input by the user is acquired. In use, the user can input the control instruction of various functions based on the UI interaction strategy defined in the operating system of the display device 200. Among them, part of the control instruction can be used to set the audio output path of the display device 200. The display device 200 can then acquire the control instruction for setting the output path by listening to the user's interaction action.

[0075] In some embodiments, the control instruction for setting the output path can be input based on the interaction mode on a specific user interface. That is, as shown in FIG. 6, the user can control the focus cursor on the display device 200 to move to the "Settings" option in the control home page, control the display device 200 to display a settings interface or a settings menu, and then select the "Sound Settings - Reset Audio Output Path" option in the settings interface or the settings menu in turn, to control the display device 200 to set the audio output path. Figure 9

[0076] In some embodiments, the control instruction for setting the output path can also be automatically input when it is determined that the working state of the display device 200 meets a specific condition. For example, the display device 200 can detect the connection state of the external device interface 240 in real time, and when it is detected that an audio output device is connected to the external device interface 240 and the display device 200 is in the audio fusion mode at this time, the control instruction for setting the output path can be automatically triggered to be input. For another example, when the display device 200 detects that the user first opens the audio fusion mode, that is, the user adjusts the switch corresponding to the "fusion mode" in the audio settings menu to the on state, the control instruction for setting the output path can also be automatically triggered to be input.

[0077] In some embodiments, for the display device 200 supporting a special interaction mode, the user can also input the control instruction for setting the output path based on the specific interaction mode. For example, for the display device 200 supporting touch interaction operation, the user can use a gesture interaction mode of simultaneously touching the lower left corner and the lower right corner (the position of the local speaker) of the display 260 and sliding towards the center area to trigger the display device 200 to open the fusion mode and to trigger the input of the control instruction for setting the output path. For another example, for the display device 200 supporting intelligent voice interaction, the user can also input a voice instruction containing "adjust the audio output path", "open the fusion mode" and the like to control the display device 200 to open the setting of the output path, that is, to input the control instruction for setting the output path.

[0078] ​After the user inputs the control instruction for setting the output path through any of the interaction modes in the above embodiments, the display device 200 can play the test audio through the local speaker and the external speaker in response to the control instruction. The test audio includes a plurality of audio signals, each of which is output through a separate audio output channel. To facilitate identification, the test audio can be a specific sound with a fixed frequency, loudness, and timbre, and include no less than the total number of speakers in the current fusion mode.

[0079] For example, the test audio can be a piano sound with a frequency of 440 Hz and a loudness of 70 dB. According to the speaker arrangement included in the current fusion mode: center path, left and right front path, left and right surround path, 5 output paths are respectively set with 5 test audio signals, which are respectively output through the center channel, the left front channel, the right front channel, the left surround channel, and the right surround channel.

[0080] In some embodiments, to alleviate the influence of the playing effect of the test audio on the environment sound, the display device 200 can also be built-in with multiple forms of test sound effects. For example, a plurality of frequencies, a plurality of loudnesses, and a plurality of timbres can be set in combination to obtain a plurality of test audio signal types, so that the user can select the test audio signal type according to different environments, or the display device 200 can automatically switch the test audio signal type involved in the detection according to the subsequent measurement result signal quality.

[0081] After determining the test audio to be played, the display device 200 can play the test audio repeatedly N times according to the total number N of speakers. The output path of the test audio is different each time, so that each speaker can emit sound individually. For example, after setting the test audio to be a piano sound with a frequency of 440 Hz and a loudness of 70 dB, the display device 200 can play the test audio through the center speaker, the left channel local speaker, the right channel local speaker, the left channel external speaker, and the right channel external speaker in turn.

[0082] To implement the above-mentioned sequential playing process, the display device 200 can sequentially output the test audio in each output channel according to the audio output path set by the current fusion mode before playing the test audio each time. For example, at the initial playing, the display device 200 can assign the output path of each speaker according to the total number of the speakers by default, and generate a test sequence based on the assigned path. Then, the test audio is played through the center speaker according to the test sequence. After the test audio is played through the center speaker once, the display device 200 can query the output path of the next playing process according to the set test sequence, which is the left channel native speaker, and the corresponding audio output path is the left channel of the front path. Therefore, the test audio can be played according to this output path, so that the display device 200 can play the test audio through the left channel native speaker. By analogy, the display device 200 can determine the output path of the test audio each time by querying the set test sequence, until all speakers complete the playing process individually.

[0083] In some embodiments, the sequential playing process can also be implemented in the form of a playing list. That is, after the display device 200 assigns the output path of each speaker according to the total number of the speakers by default, it can automatically create the same number of test audio files as the total number of the speakers, and each test audio file is set to be played according to a separate output path. For example, after determining that the total number of the speakers is 5, the display device 200 can copy the test audio file 5 times, and set the output path of each copied file, that is, the output path of the first audio file is the center path, the output path of the second audio file is the left front channel, the output path of the third audio file is the right front channel, the output path of the fourth audio file is the left surround channel, and the output path of the fifth audio file is the right surround channel. In this way, the display device 200 can generate a playing list containing the first audio file to the fifth audio file, so that when playing according to this playing list, the test audio can be sequentially output through the center channel, the left front channel, the right front channel, the left surround channel, and the right surround channel.

[0084] In the process of controlling the native speaker and the external speaker to play the test audio, the native speaker and the external speaker will generate sound signals due to the playing process, and the generated sound signals can be collected by the sound collector to form a measurement result signal. Therefore, the display device 200 can receive the measurement result signal collected by the sound collector for the test audio after controlling the native speaker and the external speaker to play the test audio.

[0085] The sound collector can be a far-field microphone built in the display device 200, which can be arranged below the display 260 of the display device 200, can collect various sounds in the current environment in real time, and convert the sounds into an electrical signal, i.e., a measurement result signal. The sound collector can also be an external microphone connected through the external device interface 240 on the display device 200. For example, the display device 200 can be provided with a 3.5mm audio interface, and a user can plug in a microphone device at the interface to collect sounds in the current scene through the microphone device and generate a measurement result signal transmitted to the internal system of the display device 200.

[0086] In some embodiments, the sound collector can also be built in the control device 100 matched with the display device 200, i.e., the control device 100 can be provided with a microphone hole and a built-in microphone assembly. In a conventional use scenario, the microphone assembly built in the control device 100 can be used for user input of voice control instructions. After the user inputs a control instruction for setting an output path, the display device 200 can send a collection instruction to the control device 100, and the control device 100 can respond to the collection instruction to turn on the microphone assembly to collect sounds in the environment through the microphone assembly to generate a measurement result signal.

[0087] Due to the interference of environmental sounds, the sound signal detected by the sound collector can contain other sound signals in addition to the test audio, and therefore the display device 200 can perform noise reduction, impurity removal, and other signal processing on the sound signal after receiving the sound signal collected by the sound collector, and identify the sound corresponding to the test audio in the sound signal. That is, as shown in some embodiments, the display device 200 can compare the waveform of the sound signal with the waveform of the test audio after obtaining the sound signal through the sound collector. Since the test audio has a specific form, i.e., a specific waveform, the waveform of the signal can be compared to identify whether the sound signal is derived from the test audio. If the waveform of the sound signal is the same as the waveform of the test audio, the sound signal is marked as a measurement result signal. Figure 10

[0088] The measurement result signal collected by the sound collector for the test audio can include waveform data corresponding to specific audio content and information such as the time when the specific waveform data is collected. These information can be further processed by the controller 250 to locate the position of each loudspeaker according to the measurement result signal.

[0089] ​In some embodiments, the controller 250 of the display device 200 can extract the acquisition time in the measurement result signal and the playing time of the test audio after obtaining the measurement result signal. To this end, the display device 200 can set a time stamp for the test audio when controlling the local speaker and the external speaker to play the test audio, where the time stamp is used to represent the time at which the display device 200 starts playing the test audio, i.e., the playing time. The acquisition time can be determined as the time at which the display device 200 just detects the measurement result signal after identifying the sound signal as the measurement result signal. For example, the display device 200 sets the playing time of the test audio as 8:20:00:000, and then plays the test audio at 8:20:00:000 and generates a sound signal. After the sound signal is played by the speaker, it can be transmitted to the sound collector position, collected by the sound collector, and converted into a measurement result signal, i.e., the acquisition time of the measurement result signal is 8:20:00:006.

[0090] After the display device 200 extracts the playing time and the acquisition time, the display device 200 can calculate the propagation time of the sound signal from the speaker to the sound collector according to the playing time and the acquisition time, i.e., the time difference between the acquisition time and the playing time. For example, when the playing time is 8:20:00:000 and the acquisition time is 8:20:00:006, the time difference between the two times can be calculated as 6 ms.

[0091] Based on the calculated time difference, the display device 200 can calculate the distance between the sound collector and each of the local speaker and the external speaker according to the time difference. Since the propagation speed of sound waves in the current application environment is known, the distance between the speaker and the sound collector can be calculated according to the time difference and the propagation speed of sound waves after the time difference is obtained. For example, the speed of sound in air under the condition of 1 standard atmosphere and 15°C is 340 m / s, and thus the distance between the speaker and the sound collector can be calculated as 340 x 0.006 = 2.04 m after the time difference between the playing time and the acquisition time is calculated as 6 ms.

[0092] In the above manner, the display device 200 can calculate the distance between the sound collector and each of the speakers by calculating the time difference between the playing time and the acquisition time and combining the propagation speed of sound waves each time the display device 200 controls the local speaker and the external speaker to play the test audio. In this way, the position of each speaker can be located according to the distance, so as to set the output path of the audio data according to the speaker position.

[0093] For example, as shown in FIG. 2, the display device 200 can set the output path of the audio data according to the distance between the sound collector and each of the speakers. Figure 11As shown, when the sound collector is arranged at the left side of the display device 200 and is collinear with the left and right sound channels of the native speakers or the external speakers, the distance between the sound collector and each speaker, i.e. the distance L0 between the sound collector and the center speaker, the distance L1 between the sound collector and the left channel native speaker, the distance L2 between the sound collector and the right channel native speaker, the distance L3 between the sound collector and the left channel external speaker, and the distance L4 between the sound collector and the right channel external speaker, can be calculated through multiple playing of test audio and sound signal detection process. Then, according to the size relationship between the calculated distances, the position of each speaker can be determined. That is, by comparison, it can be determined that L0 is between L1 and L2, and the center position can be determined, so the audio output path corresponding to the center speaker can be set as the center path. Similarly, by comparison, it can be determined that L1 is less than L2, i.e. the L1 corresponding speaker is the left channel speaker, and since L1 is greater than L3, it can be determined that the L1 corresponding speaker is not suitable as a surround sound speaker, but is more suitable as a front sound speaker, i.e. the output path of the left channel native speaker can be set as the front left channel path.

[0094] In some embodiments, in order to set the audio output effect of the display device 200 and the external device 500 after fusion, the display device 200 can calculate a distance judgment value according to the detected distance, wherein the distance judgment value is the distance between the left channel speaker and the right channel speaker. That is, the distance judgment value of the display device 200 is the distance between the left channel speaker and the right channel speaker in the native speaker, i.e. D2=L2-L1. The distance judgment value of the external device 500 is the distance between the left channel speaker and the right channel speaker in the external speaker, i.e. D5=L4-L3.

[0095] When the display device 200 sets the output path of the audio data according to the speaker parameters, the distance judgment value of the display device 200 and the external device 500 can be obtained first, and then the distance judgment value of the display device 200 and the distance judgment value of the external device 500 are compared to determine the setting mode according to the comparison result.

[0096] As Figure 12As shown, when neither the display device 200 (Master) nor the external device 500 (Slave) has a center speaker, if the distance between the left and right channel speakers (L&R) in the display device 200 is less than the distance between the left and right channel speakers (L&R) in the external device 500, the left and right channel speakers in the display device 200 are set as the center speakers; the left and right channel speakers in the external device 500 are set as the front speakers L&R; if the distance between the left and right channel speakers (L&R) in the display device 200 is greater than the distance between the left and right channel speakers (L&R) in the external device 500, the left and right channel speakers in the display device 200 are set as the front speakers L&R; the left and right channel speakers in the external device 500 are set as the center speakers.

[0097] When both the display device 200 (Master) and the external device 500 (Slave) have a center speaker, if the distance between the left and right channel speakers (L&R) in the display device 200 is less than the distance between the left and right channel speakers (L&R) in the external device 500, the left and right channel speakers in the display device 200 are set as the front speakers L&R; the left and right channel speakers in the external device 500 are set as the surround speakers Ls&Rs. If the distance between the left and right channel speakers (L&R) in the display device 200 is greater than the distance between the left and right channel speakers (L&R) in the external device 500, the left and right channel speakers in the display device 200 are set as the surround speakers Ls&Rs; the left and right channel speakers in the external device 500 are set as the front speakers L&R.

[0098] In some embodiments, when the display device 200 and the external device 500 have speakers that coincide in part, the display device 200 can set the same output path for the coinciding speakers, thereby obtaining an enhanced effect for the channel. That is, when the display device 200 sets the output path of the audio data according to the speaker parameters, the display device 200 traverses the installation position of the native speaker and the setting position of the external speaker in the speaker parameters. Then, according to the installation position and the setting position, the coinciding channel speakers are marked, so that the channel signals corresponding to the installation position in the audio data are simultaneously transmitted to the coinciding channel speakers.

[0099] For example, when both the display device 200 and the external device 500 include a subwoofer, because the subwoofer has the same output effect and the speaker positions coincide (usually both are set at the position close to the ground), when performing audio fusion, the subwoofer on both devices can be simultaneously set to play the audio data in the subwoofer channel, thereby obtaining the effect of subwoofer enhancement.

[0100] From the above, the display device 200 can set the output path of the audio data according to the manner provided by the above embodiments. In order to achieve the setting of the output path, in some embodiments of the present application, an audio intelligent fusion module can also be constructed in the display device 200. The audio intelligent fusion module can automatically calculate and distribute the audio parameters provided by the two sets of devices according to the display device 200 and the external device interface 240, control the audio system of the display device 200 to adjust the link, audio parameters, transmission time and other items, and finally realize the fusion of the two sets of internal and external systems.

[0101] In some embodiments, when the sound collector in the display device 200 is an external microphone or a microphone on the control device 100, in order to obtain more accurate detection results, the display device 200 can guide the user to set the sound collector at a suitable position through a specific prompt interface, that is, as shown in the figure, the local loudspeaker can include a left local loudspeaker and a right local loudspeaker, and the display device 200 can control the display to display a first prompt interface in the step of playing test audio through the local loudspeaker and the external loudspeaker. Figure 14

[0102] The first prompt interface is used to prompt the user to set the sound collector at a position collinear with the left local loudspeaker and the right local loudspeaker. As shown in the figure, the first prompt interface can present a prompt picture on the display device 200 in the form of text, graphics, animation, and combinations thereof. In order to improve the measurement accuracy, the distance between the sound collector and the display device 200 is between 0.4-1m, which is the best. The display device 200 can automatically switch to display the first prompt interface after obtaining the control instruction for setting the output path, thereby guiding the user to set the sound collector at a more suitable position, that is, a position collinear with the left local loudspeaker and the right local loudspeaker. Figure 15 The first prompt interface can also be provided with a "confirm" control for the user to select and input a first confirmation instruction after setting the position of the sound collector. The display device 200 receives the first confirmation instruction input by the user based on the first prompt interface, and after receiving the first confirmation instruction, plays test audio through the left local loudspeaker and the right local loudspeaker in turn. For example, after the user sets the sound collector at a position flush with the bottom of the screen of the display device 200 according to the prompt of the first prompt interface, the user can click the "confirm" option in the prompt interface, and then the display device 200 can control the left local loudspeaker to play test audio and complete a sound signal detection; and then control the right local loudspeaker to play test audio and complete another sound signal detection, thereby realizing the detection of the position of the local loudspeaker.

[0103]

[0104] ​​After the user sets the sound collector in the position collinear with the left local speaker and the right local speaker through the first prompt interface, the display device 200 can determine the position of the local speaker based on the detection result of the sound collector, and when the external speaker 500 is set near the display device 200, the position of the external speaker can also be detected together. For example, when the external device 500 is a bar-shaped sound box set below the display device 200, the position of the external speaker can be directly detected through the placement position prompted by the first prompt interface. However, in the use process, the user may set the external device 500 at a position far away from the display device 200, and if the position of the external speaker is detected again according to the position collinear with the left local speaker and the right local speaker, the display device 200 will not accurately determine the position of the external speaker.

[0105] Therefore, in some embodiments, the display device 200 can further prompt the user to adjust the position of the sound collector through a second prompt interface after displaying the first prompt interface and completing the detection, that is, when the external speaker includes a left external speaker and a right external speaker, the display device 200 can control the display 260 to display a second prompt interface. As shown in the figure, the second prompt interface is used to prompt the user to set the sound collector in a position collinear with the left external speaker and the right external speaker, and the specific display style should be the same as that of the first prompt interface, that is, the prompt picture is presented on the display device 200 through text, graphics, animation, and their combinations. Figure 16

[0106] The user can set the sound collector in the position collinear with the left external speaker and the right external speaker according to the indication in the second prompt interface, and click the "Confirm" option after the setting is completed to output a second confirmation instruction. After receiving the second confirmation instruction input by the user based on the second prompt interface, the display device 200 plays test audio through the left external speaker and the right external speaker in turn. Then, by receiving the test result signal generated by the sound collector for the audio played by the left external speaker and the right external speaker, the display device 200 can locate the positions of the left external speaker and the right external speaker according to the test result signal.

[0107] From the above technical solutions, it can be known that in the above embodiments, the display device 200 can prompt the user to set the sound collector in a position convenient for positioning the speaker position through the prompt interface, so as to facilitate the sound collector to detect a better signal and realize more accurate setting of the audio output path.

[0108] ​In some embodiments, the display device 200, when positioning the speaker positions according to the measurement result signals, can also determine the corresponding sound pressure level values of the measurement result signals by analyzing the measurement result signals. The sound pressure level value is a quantity representing the size of sound by a logarithmic ratio. For example, the ratio of the to-be-measured sound pressure p to the reference sound pressure p ref is taken as a common logarithm, and the obtained value multiplied by 20 is defined as the sound pressure level, i.e., sound pressure level = 20lg(p / p ref ).

[0109] To this end, the display device 200 can detect the energy density and / or signal average amplitude of the measurement result signals after obtaining the measurement result signals, and calculate the sound pressure level values of each audio output channel according to the energy density and / or signal average amplitude, and then calculate the relative position data of each speaker according to the sound pressure level values, so as to set the output path of the audio data according to the relative position data. The relative position data is used to represent the distance between the left and right channels, i.e., for native speakers, the relative position data is used to represent the distance between the left native speaker and the right native speaker, and for external speakers, the relative position data is used to represent the distance between the left external speaker and the right external speaker.

[0110] The relative position data can be a specific distance value or other values that can reflect the specific distance value. For example, the display device 200 can obtain the sound pressure level values of the four channels by analyzing the measurement result signals, which are SPL1 for the left native speaker, SPL2 for the right native speaker, SPL3 for the left external speaker, and SPL4 for the right external speaker. According to the acoustic law, it can be obtained that:

[0111] SPL1-SPL2 = 20lg(L2 / L1) = 20lg((L1+D2) / L1) = 20lg(1+D2 / L1);

[0112] SPL3-SPL4 = 20lg(L4 / L3) = 20lg((L3+D5) / L3) = 20lg(1+D5 / L3);

[0113] wherein L1 is the distance between the sound collector and the left native speaker, L2 is the distance between the sound collector and the right native speaker, L3 is the distance between the sound collector and the left external speaker, L4 is the distance between the sound collector and the right external speaker, D2 is the distance between the left native speaker and the right native speaker, and D5 is the distance between the left external speaker and the right external speaker.

[0114] Referring to Figure 11The greater D2 is, the smaller L1 is; the smaller D2 is, the greater L1 is. Similarly, the relationship between D5 and L3 is the same. Since the values of D2 and D5 will directly determine the sizes of D2 / L1 and D5 / L3, and then determine the sizes of (SPL1-SPL2) and (SPL3-SPL4). Therefore, the size relationship between the loudspeaker distances D2 and D5 can be compared by calculating the sound pressure difference.

[0115] That is, in some embodiments, the display device 200 can calculate a first sound pressure difference and a second sound pressure difference according to the sound pressure level values of each audio output channel in the step of setting the output path of the audio data according to the relative position data. Wherein the first sound pressure difference is equal to the difference value of the sound pressure level values between the local loudspeakers, i.e. (SPL1-SPL2); the second sound pressure difference is equal to the difference value of the sound pressure level values between the external loudspeakers, i.e. (SPL3-SPL4).

[0116] Then compare the first sound pressure difference (SPL1-SPL2) and the second sound pressure difference (SPL3-SPL4), as shown in Figure 17 If the first sound pressure difference (SPL1-SPL2) is less than the second sound pressure difference (SPL3-SPL4), i.e. the distance D2 between the left local loudspeaker and the right local loudspeaker is less than the distance D5 between the left external loudspeaker and the right external loudspeaker, the local loudspeakers can be set as front path and the external loudspeakers can be set as surround path to obtain better surround sound and front sound effect. Similarly, if the first sound pressure difference (SPL1-SPL2) is greater than the second sound pressure difference (SPL3-SPL4), i.e. the distance D2 between the left local loudspeaker and the right local loudspeaker is greater than the distance D5 between the left external loudspeaker and the right external loudspeaker, the local loudspeakers can be set as surround path and the external loudspeakers can be set as front path.

[0117] In some embodiments, if the first sound pressure difference obtained by calculation is equal to the second sound pressure difference, the sound pressure level values of the local loudspeakers and the external loudspeakers under the same side output channel can be compared again, i.e. as shown in Figure 18 The display device 200 can obtain a sound pressure judgment value, which is the sound pressure level values of the local loudspeakers and the external loudspeakers under the same side output channel. For example, when it is determined that the first sound pressure difference (SPL1-SPL2) is equal to the second sound pressure difference (SPL3-SPL4), the display device 200 can further compare the sound pressure level values of the local loudspeakers and the external loudspeakers under the same left channel.

[0118] If the sound pressure judgment value (SPL1) of the local speaker is greater than the sound pressure judgment value (SPL3) of the external speaker, that is, the sound intensity of the left local speaker is higher than the sound intensity of the left external speaker, the local speaker can be set as the surround path and the external speaker can be set as the front path. Similarly, if the sound pressure judgment value (SPL1) of the local speaker is less than the sound pressure judgment value (SPL3) of the external speaker, the local speaker can be set as the front path and the external speaker can be set as the surround path.

[0119] From the above technical solution, the display device 200 can obtain the sound pressure level values of the speakers by detecting the measurement result signal, and indirectly detect the distance between the speakers through the difference between the sound pressure level values, so as to achieve the purpose of positioning the speakers. This positioning method can reduce the influence of the position of the sound collector on the positioning accuracy, so that the user can flexibly set the position of the sound collector, and improve the positioning accuracy.

[0120] Since the display device 200 provides corresponding sound control logic and menu before the sound system is fused, and the sound control logic and menu are all for the local audio system of the display device 200. After the sound is fused, the control logic and menu should be for the entire audio system after fusion. Moreover, as the audio system after fusion, whether through the control operation of the display device 200 or the control operation of the external device 500, such as volume control and sound effect mode, should act on the display device 200 and the external device 500 at the same time. For example, when there is no audio fusion, the target speaker of the display device 200 control menu is the local speaker; after the audio fusion, it should be automatically adjusted to the target speaker of the local speaker and the external speaker. For this purpose, in some embodiments, as shown in FIG. 8, the display device 200 can record the output path after setting the output path of the audio data according to the speaker position. And real-time acquisition of the user input setting instruction for adjusting the audio parameter. When the user inputs the setting instruction for adjusting the audio parameter, the display device 200 can respond to the setting instruction, query the target speaker of the setting instruction according to the output path. Wherein, the target speaker is one or more combinations of the local speaker and the external speaker. Finally, the audio parameter specified in the setting instruction is applied to the target speaker. Figure 19

[0121] ​To achieve audio fusion control, the display device 200 can be equipped with a judgment module, a task decomposition module, and a communication module in addition to its normal control logic. When a user's setting command is received, it first determines whether it is in audio fusion mode. If it is not in audio fusion mode, audio control will be executed directly on the display device 200, i.e., the target speaker is the local speaker. If it is in audio fusion mode, the task decomposition module should be activated. The task decomposition module decomposes the setting command according to the output path configuration, so that part of the decomposed command is executed on the display device 200's local system, and the other part is executed by the external device 500.

[0122] For example, a user can control the display device 200 to perform audio blending by selecting "Settings - Sound Settings - Fusion Audio System". Depending on the audio output path settings, the display device 200 handles the overhead sound, while the external device 500 handles the front, center, and subwoofer channels. When the user selects Movie Mode from the menu, the task decomposition module will notify the display device 200's local system to issue and execute the sound effect parameters for the overhead sound channel, and simultaneously notify the external device 500 via the communication module to execute the 3.1 channel sound effect parameters. Similarly, when the external device 500 receives a user's setting command, it also needs to decompose the setting command and notify the display device 200 to execute the corresponding sound effect parameters.

[0123] Based on the above location-detection-based audio playback method, such as Figure 20 As shown, in some embodiments of this application, a display device 200 is also provided, including: a display 260, a local speaker, an external device interface 240, a sound acquisition unit, and a controller 250. The display 260 is configured to display a user interface. The local speaker is configured to play audio data and test audio. The external device interface 240 is configured to connect to an external device 500, the external device 500 including at least one external speaker, which is also configured to play audio data and test audio. The sound acquisition unit is configured to detect sound signals. The controller 250 is configured to execute the following program steps:

[0124] Obtain user input for control commands used to set the output path;

[0125] In response to control commands, test audio is played through the local speaker and external speakers. The test audio includes multiple audio signals, each of which is output through a separate audio output channel.

[0126] Receive the measurement result signal collected by the sound acquisition device for the test audio;

[0127] The loudspeaker positions are located according to the measurement result signals, and the output path of the audio data is set according to the loudspeaker positions.

[0128] According to the technical solution, the display device 200 can play test audio through the local loudspeaker and the external loudspeaker respectively after a user inputs a control instruction for setting an audio output path, and collect test result signals of the test audio through the sound collector, so as to locate the positions of the loudspeakers according to the test result signals and set the output path of the audio data according to the loudspeaker positions. The display device 200 can make the audio data output through the local loudspeaker and the external loudspeaker simultaneously, set the output path suitable for the loudspeaker positions by detecting the loudspeaker positions, and make the audio output channel match the loudspeaker positions, thereby improving the audio playing effect.

[0129] The similar parts among the embodiments provided in the present application can be referred to each other, the specific embodiments provided above are only some examples under the general concept of the present application, and do not limit the protection scope of the present application. Any other embodiments extended according to the present application solutions without creative labor are within the protection scope of the present application.

Claims

1. A display device, characterized by comprising: The application relates to a display device, comprising: a display; a local speaker configured to play audio data; an external device interface configured to connect an external device, the external device comprising at least one external speaker; a sound collector configured to detect a sound signal; a controller configured to: obtain a control instruction input by a user for setting an output path; in response to the control instruction, play test audio through the local speaker and the external speaker, the test audio comprising a plurality of audio signals, each of the audio signals being output through a separate audio output channel; receive a measurement signal collected by the sound collector for the test audio; compare a first distance and a second distance according to the measurement signal, the first distance being a distance between a left local speaker and a right local speaker in the local speaker, and the second distance being a distance between a left external speaker and a right external speaker in the external speaker; if the first distance is greater than the second distance, set the local speaker as a surround path and set the external speaker as a front path; if the first distance is less than the second distance, set the local speaker as a front path and set the external speaker as a surround path.

2. The display device of claim 1, wherein, The controller is further configured to: in the step of playing the test audio through the local speaker and the external speaker, control the display to display a first prompt interface, the first prompt interface being used for prompting the user to set the sound collector at a position collinear with the left local speaker and the right local speaker; receive a first confirmation instruction input by the user based on the first prompt interface; after receiving the first confirmation instruction, play the test audio through the left local speaker and the right local speaker in sequence.

3. The display device of claim 2, wherein, The controller is further configured to: control the display to display a second prompt interface, the second prompt interface being used for prompting the user to set the sound collector at a position collinear with the left external speaker and the right external speaker; receive a second confirmation instruction input by the user based on the second prompt interface; after receiving the second confirmation instruction, play the test audio through the left external speaker and the right external speaker in sequence.

4. The display device of claim 1, wherein, The controller is further configured to: in the step of receiving the measurement signal collected by the sound collector for the test audio, obtain a sound signal through the sound collector; compare a waveform of the sound signal with a waveform of the test audio; if the waveform of the sound signal is the same as the waveform of the test audio, mark the sound signal as the measurement signal.

5. The display device of claim 4, wherein, The controller is further configured to: in the step of comparing the first distance and the second distance according to the measurement signal, obtain an acquisition time of the measurement signal and a playing time of the test audio; calculate a time difference between the acquisition time and the playing time; calculate a distance between the sound collector and each of the local speaker and the external speaker according to the time difference; calculating the first distance according to a distance between the sound collector and the left native speaker and a distance between the sound collector and the right native speaker; calculating the second distance according to a distance between the sound collector and the left external speaker and a distance between the sound collector and the right external speaker; comparing the first distance and the second distance.

6. The display device of claim 1, wherein, The controller is further configured to: detect an energy density and / or a signal average amplitude of the measurement result signal in the step of comparing the first distance and the second distance according to the measurement result signal; calculate a sound pressure level value of each audio output channel according to the energy density and / or the signal average amplitude; compare the first distance and the second distance according to the sound pressure level value.

7. The display device of claim 6, wherein, The controller is further configured to: calculate a first sound pressure difference and a second sound pressure difference according to the sound pressure level value of each audio output channel in the step of comparing the first distance and the second distance according to the sound pressure level value, the first sound pressure difference being equal to a difference value of the sound pressure level values between the native speakers, and the second sound pressure difference being equal to a difference value of the sound pressure level values between the external speakers; if the first sound pressure difference is less than the second sound pressure difference, the first distance is less than the second distance; if the first sound pressure difference is greater than the second sound pressure difference, the first distance is greater than the second distance.

8. The display device of claim 7, wherein, if the first sound pressure difference is equal to the second sound pressure difference, the controller is further configured to: obtain a sound pressure judgment value, the sound pressure judgment value being a sound pressure level value of the native speaker and the external speaker under the same side output channel; if the sound pressure judgment value of the native speaker is greater than the sound pressure judgment value of the external speaker, set the native speaker as a surround path and set the external speaker as a front path; if the sound pressure judgment value of the native speaker is less than the sound pressure judgment value of the external speaker, set the native speaker as a front path and set the external speaker as a surround path.

9. The display device of claim 1, wherein, The controller is further configured to: after the step of setting the output paths of the native speaker and the external speaker, record the output paths; obtain a setting instruction input by a user for adjusting an audio parameter; in response to the setting instruction, query a target speaker of the setting instruction according to the output paths, the target speaker being one or a combination of the native speaker and the external speaker; apply the audio parameter specified in the setting instruction to the target speaker.

10. A method for playing audio based on a location detection, the method comprising: The display device comprises a display, native speakers, an external device interface, a sound collector and a controller, and the display device is connected to an external device through the external device interface; The external device comprises at least one external speaker; and the audio playing method comprises: obtaining a control instruction input by a user for setting an output path; in response to the control instruction, playing test audio through the native speakers and the external speakers, the test audio comprising a plurality of audio signals, each of the audio signals being output through a separate audio output channel; receiving a measurement result signal collected by the sound collector for the test audio; comparing a first distance and a second distance according to the measurement result signal, the first distance being a distance between a left local speaker and a right local speaker in the local speakers, and the second distance being a distance between a left external speaker and a right external speaker in the external speakers; if the first distance is greater than the second distance, setting the local speakers as surround paths and setting the external speakers as front paths; if the first distance is less than the second distance, setting the local speakers as front paths and setting the external speakers as surround paths.

Citation Information

Patent Citations

  • Display equipment and audio playing method

    CN111757171A

  • Sound emission / collection apparatus

    JP2009081613A