Display apparatus, sound adjustment method, storage medium, and program product

Abstract

The embodiment of the invention belongs to the display technology, and provides a display device, a sound adjustment method, a storage medium and a program product. The display equipment comprises an audio acquisition device, an image acquisition device and a controller connected with the audio acquisition device and the image acquisition device, acquiring position information of a spokesman through an image acquisition device, and acquiring a sound signal of the spokesman through an audio acquisition device; gains of the sound signals are obtained according to the position information; the gains of the sound signals comprise sound intensity gains and / or sound channel balance gains; and performing stereo adjustment on the sound signal based on the gain of the sound signal. The stereo adjustment is performed on the collected sound signals of the spokesman based on the positions of the different spokesman, so that the stereo adjustment can be performed in a targeted manner, the stereo adjustment effect can be improved, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of display. More particularly, it relates to a display device, a sound adjustment method, a storage medium and a program product. BACKGROUND

[0002] Stereophonic technology is a technology that can effectively improve the user's audio-visual experience. The display device can make the listener have a sense of being on the scene by playing stereophonic sound with spatial distribution characteristics such as azimuth level.

[0003] In some scenarios (for example, a remote conference scenario), when the display device collects the speaker's voice, the voice is transmitted to the remote listener after being enhanced by an automatic gain control algorithm.

[0004] However, the display device indiscriminately enhances the stereophonic sound for different speakers, and the remote listener can hardly feel the position distribution of different speakers, and the effect of stereophonic sound enhancement is not good. SUMMARY

[0005] Exemplary embodiments of the present application provide a display device, a sound adjustment method, a storage medium and a program product, which can improve the effect of stereophonic sound enhancement on collected voice signals, thereby improving the user's experience.

[0006] In a first aspect, the present application provides a display device, the display device comprising an audio collection device, an image collection device, and a controller connected to the audio collection device and the image collection device, the controller being configured to:

[0007] obtain position information of a speaker through the image collection device, and collect a voice signal of the speaker through the audio collection device;

[0008] obtain a gain of the voice signal according to the position information; the gain of the voice signal includes a sound intensity gain and / or a sound channel balance gain;

[0009] perform stereophonic adjustment on the voice signal based on the gain of the voice signal.

[0010] In some embodiments, the controller is configured to:

[0011] obtain a distance between the speaker and the display device according to the position information, and determine a target sound intensity of the speaker based on the distance;

[0012] obtain the sound intensity gain according to the target sound intensity and a sound intensity of the voice signal;

[0013] adjust a sound intensity of the sound signal according to the sound intensity gain.

[0014] In some embodiments, the controller is configured to:

[0015] obtain a sound intensity gain coefficient of the sound signal;

[0016] obtain the sound intensity gain according to the sound intensity gain coefficient and a distance between the speaker and the display device;

[0017] adjust a sound intensity of the sound signal according to the sound intensity gain; the adjusted sound intensity of the sound signal is within a preset sound intensity range.

[0018] In some embodiments, the controller is configured to:

[0019] obtain an environmental parameter of the display device; the environmental parameter comprises one or more of a space size of an environment where the display device is located, environmental noise, and a number of persons in the environment;

[0020] obtain the sound intensity gain coefficient by using a pre-trained gain model according to the environmental parameter; or

[0021] the controller is configured to:

[0022] determine the sound intensity gain coefficient according to a size relationship between the target sound intensity and the sound intensity of the sound signal, and a mapping relationship between the size relationship and a sound intensity gain coefficient.

[0023] In some embodiments, the controller is configured to:

[0024] obtain a position relationship between the speaker and a reference point of the display device and a vertical distance from the reference point according to the position information;

[0025] determine the sound channel balance gain according to the position relationship and the vertical distance;

[0026] adjust a preset sound channel balance parameter of the sound signal according to the sound channel balance gain.

[0027] In some embodiments, the controller is configured to:

[0028] determine a sound channel gain coefficient of the sound signal according to the position relationship and a preset sound channel gain coefficient;

[0029] determine the sound channel balance gain according to the sound channel gain coefficient and the vertical distance.

[0030] In some embodiments, the controller is configured to:

[0031] combine the sound signal adjusted according to the sound intensity and the sound signal adjusted according to the preset sound channel balance parameter to obtain a target audio of stereo sound;

[0032] transmit the target audio to a remote device connected to the display device;

[0033] Alternatively, the controller is configured to:

[0034] transmit the position information and the sound signal to the remote device, so that the remote device adjusts the sound signal to obtain a target audio of stereo sound.

[0035] In a second aspect, the embodiments of the present application provide a sound adjustment method, comprising:

[0036] obtaining position information of a speaker and a sound signal of the speaker;

[0037] obtaining a gain of the sound signal according to the position information; the gain of the sound signal includes a sound intensity gain and / or a sound channel balance gain;

[0038] adjusting the sound signal according to the gain of the sound signal.

[0039] In a third aspect, the embodiments of the present application provide a sound adjustment device, comprising:

[0040] an obtaining module configured to obtain position information of a speaker and a sound signal of the speaker;

[0041] a processing module configured to obtain a gain of the sound signal according to the position information; the gain of the sound signal includes a sound intensity gain and / or a sound channel balance gain;

[0042] an adjusting module configured to adjust the sound signal according to the gain of the sound signal.

[0043] In a fourth aspect, the present application provides a computer readable storage medium, wherein the computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by a processor to implement the method in the second aspect.

[0044] In a fifth aspect, the present application provides a computer program product, comprising a computer program, and the computer program is executed by a processor to implement the method in the second aspect.

[0045] In a sixth aspect, an embodiment of the present application provides a chip, which comprises a processor configured to invoke a computer program in a memory to execute the method according to the second aspect.

[0046] The display device, the sound adjustment method, the storage medium and the program product provided by the embodiments of the present application, the display device comprises an audio acquisition device, an image acquisition device, and a controller connected with the audio acquisition device and the image acquisition device, the controller is configured to: acquire position information of a speaker through the image acquisition device, and acquire a sound signal of the speaker through the audio acquisition device; acquire a gain of the sound signal according to the position information; the gain of the sound signal comprises a sound intensity gain and / or a sound channel balance gain; and perform stereo adjustment on the sound signal based on the gain of the sound signal. The sound signal of the speaker collected is adjusted based on the position of the speaker, the stereo adjustment can be performed in a targeted manner, the adjustment effect of the stereo sound can be improved, and the experience of the user is improved. BRIEF DESCRIPTION OF DRAWINGS

[0047] In order to more clearly illustrate the embodiments of the present application or the implementation manners in the related art, the drawings needed to be used in the embodiments or related art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art based on these drawings.

[0048] Figure 1 A scene schematic diagram of a display device provided by an embodiment of the present application for a conference;

[0049] Figure 2 A structure schematic diagram of a display device provided by an embodiment of the present application;

[0050] Figure 3 A flowchart of a sound adjustment method provided by an embodiment of the present application Figure 1 ;

[0051] Figure 4 A position relationship schematic diagram of a speaker and a display device provided by an embodiment of the present application Figure 1 ;

[0052] Figure 5 A position relationship schematic diagram of a speaker and a display device provided by an embodiment of the present application Figure 2 ;

[0053] Figure 6 A flowchart of a sound adjustment method provided by an embodiment of the present application Figure 2 ;

[0054] Figure 7A schematic diagram of a sound intensity model provided in an embodiment of the present application;

[0055] Figure 8 A flow chart of a sound adjustment method provided in an embodiment of the present application Figure 3 ;

[0056] Figure 9 A flow chart of a sound adjustment method provided in an embodiment of the present application Figure 4 ;

[0057] Figure 10 A structural diagram of a sound adjustment device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.

[0059] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0060] In addition, the terms "comprises" and "comprising" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0061] In the exemplary embodiments of the present application, words such as "first" and "second" are used to distinguish identical or similar items with substantially the same functions and effects, and do not limit their order. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity or execution order, and words such as "first" and "second" do not necessarily mean different.

[0062] It should be noted that in the exemplary embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0063] With the development of technology, the demand for video conferencing is increasing, and the conference large screen has become a commonly used display device for users. The stereo technology is a technology that can effectively improve the user's audio-visual experience. The display device can play stereo sound with spatial distribution characteristics such as azimuth level, so that the listener has a sense of being on the scene.

[0064] Figure 1 A scene diagram for a conference by a display device 200 provided by an embodiment of the present application is shown in FIG. 1. Figure 1 As shown in FIG. 1, during the conference, the display device 200 can track the speaker through an image acquisition device (for example, a camera), and collect the speaker's voice through an audio acquisition device (for example, a microphone) of the display device 200, and perform stereo enhancement through a voice enhancement algorithm (for example, an AGC algorithm), and transmit the stereo-enhanced voice to online users to improve the audio-visual experience of the online users.

[0065] Currently, when the display device 200 collects the voices of different speakers, it performs stereo enhancement without distinction through the voice enhancement algorithm. However, different speakers are located at different positions, and the display device collects different voices of the speakers. The stereo enhancement without distinction through the voice enhancement algorithm will cause the stereo voices of different speakers heard by the online users to be similar, and it is difficult to perceive the position distribution of different speakers, and the effect of stereo enhancement is not good.

[0066] In view of the above problems existing in the prior art, the present application provides a display device, a voice adjustment method and a storage medium, which can improve the enhancement effect of the stereo voice of the speaker, thereby improving the user's experience.

[0067] Among them, the display device provided by the embodiments of the present application can have various implementation forms, for example, it can be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc., and the embodiments of the present application do not limit this.

[0068] The hardware configuration of the display device mentioned above will be introduced as follows.

[0069] Figure 2 A possible hardware configuration diagram of a display device provided by the present application is shown in FIG. 2. Figure 2 As shown in FIG. 2, in some embodiments, the display device 200 can include at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a power supply 280, a storage 290, and a user interface 2100.

[0070] In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an n-th interface for input / output.

[0071] The display 260 includes a display screen component for presenting a picture, and a driving component for driving the image display, a component for receiving an image signal originated from the controller output, and a component for displaying video content, image content, and a menu operation interface, and a user operation UI interface.

[0072] The display 260 can be a liquid crystal display, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-OLED, a quantum dot light emitting diodes (QLED), and a projection display, etc., and can also be a projection device and a projection screen.

[0073] The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example, the communicator can include at least one of a WiFi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips, or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0074] The user interface 2100 can be used to receive a control signal of the control device 100 (such as an infrared remote controller, etc.).

[0075] The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver for collecting ambient light intensity, or the detector 230 includes an image collector such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures, or the detector 230 includes a sound collector such as a microphone, etc., for receiving external sounds.

[0076] The external device interface 240 can include, but is not limited to, any one or more of a High-Definition Multimedia Interface (HDMI), an analog or digital High-Definition Component Input Interface (Component), a Composite Video Input Interface (CVBS), a USB Input Interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by a plurality of the above interfaces.

[0077] The tuner / demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio / video signals and EPG data signals from a plurality of wireless or wired broadcast television signals.

[0078] In some embodiments, the controller 250 and the tuner / demodulator 210 can be located in different separate devices, i.e., the tuner / demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0079] The controller 250 controls the operation of the display device and responds to user operations by various software control programs stored in the memory 290. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command.

[0080] In some embodiments, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first to nth interface for input / output, a communication bus, etc.

[0081] The user can input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0082] A "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the conversion between the internal form of information and the form acceptable by the user. A commonly used form of a user interface is a graphic user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an icon, a window, a control, and other interface elements displayed in the display screen of an electronic device, wherein the controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and Widgets.

[0083] The technical solutions of the present application will be described in detail below in combination with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described in detail in some embodiments.

[0084] Figure 3 Flowchart of a sound adjustment method provided for the embodiments of the present application Figure 1 The execution subject of the embodiments of the present application is a display device or a controller of a display device to control the controller, for example, as shown in FIG. 1, the method comprises the following steps. Figure 3

[0085] S301, acquiring position information of a speaker through the image acquisition device, and acquiring a sound signal of the speaker through the audio acquisition device.

[0086] In some embodiments, the display device can track a target through the audio acquisition device and the image acquisition device to determine a speaker who is currently speaking. For example, when the audio acquisition device detects that a user starts to speak, the speaker recognition is performed through the camera to determine the speaker who is currently speaking.

[0087] When determining the speaker, the display device can detect the position through the image acquisition device to acquire the position information of the speaker, and perform sound pickup of the speaker through the audio acquisition device to obtain the sound signal of the speaker.

[0088] In some embodiments, the display device can take a reference point (for example, a center point of the display device, a center point of the audio acquisition device, etc.) of the display device as a reference point to acquire the coordinates of the speaker to obtain the position information. The position information can include the distance between the speaker and the display device, and / or the left-right positional relationship between the speaker and the display device.

[0089] S302, acquiring a gain of the sound signal according to the position information; the gain of the sound signal includes a sound intensity gain and / or a sound channel balance gain. ​

[0090] In some embodiments, the display device can obtain a distance between the speaker and the display device based on the position information of the speaker, calculate a sound intensity gain of the collected sound signal of the speaker based on the distance. Wherein, the sound intensity gain is used to adjust the intensity (volume) of the collected sound signal.

[0091] In some embodiments, the display device can obtain a left-right position relationship between the speaker and the display device based on the position information of the speaker, calculate a sound channel balance gain of the collected sound signal of the speaker based on the left-right position relationship. Wherein, the sound channel balance gain is used to adjust the intensity of the left and right channels of the collected sound signal.

[0092] For example, as shown in Figure 4 The display device can calculate the Euclidean distance between the speaker and the center point of the display device based on the position coordinates of the speaker, and obtain the distance between the speaker and the display device. The sound signal and the distance are input into a pre-trained sound intensity gain model to obtain the sound intensity gain.

[0093] For example, as shown in Figure 5 The display device can determine that the speaker is on the left side of the display device based on the position coordinates of the speaker, and calculate the vertical distance between the speaker and the center point of the display device to obtain the left-right position relationship distance between the speaker and the display device. The sound signal and the left-right position relationship are input into a pre-trained sound channel balance gain model to obtain the sound channel balance gain.

[0094] S303, based on the gain of the sound signal, the sound signal is adjusted.

[0095] In some embodiments, when the display device obtains the sound intensity gain and / or the sound channel balance gain, the display device can adjust the sound intensity and / or the intensity of the left and right channels of the sound signal based on the sound intensity gain and / or the sound channel balance gain. For example, the sound intensity of the sound signal is amplified according to the sound intensity gain, and / or the sound channel balance parameter of the sound signal is adjusted based on the sound channel balance gain.

[0096] In some embodiments, when the sound signal is adjusted based on the sound intensity gain and the sound channel balance gain, the sound signal can be adjusted respectively, and the two adjusted sound signals are merged to obtain a stereo sound signal.

[0097] In some embodiments, when the sound intensity of the sound signal is adjusted based on the sound intensity gain, if the adjusted sound intensity is greater than the preset maximum sound intensity, the display device can take the preset maximum sound intensity as the adjusted sound intensity. If the adjusted sound intensity is less than the preset minimum sound intensity, the display device can take the preset minimum sound intensity as the adjusted sound intensity.

[0098] The sound adjustment method provided by the embodiments of the present application includes: acquiring position information of a speaker by the image acquisition device, and collecting a sound signal of the speaker by the audio acquisition device; acquiring a gain of the sound signal according to the position information; the gain of the sound signal includes a sound intensity gain and / or a sound channel balance gain; and performing stereo adjustment on the sound signal based on the gain of the sound signal. The sound signal collected from the speaker is adjusted based on the position of the speaker, so that the stereo adjustment can be performed in a targeted manner, the adjustment effect of the stereo sound can be improved, and the user experience can be improved.

[0099] Based on the above embodiments, the method for adjusting the sound intensity of the sound signal based on the position information is further described below.

[0100] Figure 6 Flowchart of the sound adjustment method provided by the embodiments of the present application Figure 2 As shown in Figure 6 , it includes:

[0101] S601, according to the position information, the distance between the speaker and the display device is acquired, and the target sound intensity of the speaker is determined based on the distance.

[0102] In some embodiments, the display device can calculate the Euclidean distance between the speaker and the center point of the display device based on the position coordinates of the speaker, to obtain the distance between the speaker and the display device.

[0103] In some embodiments, the target sound intensity can refer to a sound intensity that is more appropriate for the sound signal of the speaker collected at the current position of the speaker.

[0104] The display device can acquire the target sound intensity based on a preset sound intensity model.

[0105] For example, the preset sound intensity model can be as shown in Figure 7 , the sound intensity and the distance can be in a proportional relationship, for example, the sound intensity and the distance can satisfy the formula as shown below:

[0106] Y=K0x+b0

[0107] wherein Y is the target sound intensity, x is the distance between the display device and the speaker, K0 is a preset sound intensity gain coefficient, b0 is a maximum preset volume when the distance is 0, and a1 is a maximum pickup distance allowed by the display device (when the distance between the display device and the speaker is greater than a1, the display device cannot collect the sound signal of the speaker), and b1 is a minimum preset volume at the farthest distance in the model.

[0108] As shown in the above formula, the display device can determine the target sound intensity Y according to the acquired position of the speaker.

[0109] S602, acquiring the sound intensity gain according to the target sound intensity and the sound intensity of the sound signal.

[0110] In some embodiments, when the target sound intensity is acquired, the sound intensity gain can be acquired based on the size relationship between the target sound intensity and the sound intensity of the sound signal.

[0111] In a possible implementation, if the target sound intensity is greater than the sound intensity of the sound signal, the intensity of the sound signal needs to be enhanced, and the display device can take the difference between the target sound intensity and the sound intensity of the sound signal as the sound intensity gain (positive gain). If the target sound intensity is less than the sound intensity of the sound signal, the intensity of the sound signal needs to be reduced, and the display device can take the difference between the sound intensity of the sound signal and the target sound intensity as the sound intensity gain (negative gain).

[0112] In another possible implementation, the sound intensity gain can be determined based on a preset sound intensity gain coefficient and the distance. For example, if the target sound intensity is greater than the sound intensity of the sound signal, the intensity of the sound signal needs to be enhanced, and the sound intensity gain can satisfy Y1=K0x. If the target sound intensity is less than the sound intensity of the sound signal, the intensity of the sound signal needs to be reduced, and the sound intensity gain can satisfy Y1=-K0x.

[0113] It should be understood that if the target sound intensity is equal to the sound intensity of the sound signal, the sound intensity gain is zero.

[0114] S603, adjusting the sound intensity of the sound signal according to the sound intensity gain.

[0115] In some embodiments, when the sound intensity gain is determined, the display device can amplify or reduce the sound intensity of the sound signal based on the sound intensity gain.

[0116] In a possible implementation, if the target sound intensity is greater than the sound intensity of the sound signal, the adjusted sound intensity satisfies Y T =Y 当前 +(Y 目标 -Y 当前 ), or Y T =Y 当前 +N*(Y 目标 -Y 当前 ), where N can be a preset adjustment coefficient, and N is greater than 0 and less than or equal to 1.

[0117] If the target sound intensity is less than the sound intensity of the sound signal, the adjusted sound intensity satisfies Y T =Y 当前 -(Y 目标 -Y 当前 ), or Y T =Y 当前 -N*(Y 目标 -Y 当前 ), where N can be a preset adjustment coefficient, and N is greater than 0 and less than or equal to 1.

[0118] In a possible implementation, if the target sound intensity is greater than the sound intensity of the sound signal, the adjusted sound intensity satisfies Y T =Y 当前 +K0x, and if the target sound intensity is less than the sound intensity of the sound signal, the adjusted sound intensity satisfies Y T =Y 当前 -K0x.

[0119] The following describes another way of obtaining a sound intensity gain. Figure 8

[0120] Figure 8 The flowchart of the sound adjustment method provided by the embodiments of the present application Figure 3 As shown in the flowchart, the method comprises the following steps. Figure 8

[0121] S801, obtain a sound intensity gain coefficient of the sound signal.

[0122] In different environments, the sound intensity gain for a speaker at the same position can need different degrees of gain, for example, in a relatively noisy environment, the sound intensity gain can need to be larger, and in a quiet environment, the sound intensity gain can need to be smaller. Therefore, the display device can obtain different sound intensity gain coefficients based on the current environment to perform targeted enhancement, so as to further improve the accuracy of sound intensity enhancement.

[0123] ​​In some embodiments, environmental parameters of the display device are obtained; the environmental parameters include one or more of the size of the space in which the display device is located, the ambient noise, and the number of people in the environment; based on the environmental parameters, a pre-trained gain model is used to obtain the sound intensity gain coefficient.

[0124] The display device can obtain the space size of the environment in which the display device is located and / or the number of people in the environment through an image acquisition device, and / or obtain the sound signal of the current environment through a sound acquisition device, and determine the current environmental noise based on a noise estimation algorithm.

[0125] When the display device obtains the environmental parameters, the environmental parameters and the preset sound intensity gain coefficients can be input into a trained gain model to obtain the sound intensity gain coefficients output by the trained gain model. Alternatively, when the display device obtains the environmental parameters, the environmental parameters can be input into a trained gain model to obtain the sound intensity gain coefficients output by the pre-trained gain model. The preset sound intensity gain coefficients can be pre-defined by the pre-trained gain model. The pre-trained gain model can be constructed based on a neural network model.

[0126] S802: Obtain the sound intensity gain according to the sound intensity gain coefficient and the distance between the speaker and the display device.

[0127] In some embodiments, the sound intensity gain may satisfy the following formula:

[0128] Y1=K1x

[0129] Where K1 is the sound intensity gain coefficient, x is the distance between the speaker and the display device, and Y1 is the sound intensity gain.

[0130] It should be understood that those skilled in the art may modify the above formula in any manner, such as, for example, Y1 = K1x + c, where c is a preset sound intensity that can be determined based on actual experience, or Y1 = A*K1x + c, where A is a preset proportional coefficient. The embodiments of the present application do not limit the form of the formula that the sound intensity gain satisfies.

[0131] S803: Adjust the sound intensity of the sound signal according to the sound intensity gain; the sound intensity of the sound signal after adjustment is within a preset sound intensity range.

[0132] In some embodiments, the sound gain may be determined based on

[0133] For example, the sound intensity Y of the sound signal after adjustment T Satisfies the following formula:

[0134] Y T = Y 当前 + K1x

[0135] In some embodiments, when adjusting the sound intensity of the sound signal, if the target sound intensity is greater than the sound intensity of the sound signal, the display device can set Y T = Y 当前 + K1x, if the target sound intensity is less than the sound intensity of the sound signal, the display device can set Y T = Y 当前 - K1x.

[0136] If the adjusted sound intensity is greater than the preset maximum sound intensity, the display device can set the preset maximum sound intensity as the adjusted sound intensity. If the adjusted sound intensity is less than the preset minimum sound intensity, the display device can set the preset minimum sound intensity as the adjusted sound intensity.

[0137] The sound adjustment method provided by the embodiments of the present application can further improve the accuracy of adjusting the sound intensity of the sound signal of the speaker by calculating the corresponding sound intensity gain coefficient based on the environmental parameters of the display device.

[0138] The following will be described in combination with Figure 9 , the method of adjusting the sound channel balance parameter of the sound signal based on the position information.

[0139] S901, according to the position information, the position relationship between the speaker and the reference point of the display device and the vertical distance from the reference point are obtained.

[0140] In some embodiments, please continue to refer to Figure 5 , the position relationship between the speaker and the reference point of the display device can mean that the position of the speaker is on the left of the reference point of the display device, or on the right of the reference point, or the speaker is on the extension line of the reference point.

[0141] In some embodiments, as Figure 5 shown, the vertical distance between the speaker and the reference point can mean the vertical distance between the speaker and the extension line of the reference point.

[0142] The display device can calculate the position relationship between the speaker and the reference point of the display device and the vertical distance from the reference point based on the obtained position coordinates of the speaker, with the reference point as the origin.

[0143] S902, according to the position relationship and the vertical distance, the sound channel balance gain is determined.

[0144] In some embodiments, the channel balance gain is used to adjust a preset channel balance parameter of the display device. The preset channel balance parameter can be used to adjust the balance control of the left and right channels of the collected sound signal to improve the effect of stereo sound.

[0145] In some embodiments, the display device can determine a channel gain coefficient of the sound signal according to the positional relationship and a preset channel gain coefficient, and determine the channel balance gain according to the channel gain coefficient and the vertical distance.

[0146] For example, the preset channel gain coefficient can be a value determined based on prior knowledge, for example, the preset channel gain coefficient is denoted as f, which is determined based on calibration of the speaker at a preset position (for example, the speaker is on the extension line of the reference point of the display device).

[0147] In some embodiments, different biased channel balance parameters are required when the user is at different positions, for example, a left-biased channel balance parameter is required when the user is on the left of the reference point of the display device, and a right-biased channel balance parameter is required when the user is on the right of the reference point of the display device. The display device can adjust the preset channel gain coefficient based on the position of the user to obtain a channel balance parameter that meets the requirements.

[0148] In some embodiments, if the speaker is on the left of the reference point of the display device, the channel gain coefficient F can satisfy the following formula:

[0149] F = -f

[0150] In some embodiments, if the speaker is on the left of the reference point of the display device, the channel gain coefficient F can satisfy the following formula:

[0151] F = f

[0152] When determining the channel gain coefficient, the display device can obtain the channel balance gain based on the channel gain coefficient and the vertical distance between the speaker and the reference point of the display device to adjust the preset channel balance parameter,

[0153] In some embodiments, the channel balance gain can satisfy the following formula:

[0154] P = FX

[0155] Wherein, X is the vertical distance between the speaker and the reference point of the display device.

[0156] It should be understood that the above formula can also be arbitrarily transformed by those skilled in the art, for example, P = n * FX, n is a preset coefficient, the channel gain coefficient F is constant, f, when the speaker is on the left of the reference point of the display device, the distance X is set to -X, when the speaker is on the right of the reference point of the display device, the distance X is set to X, etc., which is not limited in the embodiments of the present application.

[0157] S903, adjusting the preset channel balance parameter of the sound signal according to the channel balance gain.

[0158] When the display device determines the channel balance gain, the preset channel balance parameter is adjusted according to the channel balance gain, so as to obtain a channel balance parameter matching the current speaker position.

[0159] In some embodiments, the adjusted channel balance parameter P T satisfies the formula as follows:

[0160] P T = FX + P0

[0161] Wherein, P0 is a preset channel balance parameter.

[0162] As shown in the above formula, if the speaker is on the left of the reference point of the display device, P T = FX + P0 = -fX + P0, the preset channel balance parameter is adjusted to the left to obtain a left-biased channel balance parameter, and if the speaker is on the right of the reference point of the display device, P T = FX + P0 = fX + P0, the preset channel balance parameter is adjusted to the right to obtain a right-biased channel balance parameter.

[0163] When the display device determines the channel balance parameter of the current sound signal, the sound signal can be adjusted based on the determined channel balance parameter to obtain a sound signal adjusted by the channel balance parameter.

[0164] In some embodiments, the sound intensity adjustment of the sound signal and the channel balance parameter adjustment of the sound signal can be adjusted based on the original sound signal respectively, or the sound intensity adjustment of the sound signal is performed first, and then the channel balance parameter adjustment of the sound signal is performed based on the sound signal adjusted by the sound intensity. Or, the channel balance parameter adjustment of the sound signal is performed first, and then the sound intensity adjustment of the sound signal is performed based on the sound signal adjusted by the channel balance parameter. If the sound intensity adjustment of the sound signal and the channel balance parameter adjustment of the sound signal can be adjusted based on the original sound signal respectively, the display device can combine the two sound signals (for example, using a sound combination algorithm / model) to obtain a target audio of stereo sound.

[0165] In some embodiments, the display device can transmit the obtained target audio of stereo sound to a display device at a far end of a box of the target audio of stereo sound, for example, a display device of an online user in a conference scene, so that the display device of the online user plays the target audio of stereo sound, improving the audio-visual experience of the online user.

[0166] In some embodiments, the display device can also transmit the collected position information and the sound signal to the far-end device, so that the far-end device performs stereo adjustment on the sound signal by using the method in the above embodiments to obtain the target audio of stereo sound, and plays the target audio.

[0167] On the basis of the above embodiments, the embodiments of the present application further provide a sound adjustment apparatus.

[0168] Figure 10 The structural schematic diagram of the sound adjustment apparatus 100 provided by the embodiments of the present application is shown in Figure 10 as shown, comprising:

[0169] The acquisition module 1001 is configured to acquire position information of a speaker and a sound signal of the speaker.

[0170] The processing module 1002 is configured to acquire a gain of the sound signal according to the position information, wherein the gain of the sound signal comprises a sound intensity gain and / or a sound channel balance gain.

[0171] The adjustment module 1003 is configured to perform stereo adjustment on the sound signal based on the gain of the sound signal.

[0172] In some embodiments, the processing module 1002 is further configured to acquire a distance between the speaker and the display device according to the position information, and determine a target sound intensity of the speaker based on the distance. The sound intensity gain is acquired according to the target sound intensity and a sound intensity of the sound signal.

[0173] In some embodiments, the adjustment module 1003 is further configured to adjust the sound intensity of the sound signal according to the sound intensity gain.

[0174] In some embodiments, the processing module 1002 is further configured to acquire a sound intensity gain coefficient of the sound signal, and acquire the sound intensity gain according to the sound intensity gain coefficient and the distance between the speaker and the display device.

[0175] In some embodiments, the adjustment module 1003 is further configured to adjust the sound intensity of the sound signal according to the sound intensity gain, and the adjusted sound intensity of the sound signal is within a preset sound intensity range.

[0176] In some embodiments, the processing module 1002 is further configured to acquire an environmental parameter of the display device, the environmental parameter comprising one or more of a spatial size of an environment in which the display device is located, environmental noise, and a number of persons in the environment; and acquire the sound intensity gain coefficient using a pre-trained gain model according to the environmental parameter.

[0177] In some embodiments, the processing module 1002 is further configured to determine the sound intensity gain coefficient according to a size relationship between the target sound intensity and a sound intensity of the sound signal, and a mapping relationship between the size relationship and the sound intensity gain coefficient.

[0178] In some embodiments, the processing module 1002 is further configured to acquire, according to the position information, a position relationship between the speaker and a reference point of the display device, and a vertical distance from the reference point; and determine the channel balance gain according to the position relationship and the vertical distance.

[0179] In some embodiments, the adjusting module 1003 is further configured to adjust a preset channel balance parameter of the sound signal according to the channel balance gain.

[0180] In some embodiments, the processing module 1002 is further configured to determine a channel gain coefficient of the sound signal according to the position relationship and a preset channel gain coefficient; and determine the channel balance gain according to the channel gain coefficient and the vertical distance.

[0181] In some embodiments, the processing module 1002 is further configured to perform merging processing on the sound signal after sound intensity adjustment and the sound signal after preset channel balance parameter adjustment to obtain a target audio of stereo sound; and transmit the target audio to a remote device connected to the display device. Alternatively, the processing module 1002 is further configured to transmit the position information and the sound signal to the remote device to enable the remote device to perform stereo sound adjustment on the sound signal to obtain a target audio of stereo sound.

[0182] The sound adjustment apparatus provided in the present application is configured to implement the technical solutions of the sound adjustment method provided in any of the foregoing embodiments, and has similar implementation principles and technical effects, which will not be described herein again.

[0183] It should be noted that the division of each module of the above apparatus is only a logical function division, and all or part of the actual implementation can be integrated into a physical entity, or can be physically separated. And these modules can all be realized in the form of software called by a processing element; all can be realized in the form of hardware; part of the modules can be realized in the form of software called by a processing element, and part of the modules can be realized in the form of hardware. Each module can be a separately established processing element, or can be integrated in a chip of the above apparatus, in addition, the functions of each module can also be stored in the form of program code in the memory of the above apparatus, and called and executed by a processing element of the above apparatus. In addition, all or part of these modules can be integrated together, or can be independently realized. The processing element here can be an integrated circuit with signal processing capability. In the implementation process, each step of the above method or each module can be completed by the integrated logic circuit of hardware in the processing element or the instruction in the form of software.

[0184] The application further provides a computer readable storage medium, which can include a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various storage program code media, and the computer readable storage medium specifically stores program instructions. The program instructions are used for the method in the above embodiments.

[0185] The application further provides a program product, which includes execution instructions stored in a readable storage medium. At least one control module of a display device can read the execution instructions from the readable storage medium, and the at least one control module executes the execution instructions to enable the display device to implement the sound adjustment method provided by the various embodiments.

[0186] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the application, and not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the application.

[0187] For the sake of convenience, the foregoing description has been presented in terms of specific implementations. Again, however, the foregoing discussion is not intended to be exhaustive or to limit the implementations to the precise forms disclosed. Modifications and variations are possible in light of the above teachings. The implementations were chosen and described in order to provide the best illustration of the principles of the application and its practical application, and to thereby enable one of ordinary skill in the art to use the application in various implementations and with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising: The display device comprises an audio acquisition device, an image acquisition device, and a controller connected with the audio acquisition device and the image acquisition device, and the controller is configured to: acquire position information of a speaker through the image acquisition device, and acquire a sound signal of the speaker through the audio acquisition device; acquire a gain of the sound signal according to the position information; the gain of the sound signal comprises a sound intensity gain and / or a sound channel balance gain; perform stereo adjustment on the sound signal based on the gain of the sound signal.

2. The display device of claim 1, wherein, The controller is configured to: acquire a distance between the speaker and the display device according to the position information, and determine a target sound intensity of the speaker based on the distance; acquire the sound intensity gain according to the target sound intensity and a sound intensity of the sound signal; adjust the sound intensity of the sound signal according to the sound intensity gain.

3. The display device of claim 1, wherein, The controller is configured to: acquire a sound intensity gain coefficient of the sound signal; acquire the sound intensity gain according to the sound intensity gain coefficient and the distance between the speaker and the display device; adjust the sound intensity of the sound signal according to the sound intensity gain; the adjusted sound intensity of the sound signal is within a preset sound intensity range.

4. The display device of claim 3, wherein, The controller is configured to: acquire an environmental parameter of the display device; the environmental parameter comprises one or more of a space size of an environment where the display device is located, environmental noise, and a number of personnel in the environment; acquire the sound intensity gain coefficient by using a pre-trained gain model according to the environmental parameter; or, The controller is configured to: determine the sound intensity gain coefficient according to a size relationship between a target sound intensity and a sound intensity of the sound signal, and a mapping relationship between the size relationship and the sound intensity gain coefficient.

5. The display device of claim 1, wherein, The controller is configured to: acquire a position relationship of the speaker with a reference point of the display device and a vertical distance from the reference point according to the position information; determine the sound channel balance gain according to the position relationship and the vertical distance; adjust a preset sound channel balance parameter of the sound signal according to the sound channel balance gain.

6. The display device of claim 5, wherein, The controller is configured to: determine a sound channel gain coefficient of the sound signal according to the position relationship and a preset sound channel gain coefficient; determine the sound channel balance gain according to the sound channel gain coefficient and the vertical distance.

7. The display device according to any of claims 1-6, characterized in that, The controller is configured to: perform merging processing on the sound signal after sound intensity adjustment and the sound signal after preset sound channel balance parameter adjustment to obtain target audio of stereo sound; transmit the target audio to a remote device connected with the display device; Or, the controller is configured to: transmit the position information and the sound signal to the remote device, so that the remote device performs stereo adjustment on the sound signal to obtain target audio of stereo sound.

8. A sound adjustment method characterized by, comprises: acquiring position information of a speaker and a sound signal of the speaker; obtaining a gain of the sound signal according to the position information; the gain of the sound signal comprises a sound intensity gain and / or a sound channel balance gain; stereo adjusting the sound signal based on the gain of the sound signal.

9. A storage medium, characterized by The storage medium has computer execution instructions stored therein, and the computer execution instructions are used for realizing the method in claim 8 when executed by the controller.

10. A computer program product, characterised in that, The computer program is executed by the controller to realize the method in claim 8. The computer program is executed by the controller to realize the method in claim 8.

Images