Signal playing method and device, storage medium and computer equipment

Abstract

The embodiment of the invention provides a signal playing method and device, a storage medium and computer equipment, and the method comprises the steps: carrying out the detection of an obtained camera image, and generating a detection result; generating a playing signal according to an adjustment parameter and an obtained audio input signal, wherein the adjustment parameter comprises the detection result; and playing according to the playing signal, so that the computer equipment can automatically adjust the audio input signal to be played and generate the playing signal, the sound playing effect is improved, and the satisfaction degree of a user is also improved.

Description

Technical Field

[0001] The present invention relates to the field of automatic sound technology, and in particular to a signal playing method, device, storage medium and computer equipment. Background Art

[0002] Assuming that the speaker is installed in the main body of the computer device, the sound field produced by the speaker is very irregular due to the reflection from the display. Therefore, using a fixed equalizer response to balance the frequency response cannot produce a flat frequency response in all usage cases, resulting in poor sound playback and reduced user satisfaction. Summary of the invention

[0003] In view of this, the present invention provides a signal playing method, device, storage medium and computer equipment, so as to solve the problem of poor sound playing effect and reduced user satisfaction in the prior art.

[0004] In a first aspect, an embodiment of the present invention provides a method for playing a signal, comprising:

[0005] Detect the acquired camera image and generate a detection result;

[0006] generating a playback signal according to an adjustment parameter and the acquired audio input signal, wherein the adjustment parameter includes the detection result;

[0007] Play according to the playback signal.

[0008] In a possible implementation manner, before generating the playback signal according to the adjustment parameter and the acquired audio input signal, the method further includes:

[0009] Get the equipment opening parameters;

[0010] The adjustment parameter further includes a device opening parameter, and the playback signal includes a first playback signal; and generating the playback signal according to the detection result and the acquired audio input signal includes:

[0011] Determine a first equalizer parameter according to the device opening parameter and the detection result;

[0012] The audio input signal is adjusted according to the first equalizer parameter to generate the first playback signal.

[0013] In a possible implementation, the playback signal includes a second playback signal; and generating the playback signal according to the adjustment parameter and the acquired audio input signal includes:

[0014] Determine a second equalizer parameter according to the detection result;

[0015] The audio input signal is adjusted according to the second equalizer parameter to generate the second playback signal.

[0016] In a possible implementation, the detecting the acquired camera image and generating the detection result includes:

[0017] The camera image is detected by a recognition algorithm to generate a detection result.

[0018] In a possible implementation manner, the detection result includes a relative position parameter.

[0019] In a possible implementation, the recognition algorithm includes a face recognition algorithm.

[0020] In a second aspect, an embodiment of the present invention provides a signal playback device, including:

[0021] The first generating module is used to detect the acquired camera image and generate a detection result;

[0022] a second generating module, configured to generate a playback signal according to an adjustment parameter and the acquired audio input signal, wherein the adjustment parameter includes the detection result;

[0023] The playing module is used for playing according to the playing signal.

[0024] In a third aspect, an embodiment of the present invention provides a computer device, comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the computer device is triggered to execute any one of the methods described in the first aspect.

[0025] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any method described in the first aspect.

[0026] In a fifth aspect, an embodiment of the present invention provides a computer program product, wherein the computer program product comprises executable instructions, and when the executable instructions are executed on a computer, the computer executes any one of the methods described in the first aspect.

[0027] The embodiments of the present invention provide a signal playback method, device, storage medium and computer equipment, which detect an acquired camera image and generate a detection result; generate a playback signal according to adjustment parameters and an acquired audio input signal, wherein the adjustment parameters include the detection result; and play according to the playback signal, so that the computer equipment can automatically adjust the audio input signal to be played and generate a playback signal, thereby improving the sound playback effect and user satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 A flowchart of a signal playing method provided by an embodiment of the present invention;

[0030] Figure 2 A detection schematic diagram provided by an embodiment of the present invention;

[0031] Figure 3 A flowchart of generating a first playback signal provided by an embodiment of the present invention;

[0032] Figure 4a A schematic diagram of the high-frequency sound field distribution around a device provided in an embodiment of the present invention;

[0033] Figure 4b A schematic diagram of high-frequency sound field distribution around another device provided in an embodiment of the present invention;

[0034] Figure 5a A frequency distribution schematic diagram provided for an embodiment of the present invention;

[0035] Figure 5b Another frequency distribution schematic diagram provided for an embodiment of the present invention;

[0036] Figure 6 A schematic diagram of a partial response implementation of an equalizer provided by an embodiment of the present invention;

[0037] Figure 7 A flow chart of generating a second playback signal provided by an embodiment of the present invention;

[0038] Figure 8 A schematic diagram of the structure of a signal playback device provided by an embodiment of the present invention;

[0039] Fig. 9A schematic diagram of the structure of a computer device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0040] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0041] It should be clear that the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0043] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0044] In the related art, the user's ears can be detected through acoustic detection or optical detection to adjust the audio level and / or response; or the playback device can switch the audio playback mode according to the mode set by the user, but the sound playback effect is poor, which reduces user satisfaction.

[0045] In order to improve the sound playback effect and increase user satisfaction, Figure 1 A flowchart of a signal playing method provided by an embodiment of the present invention, such as Figure 1 As shown, the method includes:

[0046] Step 101: The computer device detects the acquired camera image and generates a detection result.

[0047] In some embodiments, the computer device includes but is not limited to laptop computers, desktop computers and other devices. The computer device may also include foldable devices such as foldable phones and flip phones. The computer device includes a camera, which may be integrated in the computer device or connected to the computer device via wires and / or wirelessly. The camera captures a camera image. The computer device detects the camera image to detect whether the camera image includes a face image, wherein the face image includes an image of a certain part of the face or an image of the entire face.

[0048] Step 102: The computer device generates a playback signal according to an adjustment parameter and the acquired audio input signal, where the adjustment parameter includes a detection result.

[0049] In some embodiments, the computer device adjusts the audio input signal according to the adjustment parameter, for example, the adjustment includes equalization adjustment. The audio input signal can be a music signal, a game signal, a media signal, a consumer signal, a video sound signal or a voice signal.

[0050] Step 103: The computer device plays according to the play signal.

[0051] In some embodiments, the computer device further comprises an audio amplifier and a speaker. The audio amplifier and the speaker can be used for playing the playback signal.

[0052] An embodiment of the present invention provides a signal playback method, which detects an acquired camera image and generates a detection result; generates a playback signal according to an adjustment parameter and an acquired audio input signal, wherein the adjustment parameter includes the detection result; and plays according to the playback signal, so that a computer device can automatically adjust the audio input signal to be played and generate a playback signal, thereby improving the sound playback effect and user satisfaction.

[0053] In a possible implementation, step 101 may specifically include: the computer device detects the camera image through a recognition algorithm to generate a detection result.

[0054] In some embodiments, the computer device detects the camera image through a recognition algorithm to detect whether the camera image includes a face image; after detecting that the camera image includes a face image, a relative position parameter is generated according to the camera image including the face body image, and the detection result includes the relative position parameter, and the relative position parameter includes the direction, position and / or distance of the face relative to the camera; the detection result may also include the face image. After the computer device does not detect the face image in the camera image, the computer device generates a detection result according to the camera image not including the face image, and the detection result includes: the camera image does not include the face image. Thus, human body detection can be performed through the recognition algorithm to obtain the relative position parameters between the face and the computer and the device. For example, when the computer device detects the neck, torso, shoulders and other parts in the camera image, the face position can be determined according to the detected neck, torso, shoulders and other parts, and the equalizer can be adjusted according to the estimated position of the listener's ear (which can be located on the center normal axis of the display).

[0055] Figure 2 A detection schematic diagram provided by an embodiment of the present invention, such as Figure 2As shown, the computer device is a laptop computer, and the laptop computer includes a camera, a device body, a display or cover component, and an opening sensor. The display or cover part and the device body can be connected by a hinge, and the opening angle ∠A is the angle between the display or cover part and the device body. The recognition algorithm includes a face recognition algorithm, and the laptop computer also includes a face detection module. The camera collects a camera image, and the face detection module detects the camera image and detects that the camera image includes a face image.

[0056] If the speaker is connected to the computer device via wired and / or wireless connection, when the computer device detects the camera image through the recognition algorithm, it can also detect whether the camera image includes the speaker image; when it is detected that the camera image includes the speaker image, the relative angle parameter is calculated according to the speaker image, and the detection result also includes the relative angle parameter, which includes the angle between the speaker and the reflection plane.

[0057] In a possible implementation, before step 102, the following steps are further included: step 100, the computer device obtains the device opening parameter; the adjustment parameter also includes the device opening parameter, and step 102 may specifically include:

[0058] In some embodiments, the speaker is integrated in the computer device, and the computer device further includes an opening sensor, which is used to collect device opening parameters. The device opening parameters include the angle between the device body and the display or cover component, such as Figure 2 As shown, the speaker is integrated on the laptop computer, and the reflection of sound from the display or cover part and the device body causes a very irregular sound field, so changes in geometry and listening position have an impact on the sound frequency, and the device opening parameters include the opening angle ∠A.

[0059] When the speaker is connected to a desktop via a wire or wireless connection, the opening parameter is the angle between the speaker and the surface on which it is placed, which can be set according to actual conditions. If the actual value of the opening parameter is not available, the opening parameter can be set to a default value for typical usage (i.e., a default average of the opening angle of a laptop monitor). Alternatively, if an adjustable base is provided, the base can include a detection mechanism, such as a sensor. The reading of the sensor can be returned to the computer device via a connection interface (such as USB or Bluetooth), or an equalization function can be performed locally in the speaker.

[0060] In some embodiments, if the computer device's camera is blocked or disabled, this can allow equalization principles to be used in devices such as an external display with speakers without a camera. If used with an external display, the external display typically has a stand to place it away from the desk, and the height of the external display can also be used as an additional adjustment parameter.

[0061] Figure 3 A flowchart of generating a first playback signal is provided in an embodiment of the present invention, such as Figure 3 As shown, step 102 may specifically include:

[0062] Step 1021: The computer device determines a first equalizer parameter according to the device opening parameter and the detection result.

[0063] In some embodiments, Figure 4a A schematic diagram of the high-frequency sound field distribution around a device provided in an embodiment of the present invention, Figure 4b A schematic diagram of the high-frequency sound field distribution around another device provided in an embodiment of the present invention, such as Figure 4a and Figure 4b As shown, the high frequency refers to 10kHz; the computer equipment includes a laptop computer, and the angle between the laptop screen and the keyboard is defined as the opening angle ∠A. The sound frequency around the laptop computer is affected by the opening angle ∠A of the laptop computer. The sound frequency of the space corresponding to the opening angle ∠A of the laptop computer is greater than the sound frequency of other spaces. The relative position parameters include the listener position, Figure 5a A frequency distribution diagram provided by an embodiment of the present invention, such as Figure 5a As shown, Figure 5a The frequency response changes when the opening angle and the listener position are changed are shown in the figure. The simulated frequency response shows the influence of the opening angle and the listener position change on the frequency response of the computer device. The frequency response has a significant change in a wide range, and an attempt is made to correct the response with a fixed equalizer corresponding to the average response. Figure 5b Another frequency distribution diagram provided by an embodiment of the present invention is as follows: Figure 5b As shown, Figure 5b The figure shows the frequency response changes when the opening angle is 105 degrees and the listener's azimuth elevation angle is 15 degrees, 30 degrees, and 45 degrees, and only the listener's position is changed. The horizontal axis is frequency, and the unit of frequency is Hertz (Hz); the vertical axis is level, and the unit of level is decibel (dB).

[0064] Since the reflection of sound from the display or cover part and the device body causes a very irregular sound field, the frequency distribution around the computer device depends on the device opening parameters and position relative parameters.

[0065] In the embodiment of the present invention, the adjustment parameter may also include device information of the computer device, initial information of the equalizer, etc., and the adjustment parameter is not limited in the embodiment of the present invention. Step 1021 may also include: the computer device determines the first equalizer parameter according to the device information and / or initial information, and the device opening parameter and the detection result.

[0066] Step 1022: The computer device adjusts the audio input signal according to the first equalizer parameter to generate a first playback signal.

[0067] In some embodiments, the computer device further includes an equalizer, and the equalizer is used to adjust the audio input signal. For example, the equalizer includes a high-order equalizer and / or a tilt equalizer. The equalizer is adjusted according to the first equalizer parameter, and the adjusted equalizer adjusts the audio input signal to adjust the frequency and / or level of the audio input signal, and the adjusted audio input signal is used as the first playback signal.

[0068] The simplest feasible equalizer consists of two equalizer blocks, for example, the simplest adjustable equalizer sufficient to control the frequency response consists of two second-order biquad equalizer blocks. Figure 6 A schematic diagram of a partial response implementation of an equalizer provided by an embodiment of the present invention, such as Figure 6 As shown, Figure 6 The figure shows the adjustment of the signal when two equalizer modules are used, wherein the horizontal axis is frequency, and the unit of frequency is Hertz (Hz); the vertical axis is gain, and the unit of gain is decibel (dB). With the gain of 0dB as the reference line, the upper part with a gain above 0dB is used as the gain and frequency control, and the equalizer will perform gain and frequency control on the signal; the lower part with a gain below 0dB is used as the gain control, and the equalizer will perform gain control on the signal.

[0069] In a possible implementation, the playback signal includes a second playback signal; Figure 7 A flowchart of generating a second playback signal is provided in an embodiment of the present invention, such as Figure 7 As shown, step 102 may specifically include:

[0070] Step 1023: The computer device determines the second equalizer parameters according to the detection result.

[0071] In some embodiments, the detection result includes a relative position parameter and a relative angle parameter.

[0072] In some embodiments, the adjustment parameters may also include device information of the computer device, initial information of the equalizer, etc., and the adjustment parameters are not limited in the embodiments of the present invention. Step 1023 may also include: the computer device determines the second equalizer parameter according to the device information and / or initial information, and the detection result. The specific description of step 1023 can refer to the above step 1021.

[0073] Step 1024: The computer device adjusts the audio input signal according to the second equalizer parameter to generate a second playback signal.

[0074] In some embodiments, the detailed description of step 1024 can refer to the above step 1022.

[0075] The embodiment of the present invention provides a signal playback method, which detects the acquired camera image and generates a detection result; generates a playback signal according to adjustment parameters and the acquired audio input signal, and the adjustment parameters include the detection result; plays according to the playback signal, so that the computer device obtains the detection result by identifying and detecting the camera image in real time, and then automatically adjusts the audio input signal to be played based on the adjustment parameters including the detection result to generate a playback signal, so that users can have good listening effects in different positions, improve the sound playback effect, and also improve user satisfaction.

[0076] The technical solution provided in the embodiment of the present invention can be applied to a laptop computer having a main body and another part (such as a display screen) connected to an adjustable hinge. The laptop computer is equipped with a camera facing the user and a sensor capable of reading the angle between the two parts. By determining adjustment parameters through a face detection algorithm combined with the user's position and the device geometry, and then using these adjustment parameters to adjust the audio equalizer, the equalization effect of the laptop computer's speakers can be accurately adjusted, and the audio equalizer is applicable to a wide range of desktop speakers.

[0077] Figure 8 A schematic diagram of a signal playback device provided by an embodiment of the present invention is shown in FIG. Figure 8 As shown, the device includes a first generating module 11, a second generating module 12 and a playing module 13. The first generating module 11 is connected to the second generating module 12, and the second generating module 12 is connected to the playing module 13.

[0078] The first generating module 11 is used to detect the acquired camera image and generate a detection result; the second generating module 12 is used to generate a playback signal according to adjustment parameters and the acquired audio input signal, wherein the adjustment parameters include the detection result; the playback module 13 is used to play according to the playback signal.

[0079] In a possible implementation, the device further includes an acquisition module 14, and the acquisition module 14 is connected to the first generation module.

[0080] The acquisition module 14 is used to obtain the device opening parameter; the adjustment parameter also includes the device opening parameter, and the playback signal includes a first playback signal; the first generation module 11 is specifically used to determine the first equalizer parameter based on the device opening parameter and the detection result; the audio input signal is adjusted according to the first equalizer parameter to generate the first playback signal.

[0081] In a possible implementation, the playback signal includes a second playback signal; the first generation module 11 is specifically configured to determine a second equalizer parameter according to the detection result; and adjust the audio input signal according to the second equalizer parameter to generate the second playback signal.

[0082] In a possible implementation, the second generating module 12 is specifically configured to detect the camera image through a recognition algorithm to generate a detection result.

[0083] In a possible implementation manner, the detection result includes a relative position parameter.

[0084] In a possible implementation, the recognition algorithm includes a face recognition algorithm.

[0085] An embodiment of the present invention provides a signal playback device, which detects an acquired camera image and generates a detection result; generates a playback signal according to adjustment parameters and an acquired audio input signal, wherein the adjustment parameters include the detection result; and plays according to the playback signal, so that a computer device can automatically adjust the audio input signal to be played and generate a playback signal, thereby improving the sound playback effect and user satisfaction.

[0086] Corresponding to the above embodiment, the present invention further provides a computer device. Fig. 9 A schematic diagram of the structure of a computer device provided in an embodiment of the present invention, the computer device 800 may include: a processor 801, a memory 802 and a communication unit 803. These components communicate through one or more buses. Those skilled in the art can understand that the structure of the computer device shown in the figure does not constitute a limitation on the embodiment of the present invention, it can be a bus structure or a star structure, and can also include more or less components than shown in the figure, or combine some components, or arrange the components differently.

[0087] The communication unit 803 is used to establish a communication channel so that the computer device can communicate with other devices, receive user data sent by other devices or send user data to other devices.

[0088] The processor 801 is the control center of the computer device. It uses various interfaces and lines to connect various parts of the entire computer device. It runs or executes software programs, instructions, and / or modules stored in the memory 802, and calls data stored in the memory to perform various functions of the computer device and / or process data. The processor can be composed of an integrated circuit (IC), for example, it can be composed of a single packaged IC, or it can be composed of multiple packaged ICs with the same or different functions. For example, the processor 801 can only include a central processing unit (CPU). In an embodiment of the present invention, the CPU can be a single computing core or multiple computing cores.

[0089] The memory 802 is used to store the execution instructions of the processor 801. The memory 802 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0090] When the execution instructions in the memory 802 are executed by the processor 801, the computer device 800 is able to execute Figure 1 Some or all of the steps in the illustrated embodiments.

[0091] In a specific implementation, the present invention further provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the signal playback method provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0092] In a specific implementation, the present invention further provides a computer program product, wherein the computer program product includes executable instructions, and when the executable instructions are executed on a computer, the computer executes part or all of the steps in each embodiment of the signal playback method provided by the present invention.

[0093] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention or some parts of the embodiments.

[0094] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the device embodiment and the terminal embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

Claims

1. A signal playing method, characterized in that: include: Detect the acquired camera image and generate a detection result; generating a playback signal according to an adjustment parameter and the acquired audio input signal, wherein the adjustment parameter includes the detection result; Play according to the playback signal.

2. The method according to claim 1, characterized in that Before generating the playback signal according to the adjustment parameter and the acquired audio input signal, the method further includes: Get the equipment opening parameters; The adjustment parameter further includes a device opening parameter, and the playback signal includes a first playback signal; and generating the playback signal according to the detection result and the acquired audio input signal includes: Determine a first equalizer parameter according to the device opening parameter and the detection result; The audio input signal is adjusted according to the first equalizer parameter to generate the first playback signal.

3. The method according to claim 1, characterized in that The playback signal includes a second playback signal; and the generating of the playback signal according to the adjustment parameter and the acquired audio input signal includes: Determine a second equalizer parameter according to the detection result; The audio input signal is adjusted according to the second equalizer parameter to generate the second playback signal.

4. The method according to claim 1, characterized in that: The detecting of the acquired camera image to generate the detection result includes: The camera image is detected by a recognition algorithm to generate a detection result.

5. The method according to claim 4, characterized in that The detection result includes relative position parameters.

6. The method according to claim 4, characterized in that The recognition algorithm includes a face recognition algorithm.

7. A signal playback device, characterized in that: include: The first generating module is used to detect the acquired camera image and generate a detection result; a second generating module, configured to generate a playback signal according to an adjustment parameter and the acquired audio input signal, wherein the adjustment parameter includes the detection result; The playing module is used for playing according to the playing signal.

8. A computer device, characterized in that: The method comprises a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the computer device executes the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 6.

10. A computer program product, characterized in that The computer program product comprises executable instructions, and when the executable instructions are executed on a computer, the computer is caused to perform the method according to any one of claims 1 to 6.

Images