Signal playback method and apparatus, and storage medium and computer device

Abstract

Provided in the embodiments of the present invention are a signal playback method and apparatus, and a storage medium and a computer device. The method comprises: detecting an acquired camera image, so as to generate a detection result; generating a playback signal on the basis of adjustment parameters and an acquired audio input signal, wherein the adjustment parameters comprise the detection result; and performing playback on the basis of the playback signal. Thus, a computer device can automatically adjust an audio input signal to be played back, so as to generate a playback signal, thereby improving the sound playback effect and also increasing the user satisfaction.

Description

Signal playing method and device, storage medium and computer device TECHNICAL FIELD

[0001] The present application relates to the technical field of automatic sound, in particular to a signal playing method and device, a storage medium and a computer device. BACKGROUND

[0002] Suppose a speaker is installed in the main body of a computer device, due to reflection from a display, the sound field produced by the speaker is very irregular. TECHNICAL PROBLEM

[0003] Using a fixed equalizer response to balance the frequency response cannot produce a flat frequency response in all use cases, resulting in poor sound playing effect and reducing user satisfaction. TECHNICAL SOLUTION

[0004] Therefore, the present application provides a signal playing method and device, a storage medium and a computer device to solve the problem of poor sound playing effect and reduced user satisfaction in the prior art.

[0005] In a first aspect, the embodiments of the present application provide a signal playing method, comprising:

[0006] Detecting the obtained camera image to generate a detection result;

[0007] Generating a playing signal according to the adjustment parameter and the obtained audio input signal, wherein the adjustment parameter comprises the detection result;

[0008] Playing according to the playing signal.

[0009] In a possible implementation, before generating the playing signal according to the adjustment parameter and the obtained audio input signal, the method further comprises:

[0010] Obtaining a device opening parameter;

[0011] The adjustment parameter further comprises the device opening parameter, and the playing signal comprises a first playing signal; and generating the playing signal according to the detection result and the obtained audio input signal comprises:

[0012] Determining a first equalizer parameter according to the device opening parameter and the detection result;

[0013] Adjusting the audio input signal according to the first equalizer parameter to generate the first playing signal.

[0014] In a possible implementation, the playing signal comprises a second playing signal; and generating the playing signal according to the adjustment parameter and the obtained audio input signal comprises:

[0015] determining a second equalizer parameter according to the detection result;

[0016] adjusting the audio input signal according to the second equalizer parameter to generate the second playing signal.

[0017] In a possible implementation, the detecting the obtained camera image to generate a detection result comprises:

[0018] detecting the camera image by an identification algorithm to generate the detection result.

[0019] In a possible implementation, the detection result comprises a relative position parameter.

[0020] In a possible implementation, the identification algorithm comprises a face recognition algorithm.

[0021] In a second aspect, an embodiment of the present application provides a playing device of a signal, comprising:

[0022] a first generating module configured to detect an obtained camera image to generate a detection result;

[0023] a second generating module configured to generate a playing signal according to an adjustment parameter and an obtained audio input signal, the adjustment parameter comprising the detection result;

[0024] a playing module configured to play according to the playing signal.

[0025] In a third aspect, an embodiment of the present application provides a computer device, comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the computer device is triggered to execute the method in any one of the first aspect.

[0026] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, comprising stored program, wherein when the program runs, the computer readable storage medium controls a device where the computer readable storage medium is located to execute the method in any one of the first aspect.

[0027] In a fifth aspect, an embodiment of the present application provides a computer program product, comprising executable instructions, when the executable instructions are executed on a computer, the computer executes the method in any one of the first aspect. Advantageous effects

[0028] The embodiment of the present application provides a signal playing method and device, a storage medium and a computer device, the camera image obtained is detected to generate a detection result; a playing signal is generated according to an adjustment parameter and an obtained audio input signal, the adjustment parameter comprises the detection result; the playing signal is played according to the playing signal, so that the computer device can automatically adjust the audio input signal to be played to generate a playing signal, the playing effect of the sound is improved, and the satisfaction of a user is improved. BRIEF DESCRIPTION OF DRAWINGS

[0029] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiments will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0030] Fig. 1 is a flowchart of a signal playing method provided by the embodiment of the present application;

[0031] Fig. 2 is a detection schematic diagram provided by the embodiment of the present application;

[0032] Fig. 3 is a flowchart of generating a first playing signal provided by the embodiment of the present application;

[0033] Fig. 4a is a schematic diagram of high-frequency sound field distribution around a device provided by the embodiment of the present application;

[0034] Fig. 4b is a schematic diagram of another high-frequency sound field distribution around a device provided by the embodiment of the present application;

[0035] Fig. 5a is a frequency distribution schematic diagram provided by the embodiment of the present application;

[0036] Fig. 5b is another frequency distribution schematic diagram provided by the embodiment of the present application;

[0037] Fig. 6 is a schematic diagram of an equalizer partial response implementation provided by the embodiment of the present application;

[0038] Fig. 7 is a flowchart of generating a second playing signal provided by the embodiment of the present application;

[0039] Fig. 8 is a structural schematic diagram of a signal playing device provided by the embodiment of the present application;

[0040] Fig. 9 is a structural schematic diagram of a computer device provided by the embodiment of the present application. Best mode of the present application

[0041] In order to better understand the technical solutions of the present application, the embodiments of the present application will be described in detail below with reference to the drawings.

[0042] It should be noted that the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0043] The terms used in the embodiments of the present application are only for the purpose of describing the specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0044] It should be understood that the term "and / or" used herein is only to describe the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " in this paper generally represents that the front and rear associated objects are a "or" relationship.

[0045] In the related art, the user's ear can be detected by acoustic detection or optical detection, and then the level and / or response of the audio are adjusted; or the user sets a mode, and the playing device switches the playing mode of the audio according to the mode, but the playing effect of the sound is poor, which reduces the user's satisfaction.

[0046] In order to improve the playing effect of the sound and improve the user's satisfaction, Fig. 1 is a flowchart of a signal playing method provided by an embodiment of the present application, as shown in Fig. 1, the method comprises:

[0047] Step 101, the computer device detects the obtained camera image to generate a detection result.

[0048] In some embodiments, the computer device includes but is not limited to notebook computers, desktop computers and other devices. The computer device can also include foldable phones, flip phones and other foldable devices. The computer device includes a camera, which can be integrated on the computer device or connected to the computer device through wired and / or wireless. The camera captures a camera image. The computer device detects the camera image to detect whether the camera image includes a face image, wherein the face image includes an image of a part of the face or an overall image of the face, etc.

[0049] Step 102, the computer device generates a playing signal according to the adjustment parameter and the obtained audio input signal, and the adjustment parameter includes the detection result.

[0050] In some embodiments, the computer device adjusts the audio input signal according to the adjustment parameter, for example, the adjustment includes equalization adjustment. The audio input signal can be a music signal, a game signal, a media signal, a consumer signal, a video sound signal or a voice signal, etc.

[0051] Step 103, the computer device plays according to the playing signal.

[0052] In some embodiments, the computer device further includes an audio amplifier and a speaker. The audio amplifier and the speaker can be used to play the playing signal.

[0053] The embodiment of the present application provides a playing method of a signal, detects a camera image to generate a detection result; generates a playing signal according to an adjustment parameter and an acquired audio input signal, the adjustment parameter including the detection result; and plays according to the playing signal, so that the computer device can automatically adjust the audio input signal to be played to generate a playing signal, improve the playing effect of the sound, and improve the satisfaction of the user.

[0054] In a possible implementation manner, step 101 can specifically include: the computer device detects the camera image through an identification algorithm to generate a detection result.

[0055] In some embodiments, the computer device detects the camera image through an identification algorithm to detect whether the camera image includes a face image; after detecting that the camera image includes the face image, generates a relative position parameter according to the camera image including the face image, the detection result includes the relative position parameter, and the relative position parameter includes a direction, a position and / or a distance of the face relative to the camera; and the detection result can further include the face image. After the computer device does not detect the face image in the camera image, the computer device generates a detection result according to that the camera image does not include the face image, and the detection result includes that the camera image does not include the face image. Therefore, the identification algorithm can be used for human body detection to obtain the relative position parameter between the face and the computer device. For example, when the computer device detects a neck, a torso, a shoulder or the like in the camera image, the face position can be determined according to the detected neck, the torso, the shoulder or the like, and the equalizer can be adjusted according to the estimated position of the listener's ear (which can be located on the central normal axis of the display).

[0056] Figure 2 is a detection schematic provided by an embodiment of the present application, as shown in Figure 2, the computer device is a notebook computer, the notebook computer includes a camera, a device main body, a display or cover component, and an opening angle sensor, the display or cover component and the device main body can be connected through a hinge, the opening angle ∠A is the included angle between the display or cover component and the device main body. The recognition algorithm includes a face recognition algorithm, and the notebook computer further includes a face detection module. The camera captures a camera image, and the face detection module detects the camera image to detect that the camera image includes a face image.

[0057] If the loudspeaker is connected to the computer device through a wire and / or wireless. When the computer device detects the camera image through the recognition algorithm, it can also detect whether the camera image includes a loudspeaker image; when it is detected that the camera image includes a loudspeaker image, a relative angle parameter is calculated according to the loudspeaker image, and the detection result further includes the relative angle parameter, and the relative angle parameter includes the angle between the loudspeaker and the reflection plane.

[0058] In a possible implementation, step 102 further includes step 100: the computer device acquires a device opening parameter; and the adjustment parameter further includes the device opening parameter, and step 102 specifically can include:

[0059] In some embodiments, the loudspeaker is integrated on the computer device, and the computer device further includes an opening sensor for acquiring a device opening parameter. The device opening parameter includes the included angle between the device main body and the display or cover component, as shown in Figure 2, the loudspeaker is integrated on the notebook computer, and the sound from the reflection between the display or cover component and the device main body causes a very irregular sound field, so the change of the geometry and the listening position has an impact on the sound frequency, and the device opening parameter includes the opening angle ∠A.

[0060] When the loudspeaker is connected to the desktop through a wire or wireless, the opening parameter is the angle between the loudspeaker and the surface on which it is placed, which can be set according to the actual situation. If the actual value of the opening parameter is not available, the opening parameter can be set as the default value of the typical use (i.e. the default average value of the opening angle of the notebook computer display). Or, if an adjustable base is provided, the base can include a detection mechanism, such as a sensor. The reading of the sensor can be returned to the computer device through a connection interface (such as USB or Bluetooth), or the equalization function can be performed locally in the loudspeaker.

[0061] In some embodiments, if the camera of the computer device is blocked or disabled, the equalization principle can be allowed to be used in a device with an external display or the like with a loudspeaker without the camera. If used with an external display, the external display is usually placed at a distance from the desktop, and the height of the external display can also be used as an additional adjustment parameter.

[0062] Fig. 3 is a flowchart of generating a first playing signal according to an embodiment of the present application. As shown in Fig. 3, step 102 can specifically include:

[0063] Step 1021: determining the first equalizer parameter according to the device opening parameter and the detection result.

[0064] In some embodiments, Fig. 4a is a schematic diagram of high-frequency sound field distribution around a device according to an embodiment of the present application, and Fig. 4b is another schematic diagram of high-frequency sound field distribution around a device according to an embodiment of the present application. As shown in Figs. 4a and 4b, high frequency refers to 10 kHz; the computer device includes a notebook computer, and an angle between the screen and the keyboard of the notebook computer is defined as an opening angle ∠A. The sound frequency around the notebook computer is affected by the opening angle ∠A of the notebook computer, and the sound frequency of the space corresponding to the opening angle ∠A of the notebook computer is greater than the sound frequency of other spaces. The relative position parameter includes the listener position. Fig. 5a is a frequency distribution schematic diagram according to an embodiment of the present application. As shown in Fig. 5a, the frequency response changes when the opening angle and the listener position are changed are shown in Fig. 5a. The simulated frequency response shows the influence of the change of the opening angle and the listener position on the frequency response of the computer device, and the frequency response changes significantly in a wide range, and it is tried to correct the response with a fixed equalizer corresponding to the average response. Fig. 5b is another frequency distribution schematic diagram according to an embodiment of the present application. As shown in Fig. 5b, the frequency response changes when the opening angle is 105 degrees, and the listener azimuth elevation angle is 15 degrees, 30 degrees, and 45 degrees, and only the listener position is changed. In which, the horizontal axis is frequency, and the unit of frequency is hertz (Hz); the vertical axis is level, and the unit of level is decibel (dB).

[0065] Since the reflection of sound from the display or cover part to the device main body causes a very irregular sound field, the frequency distribution around the computer device depends on the device opening parameter and the position relative parameter.

[0066] In an embodiment of the present application, the adjustment parameter can also include device information of the computer device, initial information of the equalizer, and the like, and the adjustment parameter is not limited in the embodiment of the present application. Step 1021 can also include: determining the first equalizer parameter according to the device information and / or the initial information, and the device opening parameter and the detection result.

[0067] Step 1022, the computer device adjusts the audio input signal according to the first equalizer parameter to generate a first playing signal.

[0068] In some embodiments, the computer device further comprises an equalizer for adjusting the audio input signal, for example, the equalizer comprises a high-order equalizer and / or a tilt equalizer. The equalizer is adjusted according to the first equalizer parameter, and the adjusted equalizer adjusts the audio input signal to adjust the frequency and / or level of the audio input signal, and the adjusted audio input signal is taken as the first playing signal.

[0069] The simplest equalizer is composed of two equalizer modules, for example, the simplest adjustable equalizer sufficient to control the frequency response is composed of two two-order biquad equalizer modules. FIG. 6 is a schematic diagram of an equalizer partial response implementation provided by an embodiment of the present application. As shown in FIG. 6, FIG. 6 shows the adjustment of the signal when using two equalizer modules, where the horizontal axis is the frequency, the unit of the frequency is hertz (Hz); the vertical axis is the gain, the unit of the gain is decibel (dB). Take the gain of 0 dB as the reference line, take the upper part with the gain of 0 dB or more as the gain and frequency control, and the equalizer will control the gain and frequency of the signal; take the lower part with the gain of 0 dB or less as the gain control, and the equalizer will control the gain of the signal.

[0070] In a possible implementation, the playing signal comprises a second playing signal; FIG. 7 is a flowchart of generating a second playing signal provided by an embodiment of the present application. As shown in FIG. 7, step 102 can specifically comprise:

[0071] Step 1023, the computer device determines the second equalizer parameter according to the detection result.

[0072] In some embodiments, the detection result comprises a relative position parameter and a relative angle parameter.

[0073] In some embodiments, the adjustment parameter can further comprise device information of the computer device, initial information of the equalizer, etc., and the adjustment parameter is not limited in the embodiment of the present application. Step 1023 can further comprise: the computer device determines the second equalizer parameter according to the device information and / or the initial information, and the detection result. The specific description of step 1023 can be referred to the above step 1021.

[0074] Step 1024, the computer device adjusts the audio input signal according to the second equalizer parameter to generate a second playing signal.

[0075] In some embodiments, the specific description of step 1024 can be referred to the above step 1022.

[0076] This invention provides a method for playing a signal. The method involves detecting an acquired camera image and generating a detection result; generating a playback signal based on adjustment parameters and an acquired audio input signal, the adjustment parameters including the detection result; and playing the signal. This allows a computer device to automatically adjust the audio input signal to be played based on the adjustment parameters including the detection result, thereby providing a good listening experience for users in different locations, improving sound playback quality, and increasing user satisfaction.

[0077] The technical solution provided in this invention can be applied to a laptop computer having a main body and another part (such as a display screen) connected by an adjustable hinge. The laptop computer is equipped with a camera facing the user and a sensor capable of reading the angle between the two parts. Adjustment parameters are determined by using a face detection algorithm combined with the user's position and device geometry. These adjustment parameters are then used to adjust the audio equalizer, enabling precise adjustment of the laptop computer's speaker equalization effect, and is also applicable to a wide range of desktop speakers.

[0078] Figure 8 is a schematic diagram of a signal playback device provided in an embodiment of the present invention. As shown in Figure 8, the device includes a first generation module 11, a second generation module 12, and a playback module 13. The first generation module 11 is connected to the second generation module 12, and the second generation module 12 is connected to the playback module 13.

[0079] The first generation module 11 is used to detect the acquired camera image and generate a detection result; the second generation module 12 is used to generate a playback signal based on the adjustment parameters and the acquired audio input signal, wherein the adjustment parameters include the detection result; the playback module 13 is used to play the signal according to the playback signal.

[0080] In one possible implementation, the device further includes an acquisition module 14, which is connected to the first generation module.

[0081] The acquisition module 14 is used to acquire device opening parameters; the adjustment parameters also include device opening parameters, and the playback signal includes a first playback signal; the first generation module 11 is specifically used to determine a first equalizer parameter based on the device opening parameters and the detection result; adjust the audio input signal according to the first equalizer parameter to generate the first playback signal.

[0082] In one possible implementation, the playback signal includes a second playback signal; the first generation module 11 is specifically used to determine the second equalizer parameters based on the detection result; and to adjust the audio input signal according to the second equalizer parameters to generate the second playback signal.

[0083] In a possible implementation, the second generation module 12 is specifically configured to generate a detection result by detecting the camera image through an identification algorithm.

[0084] In a possible implementation, the detection result includes a relative position parameter.

[0085] In a possible implementation, the identification algorithm includes a face recognition algorithm.

[0086] The embodiment of the present application provides a signal playing device, which detects a camera image to generate a detection result, generates a playing signal according to an adjustment parameter and an acquired audio input signal, the adjustment parameter includes the detection result, and plays according to the playing signal, so that the computer device can automatically adjust an audio input signal to be played to generate a playing signal, thereby improving the playing effect of the sound and the satisfaction of the user.

[0087] Corresponding to the above embodiment, the present application further provides a computer device. FIG. 9 is a structural schematic diagram of a computer device provided by an embodiment of the present application. The computer device 800 can include a processor 801, a memory 802 and a communication unit 803. These components communicate through one or more buses. Those skilled in the art can understand that the structure of the computer device shown in the figure does not constitute a limitation on the embodiments of the present application. It can be a bus structure or a star structure, and can include more or fewer components than shown in the figure, or combine some components, or have a different component arrangement.

[0088] The communication unit 803 is configured to establish a communication channel, so that the computer device can communicate with other devices. It receives user data sent by other devices or sends user data to other devices.

[0089] The processor 801 is the control center of the computer device, which connects various parts of the computer device through various interfaces and lines, executes software programs, instructions and / or modules stored in the memory 802, and calls data stored in the memory, to perform various functions of the computer device and / or process data. The processor can be composed of integrated circuits (ICs), for example, a single packaged IC or a plurality of packaged ICs with the same function or different functions connected together. For example, the processor 801 can only include a central processing unit (CPU). In the embodiments of the present application, the CPU can be a single operation core or can include multiple operation cores.

[0090] The memory 802 is configured to store execution instructions of the processor 801. The memory 802 can be implemented by any type of volatile or nonvolatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage devices, flash memory, magnetic disks or optical disks.

[0091] When the execution instructions in the memory 802 are executed by the processor 801, the computer device 800 is enabled to perform part or all of the steps in the embodiment shown in FIG. 1.

[0092] In specific implementations, the present disclosure further provides a computer storage medium, which can store a program. When the program is executed, it can include part or all of the steps in each embodiment of the method for playing a signal provided by the present disclosure. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0093] In specific implementations, the present disclosure further provides a computer program product, which contains executable instructions. When the executable instructions are executed on a computer, the computer is enabled to perform part or all of the steps in each embodiment of the method for playing a signal provided by the present disclosure.

[0094] Those skilled in the art can clearly understand that the technologies in the embodiments of the present disclosure can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present disclosure, essentially or in other words, the parts that make contributions to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiments of the present disclosure.

[0095] The same or similar parts among various embodiments in the present disclosure can be referred to each other. In particular, for the device embodiments and the terminal embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

Claims

1. A method of playing a signal, characterized by, The method comprises: detecting the obtained camera image to generate a detection result; generating a playing signal according to the detection result and an obtained audio input signal; playing according to the playing signal.

2. The method of claim 1, wherein, Before the step of generating a playing signal according to the detection result and an obtained audio input signal, the method further comprises: obtaining a device opening degree parameter; the adjustment parameter further comprises the device opening degree parameter, and the playing signal comprises a first playing signal; the step of generating a playing signal according to the detection result and an obtained audio input signal comprises: determining a first equalizer parameter according to the device opening degree parameter and the detection result; adjusting the audio input signal according to the first equalizer parameter to generate the first playing signal.

3. The method of claim 1, wherein, The playing signal comprises a second playing signal; the step of generating a playing signal according to the detection result and an obtained audio input signal comprises: determining a second equalizer parameter according to the detection result; adjusting the audio input signal according to the second equalizer parameter to generate the second playing signal.

4. The method of claim 1, wherein, The step of detecting the obtained camera image to generate a detection result comprises: detecting the camera image by using an identification algorithm to generate a detection result.

5. The method of claim 4, wherein, The detection result comprises a relative position parameter.

6. The method of claim 4, wherein, The identification algorithm comprises a face recognition algorithm.

7. A signal playing apparatus characterized by comprising: The method comprises: a first generating module configured to detect an obtained camera image to generate a detection result; a second generating module configured to generate a playing signal according to an adjustment parameter and an obtained audio input signal, wherein the adjustment parameter comprises the detection result; a playing module configured to play according to the playing signal.

8. A computer device, comprising: The computer program product comprises executable instructions, which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium comprises a stored program, wherein the program, when executed, controls the device in which the computer readable storage medium is located to perform the method of any one of claims 1 to 6.

10. A computer program product, characterised in that, The computer program product comprises executable instructions, which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 6.

Images