Audio playing method and laser projection device

Abstract

The present application discloses an audio playing method and a laser projection device, belonging to the technical field of laser projection. The method includes: obtaining an audio signal to be played, where the audio signal includes an audio signal in a first frequency band and an audio signal in a second frequency band, and the first frequency band is higher than the second frequency band; detecting whether the camera is in a shooting state; and when the camera is in the shooting state, playing the audio signal in the first frequency band through the projection screen and not playing the audio signal in the second frequency band. When the camera is in the shooting state, that is, when the user is using the social function, various methods are used to solve the problem of the jitter of the projection screen sound causing the jitter and blurring of the picture captured by the camera, and the effective information during the video call is retained to ensure the quality of the video call, so that the laser projection device simultaneously has powerful functions such as laser large screen eye protection, sound and picture synchronization on the screen, and real-time social sharing.

Description

Technical Field

[0001] This application relates to the technical field of laser projection, and particularly relates to an audio playback method and a laser projection device. Background Art

[0002] With the continuous progress of technology, laser projection devices with screen sound - generating functions are increasingly entering people's lives. To make people's lives more convenient, these laser projection devices can also include a camera, through which social functions can be carried out.

[0003] In the related art, taking a laser TV with screen sound - generating as an example, since the placement position of the projection host included in the laser TV is relatively low, the camera for social functions is usually preferentially placed on the projection screen. However, when using the social function on a laser TV with screen sound - generating, since the screen sound - generating causes the projection screen to vibrate, the picture captured by the camera will jitter. Summary of the Invention

[0004] Embodiments of this application provide an audio playback method and a laser projection device, which can solve the problem that the camera vibrates caused by playing low - frequency band audio signals in the related art. The technical solutions are as follows:

[0005] On the one hand, an audio playback method is provided. The laser projection device includes a projection host and a projection screen. The projection screen has a camera, and the projection screen is a sound - generating screen. The method includes:

[0006] Obtain an audio signal to be played, where the audio signal includes an audio signal in a first frequency band and an audio signal in a second frequency band, and the first frequency band is higher than the second frequency band;

[0007] Detect whether the camera is in a shooting state;

[0008] When the camera is in a shooting state, play the audio signal in the first frequency band through the projection screen and do not play the audio signal in the second frequency band.

[0009] On the other hand, a laser projection device is provided. The laser projection device includes a projection host and a projection screen. The projection screen has a camera, and the projection screen is a sound - generating screen. The projection host includes a processor, and the processor is used for:

[0010] Obtain an audio signal to be played, where the audio signal includes an audio signal in a first frequency band and an audio signal in a second frequency band, and the first frequency band is higher than the second frequency band;

[0011] Detect whether the camera is in a shooting state;

[0012] When the camera is in the shooting state, the audio signal of the first frequency band is played through the projection screen while the audio signal of the second frequency band is not played.

[0013] On the other hand, an audio playback device is provided, and the device includes:

[0014] An acquisition module for acquiring an audio signal to be played, where the audio signal includes an audio signal of a first frequency band and an audio signal of a second frequency band, and the first frequency band is higher than the second frequency band;

[0015] A detection module for detecting whether the camera is in the shooting state;

[0016] A playback module for, when the camera is in the shooting state, playing the audio signal of the first frequency band through the projection screen while not playing the audio signal of the second frequency band.

[0017] On the other hand, a computer-readable storage medium is provided, and a computer program is stored in the storage medium. When the computer program is executed by a processor, the steps of the above-mentioned audio playback method are implemented.

[0018] On the other hand, a computer program product including instructions is provided. When the instructions run on a computer, the computer is caused to execute the steps of the above-mentioned audio playback method.

[0019] The technical solution provided by the embodiments of the present application can at least bring the following beneficial effects:

[0020] When the camera is in the shooting state, that is, when the user is using the social function, since the first frequency band is higher than the second frequency band, the audio signal of the first frequency band is played through the projection screen while the audio signal of the second frequency band is not played. In this way, the audio signal of the second frequency band will not cause the projection screen to vibrate, nor will it cause the captured image of the camera to shake and blur, so that the laser projection device can simultaneously have functions such as screen sound and social sharing. Description of the Drawings

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0022] Figure 1 It is a schematic diagram of a laser projection device provided by an embodiment of the present application;

[0023] Figure 2It is a flowchart of an audio playback method provided by an embodiment of the present application;

[0024] Figure 3 It is a schematic diagram of the frequency range of a human voice provided by an embodiment of the present application;

[0025] Figure 4 It is a flowchart of an audio playback method provided by an embodiment of the present application;

[0026] Figure 5 It is a schematic structural diagram of an audio playback device provided by an embodiment of the present application;

[0027] Figure 6 It is a structural block diagram of a laser projection device provided by an embodiment of the present application. Detailed implementation manners

[0028] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0029] Before explaining the audio playback method provided by the embodiment of the present application in detail, the laser projection device involved in the embodiment of the present application will be introduced first.

[0030] Please refer to Figure 1 , Figure 1 It is a schematic diagram of a laser projection device shown according to an exemplary embodiment. The laser projection device includes a projection host 101 and a projection screen 102, and the projection screen 102 has a camera. The projection host 101 can be communicatively connected to the projection screen 102. This communication connection can be a wired or wireless connection, and the embodiments of the present application do not limit this.

[0031] Among them, the projection host 101 is usually installed on the desktop in a desktop-mounted manner or installed on the ceiling in a suspended manner, and the projection screen 102 is usually installed on the wall. When displaying a picture, the projection host 101 is used to emit laser light to the projection screen 102 based on the picture to be displayed, and the projection screen 102 is used to display the picture to be displayed. When playing an audio signal, the projection host 101 is used to send the audio signal to be played to the projection screen 102, and the projection screen 102 plays the audio signal based on the built-in sound generating unit to implement the screen sound function.

[0032] When the social function of the laser projection device is enabled, the camera can be turned on, and the captured image can be sent to the projection host 101 after being captured by the camera. The projection host 101 sends the received image through the network. However, during the process of playing the audio signal on the projection screen 102, the audio signal in the low-frequency band will cause the projection screen 102 to vibrate significantly when emitting sound, and cause the camera on the projection screen 102 to shake, thereby causing the image captured by the camera to shake or become blurred. Therefore, the embodiment of the present application provides an audio playback method, which can solve this problem through this method.

[0033] The above-described social function can be functions such as video chat, webcast, and music communication. The social function can meet the social needs of users without leaving home and provide the most realistic audio-visual effects for users.

[0034] Those skilled in the art should understand that the functions of the above projection host 101 and projection screen 102 are only examples. Other existing or future possible functions that can be applied to the embodiments of the present application should also be included within the protection scope of the embodiments of the present application and are hereby incorporated by reference.

[0035] It should be noted that the laser projection device described in the embodiments of the present application is to more clearly illustrate the technical solutions of the embodiments of the present application, and does not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art know that with the evolution of technology, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems.

[0036] Next, a detailed explanation of the audio playback method provided by the embodiments of the present application will be given.

[0037] Figure 2 It is a flowchart of an audio playback method provided by the embodiments of the present application. This method is applied to a laser projection device, which includes a projection host and a projection screen. The projection screen has a camera, and the projection screen is a sound-emitting screen. Please refer to Figure 2 , and the method includes the following steps.

[0038] Step 201: Obtain the audio signal to be played, where the audio signal includes the audio signal in the first frequency band and the audio signal in the second frequency band, and the first frequency band is higher than the second frequency band.

[0039] The audio signal in the first frequency band refers to the audio signal whose frequency exceeds the frequency threshold, and the audio signal in the second frequency band refers to the audio signal whose frequency is lower than the frequency threshold. Generally speaking, the audio signal in the first frequency band refers to the medium and high-frequency band audio signal, and the audio signal in the second frequency band refers to the low-frequency band audio signal.

[0040] In the embodiments of the present application, "exceed" can be understood as greater than, or greater than or equal to. When "exceed" is understood as greater than, "below" can be understood as less than or equal to. When "exceed" is understood as greater than or equal to, "below" can be understood as less than. The subsequent "exceed" and "below" can refer to this explanation.

[0041] Among them, the frequency threshold is set in advance, and the low-frequency band and the medium-high frequency band can be divided through this frequency threshold. Moreover, when the size of the projection screen is different, the vibration generated by the screen sound function on the projection screen may be different, and thus the jitter generated on the camera may be different. Therefore, in the actual application process, the frequency threshold can also be adjusted according to the size of the projection screen. For example, the frequency threshold can be set to 300 Hz (Hertz).

[0042] The audio signal to be played can be the conversation sound between people, the sound emitted by musical instruments when communicating music, the background sound during a video call, and so on.

[0043] Step 202: Detect whether the camera is in the shooting state.

[0044] The projection host of the laser projection device communicates with the camera, and the projection host can know whether the camera is in the shooting state.

[0045] For example, in a laser TV with screen sound function having a social function, the projection host of the laser TV communicates with the camera, and the projection host can know whether the camera is in the shooting state.

[0046] Step 203: When the camera is in the shooting state, play the audio signal of the first frequency band through the projection screen and do not play the audio signal of the second frequency band.

[0047] That is, when the camera is in the shooting state, switch the current audio playback mode of the laser projection device to the social sound mode. In the social sound mode, play the audio signal of the first frequency band through the projection screen and do not play the audio signal of the second frequency band.

[0048] In some embodiments, when the camera is in the shooting state, the audio signal of the second frequency band can be directly deleted, and the audio signal of the first frequency band is played through the projection screen.

[0049] When using the social function through the camera, the main activity is conversation. Therefore, the voices of people talking to each other are the main sounds generated during the social process. Usually, the frequency of human voices is in the first frequency band, and deleting the audio signals in the second frequency band will not cause the loss of the audio signals of the conversation between people. Therefore, when the camera is in the shooting state, the audio signals in the second frequency band can be directly deleted, and the audio signals in the first frequency band can be played through the projection screen. For example, as Figure 3 shown, the audio signals in the first frequency band refer to the audio signals with frequencies between 300 Hz and 20 K (Kilo, thousand) Hz, and the audio signals in the second frequency band refer to the audio signals with frequencies between 30 Hz and 300 Hz. The frequency range of human voices is generally between 300 Hz and 5 KHz, that is, the frequency of human voices is in the first frequency band. Therefore, deleting the audio signals in the second frequency band will not cause the loss of the audio signals of the conversation between people.

[0050] The laser projection device is equipped with a high-pass filter and a low-pass filter. When the camera is in the shooting state, the audio signals in the first frequency band can be filtered out by the high-pass filter and played through the projection screen, and the audio signals in the second frequency band can be filtered out by the low-pass filter, and the audio signals in the second frequency band are deleted. The embodiments of the present application do not limit this.

[0051] In some other embodiments, during the process of using the social function through the camera, music may also be exchanged, such as playing musical instruments. At this time, there may be valid information in the audio signals in the second frequency band, and directly deleting the audio signals in the second frequency band will cause the loss of valid signals. Therefore, when the camera is in the shooting state, it is possible to detect whether there is valid information in the audio signals in the second frequency band. When there is no valid information in the audio signals in the second frequency band, the audio signals in the second frequency band are deleted, and the audio signals in the first frequency band are played through the projection screen. When there is valid information in the audio signals in the second frequency band, the audio signals in the first frequency band are played through the projection screen, and the audio signals in the second frequency band are transferred to other devices for playing. Of course, it is also possible not to make a judgment on the valid information and directly transfer the audio signals in the second frequency band to other devices for playing.

[0052] Among them, there are two ways to detect whether there is valid information in the audio signals in the second frequency band. The following introduces these two implementation methods.

[0053] The first implementation mode is that the audio signal to be played is the audio signal generated within the video picture captured by the camera. In this case, the video picture captured by the camera can be recognized to determine whether there is a target action in the video picture. When there is no target action in the video picture, it is determined that there is no valid signal in the audio signal of the second frequency band. When there is a target action in the video picture, it is determined that there is a valid signal in the audio signal of the second frequency band.

[0054] Among them, the target action refers to the action stored locally or in the cloud space, which can be an instrument playing action or other actions that can produce sounds. The embodiments of the present application do not limit this.

[0055] Suppose the target action is an instrument playing action. Then, by recognizing multiple video frames captured by the camera, the hand action and the category of the instrument in the video picture are determined. Based on the category of the instrument in the video picture, the corresponding playing action of the instrument is determined from the stored correspondence between the instrument category and the playing action, and then it is determined whether the hand action in the video picture is consistent with the recognized playing action of the instrument. When the hand action in the video picture is consistent with the recognized playing action of the instrument, it is determined that there is an instrument playing action in the video picture. When the hand action in the video picture is inconsistent with the recognized playing action of the instrument, it is determined that there is no instrument playing action in the video picture.

[0056] Since the shapes of different instruments are different, and the hand actions are different when playing different instruments. Therefore, the hand action and the category of the instrument in the video picture can be recognized to determine whether there is an instrument playing action in the video picture, and then to judge whether there is a valid signal in the audio signal of the second frequency band.

[0057] Among them, there are various ways to recognize the hand action and the category of the instrument in the video picture. As an example, it can be recognized through a neural network model. That is, the video picture is input into the neural network model to obtain the hand action and the category of the instrument output by the neural network model.

[0058] Before using the neural network model for recognition, the neural network model needs to be trained. That is, multiple sample video segments are obtained, as well as the hand action corresponding to each video segment and the category of the instrument in the video segment. The video segment is used as the input of the neural network model, and the category of the instrument and the hand action are used as the output of the neural network model to train the neural network model.

[0059] The second implementation method is that the audio signal to be played is the audio signal generated by playing an instrument. In this case, the frequency information of the audio signal in the second frequency band can be extracted. When there is no instrument frequency information in the stored instrument frequency information that matches the frequency information of the audio signal in the second frequency band, it is determined that there is no valid signal in the audio signal in the second frequency band. When there is instrument frequency information in the stored instrument frequency information that matches the frequency information of the audio signal in the second frequency band, it is determined that there is a valid signal in the audio signal in the second frequency band.

[0060] Since the frequency of the sound emitted by each instrument during playing has its relatively fixed frequency range, the frequency information of multiple instruments whose sounding frequencies are in the second frequency band can be stored in advance. In this way, the frequency information of the audio signal in the second frequency band can be extracted and compared with the stored instrument frequency information to determine whether there is instrument frequency information in the stored instrument frequency information that matches the frequency information of the audio signal in the second frequency band, and further determine whether there is a valid signal in the audio signal in the second frequency band.

[0061] Of course, the above two implementation methods can also be combined to improve the accuracy of identifying valid signals. That is, the video frame captured by the camera is identified to determine whether there is a target action in the video frame, the frequency information of the audio signal in the second frequency band is extracted, and it is judged whether there is instrument frequency information in the stored instrument frequency information that matches the frequency information of the audio signal in the second frequency band. When there is a target action in the video frame and there is instrument frequency information in the stored instrument frequency information that matches the frequency information of the audio signal in the second frequency band, it is determined that there is a valid signal in the audio signal in the second frequency band. When there is no target action in the video frame or there is no instrument frequency information in the stored instrument frequency information that matches the frequency information of the audio signal in the second frequency band, it is determined that there is no valid signal in the audio signal in the second frequency band.

[0062] When transferring the audio signal in the second frequency band to another device for playing, there are two ways to play the audio signal in the first frequency band through the projection screen without playing the audio signal in the second frequency band. Next, these two implementation methods will be introduced.

[0063] The first implementation method is that when there is a speaker in the projection host, the audio signal in the first frequency band is played through the projection screen, and the audio signal in the second frequency band is played through the speaker.

[0064] That is to say, when the camera is in the shooting state, the audio signal of the first frequency band can be filtered out from the audio signal to be played through a high-pass filter, and the audio signal of the second frequency band can be filtered out from the audio signal to be played through a low-pass filter. Then, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the speaker. In this way, the audio signal of the second frequency band will not cause vibration to the projection screen, and thus will not cause jitter to the shooting picture of the camera.

[0065] In the second implementation manner, when a subwoofer is connected to the projection host, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer.

[0066] That is to say, when the camera is in the shooting state, the audio signal of the first frequency band can be filtered out from the audio signal to be played through a high-pass filter, and the audio signal of the second frequency band can be filtered out from the audio signal to be played through a low-pass filter. Then, the audio signal of the first frequency band is played through the projection screen, and the audio signal of the second frequency band is played through the subwoofer. In this way, the audio signal of the second frequency band will not cause vibration to the projection screen, and thus will not cause jitter to the shooting picture of the camera.

[0067] In the above description, when playing the audio signal of the first frequency band through the projection screen, the audio signal of the first frequency band can be sent to the oscillator built in the projection screen, and the oscillator generates vibration to drive the projection screen to vibrate and sound. The implementation process of screen sound in this embodiment of the application is not limited.

[0068] When the camera is in the shooting state, the method of playing the audio signal of the first frequency band through the projection screen without playing the audio signal of the second frequency band is an example. In the actual application process, it can also be implemented in other ways.

[0069] As an example, when there is a speaker in the projection host, the audio signal of the first frequency band and the audio signal of the second frequency band are played through the speaker.

[0070] That is to say, the audio signal of the full frequency band is played through the speaker in the projection host, and there is no need to play the audio signal through the projection screen. By this method, the problem of jitter in the shooting picture of the camera caused by the projection screen sounding can be effectively solved, and the audio signal of the second frequency band can be completely retained and played.

[0071] As another example, when there is a speaker in the projection host and the projection host is connected to a subwoofer, the audio signal of the first frequency band and the audio signal of the second frequency band are played through the speaker, and the audio signal of the second frequency band is played through the subwoofer.

[0072] That is, the full-band audio signal is played through the speakers in the projection host, and the audio signal of the second band is played through the subwoofer, without playing the audio signal through the projection screen. By this method, not only can the problem of camera jitter caused by the projection screen generating sound be effectively solved, but also the audio signal of the second band can be fully retained and played. Moreover, by playing the audio signal of the second band through the subwoofer, the stress and bass can be more perfectly presented, improving the audio playback effect.

[0073] The above description is about the case where the first-band audio signal is played through the projection screen and the second-band audio signal is not played when the camera is in the shooting state. When the camera is not in the shooting state, the first-band audio signal and the second-band audio signal can be directly played through the projection screen. That is, the full-band audio signal is played through the projection screen.

[0074] Next, taking Figure 4 as an example, an audio playback method provided by an embodiment of the present application will be introduced. As Figure 4 shown, after the laser projection device is powered on, it detects whether the camera is in the shooting state. When the camera is not in the shooting state, the first-band and second-band audio signals are sent to the projection screen, that is, the full-band audio signal is sent to the projection screen, and the projection screen plays the audio signal. When the camera is in the shooting state, the projection host divides the audio signal to be played to obtain the first-band audio signal and the second-band audio signal, sends the first-band audio signal to the projection screen, and determines whether the laser projection device is connected to a subwoofer. When connected to the subwoofer, the first-band audio signal is played through the projection screen, and the second-band audio signal is played through the subwoofer.

[0075] In some embodiments, when the camera is in the shooting state, that is, during the use of the social function, the image captured by the camera can also be recognized to determine the user's action, and based on the user's action, the sound of the projection screen is controlled. For example, by recognizing the image captured by the camera, it is determined that the user's action is a tilting-ear action, and when it is determined that the ear of the user tilting the ear is the right ear, the volume of the right channel of the projection screen is increased, and the volume of the left channel of the projection screen remains unchanged to achieve a sound effect of stronger near and weaker far.

[0076] In the embodiments of the present application, when the camera is in the shooting state, that is, when the user is using the social function, multiple methods are used to solve the problem of jitter caused by the sound of the projection screen, which leads to jitter and blurring of the picture captured by the camera. Moreover, in some implementation manners, by analyzing the generated audio information and recognizing the picture captured by the camera, it is determined whether there is valid information in the generated second-band audio information, and then the second-band audio signal is selected to be deleted or transferred to other devices. This can not only effectively solve the problem of jitter caused by the sound of the projection screen, which leads to jitter and blurring of the picture captured by the camera, but also retain the valid information during the video call and ensure the quality of the video call. And according to the method provided in the embodiments of the present application, the laser projection device can simultaneously have powerful functions such as laser large screen eye protection, sound and picture synchronization of the screen, and real-time social sharing.

[0077] Figure 5 FIG. is a schematic structural diagram of an audio playback device provided by an embodiment of the present application. The audio playback device can be implemented by software, hardware, or a combination of both to be part or all of the above-mentioned laser projection device. Please refer to Figure 5 The device includes: an acquisition module 501, a detection module 502, and a playback module 503.

[0078] The acquisition module 501 is configured to acquire an audio signal to be played. The audio signal includes an audio signal in a first band and an audio signal in a second band, and the first band is higher than the second band. For the detailed implementation process, refer to the corresponding content in the above embodiments, which will not be elaborated here.

[0079] The detection module 502 is configured to detect whether the camera is in the shooting state. For the detailed implementation process, refer to the corresponding content in the above embodiments, which will not be elaborated here.

[0080] The playback module 503 is configured to play the audio signal in the first band through the projection screen without playing the audio signal in the second band when the camera is in the shooting state. For the detailed implementation process, refer to the corresponding content in the above embodiments, which will not be elaborated here.

[0081] Optionally, the playback module 503 is specifically configured to:

[0082] Detect whether there is a valid signal in the audio signal in the second band;

[0083] Delete the audio signal in the second band and play the audio signal in the first band through the projection screen when there is no valid signal in the audio signal in the second band.

[0084] Optionally, the playback module 503 is further specifically configured to:

[0085] Identify the video images captured by the camera to determine whether there is a target action in the video images;

[0086] When there is no target action in the video images, determine that there is no valid signal in the audio signal of the second frequency band.

[0087] Optionally, the playback module 503 is further specifically configured to:

[0088] Extract the frequency information of the audio signal of the second frequency band;

[0089] When there is no musical instrument frequency information in the stored musical instrument frequency information that matches the frequency information of the audio signal of the second frequency band, determine that there is no valid signal in the audio signal of the second frequency band.

[0090] Optionally, the playback module 503 is specifically configured to:

[0091] When there is a speaker in the projection host, play the audio signal of the first frequency band through the projection screen and play the audio signal of the second frequency band through the speaker; or

[0092] When a subwoofer is connected to the projection host, play the audio signal of the first frequency band through the projection screen and play the audio signal of the second frequency band through the subwoofer.

[0093] In the embodiments of the present application, when the camera is in the shooting state, that is, when the user is using the social function, multiple methods are used to solve the problem of the jitter of the projection screen sound causing the jitter and blurring of the images captured by the camera. Moreover, in some implementation manners, by analyzing the generated audio information and identifying the images captured by the camera, it is determined whether there is valid information in the generated audio information of the second frequency band, and then the audio signal of the second frequency band is selected to be deleted or transferred to other devices. This can not only effectively solve the problem of the jitter of the projection screen sound causing the jitter and blurring of the images captured by the camera, but also retain the valid information during the video call and ensure the quality of the video call. And according to the method provided in the embodiments of the present application, the laser projection device can simultaneously have powerful functions such as laser large screen eye protection, screen sound and picture homology, and social real-time sharing.

[0094] It should be noted that: when the audio playback device provided in the above embodiments performs audio playback, only the above-mentioned division of each functional module is used for illustration. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the audio playback device provided in the above embodiments and the embodiments of the audio playback method belong to the same concept, and the specific implementation process is detailed in the method embodiments and will not be repeated here.

[0095] Figure 6 It is a structural block diagram of a laser projection device 600 provided by an embodiment of the present application. The laser projection device 600 includes a projection host 601 and a projection screen 602. The projection host 601 may include a processor 6011 and a memory 6012. Optionally, the projection host 601 may further include a remote pickup microphone, which can be used for sound collection of voice assistants and chat functions. The projection screen 602 is used to display information such as graphics, texts, icons, and videos. The projection screen 602 has a camera 6021, and moreover, the projection screen 602 further includes a sound generating unit 6022.

[0096] The processor 6011 includes one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 6011 can be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 6011 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake state, also known as the CPU (Central Processing Unit); the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 6011 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 6011 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.

[0097] The memory 6012 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 6012 may further include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 6012 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 6012 to implement the audio playback method provided by the method embodiment in the present application.

[0098] The camera 6021 is used to collect images or videos. Optionally, the camera 6021 is disposed in front of the projection screen 602. In some embodiments, the camera includes any one of a main camera, a depth camera, a wide-angle camera, and a telephoto camera to implement functions such as background blurring by fusing the main camera and the depth camera, panoramic shooting by fusing the main camera and the wide-angle camera, and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 6021 may further include a flash. The flash may be a single-color temperature flash or a two-color temperature flash. The two-color temperature flash refers to a combination of a warm light flash and a cold light flash and can be used for light compensation under different color temperatures.

[0099] Optionally, the laser projection host 601 may further be built with other devices such as a speaker, or the laser projection host 601 may be externally connected to other peripherals, such as a subwoofer, etc.

[0100] Those skilled in the art can understand that Figure 6 the structure shown in does not constitute a limitation on the laser projection device 600, and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0101] In some embodiments, a computer-readable storage medium is further provided. The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the audio playback method in the above embodiments are implemented. For example, the computer-readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0102] It should be noted that the computer-readable storage medium mentioned in the embodiments of the present application may be a non-volatile storage medium, in other words, it may be a non-transitory storage medium.

[0103] It should be understood that all or part of the steps of implementing the above embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions may be stored in the above computer-readable storage medium.

[0104] That is, in some embodiments, a computer program product including instructions is further provided. When it runs on a computer, it causes the computer to execute the steps of the audio playback method described above.

[0105] It should be understood that the "at least one" mentioned herein refers to one or more, and the "multiple" refers to two or more. In the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may mean A or B. The "and / or" herein is merely a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B may indicate: A exists alone, A and B exist simultaneously, and B exists alone. In addition, for the convenience of clearly describing the technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items with basically the same functions and roles. Those skilled in the art can understand that the terms such as "first" and "second" do not limit the quantity and execution order, and the terms such as "first" and "second" do not necessarily limit to be different.

[0106] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of the present application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the video images captured by the camera and the audio signals to be played obtained in the embodiments of the present application are all obtained under sufficient authorization.

[0107] The above are the embodiments provided by the present application, which are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An audio playback method, characterized in that, Applied to a laser projection device, the laser projection device includes a projection host and a projection screen, the projection screen has a camera, and the projection screen is a sound - emitting screen. The method includes: Obtain an audio signal to be played, where the audio signal includes an audio signal in a first frequency band and an audio signal in a second frequency band, and the first frequency band is higher than the second frequency band; Detect whether the camera is in a shooting state; When the camera is in a shooting state, if the audio signal to be played is an audio signal generated within the video frame captured by the camera, identify the video frame captured by the camera to determine whether there is a target action in the video frame; when there is no target action in the video frame, determine that there is no valid signal in the audio signal of the second frequency band; If the audio signal to be played is an audio signal generated by playing a musical instrument, extract the frequency information of the audio signal in the second frequency band; when there is no musical instrument frequency information in the stored musical instrument frequency information that matches the frequency information of the audio signal in the second frequency band, determine that there is no valid signal in the audio signal of the second frequency band; When there is no valid signal in the audio signal of the second frequency band, delete the audio signal of the second frequency band and play the audio signal of the first frequency band through the projection screen.

2. A laser projection device, characterized in that, The laser projection device includes a projection host and a projection screen, the projection screen has a camera, and the projection screen is a sound - emitting screen. The projection host includes a processor, and the processor is configured to: Obtain an audio signal to be played, where the audio signal includes an audio signal in a first frequency band and an audio signal in a second frequency band, and the first frequency band is higher than the second frequency band; Detect whether the camera is in a shooting state; When the camera is in a shooting state, if the audio signal to be played is an audio signal generated within the video frame captured by the camera, identify the video frame captured by the camera to determine whether there is a target action in the video frame; When there is no target action in the video frame, determine that there is no valid signal in the audio signal of the second frequency band; If the audio signal to be played is an audio signal generated by playing a musical instrument, extract the frequency information of the audio signal in the second frequency band; when there is no musical instrument frequency information in the stored musical instrument frequency information that matches the frequency information of the audio signal in the second frequency band, determine that there is no valid signal in the audio signal of the second frequency band; When there is no valid signal in the audio signal of the second frequency band, delete the audio signal of the second frequency band and play the audio signal of the first frequency band through the projection screen.

Images