Playing method, device and equipment

Abstract

The invention discloses a playing method, device and equipment. The method comprises the following steps: playing a first video stream; the first video stream comprises a first target area for displaying and outputting the second video stream; if the first audio stream corresponding to the first video stream is not matched with the second video stream, generating a second audio stream for the second video stream; and playing the second audio stream.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a playback method, device and equipment. Background Art

[0002] In actual applications, there are many first video streams obtained by shooting a second video stream or audio streams corresponding to the first video stream that contain the second video stream, but many audio streams corresponding to the first video stream do not contain valid audio streams corresponding to the second video stream, so that the audio stream corresponding to the first video stream cannot effectively contain the audio stream corresponding to the second video stream, which makes it difficult for users to watch and understand the first video stream. Summary of the invention

[0003] The embodiments of the present application are intended to provide a playback method, apparatus and device.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides a playback method, the method comprising:

[0006] Playing a first video stream; the first video stream includes a first target area for displaying and outputting a second video stream;

[0007] If the first audio stream corresponding to the first video stream does not match the second video stream, generating a second audio stream for the second video stream;

[0008] Play the second audio stream.

[0009] In the above playing method, the method also includes: playing the first audio stream.

[0010] In the above-mentioned playing method, playing the first video stream includes: displaying the video stream corresponding to the first target area in the first video stream.

[0011] In the above-mentioned playback method, the first video stream includes a target electronic device including a display, and the first target area is an area occupied by the target electronic device for displaying and outputting the second video stream.

[0012] In the above playback method, the method further includes: identifying the first content of the second video stream; identifying the second content of the first audio stream; and if the second content includes content that matches the first content, determining that the first audio stream matches the second video stream.

[0013] In the above-mentioned playback method, the method also includes: obtaining a target video stream; the target video stream includes a target electronic device including a display; if the video stream of the second target area meets the target condition, determining that the target video stream is the first video stream; wherein the second target area is the area occupied by the display of the target electronic device in the target video stream; the target condition characterizes that the display is playing the video stream.

[0014] In the above playback method, generating a second audio stream for the second video stream includes: generating a second audio stream for the second video stream based on text information in the second video stream; and / or generating a second audio stream for the second video stream based on content represented by the second video stream.

[0015] In the above-mentioned playing method, playing the first video stream includes: acquiring the first video stream captured by the image acquisition element, and displaying the first video stream on a display.

[0016] In a second aspect, an embodiment of the present application provides a playback device, including:

[0017] A first playback module is used to play a first video stream; the first video stream includes a first target area for displaying and outputting a second video stream;

[0018] A generating module, configured to generate a second audio stream for the second video stream if the first audio stream corresponding to the first video stream does not match the second video stream;

[0019] The second playing module is used to play the second audio stream.

[0020] In a third aspect, an embodiment of the present application provides a playback device, including: a display, for playing a first video stream; the first video stream contains a first target area for displaying and outputting a second video stream; a processor, the processor being used to execute if a first audio stream corresponding to the first video stream does not match the second video stream, generating a second audio stream for the second video stream; and a speaker, for playing the second audio stream.

[0021] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores one or more computer programs. The one or more computer programs can be executed by one or more processors to implement the above-mentioned playback method.

[0022] The embodiments of the present application provide a playback method, apparatus and device, the method comprising: playing a first video stream; the first video stream includes a first target area for displaying and outputting a second video stream; if a first audio stream corresponding to the first video stream does not match the second video stream, generating a second audio stream for the second video stream; and playing the second audio stream. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A flowchart of a playback method provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of an exemplary high-speed rail scenario provided in an embodiment of the present application;

[0025] Figure 3 A schematic diagram of an exemplary aircraft scene provided for an embodiment of the present application;

[0026] Figure 4 A schematic diagram of an exemplary structure of mobile handheld device playback provided in an embodiment of the present application;

[0027] Figure 5 A flowchart of an exemplary matching method provided in an embodiment of the present application;

[0028] Figure 6 A schematic diagram of an exemplary process of determining a first video stream provided in an embodiment of the present application;

[0029] Figure 7 A schematic diagram of an exemplary process of generating a second audio stream provided in an embodiment of the present application;

[0030] Figure 8 A flowchart of an exemplary playback method provided in an embodiment of the present application;

[0031] Fig. 9 A schematic diagram of the structure of a playback device provided in an embodiment of the present application;

[0032] Fig.10 A schematic diagram of the structure of a playback device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The technical solution in the present application will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present application. It is to be understood that the specific embodiments described herein are only used to explain the related application, rather than to limit the application. It should also be noted that, for ease of description, only the parts related to the related application are shown in the accompanying drawings.

[0034] In actual applications, there are many first video streams obtained by shooting a second video stream or audio streams corresponding to the first video stream containing the second video stream. Due to the loss of the audio stream corresponding to the second video stream when generating the first video stream, the audio stream corresponding to the first video does not effectively contain the audio stream corresponding to the second video. For example, for video displays installed in public places, considering the needs of everyone, the audio stream is generally not played at the same time during the video stream playback or the audio stream is played at a low volume. When shooting the second video stream played by the video display installed in a public place, the audio stream corresponding to the first video stream cannot effectively contain the audio stream corresponding to the second video stream, which makes it difficult for users to watch and understand the first video stream. For example, during screen recording, the second video stream will be played in part of the screen. If the audio stream of the second video stream is not recorded during the recording process, the audio stream corresponding to the recorded first video stream cannot effectively contain the audio stream corresponding to the second video stream, which also makes it difficult for users to watch and understand the first video stream.

[0035] The present application embodiment provides a playback method, which is implemented by a playback device, such as Figure 1 As shown, the steps S101 to S103 are included:

[0036] Step S101, playing a first video stream; the first video stream includes a first target area for displaying and outputting a second video stream.

[0037] In the embodiments of the present application, the playback device is an electronic device with a playback function, which may be a mobile phone, an augmented reality (AR) device, a virtual reality (VR) device, other head-mounted display devices with spatial computing, a tablet computer, a laptop computer, a PDA, a personal digital assistant (PDA), a desktop computer, etc. The specific playback device is not limited here.

[0038] In an embodiment of the present application, the first video stream includes a first target area for displaying and outputting a second video stream. Exemplarily, the first video stream may be a video stream generated by a playback device in the process of acquiring the second video stream. For example, a public display is provided in a public place, and a video stream (second video stream) is being played on the public display. The playback device may obtain the first video stream by capturing the first target area for displaying and outputting the second video stream, i.e., the display area of ​​the public display, through an image acquisition element.

[0039] In an embodiment of the present application, the first video stream may be generated in real time as the second video stream is played, or the first video stream may be obtained by shooting the second video stream, or may be a video stream obtained by recording the second video stream.

[0040] For example, in a scenario where the first video stream is generated in real time as the second video stream is played, a passenger takes a public transportation vehicle, the second video stream may be a video stream displayed on a public display on the transportation vehicle, and the first video stream may be obtained by the passenger taking the transportation vehicle by shooting the video stream displayed on the public display in real time using a playback device carried by the passenger. The public transportation vehicle may be a bus, a high-speed train, an airplane, etc.

[0041] For example, Figure 2 As shown, a scene of passengers riding on a high-speed train is displayed. The second video stream is a video stream 22 displayed on a public display 21 on the high-speed train. The first video stream is a video stream 24 obtained by a passenger 23 riding on the high-speed train shooting the video stream 22 displayed on the public display 21 through a playback device carried by the passenger 23, wherein the first target area is the display area of ​​the public display 21.

[0042] For example, Figure 3 As shown, a scene of passengers boarding an airplane is displayed, the second video stream is a video stream 32 displayed on a public display 31 on the airplane, and the first video stream is a video stream 34 obtained by a passenger 33 on the airplane shooting the video stream 32 displayed on the public display 31 using a playback device carried by the passenger 33 on the airplane, wherein the first target area is the display area of ​​the public display 31.

[0043] Exemplarily, in a scenario where the second video stream records a video stream, the second video stream may be a video stream added to a slide (PowerPoint, PPT), and the first video stream may be a video stream recording a PPT presentation process.

[0044] In an embodiment of the present application, the playback device may play the acquired first video stream.

[0045] Step S102: If the first audio stream corresponding to the first video stream does not match the second video stream, generate a second audio stream for the second video stream.

[0046] In an embodiment of the present application, the playback device may obtain the first audio stream corresponding to the first video stream. Exemplarily, the playback device may obtain the first audio stream corresponding to the first video stream through a microphone (mic), a pickup, or the like.

[0047] For example, in a scenario where passengers are riding on public transportation, the first audio stream acquired by the playback device may include the voices of passengers riding on the public transportation, the noise generated when the public transportation is running (for example, engine noise), and the like.

[0048] For example, in a scenario of a video stream recorded for a PPT presentation, the first audio stream acquired by the playback device may include the presentation voice of a speaker presenting the PPT, the speaking voice of a listener to whom the PPT is presented, and the like.

[0049] In an embodiment of the present application, the playback device can determine whether the first audio stream corresponding to the first video stream matches the second video stream. If the first audio stream corresponding to the first video stream does not match the second video stream, the playback device can generate a second audio stream for the second video stream.

[0050] For example, in a scenario where passengers are riding on public transportation, the first audio stream acquired by the playback device is the voice of the passengers riding on the public transportation, while the second video stream may be the animal world. In this case, the first audio stream corresponding to the first video stream does not match the second video stream, and a second audio stream can be generated for the animal world video stream.

[0051] For example, in the scenario of video streams recorded for a PPT presentation, the first audio stream obtained by the playback device is the presentation sound of the speaker presenting the PPT, while the second video stream may be playing a product promotional video. In this case, the first audio stream corresponding to the first video stream does not match the second video stream, and a second audio stream can be generated for the video stream of the product promotional video.

[0052] In an embodiment of the present application, the playback device may be provided with a function key for triggering the generation of an audio stream. If the first audio stream corresponding to the first video stream does not match the second video stream, the function key is used to determine whether to generate a second audio stream for the second video stream. The function key may be in the form of a physical button or a user interface (UI) button, and the user may manually activate the function. In this way, the audio stream can be generated according to user needs, with high flexibility.

[0053] In the embodiments of the present application, of course, when the first audio stream corresponding to the first video stream does not match the second video stream, a second audio stream for the second video stream can be directly generated. In this way, the audio stream can be generated in a timely manner in the case of a mismatch without manual operation, which is more intelligent and convenient.

[0054] In an embodiment of the present application, illustratively, the playback device may convert the second audio stream of the second video stream into text (text information) by quickly identifying the subtitle content in the video frame included in the second video stream through the subtitle extraction function in the video-to-text assistant, and then generate an audio stream based on the text (text information). In addition, the text conversion of the subtitle content in the video frame included in the second video stream may also be performed through online websites such as Speechmatics and Rev.

[0055] In an embodiment of the present application, exemplarily, the playback device may cut out the second video stream from the first video stream and input it into the intelligent engine, which outputs the second audio stream corresponding to the second video stream. The intelligent engine may be a network model, such as a generative network model, etc. The network model may be deployed on the playback device or on other devices, such as servers, other playback devices, etc.

[0056] Step S103: play the second audio stream.

[0057] In an embodiment of the present application, the playback device plays the generated second audio stream. Exemplarily, the playback device can play the second audio stream through a voice playback element such as a speaker, a wired headset, or a wireless headset.

[0058] In this way, the present application can effectively reduce the difficulty of watching and understanding silent videos and improve the convenience of video stream playback by generating and playing a matching second audio stream for a second video stream that lacks an audio stream.

[0059] In some embodiments, the playback device may further perform the following steps: playing the first audio stream.

[0060] In an embodiment of the present application, the first audio stream is the scene sound in the second video stream playback scene. The playback device can play the first audio stream corresponding to the first video stream.

[0061] For example, in the scenario of a video stream recorded for a PPT presentation, considering that not only the audio stream of the added video stream needs to be played, but also the presentation sound of the speaker presenting the PPT, the discussion sound of the listeners of the PPT being presented, etc. may need to be played. Therefore, the playback device can play the acquired presentation sound of the speaker presenting the PPT, the discussion sound of the listeners of the PPT being presented, etc. on the basis of playing the second audio stream.

[0062] For example, in the scenario where passengers are riding on public transportation, considering that there may be detailed broadcast information, the playback device can play the detailed broadcast information on the basis of playing the second audio stream. Of course, the playback device can also play the acquired speaking sounds, engine noise, etc. generated by the passengers riding the public transportation.

[0063] In this way, viewers watching the first video stream can also understand the situation in the scene in real time, so as to avoid missing important information in the scene.

[0064] In some embodiments, when the playback device executes the above step S103, it may also execute the following steps: display the video stream corresponding to the first target area in the first video stream.

[0065] In an embodiment of the present application, when playing the first video stream, the playback device can cut out the video stream corresponding to the first target area in the first video stream from the first video stream, that is, display the second video stream. In this way, the scene information included in the first video stream can be not displayed.

[0066] Exemplarily, in a scenario where a video stream is recorded for a PPT presentation, the playback device may play the video stream added to the PPT presentation.

[0067] For example, in a scenario where passengers are riding on public transportation, the playback device can play the video stream displayed on a public display. Figure 2 As shown, the playback device can display the display area (first target area) in the public display 21, and does not display other areas 25 except the display area of ​​the public display 21. Figure 3 As shown, the playback device may display the display area (first target area) of the public display 31 , and not display other areas 35 except the display area of ​​the public display 31 .

[0068] For example, Figure 4 As shown, the mobile handheld device 41 (playing device) can display the second video stream 42 through the display, and the scene information is not displayed at this time. Accordingly, when the playing device 41 generates a corresponding second audio stream for the second video stream 42, the second audio stream is played through the corresponding voice playing element 43 of the mobile handheld device 41. The voice playing element can be a wired headset that is physically connected to the mobile handheld device 41, or a wireless headset that is in communication connection with the mobile handheld device 41, or a speaker installed on the mobile handheld device 41.

[0069] In this way, the viewer can pay more attention to the second video stream, reduce the influence of the surrounding environment, and increase the readability of the second video stream.

[0070] In some embodiments, the first video stream includes a target electronic device including a display, and the first target area is an area occupied by the target electronic device display outputting the second video stream.

[0071] In an embodiment of the present application, the first video stream includes a target electronic device including a display, and the first target area is the display area of ​​the target electronic device.

[0072] Exemplarily, the target electronic device may be a television, a computer, a liquid crystal display, etc., and the first target area is the display screen of the television, the computer, the liquid crystal display, etc.

[0073] In this way, it can be ensured that the display area of ​​the target electronic device is included in the first video stream, the integrity of each frame of the second video stream is guaranteed, and the quality of video stream playback is improved.

[0074] In some embodiments, Figure 5 As shown, the playback device may also perform the following steps S501 to S503:

[0075] Step S501: Identify the first content of the second video stream.

[0076] In an embodiment of the present application, the playback device can identify the first content of the second video stream. Exemplarily, the playback device can perform image recognition on the video frames included in the second video stream, identify the text information corresponding to the second video stream through the subtitles included in the video frames of the second video stream, and identify the image information corresponding to the second video stream through the video frames included in the second video stream. Exemplarily, the image information may include the action of closing a door, the fluctuation of the waves, etc. Exemplarily, Figure 4 As shown, text information 44 (subtitles) and image information 45 (whales swimming in the sea) in the second video stream 42 are displayed.

[0077] Step S502: Identify the second content of the first audio stream.

[0078] In an embodiment of the present application, the playback device may obtain the second content by performing voice processing on the first audio stream.

[0079] Exemplarily, the playback device may identify content information included in the first audio stream, wherein the content may exemplarily be two people having a conversation, the sound of ocean waves, the sound of a door closing, and the like.

[0080] Step S503: If the second content includes content that matches the first content, determine that the first audio stream matches the second video stream.

[0081] In an embodiment of the present application, if the second content includes content that matches the first content, illustratively, the second content includes the sound of waves, and the image information of the first content also includes the fluctuations of waves, then the second content includes content that matches the first content, and the first audio stream is determined to match the second video stream, and the first audio stream is played. However, if there is text information in the first content, and the second content does not contain voice information that matches the text information in the first content, even if the sound of waves and the fluctuations of waves match, it is determined that the first audio stream does not match the second video stream.

[0082] For example, Figure 4 As shown, if the second content includes the sound of a whale swimming in the sea, but there is no voice information corresponding to the text information 44 ("swimming speed of 60 kilometers per hour"), the second content does not include content that matches the first content.

[0083] In an embodiment of the present application, if the second content includes the sound of waves and engine noise or the sound of conversation, and the image information of the first content includes the fluctuation of waves and there are no subtitles, then the second content contains content that matches the first content, and it is determined that the first audio stream matches the second video stream. The playback device can directly play the first audio stream, that is, play the sound of waves and engine noise or the sound of conversation, or can edit an audio stream that matches the first content from the first audio stream for playback, that is, play the sound of waves, and do not play the engine noise or the sound of conversation.

[0084] In an embodiment of the present application, if the second content does not include content matching the first content, it is determined that the first audio stream does not match the second video stream, corresponding to step S102, and the playback device can generate a second audio stream corresponding to the second video stream.

[0085] In this way, the playback device can play the audio stream that matches the second video stream, reduce the content and difficulty of understanding the video stream, and improve the quality of video stream playback.

[0086] In some embodiments, Figure 6 As shown, the playback device may also perform the following steps S601 and S602:

[0087] Step S601, obtaining a target video stream; the target video stream includes a target electronic device including a display.

[0088] In an embodiment of the present application, the display of the target electronic device in the target video stream acquired by the playback device may be in a state such as turned off, playing the video stream, or displaying a static picture. For the target electronic device in the states such as turned off and displaying a static picture, there is no need to match the audio stream, so the playback device needs to further determine whether the target electronic device is playing the video stream.

[0089] Exemplarily, the playback device can determine the state of the display through the image displayed on the display of the target electronic device. For example, if no image is displayed on the display, it means that the display is in an off state. If an image is displayed on the display, the rate of change or degree of change of the image can be judged based on the continuous multiple frames of the image displayed, thereby determining whether the display is playing a video stream. If the image displayed on the display changes at a rate greater than a preset rate of change or a preset degree of change, it means that the display is playing a video stream. If the picture displayed on the display changes at a rate less than or equal to a preset rate of change or a preset degree of change, it means that a still picture is displayed on the display. Among them, the preset rate of change or the preset degree of change can be set based on actual needs and application scenarios, and this application is not limited to this.

[0090] Step S602: If the video stream in the second target area meets the target condition, determine that the target video stream is the first video stream; wherein the second target area is the area occupied by the display of the target electronic device in the target video stream; and the target condition indicates that the display is playing the video stream.

[0091] In an embodiment of the present application, the target condition represents that the display is playing a video stream, and the playback device can determine whether the display of the target electronic device is playing the video stream through a video processing method. If the display of the target electronic device is playing the video stream, the target video stream is determined as the first video stream. If the display of the target electronic device is not playing the video stream, there is no need to play the first video stream.

[0092] In this way, it is possible to identify whether the display of the target electronic device is playing the video stream, thereby avoiding erroneous operation of the playback device when the display of the target electronic device is not playing the video stream.

[0093] In some embodiments, when the playback device performs the "generating a second audio stream for the second video stream" in the above step S102, Figure 7 As shown, the method may further include step S701 and / or step S702:

[0094] Step S701: Generate a second audio stream for the second video stream based on text information in the second video stream.

[0095] In an embodiment of the present application, if there are subtitles in the second video stream, the playback device can identify the subtitles in the video stream through image processing, obtain text information in the second video stream, and then convert the text information into voice information to generate a second audio stream.

[0096] Step S702: Generate a second audio stream for the second video stream based on the content represented by the second video stream.

[0097] In the embodiments of the present application, for example, if the second video stream contains content such as the fluctuation of waves and the action of closing a door, the sound of waves and the sound of closing a door can be added to the second video stream; if the second video stream shows a photographed landscape, matching background music can be added.

[0098] In this way, not only the audio stream conversion of text information is taken into consideration, but also background music is added in a timely manner, making the video stream richer and improving the quality of video stream playback.

[0099] Exemplarily, public transportation (e.g., airplanes, high-speed trains, etc.) may be equipped with public displays to play some videos, but no headphones are provided and no audio stream is played or the audio stream is very low. Although there are subtitles in these videos, users can understand the content by reading. However, if such pantomimes are watched during a long journey, it will generally be boring and tiring. Even if the user carries headphones that come with the electronic device, they may not be able to be used directly due to different interfaces. Therefore, in some embodiments, when the playback device executes the above step S101, it may also perform the following steps: obtaining the first video stream captured by the image acquisition element, and displaying the first video stream to the display.

[0100] In an embodiment of the present application, the playback device may capture the first video stream through an image capture element, wherein the image capture element may be a camera, a scanner, or other element.

[0101] In an embodiment of the present application, the playback device may display the captured first video stream on a display. Figure 4 As shown, the mobile handheld device 41 captures a first video stream within the field of view (FOV) (the display 47 which cannot access audio information) through the image acquisition element 46, then crops a second video stream 42 from the first video stream and displays the second video stream 42 on the display.

[0102] In this way, the first video stream can be captured and displayed in real time through the image acquisition element, and then step S102 and step S103 are executed. In this way, the playback device and the target electronic device can obtain the video stream displayed on the display of the target electronic device in real time through the image acquisition element and dub it without physical or network connection, thereby realizing dubbing and playback while capturing the second video stream, solving the problem of silent video streams being difficult to watch and understand in related technologies, and improving the convenience of video stream playback.

[0103] like Figure 8 As shown, an exemplary playing method is shown, including the following steps S801 to S805:

[0104] Step S801: Detect a video stream within the viewing angle of a camera viewfinder.

[0105] Here, the mobile handset (playing device) can detect the video stream (second video stream) within the viewing angle range through the camera viewfinder (image acquisition element). Here, the mobile handset can directly determine whether the display within the viewing angle range is playing the video stream.

[0106] Step S802: Detect the audio stream.

[0107] Here, the mobile handheld device can obtain the audio stream (first audio stream) in the scene where the second video stream is located through a voice collector (microphone, pickup, etc.).

[0108] Step S803: Determine whether the detected audio stream and video stream match.

[0109] Here, the mobile handheld device can determine whether the acquired video stream (second video stream) and audio stream (first audio stream) match. If they do not match, it means that the audio stream corresponding to the detected video stream cannot be accessed, and step S804 is executed. If they match, the detected audio stream is played directly (for an exemplary playback method, see the discussion at step S503 above. It will not be repeated here). For an exemplary method of determining a match, see the discussion at steps S501 to S503 above, which will not be repeated here.

[0110] Step S804: Identify text information through subtitles and convert the text information into an audio stream.

[0111] Here, the mobile handheld device processes the video frames of the second video stream, generates text information by identifying the captions of the video frames in the video stream, and converts the text information into an audio stream.

[0112] Step S805: Add sound and background music according to the content.

[0113] Here, the mobile handheld device processes the video frames of the second video stream, and adds sound and background music by identifying the image information in the video frames in the video stream. The second audio stream may include the audio stream converted from the text information in step S804, or may include the audio stream and background music for the image in step S805 based on step S804.

[0114] In this way, a method for regenerating the audio, voice or music of a video in the camera FOV can be provided by detecting whether there is matching audio, voice or music in the video in the camera FOV, thereby providing users with the convenience of watching videos on a shared display screen using electronic devices such as mobile phones or VR / AR devices.

[0115] The embodiment of the present application provides a playback method, which includes: playing a first video stream; the first video stream includes a first target area for displaying and outputting a second video stream; if the first audio stream corresponding to the first video stream does not match the second video stream, generating a second audio stream for the second video stream; playing the second audio stream. The playback method provided by the present application can effectively reduce the difficulty of watching and understanding silent videos by generating a matching second audio stream for the second video stream that lacks an audio stream and playing it, thereby improving the convenience of video stream playback.

[0116] The present application embodiment provides a playback device 9, such as Fig. 9 As shown, including:

[0117] The first playback module 901 is used to play the first video stream; the first video stream includes a first target area for displaying and outputting the second video stream;

[0118] A generating module 902, configured to generate a second audio stream for the second video stream if the first audio stream corresponding to the first video stream does not match the second video stream;

[0119] The second playing module 903 is used to play the second audio stream.

[0120] In one embodiment of the present application, the second playing module 903 is also used to play the first audio stream.

[0121] In one embodiment of the present application, the first playback module 901 is further used to display the video stream corresponding to the first target area in the first video stream.

[0122] In one embodiment of the present application, the first video stream includes a target electronic device including a display, and the first target area is an area occupied by the target electronic device for displaying and outputting the second video stream.

[0123] In one embodiment of the present application, the generation module 902 is further used to identify the first content of the second video stream; identify the second content of the first audio stream; and if the second content contains content that matches the first content, determine that the first audio stream matches the second video stream.

[0124] In one embodiment of the present application, the playback device 9 also includes a determination module (not shown in the figure) for obtaining a target video stream; the target video stream includes a target electronic device including a display; if the video stream of the second target area meets the target condition, the target video stream is determined to be the first video stream; wherein the second target area is the area occupied by the display of the target electronic device in the target video stream; the target condition characterizes that the display is playing the video stream.

[0125] In one embodiment of the present application, the generation module 902 is further used to generate a second audio stream for the second video stream based on text information in the second video stream; and / or generate a second audio stream for the second video stream based on content represented by the second video stream.

[0126] In one embodiment of the present application, the first playback module 901 is further configured to obtain a first video stream captured by the image acquisition component, and display the first video stream on a display.

[0127] The present application embodiment provides a playback device 10, such as Fig.10 As shown, the playback device 10 includes: a display 1001, used to play a first video stream; the first video stream includes a first target area for displaying and outputting a second video stream; a processor 1002, the processor is used to execute if a first audio stream corresponding to the first video stream does not match the second video stream, generate a second audio stream for the second video stream; a speaker 1003, used to play the second audio stream.

[0128] The embodiment of the present application provides a playback device, including: a display for playing a first video stream; the first video stream contains a first target area for displaying and outputting a second video stream; a processor, the processor is used to generate a second audio stream for the second video stream if the first audio stream corresponding to the first video stream does not match the second video stream; a speaker is used to play the second audio stream. The playback device provided by the present application can effectively reduce the difficulty of watching and understanding silent videos by generating a matching second audio stream for the second video stream that lacks an audio stream and playing it, thereby improving the convenience of video stream playback.

[0129] The embodiment of the present application provides a computer-readable storage medium, which stores one or more computer programs, and the one or more computer programs can be executed by one or more processors to implement the above-mentioned playback method. The computer-readable storage medium can be a volatile memory (volatile memory), such as a random access memory (Random-Access Memory, RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (Read-Only Memory, ROM), a flash memory (flash memory), a hard disk (Hard Disk Drive, HDD) or a solid-state drive (Solid-State Drive, SSD); or it can be a respective device including one or any combination of the above memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, etc.

[0130] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0131] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0132] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0133] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0134] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A playback method, the method comprising: Play the first video stream; The first video stream includes a first target area for displaying and outputting a second video stream; If the first audio stream corresponding to the first video stream does not match the second video stream, generating a second audio stream for the second video stream; Play the second audio stream.

2. The playback method according to claim 1, further comprising: Play the first audio stream.

3. The playback method according to claim 1, wherein playing the first video stream comprises: Display the video stream corresponding to the first target area in the first video stream. 4 . The playback method according to claim 1 , wherein the first video stream includes a target electronic device including a display, and the first target area is an area occupied by the target electronic device for displaying and outputting the second video stream.

5. The playback method according to claim 1, further comprising: identifying first content of the second video stream; identifying second content of the first audio stream; If the second content includes content matching the first content, it is determined that the first audio stream matches the second video stream.

6. The playback method according to claim 1, further comprising: Get the target video stream; The target video stream includes a target electronic device including a display; If the video stream of the second target area meets the target condition, determining that the target video stream is the first video stream; Wherein, the second target area is the area occupied by the display of the target electronic device in the target video stream; The target condition represents that the display is playing a video stream.

7. The playback method according to any one of claims 1 to 6, wherein generating a second audio stream for the second video stream comprises: generating a second audio stream for the second video stream based on text information in the second video stream; and / or, A second audio stream for the second video stream is generated based on content represented by the second video stream.

8. The method according to claim 1, wherein playing the first video stream comprises: Acquire a first video stream captured by an image acquisition component, and display the first video stream on a display.

9. A playback device, comprising: A first playback module, used for playing a first video stream; The first video stream includes a first target area for displaying and outputting a second video stream; A generating module, configured to generate a second audio stream for the second video stream if the first audio stream corresponding to the first video stream does not match the second video stream; The second playing module is used to play the second audio stream.

10. A playback device, comprising: A display, configured to play a first video stream; The first video stream includes a first target area for displaying and outputting a second video stream; A processor, the processor being configured to generate a second audio stream for the second video stream if a first audio stream corresponding to the first video stream does not match the second video stream; A speaker is used to play the second audio stream.

Images