Screen projection method, device, electronic device and storage medium

Abstract

The disclosed embodiments relate to a screen projection method, device, electronic device and storage medium, the method comprising: obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected; performing frame processing on the video data based on predetermined playback speed information to obtain processed data; and sending the processed data to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information. With this method, the target video can be played at a multiple without relying on the playback speed function of the screen projection sending end.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a screen projection method, device, electronic device and storage medium. Background Art

[0002] Screen projection is a technology that displays the screen of the screen projection sender (such as a mobile phone or computer) in real time on the screen projection receiver (such as a projector, conference tablet, splicing screen, electronic whiteboard, or TV).

[0003] The existing screen projection solutions can usually only transmit the projected content in real time to the screen projection receiving end for playback. This solution cannot slow down or speed up the playback of the projected content. However, double-speed playback is a commonly used function in scenarios such as online learning or quickly browsing video content. In addition, the current double-speed playback function is usually set on the screen projection sending end. Therefore, the use of the double-speed playback function has high requirements on the software and hardware of the screen projection sending end.

[0004] It can be seen that how to achieve double-speed playback without relying on the double-speed playback function of the screen projection sender is an issue worthy of attention. Summary of the invention

[0005] In view of this, in order to solve some or all of the above-mentioned technical problems, the embodiments of the present disclosure provide a screen projection method, device, electronic device and storage medium.

[0006] In a first aspect, an embodiment of the present disclosure provides a screen projection method, which is applied to a screen projection transfer terminal, and the method includes:

[0007] Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0008] Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data;

[0009] The processed data is sent to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information.

[0010] In a possible implementation manner, the video data includes image data and audio data; and

[0011] The obtaining of video data sent by the screen projection sending end includes:

[0012] Get the image data sent by the screen projection sender in the form of frame sequence and the audio data sent in the form of data packets.

[0013] In a possible implementation, obtaining video data sent by the screen projection sending end includes:

[0014] Get the video data sent by the screen projection sender in the form of frame sequence.

[0015] In a possible implementation, the performing frame processing on the video data based on the predetermined playback speed information includes:

[0016] Obtaining predetermined playback speed information;

[0017] Determine the playback multiple indicated by the playback speed information;

[0018] When the playback multiple is greater than 1, performing frame compression processing on the video data;

[0019] When the playback multiple is less than 1, frame interpolation processing is performed on the video data.

[0020] In a possible implementation manner, the playback speed information is determined in the following manner:

[0021] Get user image;

[0022] Performing image recognition on the user image to generate identification information indicating whether the user indicated by the user image is looking at the screen projection receiving end;

[0023] Based on the identification information, the playback multiple information of the target video is determined.

[0024] In a possible implementation manner, the target video includes at least one of the following:

[0025] The screen image of the main screen of the screen projection sending end, the document image of the document displayed by the screen projection sending end, and the application image of the application running in the background of the screen projection sending end.

[0026] In a second aspect, an embodiment of the present disclosure provides a screen projection method, which is applied to a screen projection receiving end, and the method includes:

[0027] Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0028] Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data;

[0029] The target video is played according to the playback multiple indicated by the playback speed information.

[0030] In a third aspect, an embodiment of the present disclosure provides a screen projection device, which is arranged at a screen projection transfer end, and includes:

[0031] A first acquisition unit is used to acquire video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0032] A first processing unit, configured to perform frame processing on the video data based on predetermined playback speed information to obtain processed data;

[0033] A sending unit is used to send the processed data to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video according to the playback multiple indicated by the playback speed information.

[0034] In a possible implementation manner, the video data includes image data and audio data; and

[0035] The obtaining of video data sent by the screen projection sending end includes:

[0036] Get the image data sent by the screen projection sender in the form of frame sequence and the audio data sent in the form of data packets.

[0037] In a possible implementation, obtaining video data sent by the screen projection sending end includes:

[0038] Get the video data sent by the screen projection sender in the form of frame sequence.

[0039] In a possible implementation, the performing frame processing on the video data based on the predetermined playback speed information includes:

[0040] Obtaining predetermined playback speed information;

[0041] Determine the playback multiple indicated by the playback speed information;

[0042] When the playback multiple is greater than 1, performing frame compression processing on the video data;

[0043] When the playback multiple is less than 1, frame interpolation processing is performed on the video data.

[0044] In a possible implementation manner, the playback speed information is determined in the following manner:

[0045] Get user image;

[0046] Performing image recognition on the user image to generate identification information indicating whether the user indicated by the user image is looking at the screen projection receiving end;

[0047] Based on the identification information, the playback multiple information of the target video is determined.

[0048] In a possible implementation manner, the target video includes at least one of the following:

[0049] The screen image of the main screen of the screen projection sending end, the document image of the document displayed by the screen projection sending end, and the application image of the application running in the background of the screen projection sending end.

[0050] In a fourth aspect, an embodiment of the present disclosure provides a screen projection device, which is applied to a screen projection receiving end, and the device includes:

[0051] A second acquisition unit is used to acquire video data sent by the screen projection sending end, wherein the video data represents a target video to be projected;

[0052] A second processing unit, configured to perform frame processing on the video data based on predetermined playback speed information to obtain processed data;

[0053] A playback unit is used to play the target video according to the playback multiple indicated by the playback speed information.

[0054] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including:

[0055] Memory for storing computer programs;

[0056] The processor is used to execute the computer program stored in the above-mentioned memory, and when the above-mentioned computer program is executed, the method of any embodiment of the screen projection method of the first aspect or the second aspect of the present disclosure is implemented.

[0057] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, and when the computer program is executed by a processor, it implements a method as in any embodiment of the screen projection method of the first aspect or the second aspect mentioned above.

[0058] In the seventh aspect, an embodiment of the present disclosure provides a computer program, which includes a computer-readable code. When the computer-readable code runs on a device, the processor in the device executes instructions for implementing the steps of the method in any embodiment of the screen projection method of the first aspect or the second aspect mentioned above.

[0059] The screen projection method applied to the screen projection transfer end provided by the embodiment of the present disclosure can obtain the video data sent by the screen projection sending end, wherein the video data represents the target video to be projected, and then, based on the predetermined playback speed information, the video data is frame processed to obtain the processed data, and then the processed data is sent to the screen projection receiving end, wherein the screen projection receiving end is used to play the target video according to the playback multiple indicated by the playback speed information. With this method, the speed playback of the target video can be achieved without relying on the speed playback function of the screen projection sending end.

[0060] The screen projection method applied to the screen projection receiving end provided by the embodiment of the present disclosure can obtain video data sent by the screen projection sending end, wherein the video data represents the target video to be projected, and then, based on the predetermined playback speed information, the video data is frame processed to obtain the processed data, and finally, the target video is played according to the playback multiple indicated by the playback speed information. With this method, the speed playback of the target video can be achieved without relying on the speed playback function of the screen projection sending end. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 A flowchart of a screen projection method applied to a screen projection transfer terminal provided in an embodiment of the present disclosure;

[0062] Figure 2 A flowchart of another screen projection method applied to a screen projection transfer terminal provided in an embodiment of the present disclosure;

[0063] Figure 3 A schematic diagram of a flow chart of a screen projection method applied to a screen projection receiving end provided in an embodiment of the present disclosure;

[0064] Figure 4A A schematic diagram of the structure of a screen projection device provided at a screen projection transfer end according to an embodiment of the present disclosure;

[0065] Figure 4B A schematic diagram of the structure of a screen projection device provided at a screen projection receiving end provided in an embodiment of the present disclosure;

[0066] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0067] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless otherwise specifically stated.

[0068] Those skilled in the art will understand that the terms "first" and "second" in the embodiments of the present disclosure are only used to distinguish objects such as different steps, devices or modules, and do not represent any specific technical meanings, nor do they indicate the logical order between them.

[0069] It should also be understood that in this embodiment, “plurality” may refer to two or more than two, and “at least one” may refer to one, two or more than two.

[0070] It should also be understood that any component, data or structure mentioned in the embodiments of the present disclosure can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0071] In addition, the term "and / or" in the present disclosure is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in the present disclosure generally indicates that the associated objects before and after are in an "or" relationship.

[0072] It should also be understood that the description of the various embodiments in the present disclosure focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0073] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0074] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the above-mentioned technologies, methods, and equipment should be considered as part of the specification.

[0075] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0076] It should be noted that, in the absence of conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. To facilitate the understanding of the embodiments of the present disclosure, the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present disclosure.

[0077] Figure 1 The following is a flowchart of a screen projection method applied to a screen projection transfer terminal provided in an embodiment of the present disclosure. Figure 1 As shown, the method specifically includes:

[0078] 101. Obtain video data sent by a screen projection sending end, wherein the video data represents a target video to be projected.

[0079] In this embodiment, the screen projection sending end may be an end for sending video data of the target video to be projected. As an example, the screen projection sending end may be software or hardware having the function of sending the above video data. For example, the screen projection sending end may be a mobile phone or a computer.

[0080] The target video may be a video to be played through the screen projection receiving end described later.

[0081] The screen projection receiving end can play the video represented by the received video data after receiving the video data (such as processed data). As an example, the screen projection receiving end can be a projector, a conference tablet, a spliced ​​screen, an electronic whiteboard, a television, etc.

[0082] The video data can be a download link of the target video to be projected, or a collection of image data and / or audio data of an image presented by the projection sender, or a collection of image data and / or audio data of an interface running in the background but not presented by the projection sender.

[0083] In some optional implementations of this embodiment, the target video includes at least one of the following:

[0084] The screen image of the main screen of the screen projection sending end, the document image of the document displayed by the screen projection sending end, and the application image of the application running in the background of the screen projection sending end.

[0085] It can be understood that in the above optional implementation, the target video may include at least one of the screen image of the main screen of the screen projection sender, the document image of the document displayed by the screen projection sender, and the application image of the application running in the background of the screen projection sender. In the prior art, it is usually only possible to play the video in the video player at a double speed. Therefore, the above optional implementation expands the types of resources that the screen projection sender supports for double-speed playback.

[0086] In some optional implementations of this embodiment, the video data includes image data and audio data. On this basis, the following method can also be used to perform the above step 101:

[0087] Get the image data sent by the screen projection sender in the form of frame sequence and the audio data sent in the form of data packets.

[0088] It can be understood that in the above optional implementation method, the screen projection sending end can send image data in the form of a frame sequence and audio data in the form of a data packet. In this way, the sending of video data by the screen projection sending end with an Android system can be realized, thereby utilizing the video resources of the screen projection sending end. In the scenario where the video playing at the video sending end is stuck, the speed playback function of the screen projection transfer end based on the Android system can achieve smoother video speed projection playback.

[0089] In some optional implementations of this embodiment, the above step 101 may also be performed in the following manner:

[0090] Get the video data sent by the screen projection sender in the form of frame sequence.

[0091] It can be understood that in the above optional implementation method, the screen projection sending end can directly send video data in the form of a frame sequence. In this way, the sending of video data of the screen projection sending end running the iOS system can be realized, thereby utilizing the video resources of the screen projection sending end. In the scenario where the video playing at the video sending end is stuck, the speed playback function of the screen projection transfer end based on the iOS system can achieve smoother video speed projection playback.

[0092] 102. Perform frame processing on the video data based on predetermined playback speed information to obtain processed data.

[0093] In this embodiment, the playback speed information can be used to indicate the playback multiple of the target video.

[0094] As an example, when the playback speed information indicates that the target video is played in a 0.5x speed mode, the original sound and picture can be supplemented by 1 frame for every 1 frame, and the frame can be re-encoded to obtain the processed data. When the playback speed information indicates that the target video is played in a 0.75x speed mode, the original sound and picture can be supplemented by 1 frame for every 3 frames, and the frame can be re-encoded to obtain the processed data. When the playback speed information indicates that the target video is played in a 1.25x speed mode, the original sound and picture can be compressed to 1 frame for every 1.25 frames, and the processed data can be re-encoded. When the playback speed information indicates that the target video is played in a 1.5x speed mode, the original sound and picture can be compressed to 1 frame for every 1.5 frames, and the processed data can be re-encoded. When the playback speed information indicates that the target video is played in a 1.75x speed mode, the original sound and picture can be compressed to 1 frame for every 1.75 frames, and the processed data can be re-encoded. When the playback speed information indicates that the target video is to be played in a 2x speed mode, the original audio and video may be compressed into 1 frame for processing at every 2 frames, and re-encoded to obtain processed data.

[0095] In some optional implementations of this embodiment, the playback speed information is determined in the following manner:

[0096] Step 1: Get the user image.

[0097] The user image may be obtained via a camera disposed on the screen projection receiving end, or may be obtained via a camera disposed at a fixed position on the screen projection receiving end.

[0098] Step two: perform image recognition on the user image to generate identification information indicating whether the user indicated by the user image is looking at the screen projection receiving end.

[0099] As an example, the user image can be input into a pre-trained recognition model to obtain recognition information indicating whether the user indicated by the user image is looking at the projection receiving end. The recognition model can be a binary classification model trained using a machine learning algorithm.

[0100] Step three: determine the playback multiple information of the target video based on the identification information.

[0101] Specifically, if the above-mentioned identification information represents that the user indicated by the user image is looking at the screen projection receiving end, then the playback multiple information of the target video can be determined as the preset playback multiple information. For example, the preset playback multiple information can indicate that the target video is played at a preset speed (for example, 2 times, 3 times). If the above-mentioned identification information represents that the user indicated by the user image is not looking at the screen projection receiving end, then the playback multiple information of the target video can be determined as an initial playback multiple information. For example, the initial playback multiple information can indicate the playback multiple (for example, 1 times) set by the user for the target video. Among them, the playback multiple indicated by the above-mentioned preset playback multiple information is greater than the playback multiple indicated by the initial playback multiple information. In some cases, the playback multiple indicated by the preset playback multiple information can be a preset multiple (for example, 2 times) of the playback multiple indicated by the initial playback multiple information.

[0102] It can be understood that in the above optional implementation, when the user is looking at the screen projection receiving end, the target video can be played at a faster speed, and when the user is not looking at the screen projection receiving end, the target video can be played at a slower speed, thereby improving the flexibility of speed playback. In addition, when the user is not looking at the screen projection receiving end, it may mean that the user is not interested in the video being played at this time, so the currently playing video can be played at a higher speed.

[0103] In some application scenarios of the above-mentioned optional implementation methods, if the above-mentioned identification information represents that the user indicated by the user image is not looking at the screen projection receiving end, and the time duration of not looking at the screen projection receiving end exceeds a preset time threshold (for example, 10 seconds), in this scenario, the playback multiple information of the target video is determined as the above-mentioned preset playback multiple information, so that the screen projection receiving end plays the target video at the playback multiple indicated by the preset playback speed information.

[0104] Optionally, the playback speed information (including initial playback speed information and preset playback speed information) may also be set by the user.

[0105] 103. Send the processed data to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information.

[0106] In some cases, the screen projection relay end can be another device independent of the screen projection sending end and the screen projection receiving end.

[0107] The screen projection method applied to the screen projection transfer end provided by the embodiment of the present disclosure can obtain the video data sent by the screen projection sending end, wherein the video data represents the target video to be projected, and then, based on the predetermined playback speed information, the video data is frame processed to obtain the processed data, and then the processed data is sent to the screen projection receiving end, wherein the screen projection receiving end is used to play the target video according to the playback multiple indicated by the playback speed information. With this method, the speed playback of the target video can be achieved without relying on the speed playback function of the screen projection sending end.

[0108] Figure 2 A flowchart of another screen projection method applied to a screen projection transfer terminal provided by an embodiment of the present disclosure. Figure 2 As shown, the method specifically includes:

[0109] 201. Obtain video data sent by a screen projection sending end, wherein the video data represents a target video to be projected.

[0110] In this embodiment, step 201 and Figure 1 Step 101 in the corresponding embodiment is basically the same and will not be described again here.

[0111] 202. Obtain predetermined playback speed information.

[0112] In this embodiment, the playback speed information can be used to indicate the playback multiple of the target video.

[0113] 203. Determine the playback multiple indicated by the playback speed information.

[0114] 204. When the playback multiple is greater than 1, frame compression processing is performed on the video data to obtain processed data.

[0115] As an example, when the playback speed information indicates that the target video is played in a 1.25x speed mode, the original sound and picture can be compressed into 1 frame for processing at every 1.25 frames, and re-encoded to obtain processed data. When the playback speed information indicates that the target video is played in a 1.5x speed mode, the original sound and picture can be compressed into 1 frame for processing at every 1.5 frames, and re-encoded to obtain processed data. When the playback speed information indicates that the target video is played in a 1.75x speed mode, the original sound and picture can be compressed into 1 frame for processing at every 1.75 frames, and re-encoded to obtain processed data. When the playback speed information indicates that the target video is played in a 2x speed mode, the original sound and picture can be compressed into 1 frame for processing at every 2 frames, and re-encoded to obtain processed data.

[0116] 205. When the playback multiple is less than 1, perform frame interpolation processing on the video data to obtain processed data.

[0117] As an example, when the playback speed information indicates that the target video is played at 0.5 times the speed, the original audio and video can be supplemented by one frame for every one frame, and the frame can be re-encoded to obtain the processed data. When the playback speed information indicates that the target video is played at 0.75 times the speed, the original audio and video can be supplemented by one frame for every three frames, and the frame can be re-encoded to obtain the processed data.

[0118] 206. Send the processed data to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information.

[0119] In this embodiment, step 206 and Figure 1 Step 103 in the corresponding embodiment is basically the same and will not be described again here.

[0120] The following is an illustrative description of the embodiments of the present disclosure, but it should be noted that the embodiments of the present disclosure may have the features described below, but the following description does not constitute a limitation on the protection scope of the embodiments of the present disclosure.

[0121] In this example, the workflow of the speed mode may include the following stages:

[0122] First, in the startup phase:

[0123] The user chooses to enter the double-speed mode, and the interface prompts that in this mode there is a slight delay between the projected image and the actual image on the mobile phone (that is, the above-mentioned projection sending end) in order to complete the multiple pre-processing of the audio and video.

[0124] Then enter the transmission phase:

[0125] In the first category, audio and video are transmitted separately during the screen projection process: the transmitting end (that is, the screen projection transmitting end mentioned above) sends the picture in the form of frame sequence and the audio in the form of data packets to the receiving end (that is, the screen projection receiving end mentioned above), and the receiving end receives and buffers the data (that is, the processed data mentioned above).

[0126] The second type is the combined transmission of audio and video during screen projection: the transmitter sends the audio and video to the receiver in frame order, and the receiver receives and buffers the data.

[0127] Then enter the multiple processing and display stage:

[0128] Specifically, when the playback speed information indicates that the target video is played in a 0.5x speed mode, the original sound and picture can be supplemented by 1 frame for every 1 frame, and the frame can be re-encoded for screen display. When the playback speed information indicates that the target video is played in a 0.75x speed mode, the original sound and picture can be supplemented by 1 frame for every 3 frames, and the frame can be re-encoded for screen display. When the playback speed information indicates that the target video is played in a 1.25x speed mode, the original sound and picture can be compressed to 1 frame for every 1.25 frames, and the frame can be re-encoded for screen display. When the playback speed information indicates that the target video is played in a 1.5x speed mode, the original sound and picture can be compressed to 1 frame for every 1.5 frames, and the frame can be re-encoded for screen display. When the playback speed information indicates that the target video is played in a 1.75x speed mode, the original sound and picture can be compressed to 1 frame for every 1.75 frames, and the frame can be re-encoded for screen display. When the playback speed information indicates that the target video is to be played in 2x speed mode, the original audio and video can be compressed into 1 frame for processing at a rate of 2 frames per frame, and then re-encoded for screen projection display.

[0129] Therefore, in the above example, by obtaining the sequence frame images and audio data packets of the mobile phone's screen and transmitting them to the receiving end, the receiving end performs frame multiple processing on the audio and video data according to the set multiples and then re-encodes them for screen projection display, thereby achieving the effect of multiple playback of the projection content.

[0130] It should be noted that, in addition to the above contents, this embodiment may also include Figure 1 The technical features described in the corresponding embodiments are realized Figure 1 For details on the technical effects of the screen projection method shown, please refer to Figure 1For the sake of brevity, the relevant description is not repeated here.

[0131] The screen projection method applied to the screen projection transfer terminal provided by the embodiment of the present disclosure can perform frame compression processing on the video data when the playback multiple is greater than 1, and perform frame supplement processing on the video data when the playback multiple is less than 1. Thus, the precision of the screen projection video played at multiple speeds is improved.

[0132] Figure 3 A flowchart of a screen projection method applied to a screen projection receiving end provided in an embodiment of the present disclosure.

[0133] Specifically, if Figure 3 As shown, the method specifically includes:

[0134] 301. Obtain video data sent by a screen projection sending end, wherein the video data represents a target video to be projected.

[0135] 302. Perform frame processing on the video data based on predetermined playback speed information to obtain processed data.

[0136] 303. Play the target video according to the playback multiple indicated by the playback speed information.

[0137] In some optional implementations of this embodiment, the video data includes image data and audio data; and

[0138] The obtaining of video data sent by the screen projection sending end includes:

[0139] Get the image data sent by the screen projection sender in the form of frame sequence and the audio data sent in the form of data packets.

[0140] In some optional implementations of this embodiment, the obtaining of video data sent by the screen projection sending end includes:

[0141] Get the video data sent by the screen projection sender in the form of frame sequence.

[0142] In some optional implementations of this embodiment, the performing frame processing on the video data based on the predetermined playback speed information includes:

[0143] Obtaining predetermined playback speed information;

[0144] Determine the playback multiple indicated by the playback speed information;

[0145] When the playback multiple is greater than 1, performing frame compression processing on the video data;

[0146] When the playback multiple is less than 1, frame interpolation processing is performed on the video data.

[0147] In some optional implementations of this embodiment, the playback speed information is determined in the following manner:

[0148] Get user image;

[0149] Performing image recognition on the user image to generate identification information indicating whether the user indicated by the user image is looking at the screen projection receiving end;

[0150] Based on the identification information, the playback multiple information of the target video is determined.

[0151] In some optional implementations of this embodiment, the target video includes at least one of the following:

[0152] The screen image of the main screen of the screen projection sending end, the document image of the document displayed by the screen projection sending end, and the application image of the application running in the background of the screen projection sending end.

[0153] It should be noted that the execution subject of the screen projection method applied to the screen projection receiving end provided by the embodiment of the present disclosure may be the screen projection receiving end described in the screen projection method applied to the screen projection transfer end. And / or, the execution subject of the screen projection method applied to the screen projection receiving end provided by the embodiment of the present disclosure may perform the same steps as the execution subject of the screen projection method applied to the screen projection transfer end. Therefore, in addition to the contents described above, this embodiment may also include Figure 1 and / or Figure 2 The technical features described in the corresponding embodiments are realized Figure 1 and / or Figure 2 For details on the technical effects of the screen projection method shown, please refer to Figure 1 and / or Figure 2 For the sake of brevity, the relevant description is not repeated here.

[0154] The screen projection method applied to the screen projection receiving end provided by the embodiment of the present disclosure can obtain video data sent by the screen projection sending end, wherein the video data represents the target video to be projected, and then, based on the predetermined playback speed information, the video data is frame processed to obtain the processed data, and finally, the target video is played according to the playback multiple indicated by the playback speed information. With this method, the speed playback of the target video can be achieved without relying on the speed playback function of the screen projection sending end.

[0155] Figure 4A A schematic diagram of the structure of a screen projection device applied to a screen projection transfer terminal provided in an embodiment of the present disclosure. Specifically comprising:

[0156] The first acquisition unit 401 is used to acquire video data sent by the screen projection sending end, wherein the video data represents the target video to be projected;

[0157] The first processing unit 402 is used to perform frame processing on the video data based on the predetermined playback speed information to obtain processed data;

[0158] The sending unit 403 is used to send the processed data to the screen projection receiving end, wherein the screen projection receiving end is used to play the target video according to the playback multiple indicated by the playback speed information.

[0159] In a possible implementation manner, the video data includes image data and audio data; and

[0160] The obtaining of video data sent by the screen projection sending end includes:

[0161] Get the image data sent by the screen projection sender in the form of frame sequence and the audio data sent in the form of data packets.

[0162] In a possible implementation, obtaining video data sent by the screen projection sending end includes:

[0163] Get the video data sent by the screen projection sender in the form of frame sequence.

[0164] In a possible implementation, the performing frame processing on the video data based on the predetermined playback speed information includes:

[0165] Obtaining predetermined playback speed information;

[0166] Determine the playback multiple indicated by the playback speed information;

[0167] When the playback multiple is greater than 1, performing frame compression processing on the video data;

[0168] When the playback multiple is less than 1, frame interpolation processing is performed on the video data.

[0169] In a possible implementation manner, the playback speed information is determined in the following manner:

[0170] Get user image;

[0171] Performing image recognition on the user image to generate identification information indicating whether the user indicated by the user image is looking at the screen projection receiving end;

[0172] Based on the identification information, the playback multiple information of the target video is determined.

[0173] In a possible implementation manner, the target video includes at least one of the following:

[0174] The screen image of the main screen of the screen projection sending end, the document image of the document displayed by the screen projection sending end, and the application image of the application running in the background of the screen projection sending end.

[0175] The screen projection device provided in this embodiment can be as follows Figure 4A The screen projection device shown in can execute all the steps of the above-mentioned screen projection methods applied to the screen projection transfer end, and thus achieve the technical effects of the above-mentioned screen projection methods applied to the screen projection transfer end. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0176] Figure 4B The present invention provides a schematic diagram of a screen projection device provided at a screen projection receiving end. Specifically, it includes:

[0177] The second acquisition unit 411 is used to acquire video data sent by the screen projection sending end, wherein the video data represents the target video to be projected;

[0178] The second processing unit 412 is used to perform frame processing on the video data based on the predetermined playback speed information to obtain processed data;

[0179] The playback unit 413 is used to play the target video according to the playback multiple indicated by the playback speed information.

[0180] The screen projection device provided in this embodiment can be as follows Figure 4B The screen projection device shown in can execute all the steps of the above-mentioned screen projection methods applied to the screen projection receiving end, and then realize the technical effects of the above-mentioned screen projection methods applied to the screen projection receiving end. Please refer to the above related description for details. For the sake of concise description, it will not be repeated here.

[0181] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure is provided. Figure 5 The electronic device 500 shown includes: at least one processor 501, a memory 502, at least one network interface 504 and other user interfaces 503. The various components in the electronic device 500 are coupled together via a bus system 505. It is understood that the bus system 505 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 505 is not shown in FIG. Figure 5 Various buses are labeled as bus system 505 .

[0182] The user interface 503 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).

[0183] It can be understood that the memory 502 in the embodiment of the present disclosure can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 502 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0184] In some implementations, the memory 502 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 5021 and an application program 5022 .

[0185] The operating system 5021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 5022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present disclosure can be included in the application 5022.

[0186] In this embodiment, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application 5022, the processor 501 is used to execute the method steps provided by each method embodiment, for example, including:

[0187] Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0188] Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data;

[0189] The processed data is sent to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information.

[0190] or,

[0191] Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0192] Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data;

[0193] The target video is played according to the playback multiple indicated by the playback speed information.

[0194] The method disclosed in the above embodiment of the present disclosure can be applied to the processor 501, or implemented by the processor 501. The processor 501 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 501 or the instruction in the form of software. The above processor 501 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present disclosure can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present disclosure can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502 and completes the steps of the above method in combination with its hardware.

[0195] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the above functions of the present disclosure, or a combination thereof.

[0196] For software implementation, the technology described above in this article can be implemented by a unit that performs the functions described above in this article. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0197] The electronic device provided in this embodiment may be Figure 5 The electronic device shown in can execute all the steps of the screen projection methods described above, and thus achieve the technical effects of the screen projection methods described above. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0198] The embodiments of the present disclosure also provide a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0199] When one or more programs in the storage medium can be executed by one or more processors, the screen projection method performed on the electronic device side can be implemented.

[0200] The processor is used to execute the screen projection program stored in the memory to implement the following steps of the screen projection method performed on the electronic device side:

[0201] Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0202] Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data;

[0203] The processed data is sent to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information.

[0204] or,

[0205] Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected;

[0206] Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data;

[0207] The target video is played according to the playback multiple indicated by the playback speed information.

[0208] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0209] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0210] The specific implementation methods described above further illustrate the purpose, technical solutions and beneficial effects of the present disclosure. It should be understood that the above description is only the specific implementation methods of the present disclosure and is not intended to limit the protection scope of the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure should be included in the protection scope of the present disclosure. In addition, for the aforementioned embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present invention is not limited by the described order of actions, because according to the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present invention.

Claims

1. A screen projection method, characterized in that: The method is applied to a screen projection transfer terminal, and the method includes: Obtaining video data sent by a screen projection sending end, wherein the video data represents a target video to be projected; Based on the predetermined playback speed information, frame processing is performed on the video data to obtain processed data; Sending the processed data to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information; The screen projection transfer end is another device independent of the screen projection sending end and the screen projection receiving end; Among them, the playback speed information is determined in the following manner: obtaining a user image; performing image recognition on the user image to generate identification information representing whether the user indicated by the user image is looking at the screen projection receiving end; based on the identification information, determining the playback speed information of the target video.

2. The method according to claim 1, characterized in that The video data includes image data and audio data; and The obtaining of video data sent by the screen projection sending end includes: Get the image data sent by the screen projection sender in the form of frame sequence and the audio data sent in the form of data packets.

3. The method according to claim 1, characterized in that The obtaining of video data sent by the screen projection sending end includes: Get the video data sent by the screen projection sender in the form of frame sequence.

4. The method according to claim 1, characterized in that: The frame processing of the video data based on the predetermined playback speed information includes: Obtaining predetermined playback speed information; Determine the playback multiple indicated by the playback speed information; When the playback multiple is greater than 1, performing frame compression processing on the video data; When the playback multiple is less than 1, frame interpolation processing is performed on the video data.

5. The method according to any one of claims 1 to 4, characterized in that: The target video includes at least one of the following: The screen image of the main screen of the screen projection sending end, the document image of the document displayed by the screen projection sending end, and the application image of the application running in the background of the screen projection sending end.

6. A screen projection device, characterized in that: The device is arranged at the screen projection transfer end, and the device comprises: A first acquisition unit is used to acquire video data sent by a screen projection sending end, wherein the video data represents a target video to be projected; A second processing unit, configured to perform frame processing on the video data based on predetermined playback speed information to obtain processed data; A sending unit, used to send the processed data to a screen projection receiving end, wherein the screen projection receiving end is used to play the target video at the playback multiple indicated by the playback speed information; The screen projection transfer end is another device independent of the screen projection sending end and the screen projection receiving end; The playback speed information is determined in the following manner: obtaining a user image; performing image recognition on the user image to generate identification information representing whether the user indicated by the user image is looking at the screen projection receiving end; based on the identification information, determining the playback speed information of the target video.

7. An electronic device, characterized in that: include: Memory for storing computer programs; A processor, configured to execute a computer program stored in the memory, and when the computer program is executed, implement the method described in any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method described in any one of claims 1 to 5 is implemented.

Images