Video processing method and device, electronic equipment and storage medium

By starting the projection control service and creating a target window during the video projection operation, the problems of poor real-time, poor compatibility and poor connection stability of video projection in the prior art are solved, and a more convenient and stable video projection experience is achieved.

CN119893192APending Publication Date: 2025-04-25BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311393876.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-10-25
Publication Date
2025-04-25

AI Technical Summary

Technical Problem

Existing video projection technologies have problems such as poor real-time, poor compatibility and poor connection stability, especially DLNA service compatibility issues between different devices, resulting in unstable projection connections.

Method used

By starting the projection control service when a video projection operation is detected, the target window displays device information, selects the target device, and casts the video to the target device by establishing a transmission channel. This method unifies the projection interfaces of different video applications and avoids compatibility issues between devices.

Benefits of technology

It improves the convenience and stability of video projection, ensures the real-time transmission of video content, and improves the user's viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119893192A_ABST
    Figure CN119893192A_ABST
Patent Text Reader

Abstract

The invention relates to a video processing method and device, electronic equipment and a storage medium, and the method comprises the steps: starting a projection control service of first equipment under the condition that a video projection operation for any video application in the first equipment is detected; creating a target window corresponding to the projection control service; under the condition that the transmission channels between the second devices which are located in the same local area network with the first device are successfully established, displaying device information of the second devices through the target window; determining a target device from each second device based on a selection operation for the device information; and projecting a video to be projected to the target equipment through the transmission channel corresponding to the target equipment. Due to unification of video projection entrances, the compatibility problem of different projection services at the two ends of the equipment does not need to be considered, and the convenience of video projection and the stability of the projection process are greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of communications, and in particular to a video processing method, device, electronic device and storage medium. Background Art

[0002] In recent years, with the rapid development of mobile Internet and the widespread popularity of smart terminal devices, people's use of video projection has grown exponentially. Video projection is the sharing and interconnection of videos between different PCs, mobile devices, and consumer appliances.

[0003] Traditional video projection technologies include DLNA (Digital Living Network Alliance) technology. However, in order to provide a better playback experience, DLNA technology usually buffers for a short period of time before transmitting data, so DLNA technology is not real-time transmission. In addition, different video apps have their own DLNA services, and different devices also have their own DLNA services, and there are certain compatibility issues between the two. When projecting a video, both ends of the device (such as the mobile phone and the TV) need to install the corresponding video app to achieve a better projection effect and viewing experience. When one end of the device (such as the TV) does not install the corresponding video app, due to compatibility issues between different DLNA services, the connection stability between the two devices is prone to poor. Summary of the invention

[0004] The present disclosure provides a video processing method, device, electronic device and storage medium to overcome the problems of poor real-time performance, poor compatibility and poor connection stability in the video projection process.

[0005] According to a first aspect of an embodiment of the present disclosure, a video processing method is provided, including:

[0006] When a video projection operation for any video application in the first device is detected, starting a projection control service of the first device;

[0007] Creating a target window corresponding to the projection control service;

[0008] In case that a transmission channel is successfully established between each second device in the same local area network as the first device, displaying device information of each second device through the target window;

[0009] Determining a target device from each of the second devices based on a selection operation on the device information;

[0010] The video to be projected is projected to the target device through the transmission channel corresponding to the target device.

[0011] In some embodiments, the video processing method further includes:

[0012] When the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video status of the video to be projected; and / or

[0013] Based on the projection status of the video to be projected, the display content in the target window is updated.

[0014] In some embodiments, when the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video status of the video to be projected includes:

[0015] When the video to be projected is successfully projected to the target device, the target window displays adjustment controls;

[0016] Based on the adjustment operation on the adjustment control, the playback parameters of the to-be-projected video played by the target device are adjusted, and based on the adjusted video state of the to-be-projected video, the display content in the target window is updated.

[0017] In some embodiments, based on the projection state of the video to be projected, updating the display content in the target window includes:

[0018] During the projection process of the video to be projected, displaying a projection icon corresponding to the target device information in the target window according to a first display effect;

[0019] When the video to be projected is successfully projected to the target device, updating the projection icon corresponding to the target device information from the first display effect to the second display effect;

[0020] The first display effect is different from the second display effect.

[0021] In some embodiments, the video processing method further includes:

[0022] Obtaining the layer position relationship between the target window and each application window;

[0023] According to the layer position relationship, the layers of the target window and / or the application window are adjusted so that the target window is located at a set layer.

[0024] In some embodiments, the video processing method further includes:

[0025] Scanning each second device in the same local area network as the first device;

[0026] Sending the key generated by the first device to each of the second devices respectively through a soft bus;

[0027] Based on the key and a preset hash verification algorithm, respectively authenticate with each of the second devices;

[0028] In case the authentication is successful, the transmission channel is established with the second device which has been successfully authenticated.

[0029] In some embodiments, projecting the video to be projected to the target device through the transmission channel corresponding to the target device includes:

[0030] Converting the video data of the video to be projected into a preset data frame format to obtain projection data;

[0031] Encrypting the projection data based on a pre-stored key to obtain encrypted data;

[0032] The encrypted data is transmitted to the target device through the transmission channel corresponding to the target device.

[0033] In some embodiments, the video processing method further includes:

[0034] When a video application switching operation acting on the target window is detected, switching the currently projected first video application to a second video application;

[0035] The video to be projected of the second video application is projected to the target device through the transmission channel corresponding to the target device.

[0036] According to a second aspect of an embodiment of the present disclosure, there is provided a video processing device, including:

[0037] A starting module, configured to start a projection control service of the first device when a video projection operation for any video application in the first device is detected;

[0038] A creation module configured to create a target window corresponding to the projection control service;

[0039] A display module, configured to display device information of each second device in the target window when a transmission channel between each second device in the same local area network as the first device is successfully established;

[0040] a determination module, configured to determine a target device from each of the second devices based on a selection operation on the device information;

[0041] The projection module is configured to project the video to be projected to the target device through the transmission channel corresponding to the target device.

[0042] In some embodiments, the video processing device further includes: an update module;

[0043] The update module is configured as follows:

[0044] When the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video status of the video to be projected; and / or,

[0045] Based on the projection status of the video to be projected, the display content in the target window is updated.

[0046] In some embodiments, the update module is further configured to:

[0047] When the video to be projected is successfully projected to the target device, the target window displays adjustment controls;

[0048] Based on the adjustment operation on the adjustment control, the playback parameters of the to-be-projected video played by the target device are adjusted, and based on the adjusted video state of the to-be-projected video, the display content in the target window is updated.

[0049] In some embodiments, the update module is further configured to:

[0050] During the projection process of the video to be projected, displaying a projection icon corresponding to the target device information in the target window according to a first display effect;

[0051] When the video to be projected is successfully projected to the target device, updating the projection icon corresponding to the target device information from the first display effect to the second display effect;

[0052] The first display effect is different from the second display effect.

[0053] In some embodiments, the update module is further configured to:

[0054] Obtaining the layer position relationship between the target window and each application window;

[0055] According to the layer position relationship, the layers of the target window and / or the application window are adjusted so that the target window is located at a set layer.

[0056] In some embodiments, the creation module is further configured to:

[0057] Scanning each second device in the same local area network as the first device;

[0058] Sending the key generated by the first device to each of the second devices respectively through a soft bus;

[0059] Based on the key and a preset hash verification algorithm, respectively authenticate with each of the second devices;

[0060] In case the authentication is successful, the transmission channel is established with the second device which has been successfully authenticated.

[0061] In some embodiments, the projection module is further configured to:

[0062] Converting the video data of the video to be projected into a preset data frame format to obtain projection data;

[0063] Encrypting the projection data based on a pre-stored key to obtain encrypted data;

[0064] The encrypted data is transmitted to the target device through the transmission channel corresponding to the target device.

[0065] In some embodiments, the update module is further configured to:

[0066] When a video application switching operation acting on the target window is detected, switching the currently projected first video application to a second video application;

[0067] The video to be projected of the second video application is projected to the target device through the transmission channel corresponding to the target device.

[0068] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0069] processor;

[0070] a memory configured to store processor-executable instructions;

[0071] Wherein, the processor is configured to execute the video processing method described in the first aspect above when calling the executable instructions in the memory.

[0072] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the video processing method described in the first aspect above.

[0073] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0074] The video processing method disclosed in the present invention starts the projection control service of the first device based on the video projection operation for any video application in the first device, creates a target window corresponding to the projection control service based on the start of the projection control service, and displays the device information of each second device through the target window when the transmission channel between each second device in the same local area network as the first device is successfully established. Based on the selection operation for the device information, the target device is determined from each second device, and the video to be projected is projected to the target device through the transmission channel corresponding to the target device. The present invention unifies the video projection services of multiple different video applications into the projection control service in the first device. Due to the unification of the video projection entrance, there is no need to consider the compatibility issues of different projection services at both ends of the device, which greatly improves the convenience of video projection and the stability of the projection process. In addition, the present invention performs video projection based on local area network technology, which ensures the real-time transmission of video content and improves the user's viewing experience.

[0075] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0076] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0077] Figure 1 The figure is a flowchart of a video processing method according to an exemplary embodiment.

[0078] Figure 2 is a schematic diagram of an interface of a target window of a projection control service according to an exemplary embodiment Figure 1 .

[0079] Figure 3 is a schematic diagram of an interface of a target window of a projection control service according to an exemplary embodiment Figure 2 .

[0080] Figure 4 is a flow chart of a video processing method according to an exemplary embodiment. Figure 2 .

[0081] Figure 5 The figure is a schematic diagram showing the structure of each module in the video processing process between a mobile phone and a television according to an exemplary embodiment.

[0082] Figure 6 is a schematic diagram of the structure of a video processing device according to an exemplary embodiment Figure 1 .

[0083] Figure 7is a schematic diagram of the structure of a video processing device according to an exemplary embodiment Figure 2 .

[0084] Figure 8 The diagram is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0085] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0086] In the specification, unless otherwise clearly stated, the terms "first" and "second" are used only to describe and distinguish constituent elements, and should not be understood as indicating an order. Unless otherwise clearly stated, the terms "connected", "fixed", etc. should be understood as having a broad meaning, including but not limited to directly, indirectly, detachably "connected", "fixed", etc.

[0087] Figure 1 The following is a flow chart of a video processing method according to an exemplary embodiment. Figure 1 ,like Figure 1 As shown, the method mainly includes the following steps:

[0088] In step 101, when a video projection operation for any video application in a first device is detected, a projection control service of the first device is started.

[0089] In this embodiment, the first device is a device that projects the video to be projected to the other end, such as a mobile phone, a tablet, a smart watch, a smart wearable device, etc. There can be multiple video applications in the first device at the same time, such as iQiyi Video APP, Youku Video APP, Tencent Video APP, etc. When a video projection operation for any video application in the first device is detected, the projection control service in the first device is started. The projection control service in the first device can integrate and unify the projection interfaces of different video applications, and after the projection requirements of different video applications are processed by the projection control service, projection is performed with the other end.

[0090] It is understandable that, taking the video projection between mobile phones and TVs as an example, if you want to project a video from the iQiyi APP on your mobile phone to the TV, the iQiyi APP must also be installed on the TV. If the user needs to project different video APPs, all the user's commonly used video APPs must be installed on the TV to complete the video projection between the mobile phone and the TV. If the corresponding video APP is not installed on the TV, the video projection service of the TV itself and the video projection service of the video APP on the mobile phone are prone to unstable projection connection between the mobile phone and the TV due to service compatibility issues, and problems may occur during the projection process.

[0091] Then, in this embodiment, when a video projection operation of any video application is detected, the projection control service in the first device is started, and the projection control service interacts and communicates with the video application to be projected to perform subsequent projection steps.

[0092] The video projection operations of different video applications may be the same or different. Specifically, the video projection operation may be a touch operation such as clicking, long pressing, sliding, etc. for the video application, or an air gesture operation for the first device or the video application, or a preset key operation for the power button, volume button, etc. Of course, when the first device is connected to a wired headset or a wireless headset, the video projection operation may also be a preset key operation for the keys of the wired headset or the wireless headset.

[0093] In step 102, a target window corresponding to the projection control service is created.

[0094] In this embodiment, the target window is a window for the user to interact with the projection control service to control the projection process. Once the projection control service in the first device is started, it triggers the creation of the target window and displays it on the display screen of the first device. The target window of the projection control service can be consistent with the interface size of the display screen of the first device, that is, the target window covers the entire interface, or it can be smaller than the interface size of the display screen of the first device. The size, position, and shape of the target window can be adjusted and set according to the size, shape, and user usage habits of the first device.

[0095] In step 103, when the transmission channel between each second device in the same local area network as the first device is successfully established, the device information of each second device is displayed through the target window.

[0096] In this embodiment, once the target window of the projection control service is successfully created, or once the target window is displayed on the display screen of the first device, the first device is triggered to establish a transmission channel between each second device in the same local area network, and then the device information (such as device name, device IP address, etc.) of each second device that successfully establishes the transmission channel is displayed in the target window. It should be noted that there may be multiple second devices in the same local area network as the first device, and among these multiple second devices, due to factors such as changes in network conditions, whether the device is trustworthy, changes in the current location of the device, etc., not all second devices can successfully establish a transmission channel with the first device. Therefore, only the device information that successfully establishes the transmission channel is displayed in the target window.

[0097] If there are multiple second devices that have successfully established a transmission channel with the first device, when switching between devices for projection, the user can switch without any perception or delay because the transmission channel has been established in advance. Of course, in order to reduce device power consumption, when there is no interaction with a second device for a long time, the transmission channel connection with the second device is cut off.

[0098] In step 104, based on the selection operation on the device information, a target device is determined from various second devices.

[0099] In this embodiment, a selection operation is performed on the area in the target window displaying device information to determine the target device for projection. The selection operation may be any one or more combinations of touch operation, air gesture operation, key operation, etc.

[0100] In step 105, the video to be projected is projected to the target device via a transmission channel corresponding to the target device.

[0101] In this embodiment, the target device may be a mobile phone, a tablet, a television, a smart wearable device, or the like, which is a device that can receive and play the video to be projected.

[0102] The present disclosure unifies the projection interfaces of different video applications into a projection control service in a first device, completes the projection of a target device through the operation of the projection control service and local area network transmission, and controls the video to be projected played by the target device through the projection control service. The entire method improves the flexibility and convenience of video projection, ensures the speed of video transmission, and improves the user's viewing experience.

[0103] In some embodiments, the video processing method further includes: when the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video status of the video to be projected; and / or, updating the display content in the target window based on the projection status of the video to be projected.

[0104] In this embodiment, the target window of the projection control service can not only control the projection process, but also display the current projection status to the user through the target window, and control and display the playback process of the target device.

[0105] It should be noted that controlling the projection process and the playback process through the target window of the projection control service is not necessarily successful. Due to various factors such as changes in network conditions, changes in the current position of the first device, changes in the current position of the target device, problems in data processing of the target device, etc., the projection control and playback control of the target device by the first device may not meet expectations. Therefore, the target window of the first device needs to update the target window display content according to the current projection status and current video status of the target device.

[0106] For example, when the projection is successful, the area in the target window indicating the projection status is the first display effect; when the projection is unsuccessful, the area in the target window indicating the projection status is the second display effect; during the projection process, the area indicating the projection status is the third display effect.

[0107] For example, when the video to be projected is playing, the area in the target window indicating the video status is the first display effect. When the video to be projected is paused, the area in the target window indicating the video status is the second display effect. When the video to be projected is fast-forwarded to a certain video frame position, the area in the target window indicating the video progress bar is changed accordingly. When the video to be projected is not fast-forwarded successfully and returns to the original video playback position, the area in the target window indicating the video progress bar is also changed accordingly.

[0108] In one embodiment, based on the projection status of the video to be projected, the display content in the target window is updated, including: during the projection process of the video to be projected, displaying the projection icon corresponding to the target device information in the target window according to the first display effect; when the video to be projected is successfully projected to the target device, updating the projection icon corresponding to the target device information from the first display effect to the second display effect; wherein the first display effect is different from the second display effect.

[0109] like Figure 2 , Figure 3 As shown, taking the target device as the Xiaomi TV in the living room, the first display effect as a spinning arrow, and the second display effect as a check mark as an example, in the process of determining the target device based on the selection operation and transmitting the video to be projected to the target device, the projection icon corresponding to the target device information in the target window is a spinning arrow. When the projection is successful, the projection icon corresponding to the target device information is changed from a spinning arrow to a check mark.

[0110] In addition, the target window can also display the video information of the video to be projected, including: video cover, video name, number of episodes played, etc. The video information in the target window changes with the change of the video to be projected.

[0111] In one embodiment, updating the display content in the target window based on the video status of the video to be projected includes: when the video to be projected is successfully projected to the target device, displaying an adjustment control in the target window; adjusting the playback parameters of the video to be projected on the target device based on an adjustment operation on the adjustment control, and updating the display content in the target window based on the adjusted video status of the video to be projected.

[0112] like Figure 3 As shown, when the video to be projected is successfully projected to the target device, the target window displays newly added adjustment controls, which may include: speed control, fast forward control, fast rewind control, remote control control, volume control, progress bar control, cut set control, etc. Due to the limitation of the target window size, other function controls that cannot be displayed in the target window can be integrated into the remote control control. After the remote control control is expanded, a control window with a size smaller than the target window can be created in the current interface, and all other function controls are displayed in the control window.

[0113] When the first device detects an adjustment operation on the adjustment control, the first device sends an adjustment instruction corresponding to the adjustment operation to the target device through the transmission channel. The target device adjusts the playback parameters of the video to be projected based on the adjustment instruction, and then the target device updates the display content in the target window based on the adjusted video state of the video to be projected.

[0114] For example: when an adjustment operation is performed on the progress bar control (dragging the current playback position forward to a certain position on the progress bar), when the target device receives the adjustment instruction corresponding to the adjustment operation, the playback progress of the video to be projected is adjusted forward to the corresponding position. However, due to the poor network status, the video playback is stuck and the playback progress is not adjusted to the corresponding progress. At this time, the target device will feedback an adjustment failure message to the first device. Based on the adjustment failure message, the first device returns the display position of the progress bar in the target window to the original playback position. Of course, if the adjustment is successful, the display position of the progress bar in the target window is at the position specified by the adjustment operation. In other words, the display effect of all content in the target window is consistent with the current status of the video to be projected on the target device.

[0115] certainly, Figure 2 and Figure 3, and the display content, layout, display effect, etc. in the target window described above are only one of the embodiments of the present disclosure, and can be adjusted according to user usage habits, achievable effects of the first device, etc. Additionally, multiple display templates of the target window can be pre-stored in the first device. The display content, layout, and display effect of different display templates are different. According to the user's selection operation of the display template, the target window is created and displayed according to the effect of the display template.

[0116] In some embodiments, the video processing method further includes: obtaining the layer position relationship between the target window and each application window; adjusting the layers of the target window and / or the application window according to the layer position relationship so that the target window is located in a set layer.

[0117] Specifically, the layer position relationship can be a preset fixed position relationship or a position relationship that is updated in real time according to a preset rule. For example: the layer position relationship can be that the target window is always located on the top layer, or a layer position relationship determined based on the usage time of the target window and each application window. For example: application A is used at time T1, the projection control service is used at time T2, and application B is used at time T3, where T1 < T2 < T3. Then at the current moment, the window of application B is located on the top layer, the target window of the projection control service is located below the window of application B, and the window of application A is located below the target window.

[0118] In the embodiments of the present disclosure, the layer where the target window is located can be adaptively adjusted, which can ensure video transmission without affecting the user's use of the first device.

[0119] In one embodiment, the video processing method further includes: scanning each second device in the same local area network as the first device; sending the keys generated by the first device to each second device through the soft bus; performing authentication with each second device respectively based on the keys and a preset hash verification algorithm; establishing a transmission channel with the second device that passes the authentication in case of successful authentication.

[0120] In this embodiment, the first device periodically or in real time scans the second device in the same local area network through a local area network scanning technology (such as: wifi mdns scanning), and sends the key randomly generated by the first device to each second device through a soft bus. Among them, the soft bus plays the same role as the computer system bus hardware bus (referred to as hard bus) in the computer system. The soft bus acts as a connecting bridge like the hard bus and is used to transmit information. Unlike the hard bus, the soft bus does not transmit information through a fixed number of lines and 0, 1 signals, but uses a set of programs to establish connections between various processes and software functions through a buffer. In other words, this embodiment can achieve efficient interconnection and intercommunication between different devices through a soft bus (a virtual bus). However, in the process of using the soft bus to transmit data, its resource overhead is large. Therefore, after the first device and the second device are successfully authenticated, a transmission channel (such as: TCP long connection) with the second device is established, and the transmission of the video to be projected is achieved through a special transmission channel.

[0121] During the two-end authentication process, the first device processes the key based on a preset hash verification algorithm to obtain the first hash value of the key. Each second device similarly processes the received key to obtain multiple second hash values, and matches the first hash value with the multiple second hash values ​​respectively. If the two match successfully, the authentication is successful.

[0122] In some embodiments, Figure 4 As shown, step 105 includes:

[0123] In step 1051, the video data of the video to be projected is converted into a preset data frame format to obtain projection data.

[0124] In step 1052, the projection data is encrypted based on a pre-stored key to obtain encrypted data.

[0125] In step 1053, the encrypted data is transmitted to the target device through a transmission channel corresponding to the target device.

[0126] In this embodiment, the preset data frame format may include: data header (frame 1), control instruction (frames 2-3), and control content (frames 4-5). The video data is encapsulated and processed according to the preset data frame format to obtain projection data. Since the data frame format only occupies a few bytes, the transmission speed is faster than that of the traditional DLNA solution using XML files for transmission. Then, the projection data is encrypted using a preset encryption algorithm (such as the AES encryption algorithm in symmetric encryption) and a key to obtain encrypted data, and the encrypted data is transmitted to the target device, thereby ensuring the security of video transmission.

[0127] In some embodiments, the video processing method also includes: when a video application switching operation acting on the target window is detected, switching the currently projected first video application to a second video application; and projecting the video to be projected of the second video application to the target device through a transmission channel corresponding to the target device.

[0128] In this embodiment, the target window also includes: an application switching control, when a video application switching operation acting on the target window is detected, the currently projected first video application is switched to the second video application, and the video to be projected of the second video application is projected to the target device. Of course, from a microscopic perspective, the switching process, the first device needs to first send a projection stop message to the target device, then stop the transmission of the video to be projected of the first video application, and finally transmit the video to be projected of the second video application to the target device.

[0129] like Figure 5 The figure shows the structure of each module in the video processing process between the mobile phone and the TV. The mobile phone includes: video APP, first projection control service, first session management service; the TV includes: system player, second projection control service, second session management service.

[0130] When the video APP on the mobile phone is playing the video to be projected, it will first initialize the first projection control service, then start the projection control service based on the video projection operation (such as: pull down the notification bar to start the projection control service) and create a target window (such as: projection control card). At this time, the target window floats above the video APP interface and displays the video cover, progress, and name. When switching the video to be played, the target window will update the cover, progress, name, etc. in real time, and the video playback of the video APP can be controlled in real time through the play control button in the target window.

[0131] When the target window is displayed, the low-power WiFi mdns LAN scanning technology is triggered to periodically or in real time scan the second device in the LAN, and the randomly generated key is encrypted and transmitted to the second device through the soft bus. After the two-end authentication is successful, a safe and reliable channel is established. A device list is generated for the second device that successfully establishes the transmission channel. The user selects the TV to initiate video projection. After the video projection is successful, the target window will display the speed, remote control, episode switching and other controls. The video APP will display the screen projection control panel.

[0132] When the TV successfully receives and plays the video to be projected, the system player in the TV will send a projection success message to the mobile phone, and the mobile phone will update the display content in the target window based on the projection success message. In addition, when the TV receives an instruction to adjust the video status, the system player will adjust the status of the currently playing video and feed back the adjustment result to the mobile phone.

[0133] Figure 6 A video processing device is shown according to an exemplary embodiment. Figure 6 As shown, the device comprises:

[0134] A starting module 601 is configured to start a projection control service of the first device when a video projection operation for any video application in the first device is detected;

[0135] A creation module 602, configured to create a target window corresponding to the projection control service;

[0136] The display module 603 is configured to display device information of each second device in the target window when a transmission channel between each second device in the same local area network as the first device is successfully established;

[0137] A determination module 604 is configured to determine a target device from each of the second devices based on a selection operation on the device information;

[0138] The projection module 605 is configured to project the video to be projected to the target device through the transmission channel corresponding to the target device.

[0139] In some embodiments, Figure 7 As shown, the video processing device further includes: an updating module 606;

[0140] The updating module 606 is configured as follows:

[0141] When the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video status of the video to be projected; and / or,

[0142] Based on the projection status of the video to be projected, the display content in the target window is updated.

[0143] In some embodiments, the update module 606 is further configured to:

[0144] When the video to be projected is successfully projected to the target device, the target window displays adjustment controls;

[0145] Based on the adjustment operation on the adjustment control, the playback parameters of the to-be-projected video played by the target device are adjusted, and based on the adjusted video state of the to-be-projected video, the display content in the target window is updated.

[0146] In some embodiments, the update module 606 is further configured to:

[0147] During the projection process of the video to be projected, displaying a projection icon corresponding to the target device information in the target window according to a first display effect;

[0148] When the video to be projected is successfully projected to the target device, updating the projection icon corresponding to the target device information from the first display effect to the second display effect;

[0149] The first display effect is different from the second display effect.

[0150] In some embodiments, the update module 606 is further configured to:

[0151] Obtaining the layer position relationship between the target window and each application window;

[0152] According to the layer position relationship, the layers of the target window and / or the application window are adjusted so that the target window is located at a set layer.

[0153] In some embodiments, the creation module 602 is further configured to:

[0154] Scanning each second device in the same local area network as the first device;

[0155] Sending the key generated by the first device to each of the second devices respectively through a soft bus;

[0156] Based on the key and a preset hash verification algorithm, respectively authenticate with each of the second devices;

[0157] In case the authentication is successful, the transmission channel is established with the second device which has been successfully authenticated.

[0158] In some embodiments, the projection module 605 is further configured to:

[0159] Converting the video data of the video to be projected into a preset data frame format to obtain projection data;

[0160] Encrypting the projection data based on a pre-stored key to obtain encrypted data;

[0161] The encrypted data is transmitted to the target device through the transmission channel corresponding to the target device.

[0162] In some embodiments, the update module 606 is further configured to:

[0163] When a video application switching operation acting on the target window is detected, switching the currently projected first video application to a second video application;

[0164] The video to be projected of the second video application is projected to the target device through the transmission channel corresponding to the target device.

[0165] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0166] like Figure 8 As shown, the embodiment of the present disclosure further provides an electronic device 700, including:

[0167] Memory 704 for storing processor executable instructions;

[0168] A processor 720 connected to the memory 704;

[0169] The processor 720 is configured to execute the video processing method provided by any of the aforementioned technical solutions.

[0170] A block diagram of an electronic device 700 is shown according to an exemplary embodiment. For example, the electronic device 700 may be a smart phone, a tablet computer, a notebook computer, a portable learning machine, and the like.

[0171] refer to Figure 8 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 718 .

[0172] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0173] The memory 704 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0174] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0175] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0176] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 718. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0177] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0178] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 800, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0179] The communication component 718 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 718 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 718 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0180] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0181] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0182] An embodiment of the present application provides a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by a processor of a computer, the computer can execute the video processing method described in one or more of the aforementioned technical solutions.

[0183] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0184] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A video processing method, characterized in that: include: When a video projection operation for any video application in the first device is detected, starting a projection control service of the first device; Creating a target window corresponding to the projection control service; In case that a transmission channel is successfully established between each second device in the same local area network as the first device, displaying device information of each second device through the target window; Determining a target device from each of the second devices based on a selection operation on the device information; The video to be projected is projected to the target device through the transmission channel corresponding to the target device.

2. The video processing method according to claim 1, characterized in that: The method further comprises: When the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video status of the video to be projected; and / or, Based on the projection status of the video to be projected, the display content in the target window is updated.

3. The video processing method according to claim 2, characterized in that: When the video to be projected is successfully projected to the target device, updating the display content in the target window based on the video state of the video to be projected includes: When the video to be projected is successfully projected to the target device, the target window displays adjustment controls; Based on the adjustment operation on the adjustment control, the playback parameters of the to-be-projected video played by the target device are adjusted, and based on the adjusted video state of the to-be-projected video, the display content in the target window is updated.

4. The video processing method according to claim 2, characterized in that: Based on the projection state of the video to be projected, updating the display content in the target window includes: During the projection process of the video to be projected, displaying a projection icon corresponding to the target device information in the target window according to a first display effect; When the video to be projected is successfully projected to the target device, updating the projection icon corresponding to the target device information from the first display effect to the second display effect; The first display effect is different from the second display effect.

5. The video processing method according to claim 1, characterized in that: The method further comprises: Obtaining the layer position relationship between the target window and each application window; According to the layer position relationship, the layers of the target window and / or the application window are adjusted so that the target window is located at a set layer.

6. The video processing method according to claim 1, characterized in that: The method further comprises: Scanning each second device in the same local area network as the first device; Sending the key generated by the first device to each of the second devices respectively through a soft bus; Based on the key and a preset hash verification algorithm, respectively authenticate with each of the second devices; In case the authentication is successful, the transmission channel is established with the second device which has been successfully authenticated.

7. The video processing method according to any one of claims 1 to 6, characterized in that: The step of projecting the video to be projected to the target device through the transmission channel corresponding to the target device includes: Converting the video data of the video to be projected into a preset data frame format to obtain projection data; Encrypting the projection data based on a pre-stored key to obtain encrypted data; The encrypted data is transmitted to the target device through the transmission channel corresponding to the target device.

8. The video processing method according to claim 1, characterized in that: The method further comprises: When a video application switching operation acting on the target window is detected, switching the currently projected first video application to a second video application; The video to be projected of the second video application is projected to the target device through the transmission channel corresponding to the target device.

9. A video processing device, characterized in that: include: A starting module, configured to start a projection control service of the first device when a video projection operation for any video application in the first device is detected; A creation module, configured to create a target window corresponding to the projection control service; A display module, configured to display device information of each second device in the target window when a transmission channel between each second device in the same local area network as the first device is successfully established; a determination module, configured to determine a target device from each of the second devices based on a selection operation on the device information; The projection module is configured to project the video to be projected to the target device through the transmission channel corresponding to the target device.

10. An electronic device, characterized in that: include: processor; a memory configured to store processor-executable instructions; The processor is configured to execute the video processing method according to any one of claims 1 to 8 when calling the executable instructions in the memory.

11. A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the video processing method according to any one of claims 1 to 8.