Cross-end video processing method and device

Abstract

The embodiment of the invention provides a cross-end video processing method and device, computer equipment, a computer readable storage medium and a computer program product, and belongs to the technical field of video processing. The cross-terminal video processing method comprises the following steps: acquiring a video stream output by a second terminal based on a screen projection mode, wherein a first terminal has video processing performance higher than that of the second terminal; accessing the video stream to a unified access layer, and allowing a unified decoding layer to read target format data processed by the unified access layer; decoding the read target format data through a unified decoding layer to obtain a video frame; performing target video enhancement processing on the video frame to obtain an enhanced video frame; and outputting the enhanced video frame. According to the invention, decoupling of the video processing logic and the transmission protocol can be realized, the universality of cross-end video processing is improved, the video processing time is reduced, the transmission delay of the live broadcast picture is reduced, and then high-quality and low-delay video output is realized.

Description

Technical Field

[0001] This application relates to the field of video processing technology, and in particular to a cross-platform video processing method, apparatus, computer device, computer-readable storage medium, and computer program product. Background Technology

[0002] In live streaming scenarios, after the mobile terminal preprocesses the video data (such as adding beauty filters and stickers), it can output the video to the PC via USB, ADB, MTP, or screen mirroring. After receiving the preprocessed video data, the PC can extract the decoded video stream by parsing the protocol, and then perform decoding to display the video from the mobile terminal.

[0003] However, prolonged video preprocessing on mobile devices can lead to overheating and lower output video frame rates. Different systems (such as Android and iOS) and transmission methods use significantly different protocol types, and the process of connecting video to a PC is tightly coupled with specific protocols, resulting in poor universality. Video data is encapsulated in a multi-layered protocol structure, requiring additional decapsulation and other processing to obtain a decodeable encoded video stream, which is time-consuming and leads to high latency.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the Invention

[0005] This application provides a cross-platform video processing method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems mentioned above.

[0006] One aspect of this application provides a cross-platform video processing method applied to a live streaming program on a first terminal, the method comprising:

[0007] The video stream output by the second terminal is obtained based on the screen mirroring mode, and the first terminal has higher video processing performance than the second terminal. The video stream is connected to the unified access layer, and the target format data obtained after processing by the unified access layer is provided to the unified decoding layer for reading. The unified decoding layer decodes the read target format data to obtain video frames; The video frame is subjected to target video enhancement processing to obtain an enhanced video frame; and Output the enhanced video frame.

[0008] Optionally, the video stream output by the second terminal is obtained based on the screen mirroring mode, including: Determine the input method information for the second terminal's video input; Based on the input method information, a screen mirroring channel is established with the second terminal, and the video stream is received through the screen mirroring channel.

[0009] Optionally, the input method information is used to indicate the wireless input method; establishing a projection channel with the second terminal includes: under the wireless input method, creating a network socket and listening for connections based on a real-time streaming media transmission protocol to receive the video stream transmitted via the connection; and / or The input method information is used to indicate the wired iOS input method; establishing a screen mirroring channel with the second terminal includes: establishing a first USB channel via a USB bridging module to receive the video stream via the first USB channel; and / or The input method information is used to indicate the wired Android input method; establishing a screen mirroring channel with the second terminal includes: switching the second terminal to AOA mode to receive the video stream via the second USB channel.

[0010] Optionally, the target format data includes byte data corresponding to the video stream; providing the target format data obtained after processing by the unified access layer to the unified decoding layer includes: The unified access layer provides byte data of the video stream to the unified decoding layer, so that the unified decoding layer can perform video decoding processing based on the byte data; In the case where the video stream is received via the first USB channel or the second USB channel, the AVIO callback is configured through the AVIO custom interface, so that the unified decoding layer reads the byte data through the AVIO callback.

[0011] Optionally, the video frame is subjected to target video enhancement processing to obtain an enhanced video frame, including: The video frames are input to the graphics processor locally configured on the first terminal; The target video enhancement process is performed on the video frame by the graphics processor to obtain the enhanced video frame; The video stream is either a video without video enhancement processing or a video that has only undergone partial video enhancement processing; the target video enhancement processing includes skin smoothing, whitening, makeup processing, sticker processing, and / or filter processing.

[0012] Optionally, the live streaming program is configured with a live streaming plugin; wherein the live streaming plugin is internally used to perform target video enhancement processing on the video frames; Outputting the enhanced video frame includes: The enhanced video frames obtained by the live streaming plugin are directly written into the rendering pipeline of the live streaming program, so that the enhanced video frames can participate as video sources in the image rendering and output of the live streaming program.

[0013] Optionally, the first terminal is used to record video enhancement parameters corresponding to the video stream; The enhanced video frame is obtained by performing target video enhancement processing on the video frame, including: When switching scenes or video sources, the video enhancement parameters are updated based on the current live streaming scene or video source identifier. Based on the updated video enhancement parameters, the corresponding video enhancement operation is performed on the video frame to obtain the enhanced video frame.

[0014] Optionally, the video frame is subjected to target video enhancement processing to obtain an enhanced video frame, including: The video frame is processed based on the video enhancement parameters, frame rate parameters, and resolution parameters to obtain the enhanced video frame.

[0015] Optionally, the first terminal is a PC and the second terminal is a mobile phone.

[0016] Another aspect of this application provides a cross-platform video processing apparatus, the apparatus comprising: The acquisition module is used to acquire the video stream output by the second terminal based on the screen projection mode. The first terminal has higher video processing performance than the second terminal. The access module is used to access the video stream into the unified access layer and to provide the target format data obtained after processing by the unified access layer to the unified decoding layer for reading. The decoding module is used to decode the read target format data through the unified decoding layer to obtain video frames; An enhancement module is used to perform target video enhancement processing on the video frame to obtain an enhanced video frame; and The output module is used to output the enhanced video frames.

[0017] Another aspect of this application provides a computer device, including: At least one processor; and A memory that is communicatively connected to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method as described above.

[0018] Another aspect of this application provides a computer-readable storage medium storing computer instructions that, when executed by a processor, implement the method described above.

[0019] Another aspect of this application provides a computer program product including a computer program that, when executed by a processor, implements the method described above.

[0020] The embodiments of this application employing the above-described technical solution may have the following advantages: In live streaming scenarios, a first terminal with higher video processing capabilities handles the live streaming, while a second terminal with lower video processing capabilities serves as the video source. This creates a deeply integrated processing chain between the first and second terminals. Within this chain, the second terminal can focus solely on video capture, while the first terminal handles the backend video processing (video enhancement, etc.). This reduces the load on the second terminal, improves the quality of its output video stream, and leverages the first terminal's higher video processing capabilities to achieve high-resolution, high-frame-rate, and low-latency video output. Furthermore, the deep integration process uses a unified access layer to convert video streams from various sources into the target format, shielding the underlying protocol differences between Android, iOS, and other systems. The first terminal doesn't need to know the source of the video stream. This decouples video processing logic from the transmission protocol, improving the versatility of cross-platform video processing. Simultaneously, a unified decoding layer directly decodes the target format data, eliminating the need for additional de-encapsulation or other processing, thus reducing video processing time and lowering transmission latency for the live stream. Attached Figure Description

[0021] The accompanying drawings exemplify embodiments and form part of the specification, serving together with the textual description to explain exemplary implementations of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0022] Figure 1 The diagram illustrates the operating environment of the cross-platform video processing method according to Embodiment 1 of this application. Figure 2 A flowchart illustrating a cross-platform video processing method according to Embodiment 1 of this application is shown schematically. Figure 3 Schematic illustration Figure 2 Flowchart of the sub-steps in step S200; Figure 4 Schematic illustration Figure 2 Flowchart of the sub-steps in step S206; Figure 5 Schematic illustration Figure 2 Flowchart of another sub-step in step S206; Figure 6 The diagram illustrates a new flowchart of a cross-platform video processing method according to Embodiment 1 of this application; Figure 7 The illustration shows an example of an application of the cross-platform video processing method according to Embodiment 1 of this application; Figure 8 A block diagram of a cross-end video processing apparatus according to Embodiment 2 of this application is schematically shown; and Figure 9 A schematic diagram of the hardware architecture of a computer device according to Embodiment 3 of this application is shown. Detailed Implementation

[0023] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0024] It should be noted that the descriptions involving "first," "second," etc., in the embodiments of this application are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of that feature. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.

[0025] It should be noted that, in any stage of this application involving the collection, storage, use, transmission, and processing of data, each stage strictly adheres to the laws, regulations, industry standards, and regulatory requirements of the data source, usage location, and relevant countries and regions to ensure the legality and compliance of data activities. In the collection stage, the purpose, method, and scope of collection are clearly communicated to the data subject in a prominent manner. Collection is conducted only after obtaining the data subject's legal authorization, ensuring that the collection process follows the "minimum necessary" principle and does not exceed the scope of data collection. In the storage stage, storage periods are limited, and data is promptly deleted or anonymized / encrypted after the storage purpose is achieved. In the usage stage, a strict data security protection mechanism is implemented, using field-level desensitization technology and processing the original data according to preset desensitization rules. For different types of data, multiple desensitization strategies, such as data generalization, data anonymization, and data encryption, are employed to effectively mitigate the risk of sensitive information leakage and ensure that all data used is securely processed and desensitized, comprehensively protecting the rights and interests of data subjects and data security. In the transmission and processing stages, the confidentiality and security of data are ensured during transmission and processing.

[0026] In the description of this application, it should be understood that the numerical labels before the steps do not indicate the order of the steps, but are only used to facilitate the description of this application and to distinguish each step, and therefore should not be construed as a limitation of this application.

[0027] First, a definition of the terminology used in this application is provided: Streaming: Collecting audio and video data from clients (such as broadcast terminals and streaming terminals), encoding it, encapsulating it using a transmission protocol, and then transmitting it to the server.

[0028] Screen casting mode: The transmission behavior of the first terminal to obtain the screen capture results or video stream of the second terminal, including wireless screen casting mode, screen casting mode based on iOS wired protocol, and wired screen casting mode based on AOA protocol.

[0029] Native camera: The physical imaging components and underlying drivers built into the device, supporting underlying hardware capabilities including wide-angle acquisition, HDR (high dynamic range), hardware-level image stabilization, and hot switching between multiple cameras.

[0030] AOA protocol: A communication protocol used to establish a private data link over a USB wired channel to transmit video encoded streams.

[0031] USB bridging module: By encapsulating the underlying driver interface, it transforms the complex USB protocol stack into a stable data stream interface that the application layer can directly call.

[0032] Rendering pipeline: It can process raw video frame data through a series of processes and finally convert it into an image sequence that can be imaged on a display or encoded and streamed.

[0033] Secondly, to facilitate understanding of the technical solutions provided in the embodiments of this application by those skilled in the art, the relevant technologies are described below: In the live streaming industry, the inventors have discovered that PC-based streamers primarily rely on the following methods to acquire video feeds: 1. Using external professional cameras connected via USB or HDMI. While this method provides relatively stable video feeds, high-performance cameras and their associated capture equipment are expensive, hardware deployment is complex, and the imaging quality of specific hardware is limited, making it a high barrier to entry for ordinary streamers. 2. Using mobile screen mirroring or projection tools. Specifically, this can include screen mirroring tools based on the ADB protocol (such as scrcpy), wireless mirroring based on native system protocols (such as AirPlay or Miracast), and various third-party screen mirroring applications. However, wireless screen mirroring is highly susceptible to network fluctuations, leading to excessively high latency. Solutions based on system debugging protocols (such as ADB) are inefficient when handling high frame rates and high-quality live streams. They can only achieve image mirroring, and the image quality suffers significantly after multiple layers of encapsulation and compression. 3. Screen capture after local beautification overlay on the mobile device. This method requires full beautification, makeup, and AI effects processing to be completed within the mobile app before screen capture is performed on the PC. This approach forces mobile devices to bear a high load of AI computing power, which can easily lead to severe overheating, system throttling, and frame drops during long-term live streaming. Furthermore, because the video is processed pixel-by-pixel on the mobile device, PC-based live streaming tools cannot flexibly re-arrange video elements or deeply integrate them with the live stream layout.

[0034] Therefore, this application provides a cross-platform video processing technology solution. Thus, a cross-platform remote camera transmission system is needed that provides unified access, high stability, low latency, and supports high-performance secondary video processing on a PC. In this solution, the shortcomings of traditional PC camera sensors—small sensor size, weak light sensitivity, and low image quality ceiling—are overcome by deeply integrating the phone's native camera with PC-based live streaming software. By utilizing the mature processing capabilities of the phone, the PC can directly acquire high-definition video sources with HDR and portrait modes (supporting 1080P / 2K / 4K), achieving low-cost acquisition of professional-grade live streaming footage. High-load calculations such as beautification, makeup, and stickers, originally performed on the phone, are transferred to the PC's GPU. This resolves the contradictions caused by severe overheating, frame drops, and the inability of some devices to simultaneously handle beautification and streaming due to AI calculations on the phone. Utilizing the redundant computing power of the PC, this solution can stably output high-resolution, high-frame-rate (e.g., 1080P 60fps) enhanced images under low power consumption, significantly improving the stability of live streaming. A unified access layer is built on the PC side. By shielding the differences in underlying protocols such as AirPlay and AOA, a consistent cross-platform connection experience is achieved, significantly improving connection success rates and reducing user learning and deployment costs. A custom AVIO callback bypasses traditional high-latency debugging protocols like ADB and MTP, combined with a unified decoding link. This solves the problems of image stuttering and high transmission latency (>300ms) caused by traditional protocol encapsulation, compressing end-to-end latency to 50ms–200ms, ensuring real-time audio-visual synchronization during live streaming. By directly integrating secondary beautification processing within the live streaming plugin, data processing is directly written to the live streaming program's native rendering pipeline. This avoids the frequent GPU / CPU copying of data between middleware and live streaming software in existing technologies, greatly reducing resource waste and processing latency by building the shortest rendering link. Through unified hosting and cross-platform synchronization of beautification parameters, frame rate, and resolution on the PC, the problems of asynchronous parameter switching between mobile and PC live streaming scenes, parameter loss after camera cuts, or flickering are solved. At the same time, it decouples the video streams from different devices, ensuring that the PC can output consistent and stable video streams regardless of the phone's performance, thus achieving global control over the live stream quality. See below for details.

[0035] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0036] like Figure 1 As shown, the operating environment diagram includes: service platform 2, first terminal (streaming terminal) 4, and second terminal (front-facing camera terminal) 6.

[0037] Service platform 2 can provide live streaming services, which can be a single server, a server cluster, or a cloud computing service center.

[0038] The first terminal 4 is used to generate live streaming data in real time and to push the live streaming data. The live streaming data may include audio or video data from different electronic devices. It can also be used to enhance the video data. The first terminal can be an electronic device with strong video processing capabilities, such as a PC or tablet computer.

[0039] The second terminal 6 can be configured to establish a screen projection connection with the first terminal 4, and capture images using its own camera and provide them to the first terminal 4 in real time. In this embodiment, the second terminal 6 can be understood as a peripheral device of the first terminal 4.

[0040] The first terminal 4 and the service platform 2 can be connected via a network. Live data is pushed to the viewer's terminal through the service platform 2. The network can include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, and / or proxy devices. The network can include physical links, such as coaxial cable links, twisted-pair cable links, fiber optic links, and combinations thereof and / or the like. The network can include wireless links, such as cellular links, satellite links, Wi-Fi links, and / or the like.

[0041] It should be noted that the number of second terminals in the figure is merely illustrative and is not intended to limit the scope of patent protection of this application.

[0042] The technical solutions of this application are described below using a first terminal as the execution subject through multiple embodiments. It should be understood that these embodiments can be implemented in many different forms and should not be construed as being limited to the embodiments described herein.

[0043] Example 1 Figure 2 A flowchart illustrating a cross-platform video processing method according to Embodiment 1 of this application is shown schematically.

[0044] like Figure 2 As shown, the cross-platform video processing method may include steps S200~S208, wherein: Step S200: Obtain the video stream output by the second terminal based on the screen mirroring mode. The first terminal has higher video processing performance than the second terminal.

[0045] Step S202: The video stream is connected to the unified access layer, and the target format data obtained after processing by the unified access layer is provided to the unified decoding layer for reading.

[0046] Step S204: Decode the read target format data through the unified decoding layer to obtain video frames.

[0047] Step S206: Perform target video enhancement processing on the video frame to obtain an enhanced video frame.

[0048] Step S208: Output the enhanced video frame.

[0049] The cross-platform video processing method provided in this embodiment, in a live streaming scenario, uses a first terminal with higher video processing capabilities to handle the live streaming, while a second terminal with lower video processing capabilities serves as the video source. This allows the first and second terminals to collaborate and form a deeply integrated processing chain. In this chain, the second terminal can focus solely on video acquisition, while the backend video processing (video enhancement, etc.) is handled by the first terminal. This reduces the load on the second terminal, improves the quality of its output video stream, and leverages the first terminal's higher video processing capabilities to achieve high-resolution, high-frame-rate, and low-latency video output. Furthermore, the deep integrated processing chain uses a unified access layer to convert video streams from various sources into the target format, shielding the underlying protocol differences between Android, iOS, and other systems, eliminating the need for the first terminal to be concerned with the video stream's origin. This decouples the video processing logic from the transmission protocol, enhancing the versatility of cross-platform video processing. Simultaneously, by having a unified decoding layer directly decode the target format data without additional de-encapsulation or other processing, video processing time is reduced, lowering the transmission latency of the live stream.

[0050] The following combination Figure 2 The steps in steps S200 to S208, as well as other optional steps, are described in detail.

[0051] Step S200 The video stream output by the second terminal is obtained based on the screen mirroring mode, and the first terminal has higher video processing performance than the second terminal.

[0052] The screen mirroring mode can be used to transmit the currently output screen data of a second terminal to a first terminal. Specifically, screen mirroring modes can include wired and wireless implementations. Wired screen mirroring can transmit screen data captured by the second terminal to the first terminal via a USB interface. Wireless screen mirroring can transmit screen data captured by the second terminal to the first terminal via Wi-Fi, WebRTC, or dedicated screen mirroring protocols. It should be noted that this embodiment does not limit the specific screen mirroring method used, as long as the first terminal can obtain a continuous video stream reflecting the currently output screen of the second terminal. It should also be noted that besides Wi-Fi, other methods include WebRTC (Web Real-Time Communication), QUIC (Fast UDP Internet Connection Protocol), and RIST (Reliable Internet Stream Transport); besides USB, other methods include MFi (Made for iPhone), MTP (Media Transfer Protocol), UVC (USB Video Class), and NDI (Network Device Interface).

[0053] The first terminal can include terminal devices with strong computing capabilities, such as personal computers, game consoles, and set-top boxes, whose video processing performance is higher than that of the second terminal. Video processing performance can include processor computing power, graphics processing unit performance, memory bandwidth, and heat dissipation capabilities. Based on these performance advantages, after acquiring the video stream, the first terminal can perform more complex and higher-quality video processing operations on the video data, such as high-precision decoding, high-resolution rendering, multi-channel beautification algorithms, real-time filter overlay, or special effects processing.

[0054] The second terminal can be any mobile terminal or remote device with image acquisition capabilities, including but not limited to smartphones, smart wearable devices (such as smart glasses), action cameras, and SLR / mirrorless cameras. In this embodiment, the second terminal serves as a video acquisition device, enabling it to capture higher-quality video footage using a native camera.

[0055] In optional embodiments, such as Figure 3 As shown, step S200 may include: Step S300: Determine the input method information for the video input of the second terminal.

[0056] Step S302: Based on the input method information, establish a screen projection channel with the second terminal, and receive the video stream through the screen projection channel.

[0057] Input method information can be used to characterize the specific access method and corresponding protocol type used by the second terminal to output video data to the first terminal. This input method information may include the second terminal's system type (e.g., Android, iOS), screen mirroring method type (e.g., wired or wireless screen mirroring), supported screen mirroring protocol identifiers, connection interface type, and device identification information.

[0058] In practical applications, due to significant differences in video output and screen mirroring support methods across different systems and manufacturers, the video input methods for second terminals are not standardized. For example, iOS terminals can output video via wired connection or AirPlay-based screen mirroring. For Android terminals, different manufacturers use their own wired screen mirroring processes, lacking a unified video output standard. Therefore, by first determining the video input method information of the second terminal, the first terminal can clearly identify the source type of the currently accessing video stream and its corresponding transmission characteristics. After determining the input method information, the first terminal can select the corresponding screen mirroring channel establishment method based on the input method information to establish a screen mirroring channel with the second terminal for video data transmission.

[0059] In this embodiment, by first determining the input method information and then establishing the corresponding screen projection channel, unified management of multiple access methods is achieved. The first terminal can shield the differences in screen projection protocols between different systems and manufacturers, so that when users switch to a second terminal of a different brand or system, they do not need to configure different software plugins to achieve video access. This improves the versatility of cross-platform video processing and reduces the learning cost for users.

[0060] The following section will provide further examples of how to establish screen projection channels for different input methods.

[0061] In optional embodiments, several input methods are provided, as follows: Input method 1: The input method information is used to indicate the wireless input method; step S302 may include: under the wireless input method, creating a network socket and listening for connections based on the real-time streaming media transmission protocol to receive the video stream transmitted through the connection.

[0062] Input Method 2: The input method information is used to indicate the wired iOS input method; step S302 may include: establishing a first USB channel through a USB bridging module to receive the video stream via the first USB channel; and / or Input method 3: The input method information is used to indicate the wired Android input method; step S302 may include: switching the second terminal to AOA mode to receive the video stream via the second USB channel.

[0063] In practical applications, when the input method information indicates wireless input, the first terminal, after starting the live streaming program, can create a network socket locally and establish an RTMP listening service based on TCP to wait for the second terminal's video streaming connection. In a wireless network environment, the second terminal can encode the acquired video data and encapsulate it into a data stream in formats such as FLV, sending it to the first terminal via the RTMP protocol. After receiving the RTMP connection, the first terminal continuously reads video stream data from the network socket and uses the video stream data as an input source to access the unified access layer. In some embodiments, the first terminal can dynamically adjust the listening port, buffer size, or connection timeout based on network conditions to improve stability and success rate in wireless connection scenarios.

[0064] In practical applications, when the input method information indicates wired iOS input, the first terminal can establish a physical connection with the second terminal via a USB interface, and a USB bridging module (such as IOSBridge) can interface with the native communication protocol of the iOS system to establish a first USB channel. In some embodiments, the USB data reading process can also be buffered and rate controlled to avoid video frame discontinuity issues caused by USB transmission jitter.

[0065] In practical applications, when the input method information indicates wired Android input, the first terminal can send control commands to the second terminal to switch the second terminal to AOA (Android Open Accessory) mode. In AOA mode, the first terminal acts as the USB host, and the second terminal establishes communication with the first terminal as an accessory. Data exchange is based on the standard USB communication mechanism provided by AOA, thus enabling video data transmission between the second and first terminals without requiring the use of an ADB debug bridge. This eliminates the reliance on high-overhead, non-standard protocols such as the ADB debug bridge. The second terminal can encapsulate its encoded video data according to a preset protocol (proprietary transmission protocol) and transmit it to the first terminal via the second USB channel. The preset protocol performs simplified frame header verification and timing marking on the raw encoded data, ensuring data integrity and timing accuracy during high-speed transmission.

[0066] In this embodiment, the process for establishing projection channels corresponding to the three input methods is unified, thereby providing a directly callable "three-in-one" access interface to external systems. This further improves the versatility of cross-platform video processing.

[0067] Step S202 The video stream is connected to the unified access layer, and the target format data obtained after processing by the unified access layer is provided to the unified decoding layer for reading.

[0068] A unified access layer can be used to centrally access and standardize video streams from a second terminal, eliminating differences caused by different transmission methods, terminal systems, and underlying protocols. Specifically, the unified access layer can continuously acquire video stream data from the corresponding data source based on the type of the established projection channel. For example, in wireless input mode, the video stream can be received in data packet form via a network socket. In wired iOS input mode, the video stream can be read from a USB channel via a USB bridging module. In wired Android input mode, the video stream can be acquired through a USB channel established in AOA mode. Standardization processing may include stripping physical transmission protocol headers (e.g., RTMP encapsulation, USB protocol encapsulation, or AOA protocol header), performing data integrity verification, and reassembling video frames. In this embodiment, the unified access layer can take over video streams from different projection channels and shield the differences in video streams at the transmission layer, uniformly converting the video data into a target data format that can be directly read by the unified decoding layer.

[0069] The following will provide a further illustrative description of the specific methods by which the unified access layer processes data to obtain the target format through specific embodiments.

[0070] In an optional embodiment, the target format data includes byte data corresponding to the video stream; step S202 may include: The unified access layer provides byte data of the video stream to the unified decoding layer, so that the unified decoding layer can perform video decoding processing based on the byte data; In the case where the video stream is received via the first USB channel or the second USB channel, the AVIO callback is configured through the AVIO custom interface, so that the unified decoding layer reads the byte data through the AVIO callback.

[0071] Specifically, this embodiment configures an AVIO custom interface through the unified access layer, binding the byte data of the video stream to the AVIO callback function. This allows the unified decoding layer to read the byte data of the video stream provided by the unified access layer according to the input specification of the unified decoding layer during decoding processing. Therefore, the raw video stream data received from different channels does not need to be converted to file or network stream format; it can be adapted into input data that the unified decoding layer can directly read through the AVIO custom interface, thereby achieving unified access and decoding processing for video streams from multiple sources. The byte data of the video stream can be in the format of a continuous byte sequence.

[0072] In practical applications, when video streams are transmitted via USB channels (iOS USB or Android AOA USB), the unified access layer directly writes the raw encoded stream binary data into the buffer through the AVIO custom interface, and provides the byte data in the AVIOContext's read_packet callback. When performing decoding tasks, the unified decoding layer directly retrieves data from the buffer through the callback function, thus without needing to know the source and protocol type of the underlying data.

[0073] In this embodiment, through the AVIO custom interface and callbacks, the unified decoding layer reads byte data and therefore does not need to be concerned with the source of the video stream to perform decoding processing. This achieves stable, low-latency real-time video transmission.

[0074] Step S204 The unified decoding layer decodes the read target format data to obtain video frames.

[0075] The unified decoding layer can be a multimedia processing engine deployed in the live streaming program of the first terminal. The core components of the unified decoding layer can include software / hardware codec plugins built on multimedia frameworks (such as FFmpeg and LibVLC).

[0076] In practical applications, when the unified decoding layer receives the binary byte stream pushed by the unified access layer, it can automatically identify the video encoding format based on the header information of the bitstream and initialize the corresponding decoder plugin. The decoder plugin can continuously fetch byte data from the memory buffer through preset AVIO callbacks and restore it to the original video frames. To ensure the efficiency of subsequent beautification processing, the decoding output can be uniformly encapsulated as standard texture data or video frame structures (e.g., source_frame). In some embodiments, the frame buffer and memory access can be optimized during the decoding process, such as using multi-threaded parallel decoding, batch reading of byte data, or pre-allocation of frame buffers, thereby reducing latency and improving decoding efficiency.

[0077] Step S206The video frame is then subjected to target video enhancement processing to obtain an enhanced video frame.

[0078] In practical applications, image enhancement operations can be performed using local chips such as GPUs (Graphics Processing Units), CPUs (Central Processing Units), SIMD (Single Instruction, Multiple Data), and NPUs (Neural Processing Units). After receiving video frames output from the unified decoding layer, the first terminal can load them into a preset video enhancement algorithm pipeline for target video enhancement processing. In some embodiments, the first terminal can be equipped with a dedicated graphics card and a dedicated AI acceleration unit (e.g., Tensor Cores), enabling parallel execution of high-precision deep learning model inference. For example, during skin smoothing, the first terminal can employ more complex algorithms than the second terminal, or run neural networks with a high number of parameters, to achieve a smoother effect while preserving skin texture details.

[0079] The following will provide further illustrative examples of specific methods for obtaining enhanced video frames through more embodiments.

[0080] In optional embodiments, such as Figure 4 As shown, step S206 may include: Step S400: Input the video frame into the graphics processor locally configured on the first terminal.

[0081] Step S402: Perform target video enhancement processing on the video frame using the graphics processor to obtain the enhanced video frame.

[0082] The video stream is either a video without video enhancement processing or a video that has only undergone partial video enhancement processing; the target video enhancement processing includes skin smoothing, whitening, makeup processing, sticker processing, and / or filter processing.

[0083] In practical applications, after receiving standardized video frames (e.g., texture data encapsulated as source_frames) from the unified decoding layer, the first terminal can utilize the parallel computing architecture of its locally configured graphics processor to map the video frame data as texture objects into video memory. Since the video stream at this time is either the original video stream without video enhancement processing or a partially enhanced stream that has only undergone low-load preprocessing (e.g., basic exposure correction), the first terminal, with its higher video processing performance, will take over the subsequent computational tasks, thereby outputting higher-quality enhanced video frames.

[0084] In some embodiments, for target video enhancement processing such as skin smoothing, whitening, makeup, and stickers, the first terminal can call the locally integrated SDK interface or AI inference engine to achieve pixel-level real-time fine retouching. For example, high-precision AI image cutout (such as background replacement and virtual live streaming room construction) can be achieved through deep learning models, or complex AR pendants and 3D dynamic stickers can be accurately anchored to specific positions in video frames using AI facial key point recognition technology.

[0085] In this embodiment, the video frames are enhanced by a target video enhancement process performed on the local graphics processor of the first terminal, which has higher video processing performance. This further reduces the load on the second terminal, thereby improving the quality of the video captured by the second terminal. Furthermore, by utilizing the higher video processing capabilities of the first terminal, enhanced video frames with higher resolution, higher frame rate, and lower latency can be output.

[0086] In an optional embodiment, the first terminal is used to record video enhancement parameters corresponding to the video stream. For example... Figure 5 As shown, step S206 may further include: Step S500: When switching scenes or video sources, update the video enhancement parameters based on the current live scene or video source identifier.

[0087] Step S502: Based on the updated video enhancement parameters, perform corresponding video enhancement operations on the video frame to obtain the enhanced video frame.

[0088] In practical applications, video enhancement parameters can include skin smoothing intensity, face slimming ratio, whitening index, lookup table index for specific filters, sticker resource paths, and the on / off status of virtual reality effects. The first terminal can record multiple configurations under different live streaming modes (e.g., different scenes, different video sources) and automatically read and update video enhancement parameters based on the current live streaming scene identifier or video source identifier, thereby ensuring the processing effect in the new live streaming mode remains continuous and consistent with the previous live streaming mode. For example, when the broadcaster switches from "outdoor" to "indoor" or from "iOS wired source" to "Android wireless source," the first terminal can identify the current scene or video source identifier, retrieve the corresponding parameter values ​​from the local database, and execute the corresponding video enhancement operation in real time.

[0089] In this embodiment, video enhancement parameters are recorded and managed on the first terminal, and these parameters are automatically read and synchronized when switching scenes or video sources. This ensures that beauty filters, makeup effects, and other enhancements are continuously and stably applied during live streaming, regardless of scene or video source changes. This avoids flickering or loss of status due to parameter asynchrony, further improving user experience and video quality.

[0090] In optional embodiments, such as Figure 6 As shown, the enhanced video frame is obtained by performing target video enhancement processing on the video frame, including: Step S600: Process the video frame according to the video enhancement parameters, frame rate parameters, and resolution parameters to obtain the enhanced video frame.

[0091] In practical applications, different second terminals or second terminals under different states may have different resolutions and frame rates. For example, when the machine overheats, it may drop frames, interpolate frames, or perform resampling, resulting in a poor final video output experience. In this embodiment, the first terminal controls the enhanced video frames to be output according to preset frame rate and resolution parameters. The second terminal only needs to be responsible for acquiring the raw data; the complex frame rate control and high-resolution enhancement are all completed by the first terminal. Therefore, regardless of the model of the second terminal, it can output consistent, high-quality, and high-frame-rate enhanced video frames, achieving decoupling of video output quality from the second terminal.

[0092] Step S208 The enhanced video frame is then output.

[0093] In practical applications, the first terminal can convert texture data enhanced by the GPU into a frame structure highly compatible with live streaming components or system display components. Specifically, the first terminal can encapsulate the enhanced video frames in video memory into a unified video frame format and submit the enhanced video frame data to the video output module according to a preset output timing. For example, in a live streaming scenario, the enhanced video frames can be sent into a unified streaming pipeline, compressed at a high bitrate using the first terminal's hardware encoder, and then sent to the network.

[0094] In an optional embodiment, the live streaming program is configured with a live streaming plugin; wherein, the live streaming plugin is internally used to perform target video enhancement processing on the video frame. Step S208 may include: directly writing the obtained enhanced video frame into the rendering pipeline of the live streaming program through the live streaming plugin, so that the enhanced video frame participates as a video source in the image rendering and output of the live streaming program.

[0095] In practical applications, the live streaming program running on the first terminal can pre-load and configure a live streaming plugin for video processing. This plugin, as part of the live streaming program, can be directly associated with its rendering pipeline. When a video frame output from the unified decoding layer is sent to the target video enhancement processing flow, the live streaming plugin can internally call the locally configured graphics processor on the first terminal to perform target video enhancement processing such as beautification, makeup, stickers, or filters on the video frame. After processing, the live streaming plugin does not need to write the enhanced video frame back to system memory or forward data through third-party middleware; instead, it directly submits the enhanced video frame to the live streaming program's rendering pipeline (e.g., render_main_texture). At this point, the enhanced video frame can serve as a native video source in the live streaming program, directly participating in subsequent global layer compositing and final streaming encoding.

[0096] In this embodiment, by configuring a live streaming plugin in the live streaming program and directly writing the enhanced video frames into the rendering pipeline of the live streaming program after generation, a shortest processing link from video decoding and video enhancement to live streaming rendering is formed. This avoids multiple transfers and redundant processing of video frames between live streaming rendering and third-party intermediate processing components, thereby reducing GPU and CPU resource consumption and further improving the real-time performance and stability of the live stream.

[0097] In an optional embodiment, the first terminal is a PC and the second terminal is a mobile phone.

[0098] For example, the broadcaster can use their mobile phone as a camera, capturing high-bitrate raw footage via the phone's native camera and connecting it to a PC via USB using AOA mode or an iOS Bridge. The PC can handle unified access and decoding of the video stream from the mobile phone, and locally utilize higher-performance CPU and GPU resources to perform video enhancement processing, scene compositing, and final live streaming output. In some embodiments, for live streaming scenarios requiring multiple perspectives, the PC can simultaneously connect multiple mobile phones as video sources (e.g., the main phone is pointed at the face, and the secondary phone is pointed at the product). The PC can uniformly manage the video enhancement parameters of all phones through a cross-platform parameter set, ensuring consistent image quality, filter colors, and beautification intensity across different camera positions.

[0099] In this embodiment, target video enhancement processing of video frames is performed on a PC with higher video processing performance, reducing the load on the mobile device and further improving the quality of the video stream output from the mobile device. The higher video processing capabilities of the PC enable higher resolution, higher frame rate, and lower latency video output.

[0100] To make this application easier to understand, the following is combined with... Figure 7 An example application is provided.

[0101] The S11 allows the PC to acquire video streams captured by the mobile phone via wireless / USB through a unified access layer.

[0102] S12, the unified decoding layer on the PC directly decodes the acquired video stream data to obtain video frames.

[0103] S13, the PC-side beautification rendering layer enhances video frames based on the GPU to obtain enhanced video frames.

[0104] S14 will write enhanced video frames into the rendering pipeline of the PC-based live streaming tool.

[0105] S15 outputs the live stream and pushes the live stream.

[0106] In this exemplary application, video frames are enhanced by a PC with higher video processing capabilities, reducing the load on the mobile device and thus improving the quality of the video stream output from the mobile device. Furthermore, by leveraging the PC's superior video processing power, high-resolution, high-frame-rate, and low-latency video output can be achieved. By unifying the output of video streams from multiple sources (wireless / USB) to the decoding layer for decoding, the underlying protocol differences between different systems such as Android and iOS are shielded, and the PC does not need to concern itself with the source of the video stream. This decouples the video processing logic from the transmission protocol, improving the versatility of cross-platform video processing. Simultaneously, by directly decoding the acquired video stream data through the PC's decoding layer, no additional de-encapsulation or other processing is required, thereby reducing video processing time and lowering the transmission latency of the live stream.

[0107] Example 2 Figure 8 The diagram schematically illustrates a cross-platform video processing apparatus according to Embodiment 2 of this application. This apparatus can be divided into one or more program modules, which are stored in a storage medium and executed by one or more processors to complete the embodiments of this application. The program module referred to in the embodiments of this application refers to a series of computer program instruction segments capable of performing a specific function. The following description will specifically introduce the functions of each program module in this embodiment. For example... Figure 8 As shown, the device 1600 may include: an acquisition module 1610, an access module 1620, a decoding module 1630, an enhancement module 1640, and an output module 1650, wherein: The acquisition module 1610 is used to acquire the video stream output by the second terminal based on the screen projection mode, wherein the first terminal has higher video processing performance than the second terminal. The access module 1620 is used to access the video stream into the unified access layer and to provide the target format data obtained after processing by the unified access layer to the unified decoding layer for reading. Decoding module 1630 is used to decode the read target format data through the unified decoding layer to obtain video frames; Enhancement module 1640 is used to perform target video enhancement processing on the video frame to obtain an enhanced video frame; and Output module 1650 is used to output the enhanced video frame.

[0108] In an optional embodiment, the device 1600 is further configured to: Determine the input method information for the second terminal's video input; Based on the input method information, a screen mirroring channel is established with the second terminal, and the video stream is received through the screen mirroring channel.

[0109] In an optional embodiment, the input mode information is used to indicate a wireless input mode; the device 1600 is further configured to: under the wireless input mode, create a network socket and listen for connections based on a real-time streaming media transport protocol to receive the video stream transmitted via the connection; and / or The input method information is used to indicate the wired iOS input method; the device 1600 is further configured to: establish a first USB channel via a USB bridging module to receive the video stream via the first USB channel; and / or The input method information is used to indicate the wired Android input method; the device 1600 is also used to: switch the second terminal to AOA mode to receive the video stream via the second USB channel.

[0110] In an optional embodiment, the target format data includes byte data corresponding to the video stream; the apparatus 1600 is further configured to: The unified access layer provides byte data of the video stream to the unified decoding layer, so that the unified decoding layer can perform video decoding processing based on the byte data; In the case where the video stream is received via the first USB channel or the second USB channel, the AVIO callback is configured through the AVIO custom interface, so that the unified decoding layer reads the byte data through the AVIO callback.

[0111] In an optional embodiment, the device 1600 is further configured to: The video frames are input to the graphics processor locally configured on the first terminal; The target video enhancement process is performed on the video frame by the graphics processor to obtain the enhanced video frame; The video stream is either a video without video enhancement processing or a video that has only undergone partial video enhancement processing; the target video enhancement processing includes skin smoothing, whitening, makeup processing, sticker processing, and / or filter processing.

[0112] In an optional embodiment, the live streaming program is configured with a live streaming plugin; wherein the live streaming plugin is internally used to perform target video enhancement processing on the video frames; the device 1600 is further used for: The enhanced video frames obtained by the live streaming plugin are directly written into the rendering pipeline of the live streaming program, so that the enhanced video frames can participate as video sources in the image rendering and output of the live streaming program.

[0113] In an optional embodiment, the first terminal is used to record video enhancement parameters corresponding to the video stream; the device 1600 is further used to: When switching scenes or video sources, the video enhancement parameters are updated based on the current live streaming scene or video source identifier. Based on the updated video enhancement parameters, the corresponding video enhancement operation is performed on the video frame to obtain the enhanced video frame.

[0114] In an optional embodiment, the process of performing target video enhancement processing on the video frame to obtain an enhanced video frame includes: The video frame is processed based on the video enhancement parameters, frame rate parameters, and resolution parameters to obtain the enhanced video frame.

[0115] In an optional embodiment, the first terminal is a PC and the second terminal is a mobile phone.

[0116] Example 3 Figure 9 This illustration schematically depicts a hardware architecture diagram of a computer device 10000 suitable for implementing a cross-platform video processing method according to Embodiment 3 of this application. In some embodiments, the computer device 10000 may be a tablet computer, personal computer, in-vehicle terminal, game console, virtual machine, workbench, set-top box, robot, or other terminal device. Figure 9 As shown, the computer device 10000 includes, but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate and be linked with each other via a system bus. Wherein: The memory 10010 includes at least one type of computer-readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 10010 may be an internal storage module of a computer device 10000, such as the hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 may also be an external storage device of the computer device 10000, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the computer device 10000. Of course, the memory 10010 may also include both the internal storage module and the external storage device of the computer device 10000. In this embodiment, the memory 10010 is typically used to store the operating system and various application software installed on the computer device 10000, such as program code for cross-platform video processing methods. Furthermore, the memory 10010 can also be used to temporarily store various types of data that have been output or will be output.

[0117] In some embodiments, processor 10020 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other chip. Processor 10020 is typically used to control the overall operation of computer device 10000, such as performing control and processing related to data interaction or communication with computer device 10000. In this embodiment, processor 10020 is used to run program code stored in memory 10010 or process data.

[0118] Network interface 10030 may include a wireless network interface or a wired network interface, which is typically used to establish a communication link between computer device 10000 and other computer devices. For example, network interface 10030 is used to connect computer device 10000 to a second terminal via a network, establishing a data transmission channel and communication link between computer device 10000 and the second terminal. The network can be an intranet, the Internet, Global System for Mobile Communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, or other wireless or wired networks.

[0119] It should be pointed out that, Figure 9 Only computer devices with components 10010-10030 are shown; however, it should be understood that it is not required to implement all of the shown components, and more or fewer components may be implemented instead.

[0120] In this embodiment, the cross-end video processing method stored in memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiments of this application.

[0121] Example 4 This application also provides a computer-readable storage medium storing a computer program thereon, wherein the computer program, when executed by a processor, implements the steps of the cross-end video processing method in the embodiments.

[0122] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the computer device. Of course, the computer-readable storage medium may include both the internal storage unit and the external storage device of the computer device. In this embodiment, the computer-readable storage medium is typically used to store the operating system and various application software installed on the computer device, such as the program code of the cross-platform video processing method in this embodiment. In addition, the computer-readable storage medium can also be used to temporarily store various types of data that have been output or will be output.

[0123] Example 5 This application also provides a computer program product, including a computer program that, when executed by a processor, implements the methods described in the above embodiments.

[0124] Obviously, those skilled in the art should understand that the modules or steps of the embodiments of this application described above can be implemented using general-purpose computer devices. They can be centralized on a single computer device or distributed across a network of multiple computer devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computer device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the embodiments of this application are not limited to any particular combination of hardware and software.

[0125] It should be noted that the above are merely preferred embodiments of this application and do not limit the scope of patent protection of this application. Any equivalent structural or procedural changes made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of this application.

Claims

1. A cross-platform video processing method, characterized in that, In a live streaming application applied to a first terminal, the method includes: The video stream output by the second terminal is obtained based on the screen mirroring mode, and the first terminal has higher video processing performance than the second terminal. The video stream is connected to the unified access layer, and the target format data obtained after processing by the unified access layer is provided to the unified decoding layer for reading. The unified decoding layer decodes the read target format data to obtain video frames; The video frame is subjected to target video enhancement processing to obtain an enhanced video frame; and Output the enhanced video frame.

2. The method according to claim 1, characterized in that, The video stream output from the second terminal is obtained based on the screen mirroring mode, including: Determine the input method information for the second terminal's video input; Based on the input method information, a screen mirroring channel is established with the second terminal, and the video stream is received through the screen mirroring channel.

3. The method according to claim 2, characterized in that: The input method information is used to indicate the wireless input method; establishing a screen projection channel with the second terminal includes: under the wireless input method, creating a network socket and listening for connections based on a real-time streaming media transmission protocol to receive the video stream transmitted via the connection; and / or The input method information is used to indicate the wired iOS input method; establishing a screen mirroring channel with the second terminal includes: establishing a first USB channel via a USB bridging module to receive the video stream via the first USB channel; and / or The input method information is used to indicate the wired Android input method; establishing a screen mirroring channel with the second terminal includes: switching the second terminal to AOA mode to receive the video stream via the second USB channel.

4. The method according to claim 3, characterized in that, The target format data includes the byte data corresponding to the video stream; the target format data obtained after processing by the unified access layer is provided to the unified decoding layer for reading, including: The unified access layer provides byte data of the video stream to the unified decoding layer, so that the unified decoding layer can perform video decoding processing based on the byte data; In the case where the video stream is received through the first USB channel or the second USB channel, the AVIO callback is configured through the AVIO custom interface so that the unified decoding layer reads the byte data through the AVIO callback.

5. The method according to claim 1, characterized in that, The enhanced video frame is obtained by performing target video enhancement processing on the video frame, including: The video frames are input to the graphics processor locally configured on the first terminal; The target video enhancement process is performed on the video frame by the graphics processor to obtain the enhanced video frame; The video stream is either a video without video enhancement processing or a video that has only undergone partial video enhancement processing; the target video enhancement processing includes skin smoothing, whitening, makeup processing, sticker processing, and / or filter processing.

6. The method according to claim 1, characterized in that, The live streaming program is configured with a live streaming plugin; wherein, the live streaming plugin is internally used to perform target video enhancement processing on the video frames; Outputting the enhanced video frame includes: The enhanced video frames obtained by the live streaming plugin are directly written into the rendering pipeline of the live streaming program, so that the enhanced video frames can participate as video sources in the image rendering and output of the live streaming program.

7. The method according to claim 1, characterized in that, The first terminal is used to record the video enhancement parameters corresponding to the video stream; The enhanced video frame is obtained by performing target video enhancement processing on the video frame, including: When switching scenes or video sources, the video enhancement parameters are updated based on the current live streaming scene or video source identifier. Based on the updated video enhancement parameters, the corresponding video enhancement operation is performed on the video frame to obtain the enhanced video frame.

8. The method according to claim 1, characterized in that, in, The enhanced video frame is obtained by performing target video enhancement processing on the video frame, including: The video frame is processed based on the video enhancement parameters, frame rate parameters, and resolution parameters to obtain the enhanced video frame.

9. The method according to any one of claims 1 to 8, characterized in that, The first terminal is a PC, and the second terminal is a mobile phone.

10. A cross-platform video processing device, characterized in that, The device includes: The acquisition module is used to acquire the video stream output by the second terminal based on the screen projection mode. The first terminal has higher video processing performance than the second terminal. The access module is used to access the video stream into the unified access layer and to provide the target format data obtained after processing by the unified access layer to the unified decoding layer for reading. The decoding module is used to decode the read target format data through the unified decoding layer to obtain video frames; An enhancement module is used to perform target video enhancement processing on the video frame to obtain an enhanced video frame; and The output module is used to output the enhanced video frames.

11. A computer device, characterized in that, include: At least one processor; and A memory communicatively connected to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method as described in any one of claims 1 to 9.

13. A computer program product, comprising a computer program, characterized in that, When executed by a processor, the computer program implements the steps of the method according to any one of claims 1 to 9.

Images