A live picture mirror correction method and system based on multi-path video fusion and a medium

Abstract

This invention discloses a live stream image mirroring correction method, system, and medium based on multi-channel video fusion. The method includes the following steps: transmitting the original screen content of a mobile terminal as a first signal to a screen hardware device via a wired connection; transmitting the original screen content of the mobile terminal as a second signal to the screen hardware device via a wireless connection; performing horizontal mirroring processing on the received second signal; identifying and cropping a target UI area from the mirrored second signal; overlaying the cropped target UI area onto the corresponding area of ​​the wired first signal; and displaying the final synthesized image on the screen hardware device. This invention solves the technical problem of inconsistency between the displayed direction of a person's movement and the actual direction of their movement when using a rear camera in live streaming.

Description

Technical Field

[0001] This invention relates to the field of video processing and live streaming technology, and in particular to a method, system and medium for live streaming image mirroring correction based on multi-channel video fusion. Background Technology

[0002] With the booming development of the internet and live streaming industry, it has become commonplace for users to conduct live streams using mobile devices such as smartphones and tablets. To obtain better image quality and a more stable angle, streamers often use the rear camera of their devices for filming. At the same time, to facilitate monitoring the live stream's quality and interaction, streamers will project the content of their device screen onto a larger monitor or capture card.

[0003] However, a common technical problem exists in this application scenario: most mobile operating systems, when displaying the rear camera preview locally, default to horizontal mirroring (horizontal flipping) to give the streamer a "mirror-like" experience. When the streamer projects this preview via wired or wireless means, the output video stream usually inherits this mirrored state. This results in the UI elements such as comments, icons, and bullet comments on the live stream interface being displayed in the normal orientation, while the streamer's movements are reversed (the streamer raises their right hand, but the monitor sees them raising their left hand). This reversed operation provides a very poor user experience and seriously affects the live stream's quality, especially for live streams requiring precise movement guidance, such as those for teaching, fitness, and crafts. Therefore, there is an urgent need for a solution that can ensure the correct orientation of the streamer's movements while maintaining the readability of UI elements, thereby improving the live stream's quality and efficiency. Summary of the Invention

[0004] The main objective of this invention is to propose a live broadcast image mirroring correction method, system, and medium based on multi-channel video fusion. This invention aims to solve the technical problem that when using a rear camera in a live broadcast, the direction of the character's movement displayed on the screen is inconsistent with the actual direction of the character's movement, resulting in a mismatch between the readability of the character and interface elements, and that while the direction of the movement is normal when the screen is mirrored, the direction of the bullet comments and other interface content is displayed in reverse.

[0005] To achieve the above objectives, the present invention provides a live broadcast image mirroring correction method based on multi-channel video fusion, the method comprising the following steps: Step S10: The original screen content of the mobile terminal is transmitted to the screen hardware device as the first signal via a wired connection. Step S20: The original screen content of the mobile terminal is transmitted to the screen hardware device as a second signal via a wireless connection. Step S30: Perform horizontal mirroring processing on the received second signal; Step S40: Identify and crop out the target UI area from the second signal after mirroring; Step S50: Overlay the cropped target UI area onto the corresponding area of ​​the first signal transmitted via wired connection; Step S60: Display the final synthesized image on the screen hardware device.

[0006] A further technical solution of the present invention is that step S30 includes: Step S301: If the image received via wireless connection is a video stream, each frame is an image, and I_in(x,y) represents this image, where I_in represents the input image, (x,y) represents the coordinates of a pixel on the image, x is the horizontal coordinate from left to right, with 0 at the far left, and y is the vertical coordinate from top to bottom, with 0 at the top. Step S302: Mirror the image by swapping its left and right sides, moving pixels from the left to the right and vice versa. The formula is as follows: I_out(x,y)=I_in(W-1-x,y): Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. Since the coordinates start from 0, the x-coordinate of the rightmost pixel is the width minus 1.

[0007] A further technical solution of the present invention is that step S40 includes: Define a cropped rectangle: rect=(L,T,R,B), where rect is the cropped rectangle, L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle. Each pixel (i,j) of the new image is represented as: new image (i,j)=original image(L-M+i,T-M+j), where L is the x-axis coordinate of the leftmost edge in the mirrored full-screen view, T is the y-axis coordinate of the topmost edge in the mirrored full-screen view, i is the x-coordinate of the new image, j is the y-coordinate of the new image, and M is the margin.

[0008] A further technical solution of the present invention is that step S50 includes: Paste the cropped content onto the wired projection screen at the same position according to the x-axis start point, y-axis start point, x-axis width, and y-axis width.

[0009] To achieve the above objectives, the present invention also proposes a live broadcast image mirroring correction system based on multi-channel video fusion. The system includes a wired projection module, a wireless projection module, and an image processing module. The image processing module includes a mirroring unit, a region recognition and cropping unit, an image synthesis unit, and an image display unit. The wired projection module is used to transmit the original screen content of the mobile terminal as a first signal to the screen hardware device via a wired connection. The wireless projection module is used to transmit the original screen content of the mobile terminal as a second signal to the screen hardware device via a wireless connection. The mirroring unit is used to perform horizontal mirroring processing on the received second signal; The region identification and cropping unit is used to identify and crop the target UI region from the second signal after mirroring; The image synthesis unit is used to overlay the cropped target UI area onto the corresponding area of ​​the first signal transmitted via wired connection; The image display unit is used to display the final synthesized image on the screen hardware device.

[0010] A further technical solution of the present invention is that the mirror unit is also used to, if the image received through the wireless connection is a video stream, and each frame is an image, use I_in(x,y) to represent this image, where I_in represents the input image, (x,y) represents the coordinates of a certain pixel point on the image, x is the horizontal coordinate, where 0 is on the far left from left to right, and y is the vertical coordinate, where 0 is on the far right from top to bottom; Mirror the image, swapping its left and right sides. Move pixels from the left to the right and vice versa. The formula is as follows: I_out(x,y)=I_in(W-1-x,y): Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. Since the coordinates start from 0, the x-coordinate of the rightmost pixel is the width minus 1.

[0011] A further technical solution of the present invention is that the region recognition and cropping unit is also used to define a cropped rectangle: rect=(L,T,R,B), where rect is the cropped rectangle, L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle; each pixel (i,j) of the new image is represented as: new image (i,j)=original image (L-M+i,T-M+j), where L is the x-axis coordinate value corresponding to the leftmost edge in the mirrored full-screen image, T is the y-axis coordinate value corresponding to the topmost edge in the mirrored full-screen image, i is the horizontal coordinate in the new image, j is the vertical coordinate in the new image, and M is the margin.

[0012] A further technical solution of the present invention is that the image synthesis unit is also used to paste the cropped content onto the wired projection screen at the same position according to the x-axis starting point, y-axis starting point, x-axis width, and y-axis width.

[0013] To achieve the above objectives, the present invention also proposes a computer-readable storage medium storing a live video image correction program based on multi-channel video fusion, wherein the live video image correction program based on multi-channel video fusion is executed by a processor to perform the steps of the method described above.

[0014] The beneficial effects of the live broadcast image mirroring correction method, system, and medium based on multi-channel video fusion of this invention are: 1. This invention fundamentally solves the contradiction between "person mirroring" and "UI mirroring" in live streaming. When the streamer uses the rear camera, they can obtain a person image consistent with the rear camera without any orientation illusion, and can also read the bullet comments and operate the interface normally.

[0015] 2. This invention provides a seamless and natural live streaming experience, eliminating the need for broadcasters to perform complex software settings or endure the hassle of reverse operations during the live stream, thereby enhancing the professionalism and watchability of the live stream content.

[0016] 3. This invention employs an innovative dual-path architecture: wired high-fidelity transmission of the UI, wireless image processing, and backend composite output. This architecture cleverly utilizes the low latency and high fidelity of wired transmission to ensure UI clarity, while leveraging the flexibility of wireless transmission for image processing, achieving effects impossible with a single technical approach. The wired transmission path ensures zero latency and extremely high clarity for core UI elements, while the image processed by the wireless path is only used for cropping specific areas, relatively reducing the requirements for overall bandwidth and processing power, resulting in a highly efficient and stable overall system performance. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.

[0018] Figure 1 This is a flowchart illustrating a preferred embodiment of the live stream image mirroring correction method based on multi-channel video fusion of the present invention. Figure 2 This is a schematic diagram of the overall process of the live broadcast image mirroring correction method based on multi-channel video fusion of the present invention.

[0019] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0020] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0021] This invention proposes a live video image mirroring correction method based on multi-channel video fusion. The technical solution adopted by this invention mainly involves acquiring two heterogeneous data streams from the same source screen in parallel, and extracting, mirroring, cropping and recombining these two data streams on a hardware terminal with independent processing capabilities, thereby creating a new image that has both directional characteristics and cannot be achieved by a single data stream.

[0022] like Figure 1 and Figure 2 As shown, a preferred embodiment of the live stream image correction method based on multi-channel video fusion of the present invention includes the following steps: Step S10: The original screen content of the mobile terminal is transmitted to the screen hardware device as the first signal via a wired connection.

[0023] In this embodiment, the mobile terminal is, for example, a smartphone or tablet computer, which can run a live streaming application. The smart terminal is equipped with at least one rear camera and integrates wireless communication functions. Its operating system supports wired video output and wireless screen mirroring protocols.

[0024] The screen hardware device serves as the final display carrier and has a built-in image processing module.

[0025] The preferred embodiment of the live broadcast image mirroring correction method based on multi-channel video fusion of the present invention can be applied to a live broadcast image mirroring correction system based on multi-channel video fusion. The system includes a wired projection module, a wireless projection module, and an image processing module. The image processing module includes a mirroring unit, a region recognition and cropping unit, an image synthesis unit, and an image display unit.

[0026] The wired projection module forms a highly reliable backbone channel for a live video mirroring correction system based on multi-channel video fusion. It connects the mobile terminal and the screen hardware device via a physical cable. This module establishes the first data channel between the mobile terminal and the screen hardware device to transmit the first screen image data, responsible for transmitting the first screen image data from the mobile terminal to the screen hardware device with extremely low latency and lossless or near-lossless transmission. This data serves as the UI reference layer, and its primary task is to ensure the absolute clarity and original orientation correctness of all static and dynamic UI elements. The wired projection module can use DisplayPort, HDMI, or USB-C video transmission protocols.

[0027] In this embodiment, the wired projection module transmits the original screen content of the mobile terminal as the first signal to the screen hardware device via a wired connection.

[0028] Step S20: The original screen content of the mobile terminal is transmitted to the screen hardware device as a second signal via a wireless connection.

[0029] In this embodiment, the wireless projection module constitutes a flexible processing channel for the system, establishing a second data channel between the mobile terminal and the screen hardware device to transmit second screen image data. It is based on a common wireless projection protocol or a proprietary high-speed Wi-Fi transmission protocol. This module is responsible for transmitting the second screen image data from the mobile terminal screen to the screen hardware device after lossy compression (such as H.264 / H.265 encoding). This data serves as the image processing source, primarily used to provide positioning references and content sources for the UI area after mirroring. The wireless projection module uses Miracast, AirPlay, or Wi-Fi Direct protocols.

[0030] In step S30, the screen hardware device performs horizontal mirroring processing on the received second signal.

[0031] In this embodiment, the image processing module is integrated into the screen hardware device and includes a data receiving and decoding unit, a frame synchronization and alignment unit, a mirroring unit, a region recognition and cropping unit, and an image synthesis unit.

[0032] The data receiving and decoding unit is used to receive the raw video stream from the wired channel and the encoded video stream from the wireless channel in parallel. For the encoded video stream from the wireless channel, it performs video decoding to restore it to a processable bitmap format.

[0033] The frame synchronization and alignment unit is a crucial processing unit. Due to the inherent difference in latency between wired and wireless transmissions (wireless latency is typically significantly higher than wired latency), direct compositing would result in ghosting or tearing. This unit dynamically adjusts the buffers of the two data streams through timestamp matching or feature point matching algorithms based on screen content (such as detecting UI changes or instantaneous character movements in a specific frame) to ensure that each frame participating in the compositing is strictly corresponding in time.

[0034] In this embodiment, the mirror unit is used to receive the image data content of the second screen.

[0035] In step S40, the screen hardware device identifies and crops out the target UI area from the mirrored second signal.

[0036] In this embodiment, the region recognition and cropping unit identifies and crops a preset target UI region from the mirrored image. The target UI region may include, for example, the bullet screen display area, the comment area, the gift notification area, etc.

[0037] The region recognition and cropping unit identifies the target UI region in the following ways: based on predefined screen coordinate regions, through template matching, or through dynamic recognition via machine learning models.

[0038] Step S50: Overlay the cropped target UI area onto the corresponding area of ​​the first signal transmitted via wired connection.

[0039] In this embodiment, the image synthesis unit overlays the cropped target UI area in the normal orientation onto the first screen image data received by the wired projection module. Specifically, the target UI area is overlaid onto the corresponding position in the first screen image data, replacing the corresponding UI content that has already been mirrored.

[0040] Step S60: Display the final synthesized image on the screen hardware device.

[0041] After the final image is synthesized, the final synthesized image is displayed on the screen hardware device through the image display unit.

[0042] Specifically, in this embodiment, step S30 includes: Step S301: If the image received via wireless connection is a video stream, each frame is an image, and this image is represented by I_in(x,y), where I_in represents the input image, (x,y) represents the coordinates of a pixel on the image, x is the horizontal coordinate, where 0 is on the far left from left to right, and y is the vertical coordinate, where 0 is on the far right from top to bottom.

[0043] Step S302: Mirror the image by swapping its left and right sides, moving pixels from the left to the right and vice versa. The formula is as follows: I_out(x,y)=I_in(W-1-x,y).

[0044] Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. Since the coordinates start from 0, the x-coordinate of the rightmost pixel is the width minus 1.

[0045] Step S40 specifically includes: Define a cropped rectangle: rect=(L,T,R,B), where rect is the cropped rectangle, L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle. Each pixel (i,j) of the new image is represented as: new image (i,j)=original image(L-M+i,T-M+j), where L is the x-axis coordinate of the leftmost edge in the mirrored full-screen view, T is the y-axis coordinate of the topmost edge in the mirrored full-screen view, i is the x-coordinate of the new image, j is the y-coordinate of the new image, and M is the margin (to prevent cropping the edges; it can also be set to 0 to indicate no outward cropping).

[0046] Step S50 specifically includes: Paste the cropped content onto the wired projection screen at the same position according to the x-axis start point, y-axis start point, x-axis width, and y-axis width.

[0047] The following examples further illustrate the live video image correction method based on multi-channel video fusion of the present invention in detail.

[0048] Assuming that we have already obtained two video stream inputs using wired and wireless screen mirroring, the next step is to mirror the content of the wireless screen mirroring.

[0049] Step 1: Obtain the screen from the wireless projection and mirror it.

[0050] Assume the wireless screen mirroring output is a video stream, with each frame being an image. This image can be represented by I_in(x,y), where I_in represents the input image, and (x,y) represents the coordinates of a pixel on the image. x is the horizontal coordinate, from left to right, with 0 at the far left, and y is the vertical coordinate, from top to bottom, with 0 at the top.

[0051] For example, if the screen projection resolution is 1280×720, then the range of x is 0 to 1279 (a total of 1280 pixels), and the range of y is 0 to 719 (a total of 720 pixels).

[0052] The core idea of ​​mirroring, or horizontal flipping, is to swap the left and right sides of an image.

[0053] Moving pixels from the left to the right, and vice versa, can be represented by the following formula: I_out(x,y)=I_in(W-1-x,y).

[0054] Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. W-1 is because the coordinates start from 0, so the x-coordinate of the rightmost pixel is the width minus 1. W-1-x: this is the key part of "mirror calculation".

[0055] For example, if the image width W = 10 pixels and the height is arbitrary, the pixels of a row in the original image I_in from left to right are: Positions: 0 1 2 3 4 5 6 7 8 9, corresponding to the colors: red, orange, yellow, green, cyan, blue, purple, pink, white, and black. The mirrored image I_out will become: For x=0 (leftmost): I_out(0,y)=I_in(10-1-0,y)=I_in(9,y)=black.

[0056] For x=1: I_out(1,y)=I_in(10-1-1,y)=I_in(8,y)=white.

[0057] For x=4 (in the middle): I_out(4,y)=I_in(10-1-4,y)=I_in(5,y)=blue.

[0058] For x=9 (the rightmost): I_out(9,y)=I_in(10-1-9,y)=I_in(0,y)=red.

[0059] The final image obtained from left to right is: Position: 0 1 2 3 4 5 6 7 8 9, corresponding to the colors black, white, pink, purple, blue, cyan, green, yellow, orange, and red, respectively.

[0060] The second step is to crop the mirrored image.

[0061] In this embodiment, a rectangle is defined using four numbers: B=(L,T,R,B), where L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle. Each pixel (i,j) of the new image is represented as: new image (i,j)=original image (L-M+i,T-M+j), where i is the x-coordinate of the new image, j is the y-coordinate of the new image, and M is the margin, which is how many pixels to expand outward, assumed to be 15.

[0062] Original image coordinates = starting point of the expanded frame + coordinates of the new image.

[0063] The original graph X = (LM) + i.

[0064] The original graph is Y = (TM) + j.

[0065] For example: On the original image, starting from position (90,40), take 220 pixels to the right and 370 pixels down. Copy this 220×370 area, and you will get the new image after cropping.

[0066] The third step is to overlay the cropped image onto the wired image: Paste the cropped content onto the wired projection screen at the same position according to the coordinates of L-axis start point, Y-axis start point, X-axis width, and Y-axis height.

[0067] Finally, the composite image output by the image synthesis unit is displayed on the screen hardware device. The image of the person comes from the mirrored video stream of the rear camera (therefore the orientation is correct), while the UI elements come from the unmirrored wired projection data stream (therefore the text and icons are in the correct orientation).

[0068] The beneficial effects of the live broadcast image mirroring correction method based on multi-channel video fusion of this invention are: 1. This invention fundamentally solves the contradiction between "person mirroring" and "UI mirroring" in live streaming. When the streamer uses the rear camera, they can obtain a person image consistent with the rear camera without any orientation illusion, and can also read the bullet comments and operate the interface normally.

[0069] 2. This invention provides a seamless and natural live streaming experience, eliminating the need for broadcasters to perform complex software settings or endure the hassle of reverse operations during the live stream, thereby enhancing the professionalism and watchability of the live stream content.

[0070] 3. This invention employs an innovative dual-path architecture: wired high-fidelity transmission of the UI, wireless image processing, and backend composite output. This architecture cleverly utilizes the low latency and high fidelity of wired transmission to ensure UI clarity, while leveraging the flexibility of wireless transmission for image processing, achieving effects impossible with a single technical approach. The wired transmission path ensures zero latency and extremely high clarity for core UI elements, while the image processed by the wireless path is only used for cropping specific areas, relatively reducing the requirements for overall bandwidth and processing power, resulting in a highly efficient and stable overall system performance.

[0071] To achieve the above objectives, the present invention also proposes a live broadcast image mirroring correction system based on multi-channel video fusion. A preferred embodiment of the live broadcast image mirroring correction system based on multi-channel video fusion of the present invention includes a wired projection module, a wireless projection module, and an image processing module. The image processing module includes a mirroring unit, a region recognition and cropping unit, an image synthesis unit, and an image display unit.

[0072] The wired projection module is used to transmit the original screen content of the mobile terminal as a first signal to the screen hardware device via a wired connection. The wireless projection module is used to transmit the original screen content of the mobile terminal as a second signal to the screen hardware device via a wireless connection. The mirroring unit is used to perform horizontal mirroring processing on the received second signal; The region identification and cropping unit is used to identify and crop the target UI region from the second signal after mirroring; The image synthesis unit is used to overlay the cropped target UI area onto the corresponding area of ​​the first signal transmitted via wired connection; The image display unit is used to display the final synthesized image on the screen hardware device.

[0073] In this embodiment, the mirroring unit is further configured to, if the image received via wireless connection is a video stream and each frame is an image, use I_in(x,y) to represent this image, where I_in represents the input image, (x,y) represents the coordinates of a pixel on the image, x is the horizontal coordinate, where 0 is on the far left from left to right, and y is the vertical coordinate, where 0 is on the far right from top to bottom. Mirror the image, swapping its left and right sides. Move pixels from the left to the right and vice versa. The formula is as follows: I_out(x,y)=I_in(W-1-x,y): Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. Since the coordinates start from 0, the x-coordinate of the rightmost pixel is the width minus 1.

[0074] In this embodiment, the region recognition and cropping unit is further used to define a cropped rectangle: rect=(L,T,R,B), where rect is the cropped rectangle, L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle; each pixel (i,j) of the new image is represented as: new image (i,j)=original image (L-M+i,T-M+j), where L is the x-axis coordinate value corresponding to the leftmost edge in the mirrored full-screen image, T is the y-axis coordinate value corresponding to the topmost edge in the mirrored full-screen image, i is the horizontal coordinate in the new image, j is the vertical coordinate in the new image, and M is the margin.

[0075] In this embodiment, the image synthesis unit is also used to paste the cropped content onto the wired projection screen at the same position according to the x-axis starting point, y-axis starting point, x-axis width, and y-axis width.

[0076] To achieve the above objectives, the present invention also proposes a computer-readable storage medium storing a live video image correction program based on multi-channel video fusion. When the processor runs the live video image correction program based on multi-channel video fusion, it executes the steps described in the above embodiments, which will not be repeated here.

[0077] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. All equivalent structural transformations made under the concept of the present invention using the contents of the present invention specification and drawings, or direct / indirect applications in other related technical fields, are included within the patent protection scope of the present invention.

Claims

1. A live stream image mirroring correction method based on multi-channel video fusion, characterized in that, The method includes the following steps: Step S10: The original screen content of the mobile terminal is transmitted to the screen hardware device as the first signal via a wired connection. Step S20: The original screen content of the mobile terminal is transmitted to the screen hardware device as a second signal via a wireless connection. Step S30: Perform horizontal mirroring processing on the received second signal; Step S40: Identify and crop out the target UI area from the second signal after mirroring; Step S50: Overlay the cropped target UI area onto the corresponding area of ​​the first signal transmitted via wired connection; Step S60: Display the final synthesized image on the screen hardware device.

2. The live broadcast image mirroring correction method based on multi-channel video fusion according to claim 1, characterized in that, Step S30 includes: Step S301: If the image received via wireless connection is a video stream, each frame is an image, and I_in(x,y) represents this image, where I_in represents the input image, (x,y) represents the coordinates of a pixel on the image, x is the horizontal coordinate from left to right, with 0 at the far left, and y is the vertical coordinate from top to bottom, with 0 at the top. Step S302: Mirror the image by swapping its left and right sides, moving pixels from the left to the right and vice versa. The formula is as follows: I_out(x,y)=I_in(W-1-x,y): Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. Since the coordinates start from 0, the x-coordinate of the rightmost pixel is the width minus 1.

3. The live broadcast image mirroring correction method based on multi-channel video fusion according to claim 2, characterized in that, Step S40 includes: Define a cropped rectangle: rect=(L,T,R,B), where rect is the cropped rectangle, L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle. Each pixel (i,j) of the new image is represented as: new image (i,j)=original image(L-M+i,T-M+j), where L is the x-axis coordinate of the leftmost edge in the mirrored full-screen view, T is the y-axis coordinate of the topmost edge in the mirrored full-screen view, i is the x-coordinate of the new image, j is the y-coordinate of the new image, and M is the margin.

4. The live broadcast image mirroring correction method based on multi-channel video fusion according to claim 3, characterized in that, Step S50 includes: Paste the cropped content onto the wired projection screen at the same position according to the x-axis start point, y-axis start point, x-axis width, and y-axis width.

5. A live stream image mirroring correction system based on multi-channel video fusion, characterized in that, The system includes a wired projection module, a wireless projection module, and an image processing module. The image processing module includes a mirroring unit, a region recognition and cropping unit, an image synthesis unit, and an image display unit. The wired projection module is used to transmit the original screen content of the mobile terminal as a first signal to the screen hardware device via a wired connection. The wireless projection module is used to transmit the original screen content of the mobile terminal as a second signal to the screen hardware device via a wireless connection. The mirroring unit is used to perform horizontal mirroring processing on the received second signal; The region identification and cropping unit is used to identify and crop the target UI region from the second signal after mirroring; The image synthesis unit is used to overlay the cropped target UI area onto the corresponding area of ​​the first signal transmitted via wired connection; The image display unit is used to display the final synthesized image on the screen hardware device.

6. The live broadcast image mirroring correction system based on multi-channel video fusion according to claim 5, characterized in that, The mirroring unit is also used to, if the image received via wireless connection is a video stream, and each frame is an image, represent the image using I_in(x,y), where I_in represents the input image, (x,y) represents the coordinates of a pixel on the image, x is the horizontal coordinate, where 0 is on the far left from left to right, and y is the vertical coordinate, where 0 is on the far right from top to bottom. Mirror the image, swapping its left and right sides. Move pixels from the left to the right and vice versa. The formula is as follows: I_out(x,y)=I_in(W-1-x,y): Where I_out(x,y) represents the color value of the new image at position (x,y) after mirroring; W represents the width of the image. Since the coordinates start from 0, the x-coordinate of the rightmost pixel is the width minus 1.

7. The live broadcast image mirroring correction system based on multi-channel video fusion according to claim 6, characterized in that, The region recognition and cropping unit is further used to define a cropped rectangle: rect=(L,T,R,B), where rect is the cropped rectangle, L is the leftmost position of the rectangle, T is the topmost position of the rectangle, R is the rightmost position of the rectangle, and B is the bottommost position of the rectangle; each pixel (i,j) of the new image is represented as: new image (i,j)=original image (L-M+i,T-M+j), where L is the x-axis coordinate value corresponding to the leftmost edge in the mirrored full-screen image, T is the y-axis coordinate value corresponding to the topmost edge in the mirrored full-screen image, i is the horizontal coordinate of the new image, j is the vertical coordinate of the new image, and M is the margin.

8. The live broadcast image mirroring correction system based on multi-channel video fusion according to claim 7, characterized in that, The image synthesis unit is also used to paste the cropped content onto the wired projection screen at the same position according to the x-axis starting point, y-axis starting point, x-axis width, and y-axis width.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a live video image correction program based on multi-channel video fusion, which, when executed by a processor, performs the steps of the method as described in any one of claims 1 to 4.

Images