Multi-device fusion screen projection interaction method and system, terminal device and storage medium

Abstract

The application discloses a multi-device fusion screen projection interaction method and system, a terminal device and a storage medium. The method comprises the following steps: a commercial display terminal receives a screen projection instruction, and acquires first real-time data flow according to the screen projection instruction, wherein the first real-time data flow reflects first display content on a display window of the commercial display terminal; the commercial display terminal sends the first real-time data flow to a screen projection terminal. The screen projection terminal receives the first real-time data flow, decodes the first real-time data flow, and obtains the first display content; the screen projection terminal acquires second real-time data flow in real time, wherein the second real-time data flow reflects second display content on a display window of the screen projection terminal; and the screen projection terminal fuses the first real-time data flow and the second real-time data flow, and projects the fusion result to a preset display terminal for screen projection display. It can be seen that the application can realize fusion screen projection of display content on display windows of two terminals, so as to meet the use requirement of a user.

Description

Technical Field

[0001] This invention relates to the field of screen projection control technology, and in particular to a multi-device integrated screen projection interaction method, system, terminal device and storage medium. Background Technology

[0002] With the development of technology, more and more smart devices are entering people's work and life. In both work and life scenarios, it's inevitable to use various smart devices to meet user needs. Currently, screen projection technology is widely used in meeting scenarios, where a PowerPoint pen is typically used to control the computer's PowerPoint presentation on an LED display. However, some meetings require the cooperation of devices with touchscreen whiteboard functionality (such as smart whiteboard applications on commercial display TVs) for better presentation results. For example, during training courses or meetings, the presenter may need to write in another area instead of on the PowerPoint slides, thus requiring the simultaneous projection of content from multiple devices. However, current technology lacks a method for simultaneously projecting content from multiple devices, failing to meet user needs.

[0003] Therefore, existing technologies still need to be improved and enhanced. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a multi-device integrated screen projection interaction method, system, terminal device and storage medium to address the above-mentioned deficiencies of the prior art, and to provide a solution to the problem that the prior art lacks a method for projecting the display content of multiple devices together.

[0005] In a first aspect, the present invention provides a multi-device integrated screen projection interaction method, wherein the multi-device integrated screen projection interaction method is applied to a commercial display terminal in a multi-device integrated screen projection interaction system, the multi-device integrated screen projection interaction system including the commercial display terminal and a screen projection terminal corresponding to the commercial display terminal, and the method includes:

[0006] Receive a screen projection command and obtain a first real-time data stream according to the screen projection command. The first real-time data stream reflects the first display content on the display window of the commercial display terminal.

[0007] The first real-time data stream is sent to the projection terminal so that the projection terminal can obtain the second real-time data stream and merge the first real-time data stream and the second real-time data stream to project onto a preset display terminal. The second real-time data stream reflects the second display content on the display window of the projection terminal.

[0008] In one implementation, receiving the screen projection instruction and obtaining the first real-time data stream according to the screen projection instruction includes:

[0009] The screen projection transmitter on the commercial display terminal receives the screen projection command and parses the screen projection command to obtain the device information in the screen projection command.

[0010] Based on the device information, the screen projection terminal is identified, and a screen projection pairing request is sent to the screen projection terminal based on the screen projection transmitter;

[0011] The content displayed in the display window is acquired in real time and packaged to form the first real-time data stream.

[0012] In one implementation, the method further includes:

[0013] The screen projection transmitter receives a mode switching instruction, switches the screen projection display mode according to the mode switching instruction, and sends the switched screen projection display mode to the screen projection terminal.

[0014] Secondly, embodiments of the present invention also provide a multi-device integrated screen projection interaction method, wherein the multi-device integrated screen projection interaction method is applied to a screen projection terminal in a multi-device integrated screen projection interaction system, the multi-device integrated screen projection interaction system includes a commercial display terminal and a screen projection terminal corresponding to the commercial display terminal, and the method includes:

[0015] Receive the first real-time data stream and decode the first real-time data stream to obtain the first display content;

[0016] The second real-time data stream is acquired in real time, and the second real-time data stream reflects the second display content on the display window of the projection terminal;

[0017] The first real-time data stream and the second real-time data stream are merged and projected onto a preset display terminal for display.

[0018] In one implementation, receiving the first real-time data stream and decoding the first real-time data stream to obtain the first display content includes:

[0019] The screen mirroring terminal receives the screen mirroring pairing request information sent by the screen mirroring transmitter and completes the screen mirroring pairing.

[0020] The first real-time data stream is received by the screen projection transmitter, and the first real-time data stream is decoded to obtain the first display content.

[0021] In one implementation, the step of fusing the first real-time data stream and the second real-time data stream and projecting them onto a preset display terminal includes:

[0022] The first display content corresponding to the first real-time data stream and the second display content corresponding to the second real-time data stream are mixed and encoded according to the screen projection display mode to obtain a mixed encoded data stream;

[0023] The mixed encoded data stream is projected onto the display terminal for display.

[0024] In one implementation, the screen mirroring receiver and the screen mirroring transmitter are pre-paired, and the screen mirroring transmitter and the screen mirroring receiver are respectively paired and connected to a preset screen mirroring triggering device.

[0025] Thirdly, embodiments of the present invention also provide a multi-device integrated screen projection interaction system, wherein the system includes a commercial display terminal and a screen projection terminal corresponding to the commercial display terminal, wherein...

[0026] The commercial display terminal includes:

[0027] The first acquisition module is used to receive a screen projection instruction and acquire a first real-time data stream according to the screen projection instruction. The first real-time data stream reflects the first display content on the display window of the commercial display terminal.

[0028] The first sending module is used to send the first real-time data stream to the projection terminal, so that the projection terminal can obtain the second real-time data stream and merge the first real-time data stream and the second real-time data stream to project onto a preset display terminal, wherein the second real-time data stream reflects the second display content on the display window of the projection terminal;

[0029] The screen projection terminal includes:

[0030] The first content acquisition module is used to receive the first real-time data stream and decode the first real-time data stream to obtain the first display content;

[0031] The second content acquisition module is used to acquire a second real-time data stream in real time, which reflects the second display content on the display window of the projection terminal.

[0032] The fusion projection control module is used to fuse the first real-time data stream and the second real-time data stream and project them onto a preset display terminal for display.

[0033] Fourthly, embodiments of the present invention also provide a terminal device, wherein the terminal device is a commercial display terminal or a projection terminal, the terminal device includes a memory, a processor, and a multi-device fusion projection interaction program stored in the memory and executable on the processor, wherein when the processor executes the multi-device fusion projection interaction program, it implements the steps of the multi-device fusion projection interaction method of any of the above solutions.

[0034] Fifthly, embodiments of the present invention also provide a computer-readable storage medium, wherein a multi-device integrated screen projection interaction program is stored on the computer-readable storage medium, and when the multi-device integrated screen projection interaction program is executed by a processor, it implements the steps of the multi-device integrated screen projection interaction method described in any of the above schemes.

[0035] Beneficial Effects: Compared with existing technologies, this invention provides a multi-device integrated screen projection interaction method. The commercial display terminal receives a screen projection command and acquires a first real-time data stream based on the command. This first real-time data stream reflects the first display content on the display window of the commercial display terminal. The commercial display terminal sends the first real-time data stream to the screen projection terminal. The screen projection terminal receives the first real-time data stream and decodes it to obtain the first display content. The screen projection terminal acquires a second real-time data stream in real time, reflecting the second display content on the display window of the screen projection terminal. The screen projection terminal merges the first and second real-time data streams and projects them onto a preset display terminal for display. Therefore, this invention can merge the first content displayed on the commercial display terminal and the second content displayed on the screen projection terminal onto the display terminal, satisfying users' needs for integrated screen projection of display content from multiple terminals and providing convenience for users. Attached Figure Description

[0036] Figure 1 A flowchart illustrating a specific implementation of the multi-device fusion screen projection interaction method provided in this embodiment of the invention.

[0037] Figure 2 This is a schematic diagram illustrating an application scenario of the multi-device fusion screen projection interaction method provided in an embodiment of the present invention.

[0038] Figure 3 This is a functional principle diagram of a multi-device integrated screen projection and interaction system provided in an embodiment of the present invention.

[0039] Figure 4 A schematic diagram of a terminal device provided in an embodiment of the present invention. Detailed Implementation

[0040] To make the objectives, technical solutions, and effects of this invention clearer and more explicit, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0041] This embodiment provides a multi-device integrated screen projection interaction method. Based on this method, the first content displayed on a commercial display terminal and the second content displayed on a projection terminal can be integrated and projected onto the display terminal to meet the user's need for integrated screen projection of display content from multiple terminals. Specifically, in this embodiment, the commercial display terminal receives a projection command and obtains a first real-time data stream according to the command. The first real-time data stream reflects the first display content on the display window of the commercial display terminal. Then, the commercial display terminal sends the first real-time data stream to the projection terminal. Next, the projection terminal receives the first real-time data stream and decodes it to obtain the first display content. Then, the projection terminal obtains a second real-time data stream in real time, which reflects the second display content on the display window of the projection terminal. Finally, the projection terminal integrates the first real-time data stream and the second real-time data stream and projects them onto a preset display terminal for display.

[0042] For example, in this case, the projection terminal is a laptop, and the commercial display terminal is a commercial TV. The commercial TV can be used for writing. During a meeting, the user can write content on the touchscreen of the commercial TV and issue a projection command. After receiving the projection command, the commercial TV begins to acquire the first display content on the current display window. This first display content is what the user writes on the touchscreen, such as whiteboard notes used for presentations during training. Then, the commercial TV sends the first real-time data stream corresponding to this first display content to the laptop. After receiving this first real-time data stream, the laptop decodes it to obtain the first display content. Since the laptop's own screen is displaying content, it also acquires a second real-time data stream, which reflects the second display content displayed on the laptop, such as PowerPoint content. Next, the laptop merges the first and second real-time data streams and projects them onto the display terminal. Thus, the display terminal can simultaneously display both the first and second display content, meeting the user's needs.

[0043] Exemplary methods

[0044] The multi-device fusion screen projection interaction method of this embodiment can be applied to a multi-device fusion screen projection interaction system, which includes a commercial display terminal and a screen projection terminal corresponding to the commercial display terminal. Specifically, the commercial display terminal can be a commercial display television, and the screen projection terminal can be a terminal device such as a laptop computer, etc. Figure 1 As shown in the figure, the multi-device fusion screen projection interaction method of this embodiment includes the following steps:

[0045] Step S100: The commercial display terminal receives a screen projection instruction and obtains a first real-time data stream according to the screen projection instruction. The first real-time data stream reflects the first display content on the display window of the commercial display terminal.

[0046] Specifically, the commercial display terminal in this embodiment is equipped with a screen projection transmitter. This transmitter can receive screen projection commands from a preset remote control device and then perform screen projection operations according to the commands. In practical applications, the remote control device in this embodiment can be set as a screen projection control pen, such as... Figure 2 As described, the screen projection pen is equipped with a screen projection transmitter and a screen projection receiver. In practical applications, the screen projection transmitter and the screen projection receiver are both located on the commercial display terminal. Furthermore, the screen projection transmitter, the screen projection receiver, and the screen projection pen are pre-paired at the factory and can communicate with each other using a 2.4G wireless protocol. In addition, the tip of the screen projection pen in this embodiment can issue a screen projection command when the touchscreen of the commercial display terminal is touched, and this command can be received by the screen projection transmitter on the commercial display terminal. Of course, as... Figure 2 As shown in the figure, the screen projection control pen in this embodiment is also equipped with a screen projection button. The screen projection button can directly issue a screen projection command, and the issued screen projection command can be sent to the screen projection transmitter and the screen projection receiver so that both the commercial display terminal and the screen projection terminal can start to perform screen projection operation.

[0047] Specifically, when a user plugs the screen mirroring transmitter into a USB or Type-C port on the commercial display terminal, the terminal will display a message indicating that it is searching for the screen mirroring pen and receiver. If the screen mirroring transmitter, receiver, and pen have been successfully paired, the terminal will display a confirmation message. If pairing fails, the terminal will prompt the user to try again and provide instructions on how to connect the screen mirroring transmitter, as well as interactive instructions for the screen mirroring pen, receiver, and transmitter, reducing the learning curve for users.

[0048] In this embodiment, after receiving a screen mirroring command, the commercial display terminal parses the command to obtain device information. Based on this device information, the commercial display terminal identifies the target screen mirroring terminal and sends a screen mirroring pairing request to it via a screen mirroring transmitter. Since the target screen mirroring terminal has a screen mirroring receiver, this pairing request can be received by the receiver. Upon receiving confirmation from the receiver that the screen mirroring request has been approved, the screen mirroring transmitter begins to acquire the content displayed on the screen window in real time and packages this content into the first real-time data stream. For example, if a user writes on the screen of the commercial display terminal using a screen mirroring pen, this writing will be packaged into the first real-time data stream.

[0049] Step S200: The commercial display terminal sends the first real-time data stream to the projection terminal.

[0050] After acquiring the first real-time data stream, the commercial display terminal will send the first real-time data stream to the projection terminal, so that the projection terminal can acquire the second real-time data stream and merge the first real-time data stream and the second real-time data stream to project onto a preset display terminal. The second real-time data stream reflects the second display content on the display window of the projection terminal.

[0051] In this embodiment, the commercial display terminal can also receive a mode switching command from the projection transmitter, switch the projection display mode according to the mode switching command, and send the switched projection display mode to the projection terminal so that projection can be performed according to the projection display mode. Furthermore, the projection button on the projection control pen in this embodiment can issue different commands. For example, when the projection button is pressed briefly (e.g., for 0.5 seconds), a short press command is sent to the projection transmitter to control the projection transmitter to transmit data to the projection receiver. After receiving a short-press command from the screen casting pen, both the screen casting transmitter and receiver return an online status. For example, the screen casting receiver returns a query status result: Device ID: TPJ2022071700001, Online: Yes. If neither the screen casting transmitter nor the screen casting receiver returns a status result for more than 10 seconds, they are judged to be offline. In this case, the short-press operation is not executed, and the status lights of the screen casting transmitter and receiver on the screen casting pen illuminate to indicate which device is offline. If both the screen casting transmitter and the screen casting receiver return an online status, the screen casting command is sent.

[0052] If a user presses the screen mirroring button twice within one second, the window style of the screen mirroring receiver transmitting data to the display terminal will be switched, which is to switch the display mode, such as large and small screen, small and large screen, full-screen laptop, full-screen commercial TV, etc. After switching modes, the screen mirroring protocol will be re-encoded and transmitted, and the data stream will be decoded by the data transmission path and displayed on the spliced ​​screen on the display terminal.

[0053] If the user presses and holds the projection button (for example, for more than 3 seconds), the system will check if there are other projection transmitters. For example, if two projection transmitters are installed in a venue, pressing and holding the projection button will allow the user to check and switch the projection data link. Furthermore, this embodiment can also directly send projection commands to the corresponding projection terminal with a single click using the projection button on the projection pen, thereby controlling the projection terminal to directly project the displayed content.

[0054] The screen casting transmitter in this embodiment can connect to multiple commercial display terminals (i.e., multiple commercial display TVs are connected to the screen casting transmitter). Simply pair the screen casting transmitter with the screen casting control pen. The screen casting control pen will then send a screen casting command via its screen casting button (e.g., a long press of the screen casting button quickly switches between commercial display TV devices and corresponding screen casting data; a long press of the screen casting button sends a device query command to query currently online screen casting transmitters that are already connected (powered and awaiting pairing or already paired devices). Once a powered screen casting transmitter is identified, the device list is transmitted to the screen casting receiver by long-pressing the screen casting button. The screen casting receiver's screen casting protocol displays this device list on the display terminal. Switching can be achieved by clicking the screen casting button on this interface. After switching, short presses (affecting the current device stream data), long presses (affecting the current data stream device), and continuous button presses can be used to switch devices and interact quickly.

[0055] Step S300: The projection terminal receives the first real-time data stream and decodes the first real-time data stream to obtain the first display content.

[0056] Because the screen mirroring terminal has a built-in screen mirroring receiver, after the receiver is plugged into the USB or Type-C port on the terminal, the terminal will display a message searching for the screen mirroring pen and receiver. If the screen mirroring transmitter, receiver, and pen are successfully paired, the terminal will display a message indicating that they have been paired. If pairing fails, the terminal will prompt the user to try again and provide instructions on how to connect the screen mirroring transmitter, as well as interactive instructions for the screen mirroring pen, receiver, and transmitter, reducing the learning curve for users.

[0057] For example, such as Figure 2 As described above, the screen projection terminal in this embodiment is a laptop computer. The laptop computer plays a PPT presentation. When the user is in a meeting, he writes content on the commercial display terminal and sends the first real-time data stream over based on the screen projection transmitter. After receiving the first real-time data stream, the screen projection receiver on the laptop computer decodes the first real-time data stream to obtain the first display content.

[0058] Furthermore, in this embodiment, the screen-casting terminal receives screen-casting pairing request information sent by the screen-casting transmitter and completes screen-casting pairing. Then, based on the screen-casting transmitter, it receives the first real-time data stream and decodes it to obtain the first display content. While decoding the first real-time data stream, it also obtains the display mode sent by the screen-casting transmitter so as to perform screen-casting display according to the display mode.

[0059] Step S400: The projection terminal acquires the second real-time data stream in real time. The second real-time data stream reflects the second display content on the display window of the projection terminal.

[0060] Once the projection terminal receives the first real-time data stream, it will begin receiving the second real-time data stream. This second real-time data stream reflects the second display content on the projection terminal's display window. For example, if the projection terminal is displaying a PowerPoint presentation, then the second display content will be the content of the PowerPoint presentation.

[0061] Step S500: The projection terminal merges the first real-time data stream and the second real-time data stream and projects them onto a preset display terminal for display.

[0062] Specifically, the projection terminal mixes and encodes the first display content corresponding to the first real-time data stream and the second display content corresponding to the second real-time data stream according to the projection display mode to obtain a mixed-encoded data stream. Then, the mixed-encoded data stream is projected onto the display terminal for display. For example, if the projection display mode is a small-window display mode, the first display content of the commercial display terminal is displayed in a small window, and the second display content of the projection terminal is displayed in a large window. Thus, the display terminal will display the first and second display contents using this projection display mode. Furthermore, the projection control pen in this embodiment is equipped with page-up and page-down buttons, allowing direct control of the projection terminal for page turning via these buttons.

[0063] Therefore, in this embodiment, the commercial display terminal receives a projection command and obtains a first real-time data stream according to the projection command. The first real-time data stream reflects the first display content on the display window of the commercial display terminal. The commercial display terminal sends the first real-time data stream to the projection terminal. The projection terminal receives the first real-time data stream and decodes it to obtain the first display content. The projection terminal obtains a second real-time data stream in real time, which reflects the second display content on the display window of the projection terminal. The projection terminal merges the first real-time data stream and the second real-time data stream and projects them onto a preset display terminal for display. Thus, this embodiment can merge the first content displayed on the commercial display terminal and the second content displayed on the projection terminal onto the display terminal, thereby meeting the user's need to merge and project the display content from multiple terminals, providing convenience for the user.

[0064] Exemplary System

[0065] Based on the above embodiments, the present invention provides a multi-device integrated screen projection and interaction system, such as... Figure 2As shown, the system includes a commercial display terminal 10 and a projection terminal 20 corresponding to the commercial display terminal 10. Specifically, the commercial display terminal 10 includes: a first acquisition module 101 and a first transmission module 102. The first acquisition module 101 is used to receive a projection command and acquire a first real-time data stream according to the projection command. The first real-time data stream reflects the first display content on the display window of the commercial display terminal. The first transmission module 102 is used to send the first real-time data stream to the projection terminal, so that the projection terminal acquires a second real-time data stream and merges the first real-time data stream and the second real-time data stream to project onto a preset display terminal. The second real-time data stream reflects the second display content on the display window of the projection terminal.

[0066] In one implementation, the projection terminal 20 includes: a first content acquisition module, a second content acquisition module 20, and a fusion projection control module 30. Specifically, the first content acquisition module 20 is used to receive the first real-time data stream and decode it to obtain first display content. The second content acquisition module 20 is used to acquire a second real-time data stream in real time, the second real-time data stream reflecting the second display content on the display window of the projection terminal. The fusion projection control module 30 is used to fuse the first real-time data stream and the second real-time data stream and project them to a preset display terminal for display.

[0067] The working principle of each module in the multi-device fusion projection interaction system of this embodiment is the same as that of each step in the above method embodiment, and will not be repeated here.

[0068] Based on the above embodiments, the present invention also provides a terminal device, the principle block diagram of which is shown in Figure 4. The terminal device can be a commercial display terminal or a screen projection terminal. The terminal device may include one or more processors 100. Figure 4 (Only one is shown in the image), a memory 101, and a computer program 102 stored in the memory 101 and executable on one or more processors 100, such as a program for multi-device converged screen projection interaction. When one or more processors 100 execute the computer program 102, they can implement the various steps in the method embodiment of multi-device converged screen projection interaction. Alternatively, when one or more processors 100 execute the computer program 102, they can implement the functions of each module / unit in the apparatus embodiment of multi-device converged screen projection interaction, which is not limited here.

[0069] In one embodiment, the processor 100 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0070] In one embodiment, memory 101 may be an internal storage unit of an electronic device, such as a hard drive or RAM. Memory 101 may also be an external storage device of the electronic device, such as a plug-in hard drive, smart media card (SMC), secure digital (SD) card, flash card, etc. Furthermore, memory 101 may include both internal and external storage units. Memory 101 is used to store computer programs and other programs and data required by the terminal device. Memory 101 can also be used to temporarily store data that has been output or will be output.

[0071] Those skilled in the art will understand that Figure 4 The block diagram shown is merely a partial structural diagram related to the present invention and does not constitute a limitation on the terminal device to which the present invention is applied. The specific terminal device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0072] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the methods described above. Any references to memory, storage, operational databases, or other media used in the embodiments provided by this invention can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual operating data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0073] In summary, this invention discloses a multi-device integrated screen projection interaction method, system, terminal device, and storage medium. The method includes: a commercial display terminal receiving a screen projection command and acquiring a first real-time data stream according to the command, the first real-time data stream reflecting a first display content on the display window of the commercial display terminal; the commercial display terminal sending the first real-time data stream to the screen projection terminal; the screen projection terminal receiving the first real-time data stream and decoding it to obtain the first display content; the screen projection terminal acquiring a second real-time data stream in real time, the second real-time data stream reflecting a second display content on the display window of the screen projection terminal; and the screen projection terminal integrating the first real-time data stream and the second real-time data stream and projecting them onto a preset display terminal for display. Therefore, this invention can achieve the integration and projection of display content from two terminals' display windows to meet user needs.

[0074] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A multi-device integrated screen projection interaction method, characterized in that, The multi-device fusion projection interaction method is applied to a commercial display terminal in a multi-device fusion projection interaction system. The multi-device fusion projection interaction system includes the commercial display terminal and a projection terminal corresponding to the commercial display terminal. The method includes: Receive a screen projection command and obtain a first real-time data stream according to the screen projection command. The first real-time data stream reflects the first display content on the display window of the commercial display terminal. The first real-time data stream is sent to the projection terminal so that the projection terminal can obtain the second real-time data stream and merge the first real-time data stream and the second real-time data stream to project onto a preset display terminal. The second real-time data stream reflects the second display content on the display window of the projection terminal. The step of receiving the screen mirroring command and obtaining the first real-time data stream according to the screen mirroring command includes: The screen projection transmitter on the commercial display terminal receives the screen projection command and parses the screen projection command to obtain the device information in the screen projection command; based on the device information, the screen projection terminal is determined, and a screen projection pairing request information is sent to the screen projection terminal based on the screen projection transmitter; the content displayed on the display window is acquired in real time, and the content displayed on the display window is packaged to form the first real-time data stream; The method further includes: receiving a mode switching instruction based on the screen projection transmitter, switching the screen projection display mode according to the mode switching instruction, and sending the switched screen projection display mode to the screen projection terminal; Sending the switched projection display mode to the projection terminal includes: after switching modes, the projection protocol is re-encoded and transmitted, and the data stream is encoded and then decoded by the data transmission path and displayed on the spliced ​​screen on the display terminal.

2. A multi-device integrated screen projection interaction method, characterized in that, The multi-device integrated screen projection interaction method is applied to a screen projection terminal in a multi-device integrated screen projection interaction system. The multi-device integrated screen projection interaction system includes a commercial display terminal and a screen projection terminal corresponding to the commercial display terminal. The method includes: Receive the first real-time data stream and decode the first real-time data stream to obtain the first display content; The second real-time data stream is acquired in real time, and the second real-time data stream reflects the second display content on the display window of the projection terminal; The process of fusing the first real-time data stream and the second real-time data stream and projecting them onto a preset display terminal includes: mixing and encoding the first display content corresponding to the first real-time data stream and the second display content corresponding to the second real-time data stream according to the projection display mode to obtain a mixed-encoded data stream; and projecting the mixed-encoded data stream onto the display terminal for projection display.

3. The multi-device integrated screen projection interaction method according to claim 2, characterized in that, The step of receiving the first real-time data stream and decoding the first real-time data stream to obtain the first display content includes: The screen mirroring receiver on the screen mirroring terminal receives the screen mirroring pairing request information sent by the screen mirroring transmitter and completes the screen mirroring pairing. The first real-time data stream is received by the screen projection transmitter, and the first real-time data stream is decoded to obtain the first display content.

4. The multi-device integrated screen projection interaction method according to claim 3, characterized in that, The screen mirroring receiver and the screen mirroring transmitter are pre-paired, and the screen mirroring transmitter and the screen mirroring receiver are respectively paired and connected to a preset screen mirroring triggering device.

5. A multi-device integrated screen projection and interaction system, characterized in that, The system includes a commercial display terminal and a screen projection terminal corresponding to the commercial display terminal, wherein... The commercial display terminal includes: The first acquisition module is used to receive a screen projection command and acquire a first real-time data stream according to the screen projection command. Specifically, it includes: receiving the screen projection command based on the screen projection transmitter on the commercial display terminal, parsing the screen projection command to obtain device information in the screen projection command; determining the screen projection terminal based on the device information, and sending screen projection pairing request information to the screen projection terminal based on the screen projection transmitter; acquiring the content displayed on the display window in real time, and packaging the content displayed on the display window to form the first real-time data stream; the first real-time data stream reflects the first display content on the display window of the commercial display terminal. The first sending module is configured to send the first real-time data stream to the projection terminal, so that the projection terminal can acquire the second real-time data stream and merge the first real-time data stream and the second real-time data stream to project onto a preset display terminal, wherein the second real-time data stream reflects the second display content on the display window of the projection terminal; based on the projection transmitter receiving a mode switching instruction, the projection display mode is switched according to the mode switching instruction, and the switched projection display mode is sent to the projection terminal; The screen projection terminal includes: The first content acquisition module is used to receive the first real-time data stream and decode the first real-time data stream to obtain the first display content; The second content acquisition module is used to acquire a second real-time data stream in real time, which reflects the second display content on the display window of the projection terminal. The fusion projection control module is used to fuse the first real-time data stream and the second real-time data stream and project them onto a preset display terminal for display. Specifically, it includes: mixing and encoding the first display content corresponding to the first real-time data stream and the second display content corresponding to the second real-time data stream according to the projection display mode to obtain a mixed encoded data stream; and projecting the mixed encoded data stream onto the display terminal for display.

6. A terminal device, characterized in that, The terminal device is a commercial display terminal or a projection terminal. The terminal device includes a memory, a processor, and a multi-device fusion projection interaction program stored in the memory and capable of running on the processor. When the processor executes the multi-device fusion projection interaction program, it implements the steps of the multi-device fusion projection interaction method as described in any one of claims 1-4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a multi-device integrated screen projection interaction program, which, when executed by a processor, implements the steps of the multi-device integrated screen projection interaction method as described in any one of claims 1-4.

Images