Screen projection display method and system, terminal and medium

Abstract

The invention discloses a projection screen display method and system, a terminal and a medium, and the method comprises the steps: building a projection screen connection through a transmitting end, and transmitting the projection screen content to a receiving end; and after the receiving end receives the screen projection content, dividing a display screen of the receiving end into a first area and a second area according to the screen projection content, displaying the screen projection content in the first area, and displaying the content of a local window of the receiving end in the second area. According to the invention, the screen of the receiving end is intelligently divided into two independent areas for respectively displaying the screen projection content and the local window content of the receiving end, so that the problem that the screen projection picture and the local interface cannot be simultaneously displayed on the same screen is solved, the user experience is enhanced, and the working efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of terminal technology, and in particular to a screen projection display method, system, terminal, and medium. Background Art

[0002] In the field of screen projection technology, screen projection methods are mainly divided into two modes: one-to-one and one-to-many. In these two modes, the common practice is to display the content of the projection source in full screen on the receiving device. Although some advanced solutions provide reverse control functions for the projection end, these solutions generally lack an important flexibility - that is, they cannot display the projection window from the remote side and the window of the local device itself on the same screen at the same time. This limitation hinders the user's need to perform other local operations while using the screen projection function.

[0003] Therefore, the prior art still needs to be improved and enhanced. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a screen projection display method, system, terminal and medium in response to the above-mentioned defects of the prior art, aiming to solve the problem that the existing screen projection method does not support the simultaneous display of the projection window and the local window on the projected end.

[0005] In order to solve the above technical problems, the technical solution adopted by the present invention is as follows:

[0006] In a first aspect, the present invention provides a screen projection display method, wherein the method comprises:

[0007] Establish a screen projection connection through the sender and send the projection content to the receiver;

[0008] After the receiving end receives the projected screen content, the display screen of the receiving end is divided into a first area and a second area according to the projected screen content, the projected screen content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area.

[0009] In one implementation, establishing a screen projection connection through a transmitting end includes:

[0010] The window module interface is called by the sending end to create a first virtual window, where the first virtual window is used to capture and prepare content that needs to be projected.

[0011] In one implementation, the receiving end receives the screen projection content, which includes:

[0012] When the sending end establishes a screen projection connection, the receiving end calls the window module interface to create a second virtual window, which is used to receive and manage the screen projection content sent from the sending end.

[0013] In one implementation, establishing a screen projection connection through a sending end and sending the screen projection content to a receiving end includes:

[0014] Call the makeMi rror interface on the sending end to create a screen projection;

[0015] Utilize the graphics module of the sending end to render the projection content on the first virtual window, and send the rendered projection content to the multimedia module of the sending end;

[0016] The sending end calls the encoding and decoding module of the multimedia module to encode the rendered screen content and package it;

[0017] The sending end sends the packaged projection content to the receiving end through the soft bus.

[0018] In one implementation, the receiving end receives the screen projection content, including:

[0019] Receive the projection content sent by the sending end through the soft bus of the receiving end, and transmit the projection content to the distributed module of the receiving end;

[0020] Transmit the screen projection content processed by the distributed module of the receiving end to the multimedia decoding module of the receiving end;

[0021] After the projection content is decoded by the multimedia decoding module of the receiving end, the decoded projection content is stored in the buffer of the second virtual window of the receiving end.

[0022] In one implementation, dividing the receiving end display screen into a first area and a second area according to the projection content includes:

[0023] Determining the type of the projected screen content according to the decoded projected screen content in the buffer of the second virtual window;

[0024] Dividing a first area on the display screen of the receiving end according to the type and a preset area division rule;

[0025] All spaces on the display screen of the receiving end except the first area are set as the second area.

[0026] In one implementation, displaying the projection content in the first area and displaying the content of the local window of the receiving end in the second area includes:

[0027] Using the graphics module of the receiving end, the decoded projection content in the buffer of the second virtual window is displayed in the first area of ​​the display screen of the receiving end, and the content of the local window of the receiving end is displayed in the second area of ​​the display screen of the receiving end.

[0028] In a second aspect, an embodiment of the present invention further provides a screen projection display system, wherein the system comprises:

[0029] The screen projection content sending module is used to establish a screen projection connection through the sending end and send the screen projection content to the receiving end;

[0030] The division and display module is used to divide the display screen of the receiving end into a first area and a second area according to the projected content after the receiving end receives the projected content, display the projected content in the first area, and display the content of the local window of the receiving end in the second area.

[0031] In a third aspect, an embodiment of the present invention further provides a terminal, wherein the terminal includes a memory, a processor, and a screen projection display program stored in the memory and capable of running on the processor, and when the processor executes the screen projection display program, the steps of the screen projection display method of any one of the above-mentioned schemes are implemented.

[0032] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein a screen projection display program is stored on the computer-readable storage medium, and when the screen projection display program is executed by a processor, the steps of the screen projection display method described in any one of the above schemes are implemented.

[0033] Beneficial effects: The present invention provides a screen projection display method. Compared with the prior art, the present invention first establishes a screen projection connection through the sending end, and sends the projection content to the receiving end. This process ensures the stability and efficiency of content transmission, reduces delays or disconnections caused by network instability, and provides users with a reliable screen projection foundation. Then, when the receiving end receives the projection content, the display screen of the receiving end is divided into a first area and a second area according to the projection content. This intelligent partitioning method makes reasonable use of the screen space, avoids the problem of information coverage in the traditional full-screen display mode, and improves the flexibility and efficiency of screen use. Finally, the projection content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area. This method allows users to operate local applications or files while viewing remote shared content, greatly improving work efficiency. The present invention simultaneously displays the projected screen content and the local window content on the receiving end, so that users can compare and edit content more intuitively without frequently switching windows or devices, thereby simplifying the operation process, improving the user's interactive experience, and solving the problems of low screen utilization and poor user experience in traditional screen projection technology. It also improves the flexibility and efficiency of information display, bringing a convenient experience to users, and is particularly suitable for complex application scenarios that need to process multiple information sources simultaneously. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A flowchart of a specific implementation of the screen projection display method provided in an embodiment of the present invention.

[0035] Figure 2 A flowchart of sending projection content in the projection display method provided in an embodiment of the present invention.

[0036] Figure 3 A flowchart for simultaneously displaying projection content and local window content in the projection display method provided in an embodiment of the present invention.

[0037] Figure 4 It is a principle block diagram of the screen projection display system provided by an embodiment of the present invention.

[0038] Figure 5 This is a block diagram of the internal structure principle of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0040] In the field of screen projection technology, screen projection methods are mainly divided into two modes: one-to-one and one-to-many. In these two modes, the common practice is to display the content of the projection source in full screen on the receiving device. Although some advanced solutions provide reverse control functions for the projection end, these solutions generally lack an important flexibility - that is, they cannot display the projection window from the remote side and the window of the local device itself on the same screen at the same time. This limitation hinders the user's need to perform other local operations while using the screen projection function.

[0041] In order to solve the above problems, this embodiment provides a screen projection display method. During specific implementation, this embodiment first establishes a screen projection connection through the sending end, and sends the projection content to the receiving end. This process ensures the stability and efficiency of content transmission, reduces delays or disconnections caused by network instability, and provides users with a reliable screen projection foundation. Then, when the receiving end receives the projection content, the display screen of the receiving end is divided into a first area and a second area according to the projection content. This intelligent partitioning method makes reasonable use of the screen space, avoids the problem of information coverage in the traditional full-screen display mode, and improves the flexibility and efficiency of screen use. Finally, the projection content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area. This method allows users to operate local applications or files while viewing remote shared content, greatly improving work efficiency. The present invention simultaneously displays the projected screen content and the local window content on the receiving end, so that users can compare and edit content more intuitively without frequently switching windows or devices, thereby simplifying the operation process, improving the user's interactive experience, and solving the problems of low screen utilization and poor user experience in traditional screen projection technology. It also improves the flexibility and efficiency of information display, bringing a convenient experience to users, and is particularly suitable for complex application scenarios that need to process multiple information sources simultaneously.

[0042] For example, suppose a teacher is preparing an online course. He hopes to display the courseware content and operate other teaching tools on the computer in real time during the teaching process, such as an electronic whiteboard or reference materials. At this time, the teacher can adopt the method proposed by the present invention. First, the teacher establishes a screen projection connection through the sending end (such as a laptop) and sends the courseware content to the receiving end (such as a large screen in the classroom). This step ensures the stability and efficiency of content transmission, reduces the delay or disconnection caused by network instability, and lays a solid foundation for subsequent teaching activities. Next, when the receiving end receives the courseware content, it will intelligently divide the large screen into two areas according to the size and layout of the content: the first area is used to display the courseware content, and the second area is used to display the local window content of the receiving end, such as an electronic whiteboard or reference materials. This process not only optimizes the use of screen space, but also avoids the problem of information coverage in the traditional full-screen display mode, so that the teacher can also perform real-time annotation or search for information in the second area while explaining the courseware, without frequently switching windows or devices, which greatly improves the fluency and interactivity of teaching. Finally, while displaying the courseware content in the first area, the local window content of the receiving end, such as an electronic whiteboard or reference materials, is displayed in the second area. This dual-screen display method not only enables students to clearly see the courseware content and the teacher's operation on the same screen, but also helps to better understand and absorb the course content, thereby improving the interactivity and teaching effect of the classroom. The screen projection display method provided by the present invention not only solves the problems of low screen utilization and poor user experience in traditional screen projection technology, but also improves the flexibility and efficiency of information display. Teachers can display courseware content and local operations on the same screen at the same time, reducing the trouble of switching windows and improving the continuity and interactivity of teaching. In addition, the high adaptability and extensibility of the method make it suitable for a variety of teaching scenarios, whether it is an online course or an offline lecture, it can effectively improve the teaching quality and students' learning experience. In short, the present invention provides a more efficient and convenient solution for modern teaching, which is particularly suitable for complex application scenarios that need to process multiple information sources at the same time.

[0043] The screen projection display method provided in this embodiment can be applied to smart terminals, such as Figure 1 As shown in , the specific steps include:

[0044] Step S100: establish a screen projection connection through the sending end, and send the screen projection content to the receiving end.

[0045] In this embodiment, first, a screen projection connection is established through a transmitting end (such as a smart phone, laptop, tablet computer, etc.), and the projection content (such as video, document, game screen, etc.) is sent to a receiving end (such as a TV, projector, display, etc.). Specifically, the transmitting end establishes a secure and reliable connection with the receiving end through wireless or wired means, supports multiple screen projection standards (such as Miracast, AirPlay, Chromecast, etc.), and is compatible with various devices and operating systems. During the transmission process, data compression and error correction mechanisms are adopted to reduce the delay and packet loss rate of data transmission, and ensure the integrity and fluency of the content. Through these technical means, the present invention ensures the stability and efficiency of the screen projection connection, provides a smoother and higher-quality screen projection experience, and provides users with a seamless, high-quality screen projection solution in a variety of scenarios (such as home entertainment, office presentations, education and training, etc.).

[0046] Specifically, Figure 2 As shown in , the step S100 includes the following steps:

[0047] Step S101, the sender calls the makeMi rror interface to establish screen projection;

[0048] Step S102: Render the projection content on the first virtual window using the graphics module of the sending end, and send the rendered projection content to the multimedia module of the sending end;

[0049] Step S103: The sending end calls the encoding and decoding module of the multimedia module to encode the rendered screen projection content and perform packaging processing;

[0050] Step S104: Use the sending end to send the packaged projection content to the receiving end through the soft bus.

[0051] In one implementation, before the sender establishes a screen projection connection, the sender calls the window module interface to create a first virtual window, which is used to capture and prepare the content to be projected. Specifically, the sender creates an independent virtual window by calling the window module interface provided by the operating system. The window can be a transparent overlay layer located above all windows currently operated by the user, or it can be an independent window, and the user can freely adjust its size and position. In the virtual window, the user can select the application window, desktop area or specific content that needs to be projected, such as video, document, game screen, etc. In this way, the system can efficiently capture the content specified by the user and pre-process it, such as resolution adjustment, format conversion, etc., to ensure that the content maintains high quality and low latency during transmission. This method not only simplifies the capture and preparation of screen projection content, improves the accuracy and efficiency of capture, but also provides a high degree of flexibility and customization capabilities, supports multiple operating systems and devices, ensures wide applicability, and reduces the difficulty of operation and improves the user experience.

[0052] In one implementation, a screen projection connection is established through the sending end, and the screen projection content is sent to the receiving end. Specifically, first, the screen projection connection is established by calling the makeMi rror interface through the sending end to ensure that a stable and efficient connection can be quickly established between the sending end and the receiving end. Then, the graphics module of the sending end is used to render the screen projection content on the first virtual window. The first virtual window is used as an independent container specifically for capturing and preparing the content that needs to be projected. The user can select the application window, desktop area or specific content that needs to be projected, such as video, document, game screen, etc. The graphics module is responsible for efficiently rendering these contents into the first virtual window to ensure the clarity and fluency of the content. Then, the codec module of the multimedia module is called by the sending end to encode the rendered screen projection content and perform packaging processing. The codec module uses advanced compression algorithms (such as H.264 or H.265), which effectively reduces the amount of data and improves transmission efficiency while maintaining high-quality visual effects. The packaging process ensures that the data is in a unified format during transmission, which is convenient for parsing and processing at the receiving end. Finally, the sending end sends the packaged projection content to the receiving end through the soft bus. As an efficient data transmission channel, the soft bus supports multiple transmission protocols (such as Wi-Fi, Bluetooth, etc.) to ensure the stability and low latency of data transmission. Through these technical means, the present invention not only simplifies the establishment of projection connection and the transmission process of content, but also provides an efficient, high-quality, and low-latency projection experience, which is suitable for a variety of application scenarios, such as home entertainment, office presentations, education and training, etc.

[0053] Step S200: After the receiving end receives the projected screen content, the display screen of the receiving end is divided into a first area and a second area according to the projected screen content, the projected screen content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area.

[0054] In this embodiment, first, after the receiving end receives the projected content, the display screen of the receiving end is divided into a first area and a second area according to the projected content, and the display screen is divided into two independent areas, ensuring efficient use of the screen space and avoiding the problem of information coverage in the traditional full-screen display mode. Then, the projected content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area, meeting different usage requirements, such as watching a remote meeting or video in the first area while operating a local document or browser in the second area, supporting multi-tasking, and improving work efficiency and user experience. Through these technical means, the present invention not only efficiently utilizes the screen space and avoids the problem of information coverage, but also supports multi-tasking, improving work efficiency and user experience.

[0055] Specifically, Figure 3 As shown in , the step S200 includes the following steps:

[0056] Step S201: receiving the projection content sent by the sending end through the soft bus of the receiving end, and transmitting the projection content to the distributed module of the receiving end;

[0057] Step S202: transmitting the screen projection content processed by the distributed module of the receiving end to the multimedia decoding module of the receiving end;

[0058] Step S203: After decoding the projection content using the multimedia decoding module of the receiving end, the decoded projection content is stored in the buffer of the second virtual window of the receiving end;

[0059] Step S204: determining the type of the projection content according to the decoded projection content in the buffer of the second virtual window;

[0060] Step S205: dividing a first area on the display screen of the receiving end according to the type and a preset area division rule;

[0061] Step S206, setting all spaces on the display screen of the receiving end except the first area as the second area;

[0062] Step S207, using the graphics module of the receiving end, display the decoded projection content in the buffer of the second virtual window in the first area of ​​the display screen of the receiving end, and display the content of the local window of the receiving end in the second area of ​​the display screen of the receiving end.

[0063] In one implementation, before the receiving end receives the projected screen content, it includes: when the sending end establishes a projection connection, the receiving end calls the window module interface to create a second virtual window, and the second virtual window is used to receive and manage the projection content sent from the sending end. Specifically, when the sending end initiates a projection connection request and successfully establishes a connection, the receiving end creates an independent second virtual window by calling the window module interface provided by the operating system. This virtual window serves as a dedicated container specifically for receiving and managing projection content, which simplifies the reception and management of projection content.

[0064] In one implementation, first, the transmitter sends the projection content to the receiver through a soft bus (such as Wi-Fi, Bluetooth, etc.). The receiver receives the data through the soft bus module and transmits it to the distributed module of the receiver. As an efficient data transmission channel, the soft bus supports multiple transmission protocols to ensure the stability and low latency of data transmission. For example, in a home entertainment scenario, users can project movies on their mobile phones to the TV via Wi-Fi and enjoy a high-definition and smooth viewing experience. Next, the distributed module of the receiver performs preliminary processing and distribution of the received data. Specifically, the distributed module checks the integrity of the data packet, handles any possible errors, and arranges the data packets in order to ensure the integrity and consistency of the data, laying the foundation for subsequent processing. For example, in an office presentation, the distributed module can ensure that all projection content is transmitted losslessly to the large screen in the conference room to avoid data loss or damage. Subsequently, the projected screen content processed by the distributed module is transmitted to the multimedia decoding module at the receiving end. The multimedia decoding module decodes the projected screen content and stores the decoded projected screen content in the buffer of the second virtual window of the receiving end. The multimedia decoding module adopts an efficient decoding algorithm to ensure that the decoded content is of high quality and fast processing speed. Efficient decoding algorithms include but are not limited to H.264 / AVC, H.265 / HEVC, VP9 and AV1. These algorithms use a variety of technical means (such as intra-frame prediction, inter-frame prediction, transform coding, adaptive loop filtering, etc.) to achieve efficient compression and decoding. For example, in the game screen projection scenario, the efficient decoding algorithm can ensure the smoothness and low latency of the game screen, and provide a better gaming experience.Then, based on the decoded projection content in the buffer of the second virtual window, the type of the projection content is determined, such as video, document, game screen, etc. Specifically, the decoded data will be analyzed, and the type will be determined based on its format and content characteristics. First, through file format analysis, the file header or metadata of the decoded content is checked to identify the file format. For example, video files (such as MP4, AVI) usually have specific file header identifiers, and document files (such as PDF, DOCX) also have corresponding format identifiers; secondly, content feature analysis is performed to perform image and video feature analysis on the decoded content. For example, video content usually contains continuous frames. sequence, while the document content contains text and static images; in addition, the metadata information of the decoded content is parsed, such as resolution, frame rate, encoding format, etc. These metadata information further confirm the content type. For example, video content usually has high resolution and high frame rate, document content usually has low resolution and 0 frame rate, and game screen usually has high resolution and high frame rate; through these technical means, the present invention can determine the type of screen projection content, provide a basis for subsequent area division, and ensure the reasonable display of content. For example, in education and training, it can be identified whether the screen projection content is PPT or video, so as to reasonably allocate the display area on the screen and provide a better user experience. Then, according to the type and the preset area division rule, the first area is divided on the display screen of the receiving end, and all spaces on the display screen of the receiving end except the first area are set as the second area. The preset area division rules can be flexibly set according to different types of content. For example, video content usually occupies 70% to 80% of the screen area and is located in the center or above the screen; document content usually occupies 50% to 60% of the screen area and is located in the center or left of the screen; game screens usually occupy 80% to 90% of the screen area and are located in the center or above the screen. Through these technical means, the present invention can reasonably divide the first area and the second area on the display screen of the receiving end according to the type and the preset area division rules, ensure the integrity and clarity of the projection content, intelligently divide the display screen into two independent areas, efficiently utilize the screen space, and avoid the problem of information coverage. For example, in remote collaboration, the first area can display the screen of the remote meeting, and the second area can display local notes or documents, which is convenient for users to record key points while watching the meeting. Finally, the decoded projection content in the buffer of the second virtual window is displayed in the first area of ​​the display screen of the receiving end using the graphics module of the receiving end. Specifically, the graphics module reads the decoded content in the buffer and renders it into the first area to ensure the integrity and clarity of the projection content and provide a high-quality visual experience.And the content of the local window of the receiving end is displayed in the second area of ​​the display screen of the receiving end. Specifically, the graphics module will read the content of the local window and render it in the second area. The user can continue to operate the local application while watching the projection content, which improves work efficiency and user experience. For example, in an office presentation, the user can display PPT in the first area while operating other applications on the computer in the second area, such as a browser or email client, to facilitate access to information or reply to emails. Through these technical means, the present invention not only ensures the efficient reception and decoding of the projection content, but also intelligently divides the display screen into two independent areas, efficiently utilizes the screen space, and avoids the problem of information coverage. At the same time, it supports multi-tasking, which improves work efficiency and user experience. The method has a high degree of flexibility and customization capabilities, supports a variety of operating systems and devices, and is suitable for a variety of application scenarios, such as home entertainment, office presentations, education and training, etc., bringing users a more convenient and smooth user experience.

[0065] In one implementation, the display screen of the receiving end supports users to perform multiple operations to provide a more flexible and convenient user experience. Specifically, the user can trigger the split-screen function by long pressing any window on the display screen of the receiving end. After long pressing, the window displaying the projected content and the window displaying the local content will automatically split the screen, with the window displaying the projected content on the left and the window displaying the local content on the right. This operation method is simple and intuitive, and users can quickly achieve split screen without complicated settings. In split-screen mode, when the user slides the window displaying the projected content on the left, the window is fixed and will not move with the sliding operation, ensuring the stability of the projected content and avoiding content shifting due to misoperation, especially when watching videos or game screens. It is very important to maintain the continuity and stability of the content. When the user slides the window displaying local content on the right, the window can operate normally, and the user can scroll, zoom in, zoom out or perform other interactive operations to ensure the normal use of the window displaying local content, improving the ability of multi-tasking. In addition, the user can exit the split-screen mode and return to the single-screen display state by double-clicking the window on the left that displays the projected content or the window on the right that displays the local content. The double-click operation is simple and quick, and the user can easily switch between the split-screen and single-screen modes, which improves the flexibility of use. Through these technical means, the present invention not only provides flexible split-screen operation, but also ensures the stability of the projected content and the normal operation of the local window, significantly improving the user experience, and is suitable for a variety of application scenarios, such as home entertainment, office presentations, education and training, etc.

[0066] In summary, this embodiment first establishes a screen projection connection through the sending end, and sends the projection content to the receiving end. This process ensures the stability and efficiency of content transmission, reduces delays or disconnection problems caused by network instability, and provides users with a reliable screen projection foundation. Then, when the receiving end receives the projection content, the display screen of the receiving end is divided into a first area and a second area according to the projection content. This intelligent partitioning method makes reasonable use of the screen space, avoids the problem of information coverage in the traditional full-screen display mode, and improves the flexibility and efficiency of screen use. Finally, the projection content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area. This method allows users to operate local applications or files while viewing remote shared content, greatly improving work efficiency. The present invention simultaneously displays the projected screen content and the local window content on the receiving end, so that users can compare and edit content more intuitively without frequently switching windows or devices, thereby simplifying the operation process, improving the user's interactive experience, and solving the problems of low screen utilization and poor user experience in traditional screen projection technology. It also improves the flexibility and efficiency of information display, bringing a convenient experience to users, and is particularly suitable for complex application scenarios that need to process multiple information sources simultaneously.

[0067] like Figure 4 As shown in , this embodiment also provides a screen projection display system, which includes: a screen projection content sending module 10 and a division and display module 20. Specifically, the screen projection content sending module 10 is used to establish a screen projection connection through the sending end and send the screen projection content to the receiving end. The division and display module block 20 is used to divide the display screen of the receiving end into a first area and a second area according to the screen projection content after the receiving end receives the screen projection content, display the screen projection content in the first area, and display the content of the local window of the receiving end in the second area.

[0068] In one implementation, the screen projection content sending module 10 includes:

[0069] The screen projection establishment unit is used to establish the screen projection by calling the makeMi rror interface through the sending end;

[0070] A rendering and sending unit, used to render the projection content on the first virtual window using the graphics module of the sending end, and send the rendered projection content to the multimedia module of the sending end;

[0071] The encoding and packaging unit is used to encode the rendered screen projection content and perform packaging processing by calling the encoding and decoding module of the multimedia module through the sending end;

[0072] The sending unit is used to use the sending end to send the packaged projection content to the receiving end through the soft bus.

[0073] In one implementation, the display module 20 includes:

[0074] A receiving and transmitting unit, used to receive the projection content sent by the transmitting end through the soft bus of the receiving end, and transmit the projection content to the distributed module of the receiving end;

[0075] A transmission and distribution unit, used to transmit the projection content processed by the distributed module of the receiving end to the multimedia decoding module of the receiving end;

[0076] A decoding and caching unit, used to decode the projection content using the multimedia decoding module of the receiving end, and then store the decoded projection content in the buffer of the second virtual window of the receiving end;

[0077] a type identification unit, configured to determine the type of the projection content according to the decoded projection content in the buffer of the second virtual window;

[0078] A region division unit, configured to divide a first region on the display screen of the receiving end according to the type and a preset region division rule;

[0079] An area setting unit, used to set all spaces on the display screen of the receiving end except the first area as the second area;

[0080] The display unit is used to display the decoded projection content in the buffer of the second virtual window in the first area of ​​the display screen of the receiving end, and to display the content of the local window of the receiving end in the second area of ​​the display screen of the receiving end using the graphics module of the receiving end.

[0081] In one implementation, the system also includes a first virtual window creation module, which is used to create a first virtual window by calling the window module interface by the sending end before the sending end establishes a screen projection connection. The first virtual window is used to capture and prepare content to be projected.

[0082] In one implementation, the system also includes a second virtual window creation module, which is used to create a second virtual window by calling the window module interface through the receiving end when the sending end establishes a screen projection connection before the receiving end receives the projected screen content. The second virtual window is used to receive and manage the projected screen content sent from the sending end.

[0083] The working principles of each module in the screen projection display system of this embodiment are the same as the principles of each step in the above method embodiment, and will not be repeated here.

[0084] Based on the above embodiment, the present invention further provides a terminal, the principle block diagram of the terminal can be as follows: Figure 5 The terminal may include one or more processors 100 ( Figure 5 Only one is shown), a memory 101 and a computer program 102 stored in the memory 101 and executable on one or more processors 100, for example, a screen projection display program. When one or more processors 100 execute the computer program 102, the various steps in the screen projection display method embodiment can be implemented. Alternatively, when one or more processors 100 execute the computer program 102, the functions of the various modules / units in the screen projection display method embodiment can be implemented, which is not limited here.

[0085] In one embodiment, the processor 100 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0086] In one embodiment, the memory 101 may be an internal storage unit of an electronic device, such as a hard disk or memory of the electronic device. The memory 101 may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device. Further, the memory 101 may also include both an internal storage unit of the electronic device and an external storage device. The memory 101 is used to store computer programs and other programs and data required by the terminal. The memory 101 may also be used to temporarily store data that has been output or is to be output.

[0087] Those skilled in the art will understand that Figure 5 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present invention, and does not constitute a limitation on the terminal to which the scheme of the present invention is applied. The specific terminal may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0088] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, operating database or other media used in the embodiments provided by the present invention may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double operational data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0089] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A screen projection display method, characterized in that: The method comprises: Establish a screen projection connection through the sender and send the projection content to the receiver; After the receiving end receives the projected screen content, the display screen of the receiving end is divided into a first area and a second area according to the projected screen content, the projected screen content is displayed in the first area, and the content of the local window of the receiving end is displayed in the second area.

2. The screen projection display method according to claim 1, characterized in that: The screen projection connection is established by the sending end, and the following steps are previously included: The window module interface is called by the sending end to create a first virtual window, where the first virtual window is used to capture and prepare content that needs to be projected.

3. The screen projection display method according to claim 2, characterized in that: The receiving end receives the screen projection content, which includes: When the sending end establishes a screen projection connection, the receiving end calls the window module interface to create a second virtual window, which is used to receive and manage the screen projection content sent from the sending end.

4. The screen projection display method according to claim 3, characterized in that: The step of establishing a screen projection connection through the sending end and sending the screen projection content to the receiving end includes: Call the makeMirror interface on the sending end to create a screen projection; Utilize the graphics module of the sending end to render the projection content on the first virtual window, and send the rendered projection content to the multimedia module of the sending end; The sending end calls the encoding and decoding module of the multimedia module to encode the rendered screen content and package it; The sending end sends the packaged projection content to the receiving end through the soft bus.

5. The screen projection display method according to claim 4, characterized in that: The receiving end receives the screen projection content, including: Receive the projection content sent by the sending end through the soft bus of the receiving end, and transmit the projection content to the distributed module of the receiving end; Transmit the screen projection content processed by the distributed module of the receiving end to the multimedia decoding module of the receiving end; After the projection content is decoded by the multimedia decoding module of the receiving end, the decoded projection content is stored in the buffer of the second virtual window of the receiving end.

6. The screen projection display method according to claim 5, characterized in that: The step of dividing the receiving end display screen into a first area and a second area according to the projection content includes: Determining the type of the projected screen content according to the decoded projected screen content in the buffer of the second virtual window; Dividing a first area on the display screen of the receiving end according to the type and a preset area division rule; All spaces on the display screen of the receiving end except the first area are set as the second area.

7. The screen projection display method according to claim 6, characterized in that: The displaying the projection content in the first area and displaying the content of the local window of the receiving end in the second area includes: Using the graphics module of the receiving end, the decoded projection content in the buffer of the second virtual window is displayed in the first area of ​​the display screen of the receiving end, and the content of the local window of the receiving end is displayed in the second area of ​​the display screen of the receiving end.

8. A screen projection display system, characterized in that: The system comprises: The screen projection content sending module is used to establish a screen projection connection through the sending end and send the screen projection content to the receiving end; The division and display module is used to divide the display screen of the receiving end into a first area and a second area according to the projected content after the receiving end receives the projected content, display the projected content in the first area, and display the content of the local window of the receiving end in the second area.

9. A terminal, characterized in that: The terminal includes a memory, a processor, and a screen projection display program stored in the memory and executable on the processor. When the processor executes the screen projection display program, the steps of the screen projection display method as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a screen projection display program, and when the screen projection display program is executed by the processor, the steps of the screen projection display method as described in any one of claims 1-7 are implemented.

Images