Multi-person screen projection directional screen capturing method and device, electronic equipment and storage medium

Abstract

Embodiments of the present application disclose a multi-person screen projection directional screenshot method and device, electronic equipment and a storage medium. The method is used for a screen projection server, which comprises: receiving a screen projection video stream sent by at least one client terminal in a multi-client terminal cooperative operation process; sending a thumbnail of the screen projection video stream to each client terminal for display, the thumbnail being displayed in the same information block of a cooperative interaction interface, and each thumbnail corresponding to a screenshot control; receiving a screenshot instruction generated by triggering the screenshot control in the cooperative interaction interface, obtaining a thumbnail identifier corresponding to the screenshot instruction; according to the thumbnail identifier, cutting a frame image from the corresponding screen projection video stream, and sending the frame image to a request terminal for display, the request terminal being the client terminal sending the screenshot instruction. The present scheme realizes directional and autonomous screenshot of a user on a client terminal for multiple screen projection.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of interactive technology, and in particular to a method, apparatus, electronic device and storage medium for targeted screenshot of multi-person screen projection. Background Technology

[0002] In information technology-based meeting scenarios, multiple people often discuss key information displayed on the meeting equipment. During this discussion, multiple people may simultaneously project their screens, and the currently displayed screen will switch according to the progress of the meeting.

[0003] During multi-person screen sharing, participants in the meeting may need to save a particular screen share. Existing technical solutions can only take screenshots of the currently displayed screen by operating the screen sharing display device; users cannot independently take targeted screenshots of the screen data. Summary of the Invention

[0004] This invention provides a method, apparatus, electronic device, and storage medium for targeted screenshotting of multiple users' screens, in order to solve the technical problem that existing users cannot perform targeted screenshotting of screen data independently.

[0005] In a first aspect, embodiments of the present invention provide a method for targeted screenshotting in multi-person screen mirroring, used on a screen mirroring server, including:

[0006] Receive screen-projected video streams sent by at least one client terminal during collaborative operation of multiple client terminals;

[0007] The thumbnail of the projected video stream is sent to each of the client terminals for display. The thumbnail is displayed in the same information block of the collaborative interaction interface, and each thumbnail has a corresponding screenshot control.

[0008] Receive a screenshot command generated by the screenshot control triggered on the collaborative interaction interface, and obtain the thumbnail identifier corresponding to the screenshot command;

[0009] According to the thumbnail identifier, a frame image is captured from the corresponding screen-casting video stream, and the frame image is sent to the requesting terminal for display. The requesting terminal is the client terminal that sends the screenshot command.

[0010] Secondly, embodiments of the present invention also provide a targeted screenshot device for multi-person screen projection, used on a screen projection server, comprising:

[0011] The video stream receiving unit is used to receive the screen-projected video stream sent by at least one client terminal during the collaborative operation of multiple client terminals.

[0012] The thumbnail sending unit is used to send thumbnails of the projected video stream to each of the client terminals for display. The thumbnails are displayed in the same information block of the collaborative interaction interface, and each thumbnail has a corresponding screenshot control.

[0013] A screenshot instruction receiving unit is used to receive a screenshot instruction generated by the screenshot control triggered on the collaborative interaction interface, and to obtain the thumbnail identifier corresponding to the screenshot instruction;

[0014] The screenshot sending unit is used to capture a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to the requesting terminal for display. The requesting terminal is a client terminal that sends the screenshot command.

[0015] Thirdly, embodiments of the present invention also provide an electronic device, comprising:

[0016] One or more processors;

[0017] Memory, used to store one or more programs;

[0018] When the one or more programs are executed by the one or more processors, the electronic device enables the targeted screenshot method for multi-person screen projection as described in the first aspect.

[0019] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the multi-person screen-casting targeted screenshot method as described in the first aspect.

[0020] The aforementioned method, apparatus, electronic device, and storage medium for targeted screenshotting in multi-user screen mirroring, the method being used on a screen mirroring server, includes: receiving a screen mirroring video stream sent by at least one client terminal during collaborative operation of multiple client terminals; sending thumbnails of the screen mirroring video stream to each of the client terminals for display, the thumbnails being displayed in the same information block on the collaborative interaction interface, each thumbnail corresponding to a screenshot control; receiving a screenshot command generated by the screenshot control on the collaborative interaction interface, and obtaining a thumbnail identifier corresponding to the screenshot command; capturing a frame image from the corresponding screen mirroring video stream according to the thumbnail identifier, and sending the frame image to a requesting terminal for display, the requesting terminal being the client terminal that sent the screenshot command. By sending the screen mirroring video stream to each client terminal for preview display in thumbnail format via the screen mirroring server, and allowing users to send screenshot commands via the screenshot controls in the thumbnails, the screen mirroring server captures the corresponding frame image according to the screenshot command and sends it to the corresponding client terminal, enabling users to take targeted, autonomous screenshots of multiple screen mirroring streams on their client terminals. Attached Figure Description

[0021] Figure 1A flowchart illustrating a method for targeted screenshotting via multi-person screen sharing, provided in an embodiment of the present invention;

[0022] Figure 2 This is a schematic diagram of the interactive flat panel interface.

[0023] Figure 3 This is a schematic diagram of the architecture of the interactive tablet and the client terminal during collaborative interaction in an embodiment of the present invention;

[0024] Figure 4 This is an illustration of clicking the screenshot control in a thumbnail.

[0025] Figure 5 This is an illustration of clicking a thumbnail in a collaborative interaction interface.

[0026] Figure 6 This is a diagram illustrating clicking the screenshot control in the preview image;

[0027] Figure 7 This is a schematic diagram of a directional screenshot device for multi-user screen sharing provided in an embodiment of the present invention;

[0028] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0029] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and not for limiting the invention. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention and not the entire structure.

[0030] It should be noted that, due to space limitations, this application specification does not exhaustively list all possible implementation methods. Those skilled in the art should be able to conceive after reading this application specification that, as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method.

[0031] The embodiments are described in detail below.

[0032] Figure 1 A flowchart of a method for targeted screenshotting via multi-person screen mirroring provided in this embodiment of the invention is shown in the figure. The method includes:

[0033] Step S110: Receive the screen-projected video stream sent by at least one client terminal during the collaborative operation of multiple client terminals.

[0034] In multi-person interactive scenarios such as meetings, teaching, discussions, and brainstorming, information transmission between multiple participants has historically been achieved through speech, sight, and hearing. This information transmission can provide participants with a good communication experience, but the recording of information during the communication process depends on the participants' personal habits and abilities, and the actual information transmitted may be lost.

[0035] With the development of information technology, there are richer means of information display and recording in multi-person interactive scenarios, especially multi-person interaction based on interactive whiteboards. Each participant can concentrate the content they need to display on the interactive whiteboard, and receive and save various information in the collaborative communication process on the interactive whiteboard.

[0036] The interactive flat panel mentioned in this solution can be an integrated device that uses touch technology to control the content displayed on the display flat panel and realize human-computer interaction. It integrates one or more functions such as projector, electronic whiteboard, screen, audio, television and video conferencing terminal.

[0037] Generally speaking, such as Figure 2 As shown, the interactive flat panel 11 includes at least one display screen 12. For example, the interactive flat panel 11 is equipped with a touch-enabled display screen 12, which can be a capacitive screen, a resistive screen, or an electromagnetic screen. In this embodiment, the user can further perform touch operations by touching the display screen 12 with a finger or a stylus. Correspondingly, the interactive flat panel 12 detects the touch position and responds according to the touch position to realize the touch function. Typically, the interactive flat panel 11 is equipped with at least one operating system, which includes, but is not limited to, Android, Linux, and Windows systems.

[0038] Interactive whiteboards, primarily designed to support multi-person communication scenarios, utilize software designed to fulfill the functional requirements of such scenarios. For example, an interactive whiteboard can install at least one application with document presentation capabilities. This application can be a pre-installed application on the operating system or downloaded from third-party devices or servers. Optionally, in addition to displaying pre-edited content, the document presentation application may offer other editing functions during the presentation, such as inserting tables, images, graphics, and drawing tables and graphs. This allows for real-time display of user information input and the presentation of input content, thereby enhancing the information display and interactive experience during document presentations. For instance, an interactive whiteboard can also install at least one application with whiteboard functionality, enabling users to write, modify, and save notes in real-time during collaborative communication scenarios.

[0039] In this solution, to further improve the convenience of file transfer in multi-person communication scenarios, the interactive whiteboard can install an application to receive and display the projected screen, thereby enabling its use... Figure 3 The architecture shown supports data transmission in multi-person communication scenarios. This means that one or more participants in a multi-person communication scenario connect their client terminals to the interactive whiteboard. The data foundation for all collaborative interactions performed by participants on their client terminals is the collaboration platform. In other words, each participant's client terminal no longer only transmits data to the interactive whiteboard 11, and the interactive whiteboard 11 is no longer the sole data aggregation point in a multi-person communication scenario. Each client terminal, while maintaining the necessary connection to the interactive whiteboard 11, also needs a data connection to the collaboration platform. This ensures that each client terminal's operations and corresponding data during multi-person communication are comprehensively recorded and managed on the collaboration platform, which is built on a server. The collaboration platform can be understood as a platform that manages all operations and corresponding data during collaborative interactions in the background. The collaborative interaction application interface can be understood as the interface on the client terminal where users interact with the data from the background management platform. Figure 3 In the specific scenario shown, the client terminal can be either a personal computer 21 or a mobile terminal 22. A single participant can connect to either the personal computer 21 or the mobile terminal 22, or connect to both simultaneously. During the interaction, participants send content files that need to be displayed on the interactive whiteboard 11 to the whiteboard 11, or display them directly on their client terminals and project them onto the interactive whiteboard 11. With this architecture, multi-person communication is no longer solely focused on the interactive whiteboard 11; instead, all participants operate on their respective client terminals to achieve better communication results. The multi-person communication process is also a collaborative interaction process.

[0040] like Figure 4 As shown, participants perform collaborative interactions on their client terminals. These interactions specifically include all operations performed by participants in a multi-person communication scenario, involving information exchange with the interactive whiteboard, other client terminals, and themselves. During the collaborative interaction process, all file or data exchange with the interactive whiteboard and other participants is completed within a single application interface 30, which is the collaborative interaction application interface 30. This application interface specifically enables operations such as file transfer, file reception, screen mirroring, video initiation, video connection, whiteboard interaction, and subsequent operations for multi-person communication, including data aggregation and display.

[0041] In collaborative interactions, the user base for all data generation is groups. A group includes multiple user identifiers, each corresponding to a participant. A user identifier can join different groups. The application interface for a user identifier can display all the groups that user identifier has joined. Receiving the first activation operation involves confirming which group's data is currently being displayed. Group information is stored on a dedicated server that provides data storage for collaborative interactions. This server also stores all associated data generated based on collaborative interactions within the group and is used to provide data transmission services between various client terminals.

[0042] Screen mirroring from client terminals is a crucial aspect of data transmission services. In this solution, when taking screenshots during multi-user screen mirroring, the video stream sent by the client terminal is aggregated and processed at different screen mirroring servers depending on the connection method. For example, in one approach, the screen mirroring server is an interactive flat panel, and the client terminal is connected to the interactive flat panel via the same local area network (LAN). The client terminal sends the video stream to the interactive flat panel via the LAN, and the interactive flat panel also sends data back to the client terminal via the LAN. All data from the entire multi-user collaboration process is sent by the interactive flat panel to a collaboration platform located on a server for unified storage and management. In another approach, the screen mirroring server is a server, and the client terminal is connected to the server via a wide area network (WAN). The client terminal sends the video stream to the server via the WAN, and the server also sends data back to the client terminal via the WAN. The server also sends the currently displayed screen mirroring data to the interactive flat panel via the WAN and receives data generated on the interactive flat panel during multi-user collaboration. All data from the entire multi-user collaboration process is stored and managed uniformly by the server.

[0043] Step S120: Send the thumbnail of the projected video stream to each of the client terminals for display. The thumbnail is displayed in the same information block of the collaborative interaction interface, and each thumbnail has a corresponding screenshot control.

[0044] Collaborative interaction on the client terminal is achieved through a collaborative interaction interface. Participants in a multi-person collaboration process are organized into groups, and each group corresponds to a group record interface. The collaborative interaction interface displays the corresponding group record interface based on the current collaborative group. Data generated by each group is displayed in the group record interface in chronological order as information blocks, with each information block displaying one data point. For example... Figure 4As shown, the group recording interface 33 displays basic information about the XXX project communication group, such as the group topic, the last modified time, and multiple collaboration controls 34. These collaboration controls 34 allow each participant to centrally record collaborative interactions that support multi-person communication. For example, the file control, note control, and whiteboard control allow users to upload files, add notes, and write on the whiteboard, respectively. In existing technologies, file uploads may require copying or online transfer to the interactive whiteboard, or uploading during scheduled multi-user communication to serve as the focus of communication for other participants to view in advance; note addition may require a dedicated note-editing application; and whiteboard writing can only be achieved through separate whiteboard software. In this solution, all operations are triggered in the group recording interface 33, thus enabling all operations, including the corresponding data, to be recorded in the group recording interface 33.

[0045] In multi-person interaction, the data currently projected is also a type of data generated by the group. When a group is engaged in multi-person interaction, at least one client terminal is in projection mode. After the projection video stream of the client terminal in projection mode is sent to the projection server, the projection server processes all received video streams according to the operations on the interactive flat panel and client terminals. The basic operation on the client terminal is that the projection server generates a corresponding thumbnail based on the projection video stream and sends the thumbnail to the client terminal for display. The thumbnail also displays a screenshot control. When the screenshot control detects a triggered operation, it confirms that the corresponding instruction has been received. The thumbnail can be a static image, an image updated periodically according to the projection video stream, or an image that is synchronously updated in real time according to the projection video stream.

[0046] like Figure 4 As shown, assuming that when the XXX project communication group is conducting multi-person interaction, there are 3 client terminals in the screen projection state. After the screen projection video stream corresponding to each client terminal is sent to the screen projection server, the screen projection server generates a corresponding thumbnail 321 for all received screen projection video streams, and then sends the thumbnail 321 to the client terminal for display. Specifically, it is displayed in the information block 32 of the corresponding group record interface 33 in the collaborative interaction interface 30. Each thumbnail 321 also has a screenshot control 322.

[0047] Step S130: Receive a screenshot command generated by the screenshot control triggered on the collaborative interaction interface, and obtain the thumbnail identifier corresponding to the screenshot command.

[0048] like Figure 4As shown, if a trigger operation is detected in the screenshot control 322 of the thumbnail 321 corresponding to screen projection 1, such as a mouse click, shortcut key selection, or touch operation selection detected in the display area of ​​the screenshot control 322, it is considered that a trigger operation performed by the corresponding participant has been received. The client terminal then generates a screenshot command for screen projection 1 and sends the screenshot command to the screen projection server. The screen projection server receives the screenshot command and obtains the thumbnail identifier (e.g., screen projection 1) corresponding to the screenshot command.

[0049] In the specific implementation process, the screenshot command generation on the client terminal can be further achieved through the following interaction process:

[0050] The client terminal receives a preview command generated from the thumbnail, displays a preview image corresponding to the thumbnail, and the screenshot control is displayed in the preview image;

[0051] Receive a screenshot command generated by the screenshot control triggered in the preview image.

[0052] like Figure 5 As shown, the thumbnail 321 displayed on the client terminal may be too small for the user to clearly see the specific content in the thumbnail 322. In this case, a trigger operation received in the display area of ​​the thumbnail 321 can confirm the receipt of the preview command. Responding to the preview command, the preview image 321' corresponding to the thumbnail 321 is displayed in the information block 32, providing a clearer display of the projected content within a larger window, making it easier for the user to confirm the screenshot target. The screenshot control 322 is also adjusted to be displayed in the preview image 321', and the screenshot command continues to be generated in the screenshot control 322.

[0053] Step S140: Capture a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to the requesting terminal for display. The requesting terminal is the client terminal that sent the screenshot command.

[0054] The corresponding screen-casting video stream is identified based on the thumbnail identifier. Then, frame images are captured from the screen-casting video stream. The specific screenshotting, sending, and display process can be achieved using existing image processing and transmission technologies. Therefore, the underlying screenshotting and transmission process will not be explained here.

[0055] Considering that the screen sharing content of another participant is being captured, in order to ensure information protection, the following steps are taken to confirm the screenshot before executing step S140:

[0056] A screenshot request is generated according to the screenshot instruction, and the screenshot request is sent to the client terminal corresponding to the thumbnail identifier for display on the collaborative interaction interface;

[0057] Confirm that the screenshot request has been received on the collaborative interaction interface.

[0058] After receiving the screenshot instruction, the screen mirroring server generates a screenshot request and sends it to the client terminal corresponding to the thumbnail identifier, which is the target client terminal for the screenshot. After confirming receipt of the client terminal's confirmation, the screenshot is taken and sent.

[0059] Adapted to the multi-person collaborative design based on the collaborative interaction interface in this solution, the screenshots are also data generated during the collaborative interaction process, and the corresponding received frame images are also displayed in the newly created information block on the collaborative interaction interface.

[0060] The frame images are saved sequentially in the storage space corresponding to the user identifier of the requesting terminal login. When the user identifier logs in on the client terminal, the data in the corresponding storage space is displayed sequentially in the corresponding information block on the collaborative interaction interface. In group collaborative interaction, data processing may be a continuous process, such as whiteboard input, which continues until input is no longer necessary or the communication process ends. In this process, only one whiteboard file is generated and recorded in a corresponding information block, which is recorded sequentially in the group records. Based on this, the orderly recording of data throughout the collaborative interaction process has been achieved. Users can quickly obtain all communication process behaviors and corresponding data generated by multiple users in sequence by accessing the collaborative interaction application interface, shortening the lengthy operation chain in the file transfer process and improving the efficiency of information flow.

[0061] The above method, used in a screen mirroring server, includes: receiving a screen mirroring video stream sent by at least one client terminal during collaborative operation of multiple client terminals; sending thumbnails of the screen mirroring video stream to each of the client terminals for display, wherein the thumbnails are displayed in the same information block on the collaborative interaction interface, and each thumbnail displays a corresponding screenshot control; receiving a screenshot command generated by the screenshot control on the collaborative interaction interface, and obtaining a thumbnail identifier corresponding to the screenshot command; capturing a frame image from the corresponding screen mirroring video stream according to the thumbnail identifier, and sending the frame image to a requesting terminal for display, wherein the requesting terminal is the client terminal that sent the screenshot command. By sending the screen mirroring video stream to each client terminal for preview display in thumbnail format through the screen mirroring server, and allowing users to send screenshot commands through the screenshot controls in the thumbnails, the screen mirroring server captures the corresponding frame image according to the screenshot command and sends it to the corresponding client terminal, enabling users to perform targeted and autonomous screenshots of multiple screen mirroring streams on their client terminals.

[0062] Figure 7 This is a schematic diagram of a directional screenshot device for multi-user screen sharing provided in an embodiment of the present invention. (Reference) Figure 7The multi-person screen-casting directional screenshot device includes: a video stream receiving unit 210, a thumbnail sending unit 220, a screenshot instruction receiving unit 230, and a screenshot sending unit 240.

[0063] The system includes a video stream receiving unit 210, used to receive a projected video stream sent by at least one client terminal during collaborative operation of multiple client terminals; a thumbnail sending unit 220, used to send thumbnails of the projected video stream to each client terminal for display, wherein the thumbnails are displayed in the same information block on the collaborative interaction interface, and each thumbnail corresponds to a screenshot control; a screenshot instruction receiving unit 230, used to receive a screenshot instruction generated by the screenshot control triggered on the collaborative interaction interface, and obtain the thumbnail identifier corresponding to the screenshot instruction; and a screenshot sending unit 240, used to extract a frame image from the corresponding projected video stream according to the thumbnail identifier, and send the frame image to the requesting terminal for display, wherein the requesting terminal is the client terminal that sent the screenshot instruction.

[0064] Based on the above embodiments, the screenshot command is generated in the following manner:

[0065] The client terminal receives a preview command generated from the thumbnail, displays a preview image corresponding to the thumbnail, and the screenshot control is displayed in the preview image;

[0066] Receive a screenshot command generated by the screenshot control triggered in the preview image.

[0067] Based on the above embodiments, the device further includes:

[0068] A screenshot request sending unit is used to generate a screenshot request according to the screenshot instruction, and send the screenshot request to the client terminal corresponding to the thumbnail identifier for display on the collaborative interaction interface;

[0069] The screenshot operation confirmation unit is used to confirm that a confirmation operation for the screenshot request has been received on the collaborative interaction interface.

[0070] Based on the above embodiments, the frame image is displayed in the newly created information block of the collaborative interaction interface.

[0071] Based on the above embodiments, the frame images are saved sequentially in the storage space corresponding to the user identifier of the requesting terminal login;

[0072] When a user logs in on a client terminal, the data in the corresponding storage space is displayed in the corresponding information block on the collaborative interaction interface in chronological order.

[0073] Based on the above embodiments, the screen projection server is an interactive flat panel, and the client terminal is connected to the interactive flat panel through the same local area network.

[0074] Based on the above embodiments, the screen projection server is a server, and the client terminal is connected to the server via a wide area network.

[0075] The multi-person screen projection targeted screenshot device provided in this embodiment of the invention is included in an electronic device and can be used to execute any of the multi-person screen projection targeted screenshot methods provided in the above embodiments, and has corresponding functions and beneficial effects.

[0076] It is worth noting that in the above embodiments of the multi-person screen projection targeted screenshot device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0077] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Figure 8 As shown, the electronic device includes a processor 310, a memory 320, an input device 330, an output device 340, and a communication device 350; the number of processors 310 in the electronic device can be one or more. Figure 8 Taking a processor 310 as an example; the processor 310, memory 320, input device 330, output device 340, and communication device 350 in the electronic device can be connected via a bus or other means. Figure 8 Taking the example of a connection between China and Israel via a bus.

[0078] The memory 320, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the multi-person screen-casting directional screenshot method in this embodiment of the invention (e.g., the video stream receiving unit 210, thumbnail sending unit 220, screenshot instruction receiving unit 230, and screenshot sending unit 240 in the multi-person screen-casting directional screenshot device). The processor 310 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the memory 320, thereby realizing the aforementioned multi-person screen-casting directional screenshot method.

[0079] The memory 320 may primarily include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a given function; the data storage area may store data created based on the use of the electronic device. Furthermore, the memory 320 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 320 may further include memory remotely located relative to the processor 310, which can be connected to the electronic device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0080] Input device 330 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the electronic device. Output device 340 may include display devices such as a display screen.

[0081] The aforementioned electronic device includes a targeted screenshot device for multi-person screen projection, which can be used to perform targeted screenshot methods for screen projection by any number of people, and has corresponding functions and beneficial effects.

[0082] This invention also provides a storage medium containing computer-executable instructions. When executed by a computer processor, the computer-executable instructions are used to perform relevant operations in the multi-person screen-casting targeted screenshot method provided in any embodiment of this application, and have corresponding functions and beneficial effects.

[0083] Those skilled in the art will understand that embodiments of this application may be provided as methods, systems, or computer program products.

[0084] Therefore, this application may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, produce implementations of the flowchart... Figure 1 One or more processes and / or boxes Figure 1The computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The functions specified in one or more boxes. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable apparatus for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0085] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0086] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0087] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0088] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. A method for targeted screenshotting in multi-user screen mirroring, used on a screen mirroring server, characterized in that, include: Receive screen-projected video streams sent by at least one client terminal during collaborative operation of multiple client terminals; The thumbnail of the projected video stream is sent to each of the client terminals for display. The thumbnail is displayed in the same information block of the collaborative interaction interface of the client terminal, and a screenshot control is displayed in each thumbnail. Receive a screenshot command generated by the screenshot control triggered on the collaborative interaction interface, and obtain the thumbnail identifier corresponding to the screenshot command; According to the thumbnail identifier, a frame image is captured from the corresponding screen-casting video stream, and the frame image is sent to the requesting terminal for display. The requesting terminal is the client terminal that sends the screenshot command.

2. The method according to claim 1, characterized in that, The screenshot command is generated in the following way: The client terminal receives a preview command generated from the thumbnail, displays a preview image corresponding to the thumbnail, and the screenshot control is displayed in the preview image; Receive a screenshot command generated by the screenshot control triggered in the preview image.

3. The method according to claim 1, characterized in that, Before extracting a frame image from the corresponding projected video stream based on the thumbnail identifier and sending the frame image to the requesting terminal for display, the method further includes: A screenshot request is generated according to the screenshot instruction, and the screenshot request is sent to the client terminal corresponding to the thumbnail identifier for display on the collaborative interaction interface; Confirm that the screenshot request has been received on the collaborative interaction interface.

4. The method according to claim 1, characterized in that, The frame image is displayed in the newly created information block of the collaborative interaction interface.

5. The method according to claim 4, characterized in that, The frame images are saved sequentially in the storage space corresponding to the user identifier of the requesting terminal login. When a user logs in on a client terminal, the data in the corresponding storage space is displayed in the corresponding information block on the collaborative interaction interface in chronological order.

6. The method according to claim 1, characterized in that, The screen projection server is an interactive flat panel, and the client terminal is connected to the interactive flat panel via the same local area network.

7. The method according to claim 1, characterized in that, The screen mirroring server is a server, and the client terminal is connected to the server via a wide area network.

8. A directional screenshot device for multi-user screen mirroring, used on a screen mirroring server, characterized in that, include: The video stream receiving unit is used to receive the screen-projected video stream sent by at least one client terminal during the collaborative operation of multiple client terminals. The thumbnail sending unit is used to send thumbnails of the projected video stream to each of the client terminals for display. The thumbnails are displayed in the same information block of the collaborative interaction interface of the client terminals, and each thumbnail has a corresponding screenshot control. A screenshot instruction receiving unit is used to receive a screenshot instruction generated by the screenshot control triggered on the collaborative interaction interface, and to obtain the thumbnail identifier corresponding to the screenshot instruction; The screenshot sending unit is used to capture a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to the requesting terminal for display. The requesting terminal is a client terminal that sends the screenshot command.

9. An electronic device, characterized in that, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the electronic device implements the multi-person screen projection directional screenshot method as described in any one of claims 1-7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the targeted screenshot method for multi-person screen projection as described in any one of claims 1-7.

Images