Multi-screen interactive method based on data stream, computer device and storage medium

Abstract

The present invention discloses a multi-screen interaction method based on data stream, a computer device and a storage medium, including receiving target screen projection data and an operable permission list sent by a main control screen projection terminal; displaying the target screen projection data on a display screen; receiving a target operation request for operating the target screen projection data sent by a current operation terminal, the target operation request including a target operation; if the current operation terminal is a main control screen projection terminal, the target operation is executed and a first operation result is displayed; if the current operation terminal is a participating screen projection terminal, the target operation is authenticated based on the operable permission list to obtain an authentication result, and when the authentication result is authentication passed, the target screen projection data is operated based on the target operation to obtain a second operation result. Both multi-terminal interaction and the security of target screen projection data can be ensured.

Description

Technical Field

[0001] The present invention relates to the field of screen projection technology, and in particular to a multi-screen interaction method based on data stream, a computer device and a storage medium. Background Art

[0002] Screen projection is the use of a large-screen display to display specific content so that multiple people can watch it.

[0003] At present, although the existing screen projection method can connect multiple participating screen projection terminals to the display terminal to watch the content displayed on the display terminal, what is displayed on the display terminal is usually video stream data. The process of the participating screen projection terminal sending the video stream to the display terminal for display requires a large bandwidth, which can easily cause the display screen to become stuck; and when the participating screen projection terminal views personal software and other operations, the screen will also be recorded in real time, which can easily leak the user's personal information. Summary of the invention

[0004] The embodiments of the present invention provide a multi-screen interaction method based on data stream, a computer device and a storage medium to solve the problems of freeze in the display screen and easy leakage of user's personal information.

[0005] A multi-screen interactive method based on data stream is applied in a multi-terminal screen projection system, wherein the multi-terminal screen projection system includes a display terminal and N participating screen projection terminals connected to the display terminal; the multi-screen interactive method based on data stream includes the following steps performed by the display terminal:

[0006] Receive the target screen projection data and operable permission list sent by the main control screen projection end;

[0007] Display the target screen projection data on a display screen;

[0008] Receiving a target operation request sent by the current operation terminal to operate the target projection screen data, wherein the target operation request includes a target operation;

[0009] If the current operating end is the main control screen projection end, the target operation is executed and the first operation result is displayed;

[0010] If the current operating end is the end participating in the screen projection, the target operation is authenticated based on the operable permission list to obtain an authentication result. When the authentication result is that the authentication is passed, the target screen projection data is operated based on the target operation to obtain a second operation result.

[0011] A computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the multi-screen interaction method based on instruction stream when executing the computer program.

[0012] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the multi-screen interaction method based on instruction stream.

[0013] The above-mentioned multi-screen interactive method, computer device and storage medium based on data stream receive the target screen projection data and the operable permission list sent by the main control screen projection end; display the target screen projection data on the display screen; the display end uses its own target software to open the target screen projection data to ensure smooth display of the target screen projection data; compared with the traditional display end receiving the video stream of the main control screen projection end for screen projection, it can effectively reduce bandwidth loss and avoid display screen freeze. When the current operating end is the main control screen projection end, the target operation is executed and the first operation result is displayed; when the current operating end is the participating screen projection end, the target operation is authenticated based on the operable permission list to obtain the authentication result. When the authentication result is authentication passed, the target screen projection data is operated based on the target operation to obtain the second operation result. Only when the authentication result is authentication passed, the target operation is operated on the target screen projection data, which can ensure both multi-end interaction and the security of the target screen projection data. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0015] Figure 1 is a structural diagram of a multi-screen interactive system based on data streams in one embodiment of the present invention;

[0016] Figure 2 is a flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0017] Figure 3 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0018] Figure 4 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0019] Figure 5 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0020] Figure 6 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0021] Figure 7 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0022] Figure 8 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0023] Fig. 9 is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention;

[0024] Fig.10 This is another flow chart of a multi-screen interaction method based on data stream in one embodiment of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] The multi-terminal screen projection method provided by the embodiment of the present invention is applied to Figure 1 In the multi-end screen projection system shown, the multi-end screen projection system includes a display end and N participating screen projection ends connected to the display end. The display end can be installed on but not limited to hardware carriers such as a TV and a box. Among them, the box needs to be connected to the display via HDMI to display on the display; the TV can display directly. The participating screen projection ends can be installed on but not limited to various personal computers, laptops, smart phones, tablets and portable wearable device display ends. Among them, N is greater than or equal to 2.

[0027] In one embodiment, if Figure 2 As shown, a multi-screen interaction method based on data stream is provided, and the method is applied in Figure 1 The following steps are used as an example to illustrate the display end in FIG. 1 :

[0028] S201: Receive the target screen projection data and the operable permission list sent by the main control screen projection terminal.

[0029] The main control screen projection end refers to the screen projection end that displays the target screen projection data through the display end at the current moment. It can be understood that the main control screen projection end is one of the N participating screen projection ends.

[0030] The target screen projection data is the data displayed on the display end. The target screen projection data includes but is not limited to file data, game interface, image data and video data.

[0031] The operational permission list is used to indicate whether the display end executes the target operations sent by the participating screen projection end.

[0032] In this embodiment, screen projection software is installed on the participating screen projection terminals and the display terminal; the user clicks on the screen projection software on the participating screen projection terminal to enter the login interface, and fills in the user ID, user position, user company and verification password in the login interface to perform identity authentication; when the verification is passed, the screen projection interface of the screen projection software is entered; the screen projection software on the display terminal displays connection methods such as QR code, digital code input, and NFC touch; multiple participating screen projection terminals can be connected to the display terminal by scanning QR code, inputting digital code and NFC touch; after each participating screen projection terminal is successfully connected, the user can click the screen projection button on the screen projection interface to generate a target screen projection request carrying screen projection request information to achieve multi-terminal screen projection.

[0033] When the display end receives the target screen projection request.

[0034] As an example, the display end obtains the current screen projection status; if the current screen projection status is the screen projection status, the participating screen projection end that is currently projecting the screen is determined as the current screen projection end; based on the screen projection request information corresponding to at least one target screen projection request, a screen projection switching request is generated; the screen projection switching request is sent to the current screen projection end; if a consent instruction carrying the target terminal identifier is received from the current screen projection end based on the screen projection switching request feedback, the master screen projection end is determined based on the target terminal identifier; if no consent instruction carrying the target terminal identifier is received from the current screen projection end based on the screen projection switching request feedback, a screen projection sequence is formed based on the screen projection request information corresponding to at least one target screen projection request; based on the screen projection sequence, the master screen projection end is determined to provide support for subsequent screen projections to ensure the continuity of the screen projection. When the current screen projection state is the waiting screen projection state, the display end can process the screen projection request information corresponding to each target screen projection request to form a screen projection data chain corresponding to each target screen projection request, and the screen projection data chain includes the participating screen projection end identification, the screen projection theme and the user information corresponding to the participating screen projection end; and generate a screen projection switching request carrying the screen projection data chain, so that the user corresponding to the current screen projection end can determine whether to switch the screen projection based on the screen projection data chain. It can be understood that the user corresponding to the current screen projection end can determine whether to switch based on the participating screen projection end identification, the screen projection theme, the user position, the user department, the user company and other information; and when the user corresponding to the current screen projection end agrees to switch, the target terminal identification of the participating screen projection end can also be sent to the display end, so that the display end can determine the main control screen projection end according to the target screen projection terminal identification, thereby ensuring the continuity of the displayed content and realizing multi-end mutual screen projection.

[0035] As an example, the screen projection request information includes user information such as user identification, user position and user company.

[0036] When there is one target screen projection request, the participating screen projection end that sends the target screen projection request will be determined as the main control screen projection end.

[0037] When there are at least two target projection requests, the user information in the projection request information corresponding to each target projection request is processed to determine a master projection terminal from multiple participating projection terminals to achieve flexible scheduling and meet the projection requirements of different participating projection terminals. The user information includes user identification, user position and user company.

[0038] When the main control screen projection end is determined, the display end sends a screen projection data acquisition request to the main control screen projection end, so that the main control screen projection end sends the target screen projection data and the operational permission list based on the screen projection data acquisition request.

[0039] Furthermore, the user information in the screen projection request information corresponding to each target screen projection request is processed to determine a master screen projection terminal from multiple participating screen projection terminals, including: determining the screen projection priority of the screen projection request information based on the user information, wherein the user information includes user position, user department, user company, etc.; then the higher the user position, the higher the screen projection priority corresponding to the screen projection request information sent by it; conversely, the lower the user position, the lower the screen projection priority corresponding to the screen projection request information sent by it. The greater the authority of the user department, the higher the screen projection priority corresponding to the screen projection request information sent by it, for example, the screen projection priority of the management department is greater than the screen projection priority of the business department; the greater the authority of the user company, the higher the screen projection priority corresponding to the screen projection request information sent by it, for example, the screen projection priority of the parent company is greater than the screen projection priority of the subsidiary, so as to ensure the continuity of the screen projection.

[0040] S202: Display the target projection data on the display screen.

[0041] In this embodiment, the display terminal opens the target software corresponding to the target projection data to display the target projection data using the target software. The display terminal uses its own target software to open the target projection data to ensure smooth display of the target projection data; compared with the traditional display terminal receiving the video stream of the main control projection terminal for projection, it can effectively reduce bandwidth loss and avoid display screen freezes.

[0042] S203: Receive a target operation request for operating the target projection data sent by the current operation terminal, where the target operation request includes a target operation.

[0043] The target operation request is a request from the current operation end to the display end to operate the target projection data. The target operation is an operation that the current operation end wants the display end to process the target projection data. For example, the target operation includes but is not limited to page turning operation, image zoom operation, volume adjustment operation, progress adjustment operation, download operation and screenshot operation.

[0044] S204: If the current operating end is the main control projection end, execute the target operation and display the first operation result.

[0045] Among them, the first operation result is the result obtained when the current operating end is the main control screen projection end, and the display end executes the target operation sent by the main control screen projection end on the target software corresponding to the target screen projection data. It can be understood that since the target screen projection data itself is sent by the main control screen projection end, the main control screen projection end can directly perform the target operation on the target screen projection data, and there is no risk of data leakage.

[0046] Among them, the current operating end is the main screen projection end, or the participating screen projection end.

[0047] As an example, the operational permission list includes an authorized user identifier and an authorized operation option corresponding to the authorized user identifier; wherein the authorized user identifier is an identifier corresponding to a user granted by the main control projection end to the participating projection end to operate the target projection data. The authorized operation option is an option that the authorized user identifier can operate on the target projection data. Exemplarily, the authorized operation option can be a page turning operation, a volume amplification operation, and the like. The authorized user identifier can be used to uniquely identify a company, a business department, a user, and the like, which are not used here. For example, the authorized user identifier can be xx company, which is used to uniquely identify a company.

[0048] The target operation request also includes an operation user identifier; the display end queries the operable permission list, and when the operation user identifier matches the authorized user identifier in the operable permission list, the current operation end corresponding to the target operation request is the participating screen projection end;

[0049] When the operating user ID does not match the authorized user ID in the operable permission list, the current operating end corresponding to the target operation request is the main control screen projection end.

[0050] As another example, the target operation request also includes an operating user identifier and an operating terminal identifier. A screen projection user information list is stored in the display terminal, and the screen projection user information list stores an association relationship between a participating screen projection terminal identifier and a user identifier corresponding to a user using the participating screen projection terminal, as well as an association relationship between a master screen projection terminal identifier and a user identifier corresponding to a user using the master screen projection terminal.

[0051] When the display end receives the target operation request, it queries the projection user information list based on the operating user identifier; when the operating user identifier matches the user identifier corresponding to the user of the participating projection end, the current operating end corresponding to the target operation request is the participating projection end; when the operating user identifier matches the user identifier corresponding to the user of the main projection end, the current operating end corresponding to the target operation request is the main projection end.

[0052] Alternatively, when the display end receives the target operation request, it queries the projection operation end information list based on the operation end identifier; when the operation end identifier matches the participating projection end identifier, the current operation end corresponding to the target operation request is the participating projection end; when the operation end identifier matches the main projection end identifier, the current operation end corresponding to the target operation request is the main projection end.

[0053] S205: If the current operating end is the end participating in the screen projection, the target operation is authenticated based on the operable permission list to obtain an authentication result. When the authentication result is that the authentication is passed, the target screen projection data is operated based on the target operation to obtain a second operation result.

[0054] Among them, the authentication result is the result of authenticating the target operation when the current operating end is the participating screen projection end, and the authentication result includes two situations: authentication passed and authentication failed. When the authentication passes, the display end can perform the target operation to obtain the second operation result. When the authentication fails, the display end does not perform the target operation, and sends the information of authentication failure to the corresponding participating screen projection end so that the corresponding user of the participating screen projection end can understand the situation.

[0055] The second operation result refers to the result obtained when the display end executes the target operation sent by the participating screen projection end on the target software corresponding to the target screen projection data when the authentication is passed.

[0056] In this embodiment, since the users corresponding to the participating screen projection ends may not be employees of the company, or the users corresponding to the participating screen projection ends may not be employees of the same department, in order to ensure the security of the target screen projection data, it is necessary to authenticate the target operation sent by the participating screen projection ends. Only when the authentication result is authorized, the target operation is executed to operate on the target screen projection data, which can ensure multi-end interaction and the security of the target screen projection data.

[0057] The multi-screen interactive method based on data stream provided in this embodiment receives the target projection data and the operable permission list sent by the main control projection end; displays the target projection data on the display screen; the display end uses its own target software to open the target projection data to ensure smooth display of the target projection data; compared with the traditional display end receiving the video stream of the main control projection end for projection, it can effectively reduce bandwidth loss and avoid display screen freeze. When the current operating end is the main control projection end, the target operation is executed and the first operation result is displayed; when the current operating end is the participating projection end, the target operation is authenticated based on the operable permission list to obtain the authentication result. When the authentication result is authentication passed, the target projection data is operated based on the target operation to obtain the second operation result. Only when the authentication result is authentication passed, the target projection data is operated by the target operation, which can ensure both multi-end interaction and the security of the target projection data.

[0058] In one embodiment, if Figure 3 As shown, after step S202, that is, after the display screen displays the target projection data, the multi-screen interaction method based on data stream further includes:

[0059] S301: Generate screen projection summary information based on the main control screen projection terminal and the target screen projection data.

[0060] S302: Broadcast the screen projection summary information corresponding to the master screen projection end to the participating screen projection ends.

[0061] Among them, the screen projection summary information refers to the summary information corresponding to the main control screen projection terminal information and the target screen projection data that are currently being projected. Exemplarily, the screen projection summary information can be xx screen projection terminal, xx user, and display xx data.

[0062] In this embodiment, the screen projection user information list also stores user information corresponding to users using the main control screen projection terminal. It can be understood that user information corresponding to users using the participating screen projection terminals is also stored; the user information includes user identification, user position, user department, and user company, etc. When the display terminal displays the target screen projection data, it is also necessary to call the broadcast template, and extract specific information from the target screen projection data and the user information corresponding to the main control screen projection terminal, and store the specific information in the location corresponding to the broadcast template to form the screen projection summary information. After the screen projection summary information is formed, the display terminal broadcasts the screen projection summary information to the participating screen projection terminals, so that the users corresponding to the participating screen projection terminals can understand the target screen projection data and the user information corresponding to the main control screen projection terminal, realize intelligent broadcasting, and provide a basis for the subsequent users who use the participating screen projection terminals to operate the target screen projection data.

[0063] The multi-screen interactive method based on data stream provided in this embodiment generates screen projection summary information based on the main control screen projection terminal and the target screen projection data. The screen projection summary information corresponding to the main control screen projection terminal is broadcast to the participating screen projection terminals, providing a basis for the subsequent users of the participating screen projection terminals to operate the target screen projection data.

[0064] In one embodiment, if Figure 4 As shown, step S202, that is, displaying the target projection data on the display screen, includes:

[0065] S401: Based on the target attributes corresponding to the target screen projection data, determine whether there is target software that matches the target attributes.

[0066] Among them, the target attribute is the attribute corresponding to the target projection data. Specifically, the target attribute can be the data format, the name of the application that can open the target projection data, etc. Exemplarily, when the target projection data is a document, the target attribute can be in doc format, xml format, pdf format, etc.; when the target projection data is a picture, the target attribute can be in jpg format, png format, etc. When the target projection data is a game name identifier, the target attribute can be the application name.

[0067] In this embodiment, the display end determines the target attribute of the target projection data by querying the attribute of the target projection data; after the target attribute is determined, it queries the existing software to determine whether there is a target software that can open the target attribute.

[0068] S402: If there is a target software that matches the target attribute, the target screen projection data is opened in the target software and displayed.

[0069] S403: If there is no target software matching the target attribute, the target software is downloaded in real time, and the target screen projection data is opened in the target software to display the target screen projection data.

[0070] In this embodiment, the display end determines the target software that can open the target projection data through the target attributes to ensure that the target projection data can be opened by using the target software on the display end to ensure smooth projection. Moreover, since the target projection data is displayed by the target software in the display end, the display image can be smooth and without lag. At the same time, the main control projection end can view personal software and other operations without being recorded to protect the user's personal information.

[0071] The multi-screen interactive method based on data stream provided in this embodiment determines whether there is target software that matches the target attribute based on the target attribute corresponding to the target projection data. When there is target software that matches the target attribute, the target projection data is opened in the target software to display the target projection data. When there is no target software that matches the target attribute, the target software is downloaded in real time, and the target projection data is opened in the target software to display the target projection data. The target projection data is opened using the target software to ensure smooth projection.

[0072] In one embodiment, if Figure 5 As shown, step S203, that is, receiving a target operation request sent by the current operation terminal to operate the target projection data, includes:

[0073] S501: Receive an original operation request sent by the current operation terminal to operate the target projection data.

[0074] S502: If an original operation request is received, the original operation request is determined as a target operation request.

[0075] S503: If at least two original operation requests are received, determine whether the at least two original operation requests are parallel operation requests.

[0076] Wherein, parallel operation requests refer to unrelated requests. For example, original operation request a and original operation request b; the original operation carried in original operation request a is page turning; the original operation carried in original operation request b is volume adjustment, then original operation request a and original operation request b are parallel operation requests; if the original operation carried in original operation request a is to control volume increase; the original operation carried in original operation request b is to reduce volume, then original operation request a and original operation request b are not parallel operation requests.

[0077] S504: If at least two original operation requests are parallel operation requests, the two original operation requests are simultaneously determined as target operation requests.

[0078] When at least two target operation requests are parallel operation requests, they will not affect each other. Therefore, the two original operation requests are simultaneously determined as target operation requests to improve operation efficiency.

[0079] S505: If at least two original operation requests are not parallel operation requests, determine the operation priorities of the original operation requests.

[0080] The operation priority is a priority used to determine the order of executing the original operation request. The operation priority can be determined according to the user's position, user department, etc.

[0081] In this embodiment, when at least two original operation requests are not parallel operation requests, at least two original operation requests are the same original operation. The same original operation may be mutually exclusive. For example, the original operation corresponding to one of the original operation requests is to increase the volume; the original operation corresponding to the other original operation request is to decrease the volume; at this time, they are mutually exclusive. If the operations are performed simultaneously, the operation effect cannot be achieved. Therefore, the operation priority of each original operation request is determined according to the user position corresponding to the user at the participating screen projection end who sent the original operation request, so as to execute the original operation request with the highest operation priority. Alternatively, the original operation corresponding to one of the original operation requests is to increase the volume; the original operation corresponding to the other original operation request is to increase the volume; the operation may be excessive, affecting the user's perception. Therefore, it is necessary to determine the operation priority of each original operation request according to the user position corresponding to the user at the participating screen projection end who sent the original operation request, so as to execute the original operation request with the highest operation priority, so as to ensure that multi-terminal interaction can be carried out, ensure that the screen projection is orderly and smooth, and avoid screen projection confusion.

[0082] S506: Determine a target operation request from at least two original operation requests based on the operation priority.

[0083] In this embodiment, the operation priority of each original operation request is determined, so that the original operation request with the highest operation priority is determined as the target operation request, so as to ensure that multi-terminal interaction can be carried out, ensure that the screen projection is orderly and smooth, and avoid screen projection confusion.

[0084] Furthermore, when at least two original operation requests are not parallel operation requests, and the number of original operation requests is not less than three, the number of identical original operation requests can also be counted; the largest number of identical original operation requests are determined as target operation requests to execute the target operation requests, thereby ensuring multi-terminal interaction.

[0085] The multi-screen interaction method based on data stream provided in this embodiment receives the original operation request sent by the current operation terminal to operate the target projection data; if an original operation request is received, the original operation request is determined as the target operation request; if at least two original operation requests are parallel operation requests, the two original operation requests are simultaneously determined as target operation requests to improve operation efficiency. If at least two original operation requests are not parallel operation requests, the operation priority of the original operation request is determined to ensure that multi-terminal interaction can be carried out, to ensure that the projection is orderly and smoothly carried out, and to avoid projection confusion. Based on the operation priority, the target operation request is determined from at least two original operation requests to ensure that multi-terminal interaction can be carried out, to ensure that the projection is orderly and smoothly carried out, and to avoid projection confusion.

[0086] In one embodiment, the operable permission list includes an authorized user identifier and an authorized operation option corresponding to the authorized user identifier. The target operation request also includes a participating user identifier corresponding to the participating screen projection terminal. The participating user identifier is an identifier used to uniquely identify a user using the participating screen projection terminal.

[0087] like Figure 6 As shown, step S205, that is, performing authentication processing on the target operation based on the operable permission list and obtaining the authentication result, includes:

[0088] S601: Obtain the operation type corresponding to the target operation.

[0089] The operation type indicates the type of target operation. The operation type includes a control operation type and a data transmission type. The target operation corresponding to the control operation type is an operation for controlling the target projection data. For example, the target operation corresponding to the control operation type can be page turning control, image zooming, volume adjustment, and progress adjustment.

[0090] The target operation corresponding to the data transmission type is an operation for obtaining target screen projection data. For example, the target operation corresponding to the data transmission type may be a download operation and a screenshot operation.

[0091] S602: If the operation type is a control operation type, obtain an authentication result of passed authentication.

[0092] In this embodiment, when the operation type of the target operation is a control operation type, it means that the target operation sent by the participating screen projection end is to control the target screen projection data, and does not involve data transmission, and will not endanger the security of the target screen projection data. Therefore, the authentication result is directly determined as authentication passed to speed up the execution of subsequent target operations while ensuring the security of the target screen projection data.

[0093] S603: If the operation type is a data transmission type, authentication processing is performed on the participating user identifier and the target operation based on the authorized user identifier and the authorized operation option corresponding to the authorized user identifier to obtain an authentication result.

[0094] In this embodiment, when the operation type corresponding to the target operation is a data transmission type, it means that the user corresponding to the participating user identifier needs to obtain detailed information of the target projection data. At this time, the display end needs to determine whether the target operation sent by the participating projection end has authority to obtain the authentication result. Only when the authentication result is authentication passed, the target operation is executed to ensure the security of the target projection data.

[0095] The multi-screen interaction method based on data stream provided in this embodiment obtains the operation type corresponding to the target operation. If the operation type is a control operation type, the authentication result of the authentication is obtained to speed up the execution of subsequent target operations while ensuring the security of the target projection data. If the operation type is a data transmission type, the participating user identification and the target operation are authenticated based on the authorized user identification and the authorized operation options corresponding to the authorized user identification, and the authentication result is obtained. Only when the authentication result is authentication passed, the target operation is executed to ensure the security of the target projection data.

[0096] In one embodiment, if Figure 7 As shown, step S603, that is, based on the authorized user identifier and the authorized operation option corresponding to the authorized user identifier, the participating user identifier and the target operation are authenticated to obtain the authentication result, including:

[0097] S701: Determine the authorized user identity corresponding to the participating user identity as the target user identity; determine the authorized operation option corresponding to the authorized user identity corresponding to the participating user identity as the target operation option.

[0098] The target user ID may be understood as a participating user ID in the operable permission list.

[0099] The target operation option refers to the option authorized by the main control screen projection end to the target user ID so that the target user ID has the right to operate the target screen projection data.

[0100] In this embodiment, when the display end receives a target operation request sent by a participating screen projection end, the participating user identifier carried by the target operation request can be obtained; the participating user identifier is matched with the authorized user identifier in the operational permission list to obtain the authorized user identifier that matches the participating user identifier, and then the target user identifier can be obtained, thereby obtaining the target operation option corresponding to the target user identifier, providing technical support for determining whether to execute the target operation sent by the participating screen projection end, so as to ensure the security of the target screen projection data.

[0101] S702: Determine whether the target operation is included in the target operation options.

[0102] S703: If the target operation is included in the target operation options, the authentication result is authentication passed.

[0103] S704: If the target operation is not included in the target operation options, the authentication result is authentication failure.

[0104] Specifically, when the target operation is included in the target operation options, that is, the target operation corresponding to the participating user identity matches any one of the authorized operation options corresponding to the target user identity, the authentication result is authentication passed; when the target operation is not included in the target operation options, that is, the target operation corresponding to the participating user identity does not match any one of the authorized operation options corresponding to the target user identity, the authentication result is authentication failed. The authentication result is obtained to provide technical support for determining whether to execute the target operation sent by the participating screen projection end, so as to ensure the security of the target screen projection data.

[0105] The multi-screen interaction method based on data stream provided in this embodiment determines the authorized user identifier corresponding to the participating user identifier as the target user identifier; and determines the authorized operation option corresponding to the authorized user identifier corresponding to the participating user identifier as the target operation option. When the target operation is included in the target operation option, the authentication result is authentication passed. When the target operation is not included in the target operation option, the authentication result is authentication failed, which provides technical support for determining whether to execute the target operation sent by the participating screen projection end, so as to ensure the security of the target screen projection data.

[0106] In one embodiment, the target operation whose operation type is a data transmission type includes a download operation, a preview operation, and a screenshot operation.

[0107] Specifically, the display end, the main control participating screen projection end and the participating screen projection end are all provided with N target controllers, each target controller corresponds to a function; the target operation request carries the target operation; therefore, the main control participating screen projection end and the participating screen projection end send the target operation request carrying the target operation to the display end through the target controller; the display end calls the corresponding target controller according to the target operation and performs the corresponding operation to realize multi-end interaction. It can be understood that the display end opens the target screen projection data in the target software, and the participating screen projection end sends the target operation request to the display end, which can ensure that each participating screen projection end can participate in the interaction, and at the same time, ensure the smooth display of the display screen; while in the existing video stream projection, the participating screen projection end can only watch the video stream and cannot operate. Furthermore, after executing the target operation, the display end will also broadcast the corresponding status of the target screen projection data to the participating screen projection end and the main control screen projection end in real time, so that the users of the participating screen projection end and the main control screen projection end can understand the projection situation and provide support for subsequent multi-end interaction. For example, if the target projection data is a file, the target controller is a document reader; the target operations can be page turning, inserting annotations, downloading, previewing, screenshots, etc. When the target projection data is a video, the target controller can be a player, etc., and the target operations can be full screen, bullet screen, and lower volume, etc.

[0108] In one embodiment, the target operation includes a download operation.

[0109] like Figure 8As shown, step S205, that is, authenticating the target operation based on the operable permission list to obtain an authentication result, when the authentication result is authentication passed, operating the target projection data based on the target operation to obtain a second operation result, includes:

[0110] S801: Determine whether the target operation option includes a download operation.

[0111] S802: If the target operation option includes a download operation, the authentication result is authentication passed.

[0112] S803: Send the target screen projection data to the participating screen projection terminals.

[0113] In this embodiment, when the target operation sent by the participating screen projection end corresponding to the participating user identifier is a download operation, it is determined whether the target operation option includes the download operation. If the target operation option includes the download operation, the authentication result is that the authentication is passed, and the display end sends the target screen projection data to the participating screen projection end, thereby ensuring the security of the target screen projection data and realizing multi-end interaction.

[0114] The multi-screen interaction method based on data stream provided in this embodiment has the authentication result of passing the authentication when the target operation option includes a download operation; the target screen projection data is sent to the participating screen projection terminals, thereby achieving multi-terminal interaction while ensuring the security of the target screen projection data.

[0115] In one embodiment, if Fig. 9 As shown, the target operation is a preview operation.

[0116] Step S205, that is, performing authentication processing on the target operation based on the operable permission list to obtain an authentication result, and when the authentication result is authentication passed, performing an operation on the target projection data based on the target operation to obtain a second operation result, including:

[0117] S901: Determine whether the target operation option includes a preview operation.

[0118] S902: If the target operation option includes a preview operation, the authentication result is authentication passed.

[0119] S903: Perform information extraction and processing on the target screen projection data, generate preview information, and send the preview information to the participating screen projection terminals.

[0120] Among them, the preview information is information extracted and processed from the target screen projection data. The preview information can be a directory of the target screen projection data, or a content summary of the target screen projection data and other information.

[0121] In this embodiment, when the target operation sent by the participating screen projection end corresponding to the participating user identifier is a preview operation, it is determined whether the target operation option includes the preview operation. If the target operation option includes the preview operation, the authentication result is that the authentication is passed, and the display end extracts information from the target screen projection data to obtain preview information, and sends it to the participating screen projection end, so that the users of the participating screen projection end can view the preview information, thereby ensuring the security of the target screen projection data and realizing multi-end interaction.

[0122] In the multi-screen interactive method based on data stream provided in this embodiment, when the target operation option includes a preview operation, the authentication result is authentication passed. The target projection screen data is subjected to information extraction and processing, and preview information is generated, and the preview information is sent to the participating projection screen terminals, so as to realize multi-terminal interaction while ensuring the security of the target projection screen data.

[0123] In one embodiment, if Fig.10 As shown, the target operation is a screenshot operation.

[0124] Step S205, that is, performing authentication processing on the target operation based on the operable permission list to obtain an authentication result, and when the authentication result is authentication passed, performing an operation on the target projection data based on the target operation to obtain a second operation result, including:

[0125] S1001: Determine whether the target operation option includes a screenshot operation;

[0126] S1002: If the target operation option includes a screenshot operation, the authentication result is authentication passed;

[0127] S1003: Take a screenshot of the currently displayed content, generate screenshot information, and send the screenshot information to the participating screen projection terminals.

[0128] In this embodiment, when the target operation sent by the participating screen projection end corresponding to the participating user identifier is a screenshot operation, it is determined whether the target operation option includes a screenshot operation. If the target operation option includes a screenshot operation, the authentication result is that the authentication is passed. The display end then performs a screenshot process on the content being displayed in the target screen projection data at the current moment, that is, the currently displayed content, to obtain the screenshot information, and sends it to the participating screen projection end to realize a screenshot of the target screen projection data, thereby achieving multi-end interaction while ensuring the security of the target screen projection data.

[0129] The multi-screen interaction method based on data stream provided in this embodiment has the authentication result of passing the authentication when the target operation option includes a screenshot operation; a screenshot is taken of the currently displayed content to generate screenshot information, and the screenshot information is sent to the participating screen projection terminals, thereby achieving multi-terminal interaction while ensuring the security of the target screen projection data.

[0130] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0131] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the multi-terminal screen projection method in the above-mentioned embodiment are implemented.

[0132] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the multi-terminal screen projection method in the above embodiment are implemented.

[0133] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in the present application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0134] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0135] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A multi-screen interactive method based on data stream, applied in a multi-terminal screen projection system, wherein the multi-terminal screen projection system comprises a display terminal and N participating screen projection terminals connected to the display terminal; characterized in that: The multi-screen interaction method based on data stream includes the following steps performed by the display end: When receiving the target screen projection request sent by the participating screen projection end, obtain the current screen projection status; If the current screen projection state is in the screen projection state and a consent instruction is received from the current screen projection end, or if the current screen projection state is in the waiting screen projection state and the user of the current screen projection end agrees to switch the screen projection, the main control screen projection end is determined according to the target terminal identifier; the current screen projection end is the participating screen projection end that is currently projecting; If the current screen projection state is in the screen projection state and no consent instruction is received from the current screen projection end, a screen projection sequence is formed based on the screen projection request information corresponding to at least one target screen projection request, and the main control screen projection end is determined based on the screen projection sequence; Receive the target screen projection data and operable permission list sent by the main control screen projection end; The operable permission list includes an authorized user identifier and authorized operation options corresponding to the authorized user identifier; Display the target screen projection data on a display screen; Receive a target operation request sent by the current operation terminal to operate the target screen projection data, wherein the target operation request includes a target operation; the target operation request also includes a participating user identifier corresponding to the participating screen projection terminal; If the current operating end is the main control screen projection end, the target operation is executed and the first operation result is displayed; If the current operating terminal is a participating screen projection terminal, the target operation is authenticated based on the operable permission list to obtain an authentication result, including: Obtaining the operation type corresponding to the target operation; If the operation type is a control operation type, the authentication result of the authentication is obtained; the control operation type is used to indicate that the target operation sent by the participating screen projection end is to control the target screen projection data without involving data transmission; If the operation type is a data transmission type, the authorized user identifier corresponding to the participating user identifier is determined as the target user identifier; the authorized operation option corresponding to the authorized user identifier corresponding to the participating user identifier is determined as the target operation option; it is determined whether the target operation is included in the target operation option; if the target operation is included in the target operation option, the authentication result is that the authentication is passed; if the target operation is not included in the target operation option, the authentication result is that the authentication is not passed; the data transmission type is used to indicate that the user corresponding to the participating user identifier needs to obtain detailed information on the target projection data; When the authentication result is that the authentication is passed, the target projection data is operated based on the target operation to obtain a second operation result.

2. The multi-screen interactive method based on data stream according to claim 1, characterized in that: After the target projection data is displayed on the display screen, the multi-screen interaction method based on data stream further includes: Generate screen projection summary information based on the main control screen projection terminal and the target screen projection data; Broadcast the screen projection summary information corresponding to the master screen projection end to the participating screen projection ends.

3. The multi-screen interactive method based on data stream according to claim 1, characterized in that: Displaying the target screen projection data on the display screen includes: Based on the target attribute corresponding to the target projection data, determining whether there is a target software matching the target attribute; If there is a target software matching the target attribute, opening the target screen projection data in the target software and displaying the target screen projection data; If there is no target software matching the target attribute, the target software is downloaded in real time, and the target screen projection data is opened in the target software to display the target screen projection data.

4. The multi-screen interactive method based on data stream according to claim 1, characterized in that: The receiving a target operation request for operating the target screen projection data sent by the current operation terminal includes: Receiving an original operation request sent by the current operation terminal to operate the target screen projection data; If an original operation request is received, determining the original operation request as a target operation request; If at least two of the original operation requests are received, determining whether the at least two original operation requests are parallel operation requests; If at least two original operation requests are parallel operation requests, the two original operation requests are simultaneously determined as target operation requests; If at least two original operation requests are not parallel operation requests, determining the operation priorities of the original operation requests; Based on the operation priority, a target operation request is determined from at least two original operation requests.

5. The multi-screen interactive method based on data stream according to claim 1, characterized in that: The target operation whose operation type is a data transmission type includes a download operation, a preview operation, and a screenshot operation.

6. The multi-screen interactive method based on data stream according to claim 5, characterized in that: The target operation is a download operation; The performing authentication processing on the target operation based on the operable permission list to obtain an authentication result, and when the authentication result is authentication passed, performing an operation on the target projection data based on the target operation to obtain a second operation result, includes: Determining whether the target operation option includes a download operation; If the target operation option includes a download operation, the authentication result is authentication passed; The target screen projection data is sent to the participating screen projection terminals.

7. The multi-screen interactive method based on data stream according to claim 5, characterized in that: The target operation is a preview operation; The performing authentication processing on the target operation based on the operable permission list to obtain an authentication result, and when the authentication result is authentication passed, performing an operation on the target projection data based on the target operation to obtain a second operation result, includes: Determining whether the target operation option includes a preview operation; If the target operation option includes a preview operation, the authentication result is authentication passed; Perform information extraction and processing on the target screen projection data, generate preview information, and send the preview information to the participating screen projection terminals.

8. The multi-screen interactive method based on data stream according to claim 5, characterized in that: The target operation is a screenshot operation; The performing authentication processing on the target operation based on the operable permission list to obtain an authentication result, and when the authentication result is authentication passed, performing an operation on the target projection data based on the target operation to obtain a second operation result, includes: Determine whether the target operation option includes a screenshot operation; If the target operation option includes a screenshot operation, the authentication result is authentication passed; The currently displayed content is captured, screenshot information is generated, and the screenshot information is sent to the participating screen projection end.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the multi-screen interaction method based on data stream as described in any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the multi-screen interaction method based on data stream as described in any one of claims 1 to 8 are implemented.

Images