A service recovery method, apparatus, terminal device, and storage medium

By acquiring the service information of the video network terminal and using the database to determine multi-screen data, the data loss problem caused by abnormal video network multi-screen meetings is solved, and the recovery and continuation of multi-screen meetings are achieved.

CN112437244BActive Publication Date: 2025-06-27VISIONVERA INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011135835.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-21
Publication Date
2025-06-27
Estimated Expiration
2040-10-21

AI Technical Summary

Technical Problem

In multi-screen meetings in video network, abnormal situations (such as disconnection of the network) cause the conference business to fail to proceed normally, and the video data is lost when the conference business is restored and cannot be restored.

Method used

Obtain the service information of the video network terminal in the multi-screen service, including the service status and terminal number, and determine the multi-screen data using a pre-established database, including split-screen mode and screen display content, and send it to the terminal through the video network server to restore the multi-screen service.

Benefits of technology

Recover business data for multi-screen meetings under abnormal conditions and continue multi-screen meetings.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112437244B_ABST
    Figure CN112437244B_ABST
Patent Text Reader

Abstract

An embodiment of the present invention provides a service recovery method, apparatus, terminal device, and storage medium, including: obtaining service information of a first Visual Networking Terminal in a multi-screen service, where the service information includes a service status and a first Visual Networking Terminal number; in the case where the service status of the first Visual Networking Terminal changes from an offline state to an online state, determining multi-screen data corresponding to the first Visual Networking Terminal number according to a pre-established database, where the multi-screen data includes a split-screen mode and screen display content; sending the multi-screen data to a Visual Networking Server, and the Visual Networking Server sending the multi-screen data to the first Visual Networking Terminal, and the first Visual Networking Terminal displaying the screen display content at a split-screen position corresponding to a split-screen identifier on a display according to the split-screen mode to recover the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen meeting, not only can the multi-screen service data that was originally in progress be recovered, but the multi-screen service can also continue.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of vision networking, and in particular, to a service recovery method, apparatus, terminal device, and storage medium. Background Art

[0002] For current vision networking services, when performing multi-screen conference service operations, after pulling vision networking terminals into a conference through the vision networking scheduling software, each vision networking terminal is set to multi-screen display, that is, it can not only display its own video data, but also display the video data of other vision networking terminals. If an abnormal situation occurs, such as network disconnection, etc., it will cause the multi-screen conference service to not proceed normally. When the abnormality is eliminated, the video data of the previous conference service has been lost, and the current conference service cannot be restored either. Summary of the Invention

[0003] In view of the above problems, embodiments of the present invention are proposed to provide a service recovery method, apparatus, terminal device, and storage medium that overcome the above problems or at least partially solve the above problems.

[0004] In a first aspect, an embodiment of the present invention provides a service recovery method, and the method includes:

[0005] Obtain service information of a first vision networking terminal in a multi-screen service, where the service information includes a service status and a first vision networking terminal number;

[0006] When the service status of the first vision networking terminal changes from an offline state to an online state, determine multi-screen data corresponding to the first vision networking terminal number according to a pre-established database, where the multi-screen data includes a split-screen mode and screen display content;

[0007] Send the multi-screen data to a vision networking server, so that the vision networking server sends the multi-screen data to a first vision networking terminal corresponding to the first vision networking terminal number, so that the first vision networking terminal displays the screen display content at a split-screen position corresponding to a split-screen identifier on a display according to the split-screen mode to restore the multi-screen service, where the display is connected to the first vision networking terminal.

[0008] Optionally, the vision networking server sending the multi-screen data to a first vision networking terminal corresponding to the first vision networking terminal number includes:

[0009] The vision networking server decrypts the multi-screen data according to a pre-stored private key to obtain the split-screen mode and the screen display content, where the multi-screen data is encrypted by a public key, and the public key corresponds to the private key;

[0010] Send the split-screen mode and the screen display content to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number.

[0011] Optionally, the method further includes:

[0012] If no multi-screen data corresponding to the second Visual Networking Terminal number is found in the pre-established database, receive the first multi-screen data sent by the second Visual Networking Terminal;

[0013] Use the RSA asymmetric encryption and decryption algorithm to encrypt the first multi-screen data to obtain the second multi-screen data;

[0014] Save the second multi-screen data in the pre-established database.

[0015] Optionally, before obtaining the service information of the first Visual Networking Terminal in the multi-screen service, the method further includes:

[0016] If the network management server receives the heartbeat data packet sent by the Visual Networking Terminal every preset time period, receive the first status data packet sent by the network management server, where the first status data packet includes the online status identifier of the Visual Networking Terminal;

[0017] If the network management server does not receive the heartbeat data packet sent by the Visual Networking Terminal every preset time period, receive the second status data packet sent by the network management server, where the second status data packet includes the offline status identifier of the Visual Networking Terminal.

[0018] Optionally, the method further includes:

[0019] In the case where the service status of the Visual Networking Terminal changes from the online status to the offline status, receive the instruction to stop the service, so that the Visual Networking Terminal ends the service.

[0020] Optionally, the method further includes:

[0021] Send a start instruction for a multi-screen conference to the Visual Networking Terminal;

[0022] After the multi-screen conference is started, set the Visual Networking Terminal to the multi-screen participant role.

[0023] Optionally, the method further includes:

[0024] Send a multi-screen mode setting instruction to the Visual Networking Terminal, where the multi-screen mode setting instruction includes the split-screen mode, so that the Visual Networking Terminal performs display screen settings according to the split-screen mode.

[0025] Second aspect, an embodiment of the present invention provides a service recovery device, the device comprising:

[0026] An acquisition module, configured to acquire service information of a first Visual Networking Terminal in a multi-screen service, wherein the service information includes a service status and a first Visual Networking Terminal number;

[0027] A determination module, configured to, when the service status of the first Visual Networking Terminal changes from an offline state to an online state, determine, according to a pre-established database, multi-screen data corresponding to the first Visual Networking Terminal number, wherein the multi-screen data includes a split-screen mode and screen display content;

[0028] A recovery module, configured to send the multi-screen data to a Visual Networking Server, so that the Visual Networking Server sends the multi-screen data to a first Visual Networking Terminal corresponding to the first Visual Networking Terminal number, such that the first Visual Networking Terminal displays the screen display content at a split-screen position corresponding to a split-screen identifier on a display according to the split-screen mode, to recover the multi-screen service, wherein the display is connected to the first Visual Networking Terminal.

[0029] Optionally, the Visual Networking Server includes a decryption module, and the decryption module is configured to:

[0030] Decrypt the multi-screen data according to a pre-stored private key to obtain the split-screen mode and the screen display content, wherein the multi-screen data is encrypted by a public key, and the public key corresponds to the private key;

[0031] Send the split-screen mode and the screen display content to a first Visual Networking Terminal corresponding to the first Visual Networking Terminal number.

[0032] Optionally, the device further includes an encryption module, and the encryption module is configured to:

[0033] If multi-screen data corresponding to a second Visual Networking Terminal number cannot be found in the pre-established database, receive first multi-screen data sent by the second Visual Networking Terminal;

[0034] Encrypt the first multi-screen data by using an RSA asymmetric encryption and decryption algorithm to obtain second multi-screen data;

[0035] Save the second multi-screen data in the pre-established database.

[0036] Optionally, the device further includes a detection module, and the detection module is configured to:

[0037] If the network management server receives a heartbeat data packet sent by the Visual Networking Terminal every preset time period, it receives a first status data packet sent by the network management server, where the first status data packet includes an online status identifier of the Visual Networking Terminal;

[0038] If the network management server does not receive a heartbeat data packet sent by the Visual Networking Terminal every preset time period, it receives a second status data packet sent by the network management server, where the second status data packet includes an offline status identifier of the Visual Networking Terminal.

[0039] Optionally, the device further includes a stop module, and the stop module is configured to:

[0040] In the case where the service status of the Visual Networking Terminal changes from the online status to the offline status, receive an instruction to stop the service, so that the Visual Networking Terminal ends the service.

[0041] Optionally, the device further includes a meeting start module, and the meeting start module is configured to:

[0042] Send a start instruction for a multi-screen meeting to the Visual Networking Terminal;

[0043] After the multi-screen meeting is started, set the Visual Networking Terminal to the role of a multi-screen participant.

[0044] Optionally, the device further includes a setting module, and the setting module is configured to:

[0045] Send a multi-screen mode setting instruction to the Visual Networking Terminal, where the multi-screen mode setting instruction includes the split screen mode, so that the Visual Networking Terminal performs display screen settings according to the split screen mode.

[0046] In a third aspect, an embodiment of the present invention provides a terminal device, including: at least one processor and a memory;

[0047] The memory stores a computer program; the at least one processor executes the computer program stored in the memory to implement the service recovery method provided in the first aspect.

[0048] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed, the service recovery method provided in the first aspect is implemented.

[0049] The embodiments of the present invention have the following advantages:

[0050] Embodiments of the present invention utilize the characteristics of the Visual Networking to obtain the service information of the first Visual Networking terminal in a multi-screen service, where the service information includes the service status and the first Visual Networking terminal number; in the case where the service status of the first Visual Networking terminal changes from the offline state to the online state, according to a pre-established database, determine the multi-screen data corresponding to the first Visual Networking terminal number, where the multi-screen data includes the split-screen mode and the screen display content; send the multi-screen data to the Visual Networking server, and the Visual Networking server sends the multi-screen data to the first Visual Networking terminal corresponding to the first Visual Networking terminal number, and the first Visual Networking terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode to restore the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally in progress be restored, but the multi-screen service can also continue. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 is a flowchart of the steps of an embodiment of a service restoration method of the present invention;

[0052] Figure 2 is a flowchart of the steps of another embodiment of a service restoration method of the present invention;

[0053] Figure 3 is a flowchart of the steps of yet another embodiment of a service restoration method of the present invention;

[0054] Figure 4 is a block diagram of the structure of an embodiment of a service restoration device of the present invention;

[0055] Figure 5 is a schematic diagram of the structure of a terminal device of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0056] To make the above objects, features, and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0057] The Visual Networking is an important milestone in the development of the network. It is a real-time network that can achieve real-time high-definition video transmission, pushing many Internet applications towards high-definition video and high-definition face-to-face.

[0058] The Visual Networking adopts real-time high-definition video switching technology, and can integrate dozens of services such as high-definition video conferencing, video surveillance, intelligent surveillance analysis, emergency command, digital radio and television, delayed television, online teaching, live broadcast, VOD on demand, television mail, personalized recording (PVR), internal network (self-run) channels, intelligent video broadcast control, information release, etc. of video, voice, pictures, text, communication, data, etc. on a single system platform, and realizes high-definition quality video playback through a TV or computer.

[0059] Based on the above characteristics of the Vision Internet, one of the core concepts of the embodiments of the present invention is proposed. Following the protocol of the Vision Internet, obtain the service information of the first Vision Internet terminal in the multi-screen service, where the service information includes the service status and the first Vision Internet terminal number; in the case where the service status of the first Vision Internet terminal changes from the offline state to the online state, determine the multi-screen data corresponding to the first Vision Internet terminal number according to the pre-established database, where the multi-screen data includes the split-screen mode and the screen display content; send the multi-screen data to the Vision Internet server, and the Vision Internet server sends the multi-screen data to the first Vision Internet terminal corresponding to the first Vision Internet terminal number. The first Vision Internet terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode to restore the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen meeting, not only can the multi-screen service data that was originally in progress be restored, but the multi-screen service can also continue.

[0060] The following are the explanations of terms:

[0061] Multi-screen participant: It refers to modifying the participant role of a certain type of physical terminal to the multi-screen participant role before starting a multi-screen meeting;

[0062] Multi-screen meeting: A meeting participated by terminals with multi-screen participants is a multi-screen meeting;

[0063] An embodiment of the present invention provides a service recovery method for recovering the data of a multi-screen meeting. The execution subject of this embodiment is a service recovery device, which is set on a tablet device.

[0064] Refer to Figure 1 , which shows the step flow chart of an embodiment of the service recovery method of the present invention. The method may specifically include the following steps:

[0065] S101. Obtain the service information of the first Vision Internet terminal in the multi-screen service, where the service information includes the service status and the first Vision Internet terminal number;

[0066] Specifically, the embodiments of the present invention are applied to a multi-screen conference system, which includes a tablet device, a background server, a Visual Networking server, and multiple first Visual Networking terminals. The tablet device is connected to each first Visual Networking terminal through the background server. The Visual Networking server is connected to each first Visual Networking terminal. The first Visual Networking terminal can be connected to multiple displays for displaying data of other first Visual Networking terminals in a multi-screen conference. A Visual Networking conference scheduling software is installed on the tablet device. Through this Visual Networking conference scheduling software, multiple first Visual Networking terminals are added to the multi-screen conference, and the multiple first Visual Networking terminals are set as multi-screen conference roles. After the multi-screen conference is started, the first Visual Networking terminal sends the first Visual Networking terminal number and the service status to the background server, and then the background server sends them to the tablet device, where the service status includes an online status or an offline status.

[0067] S102. In the case where the service status of the first Visual Networking terminal changes from the offline status to the online status, determine the multi-screen data corresponding to the first Visual Networking terminal number according to a pre-established database, where the multi-screen data includes a split-screen mode and screen display content.

[0068] Specifically, when the service status of the first Visual Networking terminal is the online status, the first Visual Networking terminal number and the screen display content in the conference are sent to the tablet device. The tablet device saves the correspondence between the first Visual Networking terminal number and the corresponding screen display content and stores it in a pre-established database. The multi-screen data includes a split-screen mode, the screen display content of the first Visual Networking terminal, and the split-screen identifier corresponding to the screen display content in this allocation mode.

[0069] If the tablet device detects that the service status of the first Visual Networking terminal changes from the offline status to the online status, the tablet device searches in the pre-established database according to the first Visual Networking terminal number to find the multi-screen data corresponding to the first Visual Networking terminal number, that is, obtains the screen display content and split-screen mode on the first Visual Networking terminal, and the split-screen identifier corresponding to the screen display content in this allocation mode.

[0070] S103. Send the multi-screen data to the Visual Networking server so that the Visual Networking server sends the multi-screen data to the first Visual Networking terminal corresponding to the first Visual Networking terminal number, so that the first Visual Networking terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode to restore the multi-screen service, where the display is connected to the first Visual Networking terminal.

[0071] Specifically, after the tablet device obtains the multi-screen data, it sends the multi-screen data and the first Visual Networking Terminal number to the Visual Networking Server. The Visual Networking Terminal then sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number. After receiving the multi-screen data, the first Visual Networking Terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode in the multi-screen data. In this way, the multi-screen data of the first Visual Networking Terminal in the offline state is restored. Furthermore, when the first Visual Networking Terminal is in the online state, it can continue with the multi-screen service.

[0072] The service restoration method provided by the embodiment of the present invention obtains the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking Terminal number; in the case where the service status of the first Visual Networking Terminal changes from the offline state to the online state, according to the pre-established database, determine the multi-screen data corresponding to the first Visual Networking Terminal number, where the multi-screen data includes the split-screen mode and the screen display content; send the multi-screen data to the Visual Networking Server, and the Visual Networking Server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number. The first Visual Networking Terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode to restore the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally being carried out be restored, but the multi-screen service can also continue.

[0073] Another embodiment of the present invention further supplements and explains the service restoration method provided in the above embodiment.

[0074] As Figure 2 shown, a step flowchart of another embodiment of the service restoration method of the present invention is shown. The service restoration method includes:

[0075] S201. Send a start instruction for a multi-screen conference to the Visual Networking Terminal; after the multi-screen conference is opened, set the Visual Networking Terminal as a multi-screen participant role.

[0076] Specifically, the embodiment of the present invention is applied to a multi-screen conference system, which includes a tablet device, a background server, a Visual Networking Server, and multiple Visual Networking Terminals. The tablet device is connected to each Visual Networking Terminal through the background server. The Visual Networking Server is connected to each Visual Networking Terminal. The Visual Networking Terminal can be connected to multiple displays for displaying the data of other Visual Networking Terminals in the multi-screen conference. The Visual Networking Conference Scheduling Software is installed on the tablet device. Through the Visual Networking Conference Scheduling Software, a start instruction for a multi-screen conference is sent to multiple Visual Networking Terminals to add the multiple Visual Networking Terminals to the multi-screen conference. After the multi-screen conference is opened, the Visual Networking Terminal is set as a multi-screen participant role.

[0077] S202. Send a multi-screen mode setting instruction to the Visual Networking Terminal, where the multi-screen mode setting instruction includes the split-screen mode, so that the Visual Networking Terminal performs display screen settings according to the split-screen mode.

[0078] Specifically, the tablet device sends a multi-screen mode setting instruction to the Visual Networking Terminal. The multi-screen mode setting instruction includes the split-screen mode. For example, it can be a two-screen split or a four-screen split, which can be set according to actual needs. In this way, the Visual Networking Terminal can display the screen display content of itself and the screen display content of other Visual Networking Terminals in the multi-screen conference on the display according to the split-screen mode, and each split-screen position of the screen display content corresponds to a split-screen identifier.

[0079] S203. If the network management server receives a heartbeat data packet sent by the Visual Networking Terminal every preset time period, then receive a first status data packet sent by the network management server, where the first status data packet includes an online status identifier of the Visual Networking Terminal;

[0080] S204. If the network management server does not receive a heartbeat data packet sent by the Visual Networking Terminal every preset time period, then receive a second status data packet sent by the network management server, where the second status data packet includes an offline status identifier of the Visual Networking Terminal.

[0081] Specifically, the network management server is connected to the tablet device and the Visual Networking Terminal respectively. The network management server detects the service status of the Visual Networking Terminal every preset time period, that is, monitors the heartbeat data packet sent by the Visual Networking Terminal. If the network management server receives a heartbeat data packet sent by the Visual Networking Terminal every preset time period, it means that the Visual Networking Terminal is in an online state, and the online status identifier is sent to the tablet device. If the network management server does not receive a heartbeat data packet sent by the Visual Networking Terminal within the preset time period, it means that the Visual Networking Terminal is in an offline state, such as a network interruption, and the offline status identifier of the Visual Networking Terminal is sent to the tablet device.

[0082] S205. Obtain the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking Terminal number;

[0083] Specifically, the tablet device obtains the service information of the Visual Networking Terminal in the multi-screen service through the network management server. The service information includes the service status and the first Visual Networking Terminal number.

[0084] S206. In the case where the service status of the first Visual Networking Terminal changes from an offline state to an online state, determine the multi-screen data corresponding to the first Visual Networking Terminal number according to a pre-established database, where the multi-screen data includes the split-screen mode and the screen display content;

[0085] Specifically, when the service status of the Visual Networking Terminal is the online status, the Visual Networking Terminal number of the Visual Networking Terminal and the screen display content in the conference are sent to the tablet device. The tablet device encrypts the multi-screen data using the RSA asymmetric encryption algorithm, that is, encrypts the multi-screen data using the public key to obtain the encrypted multi-screen data. The tablet device saves the correspondence between the Visual Networking Terminal number and the corresponding encrypted multi-screen data, and stores it in a pre-established database, and saves the private key corresponding to the public key on the Visual Networking server. Among them, the multi-screen data includes the split-screen mode, the screen display content of the first Visual Networking Terminal, and the split-screen identifier corresponding to the screen display content in the allocation mode.

[0086] S207. Send the multi-screen data to the Visual Networking server so that the Visual Networking server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number, so that the first Visual Networking Terminal displays the screen display content on the display at the split-screen position corresponding to the split-screen identifier according to the split-screen mode to restore the multi-screen service, where the display is connected to the first Visual Networking Terminal.

[0087] Specifically, the Visual Networking server sending the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number includes:

[0088] The Visual Networking server decrypts the multi-screen data according to the pre-stored private key to obtain the split-screen mode and the screen display content, where the multi-screen data is encrypted using the public key, and the public key corresponds to the private key;

[0089] Send the split-screen mode and the screen display content to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number.

[0090] Specifically, the tablet device sends the encrypted multi-screen data and the first Visual Networking Terminal number to the Visual Networking server. The Visual Networking server decrypts the encrypted multi-screen data according to the pre-stored private key corresponding to the first Visual Networking Terminal number to obtain the original multi-screen data, and sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number. After receiving the multi-screen data, the first Visual Networking Terminal displays the screen display content on the display at the split-screen position corresponding to the split-screen identifier according to the split-screen mode in the multi-screen data. In this way, the multi-screen data of the first Visual Networking Terminal in the offline state is restored, and then the first Visual Networking Terminal can continue the multi-screen service in the online state.

[0091] S208. If no multi-screen data corresponding to the second Visual Networking Terminal number is found in the pre-established database, receive the first multi-screen data sent by the second Visual Networking Terminal;

[0092] Use the RSA asymmetric encryption and decryption algorithm to encrypt the first multi-screen data to obtain the second multi-screen data;

[0093] Save the second multi-screen data in the pre-established database.

[0094] Specifically, if the tablet device does not find multi-screen data corresponding to the second Visual Networking Terminal number in the pre-established database, receive the first multi-screen data sent by the second Visual Networking Terminal; then use the above RSA asymmetric encryption and decryption algorithm to encrypt the first multi-screen data, that is, use the public key to encrypt the first multi-screen data to obtain the second multi-screen data, and save the correspondence between the second multi-screen data and the second Visual Networking Terminal number in the pre-established database.

[0095] Among them, the "first" and "second" in the first Visual Networking Terminal and the second Visual Networking Terminal are only used to distinguish the Visual Networking Terminals in different stages, and are not restrictions on the specific order.

[0096] S209. In the case where the service state of the Visual Networking Terminal changes from the online state to the offline state, receive an instruction to stop the service, so that the Visual Networking Terminal ends the service.

[0097] Specifically, if the tablet device detects that the service state of the Visual Networking Terminal changes from online to offline, receive the service stop instruction input by the user, that is, close the relevant functions of the multi-screen participants. In this way, the interface for the multi-screen service on the Visual Networking Terminal cannot be operated, preventing misoperations.

[0098] Figure 3 It is the step flowchart of another embodiment of the service recovery method of the present invention. As Figure 3 shown, the service recovery method includes:

[0099] 1. Install the Visual Networking Conference Scheduling System on the Android mobile device, that is, the tablet. In this conference scheduling system, the multi-screen display mode of the participating Visual Networking Terminals can be set;

[0100] 2. Send a multi-screen conference instruction to each participating Visual Networking Terminal through this Visual Networking Conference Scheduling System. The multi-screen conference instruction includes the multi-screen display mode, start the multi-screen conference, and display the picture of the Visual Networking Terminal in the multi-screen participant picture.

[0101] 3. If the meeting is successfully started, each participating Visual Networking Terminal will be set according to this multi-screen display mode, and multiple video images will be displayed at the corresponding positions.

[0102] If the meeting fails to start, the meeting start instruction will be resent.

[0103] 4. The background server detects the status of the participating Visual Networking Terminals in real time through the network management server, that is, the network management server determines the status of the participating Visual Networking Terminals through heartbeat data packets. If a heartbeat data packet sent by a participating Visual Networking Terminal is received, it indicates that the participating Visual Networking Terminal is online. If no heartbeat data packet sent by the participating Visual Networking Terminal is received after a preset time, it indicates that the participating Visual Networking Terminal is offline, and the status of the Visual Networking Terminal will be sent to the background server.

[0104] 5. When the Visual Networking Conference Scheduling System determines that a participating Visual Networking Terminal changes from online to offline, the user will automatically turn off the multi-screen conference function on the Visual Networking Conference Scheduling System. This function will monitor the status of multi-screen participants in real time on the Visual Networking scheduling tablet and handle whether the service can be carried out normally based on the status. If the current service cannot be carried out normally, the current function will be automatically turned off, and the content displayed on the screen in the multi-screen display mode will be encrypted using the RSA public key.

[0105] 6. When the Visual Networking Conference Scheduling System determines that a participating Visual Networking Terminal changes from offline to online, it will determine whether there is multi-screen data stored in the memory in the online state of the participating Visual Networking Terminal. Among them, the multi-screen data includes the split-screen mode, the Visual Networking Terminal number, and the screen content.

[0106] If there is multi-screen data in the memory, the Visual Networking Conference Scheduling System will send the multi-screen data to the Visual Networking server. Among them, the multi-screen data is pre-encrypted using the public key and stored in the Visual Networking Conference Scheduling System, and the corresponding private key is stored on the Visual Networking server.

[0107] 7. The Visual Networking server decrypts the multi-screen data according to the private key corresponding to the Visual Networking Terminal number to obtain the split-screen mode and the screen content; it sends the split-screen mode and the screen content to the corresponding Visual Networking Terminal, and the Visual Networking Terminal displays the corresponding screen content at the corresponding position on the display screen according to the split-screen mode.

[0108] 8. If there is no multi-screen data in the memory, the service will be carried out in the same way as when the multi-screen conference is first started, that is, the screen content and the split-screen mode will be encrypted using the RSA public key and stored on the tablet device.

[0109] It should be noted that, for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequences, because according to the embodiments of the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential for the embodiments of the present invention.

[0110] The service recovery method provided by the embodiments of the present invention includes obtaining the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking Terminal number; when the service status of the first Visual Networking Terminal changes from the offline state to the online state, determining the multi-screen data corresponding to the first Visual Networking Terminal number according to a pre-established database, where the multi-screen data includes the split-screen mode and the screen display content; sending the multi-screen data to the Visual Networking Server, and the Visual Networking Server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number. The first Visual Networking Terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode to recover the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally in progress be recovered, but the multi-screen service can also continue.

[0111] Another embodiment of the present invention provides a service recovery device for performing the service recovery method provided in the above embodiments.

[0112] Refer to Figure 4 , which shows a structural block diagram of an embodiment of a service recovery device of the present invention. The device can be applied to the Visual Networking and specifically includes the following modules: an obtaining module 401, a determining module 402, and a recovery module 403, where:

[0113] The obtaining module 401 is configured to obtain the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking Terminal number;

[0114] The determining module 402 is configured to, when the service status of the first Visual Networking Terminal changes from the offline state to the online state, determine the multi-screen data corresponding to the first Visual Networking Terminal number according to a pre-established database, where the multi-screen data includes the split-screen mode and the screen display content;

[0115] The recovery module 403 is used to send the multi-screen data to the Visual Networking server, so that the Visual Networking server sends the multi-screen data to the first Visual Networking terminal corresponding to the first Visual Networking terminal number, and the first Visual Networking terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode, so as to recover the multi-screen service, where the display is connected to the first Visual Networking terminal.

[0116] The service recovery device provided by the embodiment of the present invention obtains the service information of the first Visual Networking terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking terminal number; when the service status of the first Visual Networking terminal changes from the offline state to the online state, according to the pre-established database, determine the multi-screen data corresponding to the first Visual Networking terminal number, where the multi-screen data includes the split-screen mode and the screen display content; send the multi-screen data to the Visual Networking server, and the Visual Networking server sends the multi-screen data to the first Visual Networking terminal corresponding to the first Visual Networking terminal number, and the first Visual Networking terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode, so as to recover the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally in progress be recovered, but the multi-screen service can also continue.

[0117] Another embodiment of the present invention further supplements the service recovery device provided in the above embodiment.

[0118] Optionally, the Visual Networking server includes a decryption module, and the decryption module is used to:

[0119] Decrypt the multi-screen data according to the pre-stored private key to obtain the split-screen mode and the screen display content, where the multi-screen data is encrypted by the public key, and the public key corresponds to the private key;

[0120] Send the split-screen mode and the screen display content to the first Visual Networking terminal corresponding to the first Visual Networking terminal number.

[0121] Optionally, the device further includes an encryption module, and the encryption module is used to:

[0122] If the multi-screen data corresponding to the second Visual Networking terminal number cannot be found in the pre-established database, receive the first multi-screen data sent by the second Visual Networking terminal;

[0123] Encrypt the first multi-screen data by using the RSA asymmetric encryption and decryption algorithm to obtain the second multi-screen data;

[0124] Save the second multi-screen data in the pre-established database.

[0125] Optionally, the device further includes a detection module, and the detection module is configured to:

[0126] If the network management server receives a heartbeat data packet sent by the Visual Networking Terminal every preset time period, receive a first status data packet sent by the network management server, where the first status data packet includes an online status identifier of the Visual Networking Terminal;

[0127] If the network management server does not receive a heartbeat data packet sent by the Visual Networking Terminal every preset time period, receive a second status data packet sent by the network management server, where the second status data packet includes an offline status identifier of the Visual Networking Terminal.

[0128] Optionally, the device further includes a stop module, and the stop module is configured to:

[0129] In the case where the service status of the Visual Networking Terminal changes from the online status to the offline status, receive an instruction to stop the service, so that the Visual Networking Terminal ends the service.

[0130] Optionally, the device further includes a meeting start module, and the meeting start module is configured to:

[0131] Send a start instruction for a multi-screen meeting to the Visual Networking Terminal;

[0132] After the multi-screen meeting is started, set the Visual Networking Terminal to the multi-screen participant role.

[0133] Optionally, the device further includes a setting module, and the setting module is configured to:

[0134] Send a multi-screen mode setting instruction to the Visual Networking Terminal, where the multi-screen mode setting instruction includes the split screen mode, so that the Visual Networking Terminal performs display screen setting according to the split screen mode.

[0135] It should be noted that each implementable manner in this embodiment can be implemented independently, or can be combined in any combination manner without conflict. The present application makes no limitation.

[0136] For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For related parts, refer to the partial description of the method embodiment.

[0137] The service recovery device provided by the embodiment of the present invention obtains the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking Terminal number; when the service status of the first Visual Networking Terminal changes from the offline state to the online state, according to the pre-established database, determine the multi-screen data corresponding to the first Visual Networking Terminal number, where the multi-screen data includes the split-screen mode and the screen display content; send the multi-screen data to the Visual Networking server, and the Visual Networking server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number, and the first Visual Networking Terminal displays the screen display content on the display at the split-screen position corresponding to the split-screen identifier according to the split-screen mode to restore the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally in progress be restored, but the multi-screen service can also be continued.

[0138] Another embodiment of the present invention provides a terminal device for executing the service recovery method provided by the above embodiment.

[0139] Figure 5 It is a schematic structural diagram of a terminal device of the present invention, as Figure 5 shown, the terminal device includes: at least one processor 501 and a memory 502;

[0140] The memory stores a computer program; the at least one processor executes the computer program stored in the memory to implement the service recovery method provided by the above embodiment.

[0141] The terminal device provided by this embodiment obtains the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking Terminal number; when the service status of the first Visual Networking Terminal changes from the offline state to the online state, according to the pre-established database, determine the multi-screen data corresponding to the first Visual Networking Terminal number, where the multi-screen data includes the split-screen mode and the screen display content; send the multi-screen data to the Visual Networking server, and the Visual Networking server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number, and the first Visual Networking Terminal displays the screen display content on the display at the split-screen position corresponding to the split-screen identifier according to the split-screen mode to restore the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally in progress be restored, but the multi-screen service can also be continued.

[0142] Another embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed, it implements the service recovery method provided by any of the above embodiments.

[0143] A computer-readable storage medium according to this embodiment obtains service information of a first Visual Networking Terminal in a multi-screen service, where the service information includes a service status and a first Visual Networking Terminal number; when the service status of the first Visual Networking Terminal changes from an offline state to an online state, determines multi-screen data corresponding to the first Visual Networking Terminal number according to a pre-established database, where the multi-screen data includes a split-screen mode and screen display content; sends the multi-screen data to a Visual Networking server, and the Visual Networking server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number. The first Visual Networking Terminal displays the screen display content at a split-screen position corresponding to a split-screen identifier on a display according to the split-screen mode to restore the multi-screen service. In this way, when an abnormal situation occurs during a multi-screen conference, not only can the multi-screen service data that was originally in progress be restored, but the multi-screen service can also continue.

[0144] Each embodiment in this specification is described in a progressive manner. The key point of each embodiment is the difference from other embodiments. The same or similar parts among the embodiments can be referred to each other.

[0145] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a device, or a computer program product. Therefore, the embodiments of the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memories, CD-ROMs, optical memories, etc.) containing computer-usable program codes.

[0146] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of methods, electronic devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram can be implemented by computer program instructions, and the combination of processes and / or blocks in the flowchart and / or block diagram can also be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing electronic devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing electronic devices generate a device for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0147] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing electronic devices to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device implements the functions in the processFigure 1 one process or multiple processes and / or blocks Figure 1 the functions specified in one block or multiple blocks.

[0148] These computer program instructions can also be loaded onto a computer or other programmable electronic data processing device, so that a series of operation steps are executed on the computer or other programmable electronic device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable electronic device provide steps for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0149] Although the preferred embodiments of the embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present invention.

[0150] Finally, it should also be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or electronic device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or electronic device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the presence of additional identical elements in the process, method, article or electronic device comprising the element.

[0151] The above has introduced in detail a service recovery method and a service recovery device provided by the present invention. Specific examples are used in this text to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. A service recovery method, characterized in that, Applied to a tablet device installed with the Visual Networking Conference Scheduling Software, the method includes: Obtain the service information of the first Visual Networking terminal in the multi-screen service, where the service information includes the service status and the first Visual Networking terminal number; When the service status of the first Visual Networking terminal changes from the offline state to the online state, determine the multi-screen data corresponding to the first Visual Networking terminal number according to a pre-established database, where the multi-screen data includes the split-screen mode, the screen display content, and the split-screen identifier corresponding to the screen display content in the split-screen mode; Send the multi-screen data to the Visual Networking server, so that the Visual Networking server sends the multi-screen data to the first Visual Networking terminal corresponding to the first Visual Networking terminal number, so that the first Visual Networking terminal displays the screen display content at the split-screen position corresponding to the split-screen identifier on the display according to the split-screen mode to restore the multi-screen service, where the display is connected to the first Visual Networking terminal.

2. The method according to claim 1, characterized in that, The Visual Networking server sending the multi-screen data to the first Visual Networking terminal corresponding to the first Visual Networking terminal number includes: The Visual Networking server decrypts the multi-screen data according to a pre-stored private key to obtain the split-screen mode and the screen display content, where the multi-screen data is encrypted by a public key, and the public key corresponds to the private key; Send the split-screen mode and the screen display content to the first Visual Networking terminal corresponding to the first Visual Networking terminal number.

3. The method according to claim 2, wherein The method further includes: If the multi-screen data corresponding to the first Visual Networking terminal number cannot be found in the pre-established database, receive the first multi-screen data sent by the first Visual Networking terminal; Encrypt the first multi-screen data using the RSA asymmetric encryption and decryption algorithm to obtain the second multi-screen data; Save the second multi-screen data in the pre-established database.

4. The method according to claim 1, characterized in that, Before obtaining the service information of the first Visual Networking terminal in the multi-screen service, the method further includes: If the network management server receives the heartbeat data packet sent by the first Visual Networking terminal every preset time period, receive the first status data packet sent by the network management server, where the first status data packet includes the online status identifier of the first Visual Networking terminal; If the network management server does not receive the heartbeat data packet sent by the first Visual Networking terminal every preset time period, receive the second status data packet sent by the network management server, where the second status data packet includes the offline status identifier of the first Visual Networking terminal.

5. The method according to claim 1, characterized in that The method further includes: When the service status of the first Visual Networking terminal changes from the online state to the offline state, receive an instruction to stop the service, so that the first Visual Networking terminal ends the service.

6. The method according to claim 1, characterized in that Before obtaining the service information of the first Visual Networking terminal in the multi-screen service, it further includes: Send a start instruction for the multi-screen conference to the first Visual Networking terminal; After the multi-screen conference is started, set the first Visual Networking terminal as the multi-screen participant role.

7. The method according to claim 6, wherein Before obtaining the service information of the first Visual Networking Terminal in the multi-screen service, it further includes: Sending a multi-screen mode setting instruction to the first Visual Networking Terminal, where the multi-screen mode setting instruction includes the split-screen mode, so that the first Visual Networking Terminal performs display screen settings according to the split-screen mode.

8. A service recovery device, characterized in that, Applied to a tablet device, the tablet device is installed with Visual Networking Conference Scheduling Software, and the device includes: An obtaining module, configured to obtain the service information of the first Visual Networking Terminal in the multi-screen service, where the service information includes a service status and a first Visual Networking Terminal number; A determining module, configured to, when the service status of the first Visual Networking Terminal changes from an offline state to an online state, determine, according to a pre-established database, multi-screen data corresponding to the first Visual Networking Terminal number, where the multi-screen data includes a split-screen mode, screen display content, and a split-screen identifier corresponding to the screen display content in the split-screen mode; A restoring module, configured to send the multi-screen data to a Visual Networking Server, so that the Visual Networking Server sends the multi-screen data to the first Visual Networking Terminal corresponding to the first Visual Networking Terminal number, so that the first Visual Networking Terminal displays the screen display content at a split-screen position corresponding to the split-screen identifier on a display according to the split-screen mode, to restore the multi-screen service, where the display is connected to the first Visual Networking Terminal.

9. A terminal device, characterized in that, It includes: At least one processor and a memory; The memory stores a computer program; The at least one processor executes the computer program stored in the memory to implement the service restoration method according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, A computer program is stored in the computer-readable storage medium, and when the computer program is executed, the service restoration method according to any one of claims 1-7 is implemented.

Citation Information

Patent Citations

  • Visual networking service processing method and apparatus thereof

    CN106034261A

  • Screen splitting control method and device for conference management system

    CN111131754A