Secure interaction method and device

Abstract

The embodiment of the invention discloses secure interaction equipment and a secure interaction method. According to the technical scheme provided by the embodiment of the invention, the data information sent by the first system to the second system is acquired and the data information is coded to obtain the audio and video information, and the target security data is determined based on the audio and video data and is sent to the second system, so that isolation between the first system and the second system is realized; the data information provided by the first system is coded into the audio and video data to realize encryption processing of the transmission data, and only the audio and video data can be transmitted between the first system and the second system, so that the secure connection between the first system and the second system can be effectively improved; conditions that dangerous data enter the first system and data of the first system are stolen are reduced, and data security of the first system is ensured.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of computer, and particularly relate to a secure interaction device and a secure interaction method. BACKGROUND

[0002] In order to ensure the confidentiality of the data, it is usually necessary to save the data in the internal network database, for example, in the medical field, due to the requirement of patient data confidentiality, the patient data is basically stored in the hospital intranet server as internal data.

[0003] When the external network needs to view the data, the interaction between the internal and external networks is usually realized through a gatekeeper system or a NAT (Network Address Translation) service system. However, the configuration and maintenance costs of the gatekeeper system or the NAT server system are very high, and the internal and external network interaction cost is high. SUMMARY

[0004] Embodiments of the present application provide a secure interaction device and a secure interaction method to solve the technical problem of high internal and external network interaction cost in related technologies, and effectively reduce the internal and external network interaction cost.

[0005] In a first aspect, embodiments of the present application provide a secure interaction method for implementing the interaction process of a plurality of systems, the plurality of systems at least including a first system and a second system, and the secure interaction method comprises:

[0006] obtaining data information sent by the first system to the second system;

[0007] encoding the data information according to a preset condition to form audio and video data;

[0008] sending target security data to the second system, the target security data being at least one of audio data, video data and image data based on the audio and video data.

[0009] The present application obtains the data information sent by the first system to the second system and encodes the data information to obtain audio and video information, and determines the target security data based on the audio and video data and sends it to the second system, while realizing the isolation between the first system and the second system, the encryption processing of the transmission data is realized by encoding the data information provided by the first system into audio and video data, the transmission between the first system and the second system can only be audio and video data, which can effectively improve the secure connection between the first system and the second system, reduce the risk of data entering the first system and the first system data being stolen, and ensure the data security of the first system.

[0010] In a second aspect, the embodiments of the present application provide a secure interaction method for implementing an interaction process of a plurality of systems, the plurality of systems at least including a first system and a second system, the first system and the second system being an internal network system and an external network system respectively, and the secure interaction method comprising:

[0011] acquiring data information sent by the first system to the second system;

[0012] encoding the data information according to a preset condition to form audio and video data;

[0013] sending target security data to the second system, the target security data being at least one of audio data, video data and image data based on the audio and video data.

[0014] The present application acquires data information sent by the internal network system to the external network system, encodes the data information to obtain audio and video information, and determines target security data based on the audio and video data and sends the target security data to the external network system, thereby realizing isolation between the internal network system and the external network system, and realizing encryption processing of the transmission data by encoding the data information provided by the internal network system into audio and video data, so that the internal network system and the external network system can only transmit audio and video data, the secure connection between the internal network system and the external network system can be effectively improved, the situation that dangerous data enters the internal network system and the internal network system data is stolen can be reduced, and the data security of the internal network system is ensured.

[0015] In a third aspect, the embodiments of the present application provide a secure interaction method for implementing an interaction process of a plurality of systems, the plurality of systems at least including a first system and a second system, the first system and the second system being an internal network system and an external network system respectively, and the internal network system and the external network system being integrated in a same terminal, the terminal further comprising a control module, and the secure interaction method comprising:

[0016] acquiring data information sent by the first system to the second system;

[0017] encoding the data information according to a preset condition to form audio and video data;

[0018] sending target security data to the second system, the target security data being at least one of audio data, video data and image data based on the audio and video data.

[0019] This application acquires data information sent from an intranet system to an extranet system, encodes the data information to obtain audio and video information through a control module, and determines target security data based on the audio and video data and sends it to the extranet system through the control module. While achieving isolation between the intranet system and the extranet system, it encrypts the transmitted data by encoding the data information provided by the intranet system into audio and video data. Only audio and video data can be transmitted between the intranet system and the extranet system, which can effectively improve the secure connection between the intranet system and the extranet system, reduce the possibility of dangerous data entering the intranet system and the theft of intranet system data, and ensure the data security of the intranet system.

[0020] Furthermore, the secure interaction method according to any of the foregoing aspects also includes a control process:

[0021] Obtain control commands;

[0022] Based on the target system indicated by the control command, a simulated control command matching the target system is generated;

[0023] Send simulated control commands to the target system.

[0024] The above describes how control commands are converted into analog control commands that match the target system and sent to the target system, thereby enabling control of the target system and making safe interaction between multiple systems more flexible.

[0025] Furthermore, the target system based on the control command includes:

[0026] Based on the coordinate information of the control command and / or the display priority of the first and second systems, identify the target system to which the control command points.

[0027] As described above, by determining the target system based on the display priority of the first system and the second system, effective isolation between the first system and the second system is achieved, while secure interaction between the first system and the second system is also realized.

[0028] Furthermore, the secure interaction method according to any of the foregoing aspects includes:

[0029] The system acquires external input events from the second system, converts the external input events into analog control commands, and sends the analog control commands to the first system.

[0030] The first system responds to the simulated control command and generates first interactive screen data based on the response result to the simulated control command;

[0031] The first system sends the first interactive screen data to the second system, so that the second system can generate the second interactive screen data based on the first interactive screen data;

[0032] The second system outputs the second interactive screen data.

[0033] As described above, the first system responds to external input events and generates first interactive screen data, which is then sent to the second system. The second system generates second interactive screen data based on the first interactive screen data provided by the first system and outputs it. Content sharing of data in the first system can be achieved between the first and second systems through the transmission of interactive screens and simulated control commands. Furthermore, the first and second systems are physically isolated, eliminating the need for a network gateway system or NAT server system for internal and external network interaction. This effectively reduces the cost of internal and external network interaction while ensuring the security of internal network data.

[0034] Furthermore, before obtaining external input events from the second system, the process also includes:

[0035] The second system receives a first external input event sent by a remote terminal.

[0036] As described above, by receiving the first external input event sent by the remote terminal through the second system, the user can initiate the first external input event through the remote terminal. While effectively isolating the first system and the second system, the remote terminal can interactively control the first system, making the secure interaction between the first system and the second system more flexible.

[0037] Furthermore, the second system generates second interactive screen data based on the first interactive screen data, including:

[0038] The second system adds the screen corresponding to the first interactive screen data to the set display range to obtain the second interactive screen data.

[0039] As described above, by adding the screen corresponding to the first interactive screen data to the set display range to obtain the second interactive screen data, content sharing between internal and external networks can be achieved through screen sharing, effectively reducing the interaction cost between internal and external networks.

[0040] Furthermore, the second system adds the screen corresponding to the first interactive screen data to a set display area to obtain the second interactive screen data, including:

[0041] The second system scales the data of the first interactive screen based on a set size;

[0042] The second system adds the image corresponding to the scaled first interactive image data to a set display range to obtain the second interactive image data. The set size is determined based on the set display range.

[0043] As described above, by scaling the first interactive screen data and adding the screen corresponding to the scaled first interactive screen data to the set display range, the second interactive screen data containing the content corresponding to the first interactive screen data is accurately generated, ensuring the accurate interaction between internal and external networks.

[0044] In a fourth aspect, this application provides a secure interaction device, including a first system, a second system, and a control module. Both the first system and the second system are connected to the control module. The first system is used to connect to a first network, and the second system is used to connect to a second network, wherein:

[0045] The first system is used to respond to external input events sent by the control module, generate data information, and send the data information to the control module;

[0046] The control module is used to encode the data information sent by the first system to form the first interactive screen data;

[0047] The second system is used to generate second interactive screen data based on the first interactive screen data provided by the control module, and output the second interactive screen data, as well as receive external input events and send the external input events to the control module;

[0048] The control module is also used to acquire the second interactive screen data and external input events provided by the second system; send the external input events to the first system; and send the first interactive screen data to the second system.

[0049] As described above, the first system responds to external input events sent by the control module, generates first interactive screen data, and sends the first interactive screen data to the control module. The second system generates second interactive screen data based on the first interactive screen data provided by the control module and sends the second interactive screen data to the control module. It also receives external input events and sends them to the control module. Furthermore, the control module obtains the second interactive screen data and external input events provided by the second system, obtains the first interactive screen data provided by the first system, sends external input events to the first system, sends the first interactive screen data to the second system, and outputs the second interactive screen data. Content sharing of intranet data can be achieved between the first and second systems through the transmission of interactive screens and external input events via the control module. Moreover, the first and second systems are physically isolated, eliminating the need for a network gateway or NAT server system for intranet / extranet interaction. This effectively reduces the cost of intranet / extranet interaction while ensuring intranet data security. Attached Figure Description

[0050] Figure 1 This is a schematic diagram of the structure of a secure interactive device provided in an embodiment of this application;

[0051] Figure 2 This is a schematic diagram of the structure of another secure interactive device provided in an embodiment of this application;

[0052] Figure 3 This is a schematic diagram of the structure of a control module provided in an embodiment of this application;

[0053] Figure 4 This is a schematic diagram of an internal and external network interaction scenario provided in an embodiment of this application;

[0054] Figure 5 This is a flowchart of the first secure interaction method provided in the embodiments of this application;

[0055] Figure 6 This is a flowchart of the third secure interaction method provided in the embodiments of this application;

[0056] Figure 7 This is a flowchart of the fourth secure interaction method provided in the embodiments of this application;

[0057] Figure 8 This is a flowchart of the fifth secure interaction method provided in the embodiments of this application.

[0058] Reference numerals in the attached diagram: 1. Intranet system; 2. Extranet system; 3. Control module; 31. Screen signal acquisition unit; 32. Input signal acquisition unit; 33. Transmitting unit; 34. Display unit; 4. Display module; 5. Remote terminal; 6. External input module. Detailed Implementation

[0059] To make the objectives, technical solutions, and advantages of this application clearer, specific embodiments of this application will be described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely for explaining this application and not for limiting it. It should also be noted that, for ease of description, only the parts relevant to this application are shown in the drawings, not all of them. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations (or steps) as sequential processes, many of these operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but additional steps not included in the drawings may also be present. The above processes can correspond to methods, functions, procedures, subroutines, subroutines, etc.

[0060] In existing intranet / extranet interaction solutions, external network access to the internal network is typically achieved through a network isolation system or a NAT server system. However, the cost of such a system is very high, and its maintenance is complex, requiring engineers with relevant experience, resulting in high intranet / extranet interaction costs. Therefore, this application provides a secure interaction device and method to address the high cost of existing intranet / extranet interaction solutions and effectively reduce these costs.

[0061] Figure 1 A schematic diagram of the structure of a secure interactive device provided in an embodiment of this application is given, with reference to... Figure 1 The secure interactive device includes a first system 1, a second system 2, and a control module 3. Both the first system 1 and the second system 2 are connected to the control module 3. The first system 1 is used to connect to an internal network, and the second system 2 is used to connect to an external network. In one embodiment, the first system 1 and the second system 2 provided in this solution can be an intranet system and an extranet system, respectively.

[0062] Optionally, the first system 1 and the second system 2 provided in this solution can be configured with a first network interface card (NIC) module and a second NIC module respectively, and the first NIC module and the second NIC module are independent of each other (there is physical isolation between the first NIC module and the second NIC module). The first system 1 provided in this solution can establish a communication connection with the internal network through the first NIC module, and can access the internal network database and read the data stored in the internal network database. The second system 2 provided in this solution can establish a communication connection with the external network through the second NIC, and can communicate with remote terminals through the external network.

[0063] The first system 1 and the second system 2 provided in this solution are respectively equipped with a first operating system and a second operating system. For example, the first operating system can be a Windows operating system, a Linux operating system, etc., and the second operating system can be an Android operating system, etc. The first operating system and the second operating system can be the same type of operating system or different types of operating systems. Optionally, a conferencing software program for communicating with remote terminals can be installed on the second system 2 to realize the communication connection and data transmission between the second system 2 and the remote terminals.

[0064] The first system 1 provided in this solution can be used to respond to external input events sent by the control module 3, generate data information (such as first interactive screen data), and send the data information to the control module 3. The first interactive screen data can be the screen output by the first system 1. External input events can be input events generated by operations performed on input devices such as a mouse, keyboard, or touch module (such as clicking, dragging, or entering characters). Optionally, responding to external input events can involve adding corresponding interactive icons (such as mouse images) to the generated first interactive screen data, opening, moving, creating new files, entering characters, etc., and interacting with interactive controls in the first system 1.

[0065] The second system 2 provided in this solution can be used to generate second interactive screen data based on the first interactive screen data provided by the control module 3, and send the second interactive screen data to the control module 3. It can also receive external input events and send external input events to the control module 3. The control module 3 can be connected to a local display device such as a monitor or large panel, enabling the local display device to display the second interactive screen data. Optionally, the second system 2 generates the second interactive screen data based on the first interactive screen data by adding the screen corresponding to the first interactive screen data to a set display range. The set display range can be all or part of the entire display range of the second system 2.

[0066] The control module 3 can be used to acquire second interactive screen data and external input events provided by the second system 2, as well as acquire first interactive screen data provided by the first system 1, send external input events to the first system 1, send first interactive screen data to the second system 2, and output second interactive screen data. Optionally, the second interactive screen data can be output to a built-in or external display module (e.g., a display screen) of the security interaction device for display, or it can be sent by the second system 2 to a remote terminal via an external network for display.

[0067] As described above, the first system 1 responds to external input events sent by the control module 3, generates first interactive screen data, and sends the first interactive screen data to the control module 3. The second system 2 generates second interactive screen data based on the first interactive screen data provided by the control module 3 and sends the second interactive screen data to the control module 3. It also receives external input events and sends them to the control module 3. The control module 3 obtains the second interactive screen data and external input events provided by the second system 2, obtains the first interactive screen data provided by the first system 1, sends external input events to the first system 1, sends the first interactive screen data to the second system 2, and outputs the second interactive screen data. The first system 1 and the second system 2 can achieve content sharing of intranet data by transmitting interactive screens and external input events through the control module 3. Furthermore, the first system 1 and the second system 2 are physically isolated, and there is no need to configure a network gateway system or NAT server system for intranet and extranet interaction. This can effectively reduce the cost of intranet and extranet interaction while ensuring intranet data security.

[0068] Based on the above embodiments, Figure 2 A schematic diagram of another secure interactive device provided in this application embodiment is given. Based on the secure interactive device provided in the above embodiment, the secure interactive device provided in this solution also includes a display module 4, a remote terminal 5, and an external input module 6.

[0069] The display module 4 is connected to the control module 3. The control module 3 provided in this solution can also output second interactive screen data to the display module 4, so that the display module 4 displays a screen based on the second interactive screen data. At this time, the screen displayed by the display module 4 includes the screen content corresponding to the first interactive screen data. By outputting the second interactive screen data to the display module 4, this solution allows real-time observation of the screen content corresponding to the first interactive screen data generated in real-time by the first system 1, enabling the viewing of internal network data and improving the flexibility of internal and external network interaction.

[0070] In one embodiment, the external input module 6 provided in this solution is connected to the second system 2 via wired and / or wireless means. Optionally, the external input module 6 can be a mouse, keyboard, touch module (e.g., a touch unit configured on the display module 4), etc., which can be connected via wired and / or wireless means. The second system 2 provided in this solution can receive second external input events through the external input module 6, wherein the second external input event is an external input event generated by the operation of the external input module 6 connected to the second system 2.

[0071] For example, a user can generate a second external input event using a mouse, keyboard, touch module, etc. After detecting the second external input event, the second system 2 sends it to the control module 3. The control module 3 then sends the second external input event to the internal operating system, which responds accordingly. Essentially, the control module 3 intercepts the second external input event received by the second system 2 and sends it to the first system 1 for interactive operation. This solution receives the second external input event through the external input module 6. Users can initiate the second external input event through the external input module 6, effectively isolating the first system 1 and the second system 2 while enabling interactive control of the first system 1.

[0072] In one embodiment, the remote terminal 5 provided by this solution is communicatively connected to the second system 2. The second system 2 is also used to send second interactive screen data to the remote terminal 5 for display. This solution sends the second interactive screen data to the remote terminal 5 for display via the second system 2. The first system 1 and the second system 2 are physically isolated. Content sharing of intranet data can be achieved between the first system 1 and the second system 2 through the transmission of screen information. The second system 2 and the remote terminal 5 cannot directly obtain intranet data, eliminating the need to configure a network gateway system or NAT server system for intranet / extranet interaction. This effectively reduces the cost and maintenance costs of intranet / extranet interaction while ensuring intranet data security.

[0073] In one possible embodiment, the second system 2 provided by this solution can also be used to receive a first external input event sent by the remote terminal 5, wherein the first external input event is an external input event generated by the operation of the terminal input module connected to the remote terminal 5.

[0074] For example, the user of remote terminal 5 can use terminal input modules such as a mouse, keyboard, and touch module to generate a first external input event. After detecting the first external input event, remote terminal 5 sends the first external input event to the second system 2. The second system 2 then sends the first external input event to the control module 3, which in turn sends it to the internal operating system. The internal operating system responds to the first external input event, which is equivalent to the control module 3 intercepting the first external input event received by the second system 2 and sending it to the first system 1 for interactive operation. This solution receives the first external input event through external input module 6. Users can initiate the first external input event through external input module 6, effectively isolating the first system 1 and the second system 2 while enabling interactive control of the first system 1.

[0075] Optionally, the external input events (including the first external input event and the second external input event) provided by this solution can record corresponding coordinate information (such as the coordinates of the movement trajectory, the coordinates of the click operation, the coordinates of the input operation, etc.) and input type (such as click, drag, input characters, etc.). The coordinate information corresponding to the external input event can be mapped to the corresponding mapping coordinates on the first interactive screen data according to the coordinate mapping relationship between the second interactive screen data and the first interactive screen data. The first external input event can be responded to based on the mapping coordinates and the corresponding input type. Optionally, the coordinate mapping relationship between the second interactive screen data and the first interactive screen data can be determined based on the screen scaling relationship and / or position offset between the second interactive screen data and the first interactive screen data. For example, when the sizes of the second interactive screen data and the first interactive screen data are the same, the coordinates of the second interactive screen data and the first interactive screen data overlap and align, and the coordinate mapping relationship between the second interactive screen data and the first interactive screen data is a 1:1 relationship, that is, the mapped coordinates are consistent with the coordinate information corresponding to the first external input event. The external input event received by the second system 2 is intercepted and converted to the coordinates corresponding to the first system 1. By displaying the dual systems on the same screen and making the coordinates of the virtual external input module coincide (e.g., mouse coordinates coincide), the first system 1 responds to the external input event and performs corresponding operations. Real-time control of the internal and external networks can be achieved through a single secure interactive device, and the internal and external networks are physically isolated, which can effectively ensure data security. Optionally, the conversion between coordinate information and mapped coordinates can be performed in one or more combinations of the control module 3, external system, internal system, and remote terminal 5.

[0076] In one possible embodiment, such as Figure 3 As shown in the schematic diagram of a control module, the control module 3 provided in this solution includes a screen signal acquisition unit 31, an input signal acquisition unit 32, a transmission unit 33, and a display unit 34. The screen signal acquisition unit 31, the input signal acquisition unit 32, and the display unit 34 are connected to the transmission unit 33.

[0077] The transmitting unit 33 provided in this solution can be used to realize data transmission between the control module 3 and the first system 1 and the second system 2. The screen signal acquisition unit 31 provided in this solution can be communicatively connected to the first system 1 and the second system 2, and can also be used to acquire the first interactive screen data provided by the first system 1 and send the first interactive screen data to the second system 2 through the transmitting unit 33, and acquire the second interactive screen data provided by the second system 2 and send the second interactive screen data to the display unit 34 through the transmitting unit 33.

[0078] The input signal acquisition unit 32 provided in this solution can be communicatively connected to the second system 2. The input signal acquisition unit 32 can be used to acquire external input events provided by the second system 2 and send the external input events to the first system 1 through the sending unit 33. The display unit 34 provided in this solution can be communicatively connected to the display module 4. The display unit 34 can be used to receive the second interactive screen data sent by the display unit 34 and display the second interactive screen data through the display module 4.

[0079] This solution uses a screen signal acquisition unit 31, an input signal acquisition unit 32, a sending unit 33, and a display unit 34 to acquire and transmit first screen information, second interactive screen data, and external input events. While ensuring physical isolation between the first system 1 and the second system 2, it effectively achieves screen sharing between the first system 1 and the second system 2, realizing efficient and low-cost information interaction between internal and external networks. While ensuring the security of internal network data, it effectively reduces the cost of interaction between internal and external networks.

[0080] In one possible embodiment, the second system 2 provided by this solution generates second interactive screen data based on the first interactive screen data provided by the control module 3. This can be achieved by adding the screen corresponding to the first interactive screen data provided by the control module 3 to a set display range to obtain the second interactive screen data.

[0081] For example, a set display range for displaying the first interactive screen data is determined in the display page of the second system 2. For example, the range for displaying the first interactive screen data is set in the display page of the conference software program. The set display range can be all or part of the range in the display page.

[0082] The second system 2 receives the first interactive screen data provided by the control module 3 in real time, adds the screen corresponding to the first interactive screen data to the set display area of ​​the display page of the second system 2, and renders the display page to obtain second interactive screen data containing the content corresponding to the first interactive screen data. After obtaining the second interactive screen data, the second system 2 can send the second interactive screen data to the remote terminal 5 and / or the control module 3. This solution obtains the second interactive screen data by adding the screen corresponding to the first interactive screen data provided by the control module 3 to the set display area, and realizes content sharing between internal and external networks through screen sharing, effectively reducing the interaction cost between internal and external networks.

[0083] In one possible embodiment, the second system 2 provided by this solution adds the screen corresponding to the first interactive screen data provided by the control module 3 to a set display range to obtain the second interactive screen data. This can be done by: scaling the first interactive screen data provided by the control module 3 based on a set size; adding the screen corresponding to the scaled first interactive screen data to the set display range to obtain the second interactive screen data, wherein the set size is determined based on the set display range.

[0084] For example, based on the set display range for displaying the first interactive screen data determined in the display page of the second system 2, the set size for displaying the first interactive screen data is determined. The second system 2 receives the first interactive screen data provided by the control module 3 in real time, scales the first interactive screen data to the set size, adds the screen corresponding to the scaled first interactive screen data to the set display range of the display page, and renders the display page to obtain second interactive screen data containing the content corresponding to the first interactive screen data. This solution accurately generates second interactive screen data containing the content corresponding to the first interactive screen data by scaling the first interactive screen data and adding the screen corresponding to the scaled first interactive screen data to the set display range, ensuring accurate interaction between internal and external networks.

[0085] For example, such as Figure 4 The diagram illustrates an internal / external network interaction scenario. Assuming a remote consultation in a medical setting, the internal system of a secure interactive device can be connected to the local internal network. The internal system can access the internal network's database. Simultaneously, it establishes a connection with the remote terminals used by participants in the remote consultation via conferencing software installed on an external system. The first system 1 can collect its own first interactive screen data in real time and send it to the control module in the secure interactive device. The control module then forwards the first interactive screen data to the second system 2.

[0086] When the second system 2 enables the internal and external network interaction function in the conferencing software program, the second system 2 receives the first interactive screen data in real time and performs screen rendering based on the first interactive screen data (for example, adding the first interactive screen data to the set display range and rendering it) to obtain the second interactive screen data.

[0087] After generating the second interactive screen data, the second system 2 can send the second interactive screen data to the control module. The control module displays the second interactive screen data through the display module. At this time, the display content corresponding to the first interactive screen data can be observed in the second interactive screen data displayed on the display module. Optionally, on-site personnel can perform interactive operations on the second interactive screen data through an external input module connected to the second system 2 to generate a second external input event. Simultaneously, the second system 2 sends the second external input event to the control module, which then sends the second external input event to the first system 1. The first system 1 will respond to the second external input event. At this time, the response process of the first system 1 to the second external input event can be observed synchronously in the second interactive screen data displayed on the display module. Furthermore, at this time, what is transmitted between the first system 1 and the second system 2 is screen information. The external network cannot actually obtain the data of the internal network, which can effectively realize the interaction between the internal and external networks while ensuring the security of the internal network data.

[0088] Simultaneously, after generating the second interactive screen data, the second system 2 can also send the second interactive screen data to a remote terminal for display. At this time, the content corresponding to the first interactive screen data can be observed in the second interactive screen data displayed on the remote terminal. Optionally, participants in the remote consultation can generate a first external input event through the terminal input module of the remote terminal by performing interactive operations on the second interactive screen data, and then send the first external input event to the second system 2. The second system 2 sends the first external input event to the control module, which in turn sends it to the first system 1. The first system 1 responds to the first external input event, and the response process of the first system 1 to the first external input event can be observed synchronously in the second interactive screen data displayed on the remote terminal. Furthermore, at this time, only screen information is transmitted between the first system 1 and the remote terminal; the remote terminal cannot actually obtain data from the internal network. This effectively achieves interaction between the internal and external networks while ensuring the security of internal network data.

[0089] As described above, the first system 1 responds to external input events sent by the control module 3, generates first interactive screen data, and sends the first interactive screen data to the control module 3. The second system 2 generates second interactive screen data based on the first interactive screen data provided by the control module 3 and sends the second interactive screen data to the control module 3. It also receives external input events and sends them to the control module 3. The control module 3 obtains the second interactive screen data and external input events provided by the second system 2, obtains the first interactive screen data provided by the first system 1, sends external input events to the first system 1, sends the first interactive screen data to the second system 2, and outputs the second interactive screen data. The first system 1 and the second system 2 can achieve content sharing of intranet data by transmitting interactive screens and external input events through the control module 3. Furthermore, the first system 1 and the second system 2 are physically isolated, and there is no need to configure a network gateway system or NAT server system for intranet and extranet interaction. This can effectively reduce the cost of intranet and extranet interaction while ensuring intranet data security. Simultaneously, by outputting second interactive screen data to display module 4, the content of the screen corresponding to the first interactive screen data generated in real time by the first system 1 can be observed in real time, enabling the viewing of internal network data and improving the flexibility of internal and external network interaction. Furthermore, the second interactive screen data can be sent to remote terminal 5 for display via the second system 2. The first system 1 and the second system 2 are physically isolated, and content sharing of internal network data can be achieved through the transmission of screen information. The second system 2 and the remote terminal 5 cannot directly obtain internal network data, eliminating the need for configuring a network gateway system or NAT server system for internal and external network interaction. This effectively reduces the cost and maintenance costs of internal and external network interaction while ensuring internal network data security.

[0090] Figure 5 A flowchart of a first secure interaction method provided in an embodiment of this application is given. This secure interaction method can be applied to secure interaction devices as provided in any of the above embodiments. This secure interaction method can be used to implement the interaction process of multiple systems. The multiple systems provided in this solution include at least a first system and a second system. (Reference) Figure 5 The first secure interaction method provided by this solution includes:

[0091] S110: Obtain data information sent from the first system to the second system.

[0092] S120: Encodes the data information according to preset conditions to form audio and video data.

[0093] The first system provided in this solution can be a system that needs to keep data confidential or isolate it from the outside world. The first system and the second system can communicate directly or indirectly. For example, when the first system needs to share or display data information to the outside world, it can send data information to the second system. However, the data information sent by the first system to the second system is not sent directly to the second system. Instead, it needs to be encoded into audio and video data first and then sent in other data forms to avoid the possibility of data leakage due to the first system directly sending data information to the second system.

[0094] After receiving data information sent from the first system to the second system, the data information can be encoded according to preset conditions (such as preset encoding processing conditions, encoding control parameters, etc.) to obtain audio and video data that reflects the data information. Optionally, the data type provided by this solution can be set according to the needs of information interaction. The data information can be image data, video data, audio data, text data, document files, web page files, etc. The audio and video data obtained by encoding the data information can reflect all or part of the content of the data information. For example, when the data information is text data, when playing the encoded audio and video data, the playback screen can display the corresponding text content.

[0095] S130: Send target security data to the second system. The target security data is at least one of audio data, video data, and image data obtained based on audio and video data.

[0096] For example, after obtaining the audio and video data, the system determines the target security data based on the audio and video data and sends the target security data to the second system. After receiving the target security data, the second system can display or play the target security data, or send the target security data to a connected remote terminal for display or playback.

[0097] Optionally, the target security data provided in this solution can be audio and video data, or at least one of audio data, video data, and image data obtained by processing audio and video data. For example, extracting part or all of the audio data from the audio and video data as target security data, extracting part or all of the video data from the audio and video data as target security data, or extracting part or all of the image data from the audio and video data as target security data.

[0098] As described above, by acquiring data information sent from the first system to the second system and encoding the data information to obtain audio and video information, and by determining target security data based on the audio and video data and sending it to the second system, isolation is achieved between the first system and the second system. At the same time, encryption processing of the transmitted data is achieved by encoding the data information provided by the first system into audio and video data. Only audio and video data can be transmitted between the first system and the second system, which can effectively improve the security connection between the first system and the second system, reduce the possibility of dangerous data entering the first system and the theft of data in the first system, and ensure the data security of the first system.

[0099] This application also provides a second secure interaction method, which can be applied to the secure interaction device provided in any of the above embodiments. This secure interaction method can be used to realize the interaction process of multiple systems. The multiple systems provided in this solution include at least a first system and a second system. The first system and the second system provided in this solution are respectively an intranet system and an extranet system.

[0100] The second secure interaction method provided in this solution includes:

[0101] S210: Obtain data information sent from the first system to the second system.

[0102] S220: Encode the data information according to preset conditions to form audio and video data.

[0103] S230: Send target security data to the second system. The target security data is at least one of audio data, video data, and image data obtained based on audio and video data.

[0104] The difference between the secure interaction method provided in this embodiment and the secure interaction method provided in the above embodiments lies in that the first system and the second system provided in this solution are respectively an intranet system and an extranet system. The relevant operation steps can be referred to the secure interaction method provided in the above embodiments, and will not be repeated here. This solution encodes the data information sent from the intranet system to the extranet system into audio and video data, and after determining the target secure data based on the audio and video data, sends it to the extranet system. This achieves effective isolation between the intranet system and the extranet system while enabling secure interaction between them.

[0105] The above describes a process where data information sent from the intranet system to the extranet system is acquired and encoded to obtain audio and video information. Based on this audio and video data, target security data is determined and sent to the extranet system. This achieves isolation between the intranet and extranet systems while simultaneously encrypting the transmitted data by encoding the data provided by the intranet system into audio and video data. Only audio and video data can be transmitted between the intranet and extranet systems, effectively improving the security of the connection, reducing the risk of dangerous data entering the intranet system and the theft of intranet system data, and ensuring the data security of the intranet system.

[0106] Figure 6 A flowchart of a third secure interaction method provided in this application embodiment is given. This secure interaction method can be applied to the secure interaction device provided in any of the above embodiments. This secure interaction method can be used to realize the interaction process of multiple systems. The multiple systems provided in this solution include at least a first system and a second system. The first system and the second system provided in this solution are an intranet system and an extranet system, respectively, and the intranet system and the extranet system are integrated into the same terminal. The terminal also includes a control module, that is, the terminal is configured with a control module, the intranet system, and the extranet system, and the control module is communicatively connected to both the intranet system and the extranet system.

[0107] refer to Figure 6 The third secure interaction method provided in this solution includes:

[0108] S310: Obtain data information sent from the first system to the second system.

[0109] S320: The control module encodes data information according to preset conditions to form audio and video data.

[0110] S330: The control module sends target security data to the second system. The target security data is at least one of audio data, video data, and image data obtained based on audio and video data.

[0111] The difference between the secure interaction method provided in this embodiment and the secure interaction method provided in the above embodiments lies in that, in this solution, data information is encoded according to preset conditions to form audio and video data, and the sending of target security data to the second system is executed by the control module. The relevant operation steps can be referred to the secure interaction method provided in the above embodiments, and will not be repeated here. This solution achieves the isolation of data information into audio and video data, as well as the determination and sending of target security data through the control module. This effectively isolates the internal network system from the external network system while enabling secure interaction between the two systems.

[0112] The above describes a system that acquires data sent from the intranet system to the extranet system, encodes the data using a control module to obtain audio and video information, and determines target security data based on the audio and video data before sending it to the extranet system. This achieves isolation between the intranet and extranet systems while encrypting transmitted data by encoding the data provided by the intranet system into audio and video data. Only audio and video data can be transmitted between the intranet and extranet systems, effectively improving the security of the connection, reducing the risk of dangerous data entering the intranet system and the theft of intranet system data, and ensuring the data security of the intranet system.

[0113] Figure 7 A flowchart of the fourth secure interaction method provided in this application embodiment is given. The secure interaction method provided in this solution can be further configured based on the secure interaction method provided in any of the above embodiments. In addition to the secure interaction method provided in any of the above embodiments, the secure interaction method provided in this solution also provides a secure interaction control process, realizing control of the target system during the interaction process of multiple systems.

[0114] refer to Figure 7 The fourth secure interaction method provided in this solution includes:

[0115] S410: Obtain data information sent from the first system to the second system.

[0116] S420: Encodes data information according to preset conditions to form audio and video data.

[0117] S430: Send target security data to the second system. The target security data is at least one of audio data, video data, and image data obtained based on audio and video data.

[0118] S440: Get control commands.

[0119] For example, a control command is acquired, which may be obtained based on control information input from input devices such as a mouse or keyboard connected to the first or second system. After acquiring the control command, the target system (first or second system) to which the control command points is determined, and the control command is converted into an analog control command adapted to the target system (i.e., an analog control command that the target system can correctly recognize and respond to) according to the control information format corresponding to the target system.

[0120] S450: Based on the target system indicated by the control command, generate analog control commands that match the target system.

[0121] S460: Sends analog control commands to the target system.

[0122] In one embodiment, the first system and the second system provided by this solution can be built on different operating systems. For example, the first system and the second system are a PC system (e.g., Windows system, Linux system, etc.) and an Android system, respectively. Different operating systems correspond to different types of control information. Based on the pre-set conversion logic between control instructions and control information of different operating systems, the control instructions can be converted into analog control instructions that match the corresponding operating system according to the requirements of different operating systems for control information.

[0123] After receiving the simulation control command, the simulation control command is sent to the target system so that the target system can receive and respond to the simulation control command, thereby realizing the control of the target system.

[0124] In one possible embodiment, the secure interaction method provided by this solution is based on the target system pointed to by the control command, which may be: based on the coordinate information of the control command and / or the display priority of the first system and the second system, to identify the target system pointed to by the control command.

[0125] After obtaining the control command, the target system can be determined based on the coordinate information of the control command and / or the display priority of the first and second systems. In one embodiment, for determining the target system based on coordinate information, assuming that the first and second systems share a display module, the display area of ​​the display module is divided into a first display area and a second display area, which respectively display the corresponding screen information of the first and second systems (e.g., displaying the corresponding screen information of the first and second systems at a set ratio or at a 1:1 ratio). The coordinate information of the control command can indicate the position of the relevant operation in the display area (e.g., the mouse click position, keyboard input position, etc.). The corresponding display area is determined based on the coordinate information of the control command, and the system corresponding to the display area is taken as the target system.

[0126] For example, the display area of ​​the display module can be divided into two equal parts, left and right. These two areas display the corresponding screen information of the first and second systems, respectively. Interaction is achieved by using the mouse to control the display. When the mouse is in the left half of the display area, a control command is generated pointing to the first system; when the mouse is in the right half, a control command is generated pointing to the second system. Optionally, the coordinate information can be a specific point within the display area or a range of coordinates within the display area (e.g., represented by the coordinates of the four corner points). This solution determines the target system based on the coordinate information of the control commands, accurately controlling the target system interactively. Furthermore, the target system determined based on coordinate information is more in line with user operating habits, effectively improving the user experience.

[0127] In one embodiment, to determine the target system based on the display priorities of the first and second systems, the display priorities of the first and second systems can be preset, determined based on the user's display priority setting operation, or, when the first and second systems share a display module, determined based on the display areas of the first and second systems (e.g., setting the system displaying in the designated display area to have a higher display priority). Upon receiving a control command, the system with the higher display priority is determined and designated as the target system for the control command. For example, setting the display priority of the first system higher than that of the second system ensures that all acquired control commands are directed to the first system, and control operations are performed on the first system. This solution, by determining the target system based on the display priorities of the first and second systems, achieves effective isolation between the first and second systems while enabling secure interaction between them.

[0128] As described above, by acquiring and encoding data information sent from the first system to the second system to obtain audio and video information, and determining target security data based on the audio and video data and sending it to the second system, isolation is achieved between the first and second systems. Encryption of transmitted data is achieved by encoding the data information provided by the first system into audio and video data. Only audio and video data can be transmitted between the first and second systems, effectively improving the secure connection between them, reducing the possibility of dangerous data entering the first system and the theft of its data, and ensuring the data security of the first system. Simultaneously, control commands are converted into analog control commands matching the target system and sent to it, enabling control of the target system and making secure interaction between multiple systems more flexible.

[0129] Figure 8 A flowchart of the fifth secure interaction method provided in this application embodiment is given. The secure interaction method provided in this solution can be further configured based on the secure interaction method provided in any of the above embodiments. (Reference) Figure 8 The secure interaction method includes:

[0130] S510: Obtain external input events from the second system, convert the external input events into analog control commands, and send the analog control commands to the first system.

[0131] The second system provided in this solution can receive external input events generated by operations using input devices such as a mouse, keyboard, and touch module. These external input events can be external input events targeting the first system and are used to interact with the first system.

[0132] For example, an external input event is acquired from the second system, and the external input event is converted into an analog control command that matches the first system (e.g., the corresponding control command is determined based on the external input event, and the control command is converted into an analog control command that matches the first system), and the analog control command is sent to the first system. In one embodiment, acquiring the external input event from the second system, converting the external input event into an analog control command, and sending the analog control command to the first system can be performed by a control module connected to both the first and second systems.

[0133] Optionally, the external input event provided by this solution can be a first external input event sent by a remote terminal, or a second external input event received through an external input module. In one possible embodiment, the secure interaction method provided by this solution further includes, before obtaining the external input event from the second system, the second system receiving the first external input event sent by the remote terminal.

[0134] For example, the second system is connected to a remote terminal, and the remote terminal is connected to terminal input modules such as a mouse, keyboard, and touch module. When the remote terminal detects input operations from the terminal input modules, it can send a corresponding first external input event to the second system. This solution allows the second system to receive the first external input event sent by the remote terminal. Users can initiate the first external input event through the remote terminal, effectively isolating the first and second systems while enabling interactive control of the first system from the remote terminal. This provides more flexible and secure interaction between the first and second systems.

[0135] In one possible embodiment, the second system is also connected to an external input module. The secure interaction method provided by this solution further includes: the second system receiving a second external input event through the external input module.

[0136] For example, the second system can receive a second external input event through an external input module, where the second external input event is an external input event generated by operating the external input module connected to the second system. This solution receives the second external input event through the external input module, allowing users to initiate the second external input event. This effectively isolates the first and second systems while enabling interactive control of the first system, making secure interaction between the first and second systems more flexible.

[0137] S520: The first system responds to the analog control command and generates the first interactive screen data based on the response result to the analog control command.

[0138] In one embodiment, the solution uses the screen data generated by the first system as data information to be sent to the second system, and the first system can respond to the received analog control command and generate screen data corresponding to the response result.

[0139] For example, after receiving a simulated control command, the first system can respond to the simulated control command and generate first interactive screen data based on the response result. For instance, when the external input event is a mouse click event on a target object (such as an interactive control displayed on the screen corresponding to the first system), a simulated control command to click the target object is generated. The first system will respond to the simulated control command by executing the corresponding click response action and generate first interactive screen data after executing the click response action.

[0140] S530: The first system sends the first interactive screen data to the second system so that the second system can generate the second interactive screen data based on the first interactive screen data.

[0141] For example, after generating the first interactive screen data, the first system sends the first interactive screen data to the second system, so that the second system can generate the second interactive screen data based on the first interactive screen data. Optionally, the first system can send the first interactive screen data to the second system directly, or the first system can send the first interactive screen data to the second system through a control module.

[0142] When the second system generates the second interactive screen data based on the first interactive screen data, it may use the first interactive screen data as the second interactive screen data, or it may add the screen corresponding to the first interactive screen data to a set display range. The set display range may be all or part of the entire display range of the second system 2.

[0143] In one possible embodiment, the second system provided by this solution generates second interactive screen data based on the first interactive screen data. This can be achieved by the second system adding the screen corresponding to the first interactive screen data to a set display range to obtain the second interactive screen data.

[0144] For example, a set display range for displaying the first interactive screen data can be determined in the display page of the second system. For instance, the range for displaying the first interactive screen data can be set in the display page of the conferencing software program. The set display range can be all or part of the range in the display page.

[0145] The second system collects the first interactive screen data in real time and adds the corresponding screen to the designated display area of ​​the second system's display page. The rendered display page then produces second interactive screen data containing the content corresponding to the first interactive screen data. This solution obtains the second interactive screen data by adding the screen corresponding to the first interactive screen data to the designated display area. Content sharing between internal and external networks can be achieved through screen sharing, effectively reducing the interaction costs between internal and external networks.

[0146] In one possible embodiment, the second system provided by this solution adds the screen corresponding to the first interactive screen data to a set display range to obtain the second interactive screen data. This can be achieved by: the second system scaling the first interactive screen data based on a set size; and the second system adding the screen corresponding to the scaled first interactive screen data to the set display range to obtain the second interactive screen data, wherein the set size is determined based on the set display range.

[0147] For example, based on the set display range for displaying the first interactive screen data determined in the display page of the second system, a set size for displaying the first interactive screen data is determined. The second system receives the first interactive screen data in real time, scales the first interactive screen data to the set size, and adds the screen corresponding to the scaled first interactive screen data to the set display range of the display page. The display page is then rendered to obtain second interactive screen data containing the content corresponding to the first interactive screen data. This solution accurately generates second interactive screen data containing the content corresponding to the first interactive screen data by scaling the first interactive screen data and adding the screen corresponding to the scaled first interactive screen data to the set display range, ensuring accurate interaction between internal and external networks.

[0148] S540: The second system outputs the second interactive screen data.

[0149] For example, after obtaining the second interactive screen data, the second system can output the second interactive screen data. Optionally, the second system can output the second interactive screen to a connected display module for display, or it can output the second interactive screen data to a remotely connected remote terminal for display.

[0150] As described above, the first system responds to external input events and generates first interactive screen data, which is then sent to the second system. The second system generates second interactive screen data based on the first interactive screen data provided by the first system and outputs it. Content sharing of data in the first system can be achieved between the first and second systems through the transmission of interactive screens and simulated control commands. Furthermore, the first and second systems are physically isolated, eliminating the need for a network gateway system or NAT server system for internal and external network interaction. This effectively reduces the cost of internal and external network interaction while ensuring the security of internal network data.

[0151] The operation steps of each module (including the first system, the second system, the control module, the display module, the external input module, and the remote terminal) in the secure interaction method provided in this solution can be referred to the relevant description of the secure interaction device provided in any of the above embodiments, and have the corresponding effects. This solution will not repeat them here.

[0152] The above description is merely a preferred embodiment and the technical principles employed in this application. This application is not limited to the specific embodiments provided herein, and various obvious changes, readjustments, and substitutions that can be made by those skilled in the art will not depart from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the claims.

Claims

1. A secure interaction method for implementing an interaction process of a plurality of systems, the plurality of systems comprising at least a first system, a second system, characterized in that, The safe interaction method comprises: Obtaining data information sent by a first system to a second system; According to a preset condition, the data information is encoded to form audio and video data; The target security data is at least one of audio data, video data and image data based on the audio and video data.

2. A secure interaction method for implementing an interaction process of a plurality of systems, the plurality of systems comprising at least a first system and a second system, the first system and the second system being respectively an intranet system and an extranet system, characterized in that, The safe interaction method comprises: Obtaining data information sent by a first system to a second system; According to a preset condition, the data information is encoded to form audio and video data; The target security data is at least one of audio data, video data and image data based on the audio and video data.

3. A secure interaction method for implementing an interaction process of a plurality of systems, the plurality of systems comprising at least a first system and a second system, the first system and the second system being respectively an intranet system and an extranet system, and the intranet system and the extranet system being integrated in a same terminal, the terminal further comprising a control module, characterized in that, The safe interaction method comprises: Obtaining data information sent by a first system to a second system; The control module encodes the data information according to a preset condition to form audio and video data; The control module sends the target security data to the second system, and the target security data is at least one of audio data, video data and image data based on the audio and video data.

4. The secure interaction method according to any one of claims 1 to 3, characterized in that, Further comprising a control process: Obtaining a control instruction; Based on the target system pointed by the control instruction, forming a simulated control instruction matched with the target system; Sending the simulated control instruction to the target system.

5. The secure interaction method of claim 4, wherein, The target system based on the control instruction comprises: Based on the coordinate information of the control instruction and / or the display priority of the first system and the second system, identifying the target system pointed by the control instruction.

6. The secure interaction method according to any one of claims 1 to 3, characterized in that, Comprise: Obtaining external input events from the second system, converting the external input events into simulated control instructions, and sending the simulated control instructions to the first system; The first system responds according to the simulated control instruction, and generates first interaction picture data based on the response result of the simulated control instruction; The first system sends the first interaction picture data to the second system, so that the second system generates second interaction picture data based on the first interaction picture data; The second system outputs the second interaction picture data.

7. The secure interaction method of claim 6, wherein, Before obtaining external input events from the second system, further comprising: The second system receives the first external input event sent by the remote terminal.

8. The secure interaction method of claim 6, wherein, The second system generates second interaction picture data based on the first interaction picture data, comprising: The second system adds the picture corresponding to the first interaction picture data to the set display range to obtain the second interaction picture data.

9. The secure interaction method of claim 8, wherein, The second system adds the picture corresponding to the first interaction picture data to the set display range to obtain the second interaction picture data, comprising: The second system scales the first interaction picture data based on the set size; The second system adds the picture corresponding to the scaled first interaction picture data to the set display range to obtain the second interaction picture data, and the set size is determined based on the set display range.

10. A secure interaction device, characterized in that The application relates to a system comprising a first system, a second system and a control module, wherein the first system and the second system are connected to the control module, the first system is used for connecting to a first network, and the second system is used for connecting to a second network, wherein: the first system is used for responding to an external input event sent by the control module, generating data information, and sending the data information to the control module; the control module is used for encoding the data information sent by the first system to form first interactive picture data; the second system is used for generating second interactive picture data according to the first interactive picture data provided by the control module, outputting the second interactive picture data, receiving an external input event, and sending the external input event to the control module; the control module is further used for acquiring the second interactive picture data and the external input event provided by the second system, sending the external input event to the first system, and sending the first interactive picture data to the second system.

Images