Secure interaction device

Abstract

The embodiment of the invention discloses secure interaction equipment. According to the technical scheme provided by the embodiment of the invention, the data information sent by the first system to the second system is acquired through the control module, the data information is coded according to the preset condition to form the audio and video data, and the audio and video data is sent to the second system, so that the isolation between the first system and the second system is realized; the data information provided by the first system is coded into audio and video data to realize encryption processing of transmission data, so that secure connection between the first system and the second system can be effectively ensured, the situations that dangerous data enter the first system and the data of the first system are stolen are reduced, the data security of the first system is ensured, and the user experience is improved. And the security interaction cost between systems is reduced.

Description

Technical Field

[0001] This application relates to the field of computer technology, and more particularly to a secure interactive device. Background Technology

[0002] To ensure the confidentiality of information, it is usually necessary to store the data in a database on an internal network. For example, in the medical field, due to the confidentiality requirements of patient data, patient data is usually stored on the hospital's intranet server for internal use.

[0003] When accessing data on an external network, interaction between the internal and external networks is typically achieved through a network isolation system or a NAT (Network Address Translation) service. However, network isolation systems and NAT server systems have very high configuration and maintenance costs, resulting in high costs associated with inter-network interaction. Summary of the Invention

[0004] This application provides a secure interaction device to solve the technical problem of high interaction costs between internal and external networks in related technologies, and effectively reduce the interaction costs between internal and external networks.

[0005] This application provides a secure interactive device, including a control module, wherein:

[0006] The control module is used to acquire data information sent from the first system to the second system, encode the data information according to preset conditions to form audio and video data, and send the audio and video data to the second system. The audio and video data is at least one of audio data, video data, and image data.

[0007] This application embodiment obtains data information sent from the first system to the second system through a control module, encodes the data information according to preset conditions to form audio and video data, and sends the audio and video data to the second system. While achieving isolation between the first system and the second system, the encryption of transmitted data is achieved by encoding the data information provided by the first system into audio and video data. This can effectively ensure a secure connection between the first system and the second system, reduce the possibility of dangerous data entering the first system and the theft of data in the first system, ensure the data security of the first system, and reduce the cost of secure interaction between systems.

[0008] Furthermore, it also includes a control input module, which is directly or indirectly connected to the first system and the second system. The control input module is used to acquire control commands, generate analog control commands that match the target system based on the target system pointed to by the control commands, and send the analog control commands to the target system; the target system is the first system and / or the second system.

[0009] The control input module is also used to acquire control commands sent by the first system and send them to the second system; and / or

[0010] The control input module is also used to acquire control commands sent by the second system and send them to the first system.

[0011] As described above, the control input module generates simulated control commands based on the target system indicated by the acquired control commands and sends them to the target system, effectively realizing the control of the target system and making the safe interaction of multiple systems more flexible.

[0012] Furthermore, the control module, based on the target system indicated by the control command, generates analog control commands that match the target system, including:

[0013] Based on the coordinate information of the control command, using the system corresponding to that system as the target system, simulated control commands matching the target system are generated; and / or

[0014] Based on the coordinate information of the control command, the display priorities of the first system and the second system are determined, and the system with the higher display priority is taken as the target system, and a simulated control command matching the target system is generated.

[0015] As described above, by determining the target system based on the coordinate information of the control command, the target system can be accurately interactively controlled. Furthermore, the target system determined based on the coordinate information is more in line with user operating habits, effectively improving the user experience. Additionally, the target system can be determined based on the display priority of the first system and the second system, achieving effective isolation between the first system and the second system while enabling secure interaction between them.

[0016] Furthermore, it also includes a display module, which is connected to the control module or the second system. The display module is used to acquire interactive screen data provided by the control module and / or the second system, and to display the screen data of the interactive screen.

[0017] As described above, by outputting interactive screen data to the display module, the corresponding screen content can be observed in real time through the interactive screen data. While ensuring the security of multi-system interaction, flexible data viewing is achieved, improving the flexibility of multi-system interaction.

[0018] Furthermore, it also includes an external input module, which is connected to the control module or the second system. The external input module is used to generate a first external input event based on an external input operation triggered by the external input module.

[0019] As described above, by generating the first external input event based on the external input operation through the external input module, the input control of the control module or the second system can be effectively realized, and the safe interaction of multiple systems is more flexible.

[0020] Furthermore, the control module is also used to acquire external input events, convert the external input events into analog control commands, and send the analog control commands to the first system;

[0021] The first system is further configured to respond to the analog control command, generate first interactive screen data based on the response result to the analog control command, and send the first interactive screen data to the control module so that the control module encodes the first interactive screen data according to preset conditions to form audio and video data, and sends it to the second system.

[0022] The second system is also used to generate second interactive screen data based on the audio and video data, and output the second interactive screen data.

[0023] As described above, the first system responds to external input events and generates first interactive screen data, which is then sent to the control module. The control module encodes the first interactive screen data according to preset conditions to form audio and video data. The second system then generates and outputs second interactive screen data based on the audio and video data. Content sharing of data in the first system can be achieved between the first and second systems through the transmission of interactive screens and analog control commands. Furthermore, the first and second systems are physically isolated, eliminating the need for network gateways or NAT server systems for internal and external network interaction. This effectively reduces the cost of internal and external network interaction while ensuring the security of internal network data.

[0024] Furthermore, the external input event includes a first external input event received from the external input module, and / or a second external input event received by the second system from the remote terminal.

[0025] As described above, by receiving the first external input event through the external input module and / or by receiving the first external input event sent by the remote terminal through the second system, the user can flexibly initiate external input events through the external input module and / or the remote terminal. While effectively isolating the first system and the second system, the user can also achieve interactive control of the first system by the remote terminal, making the secure interaction between the first system and the second system more flexible.

[0026] Furthermore, the second system generates second interactive screen data based on the audio and video data, including:

[0027] The video and audio data corresponding to the image are added to the set display range to obtain the second interactive image data.

[0028] As described above, by adding the corresponding video and audio data to the set display range to obtain the second interactive screen data, content sharing between internal and external networks can be achieved through screen sharing, effectively reducing the interaction cost between internal and external networks.

[0029] Furthermore, the second system adds the image corresponding to the audio and video data to a set display area to obtain second interactive image data, including:

[0030] The second system scales the audio and video data based on a set size;

[0031] The second system adds the image corresponding to the scaled audio and video data to the set display range to obtain the second interactive image data. The set size is determined based on the set display range.

[0032] As described above, by scaling the audio and video data and adding the corresponding screen to the scaled audio and video data into the set display range, the second interactive screen data containing the corresponding content of the audio and video data is accurately generated, ensuring the accurate interaction between internal and external networks.

[0033] Furthermore, the secure interactive device also includes a first system module, which is connected to the control module and is configured with a first system.

[0034] As described above, by configuring the first system in the first system module, a network connection can be established with the intranet to form an intranet system. By replacing the network gateway system and NAT server system with the control module, secure interaction between the intranet and the NAT server can be achieved. This can effectively reduce the interaction cost and maintenance cost between the intranet and the NAT server while ensuring the security of intranet data.

[0035] Furthermore, the secure interactive device also includes a second system module, which is connected to the control module and is configured with a second system.

[0036] As described above, by configuring the second system in the second system module, it can be connected to the external network to form an external network system. It can also be connected to the internal network system (such as internal network devices such as hosts connected to the internal network) through the control module. There is no need to configure a network gateway system or NAT server system for internal and external network interaction. This can effectively reduce the cost of internal and external network interaction and maintenance costs while ensuring the security of internal network data. Attached Figure Description

[0037] Figure 1 This is a schematic diagram of the structure of a secure interactive device provided in an embodiment of this application;

[0038] Figure 2 This is a schematic diagram of the structure of another secure interactive device provided in an embodiment of this application;

[0039] Figure 3 This is a schematic diagram of the structure of a control module provided in an embodiment of this application;

[0040] Figure 4 This is a schematic diagram of an internal and external network interaction scenario provided in an embodiment of this application;

[0041] Figure 5 This is a schematic diagram of the structure of another secure interactive device provided in an embodiment of this application.

[0042] Reference numerals: 1. First system; 2. Second system; 3. Control module; 31. Screen signal acquisition unit; 32. Input signal acquisition unit; 33. Transmission unit; 34. Display unit; 4. Display module; 5. Remote terminal; 6. Control input module; 7. External input module; 8. First system module; 9. Second system module. Detailed Implementation

[0043] To make the objectives, technical solutions, and advantages of this application clearer, specific embodiments of this application will be described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of this application and not intended to limit it. Furthermore, it should be noted that, for ease of description, only the parts relevant to this application are shown in the accompanying drawings, not all of them.

[0044] In the description of the embodiments of this application, unless otherwise expressly specified and limited, the terms "connected," "linked," and "fixed" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two elements or the interaction between two elements. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of the operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The above process can be terminated when its operation is completed, but it may also have additional steps not included in the drawings. The above process can correspond to a method, function, procedure, subroutine, subroutine, etc.

[0045] An intranet is a private network established within a user's premises. It connects users' computers, servers, internal databases, printers, scanners, and other devices to enable internal resource sharing, file transfer, email communication, and collaborative work. Intranet systems typically employ firewalls or other security devices to isolate them from the external network, ensuring the security and privacy of internal data. An intranet system can be defined as software and / or hardware systems that allow for information access and management within the intranet.

[0046] The external network is an open network environment, such as the Internet, through which various users access various websites, services, applications and other resources. The external network system is a software and / or hardware system that can access and manage information based on the external network, thereby achieving data sharing and effective isolation between the internal network system and the external network system.

[0047] In existing intranet / extranet interaction solutions, external network access to the internal network is typically achieved through a network isolation system or a NAT server system. However, the cost of such a system is very high, and its maintenance is complex, requiring engineers with relevant experience, resulting in high intranet / extranet interaction costs. Therefore, this application provides a control module 3 according to an embodiment of the present application to solve the technical problem of high intranet / extranet interaction costs and effectively reduce these costs.

[0048] This application provides a schematic diagram of a secure interactive device, which includes a control module 3. The control module 3 is communicatively connected to a first system 1 and a second system 2. The first system 1 is an operating system connected to an intranet (internal network system), and the second system 2 is an operating system connected to an external network (external network system). When the first system 1 sends data information to the second system 2, the control module 3 first encodes the data information according to preset conditions to form audio and video data, and then sends the audio and video data to the second system 2. The audio and video data provided in this solution is at least one of audio data, video data, and image data.

[0049] In some embodiments, such as Figure 1 As shown, the first system 1, the second system 2, and the control module 3 are all integrated within the secure interaction device. However, in some embodiments, the secure interaction device only includes the control module 3, meaning that the control module 3 and the first system 1 and the second system 2 belong to different operating systems. The first system 1 and the second system 2 can optionally run on user terminal devices such as PCs and tablets.

[0050] In some embodiments, the control module 3 provided in this solution realizes bidirectional transmission of data information. The control module 3 can also obtain data information sent from the second system 2 to the first system 1. For example, the control module 3 obtains data information sent from the second system 2 to the first system 1, encodes the data information according to preset conditions to form audio and video data, and sends the audio and video data to the first system 1.

[0051] Optionally, the secure interactive device provided in this solution can be applied in scenarios where data security protection for the first system 1 is required, and where the first system 1 needs to share data with the second system 2. For example, in a remote medical consultation scenario, the first system 1 can be connected to the hospital's internal network, and the second system 2 can be connected to an external network (such as the Internet), establishing communication with the remote terminals participating in the remote medical consultation. The first system 1 can normally access the hospital's internal data, and through the above method, it can encode and process the hospital's internal data in the first system 1's internal network to form audio and video data, which is then sent to the second system 2. The second system 2 then transmits the data to the remote terminals, enabling the remote terminals to remotely view the data on the internal network.

[0052] Optionally, the first system 1 and the second system 2 provided in this solution can be configured with a first network interface card (NIC) module and a second NIC module respectively, and the first NIC module and the second NIC module are independent of each other (there is physical isolation between the first NIC module and the second NIC module). The first system 1 provided in this solution can establish a communication connection with the internal network through the first NIC module, and can access the internal network database and read the data stored in the internal network database. The second system 2 provided in this solution can establish a communication connection with the external network through the second NIC, and can communicate with remote terminals such as mobile phones, tablets, and computers through the external network.

[0053] The first system 1 and the second system 2 provided in this solution are respectively a first operating system and a second operating system. For example, the first operating system can be a Windows operating system, a Linux operating system, etc., and the second operating system can be an Android operating system, etc. The first operating system and the second operating system can be the same type of operating system or different types of operating systems. Optionally, a conferencing software program for communicating with the remote terminal 5 can be installed on the second system 2 to realize the communication connection and data transmission between the second system 2 and the remote terminal 5.

[0054] For example, when the first system 1 needs to share or display data information to the outside world, it can send the data information to the second system 2. However, the data information sent by the first system 1 to the second system 2 is not sent directly to the second system 2. Instead, it needs to be encoded and processed into audio and video data before being sent, in order to avoid the situation where the first system 1 directly sends the data information to the second system 2, which could lead to the leakage of data information.

[0055] After receiving data information sent from the first system 1 to the second system 2, the control module 3 can encode the data information according to preset conditions (such as preset encoding processing conditions, encoding control parameters, etc.) to obtain audio and video data that reflects the data information. Optionally, the data type of the data information provided in this solution can be set according to the information interaction needs. The data information can be image data, video data, audio data, text data, document files, web page files, etc. The audio and video data obtained by encoding the data information can reflect all or part of the content of the data information. For example, when the data information is text data, when playing the encoded audio and video data, the playback screen can display the corresponding text content.

[0056] For example, after obtaining the audio and video data, the system sends the audio and video data to the second system 2. After receiving the audio and video data, the second system 2 can display or play the audio and video data, or send the audio and video data to the connected remote terminal 5 for display or playback by the remote terminal 5.

[0057] Optionally, this solution processes audio and video data to obtain target security data suitable for transmission to the external network. This target security data can be at least one of audio data, video data, or image data. For example, it can extract some or all audio data, some or all video data, or some or all image data from the audio and video data as target security data. The intranet system and the external network system can be designated as System 1 and System 2, respectively. By encoding the data sent from the intranet system to the external network system into audio and video data, and determining the target security data based on the audio and video data, the data is sent to the external network system. This achieves effective isolation between the intranet system and the external network system while enabling secure interaction between them.

[0058] As described above, the control module 3 acquires the data information sent from the first system 1 to the second system 2, encodes the data information according to preset conditions to form audio and video data, and sends the target security data to the second system 2. While achieving isolation between the first system 1 and the second system 2, the encryption of the transmitted data is achieved by encoding the data information provided by the first system 1 into audio and video data. This can effectively ensure the secure connection between the first system 1 and the second system 2, reduce the possibility of dangerous data entering the first system 1 and the theft of data from the first system 1, ensure the data security of the first system 1, and reduce the cost of secure interaction between systems.

[0059] Based on the above embodiments, Figure 2 A schematic diagram of another secure interaction device provided in an embodiment of this application is given. This secure interaction device can be further configured based on the secure interaction device provided in the above embodiments. (Reference) Figure 2 The secure interactive device includes a control module 3 and a control input module 6.

[0060] The control input module 6 provided in this solution can be indirectly connected to the first system 1 and the second system 2 via the control module 3. Alternatively, the control input module 6 can be directly connected to the first system 1 or the second system 2, and indirectly connected to the second system 2 or the first system 1 via the control module 3. For example, the control input module 6 can be connected to the first system 1, the second system 2, or the control module 3 via wired and / or wireless means. The control input module 6 can be used to acquire control commands generated by the user's manipulation of the control input module 6.

[0061] This scheme includes at least one control method, wherein the control module 3 acquires the control commands from the control input module 6, the control module 3 generates a simulated control command that matches the target system based on the target system indicated by the control command (that is, converts the control command into a simulated control command that the target system can correctly recognize and respond to), and sends the simulated control command to the target system, wherein the target system is either the first system 1 or the second system 2 depending on the actual command situation.

[0062] Optionally, the control input module 6 provided in this solution can be a mouse or a touchpad. By responding to user control operations on the mouse or touchpad, the control input module 6 can still control the first system 1 and the second system 2, even though the first system and the second system 2 are isolated. Optionally, the control operations on the control input module 6 can be operations such as moving or clicking the mouse or touchpad.

[0063] For example, such as Figure 2As shown, the control input module 6 is connected to the second system 2. The user can initiate control operations through the control input module 6. The control operations are transmitted to the control module 3 via the second system 2. The control module 3 analyzes the control operations, confirms the target system to which the control operations are directed, and responds to the control operations collected by the control input module 6 to obtain the corresponding control instructions (such as moving the cursor, clicking, etc.). Based on the target system to which the control instructions are directed (such as the first system 1 and / or the second system 2 to which the control module 3 is connected), the control module 3 generates simulated control instructions that match the target system (such as simulated control instructions that indicate moving the cursor, clicking, etc.) and sends the simulated control instructions to the target system so that the target system responds to the simulated control instructions.

[0064] In one embodiment, the first system 1 and the second system 2 provided by this solution can be built based on different operating systems. For example, the first system 1 and the second system 2 can be a PC system (e.g., Windows system, Linux system, etc.) and an Android system, respectively. Different operating systems correspond to different types of control information. Based on a pre-set conversion logic between control instructions and control information of different operating systems, the control instructions can be converted into analog control instructions that match the corresponding operating system according to the requirements of different operating systems for control information. After receiving the analog control instructions, the control input module 6 sends the analog control instructions to the target system so that the target system receives and responds to the analog control instructions, thereby realizing the control of the target system.

[0065] In one possible embodiment, the control input module 6 provided by this solution generates analog control commands that match the target system based on the target system pointed to by the control commands, including:

[0066] Obtain coordinate information from control commands;

[0067] Taking the control input module 6 as an example, when the mouse performs a click operation, it generates a click control command, which includes the coordinate information of the mouse click location.

[0068] Based on the coordinate information corresponding to the control command, the system is used as the target system to form a simulated control command that matches the target system.

[0069] The first system 1 and the second system 2 can be displayed on the same display screen (the display screen built into the security interaction device or the external display screen of the security interaction device) according to a preset display template. For example, the first system 1 and the second system 2 can be displayed side by side horizontally or side by side vertically. Based on this, taking a mouse as an example, the mouse body is connected to the second system 2, but the coordinates of its corresponding click operation correspond to the position of the first system 1 on the display screen. Then, the control input module 6 obtains the control command through the second system 2 and converts the control command into an analog control command that matches the first system 1.

[0070] And / or, based on the coordinate information of the control command, determine the display priority of the first system 1 and the second system 2, take the system with the higher display priority as the target system, and form a simulation control command that matches the target system.

[0071] The first system 1 and the second system 2 can also be displayed in an overlay manner, meaning that the first system 1 and the second system 2 partially overlap, and the content displayed in the first system 1 can be on top of the content displayed in the second system 2. In other words, at the overlapped position, the first system 1 has a higher display priority than the second system 2. Taking a mouse as an example, the mouse body is connected to the second system 2, but the coordinates of its click operation correspond to the overlapping position of the first system 1 and the second system 2 on the display screen. Since the first system 1 has a higher display priority than the second system 2 at this overlapped position, the control input module 6 obtains the control command through the second system 2 and converts the control command into an analog control command that matches the first system 1.

[0072] For example, after obtaining the control command, the target system can be determined based on the coordinate information of the control command and / or the display priority of the first system 1 and the second system 2, and a simulated control command matching the target system can be formed.

[0073] In one embodiment, for determining the target system based on coordinate information, the system corresponding to the coordinate information of the control command (first system 1 or second system 2) is determined, and this system is used as the target system. Simulated control commands matching the target system are then generated based on the control commands. Optionally, the first system 1 and the second system 2 share a display module 4 (which can be a built-in display of the safety interactive device or an external display). The display module 4 can be connected to the first system 1 and the second system 2 via the control module 3; the display module 4 can also be... Figure 2 As shown, the control module 3 and the second system 2 are connected through multiple video input interfaces.

[0074] The secure interactive device includes at least a first display mode and a second display mode;

[0075] In the first display mode, the control module 3 sends the screen information of the first system 1 or the second system 2 to the display module 4 for individual display, or the second system 2 directly sends the screen information to the display module 4;

[0076] In the second display mode, the display area of ​​the display module 4 is divided into a first display area and a second display area, which respectively display the corresponding screen information of the first system 1 and the second system 2 (for example, displaying the corresponding screen information of the first system 1 and the second system 2 according to a set ratio or a 1:1 ratio). The coordinate information of the control command can indicate the position of the relevant operation in the display area (for example, the cursor position corresponding to the control input module 6). The specific position of the control command in the display area is determined according to the coordinate information of the control command, and the system corresponding to the specific position is taken as the target system (if the specific position corresponds to the first display area, the target system of the control command is the first system 1; if the specific position corresponds to the second display area, the target system of the control command is the second system 2).

[0077] For example, the display area of ​​display module 4 is divided into two equally divided display areas, left and right. The left and right display areas respectively display the screen information of the first system 1 and the second system 2. The control input module 6 interacts with the display screen. When the cursor position of the control input module 6 is in the left half of the display area, a control command pointing to the first system 1 is generated; when the cursor position is in the right half of the display area, a control command pointing to the second system 2 is generated. Optionally, the coordinate information can be a specific coordinate point within the display area, or a coordinate range within the display area (e.g., the mouse selects a specific coordinate range within the display area, which can be represented by the coordinate points of the four corners). This solution determines the target system based on the coordinate information of the control command, accurately controls the target system interactively, and the target system determined based on the coordinate information is more in line with user operating habits, effectively improving the user experience.

[0078] In one embodiment, to determine the target system based on the display priority of the first system 1 and the second system 2, the display priorities of the first system 1 and the second system 2 can be preset, or determined based on the user's display priority setting operation. Alternatively, when the first system 1 and the second system 2 share the display module 4, the display priorities of the first system 1 and the second system 2 can be determined based on their display areas (e.g., setting the system displayed in the designated display area to have a higher display priority). Upon receiving a control command, the system with the higher display priority is determined and designated as the target system for the control command. For example, if the display priority of the first system 1 is set higher than that of the second system 2, then in the overlapping area of ​​the screens of the first system 1 and the second system 2, all control commands will be directed to the first system 1, and the control operations will be performed on the first system 1. This solution, by determining the target system based on the display priority of the first system 1 and the second system 2, achieves effective isolation between the first system 1 and the second system 2 while enabling separate interactive control of the first system 1 and the second system 2.

[0079] In one embodiment, the solution further includes an external input module 7, which is directly or indirectly (via the first system 1 or the second system 2) connected to the control module 3. The external input module 7 is used to obtain the user's input command, trigger the external input operation, and generate the first external input event.

[0080] For example, the external input module 7 does not have a target system pointing function. When only a single system is running, the external input module 7 can generate analog control commands that match the current system through the control module 3. When both the first system 1 and the second system 2 are running, the control input module 6, based on the first external input event, operates to confirm the current target system. The control module 3 then converts the first external input event into analog control commands that match the target system and sends them to the target system for operation.

[0081] Optionally, the external input module 7 provided in this solution can be a keyboard. By responding to keyboard input operations, it can achieve system isolation while simultaneously responding to input operations connected to the control module 3 or the second system 2. Optionally, the input operation to the external input module 7 can be text input, control signals, etc., using the keyboard. This solution generates a first external input event based on the external input operation through the external input module 7, effectively realizing input control of the first system 1 or the second system 2.

[0082] The control input module 6 provided in this solution can be connected to the first system 1 and / or the second system 2. Based on the control commands received by the control input module 6, it can generate control commands matching the target system, thereby controlling the target system and providing more flexible control input to the first system 1 and / or the second system 2. The external input module 7 can be directly connected to the second system 2 and / or connected via the control module 3 to control the first system 1, reducing the number of connected devices to the first system 1 and protecting its safety.

[0083] For example, by connecting a mouse as a control input module 6 to the first system 1 or the second system 2, the user can perform external control operations through the mouse and input control commands through the keyboard. The keyboard can generate analog control commands that match the target system (first system 1 or second system 2) based on the target system (first system 1 or second system 2) pointed to by the control commands, and send analog control commands to the first system 1 or the second system 2 so that the first system 1 or the second system 2 can respond to the analog control commands.

[0084] When the keyboard is connected as an external input module 7 to the second system 2, the user can perform external input operations via the keyboard. The keyboard will generate a first external input event upon detecting the external input operation and send the first external input event to the second system 2. The second system 2 can respond to the external input operation based on the first external input event. When the keyboard is connected as an external input module 7 to the control module 3, the user can perform external input operations via the keyboard. The keyboard will generate a first external input event upon detecting the external input operation and send the first external input event to the control module 3. The control module 3 can send the first external input event to the first system 1, and the first system 1 can respond to the external input operation based on the first external input event.

[0085] Optionally, the control commands generated by the control input module 6 and external input module 7 provided in this solution can record corresponding coordinate information (such as coordinates of movement trajectory, click operation, input operation, etc.) and input type (such as click, drag, input character, etc.). The coordinate information corresponding to the control command can be mapped to the corresponding mapping coordinates on the first interactive screen data according to the coordinate mapping relationship between the second interactive screen data and the audio and video data. The first external input event can be responded to based on the mapping coordinates and the corresponding input type.

[0086] Optionally, in the first display mode, the coordinate mapping relationship between the second interactive screen data and the audio / video data can be determined based on the screen scaling relationship and / or position offset between the second interactive screen data and the audio / video data. For example, when the sizes of the second interactive screen data and the audio / video data are the same, the coordinates of the second interactive screen data and the audio / video data overlap and align, and the coordinate mapping relationship between the second interactive screen data and the audio / video data is a 1:1 relationship, that is, the mapped coordinates are consistent with the coordinate information corresponding to the first external input event. The control commands received by the second system 2 are intercepted and converted to the coordinates corresponding to the first system 1, so that the first system 1 responds to the control commands formed by the control input module 6 and the external input module 7 and performs corresponding operations. Real-time control of the internal and external networks can be realized through a single secure interactive device, and the internal and external networks are physically isolated, which can effectively ensure data security.

[0087] In some embodiments, the secure interactive device of this solution can also conduct remote conferences with remote terminals 5 on the external network through the second system 2, and share the screen of the second system 2 with the remote terminals 5.

[0088] Based on this, this solution also discloses a remote screen sharing mode involving the first system 1, including:

[0089] The first system 1 responds to the analog control command and generates first interactive screen data based on the response result. It also sends the first interactive screen data to the control module 3. The control module 3 encodes the first interactive screen data according to preset conditions to form audio and video data, and sends it to the second system 2. The second system 2 generates second interactive screen data based on the audio and video data. The second system 2 remotely shares the second interactive screen data with the remote terminal 5, thereby realizing remote screen sharing of the first system 1.

[0090] In some embodiments, the control module 3 may also collect the second interactive screen data and send it to the display module 4 for local display, or the second system 2 may directly send it to the display module 4 for local display. The specific display method can be referred to the foregoing content and will not be repeated here.

[0091] For example, after receiving a simulated control command (which can be generated by the control input module 6, the external input module 7, or by the remote terminal 5, as described in the following embodiments), the first system 1 can respond to the simulated control command and generate first interactive screen data based on the response result. For example, when the external input event is a mouse click event on a target object (e.g., an interactive control displayed on the screen corresponding to the first system 1), the control module 3 generates a simulated control command to click the target object and sends it to the first system 1. The first system 1 will respond to the simulated control command by executing the corresponding click response action and generate the first interactive screen data after executing the click response action.

[0092] After generating the first interactive screen data, the first system 1 sends it to the control module 3. The control module 3 encodes the first interactive screen data according to preset conditions to form audio and video data, and sends the audio and video data to the second system 2 so that the second system 2 can generate the second interactive screen data based on the audio and video data.

[0093] Optionally, when the second system 2 generates the second interactive screen data based on the audio and video data, it includes at least the first generation mode and / or the second generation mode;

[0094] The first generation mode specifically includes:

[0095] The audio and video data is collected and displayed directly, meaning that the content of the first interactive screen data and the second interactive screen data are completely identical.

[0096] The second generation mode specifically includes:

[0097] Only a portion of the display area in the second interactive screen is used to display the audio and video data;

[0098] The audio and video data is captured and then scaled down or enlarged so that the audio and video data is displayed within the set display range of the second interactive screen data.

[0099] For example, in a telemedicine consultation scenario, the first system 1 is connected to the hospital's internal network to access the internal database, while the second system 2 is connected to an external network (e.g., the Internet) to establish a communication connection with the remote terminal 5 participating in the telemedicine consultation. After the first system 1 accesses the data in the internal database and generates the corresponding first interactive screen data, it sends the first interactive screen data to the control module 3. The control module 3 then sends the audio and video data processed from the first interactive screen data to the second system 2.

[0100] In the first generation mode, after receiving the audio and video data processed from the first interactive screen data, the second system 2 can directly use the first interactive screen data as the corresponding screen information for the second interactive screen data display and send it to the remote terminal 5 for display. At this time, the screen displayed based on the second interactive screen data is the screen corresponding to the first interactive screen data.

[0101] In the second generation mode, after receiving the audio and video data processed from the first interactive screen data, the second system 2 adds the screen corresponding to the audio and video data to a set display range (e.g., a pre-set shared screen range in the conference interface for remote medical consultation) to obtain the second interactive screen data. The second system 2 then displays the corresponding screen information based on the second interactive screen data, or sends the second interactive screen data to the remote terminal 5 for display. At this time, the screen displayed based on the second interactive screen data includes the pre-set screen and the screen corresponding to the first interactive screen data within the set display range, such as displaying the screen corresponding to the first interactive screen data in the conference interface for remote medical consultation.

[0102] Taking the characteristics of the conferencing software as an example, in the second generation mode, part of the display area of ​​the second interactive screen data is also used to display the names of the participants or the discussion content of the participants, while the audio and video data formed by the first interactive screen data is only displayed in part of the second interactive screen data.

[0103] Specifically, in one embodiment, the second system 2 provided by this solution generates second interactive screen data based on audio and video data processed from the first interactive screen data. This can be achieved by adding the screen corresponding to the audio and video data to a set display range to obtain the second interactive screen data.

[0104] For example, the set display range for displaying audio and video data can be determined in the display page of the second system 2. For example, the range for displaying audio and video data can be set in the display page of the conferencing software program. The set display range can be all or part of the range in the display page.

[0105] The second system 2 acquires audio and video data and adds the corresponding images to the designated display area of ​​its display page. The display page is then rendered to obtain second interactive screen data containing the content corresponding to the audio and video data. This solution obtains second interactive screen data by adding the images corresponding to the audio and video data to the designated display area, enabling the second system 2 to obtain the interactive screen content of the first system 1. Furthermore, content sharing between internal and external networks is achieved through screen sharing, allowing the remote terminal 5 to directly obtain the interactive screen content of the first system 1 based on the secure interactive device, effectively reducing the cost of interaction between internal and external networks.

[0106] In one possible embodiment, the second system 2 provided by this solution adds the screen corresponding to the audio and video data to a set display range to obtain the second interactive screen data. This can be achieved by: the second system 2 scaling the audio and video data based on a set size; the second system 2 adding the screen corresponding to the scaled audio and video data to the set display range to obtain the second interactive screen data, wherein the set size is determined based on the set display range.

[0107] For example, based on the set display range for displaying audio and video data determined in the display page of the second system 2, the set size for displaying audio and video data is determined. The second system 2 receives the audio and video data in real time, scales the audio and video data to the set size, and adds the corresponding image of the scaled audio and video data to the set display range of the display page. The display page is then rendered to obtain second interactive screen data containing the content corresponding to the audio and video data. This solution accurately generates second interactive screen data containing the content corresponding to the audio and video data by scaling the audio and video data and adding the corresponding image of the scaled audio and video data to the set display range, ensuring accurate interaction between internal and external networks.

[0108] After generating the second interactive screen data based on the audio and video data, the second system 2 can send the second interactive screen data to the connected remote terminal 5 so that the remote terminal 5 can display the corresponding screen based on the second interactive screen data.

[0109] This solution involves the first system 1 responding to external input events and generating first interactive screen data, which is then sent to the second system 2. The second system 2 then generates and outputs second interactive screen data based on the first interactive screen data provided by the first system 1. Content sharing of data in the first system 1 can be achieved between the first system 1 and the second system 2 through the transmission of interactive screens and analog control commands. Furthermore, the first system 1 and the second system 2 are physically isolated, eliminating the need for a network gateway system or NAT server system for internal and external network interaction. This effectively reduces the cost of internal and external network interaction while ensuring the security of internal network data.

[0110] In one embodiment, in the remote screen sharing mode, the secure interactive device of this solution transfers control to the remote terminal 5, which then controls the first system 1 and adjusts the display content of the currently shared screen.

[0111] Based on this, this solution also discloses a remote control method in a remote screen sharing mode, including:

[0112] The second system 2 acquires the remote control command sent from the remote terminal 5 and uses the remote control command as a second external input event;

[0113] In the remote screen sharing mode, the second system 2 is connected to the remote terminal 5, and the remote terminal 5 is connected to terminal input modules such as mouse, keyboard, and touch module. When the remote terminal 5 detects the input operation of the terminal input module, it can send a remote control command to the second system 2 as the corresponding second external input event.

[0114] In the first generation mode, the control module 3 acquires the second external input event, converts it into an analog control command that matches the first system 1, and sends it to the first system 1 to achieve remote interaction;

[0115] In the second generation mode, the control module 3 or the second system 2 acquires the second external input event; extracts the first relative position of the second external input event in the corresponding frame of the audio and video data; transforms the relative position proportionally according to the size ratio of the corresponding frame of the audio and video data and the first interactive frame data to obtain the second relative position; transforms the instruction content of the second external input event with the second relative position to obtain the analog control instruction that matches the first system 1, and sends it to the first system 1 to realize remote interaction;

[0116] The second external input event provided in this solution can record corresponding coordinate information (such as coordinates of movement trajectory, click operation, input operation, etc.) and input type (such as click, drag, input character, etc.). Based on the coordinate mapping relationship between the second interactive screen data and the audio / video data, the coordinate information corresponding to the second external input event can be mapped to the corresponding mapping coordinates on the first interactive screen data (the audio / video data is actually a one-to-one image with the first interactive screen data). The second external input event is responded to based on the mapped coordinates and the corresponding input type. Optionally, the coordinate mapping relationship between the second and first interactive screen data can be determined based on the screen scaling relationship and / or position offset between the second and first interactive screen data. For example, when the sizes of the second and first interactive screen data are the same, the coordinates of the second and first interactive screen data overlap and align, and the coordinate mapping relationship between the second and first interactive screen data is 1:1, meaning the mapped coordinates are consistent with the coordinate information corresponding to the second external input event. This intercepts and converts the external input event received by the second system 2 to the corresponding coordinates of the first system 1, enabling control of the intranet.

[0117] This solution receives a second external input event sent by a remote terminal 5 through a second system 2. While ensuring the isolation between the first system 1 and the second system 2, it enables the remote terminal 5 to interactively control the first system 1. In actual medical consultation scenarios, the remote terminal 5 can be controlled by experts from other hospitals. Based on this remote control method, it is convenient for experts from other hospitals to adjust and query the content of the first system 1 through the external network, thereby realizing the interactive process of remote consultation.

[0118] In one possible embodiment, such as Figure 3 As shown in the schematic diagram of a control module, the control module 3 provided in this solution includes a screen signal acquisition unit 31, an input signal acquisition unit 32, a transmission unit 33, and a display unit 34. The screen signal acquisition unit 31, the input signal acquisition unit 32, and the display unit 34 are connected to the transmission unit 33.

[0119] The sending unit 33 provided in this solution can be used to realize data transmission between the control module 3 and the first system 1 and the second system 2. The screen signal acquisition unit 31 provided in this solution can be communicatively connected to the first system 1 and the second system 2. It can also be used to acquire the first interactive screen data provided by the first system 1 and send the first interactive screen data to the second system 2 through the sending unit 33, and acquire the second interactive screen data provided by the second system 2 and send the second interactive screen data to the display unit 34 through the sending unit 33. The display unit 34 sends the second interactive screen content to the display module 4 to realize the local display of the second interactive screen content.

[0120] The input signal acquisition unit 32 provided in this solution can be communicatively connected to the second system 2. The input signal acquisition unit 32 can be used to acquire external input events provided by the second system 2 and send the external input events to the first system 1 through the sending unit 33. The display unit 34 provided in this solution can be communicatively connected to the display module 44. The display unit 34 can be used to receive the second interactive screen data sent by the display unit 34 and display the second interactive screen data through the display module 44.

[0121] This solution uses a screen signal acquisition unit 31, an input signal acquisition unit 32, a sending unit 33, and a display unit 34 to acquire and transmit first screen information, second interactive screen data, and external input events. While ensuring physical isolation between the first system 1 and the second system 2, it effectively achieves screen sharing between the first system 1 and the second system 2, realizing efficient and low-cost information interaction between internal and external networks. While ensuring the security of internal network data, it effectively reduces the cost of interaction between internal and external networks.

[0122] For example, such as Figure 4The diagram illustrates an intranet / extranet interaction scenario. Assuming a remote consultation in a medical setting, remote terminal 5 needs to display data from a hospital's internal database. Since the database is configured on the internal network, the local terminal needs to communicate with the remote terminal via an external network. There is isolation between the internal and external networks. To ensure data sharing while maintaining this isolation, the control module 3 of the secure interaction device can be connected to the local first system 1 (internal network system). First system 1 can access the internal network database. Simultaneously, it establishes a connection with the conferencing software installed on the remote terminal 5 used by the participants in the remote consultation through the conferencing software program installed in the second system 2 (extranet system). First system 1 can collect its own first interactive screen data in real time and send it to the control module 3 in the secure interaction device. The control module 3 then forwards the first interactive screen data to the second system 2.

[0123] When the second system 2 enables the internal and external network interaction function in the conferencing software program, the second system 2 receives the first interactive screen data in real time and performs screen rendering based on the first interactive screen data (for example, adding the first interactive screen data to the set display range and rendering it) to obtain the second interactive screen data.

[0124] After generating the second interactive screen data, the second system 2 can send the second interactive screen data to the control module 3. The control module 3 displays the second interactive screen data through the display module 4. At this time, the display content corresponding to the first interactive screen data can be observed in the second interactive screen data displayed on the display module 4. Optionally, on-site personnel can perform interactive operations on the second interactive screen data through the external input module 7 connected to the second system 2 to generate a first external input event. At the same time, the second system 2 sends the first external input event to the control module 3. The control module 3 converts the first external input event into an analog control command and sends it to the first system 1. The first system 1 will respond to the analog control command. At this time, the response process of the first system 1 to the first external input event can be observed synchronously in the second interactive screen data displayed on the display module 4. At this time, what is transmitted between the first system 1 and the second system 2 is screen information. The external network cannot actually obtain the data of the internal network, which can effectively realize the interaction between the internal and external networks while ensuring the security of the internal network data.

[0125] Simultaneously, after generating the second interactive screen data, the second system 2 can also send the second interactive screen data to the remote terminal 5, where it is displayed. At this time, the content corresponding to the first interactive screen data can be observed in the second interactive screen data displayed on the remote terminal 5. Optionally, participants in the remote consultation can generate a second external input event through the terminal input module of the remote terminal 5 by performing interactive operations on the second interactive screen data, and then send the second external input event to the second system 2. The second system 2 sends the second external input event to the control module 3, which converts it into an analog control command and sends it to the first system 1. The first system 1 responds to the analog control command, and the response process of the first system 1 to the second external input event can be observed synchronously in the second interactive screen data displayed on the remote terminal 5. Furthermore, at this time, only screen information is transmitted between the first system 1 and the remote terminal 5; the remote terminal 5 cannot actually obtain data from the internal network. This effectively achieves interaction between the internal and external networks while ensuring the security of internal network data.

[0126] As described above, the control module 3 acquires data information sent from the first system 1 to the second system 2, encodes the data information according to preset conditions to form audio and video data, and sends the audio and video data to the second system 2. While achieving isolation between the first system 1 and the second system 2, the encoding of the data information provided by the first system 1 into audio and video data effectively encrypts the transmitted data, ensuring a secure connection between the first system 1 and the second system 2. This reduces the possibility of dangerous data entering the first system 1 and the theft of data from the first system 1, ensuring data security for the first system 1 and reducing the cost of secure interaction between systems. Simultaneously, by outputting second interactive screen data to the display module 4, the screen content corresponding to the first interactive screen data generated in real time by the first system 1 can be observed, enabling the viewing of internal network data and improving the flexibility of internal and external network interaction. Furthermore, the second interactive screen data can be sent to the remote terminal 5 for display through the second system 2. The first system 1 and the second system 2 are physically isolated. The first system 1 and the second system 2 can share the content of intranet data through the transmission of screen information. The second system 2 and the remote terminal 5 cannot directly obtain intranet data. There is no need to configure a network gateway system or NAT server system for intranet-extranet interaction. While ensuring the security of intranet data, it can effectively reduce the cost of intranet-extranet interaction and the maintenance cost of intranet-extranet interaction.

[0127] Based on the above embodiments, Figure 5 A schematic diagram of another secure interaction device provided in an embodiment of this application is given. This secure interaction device can be further configured based on the secure interaction device provided in the above embodiments. (Reference) Figure 5The secure interactive device also includes a first system module 8 and a second system module 9.

[0128] The first system module 8 and the second system module 9 provided in this solution are connected to the control module 3. For example, when the first system module 8 is configured with an intranet system (first system 1), the second system module 9 can be configured with an extranet system (second system 2). The secure interaction scheme between the control module 3 and the first system module 8 and the second system module 9 can refer to the above embodiments to achieve the corresponding technical effects, and will not be described in detail here.

[0129] As described above, by integrating the first system module 8 and the second system module 9 into the secure interactive device, the secure interactive device itself can run the first system 1 and the second system 2. When using it, the user only needs to configure the first system module 8 as the intranet system and the second system module 9 as the extranet system to achieve flexible configuration of the intranet system and the extranet system. There is no need to configure a network gateway system or NAT server system for intranet-extranet interaction. While ensuring the security of intranet data, it can effectively reduce the cost of intranet-extranet interaction and the maintenance cost of intranet-extranet interaction.

[0130] The above description is merely a preferred embodiment and the technical principles employed in this application. This application is not limited to the specific embodiments provided herein, and various obvious changes, readjustments, and substitutions that can be made by those skilled in the art will not depart from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the claims.

Claims

1. A secure interaction device, characterized in that, The control module is configured to acquire data information sent by the first system to the second system, encode the data information according to a preset condition to form audio and video data, and send the audio and video data to the second system, wherein the audio and video data are at least one of audio data, video data and image data. The control input module is directly or indirectly connected to the first system and the second system, and is configured to acquire a control instruction, form a simulated control instruction matched with a target system based on the target system pointed by the control instruction, and send the simulated control instruction to the target system, wherein the target system is the first system and / or the second system.

2. The secure interaction device of claim 1, wherein, The control input module is further configured to acquire a control instruction sent by the first system and send the control instruction to the second system, and / or acquire a control instruction sent by the second system and send the control instruction to the first system. The control input module forms the simulated control instruction matched with the target system based on the target system pointed by the control instruction, including: forming the simulated control instruction matched with the target system based on a system corresponding to coordinate information of the control instruction, and / or 3. The secure interaction device of claim 2, wherein, forming the simulated control instruction matched with the target system based on a system with a high display priority among the first system and the second system at the coordinate information of the control instruction. The display module is connected to the control module or the second system, and is configured to acquire interactive screen data provided by the control module and / or the second system, and display a screen of the interactive screen data. The external input module is connected to the control module or the second system, and is configured to generate a first external input event according to an external input operation triggered by the external input module.

4. The secure interaction device of claim 1, wherein, The control module is further configured to acquire the external input event, convert the external input event into a simulated control instruction, and send the simulated control instruction to the first system.

5. The secure interaction device of claim 1, wherein, The first system is further configured to respond to the simulated control instruction, generate first interactive screen data based on a response result of the simulated control instruction, and send the first interactive screen data to the control module, so that the control module encodes the first interactive screen data according to a preset condition to form audio and video data, and sends the audio and video data to the second system.

6. The secure interaction device of claim 1, wherein, The second system is further configured to generate second interactive screen data based on the audio and video data, and output the second interactive screen data. The external input event includes a first external input event received by the external input module and / or a second external input event received by the second system from a remote terminal. The second system generates the second interactive screen data based on the audio and video data, including: adding a screen corresponding to the audio and video data to a set display range to obtain the second interactive screen data.

7. The secure interaction device of claim 6, wherein, ​ 8. The secure interaction device of claim 6, wherein, ​ ​ 9. The secure interaction device of claim 8, wherein, The second system adds a picture corresponding to the audio and video data to a set display range to obtain second interactive picture data, including: The second system performs scaling processing on the audio and video data based on a set size; The second system adds a picture corresponding to the audio and video data after scaling processing to a set display range to obtain second interactive picture data, and the set size is determined based on the set display range.

10. The secure interaction device according to any of claims 1 to 9, characterized in that, The safe interaction device further comprises a first system module connected with the control module, and the first system module is configured with a first system; or The safe interaction device further comprises a second system module connected with the control module, and the second system module is configured with a second system.

Images