Human-computer interaction system and method with bidirectional communication

Abstract

Disclosed in the present disclosure are a human-computer interaction system and method with bidirectional communication. The system comprises a human-computer interaction apparatus and a computing apparatus which are physically separated. The human-computer interaction apparatus is used for receiving and displaying applications to which permissions are allocated by the computing apparatus, operating the computing apparatus on the basis of permissions, receiving a human-computer interaction command, transmitting same to the computing apparatus and receiving and displaying a processing result returned by the computing apparatus. The computing apparatus is used for allocating the permissions of the human-computer interaction apparatus, carrying out computational processing and software operations and returning the processing result to the human-computer interaction apparatus. Combination forms of the system comprise one human-computer interaction apparatus and one computing apparatus, a plurality of human-computer interaction apparatuses and one computing apparatus, one human-computer interaction apparatus and a plurality of computing apparatuses, or a plurality of human-computer interaction apparatuses and a plurality of computing apparatuses. The present invention avoids the need of binding computing terminals and human-computer interaction terminals within constrained spaces, expands interaction modes and enables effective separation between computing and interaction, thus reducing waste of computing power and reducing the cost.

Description

A two-way communication human-computer interaction system and interaction method

[0001] Related applications

[0002] This application claims priority to Chinese patent application No. 202311835856.6, entitled “A human-computer interaction system and interaction method for two-way communication,” filed on December 28, 2023, and is hereby incorporated by reference into this application. Technical Field

[0003] The present invention relates to the field of touch-display communication technology, and in particular to a human-computer interaction system and interaction method for two-way communication. Background Art

[0004] The multi-screen interactions currently available on the market basically involve projecting the computing device operation page onto the receiving screen, and performing operations through the computing device, but it is not possible to operate on the receiving screen and synchronously transmit the screen back. The Chinese patent application with publication number CN 114647390A provides an enhanced screen sharing method, system, and electronic device. During screen sharing between electronic devices, the receiving device of the screen sharing can receive more types of operations performed by the user on the shared interface of the screen sharing. However, the electronic devices are all computing devices and are only suitable for screen sharing between two devices. They have great limitations for scenarios requiring multi-screen sharing, and the computing power is wasted a lot. The Chinese patent application with publication number CN 114356266A provides an interactive method, device, and electronic device. In the application of sharing the screen, the shared end does not have to follow the sharing progress of the sharing end, but can browse the content that has not been shared or the content that has been shared before in the shared file based on its own needs. However, the sharing process is limited to a single application, and when other applications need to be shared, it is necessary to switch back and forth, which is cumbersome. The Chinese patent application with publication number CN 104796315A provides a resource sharing processing method and device, which can realize screen sharing, and the shared receiving end can also effectively control the shared resources, but the shared receiving end cannot fully control the host. The Chinese patent application with publication number CN 106354505A provides a method for operating the shared screen, which can remotely control the shared screen, and the shared screen can also control the screen of the original sharing device, but it is only applicable to screen sharing between two terminal devices and cannot be shared by multiple devices. The Chinese patent application with publication number CN 116708885A provides a screen projection method, a screen projection device, a connecting device, a screen projection device and a storage medium. The relationship between the screen projection device and the screen projection device can be one-to-one, one-to-many or many-to-many, but the screen projection device cannot operate the screen projection information and transmit it back to the screen projection device. The Chinese patent application with publication number CN 116800799A provides an intelligent interaction system between a vehicle computer and a mobile terminal. The mobile terminal can control the vehicle computer to realize vehicle computer functions, and the vehicle computer can also realize synchronous control of the mobile terminal. However, it is limited to the intelligent interaction between the mobile terminal and the vehicle computer and cannot be shared by multiple devices.

[0005] Summary of the Invention

[0006] The purpose of the present invention is to overcome the defects of the prior art and to provide a two-way communication human-computer interaction system and interaction method.

[0007] In order to achieve the above-mentioned object, the present invention proposes a two-way communication human-computer interaction system, wherein the system includes a physically separated human-computer interaction device and a computing device, wherein:

[0008] The human-computer interaction device is used to receive and display the application of the authority allocated by the computing power device, and operate the computing power device according to the authority; it is also used to receive human-computer interaction commands, transmit them to the computing power device, and receive and display the processing results sent back by the computing power device;

[0009] The computing device is used to allocate permissions to the human-computer interaction device, perform computing processing and software operations, and transmit the processing results back to the human-computer interaction device;

[0010] The combination of the system includes a human-computer interaction device and a computing device, multiple human-computer interaction devices and a computing device, a human-computer interaction device and multiple computing devices, or multiple human-computer interaction devices and multiple computing devices.

[0011] Preferably, the human-computer interaction device includes: a communication module, a display module and a human-computer interaction module, wherein:

[0012] The communication module is used to perform two-way communication with the computing device, receive permissions assigned by the computing device and transmit them to the display module, send commands and / or requests to the computing device, receive processing results sent back by the computing device, and transmit them to the display module;

[0013] The display module is used to display the application of the computing power device's assigned permissions and the returned processing results;

[0014] The human-computer interaction module is used to receive human-computer interaction commands using human-computer interaction technology.

[0015] Preferably, the human-computer interaction technology includes: one or more of resistive touch, capacitive touch, electromagnetic touch, infrared touch, surface acoustic wave touch, visual recognition, voice recognition, lidar, mouse, keyboard, touchpad, pen touch, 3D touch and gravity sensing.

[0016] Preferably, the technology adopted by the display module includes: one or more of liquid crystal display, OLED display, ink screen display, mini-LED display, micro-LED display, holographic imaging display and full-band display.

[0017] Preferably, the request sent by the communication module of the human-computer interaction device to the computing power device includes: a communication connection request and a request to suspend or disconnect the connection with the computing power device.

[0018] Preferably, the computing device adopts a multi-threaded parallel working mode, and the computing device includes: a communication module, a processing module and an authority control module; wherein,

[0019] The communication module is used to perform two-way communication with the human-computer interaction device, transmit open applications to the human-computer interaction device, receive commands and / or requests from the human-computer interaction device, and return processing results to the human-computer interaction device;

[0020] The processing module is used to perform computing processing and software operations according to the instructions of the human-computer interaction device, and transmit the processing results to the communication module;

[0021] The authority control module is used to allocate the authority of the human-computer interaction device, and the authority includes opening some applications and all applications.

[0022] Preferably, the communication module of the computing power device is also used to suspend or disconnect the communication connection with the human-computer interaction device; and is also used to receive a request sent by the human-computer interaction device to suspend or disconnect the connection with the computing power device, and decide whether to agree.

[0023] Preferably, the communication method between the human-computer interaction device and the computing power device is wired or wireless, and the wireless method includes one or more of WiFi, Bluetooth, Zigbee, NB-IoT and LoRa.

[0024] On the other hand, the present invention proposes a two-way communication human-computer interaction method, which is implemented according to the above system.

[0025] When the system includes a human-computer interaction device and a computing device, the method includes:

[0026] The human-computer interaction device initiates a connection request to the computing power device through the communication identification code;

[0027] The computing device accepts the connection request and establishes a connection;

[0028] The computing device allocates permissions to the human-computer interaction device;

[0029] The human-computer interaction device displays the application of the authority allocated to the computing power device;

[0030] The human-computer interaction device operates the computing device according to the authority, receives human-computer interaction commands and / or requests, and transmits them to the computing device;

[0031] The computing device performs computing processing and software operations and transmits the processing results back to the human-computer interaction device;

[0032] The human-computer interaction device displays the processing results;

[0033] When the system includes multiple human-computer interaction devices and a computing device, the method includes:

[0034] Multiple human-computer interaction devices initiate connection requests to the computing power device through communication identification codes;

[0035] The computing device determines the human-computer interaction device to be connected and establishes the connection respectively;

[0036] The computing device assigns permissions to each connected human-computer interaction device;

[0037] Each connected human-computer interaction device displays the application of the authority allocated to the computing power device;

[0038] Each connected human-computer interaction device operates the computing device according to its own authority, receives human-computer interaction commands and / or requests, and transmits them to the computing device;

[0039] The computing device performs computing processing and software operations and transmits the processing results back to the corresponding connected human-computer interaction device;

[0040] The human-computer interaction device displays the processing results;

[0041] When the system includes a human-computer interaction device and multiple computing devices, the method includes:

[0042] Multiple computing devices respectively initiate connection requests to the human-computer interaction device through communication identification codes;

[0043] The human-computer interaction device accepts the connection request and establishes a connection;

[0044] Each computing device that establishes a connection sets the human-computer interaction device allocation authority separately;

[0045] The human-computer interaction device displays the applications with permissions assigned to different computing devices on a split-screen basis;

[0046] The human-computer interaction device operates the computing device according to the authority and transmits the human-computer interaction command and / or request to the corresponding computing device;

[0047] Each connected computing device performs computing processing and software operations and transmits the processing results back to the human-computer interaction device;

[0048] The human-computer interaction device displays the processing results of different computing devices on a split screen;

[0049] When the system includes multiple human-computer interaction devices and multiple computing devices, the method includes:

[0050] Multiple human-computer interaction devices respectively initiate connection requests to multiple computing power devices through communication identification codes;

[0051] Each computing device accepts the corresponding connection request and establishes a connection;

[0052] Each computing device is separately set to establish a human-computer interaction device to allocate permissions;

[0053] Each connected human-computer interaction device displays applications with permissions assigned to different computing devices on a split-screen basis;

[0054] Each connected human-computer interaction device operates the computing device according to the assigned authority and transmits the human-computer interaction command and / or request to the corresponding computing device;

[0055] Each computing device performs computing processing and software operations and transmits the processing results back to the corresponding connected human-computer interaction device;

[0056] Each connected human-computer interaction device displays the processing results of different computing devices on a split-screen basis.

[0057] Preferably, the method further comprises:

[0058] The computing device directly suspends or disconnects from the human-computer interaction device; or

[0059] The computing device receives the pause or disconnect request sent by the human-computer interaction device and decides whether to agree.

[0060] Compared with the prior art, the advantages of the present invention are:

[0061] The present invention adopts a physical separation of the human-computer interaction device and the computing power device, and can connect to the computing power device through wireless or wired communication. A method for realizing two-way communication between a human-computer interaction device and a computing power device is described. The human-computer interaction device and the computing power device establish a communication connection through a communication protocol. The computing power device can allocate permissions to the human-computer interaction device. The interaction information of the human-computer interaction device can be transmitted to the computing power device for computing power processing and software operation. The data results of the computing power device are transmitted back to the human-computer interaction device. It is applicable to one-to-one, one-to-many, many-to-one, many-to-many and other communication modes. The present invention can eliminate the need for the computing power end to be bound to the human-computer interaction end in a limited space, expand the interaction mode, realize the effective separation of computing power and interaction, reduce computing power waste, and reduce costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] FIG1 is a schematic diagram of a human-computer interaction device according to Embodiment 1 of the present invention, wherein a, b, c, and d are a front view, a left view, a right view, and a rear view, respectively;

[0063] FIG2 is a schematic diagram of a preferred nano silver wire touch display module of a human-computer interaction device according to Example 2 of the present invention;

[0064] FIG3 is a flow chart of a method for achieving one-to-one bidirectional communication between a human-computer interaction device and a computing device according to Embodiment 3 of the present invention;

[0065] FIG4 is a flow chart of a method for realizing one-to-many bidirectional communication between a human-computer interaction device and a computing device according to a fourth embodiment of the present invention;

[0066] FIG5 is a flow chart of a method for implementing many-to-one bidirectional communication between a human-computer interaction device and a computing device according to Embodiment 5 of the present invention;

[0067] FIG6 is a flow chart of a method for realizing many-to-many bidirectional communication between a human-computer interaction device and a computing device according to embodiment 6 of the present invention.

[0068] Reference numerals 1, audio playback port 2, USB port for wired connection to mobile phone 3, headphone jack 4, Type-C port 5, volume adjustment button 6, power switch button 7, back frosted nano silver wire conductive film 8, OCA glue 9, nano silver wire conductive film 10, display module DETAILED DESCRIPTION

[0069] The present invention provides a bidirectional human-computer interaction system and method. The human-computer interaction device is physically separated from the computing device and can be connected to the computing device via wireless or wired communication. This eliminates the need for computing power to be bound to the interaction end within a limited space, expanding interaction options, reducing computing power waste, and lowering costs. Interaction information from the human-computer interaction device can be transmitted to the computing device for processing and software operation, and the processing results from the computing device are then transmitted back to the human-computer interaction device. This system is applicable to one-to-one, one-to-many, many-to-one, and many-to-many communication modes.

[0070] Preferably, the communication mode is wireless communication. Another optional communication mode between the human-computer interaction device and the computing power device is wired communication, which supports a common data line interface and can be connected to the computing power device while optionally charging the computing power device.

[0071] The human-computer interaction device comprises: a communication module, a display module and a human-computer interaction module.

[0072] The functions that can be performed by the communication module include but are not limited to wireless communication, wired communication, optical communication or other communication methods, wherein the technical forms of wireless communication include but are not limited to WiFi, Bluetooth, Zigbee, NB-IoT, and LoRa.

[0073] The display technologies that can be used in the display module include but are not limited to liquid crystal display, OLED display, ink screen display, mini-LED display, micro-LED display, holographic imaging display, and full-band display.

[0074] The human-computer interaction technologies that can be used in the human-computer interaction module include but are not limited to resistive touch, capacitive touch, electromagnetic touch, infrared touch, surface acoustic wave touch, visual recognition, voice recognition, lidar, mouse, keyboard, touchpad, pen touch, 3D touch, and gravity sensing.

[0075] Optionally, the human-computer interaction device also includes but is not limited to: lithium battery power supply: supports Type-C interface charging, is equipped with a microphone and a speaker, supports pen touch, comes with a soft keyboard, and is equipped with a camera.

[0076] Capacitive touch includes but is not limited to ITO conductive film capacitive touch, nano silver wire conductive film capacitive touch, metal mesh conductive film capacitive touch, and carbon nanotube conductive film capacitive touch, with nano silver wire conductive film capacitive touch being preferred. Preferably, the nano silver wire capacitive touch adopts a nano silver wire coverless rigid flexible ultra-thin touch screen, the touch screen surface being frosted, having the advantages of being scratch-resistant, anti-fingerprint, and reducing reflections, and enabling a "paper-like" touch experience. The use of a coverless nano silver wire ultra-thin rigid flexible touch screen reduces the use of one OCA layer and one cover plate, thereby saving costs and enabling the high-speed two-way projection PAD to achieve the goal of reducing weight and thickness.

[0077] The computing device includes: a communication module, a processing module and an authority control module; wherein,

[0078] A communication module, configured to perform two-way communication with the human-computer interaction device, transmit open applications to the human-computer interaction device, receive commands and / or requests from the human-computer interaction device, and transmit processing results back to the human-computer interaction device;

[0079] The processing module is used to perform computing processing and software operations according to the instructions of the human-computer interaction device, and transmit the processing results to the communication module;

[0080] An authority control module is used to allocate authorities to human-computer interaction devices, and the authorities include opening some applications and all applications; when there is only one human-computer interaction device and one computing device, the authority control module is also used to set the priority of allowing the human-computer interaction device to operate applications; when there are multiple human-computer interaction devices and one computing device, the authority control module is also used to set the priority of different connected human-computer interaction devices and the priority of allowing the human-computer interaction devices to operate applications; when there are one human-computer interaction device and multiple computing devices, the authority control module is also used to set the priority of different connected human-computer interaction devices, the priority of the computing device connected to each human-computer interaction device, and the priority of allowing the human-computer interaction device to operate applications.

[0081] The computing device includes but is not limited to a memory, a processor, a communication module, and a human-computer interaction module.

[0082] A method for achieving two-way communication between a human-computer interaction device and a computing device, characterized in that one of the human-computer interaction device or the computing device initiates a communication identification code connection request, the other accepts the connection request, and a communication connection is established through a communication protocol. The interaction information of the human-computer interaction device can be transmitted to the computing device for computing processing and software operation, and the data results of the computing device are transmitted back to the human-computer interaction device; the computing device can assign permissions to the human-computer interaction device, allowing the human-computer interaction device to control some applications of the computing device or completely control the computing device; during the communication connection between the computing device and the human-computer interaction device, the computing device can work in multiple threads, while supporting the working thread of the human-computer interaction device, the computing device can also independently process other threads; the computing device has the priority to pause or disconnect the communication connection, that is, the computing device can directly control the suspension or disconnection of the communication connection with the human-computer interaction device, and the human-computer interaction device can send an application to suspend or disconnect the communication connection with the computing device, and the computing device decides whether to approve or reject its application. Preferably, when disconnecting, the computing device can decide whether the human-computer interaction device saves the data information during the connection operation.

[0083] The method for achieving two-way communication between the human-computer interaction device and the computing power device is applicable to one-to-one, one-to-many, many-to-one, many-to-many and other communication modes.

[0084] The one-to-one communication mode refers to the direct establishment of a communication connection between a computing device and a human-computer interaction device, and the computing device can allocate permissions to the human-computer interaction device; the one-to-many communication mode refers to the establishment of a communication connection between a computing device and multiple human-computer interaction devices, and the computing device can allocate permissions to each human-computer interaction device separately, or uniformly set permissions for each human-computer interaction device, and display them in a split-screen on the computing device; the many-to-one communication mode refers to the establishment of a communication connection between multiple computing devices and a human-computer interaction device, each computing device can allocate permissions to the human-computer interaction device separately, and display them in a split-screen on the human-computer interaction device, and the human-computer interaction device can individually amplify and control the allowed applications of one of the computing devices, and switch to control the allowed applications of another computing device; the many-to-many communication mode refers to the establishment of a communication connection between multiple computing devices and multiple human-computer interaction devices, each computing device can allocate permissions to each human-computer interaction device separately, and display them in a split-screen on multiple human-computer interaction devices, and each human-computer interaction device can individually amplify and control the allowed applications of one of the computing devices, and switch to control the allowed applications of another computing device.

[0085] To pause or disconnect:

[0086] In the one-to-one communication mode, the computing device directly suspends or disconnects the connection, or the human-computer interaction device applies for suspension or disconnection and the computing device decides whether to agree;

[0087] In the one-to-many communication mode, the computing power device directly suspends or disconnects some of the human-computer interaction devices, or directly suspends or disconnects all the human-computer interaction devices; or the human-computer interaction device applies for suspension or disconnection and the computing power device decides whether to agree.

[0088] In the many-to-one communication mode, the computing device directly suspends or disconnects the connection, or the human-computer interaction device applies to suspend or disconnect the connection of some or all computing devices, and the corresponding computing device decides whether to agree;

[0089] In the many-to-many communication mode, the computing device directly suspends or disconnects some of the human-computer interaction devices, or directly disconnects all connected human-computer interaction devices; or the human-computer interaction device applies to suspend or disconnect some or all of the computing devices and the corresponding computing device decides whether to agree.

[0090] The human-computer interaction device and method that can achieve two-way communication with the computing power device have multiple application scenarios, including business office, home screen projection theater, office outside, student online classes, and car-mounted.

[0091] The technical solution of the present invention is described in detail below with reference to the accompanying drawings and embodiments.

[0092] Example 1

[0093] Embodiment 1 of the present invention proposes a bidirectional communication human-computer interaction system, the system including a physically separated human-computer interaction device and a computing device, wherein:

[0094] A human-computer interaction device, configured to receive and display the application of permissions assigned by the computing device, and to operate the computing device according to the permissions; further configured to receive human-computer interaction commands, transmit them to the computing device, and receive and display the processing results transmitted back by the computing device;

[0095] The computing device is used to allocate permissions to the human-computer interaction device, perform computing processing and software operations, and transmit the processing results back to the human-computer interaction device.

[0096] Reference is made to Figure 1, which is a schematic diagram of one of the human-computer interaction devices described in this application. Figures a, b, c, and d in Figure 1 are the front, left, right, and rear views, respectively, of the high-speed two-way projection PAD. The exterior includes a sound playback port 1, a USB port 2 for wired connection to a mobile phone, a headphone jack 3, a Type-C port 4, a volume adjustment button 5, and a power on / off button 6. Other distribution states of the above playback ports, interfaces, sockets, or buttons can be obtained according to this embodiment.

[0097] The human-computer interaction device includes: a communication module, a display module and a human-computer interaction module.

[0098] The functions that can be performed by the communication module include but are not limited to wireless communication, wired communication, optical communication or other communication methods, among which the technical forms of wireless communication include but are not limited to WiFi, Bluetooth, Zigbee, NB-IoT, and LoRa.

[0099] The display technologies that can be used in the display module include but are not limited to liquid crystal display, OLED display, ink screen display, mini-LED display, micro-LED display, holographic imaging display, and full-band display.

[0100] The human-computer interaction technologies that can be used in the human-computer interaction module include but are not limited to resistive touch, capacitive touch, electromagnetic touch, infrared touch, surface acoustic wave touch, visual recognition, voice recognition, lidar, mouse, keyboard, touchpad, pen touch, 3D touch and gravity sensing.

[0101] Example 2

[0102] Embodiment 2 of the present invention proposes a bidirectional communication human-computer interaction system, which includes a physically separated human-computer interaction device and a computing device, wherein:

[0103] A human-computer interaction device, configured to receive and display the application of permissions assigned by the computing device, and to operate the computing device according to the permissions; further configured to receive human-computer interaction commands, transmit them to the computing device, and receive and display the processing results transmitted back by the computing device;

[0104] The computing device is used to allocate permissions to the human-computer interaction device, perform computing processing and software operations, and transmit the processing results back to the human-computer interaction device.

[0105] 2 is a schematic diagram of a preferred nano silver wire touch display module for a human-computer interaction device, which includes a frosted nano silver wire conductive film 7 , OCA glue 8 , a nano silver wire conductive film 9 , and a display module 10 .

[0106] The nano silver wire ultra-thin touch screen is a hard flexible touch screen without a cover plate. The touch screen surface is frosted, which has the advantages of scratch resistance, anti-fingerprint, and reduced reflection, and can achieve a "paper-like" touch experience.

[0107] The use of a cover-free nano silver wire ultra-thin hard flexible touch screen reduces the use of one layer of OCA and one layer of cover, which not only saves costs but also enables the high-speed two-way projection PAD to achieve the purpose of reducing weight and thickness.

[0108] Example 3

[0109] Embodiment 3 of the present invention proposes a bidirectional human-computer interaction method. Referring to FIG3 , the bidirectional communication between the human-computer interaction device and the computing device is achieved through one-to-one communication. The specific process is as follows:

[0110] The human-computer interaction device initiates a communication identification code connection request, the computing device accepts the connection request, and the human-computer interaction device and the computing device establish a communication connection through the communication protocol;

[0111] The computing device allocates permissions to the human-computer interaction device: When the permissions are for some applications of the computing device, the human-computer interaction device communicates with the computing device in real time, displays the applications for which the permissions are allocated to the computing device, and operates the authorized applications; when the permissions are for all applications of the computing device, the human-computer interaction device communicates with the computing device in real time, displays all applications of the computing device, and operates all applications of the computing device;

[0112] The interaction information of the human-computer interaction device is transmitted to the computing device for computing processing and software operation, and the data results of the computing device are returned to the human-computer interaction device;

[0113] The computing device can work in multiple threads. While supporting the working thread of the human-computer interaction device, the computing device can also independently process other threads.

[0114] When suspension or disconnection is required, the computing device directly suspends or disconnects, or the human-computer interaction device applies for suspension or disconnection and the computing device decides whether to agree.

[0115] The computing device can set the priority of the applications allowed to be operated by the human-computer interaction device.

[0116] Example 4

[0117] Embodiment 4 of the present invention proposes a bidirectional human-computer interaction method. Referring to FIG4 , the bidirectional communication between the human-computer interaction device and the computing device is achieved through one-to-many communication. The specific process is as follows:

[0118] Each human-computer interaction device initiates a connection request through a communication identification code. The computing device decides which human-computer interaction devices' connection requests to accept. The multi-human computer interaction device and the computing device establish a communication connection through a communication protocol.

[0119] The computing device allocates permissions to each connected human-computer interaction device separately. If all human-computer interaction devices need to control the same application, permissions can be allocated to all connected human-computer interaction devices uniformly and displayed on the computing device split screen.

[0120] When the permission is for some applications of the computing power device, each human-computer interaction device communicates with the computing power device in real time, displays the applications for which the permission is assigned to the computing power device, and operates the authorized applications; when the permission is for all applications of the computing power device, each human-computer interaction device communicates with the computing power device in real time, displays all applications of the computing power device, and operates all applications of the computing power device;

[0121] The interaction information of each human-computer interaction device is transmitted to the computing device for computing processing and software operation, and the data results of the computing device are returned to the human-computer interaction device;

[0122] The computing device can work in multiple threads. While supporting the working thread of the human-computer interaction device, the computing device can also independently process other threads.

[0123] When suspension or disconnection is required, the computing power device directly suspends or disconnects some of the human-computer interaction devices, or directly suspends or disconnects all human-computer interaction devices; or the human-computer interaction device applies for suspension or disconnection and the computing power device decides whether to agree.

[0124] The computing device can set the priority of the human-computer interaction device and the priority of the applications allowed to operate.

[0125] Example 5

[0126] Embodiment 5 of the present invention proposes a bidirectional human-computer interaction method. Referring to FIG5 , the bidirectional communication between the human-computer interaction device and the computing device is achieved through many-to-one communication. The specific process is as follows:

[0127] Each computing device initiates a connection request through a communication identification code, the human-computer interaction device accepts the connection request, and the human-computer interaction device and the computing device establish a communication connection through a communication protocol;

[0128] Each computing device is assigned the permissions of the human-computer interaction device to some or all applications of the computing device, and displayed on a split screen on the human-computer interaction device;

[0129] The human-computer interaction device independently amplifies and controls the permitted application of one of the computing devices, and switches to operate the permitted application of another computing device;

[0130] The interaction information of the human-computer interaction device is transmitted to the corresponding computing device for computing processing and software operation, and the data results of the computing device are returned to the human-computer interaction device;

[0131] The computing device can work in multiple threads. While supporting the working thread of the human-computer interaction device, the computing device can also independently process other threads.

[0132] When suspension or disconnection is required, the computing device directly suspends or disconnects, or the human-computer interaction device applies to suspend or disconnect some or all computing devices and the corresponding computing device decides whether to agree.

[0133] The computing power device can set the priority of the computing power device operated by the human-computer interaction device and the priority of the application allowed to operate.

[0134] Example 6

[0135] Embodiment 6 of the present invention proposes a bidirectional human-computer interaction method. Referring to FIG6 , the bidirectional communication between the human-computer interaction device and the computing device is achieved through many-to-many communication. The specific process is as follows:

[0136] Each computing device and each human-computer interaction device initiates a connection through a communication identification code, and the human-computer interaction device and the computing device establish a communication connection through a communication protocol;

[0137] Each computing device displays the connected human-computer interaction device on a split screen, and allocates the permissions of the connected human-computer interaction device to some applications or uniformly sets them to all applications;

[0138] Each human-computer interaction device is displayed on a split screen, and the allowed applications of one computing device can be magnified and operated separately, and the allowed applications of another computing device can be switched to operate;

[0139] The interaction information of the human-computer interaction device is transmitted to the corresponding computing device for computing processing and software operation, and the data results of the computing device are returned to the corresponding human-computer interaction device;

[0140] The computing device can work in multiple threads. While supporting the working thread of the human-computer interaction device, the computing device can also independently process other threads.

[0141] When suspension or disconnection is required, the computing device directly suspends or disconnects some of the human-computer interaction devices, or directly disconnects all connected human-computer interaction devices; or the human-computer interaction device applies to suspend or disconnect some or all of the computing devices and the corresponding computing device decides whether to agree.

[0142] The computing device can set the priority of the human-computer interaction device, the priority of the computing device operated by the human-computer interaction device, and the priority of the application allowed to operate.

[0143] Finally, it should be noted that the above embodiments are intended only to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the embodiments, those skilled in the art will appreciate that modifications or equivalent substitutions to the technical solutions of the present invention do not depart from the spirit and scope of the present invention and are intended to be encompassed by the claims of the present invention.

Claims

1. A man-machine interaction system for two-way communication, characterized in that The system includes a physically separated human-computer interaction device and a computing power device. Among them, the human-computer interaction device is used to receive and display applications with permissions allocated by the computing power device, and operate the computing power device according to the permissions; it is also used to receive human-computer interaction commands, transmit them to the computing power device, and receive and display the processing results returned by the computing power device; the computing power device is used to allocate permissions to the human-computer interaction device, perform computing power processing and software operations, and return the processing results to the human-computer interaction device; The combination forms of the system include one human-computer interaction device and one computing power device, multiple human-computer interaction devices and one computing power device, one human-computer interaction device and multiple computing power devices, or multiple human-computer interaction devices and multiple computing power devices.

2. The two-way communication human-computer interaction system according to claim 1, characterized in that, The human-computer interaction device includes: a communication module, a display module, and a human-computer interaction module. Among them, the communication module is used to communicate bidirectionally with the computing power device, receive the permissions allocated by the computing power device and transmit them to the display module, send commands and / or requests to the computing power device, receive the processing results returned by the computing power device, and transmit them to the display module; the display module is used to display the applications with permissions allocated by the computing power device, and is also used to display the returned processing results; the human-computer interaction module is used to receive human-computer interaction commands using human-computer interaction technology.

3. The two-way communication human-computer interaction system according to claim 2, wherein The human-computer interaction technology includes: one or more of resistive touch, capacitive touch, electromagnetic touch, infrared touch, surface acoustic wave touch, visual recognition, voice recognition, lidar, mouse, keyboard, touchpad, pen touch, 3D touch, and gravity sensing.

4. The two-way communication human-computer interaction system according to claim 2, wherein The technology adopted by the display module includes: one or more of liquid crystal display, OLED display, e-ink display, mini-LED display, micro-LED display, holographic imaging display, and full-band display.

5. The two-way communication human-computer interaction system according to claim 2, characterized in that, The requests sent by the communication module of the human-computer interaction device to the computing power device include: communication connection requests and requests to pause or disconnect the connection with the computing power device.

6. The two-way communication human-computer interaction system according to claim 1, characterized in that, The computing power device adopts a multi-threaded parallel working mode. The computing power device includes: a communication module, a processing module, and a permission control module; among them, the communication module is used to communicate bidirectionally with the human-computer interaction device, transmit the open applications to the human-computer interaction device, receive the commands and / or requests of the human-computer interaction device, and return the processing results to the human-computer interaction device; the processing module is used to perform computing power processing and software operations according to the instructions of the human-computer interaction device, and transmit the processing results to the communication module; the permission control module is used to allocate permissions to the human-computer interaction device, and the permissions include opening some applications and all applications.

7. The two-way communication human-computer interaction system according to claim 6, wherein The communication module of the computing power device is also used to pause or disconnect the communication connection with the human-computer interaction device; it is also used to receive the requests sent by the human-computer interaction device to pause or disconnect the connection with the computing power device and decide whether to agree.

8. The man-machine interaction system for two-way communication according to claim 1, characterized in that, The communication method between the human-computer interaction device and the computing power device is wired or wireless. The wireless methods include one or more of WiFi, Bluetooth, Zigbee, NB-IoT, and LoRa.

9. A human-computer interaction method for two-way communication, implemented by the system according to any one of claims 1 to 8, When the system includes a human-computer interaction device and a computing device, the method includes: The human-computer interaction device initiates a connection request to the computing device through the communication identification code; The computing device accepts the connection request and establishes a connection; The computing device allocates permissions to the human-computer interaction device; The human-computer interaction device displays the application of the authority allocated to the computing power device; The human-computer interaction device operates the computing device according to the authority, receives the human-computer interaction command and / or request, and transmits it to the computing device; The computing device performs computing processing and software operation and transmits the processing results back to the human-computer interaction device; The human-computer interaction device displays the processing results; When the system includes multiple human-computer interaction devices and a computing device, the method includes: Multiple human-computer interaction devices respectively initiate connection requests to the computing power device through communication identification codes; The computing device determines the human-computer interaction device to be connected and establishes the connection respectively; The computing device assigns permissions to each connected human-computer interaction device; Each connected human-computer interaction device displays the application of the authority assigned to the computing power device; Each connected human-computer interaction device operates the computing device according to its own authority, receives human-computer interaction commands and / or requests, and transmits them to the computing device; The computing device performs computing processing and software operation and transmits the processing results back to the corresponding connected human-computer interaction device; The human-computer interaction device displays the processing results; When the system includes a human-computer interaction device and a plurality of computing devices, the method includes: Multiple computing devices respectively initiate connection requests to the human-computer interaction device through communication identification codes; The human-computer interaction device accepts the connection request and establishes a connection; Each computing device that establishes a connection allocates permissions to the human-computer interaction device; The human-computer interaction device displays the applications that allocate permissions to different computing devices in a split-screen manner; The human-computer interaction device operates the computing device according to the authority and transmits the human-computer interaction command and / or request to the corresponding computing device; Each connected computing device performs computing processing and software operation and transmits the processing results back to the human-computer interaction device; The human-computer interaction device displays the processing results of different computing devices on a split screen; When the system includes multiple human-computer interaction devices and multiple computing devices, the method includes: Multiple human-computer interaction devices respectively initiate connection requests to multiple computing devices through communication identification codes; Each computing device accepts the corresponding connection request and establishes a connection; Each computing device allocates permissions to the human-computer interaction device that establishes the connection; Each connected human-computer interaction device displays applications that have permissions assigned to different computing devices in a split-screen manner; Each connected human-computer interaction device operates the computing device according to the authority and transmits the human-computer interaction command and / or request to the corresponding computing device; Each computing device performs computing processing and software operation and transmits the processing results back to the corresponding human-computer interaction device to establish a connection; Each connected human-computer interaction device displays the processing results of different computing devices on a split screen.

10. The two-way communication human-computer interaction method according to claim 9, characterized in that, The method further comprises: The computing device directly suspends or disconnects from the human-computer interaction device; or The computing power device receives the pause or disconnection request sent by the human-computer interaction device and decides whether to agree.

Images