A human-computer interaction method and device based on an Internet of Things and related media

Abstract

The application discloses a kind of based on Internet of Things man-machine interaction method, device and related medium, the method includes: creating first EUI page;Extract the device information of the first EUI page, obtain first device information set;According to the matching of general UI specification to the first device information set, obtain second EUI page;While the first device information set is updated to second device information set;With NFC module and bluetooth module, front-end application and device establish communication session group;Identify the communication session group, process and obtain third device information set;Determine whether the communication session group is abnormal, finally call out the second EUI page transmission to the front-end application, for display UI page.The application establishes communication after the front-end application and the device, call out the second EUI page transmission to the front-end application, in this way, improve the UI digitization of electronic equipment product, and the UI interface of electronic equipment product internal system is completely displayed on screen.

Description

Technical Field

[0001] This invention relates to the field of digital device interaction technology, and in particular to a human-computer interaction method, device and related medium based on the Internet of Things. Background Technology

[0002] In the existing technology, the design of electronic devices often only focuses on interactive functions that meet basic consumer needs, without even fully displaying the UI of the internal system on the screen; for example, minimalist LCD panels.

[0003] On the other hand, electronic devices lack interconnectivity and interoperability, as well as a unified interconnectivity execution standard. This results in a low level of UI digitalization within the internal systems of electronic devices, leading to a poor user experience. Summary of the Invention

[0004] This invention provides a human-computer interaction method, device, and related medium based on the Internet of Things, aiming to solve the problems of low UI digital transformation and lack of unified and interconnected execution standards in the internal systems of electronic devices in the prior art.

[0005] In a first aspect, embodiments of the present invention provide a human-computer interaction method based on the Internet of Things, comprising:

[0006] Create the first EUI page;

[0007] Extract the device information from the first EUI page and identify the device information to obtain a first device information set;

[0008] The first device information set is matched according to the general UI specifications to obtain the second EUI page; at the same time, the first device information set is updated to the second device information set.

[0009] The NFC and Bluetooth modules are used to establish a communication session group between the front-end application and the device.

[0010] Identify the communication session group, update the communication session group to the second device information set, and obtain the third device information set;

[0011] Determine if the communication session group is abnormal; if so, re-establish the communication session group and determine if it is abnormal again; if not, load the third device information set and call up the second EUI page to transmit to the front-end application for displaying the UI page.

[0012] Secondly, embodiments of the present invention provide a human-computer interaction device based on the Internet of Things, comprising:

[0013] The page creation unit is used to create the first EUI page;

[0014] The page extraction unit is used to extract device information from the first EUI page and identify the device information to obtain a first device information set.

[0015] The page update unit is used to match the first device information set according to the general UI specifications to obtain the second EUI page; at the same time, the first device information set is updated to the second device information set.

[0016] The page connection unit is used to establish a communication session group between the front-end application and the device using the NFC module and Bluetooth module;

[0017] A page identification unit is used to identify the communication session group, update the communication session group to the second device information set, and obtain the third device information set.

[0018] The page output unit is used to determine whether the communication session group is abnormal; if so, the communication session group is re-established and the abnormality is determined again; if not, the third device information set is loaded and the second EUI page is called up and transmitted to the front-end application for displaying the UI page.

[0019] Thirdly, embodiments of the present invention provide a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the Internet of Things-based human-computer interaction method of the first aspect.

[0020] Fourthly, embodiments of the present invention provide a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, it implements the Internet of Things-based human-computer interaction method of the first aspect.

[0021] This invention provides a human-computer interaction method based on the Internet of Things (IoT). The method includes: creating a first EUI page; extracting device information from the first EUI page to obtain a first device information set; matching the first device information set according to a general UI specification to obtain a second EUI page; simultaneously updating the first device information set to the second device information set; establishing a communication session group between a front-end application and the device using an NFC module and a Bluetooth module; identifying the communication session group and processing it to obtain a third device information set; determining whether the communication session group is abnormal; and finally, retrieving the second EUI page and transmitting it to the front-end application for displaying the UI page. This invention establishes communication between the front-end application and the device, and then retrieves and transmits the second EUI page to the front-end application, thereby improving the digitization of the UI of electronic device products and fully displaying the UI interface of the internal system of the electronic device product on the screen.

[0022] This invention also provides an Internet of Things-based human-computer interaction device, computer equipment, and storage medium, which have the same beneficial effects as described above. Attached Figure Description

[0023] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 A flowchart illustrating a human-computer interaction method based on the Internet of Things (IoT) provided in an embodiment of the present invention;

[0025] Figure 2 A flowchart illustrating the communication establishment between a front-end application and a device provided in an embodiment of the present invention;

[0026] Figure 3 This is a schematic block diagram of a human-computer interaction device based on the Internet of Things, provided as an embodiment of the present invention. Detailed Implementation

[0027] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0028] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0029] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0030] It should also be further understood that the term "and / or" as used in this specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0031] Please see below. Figure 1 , Figure 1 The flowchart of a human-computer interaction method based on the Internet of Things provided in this embodiment of the invention specifically includes steps S101 to S106.

[0032] S101. Create the first EUI page;

[0033] S102. Extract the device information from the first EUI page and identify the device information to obtain a first device information set;

[0034] S103. Match the first device information set according to the general UI specification to obtain the second EUI page; at the same time, update the first device information set to the second device information set;

[0035] S104. Use the NFC module and Bluetooth module to establish a communication session group between the front-end application and the device.

[0036] S105. Identify the communication session group, update the communication session group to the second device information set, and obtain the third device information set;

[0037] S106. Determine whether the communication session group is abnormal; if so, re-establish the communication session group and determine whether it is abnormal again; if not, load the third device information set and call up the second EUI page to transmit to the front-end application for displaying the UI page.

[0038] In step S101, a pre-built device embedded UI framework script is run in the device MCU, and the first EUI page is created and the corresponding EUI version information is stored for application in the next step.

[0039] In step S102, device information is first extracted from the pre-built first EUI page; wherein, the device information includes the device's UI page, the device's real-time operating status information, and the device's control IO information, etc.; only the more core device information is exemplified here, and other device information can be added as needed; then, the device information is identified and recorded to obtain the first device information set; of course, if there are multiple devices, multiple device information sets can be obtained, which can be set according to the situation.

[0040] In step S103, information points in the first device information set are identified and matched with and continuously optimized according to a general UI specification to obtain the second EUI page and the corresponding EUI version information. The second EUI page and the corresponding EUI version information are recorded and the first device information set is updated to obtain the second device information set. Additionally, the communication session records collected during the synchronization process are also included in the second device information set.

[0041] In one embodiment, the general UI specification includes:

[0042] A general-purpose container button used to perform a specific function;

[0043] A general-purpose container text for displaying different types of text;

[0044] A general-purpose container progress bar used to display the status of a specified function;

[0045] A general container background used as a background image for windows.

[0046] In this embodiment, the general UI specification is used to adapt to the embedded UI framework script rule specification. Different device products have different hardware components (peripheral devices), which means that all device products cannot be displayed using the same UI program. Since the generality of device products is basically the same, the general UI specification is used to match and optimize to obtain the second EUI page. Overall, they are largely similar; if some other function buttons need to be adjusted, only corresponding modifications need to be made according to the requirements. In addition, general container buttons are used to implement specific functions, such as confirm, cancel, return, function boxes, and home.

[0047] Combination Figure 2As shown, in step S104, when the front-end application establishes communication with the device for the first time, it needs to run a page that loads the embedded UI framework script specification. In this embodiment, a mobile phone is used to connect to the device. Of course, other mobile devices can also connect to the device; a mobile phone is used as an example here. When the mobile phone touches the device, the device detects whether the mobile phone has previously connected to the current device. If so, it can directly proceed to the next step; if not, it needs to authenticate via NFC to trigger the device's Bluetooth to send a connection request to the mobile phone. Then, the mobile phone completes Bluetooth pairing and establishes a communication connection.

[0048] In one embodiment, the Bluetooth module includes a MAC-1 address and a MAC-2 address; the NFC module includes the NFC module of the mobile terminal and the NFC module of the device; step S104 includes:

[0049] According to the SPP protocol, the NFC module of the mobile terminal is matched with the MAC-2 address in the NFC module of the device using the MAC-1 address.

[0050] Furthermore, according to the SPP protocol, the step of enabling the NFC module of the mobile terminal to match the MAC-1 address with the MAC-2 address in the NFC module of the device includes: creating a Bluetooth data packet; packaging the Bluetooth data packet according to the NFC data exchange format to obtain a complete data packet; sending the complete data packet to the NFC module of the device; controlling the listen function in the Bluetooth module to enter a listening and waiting state; and receiving the connection request from the NFC module of the device through the accept function, registering the program with the system, and starting a data transmission thread.

[0051] In this embodiment, the device is equipped with a Bluetooth module (version 5.0 or higher), achieving a communication speed of 1 Mbps (LE1MPHY) to 2 Mbps (LE2MPHY), with an inter-frame spacing (IFS) delay of only 150 µs. Additionally, the NFC module pairs with other Bluetooth-enabled devices by providing a Bluetooth address. Pairing utilizes the Secure Simple Protocol (SPP) in Bluetooth technology. When the SPP uses out-of-band pairing, the NFC module can participate in the out-of-band pairing and complete the information exchange. Therefore, pairing of Bluetooth terminals no longer requires connection searching and PIN code authentication, significantly reducing connection time.

[0052] Furthermore, the processing chip of the mobile terminal (such as a mobile phone) generates a Bluetooth OOB data packet (the Bluetooth data packet) as specified in the SSP protocol. The Bluetooth data packet contains a 2-byte OOB data length, a 6-byte Bluetooth device address, and OOB operation data. The OOB operation data includes the Bluetooth module name, HASHC code, R code, UUID (a globally unique identifier for each service and its attributes in Bluetooth; here, the UUID of the Bluetooth connection process service is used), and device class code. After the Bluetooth data packet is generated, it is packaged into a complete NDEF record (the complete data packet) according to the NFC Data Exchange Format (NDEF). Finally, the mobile terminal sends the complete data packet to the device. After completing the sending operation, the mobile terminal controls the listen function in the Bluetooth module to enter a listening and waiting state; specifically, it controls the listen function of the Bluetooth Socket to enter a listening and waiting state.

[0053] Furthermore, the mobile terminal receives the connection request from the device via the `accept` function, registers its program UUID with the system, and starts a data transmission thread. To enhance security, an elliptic curve cryptography algorithm is incorporated into the connection pairing process. Using this encryption algorithm, before transmitting OOB data, the mobile terminal first transmits the ECC key to the receiving device via NFC touch. After correctly decrypting the received ECC key, the device parses the OOB information contained in the mobile terminal's record. Based on the Bluetooth name, address, and unique UUID data in the OOB information, it requests a connection from the mobile terminal via the `connect` function in the Bluetooth Socket.

[0054] In addition, the transmitted data can be encrypted with a key, and then the encrypted information can be sent to the other party using Bluetooth insecure mode. The receiving party can then decrypt the data and restore it, thus completing the data transmission between the two devices. This will greatly improve the security of data transmission while increasing the Bluetooth connection speed.

[0055] In step S105, when identifying the communication session group, it can be identified as A-connection01, and the communication session group A-connection01 is updated to the second device information set to obtain the third device information set. It should be noted that if multiple mobile terminals are connected, the communication session group of the first mobile terminal can be identified as A-connection01, the communication session group of the second mobile terminal can be identified as A-connection02, the communication session group of the third mobile terminal can be identified as A-connection03, and so on, increasing sequentially.

[0056] In step S106, the mobile terminal activates the electronic device search function. By identifying the information of the communication session group and loading the third device information set, it determines whether the communication between the mobile terminal and the device is normal. Further, it checks whether the communication session group is abnormal; if so, it re-establishes the communication session group and checks for abnormality again; if not, it loads the third device information set and displays the second EUI page to the front-end application for UI display. It should be noted that the third device information set is obtained by continuously updating the first device information set, and the second EUI page is also obtained by continuously updating the first EUI page; more iterative updates result in more accurate data.

[0057] In this invention, by pre-constructing a UI interaction design that satisfies the human-computer interaction of the Internet of Things, the device is authenticated via NFC (or network authentication), and the device is transmitted via Bluetooth (or via WIFI network status or Bluetooth communication without network). The mobile terminal can synchronously view the status of the device and control the device through the digital UI pre-constructed by the device.

[0058] In one embodiment, step S106 includes:

[0059] Determine whether the communication heartbeat signal command set by the device responds to the heartbeat; if yes, the communication is considered normal; if no, the communication is considered abnormal.

[0060] Furthermore, determine whether the connection status of the front-end application is successful; if yes, display the device information; if no, determine that the connection is abnormal.

[0061] Furthermore, the device receives the connection request information from the front-end application and sends the second EUI page to the controller of the front-end application; the controller traverses the second EUI page and generates a session application page identifier or session HTML page data.

[0062] In this embodiment, the device actively requests a connection via its NFC and Bluetooth modules (using POST method, with the command packet in JSON format). After establishing a connection via the SSP protocol, it sets the communication heartbeat signal command "hwd" and the heartbeat response "hwd_reply". When hwd_reply = 1, a response is required. The heartbeat interval "heart_time" is set, and a response check is performed every 10,000 milliseconds. When "hwd_reply_id = 1", communication is normal; when "hwd_reply_id = 0", communication is abnormal.

[0063] Furthermore, the front-end application on the mobile terminal loads the third device information set. When the connection returns a status "status":0 (0 for success, 1 for failure), the device information is displayed. When the connection returns a status "status":1 (0 for success, 1 for failure), the front-end application re-initiates the connection request and displays the result on the front-end application. If the connection still fails, it is determined to be abnormal, and the user is prompted to touch the device again to establish a communication connection.

[0064] Furthermore, the front-end application on the mobile terminal sends a UI connection request to the UI page server of the device. The device receives the connection request information from the front-end application and responds to the request information by listening to Bluetooth session information. It checks the latest version information of the device information set (i.e., the third device information set) and sends the latest version information of the device EUI page (i.e., the second EUI page) to the front-end application. Specifically, the controller of the front-end application traverses the control information in the second EUI page and generates corresponding session application page identifiers or session HTML page data. In simpler terms, the control information in the second EUI page is transformed into virtual machine page or HTML page effects, intuitively realizing the effect of human-computer interaction.

[0065] The method provided in this implementation is only an example of establishing a communication connection for the first time. In actual use, after establishing a communication connection, the mobile terminal monitors the Bluetooth communication session in real time to ensure uninterrupted communication. The mobile terminal manipulates the EUI page, and the EUI page operation commands are sent to the device in real time via the Bluetooth SSP protocol to request EUI page data and receive information returned by the device. The device monitors the updates of its UI information version information and device information in real time, and periodically sets up device information. Furthermore, after establishing a communication connection for the first time, in a second connection, the mobile terminal can touch the device through its NFC module to wake up the communication session group of the device data set in the device, thereby quickly establishing two-way communication and bringing up the latest EUI page of the device in real time.

[0066] In summary, this invention further optimizes the design of the device, assisting enterprises in technological upgrades and cost reduction and efficiency improvement. Simultaneously, this invention possesses versatility and practicality; the device's built-in UI is invoked, enabling human-computer interaction and truly digitizing the device. Furthermore, the connection between the mobile terminal and the device achieves IoT functionality, improving operation and maintenance efficiency. This invention constructs an IoT human-computer interaction method that integrates "electronic devices (such as IIS server roles), UI digitization (such as web pages), multi-level functions of electronic device UI (such as multi-level subpages of web pages), and universal containers (such as Internet Explorer)."

[0067] Figure 3 This is a schematic block diagram of a human-computer interaction device based on the Internet of Things (IoT) provided in an embodiment of the present invention. The IoT-based human-computer interaction device 300 includes:

[0068] Page creation unit 301 is used to create the first EUI page;

[0069] The page extraction unit 302 is used to extract device information from the first EUI page and identify the device information to obtain a first device information set;

[0070] Page update unit 303 is used to match the first device information set according to the general UI specification to obtain the second EUI page; at the same time, the first device information set is updated to the second device information set.

[0071] Page connection unit 304 is used to establish a communication session group between the front-end application and the device using the NFC module and Bluetooth module;

[0072] Page identification unit 305 is used to identify the communication session group, update the communication session group to the second device information set, and obtain the third device information set;

[0073] Page output unit 306 is used to determine whether the communication session group is abnormal; if so, the communication session group is re-established and the abnormality is determined again; if not, the third device information set is loaded and the second EUI page is called up and transmitted to the front-end application for displaying the UI page.

[0074] In this embodiment, firstly, the page creation unit 301 creates a first EUI page; the page extraction unit 302 extracts the device information from the first EUI page and identifies the device information to obtain a first device information set; the page update unit 303 matches the first device information set according to a general UI specification to obtain a second EUI page; simultaneously, the first device information set is updated to the second device information set; the page connection unit 304 uses an NFC module and a Bluetooth module to establish a communication session group between the front-end application and the device; the page identification unit 305 identifies the communication session group and updates the communication session group to the second device information set to obtain a third device information set; finally, the page output unit 306 determines whether the communication session group is abnormal; if so, the communication session group is re-established and the abnormality is determined again; if not, the third device information set is loaded and the second EUI page is displayed and transmitted to the front-end application for displaying the UI page.

[0075] In one embodiment, the generic UI specification includes:

[0076] A general-purpose container button used to perform a specific function;

[0077] A general-purpose container text for displaying different types of text;

[0078] A general-purpose container progress bar used to display the status of a specified function;

[0079] A general container background used as a background image for windows.

[0080] In one embodiment, the Bluetooth module includes a MAC-1 address and a MAC-2 address; the NFC module includes an NFC module for a mobile terminal and an NFC module for a device; the page connection unit 304 includes:

[0081] The matching unit is used to enable the NFC module of the mobile terminal to match the MAC-1 address with the MAC-2 address in the NFC module of the device according to the SPP protocol.

[0082] Furthermore, the matching unit includes:

[0083] Create a unit used to create Bluetooth data packets;

[0084] The packetizing unit is used to package the Bluetooth data packet according to the NFC data exchange format to obtain a complete data packet;

[0085] A sending unit is used to send the complete data packet to the device's NFC module;

[0086] The request unit is used to control the listen function in the Bluetooth module to enter the listening and waiting state; and to receive the connection request from the NFC module of the device through the accept function, register the program with the system, and start the data sending thread.

[0087] In one embodiment, the page output unit 306 includes:

[0088] The heartbeat unit is used to determine whether the communication heartbeat signal command set by the device responds to the heartbeat; if yes, the communication is considered normal; if no, the communication is considered abnormal.

[0089] The connection unit is used to determine whether the connection status of the front-end application is successful; if so, it displays the device information; if not, it determines that the connection is abnormal.

[0090] Furthermore, the page output unit 306 is used for:

[0091] The device receives the connection request information from the front-end application and sends the second EUI page to the controller of the front-end application;

[0092] The controller iterates through the second EUI page and generates a session application page identifier or session HTML page data.

[0093] Since the embodiments of the apparatus and the embodiments of the method correspond to each other, please refer to the description of the embodiments of the method for the embodiments of the apparatus, which will not be repeated here.

[0094] This invention also provides a computer-readable storage medium storing a computer program thereon, which, when executed, can perform the steps provided in the above embodiments. The storage medium may include various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0095] This invention also provides a computer device, which may include a memory and a processor. The memory stores a computer program, and when the processor calls the computer program in the memory, it can implement the steps provided in the above embodiments. Of course, the computer device may also include various network interfaces, power supplies, and other components.

[0096] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the systems disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the descriptions are relatively simple; relevant parts can be referred to in the method section. It should be noted that those skilled in the art can make various improvements and modifications to this application without departing from the principles of this application, and these improvements and modifications also fall within the protection scope of the claims of this application.

[0097] It should also be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A human-computer interaction method based on the Internet of Things, characterized in that, include: Create the first EUI page; Extract the device information from the first EUI page and identify the device information to obtain a first device information set; The first device information set is matched according to the general UI specifications to obtain the second EUI page; at the same time, the first device information set is updated to the second device information set. The NFC and Bluetooth modules are used to establish a communication session group between the front-end application and the device. Identify the communication session group, update the communication session group to the second device information set, and obtain the third device information set; Determine whether the communication session group is abnormal; If yes, then re-establish the communication session group and check for abnormality again; if no, then load the third device information set and call up the second EUI page to transmit to the front-end application for displaying the UI page.

2. The human-computer interaction method based on the Internet of Things according to claim 1, characterized in that, The general UI specifications include: A general-purpose container button used to perform a specific function; A general-purpose container text for displaying different types of text; A general-purpose container progress bar used to display the status of a specified function; A general container background used as a background image for windows.

3. The human-computer interaction method based on the Internet of Things according to claim 1, characterized in that, The Bluetooth module includes a MAC-1 address and a MAC-2 address; the NFC module includes the NFC module of the mobile terminal and the NFC module of the device. The method of establishing a communication session group between the front-end application and the device using the NFC module and Bluetooth module includes: According to the SPP protocol, the NFC module of the mobile terminal is matched with the MAC-2 address in the NFC module of the device using the MAC-1 address.

4. The human-computer interaction method based on the Internet of Things according to claim 3, characterized in that, The step of matching the NFC module of the mobile terminal with the MAC-2 address in the NFC module of the device using the MAC-1 address, according to the SPP protocol, includes: Create Bluetooth data packets; The Bluetooth data packet is packaged according to the NFC data exchange format to obtain a complete data packet; Send the complete data packet to the device's NFC module; The listen function in the Bluetooth module is controlled to enter a listening and waiting state; and the accept function is used to receive the connection request from the NFC module of the device, register the program with the system, and start the data sending thread.

5. The human-computer interaction method based on the Internet of Things according to claim 1, characterized in that, The step of determining whether the communication session group is abnormal includes: Determine whether the communication heartbeat signal command set by the device responds to the heartbeat; if yes, the communication is considered normal; if no, the communication is considered abnormal.

6. The human-computer interaction method based on the Internet of Things according to claim 1, characterized in that, The step of determining whether the communication session group is abnormal also includes: Determine whether the connection status of the front-end application is successful; if yes, display the device information; if no, determine that the connection is abnormal.

7. The human-computer interaction method based on the Internet of Things according to claim 1, characterized in that, The step of loading the third device information set and displaying the second EUI page to transmit it to the front-end application includes: The device receives the connection request information from the front-end application and sends the second EUI page to the controller of the front-end application; The controller iterates through the second EUI page and generates a session application page identifier or session HTML page data.

8. A human-computer interaction device based on the Internet of Things, characterized in that, include: The page creation unit is used to create the first EUI page; The page extraction unit is used to extract device information from the first EUI page and identify the device information to obtain a first device information set. The page update unit is used to match the first device information set according to the general UI specifications to obtain the second EUI page; at the same time, the first device information set is updated to the second device information set. The page connection unit is used to establish a communication session group between the front-end application and the device using the NFC module and Bluetooth module; A page identification unit is used to identify the communication session group, update the communication session group to the second device information set, and obtain the third device information set. A page output unit is used to determine whether the communication session group is abnormal. If yes, then re-establish the communication session group and check for abnormality again; if no, then load the third device information set and call up the second EUI page to transmit to the front-end application for displaying the UI page.

9. A computer device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the Internet of Things-based human-computer interaction method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the Internet of Things-based human-computer interaction method as described in any one of claims 1 to 7.

Images