Internet of Things application online development system based on 3D scene interaction and construction method

Abstract

The invention discloses an Internet of Things application online development system based on 3D scene interaction and a construction method, and belongs to the field of Internet of Things online development. The system comprises a virtual scene module which is responsible for constructing a 3D smart home environment and interacting with Internet of Things equipment through animations so as to realize linkage of virtuality and reality and provide immersive experience for a user; the data transmission module realizes real-time two-way data interaction between the virtual scene and the Internet of Things equipment, including compiling and programming of user codes and synchronous transmission of equipment control instructions, and ensures the operation consistency of virtual and real equipment; the course platform module integrates the virtual scene and the data transmission module, provides online experiment courses and teaching resources, and supports user learning and remote Internet of Things experiment. Immersive experience, real-time data and various development versions are provided for the user, so that the user can more clearly understand the operation mechanism of the Internet of Things equipment in an actual scene.

Description

Technical Field

[0001] The present invention belongs to the field of online development of the Internet of Things, and specifically relates to an online development system and construction method for Internet of Things applications based on 3D scene interaction. Background Art

[0002] As an integral part of modern technology, the Internet of Things (IoT) is increasingly being applied across a wide range of sectors, from smart homes to industrial automation. However, IoT application development faces numerous challenges, including strong device dependency, high device heterogeneity, poor user interaction experience, and strong scenario dependency.

[0003] There are already several successful application cases of IoT virtual experiment platforms. By adopting technologies such as microservices architecture and WebIDE, these platforms have successfully addressed issues such as strong device dependencies and high device heterogeneity. For example, some platforms significantly reduce the difficulty of IoT application development and improve development efficiency by using distributed remote IoT development and testing platforms that support a full development process, including online compilation, remote flashing, and distributed deployment for multiple heterogeneous devices. These platforms not only simplify device configuration and debugging but also provide an integrated development environment, enabling developers to complete the entire process from code writing to device deployment in a remote environment, greatly enhancing the convenience and flexibility of development.

[0004] Furthermore, these platforms typically offer advanced IoT virtual simulation development capabilities, supporting not only remote operation of real devices but also the invocation of virtual devices. These virtual devices can simulate the behavior and reactions of real-world devices, providing developers with a low-cost, efficient testing environment and significantly reducing the experimental costs of IoT application development. However, these platforms still have some shortcomings, such as low resource utilization and insufficient interactivity. For example, the relatively limited interaction methods of virtual experimentation platforms fail to provide a sufficiently immersive experience, resulting in a lack of user interaction with the system.

[0005] Furthermore, traditional IoT application development is mostly focused on specific scenarios, such as smart homes, smart agriculture, and smart transportation. Building a specific scenario for application verification testing is costly and has a limited audience. Traditional methods often require extensive physical equipment and testing environments, resulting in long development cycles, high investment, and high risk. Summary of the Invention

[0006] In view of the shortcomings of the existing technology, the purpose of the present invention is to provide an online development system and construction method for Internet of Things applications based on 3D scene interaction.

[0007] The object of the present invention is achieved through the following technical solutions: an online development system for Internet of Things applications based on 3D scene interaction, comprising:

[0008] The virtual scene module is used to build a 3D smart home environment, add animation effects to interactive devices, and bind some devices to the IoT experimental sensor development board to achieve virtual and real-world linkage. The module uses a 3D engine to create an overall smart home scene and three-dimensionally model the actuator devices in the virtual home based on this overall scene. Users can move freely in the constructed virtual scene from a first-person perspective. An interactive interface is also built to allow users to view real-time changes in key parameters in the IoT environment, such as temperature and humidity, light intensity, and carbon dioxide concentration.

[0009] The data transmission module is used to achieve real-time, two-way data interaction between virtual scenes and IoT devices. This includes compiling and burning user code and synchronously transmitting device control commands, ensuring that the device management center correctly allocates and identifies device exclusive rights. Group IDs are transmitted via WebSocket to ensure that control commands and data between virtual scenes and real devices match, preventing interference between different users' operations. User interactions in the virtual scene are synchronized to real sensors via HTTP requests, enabling real-time data interaction between virtual and real devices.

[0010] The course platform module is used to integrate the virtual scene module and the data transmission module, provide and manage online experimental courses and teaching resources, and support users to learn and conduct remote IoT experiments; ensure that users can systematically learn the principles and practical steps of IoT development, and ultimately achieve an efficient teaching experience for remote online experiments.

[0011] Furthermore, the system supports integration into existing IoT remote experiment platforms, supports access to multiple IoT devices and sensors, and is compatible with multiple communication protocols; the IoT devices are used to collect data in real time and feed it back to the virtual environment, supporting remote control, debugging, and real-time data interaction of the devices; the module is used to provide compatibility with multiple hardware platforms, enabling seamless collaboration of various devices and communication technologies.

[0012] Furthermore, the 3D engine is Unity 3D, and the three-dimensional modeling is achieved through 3ds Max.

[0013] The present invention also provides a method for constructing an online development system for Internet of Things applications based on 3D scene interaction, comprising the following steps:

[0014] S1: Build a virtual scene module, design and model a virtual 3D scene, integrate virtual models of multiple IoT devices, configure interactive animations and control functions for each device, and display sensor data and the results of users' IoT online development experiments in the IoT remote experiment platform through the UI;

[0015] S2: Build a data transmission module to achieve two-way real-time data transmission between the virtual scene and the IoT platform, so that real sensor data can be displayed in the virtual scene in real time, and the user's operation results in the virtual scene can be fed back to the platform in a timely manner;

[0016] S3: Build a course platform module and integrate the virtual scene module and data transmission module into the existing IoT remote experiment platform to realize a complete online development process of IoT applications.

[0017] Furthermore, the step S1 includes:

[0018] S1.1: Use 3ds Max modeling software to create a virtual scene, including functional areas and IoT device models with accurate and realistic proportions relative to the overall virtual scene environment; export the model to a format supported by Unity, import it into the Unity editor, and check the model's materials and textures;

[0019] S1.2: Adjust the material, texture, and lighting of the model to optimize the visual effect and enhance the rendering realism of the scene;

[0020] S1.3: Add colliders to objects in the scene (e.g., tables and stools) and adjust the physics engine to ensure that interactions conform to physical rules; write a first-person controller script to enable smooth user movement in the virtual scene; use Dotween and Avpro plug-ins to optimize dynamic effects and video playback;

[0021] S1.4: Write C# scripts to implement device control logic, update device status in real time, and develop an intuitive UI interface to display sensor data and the results of IoT online development experiments. Implement the data display and device control functions of the interface. The interface is used to dynamically display sensor parameters in IoT development and the results of online development code.

[0022] Furthermore, the step S1.4 includes:

[0023] S1.4.1: Use Unity UI to design the UI layout, including the sensor data display area, device control buttons, and adjustment sliders, to make operation simple and intuitive;

[0024] S1.4.2: Provides an API interface, allowing users to customize device control logic through code;

[0025] S1.4.3: Set up a device status feedback mechanism. When the user operates the corresponding device in the virtual scene, the corresponding device and sensor data are updated and fed back to the UI interface in real time;

[0026] S1.4.4: Implement data synchronization to enable real-time transmission of device control instructions and sensor data, maintaining consistency between the UI and device status.

[0027] Furthermore, the step S2 includes:

[0028] S2.1: In the virtual scene, the system obtains the groupID bound between the user and the remote device from the course platform, uses the groupID to identify and associate the virtual environment with the real device, and accurately transmits subsequent data;

[0029] S2.2: Build the virtual scene server UnityServer, connect to the device management center, and obtain relevant experimental data from the virtual sensor end through the groupID; the system assigns the data to the corresponding client through the ID, so that the user and device data are matched with each other;

[0030] S2.3: Use the WebSocket protocol to achieve two-way data transmission between real devices and the virtual environment. Sensor data is transmitted to the virtual scene in real time through these protocols and dynamically updated in the interface, allowing users to see the device status in real time.

[0031] S2.4: After the user operates in the virtual scene, the system transmits the operation results and data back to the platform server in real time through the communication protocol. The server processes and updates the device status, feedbacks the operation results and updates the device status in a timely manner.

[0032] Furthermore, the step S3 includes:

[0033] S3.1: Integrate the virtual scene module and data transmission module on the IoT remote experiment platform through front-end and back-end related development technologies such as Vue, Sprong Boot, and MySQL, log in to the IoT remote experiment platform, and write code for online development;

[0034] S3.2: Online compilation, searching for an available development board and binding it to the user (ultimately binding it to the corresponding executable device with interactive functions in the virtual scene), completing remote programming and execution, returning the development results and displaying them;

[0035] S3.3: Start the virtual scene WebGL, run the Unity virtual scene, and verify the development results;

[0036] S3.4: Interact with the interactive modules in the virtual scene to verify the functions of the execution devices in the virtual scene and the experimental results of online development, and report the interaction results.

[0037] The present invention also provides an electronic device, including a memory and a processor, wherein the memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the method for constructing an online development system for Internet of Things applications based on 3D scene interaction.

[0038] The present invention also provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the method for constructing an online development system for Internet of Things applications based on 3D scene interaction is implemented.

[0039] The beneficial effects of the present invention are:

[0040] (1) Immersive Experience: This invention innovates on the existing IoT virtual experiment platform by integrating 3D scenes developed based on Unity3D technology. It proposes a method for constructing an IoT application online development system based on 3D scene interaction. Through advanced 3D rendering technology, users can remotely control various smart devices in a virtual smart home environment. This not only enhances the user's interactive experience, but also makes controlling device operations more intuitive and convenient.

[0041] (2) Real-time data: To ensure the accuracy and real-time nature of operations, the system of the present invention acquires data from real sensors. After processing, this data can be fed back into the 3D environment in real time, ensuring that virtual operations are consistent with the behavior of the actual device. This integration of real-time data greatly improves the reliability of online development experiments and testing.

[0042] (3) Support for multiple development boards: This system is compatible with a variety of development boards, including Hi3861, STM32, ESP32, etc. This wide compatibility allows developers to flexibly choose the development board that suits their project, thereby achieving more diverse and innovative smart application development.

[0043] (4) The system of the present invention adopts an Internet of Things development model that is completely based on a browser. Users do not need to install a local integrated development environment, a cross-compilation tool chain or a serial port burning tool, nor do they need to purchase actual equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the examples of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0045] Figure 1 It is a flow chart for realizing the virtual scene module of the system of the present invention;

[0046] Figure 2 It is a flow chart of the data transmission module of the system of the present invention;

[0047] Figure 3 This is a complete system workflow diagram after the course platform module of the system of the present invention is implemented;

[0048] Figure 4 It is a structural diagram of the system of the present invention;

[0049] Figure 5 It is a flow chart of the construction method of the system of the present invention. DETAILED DESCRIPTION

[0050] The following further illustrates the technical solution of the present invention with reference to the accompanying drawings, and briefly demonstrates the online development process of IoT applications based on 3D scenes.

[0051] Example 1

[0052] like Figure 4 As shown, this embodiment provides an online development system for IoT applications based on 3D scene interaction, which consists of three modules: a virtual scene module, a data transmission module, and a course platform module. The virtual scene module is responsible for building a 3D smart home environment and interacting with IoT devices through animation to achieve the linkage between virtual and reality and provide users with an immersive experience. The data transmission module realizes real-time two-way data interaction between the virtual scene and IoT devices, including the compilation and burning of user code and the synchronous transmission of device control instructions, ensuring the consistency of operation between virtual and real devices. The course platform module integrates the virtual scene and data transmission modules, provides online experimental courses and teaching resources, and supports users to learn and conduct remote IoT experiments.

[0053] like Figure 1 As shown, the virtual scene module is used to build a 3D virtual environment for a smart home. The overall scene is first created using Unity3D, and the devices within the virtual home are modeled using 3ds Max. For interactive devices, animation effects are added, and some devices are linked to the IoT experimental sensor development board to achieve a connection between virtual and real life. Users can move freely in the virtual room from a first-person perspective, enhancing the sense of immersion. Furthermore, an interactive interface is constructed using Unity's UI, allowing users to intuitively view real-time changes in key parameters in the IoT environment, such as temperature and humidity, light intensity, and carbon dioxide concentration.

[0054] The virtual scene is presented in a web format, contains a variety of interactive devices, and supports real-time transmission of sensor data; users simulate and adjust the operating status of IoT devices through the control interface, realizing instant interaction and status feedback of devices.

[0055] like Figure 2 As shown in the figure, the data transmission module is used to achieve real-time, two-way data exchange between the virtual scene and IoT experimental devices. This module first handles the compilation and flashing of user code, ensuring that the device management center correctly allocates and identifies exclusive rights to the device. Next, group IDs are transmitted via WebSocket to ensure that control commands and data between the virtual scene and the real device match, preventing interference between different users' operations. Finally, user interactions in the virtual scene are synchronized to real sensors via HTTP requests, enabling real-time data exchange between virtual and real devices.

[0056] Remote control and verification of IoT devices are achieved through real-time interaction between virtual and real devices. User operations in the virtual environment are instantly synchronized to the actual IoT devices, thus ensuring operational consistency between virtual and reality. Real-time synchronization of data and control commands is maintained, completing the seamless two-way interaction between virtual scenes and IoT devices.

[0057] The workflow of the data transmission module is as follows:

[0058] In the first step, the user enters the experimental development interface from the experimental platform course center, first reads the relevant development experiment manuals and tutorials, then enters WebIDE to write code and submit it.

[0059] In the second step, the user's code is compiled and remotely flashed online in the Device Management Center. The Device Management Center server checks for an available development board and, if so, returns a success message to the WebIDE. During this process, the user has exclusive use of the device until the end of the experiment. The source code indicates this "user exclusive use of the device" through a groupId variable. The Device Management Center transmits this groupId, indicating "user exclusive use of the device," to the virtual sensor module and the course platform server, which then stores it.

[0060] The third step is to open the virtual scene WebGL after the code is correctly burned. The 3D scene will connect to the course platform server through WebSocket1, and then the course platform server will send the groupId to the virtual scene through WebSocket.

[0061] Step 4: Inside the virtual scene, pass groupId from WebSocket1 to WebSocket2.

[0062] In the fifth step, the virtual sensor sends the execution device control instruction and groupID to the UnityServer server through an http request.

[0063] In step 6, after receiving the data from the virtual sensor, the UnityServer parses the control command and group ID. Since the group ID was already received in the virtual scene in step 4, the UnityServer uses the group ID as a form of identity authentication and sends the control command to the Unity client with the same group ID. This ensures that the user sees the results of the code they developed remotely during their online development experiment in the virtual scene, rather than the results of someone else, thus ensuring system stability.

[0064] In step 7, the virtual scene receives data from UnityServer and displays it in the UI. User interactions within the virtual scene cause changes in sensor data on the UI to be sent to the virtual sensor via HTTP requests. Upon receiving the message from the virtual scene, the virtual sensor makes corresponding changes to the real sensor, thus enabling two-way real-time data exchange.

[0065] like Figure 3 As shown, the course platform module integrates the virtual scene and data transmission modules, enabling smooth integration into the remote IoT experiment course platform and integrating it with online development experiments and teaching content. This module manages the course and experiment content, providing development experiment manuals and operation tutorials to ensure that users can systematically learn the principles and practical steps of IoT development, ultimately achieving a highly efficient teaching experience for remote online experiments.

[0066] The system of the present invention supports integration into existing IoT remote experiment platforms, supports access to a variety of IoT hardware devices and environmental sensors, and is compatible with a variety of communication protocols; hardware devices can collect data in real time and feed it back to the virtual environment, supporting remote control, debugging and real-time data interaction of devices; the system core module provides compatibility with multiple hardware platforms, enabling various devices and communication technologies to work together seamlessly.

[0067] Example 2

[0068] like Figure 5 As shown, this embodiment provides a method for constructing an online development system for Internet of Things applications based on 3D scene interaction, comprising the following steps:

[0069] S1: Build a virtual scene module, design and model a virtual 3D scene, integrate virtual models of multiple IoT devices, configure interactive animations and control functions for each device, and display sensor data and the results of users' IoT online development experiments in the IoT remote experiment platform through the UI.

[0070] The steps for constructing the virtual scene module are as follows:

[0071] S1.1, 3ds Max modeling

[0072] The smart home scene was modeled in 3ds Max, encompassing the various functional areas of the house, as well as the furniture and equipment within. The modeling process was strictly adhered to actual scale and design requirements to ensure the model's accuracy within the virtual environment and provide foundational support for subsequent rendering and interaction.

[0073] S1.2. Import the model into Unity

[0074] Export the file generated by 3ds Max modeling to a standard format supported by Unity (such as FBX or OBJ) and import it into the Unity editor. During the import process, ensure that the model's materials, textures, coordinate system, and scale are correct.

[0075] S1.3. Material Adjustment

[0076] Adjust the imported model's materials, textures, and lighting effects based on actual needs to ensure its visual effects in Unity meet expectations. This stage also involves material optimization, using efficient shaders and optimization techniques.

[0077] S1.4. UI panel construction

[0078] Design and build a user interface using Unity's built-in UI tools. Use Canvas and its subcomponents to implement data display and device control. The interface will dynamically display common sensor parameters used in IoT development and create a console interface, allowing users to observe the results of experimental code execution in real time within the course platform's intelligent WebIDE, even within the virtual scene.

[0079] S1.5. Adding colliders and physical interactions

[0080] Add appropriate colliders to various objects in the scene (such as tables and walls) to ensure that objects in the virtual environment respond appropriately to user interaction and avoid penetration. By adjusting the physics engine, ensure that collision behavior conforms to real-world physics rules, enhancing the scene's immersion and interactivity.

[0081] S1.6. Writing a First-Person Controller

[0082] Use Unity's standard FirstPersonController or a custom controller script to enable users to move freely in the virtual environment. The controller should support basic operations such as rotation, translation, and jumping to ensure that users can navigate the smart home scene naturally and smoothly from a first-person perspective.

[0083] S1.7. Import animation plug-ins and achieve dynamic effects

[0084] To optimize animation effects and implement video playback, plug-ins such as Dotween and Avpro were imported. The Dotween plug-in can be used to achieve smooth animation transitions for various objects in the scene (such as curtain opening and closing, air conditioning temperature control, etc.), while Avpro can be used to smoothly play video content, further enhancing the dynamic effects and interactivity of the scene.

[0085] S1.8. Functional code writing and logic implementation

[0086] Write C# scripts to implement the control logic of smart home devices, including but not limited to temperature and humidity sensors, air quality monitoring, lighting control, and temperature adjustment. Use appropriate network communication protocols to interact with IoT devices, achieve real-time device status updates, and display sensor data changes and device execution results through the UI.

[0087] S1.9 Testing

[0088] Conduct comprehensive testing on the developed smart home scenarios.

[0089] S1.10, WebGL packaging and publishing

[0090] After completing all functional and performance optimizations, the entire project is packaged into WebGL format to run in the browser.

[0091] S2: Build a data transmission module to realize two-way real-time data transmission between the virtual scene and the IoT platform, so that real sensor data can be displayed in the virtual scene in real time, and the user's operation results in the virtual scene can be fed back to the platform in a timely manner.

[0092] In step S2, the specific steps are as follows:

[0093] S2.1: In the virtual scene, the system obtains the groupID bound to the user and the remote device from the course platform, uses this ID to identify and associate the virtual environment with the real device, and accurately transmits subsequent data;

[0094] S2.2: Build a virtual scene server, connect to the device management center, and obtain relevant experimental data from the virtual sensor end through the groupID; the system assigns the data to the corresponding client through the ID, so that the user and device data are matched with each other;

[0095] S2.3: Use WebSocket, MQTT, or HTTP 2.0 protocols to enable bidirectional data transmission between real devices and the virtual environment. Sensor data is transmitted to the virtual scene in real time through these protocols and dynamically updated in the interface, allowing users to see device status in real time.

[0096] S2.4: After the user operates in the virtual scene, the system transmits the operation results and data back to the platform server in real time through the communication protocol. The server processes and updates the device status, feedbacks the operation results and updates the device status in a timely manner.

[0097] S3: Build a course platform module, integrate the virtual scene module and the data transmission module into the existing IoT remote experiment platform, and realize a complete online development process of IoT applications.

[0098] In step S3, the specific steps are as follows:

[0099] S3.1: Integrate the virtual scene module and data transmission module in the IoT remote experiment platform through front-end and back-end related development technologies such as Vue, Sprong Boot, and Mysql, log in to the platform, enter the relevant development interface, and write code for online development.

[0100] S3.2: Online compilation, searching for available development boards and binding them to the user (ultimately binding them to the corresponding executable device with interactive functions in the virtual scene), completing remote programming and execution, returning the development results and displaying them.

[0101] S3.3: Start the virtual scene WebGL, run the Unity virtual scene, and verify the development results.

[0102] S3.4: Interact with the interactive modules in the virtual scene to verify the functions of the execution devices in the virtual scene and the experimental results of online development, and report the interaction results.

[0103] like Figure 3 As shown, the workflow of an online development system for Internet of Things applications based on 3D scene interaction provided by an embodiment of the present invention is as follows:

[0104] The user first needs to log in to the remote experiment platform, access the corresponding course and experiment page, and use text to understand the background technology, experimental principles, environment, and other aspects of the relevant experiment. Then, enter the intelligent WebIDE to write the application code. After submitting the code through the WebIDE, the user can send a burning request to the code burning server. The server will check whether there is an available development board. If so, it will return a success message to the WebIDE. During this process, the user will have exclusive use of the device until the end of the experiment. The device control center is the manager of the IoT hardware device, responsible for program compilation and development board burning services.

[0105] Successful programming returns the experimental results to the front-end IoT remote experiment platform course center and opens the virtual scene WebGL. The virtual scene's resource files are loaded from the server, and the results of the previous online development are reflected in the virtual scene. Two translucent floating windows are provided in the virtual scene for receiving and displaying console and sensor data transmitted from the server. Simultaneously, through the virtual scene's UI, user operations within the virtual scene are fed back to the device control center in real time. Users can then further observe the results of previously developed online experiments in the virtual scene, such as those related to lighting, temperature and humidity, smoke, and carbon dioxide. These interactions are ultimately reflected in the experiment's run log. For example, changes to temperature, lighting, or carbon dioxide levels allow users to verify whether they have performed any interactive actions in the log.

[0106] An embodiment of the present invention also provides an electronic device, including a memory and a processor, wherein the memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the method for constructing an online development system for Internet of Things applications based on 3D scene interaction.

[0107] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the method for constructing an online development system for Internet of Things applications based on 3D scene interaction is implemented.

[0108] The computer-readable storage medium may be an internal storage unit of any device with data processing capabilities described in any of the aforementioned embodiments, such as a hard disk or memory. The computer-readable storage medium may also be any device with data processing capabilities, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash card, etc. equipped on the device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of any device with data processing capabilities and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by any device with data processing capabilities, and may also be used to temporarily store data that has been output or is to be output.

[0109] The contents described in the embodiments of this specification are merely an enumeration of the implementation forms of the inventive concept. The scope of protection of the present invention should not be regarded as limited to the specific forms described in the embodiments. The scope of protection of the present invention also extends to equivalent technical means that can be conceived by those skilled in the art based on the inventive concept.

Claims

1. An online development system for Internet of Things applications based on 3D scene interaction, characterized in that: include: The virtual scene module is used to build a 3D smart home environment, add animation effects to devices with interactive functions, and bind some executable devices with interactive functions to the IoT experimental sensor development board to achieve the linkage between virtual and reality; create the overall scene of the smart home through a 3D engine, and perform three-dimensional modeling of the executable devices in the virtual home according to the overall scene; users can move freely in the constructed virtual scene from a first-person perspective, and at the same time build an interactive interface; The data transmission module is used to realize real-time two-way data interaction between virtual scenes and IoT devices, including the compilation and burning of user codes and the synchronous transmission of device control instructions, ensuring that the device management center correctly allocates and identifies the exclusive rights of the device; groupID is transmitted through WebSocket to ensure that the control instructions and data between the virtual scene and the real device match to avoid interference between operations of different users; and the user's interactive operations in the virtual scene are synchronized to the real sensor through HTTP requests to realize real-time data interaction between virtual and real devices; The course platform module is used to integrate the virtual scene module and the data transmission module, provide and manage online experimental courses and teaching resources, and support users to learn and conduct remote IoT experiments.

2. According to claim 1, an online development system for Internet of Things applications based on 3D scene interaction is characterized in that: The system supports integration into the existing IoT remote experiment platform, supports the access of various IoT devices and sensors, and is compatible with various communication protocols; the IoT devices are used to collect data in real time and feed it back to the virtual environment, supporting remote control, debugging and real-time data interaction of the devices; The module is used to provide compatibility with multiple hardware platforms, allowing various devices and communication technologies to work together seamlessly.

3. According to claim 1, an online development system for Internet of Things applications based on 3D scene interaction is characterized in that: The 3D engine is Unity 3D, and the three-dimensional modeling is achieved through 3ds Max.

4. A method for constructing an online development system for Internet of Things applications based on 3D scene interaction, characterized in that: The following steps are involved: S1: Build a virtual scene module, design and model a virtual 3D scene, integrate virtual models of multiple IoT devices, configure interactive animations and control functions for each device, and display sensor data and the running results of the IoT online development experiment conducted by users in the IoT remote experiment platform through the UI; S2: Build a data transmission module to realize two-way real-time data transmission between the virtual scene and the IoT platform, so that real sensor data can be displayed in real time in the virtual scene, and the user's operation results in the virtual scene can be fed back to the platform in a timely manner; S3: Build a course platform module, integrate the virtual scene module and data transmission module into the existing IoT remote experiment platform to realize a complete online development process of IoT applications.

5. According to claim 4, a method for constructing an online development system for Internet of Things applications based on 3D scene interaction is characterized in that: The step S1 comprises: S1.1: Use 3ds Max modeling software to create a virtual scene, including functional areas and IoT device models with accurate and realistic proportions relative to the overall environment of the virtual scene; export the model to a format supported by Unity, import it into the Unity editor, and check the material and texture of the model; S1.2: Adjust the material, texture and lighting of the model; S1.3: Add colliders to objects in the scene and adjust the physics engine to make the interaction conform to the rules of physics; write the first-person controller script to enable the user to move smoothly in the virtual scene; use Dotween and Avpro plug-ins to optimize dynamic effects and video playback functions; S1.4: Write C# scripts to implement device control logic, update device status in real time, develop an intuitive UI interface, display sensor data and the running results of the IoT online development experiment through the UI, and realize the data display and device control functions of the interface. The interface is used to dynamically display the sensor parameters in the IoT development and the running results of the online development code.

6. The method for constructing an online development system for Internet of Things applications based on 3D scene interaction according to claim 5 is characterized in that: The step S1.4 comprises: S1.4.1: Use Unity UGUI to design the UI layout, including the sensor data display area, device control buttons, and adjustment sliders; S1.4.2: Provide API interface, users can customize device control logic through code; S1.4.3: Set up a device status feedback mechanism. After the user operates the corresponding device in the virtual scene, the corresponding device and sensor data are updated and fed back to the UI interface in real time; S1.4.4: Realize data synchronization to enable real-time transmission of device control instructions and sensor data, and maintain consistency between UI and device status.

7. According to claim 4, a method for constructing an online development system for Internet of Things applications based on 3D scene interaction is characterized in that: The step S2 comprises: S2.1: In the virtual scene, the system obtains the groupID bound between the user and the remote device from the course platform, uses the groupID to identify and associate the virtual environment with the real device, and accurately transmits subsequent data; S2.2: Build the virtual scene server UnityServer, connect to the device management center, and obtain relevant experimental data from the virtual sensor through the groupID; the system assigns the data to the corresponding client through the ID, so that the user and device data match each other; S2.3: WebSocket protocols are used to achieve two-way data transmission between real devices and virtual environments. Sensor data is transmitted to the virtual scene in real time through these protocols and dynamically updated in the interface, allowing users to see the device status in real time. S2.4: After the user operates in the virtual scene, the system transmits the operation results and data back to the platform server in real time through the communication protocol. The server processes and updates the device status, feedbacks the operation results and updates the device status in a timely manner.

8. According to claim 4, a method for constructing an online development system for Internet of Things applications based on 3D scene interaction is characterized in that: The step S3 comprises: S3.1: Integrate the virtual scene module and data transmission module in the IoT remote experiment platform through front-end and back-end related development technologies, log in to the IoT remote experiment platform, and write code for online development. The front-end and back-end related development technologies include Vue, Sprong Boot, and Mysql; S3.2: Online compilation, search for available development boards and bind them to users, complete remote programming and execution, return development results and display them; S3.3: Start the virtual scene WebGL, run the Unity virtual scene, and verify the development results; S3.4: Interact with the interactive modules in the virtual scene, verify the functions of the execution equipment in the virtual scene and the experimental results of online development, and report the interaction results.

9. An electronic device, comprising a memory and a processor, characterized in that: The memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement a method for constructing an online development system for Internet of Things applications based on 3D scene interaction as described in any one of claims 4-8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by the processor, it implements a method for constructing an online development system for Internet of Things applications based on 3D scene interaction as described in any one of claims 4 to 8.

Images