Multi-source heterogeneous data automatic gathering system and gathering method for smart park

Abstract

This invention discloses an automatic aggregation system for multi-source heterogeneous data in smart parks, comprising an operating system, a general tool interface module, a hardware abstraction module, a peripheral device management module, a connection status management module, and a data on-demand forwarding module. Compatible access devices include: wireless panoramic cameras, UAV data transmission modules, voice broadcasters, AR glasses, handheld terminals, and PCs. This invention solves the problems of data access, aggregation, and preprocessing from multiple types of peripheral devices in complex environments.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of Internet of Things platforms, in particular to a multi-source heterogeneous data automatic aggregation system and method in a smart park scenario. BACKGROUND

[0002] Due to different deployment methods and application scenarios, the devices connected to various Internet of Things platforms are diverse, and due to the lack of unified standard specifications, the interfaces, buses, and protocols of various types of connected devices are different, and the data types and structures are increasingly complex, bringing new challenges to data aggregation.

[0003] In the field of smart parks, the connected devices are highly unknown, and the connection methods and communication protocols of various devices are inconsistent. Some devices are directly connected to the Internet of Things platform, some devices need to be connected to the cloud platform directly or through multiple gateways, and how to solve the problem of complex and fragmented device connection to connect various devices and application systems in the most convenient way while maintaining flexibility and faster matching of user needs.

[0004] In the field of smart parks, different sources of data are currently aggregated into a big data platform in a non-discriminatory manner. This architecture cannot efficiently process data locally according to processing rules, data sources, or data content, cannot automatically determine abnormal conditions in device operation data and device collection data from various sensors, cannot judge and provide early warning for possible events, and the data aggregation system has low processing efficiency and low real-time performance.

[0005] Chinese patent CN111753007A discloses a pluggable component data aggregation system and method under multiple systems. The data streams collected by the aggregation server in the aggregation system come from the system network and only support network protocols. Chinese patent CN112883095A discloses a method, system, device, and storage medium for aggregating multi-source heterogeneous data. The FTP interface and Web Service interface in the data interface are both network-based protocols or components. However, the above two aggregation systems only complete network communication protocol conversion and cannot process and transmit multiple other types of protocols, making them unsuitable for application scenarios with complex communication interfaces.

[0006] Chinese patent CN114498927A discloses a power transmission line multi-parameter sensing data aggregation system, method, and device. In terms of data aggregation, the main control unit receives multi-parameter sensing data sent by the remote communication unit and the local communication unit. In terms of data forwarding, the remote communication unit reliably forwards data from various remote sensing terminals. Although this patent converts communication protocols, the data stream aggregation and forwarding direction are fixed, and custom data forwarding between external devices cannot be achieved.

[0007] Therefore, there is a need to provide a multi-source heterogeneous data automatic aggregation system and method for smart park to overcome the above problems, break through the interface bus, communication protocol and data format restrictions between access devices and data sources, implement inference and prediction of execution models at the edge of devices, and improve user edge side data collection, processing and response efficiency, and interconnection and intercommunication between access devices and data sources, data aggregation and computing capacity. SUMMARY

[0008] The present application aims to provide a multi-source heterogeneous data automatic aggregation system and method for smart park to solve the problem of multi-type peripheral data access, aggregation and preprocessing in complex environment.

[0009] The technical solution for achieving the purpose of the present application is a multi-source heterogeneous data automatic aggregation system for smart park, comprising an operating system, a general tool interface module, a hardware abstraction module, a peripheral management module, a connection state management module and a data on-demand forwarding module, and the adaptive access devices include a wireless panoramic camera, a UAV data transmission module, a voice broadcaster, AR glasses, a handheld terminal and a PC, wherein:

[0010] The operating system is used to build a network bridge device, connect multiple wired and wireless physical network ports into a virtual network segment, realize network data forwarding and communication, set the network bridge device as a wireless access point, and support the access of multiple Wi-Fi devices as a wireless gateway, provide network connection services to these Wi-Fi devices, support WPA-PSK / WPA2-PSK authentication and encryption, and allocate IP addresses, subnet masks, gateway addresses and DNS server parameters to clients in the network;

[0011] The general tool interface module is used to provide a start parameter reading and writing method, provide json file reading and writing interfaces based on the third-party integrated library jsoncpp, provide functions of obtaining millisecond-level time stamp, network cable connection detection, wireless LAN scanning discovery, obtaining network interface configuration and shell script execution success check, and provide methods of ARP cache setting, ARP cache setting acquisition, peripheral connection state setting, peripheral connection state setting acquisition, peripheral file handle addition, peripheral file handle acquisition, peripheral file handle deletion, data queue addition, data queue acquisition, data queue deletion, system state monitoring setting and system state monitoring acquisition;

[0012] The hardware abstraction module provides a serial interface library, a network library, and a display management library. The serial interface library provides initialization parameter configuration for serial interface peripherals, supporting baud rate, timeout, data bits, parity bits, stop bits, and flow control configuration. It also provides interfaces for serial interface open status detection, serial interface input buffer refresh, serial interface reading, serial interface writing, and serial interface closing. The network library provides initialization parameter configuration for network peripherals, providing interfaces for connection status detection, network socket reading, and network socket writing. The display management library provides interface settings for display peripherals, including resolution, refresh rate, rotation mode, coordinate position, and specified output port.

[0013] The peripheral management module is used to parse the peripheral whitelist and load the business logic of wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal and PC based on peripheral name key-value pair and peripheral enable key-value pair.

[0014] The connection status management module is used to obtain ARP information from handheld terminals and PCs within the local area network (LAN), call the LAN scanning shell script, read the ARP cache file, discard abnormal data, call the ARP cache setting interface in the general tool interface module, and save the ARP cache list in standard JSON format. Each element in the ARP cache list has three key-value pairs, with values ​​representing IP address, online status, and MAC address, respectively. It also outputs the connection status of the wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal, and PC to a JSON file and calls the peripheral connection status function in the general tool interface module. Set the acquisition method to obtain peripheral connection status data in JSON format, then call the JSON file read / write interface in the general tool interface module to generate a JSON file from the peripheral connection status data according to the defined path and name; and output the ARP information of handheld terminals and PCs in the local area network to a JSON file, call the ARP cache setting acquisition method in the general tool interface module to obtain ARP information data of handheld terminals and PCs in JSON format, then call the JSON file read / write interface in the general tool interface module to generate a JSON file from the ARP information of handheld terminals and PCs in the local area network according to the defined path and name;

[0015] The data on-demand forwarding module calls the data queue acquisition method in the general tool interface module to retrieve a standard structured data element from the head of the double-ended queue. The data element is in standard JSON format, and each element has three key-value pairs, whose values ​​represent the source peripheral, source data, and destination peripheral, respectively. If the destination peripheral key-value pair is empty, the peripheral data flow direction list data is obtained based on the source peripheral key-value pair and destination peripheral key-value pair values ​​of each element in the peripheral data flow direction list. Based on the single peripheral associated with the destination peripheral, the module calls the corresponding peripheral data sending interface, passes the source data as a parameter to the peripheral data sending interface, and sends the data stream to the destination peripheral. Finally, the module calls the data queue deletion method in the general tool interface module to delete a standard structured data element from the head of the double-ended queue.

[0016] Furthermore, the wireless panoramic camera connects to the automatic data aggregation system via Wi-Fi, the drone data transmission module connects to the automatic data aggregation system via a USB Type-A to TTL serial interface, the voice broadcaster connects to the automatic data aggregation system via a DB9 RS-232 serial interface, the AR glasses connect to the automatic data aggregation system via a USB Type-C DisplayPort interface, the handheld terminal connects to the automatic data aggregation system via Wi-Fi, and the PC connects to the automatic data aggregation system via an Ethernet RJ45 connection.

[0017] Furthermore, before deploying the automatic data aggregation system, the operating system needs to be modified and adapted, mainly including kernel adaptation, file system adaptation, and system application adaptation, among which:

[0018] Kernel adaptation: Obtain peripheral drivers, compile drivers, generate driver modules and integrate them into the kernel to ensure that the kernel supports DHCP, firewall configuration and management and network bridging;

[0019] File system adaptation: Modify the root file system of Linux, Android, and Ubuntu, and configure the username, account password, hostname, and wallpaper;

[0020] System application adaptation: Deploy dhcpd, hostapd, brctl, and nginx network services and set them to start automatically; deploy gcc, g++, and cmake compilation toolchains; and deploy the mjpg-streamer component.

[0021] Furthermore, during the initialization of the general tool interface module, the system default startup parameters are read from a standard JSON data file according to the defined path and filename. These parameters include the TCP server port number, peripheral whitelist, peripheral connection port list, and peripheral data flow direction list. When users need to modify, add, or remove system parameters, only the JSON file needs to be modified; a complete project recompilation is not required.

[0022] The following arrays can be used to represent TCP server port numbers: key-value pairs, with names and values ​​separated by colons; peripheral whitelists, which can be expanded to include all elements, with each element being an object containing a peripheral name key-value pair and a peripheral enable / disable key-value pair; peripheral data streams, which can also be expanded to include all elements, with each element being an object containing source and destination peripheral key-value pairs; and peripheral connection ports, which can also be expanded to include all elements, with each element being an object containing peripheral name key-value pairs and peripheral connection port key-value pairs.

[0023] Furthermore, during the initialization of the peripheral management module, the peripheral whitelist list in the general tool interface module is parsed. Based on the peripheral name key-value pair and the peripheral enable / disable key-value pair value for each element in the list, the whitelist peripheral initialization sequence is executed sequentially, initializing the wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal, and PC. If initialization fails, an error message is displayed and the initialization sequence is exited.

[0024] During the initialization of the wireless panoramic camera, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed to the wireless panoramic camera key-value pair. The wireless panoramic camera connection network port key-value pair value is obtained. If the network port is valid, the network port in the automatic aggregation system is enabled; otherwise, an error is displayed and the process ends. After the wireless panoramic camera enters the business logic, it first calls the wireless LAN scan discovery interface of the general tool interface module to determine whether the wireless access point of the wireless panoramic camera has been established. If the wireless access point has been established, the wireless panoramic camera connection network port is controlled to connect to the wireless access point, obtain the IP address, configure the network firewall, and allow network data packets to be forwarded from the wireless panoramic camera to the automatic aggregation system. At this time, the wireless panoramic camera is in a connected state. If the wireless access point has not been established, it waits, and the wireless panoramic camera is in an unconnected state. Finally, the peripheral connection status setting method in the general tool interface module is called to set the connection status of the wireless panoramic camera.

[0025] During the initialization of the UAV data transmission module, the peripheral name values ​​in the peripheral connection port list of the general tool interface module are parsed to obtain the UAV data transmission module key-value pairs. The serial interface key-value pair value is then retrieved. If the serial interface is valid, the parameter configuration interface of the hardware abstraction module's serial interface library is called to set the baud rate, data bits, stop bits, parity bits, and control flow. The peripheral connection status setting method in the general tool interface module is then called to set the UAV data transmission module status to connected. Otherwise, an error message is displayed and the process terminates. Upon entering the UAV data transmission module's business logic, the first step is to call the read interface of the hardware abstraction module's serial interface library and configure the UAV data transmission module accordingly. The block protocol parses the data to obtain the source data and the destination peripheral. The peripheral is named the source peripheral. Then, the source peripheral, source data, and destination peripheral are encapsulated into standard structured data in standard JSON format. Each element has three key-value pairs, whose values ​​represent the source peripheral, source data, and destination peripheral, respectively. Finally, the data queue addition method of the general tool interface module is called to store the standard JSON data at the tail of the double-ended queue. The UAV data transmission module also provides a data sending interface. The peripheral data sending interface converts the data according to the UAV data transmission module protocol and then calls the write interface of the serial interface library of the hardware abstraction module to send data to the UAV data transmission module.

[0026] During voice broadcaster initialization, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed into a voice broadcaster key-value pair. The value of the peripheral voice broadcaster connection serial interface key-value pair is obtained. If the serial interface is valid, the parameter configuration interface of the serial interface library of the hardware abstraction module is called to set the baud rate, data bits, stop bits, parity bits, and control flow. The peripheral connection status setting method in the general tool interface module is called to set the peripheral voice broadcaster status to connected. Otherwise, an error message is displayed and the process ends. The voice broadcaster also provides a peripheral data transmission interface. The peripheral data transmission interface converts the data according to the peripheral voice broadcaster protocol and then calls the write interface of the serial interface library of the hardware abstraction module to send data to the voice broadcaster.

[0027] During AR glasses initialization, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed into an AR glasses key-value pair. The value of the peripheral AR glasses connection projection port key-value pair is obtained. If the projection port is valid, the hardware abstraction module display library parameter configuration interface is called to dynamically adjust and configure parameters such as the automatic convergence system output screen resolution, screen position, and refresh rate. Otherwise, an error is displayed and the process ends. After entering the AR glasses business logic, the peripheral connection status setting method in the general tool interface module is called to set the peripheral AR glasses status to connected.

[0028] During handheld terminal initialization, the key-value pair of the TCP server port number in the general tool interface module is parsed, and the network socket service initialization is completed by calling the network library of the hardware abstraction module. After entering the handheld terminal business logic, two sub-threads are created: a peripheral connection status sending thread and a network data receiving thread. These two sub-threads are separated so that they can run independently. The peripheral connection status sending thread periodically calls the peripheral connection status setting and obtaining method in the general tool interface module to obtain peripheral connection status data in JSON format, and then calls the peripheral handheld terminal data sending interface to send the peripheral connection status data to the handheld terminal device. The network data receiving thread first calls... The hardware abstraction module (HEP) network library reads data and parses it according to the peripheral handheld terminal protocol to obtain the source data and the destination peripheral. The name of the peripheral is "source peripheral". The source peripheral, source data, and destination peripheral are then encapsulated into standard structured data in standard JSON format. Each element has three key-value pairs, whose values ​​represent the source peripheral, source data, and destination peripheral, respectively. Finally, the data queue addition method of the general utility interface module is called to store the standard JSON data at the tail of a double-ended queue. The handheld terminal also provides a peripheral data sending interface. The peripheral data sending interface converts the data according to the peripheral handheld terminal protocol and then calls the write interface of the HEP network library to send data to the peripheral handheld terminal.

[0029] During peripheral PC initialization, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed as a PC key-value pair. The value of the peripheral PC's network port key-value pair is obtained. If the network port is valid, the automatic aggregation of the network port in the system is enabled; otherwise, an error is displayed and the process ends. After entering the peripheral PC's business logic, the network cable connection detection interface of the general tool interface module is first called to determine whether a network cable is connected to the PC's network port. If a network cable is connected, the peripheral PC is in a connected state; if no network cable is connected, it waits, and the peripheral PC is in an unconnected state. The peripheral connection status setting method in the general tool interface module is then called to set the peripheral PC's connection status.

[0030] Furthermore, during the initialization of the data on-demand forwarding module, the user-defined peripheral data flow direction list in the general tool interface module is parsed. Based on the source peripheral key-value pair and destination peripheral key-value pair values ​​of each element in the list, the peripheral data flow direction list data is obtained. The format is standard JSON data, and each element has two key-value pairs, whose values ​​represent the source peripheral and the destination peripheral, respectively.

[0031] In a smart park scenario, the list of custom peripheral data flow directions is as follows:

[0032] Source peripheral: Wireless panoramic camera; Destination peripheral: PC.

[0033] Source peripheral: handheld terminal; Destination peripheral: voice broadcaster;

[0034] Source peripheral: UAV data transmission module; Destination peripheral: Handheld terminal;

[0035] Source peripheral: AR glasses; Destination peripheral: PC.

[0036] Source peripheral: handheld terminal; destination peripheral: UAV data transmission module.

[0037] An automatic data aggregation method for smart parks, based on the aforementioned automatic data aggregation system for smart parks, enables automatic data aggregation for smart parks.

[0038] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it realizes automatic data aggregation for smart parks based on the aforementioned automatic data aggregation system for smart parks.

[0039] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, enables automatic data aggregation for smart parks based on the aforementioned automatic data aggregation system for smart parks.

[0040] Compared with the prior art, the present invention has the following significant advantages: (1) The general tool interface provides a multi-functional, general, and business-independent data interface, which can realize the configuration of TCP server port number, peripheral whitelist, peripheral connection port and peripheral data flow direction. When users need to modify, add or reduce system parameters, there is no need to compile the whole project. The modular design allows for rapid deployment and simple implementation conditions. (2) The multi-threaded architecture is compatible with operating systems such as Ubuntu, Linux and Android, as well as 32-bit and 64-bit processor platforms, to meet the data aggregation needs of different business systems. Attached Figure Description

[0041] Figure 1 This is a diagram of the multi-source heterogeneous data automatic aggregation system of the present invention, applied to a smart park scenario;

[0042] Figure 2 These are the default startup parameters for the universal tool interface module system of this invention;

[0043] Figure 3 This invention relates to the peripheral data receiving, processing, and forwarding business logic. Implementation

[0044] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0045] This invention relates to an automatic aggregation system for multi-source heterogeneous data in smart parks, comprising an operating system layer, a general tool interface layer, a hardware abstraction layer, a peripheral management layer, a connection status management layer, and a data on-demand forwarding layer. Compatible access devices include: wireless panoramic cameras, drone data transmission modules, voice broadcasters, AR glasses, handheld terminals, and PCs. Figure 1 As shown, in the data automatic aggregation system for smart parks, a wireless panoramic camera connects to the system via Wi-Fi, operating in wireless access point mode while the automatic aggregation system operates in site mode. A drone data transmission module connects to the system via a USB Type-A to TTL serial interface. A voice broadcaster connects to the system via a DB9 RS-232 serial interface. AR glasses connect to the system via a USB Type-C DisplayPort interface, operating in output mode while the AR glasses operate in input mode. A handheld terminal connects to the system via Wi-Fi, operating in wireless access point mode while the handheld terminal operates in site mode. A PC connects to the system via Ethernet RJ45.

[0046] (1) Operating System

[0047] The operating system, as the foundation of the aggregation system, shields the differences between applications and hardware. Before deploying an automated aggregation system, the operating system needs to be modified and adapted, mainly including kernel adaptation, file system adaptation, and system application (service) adaptation, among which:

[0048] Kernel Adaptation: Working closely with manufacturers of peripherals such as drone data transmission modules, we obtain peripheral drivers such as the USB Type-A to TTL serial interface driver for drone data transmission modules, compile the drivers, generate driver modules, and integrate them into the kernel to ensure that the kernel supports network features such as DHCP, firewall configuration and management, and network bridging.

[0049] File system adaptation: Modify the root file system of Linux, Android, Ubuntu, etc., and configure personalized parameters such as username, account password, hostname, and wallpaper.

[0050] System application (service) adaptation: Deploy network services such as dhcpd, hostapd, brctl, and nginx and set them to start automatically; deploy compilation toolchains such as gcc, g++, and cmake; and deploy the mjpg-streamer component.

[0051] After the operating system boots up, a new network bridging device is created, connecting multiple wired and wireless physical network ports into a virtual network segment to enable network data forwarding and communication. The network bridging device is configured as a wireless access point, and the aggregation system acts as a wireless gateway to support the access of multiple Wi-Fi devices and provide network connectivity services to these Wi-Fi devices, supporting WPA-PSK / WPA2-PSK authentication and encryption. Network parameters such as IP address, subnet mask, gateway address, and DNS server are assigned to clients in the network, so that clients obtain the correct network configuration when accessing the network.

[0052] (2) General tool interface layer

[0053] During the initialization of the general tool interface module, the system default startup parameters are read from a standard JSON data file according to the defined path and filename, such as... Figure 2 As shown, this includes TCP server port numbers, peripheral whitelists, peripheral connection ports, and peripheral data flow directions. When users need to modify, add, or remove system parameters, only the JSON file needs to be modified; a complete project recompilation is not required. The automatic aggregation system uses TCP server port numbers for program identification and location when communicating with the handheld terminal. The TCP server port numbers are represented as key-value pairs, using colons to separate names and values; the peripheral whitelist is represented as an array, with the number of array elements expandable. Each element in the array is an object containing a peripheral name key-value pair and a peripheral enable / disable key-value pair; the peripheral data flow list is represented as an array, with the number of array elements expandable. Each element in the array is an object containing source peripheral key-value pairs and destination peripheral key-value pairs; the peripheral connection port list is represented as an array, with the number of array elements expandable. Each element in the array is an object containing peripheral name key-value pairs and peripheral connection port key-value pairs.

[0054] The general-purpose tool interface module provides methods for reading and writing startup parameters, based on the third-party integration library jsoncpp, offering interfaces for reading and writing JSON files. It provides common, business-independent functions such as obtaining millisecond-level timestamps, network cable connection detection, wireless LAN scanning and discovery, obtaining network interface configurations, and checking shell script execution success. It also provides methods for accessing internal member variables, including ARP cache settings, ARP cache settings retrieval, peripheral device connection status settings, peripheral file handle addition, peripheral file handle retrieval, peripheral file handle deletion, data queue addition, data queue retrieval, data queue deletion, system status monitoring settings, and system status monitoring retrieval.

[0055] (3) Hardware Abstraction Layer

[0056] The hardware abstraction module provides a serial interface library, a network library supporting common network protocols such as TCP / UDP and HTTP / Websocket, and a display management library, among which:

[0057] The serial interface library provides initialization parameter configuration for serial interface peripherals such as UAV data transmission modules and voice broadcasters. It supports baud rate, timeout, data bits, parity bits, stop bits, and flow control configuration. It also provides serial interface open status detection, serial interface input buffer refresh, serial interface read, serial interface write, and serial interface close interfaces.

[0058] The network library supports common network protocols such as TCP / UDP and HTTP / Websocket, and provides initialization parameter configuration for network peripherals such as handheld terminals and PCs. It also provides interfaces for connection status detection, network socket reading, and network socket writing.

[0059] The display management library provides interface settings for display peripherals such as AR glasses, including resolution, refresh rate, rotation mode, coordinate position, and specified output port.

[0060] (4) Peripheral management layer

[0061] When the peripheral management module is initialized, it parses the peripheral whitelist list in the general tool interface module. Based on the peripheral name key-value pair and peripheral enable key-value pair value of each element in the list, it executes the whitelist peripheral initialization sequence in sequence to initialize peripherals such as wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal and PC. If the initialization fails, it will prompt the error peripheral and exit the initialization sequence.

[0062] After entering the peripheral management module's business logic, the peripheral whitelist in the general tool interface module is parsed. Based on the peripheral name key-value pair and the peripheral enable / disable key-value pair value for each element in the list, the business logic of peripherals such as the wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal, and PC is loaded sequentially. The peripheral management module creates sub-threads (including sub-threads for each business of the wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal, and PC) and separates the created sub-threads from the parent thread, allowing the thread to run independently without depending on the parent thread. When a thread is separated, the parent thread no longer waits for the sub-thread to complete but can continue executing other tasks, while the sub-thread runs independently in the background until it completes on its own. The peripheral management module's sub-threads enter a periodic loop, collecting and outputting automatic aggregation system operating status parameters, including CPU core temperature, CPU utilization, and memory utilization. Based on the TCP server port number defined in the general tool interface module, users can receive the automatic aggregation system's operating status parameters after connecting to the automatic aggregation system using a handheld terminal or PC.

[0063] The peripheral wireless panoramic camera is initialized. The peripheral name value in the peripheral connection port list in the general tool interface module is parsed as a wireless panoramic camera key-value pair. The value of the peripheral wireless panoramic camera connection network port key-value pair is obtained. If the network port is valid, the automatic aggregation of the network port in the system is enabled. Otherwise, an error message is displayed and the process ends.

[0064] Upon entering the peripheral wireless panoramic camera's business logic, a new sub-thread for the wireless panoramic camera's periodic loop is created and separated from the main wireless panoramic camera business thread, allowing this sub-thread to run independently. The sub-thread created by the peripheral wireless panoramic camera then enters its periodic loop. First, the wireless LAN scanning and discovery interface of the general tool interface module is called to determine if the wireless access point for the wireless panoramic camera has been established. If the wireless access point has been established, the peripheral wireless panoramic camera's network port is controlled to connect to the wireless access point, obtain an IP address, configure the network firewall, and allow network packets to be forwarded from the wireless panoramic camera to the automatic aggregation system. At this point, the peripheral wireless panoramic camera is in a connected state. If the wireless access point has not been established, the process waits, and the peripheral wireless panoramic camera is in an unconnected state. Finally, the peripheral connection status setting method in the general tool interface module is called to set the connection status of the peripheral wireless panoramic camera.

[0065] The peripheral UAV data transmission module is initialized. The peripheral name value in the peripheral connection port list of the general tool interface module is parsed as the UAV data transmission module key-value pair. The value of the peripheral UAV data transmission module connection serial interface key-value pair is obtained. If the serial interface is valid, the hardware abstraction layer serial interface library parameter configuration interface is called to set parameters such as baud rate, data bits, stop bits, parity bits, and control flow. The peripheral connection status setting method in the general tool interface module is called to set the peripheral UAV data transmission module status to connected. Otherwise, an error is displayed and the process ends.

[0066] The logic for the peripheral UAV data transmission module is then entered. A blocking loop sub-thread for the UAV data transmission module is created and separated from the main UAV data transmission module business thread, allowing this sub-thread to run independently. The sub-thread created by the peripheral UAV data transmission module enters a blocking loop. First, the read interface of the hardware abstraction layer serial interface library is called to parse the data according to the peripheral UAV data transmission module protocol, obtaining the source data and the destination peripheral. The peripheral is named "source peripheral". Then, the source peripheral, source data, and destination peripheral are encapsulated into standard structured data in standard JSON format. Each element has three key-value pairs, with values ​​representing the source peripheral, source data, and destination peripheral, respectively. Finally, the data queue addition method of the general utility interface layer is called to store the standard JSON data at the tail of a double-ended queue.

[0067] The peripheral UAV data transmission module also provides a peripheral data transmission interface. The peripheral data transmission interface converts data according to the peripheral UAV data transmission module protocol, and then calls the write interface of the hardware abstraction layer serial interface library to send data to the peripheral UAV data transmission module.

[0068] The peripheral voice broadcaster is initialized by parsing the peripheral name value from the peripheral connection port list in the general tool interface module into a voice broadcaster key-value pair. The peripheral voice broadcaster connection serial interface key-value pair value is obtained. If the serial interface is valid, the hardware abstraction layer serial interface library parameter configuration interface is called to set parameters such as baud rate, data bits, stop bits, parity bits, and control flow. The peripheral connection status setting method in the general tool interface module is called to set the peripheral voice broadcaster status to connected. Otherwise, an error message is displayed and the process ends.

[0069] The peripheral voice broadcaster also provides a peripheral data transmission interface. The peripheral data transmission interface converts data according to the peripheral voice broadcaster protocol, and then calls the write interface of the hardware abstraction layer serial interface library to send data to the peripheral voice broadcaster.

[0070] The peripheral AR glasses are initialized. The peripheral name value in the peripheral connection port list in the general tool interface module is parsed as the AR glasses key-value pair. The value of the peripheral AR glasses connection projection port key-value pair is obtained. If the projection port is valid, the hardware abstraction layer display library parameter configuration interface is called to dynamically adjust and configure parameters such as the automatic convergence system output screen resolution, screen position and refresh rate. Otherwise, an error is displayed and the process ends.

[0071] Upon entering the peripheral AR glasses business logic, a blocking loop sub-thread for AR glasses is created and separated from the AR glasses business thread, allowing this sub-thread to run independently. The sub-thread created by the peripheral AR glasses enters a blocking loop. The peripheral connection status setting method in the general tool interface module is called to set the peripheral AR glasses status to connected.

[0072] The peripheral handheld terminal is initialized, the TCP server port number key-value pair in the general tool interface module is parsed, and the network socket service is initialized by calling the hardware abstraction layer network library.

[0073] Upon entering the peripheral handheld terminal business logic, two sub-threads are created: a peripheral connection status sending thread and a network data receiving thread. These two sub-threads are separated, allowing them to run independently. The peripheral connection status sending thread periodically calls the peripheral connection status setting and retrieval method in the general tool interface module to obtain peripheral connection status data in JSON format. It then calls the peripheral handheld terminal data sending interface to send the peripheral connection status data to the handheld terminal device. The network data receiving thread first calls the read interface of the hardware abstraction layer network library and parses the data according to the peripheral handheld terminal protocol to obtain the source data and destination peripheral. The peripheral's name is "source peripheral." It then encapsulates the source peripheral, source data, and destination peripheral into standard structured data in standard JSON format. Each element has three key-value pairs, with values ​​representing the source peripheral, source data, and destination peripheral, respectively. Finally, it calls the data queue addition method of the general tool interface layer to store the standard JSON data at the tail of a double-ended queue.

[0074] The peripheral handheld terminal also provides a peripheral data transmission interface. The peripheral data transmission interface converts data according to the peripheral handheld terminal protocol, and then calls the write interface of the hardware abstraction layer network library to realize the transmission of data to the peripheral handheld terminal.

[0075] The peripheral PC is initialized. The peripheral name value in the peripheral connection port list in the general tool interface module is parsed as a PC key-value pair. The peripheral PC connection network port key-value pair value is obtained. If the network port is valid, the automatic aggregation of the network port in the system is enabled. Otherwise, an error message is displayed and the process ends.

[0076] Upon entering the peripheral PC's business logic, a PC-based periodic loop sub-thread is created and separated from the PC's business thread, allowing it to run independently. The peripheral PC's sub-thread then enters its periodic loop. First, the network cable connection detection interface of the general tool interface module is called to determine if a network cable is connected to the PC's network port. If a network cable is connected, the peripheral PC is in a connected state; otherwise, it waits, and the peripheral PC is in an unconnected state. Then, the peripheral connection status setting method in the general tool interface module is called to set the peripheral PC's connection status.

[0077] (5) Connection status management module

[0078] The connection state management module does not require initialization. Upon entering the connection state module's business logic, the connection state module creates a periodic loop sub-thread for the connection state management module. This newly created periodic loop sub-thread is separated from the connection state management module's business thread, allowing it to run independently. The connection state management module sub-thread enters a periodic loop, within which a millisecond-level timestamp function is obtained from the general utility interface module. This, along with a system delay function, prevents the loop period from becoming too short.

[0079] First, obtain ARP information from handheld terminals and PCs within the local area network, call the local area network scanning shell script, read the ARP cache file, discard abnormal data, call the ARP cache setting interface in the general tool interface module, and save the ARP cache list in standard JSON format. Each element in the ARP cache list has three key-value pairs, whose values ​​represent IP address, online status, and MAC address, respectively.

[0080] Next, the connection status of peripheral wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal and PC is output to JSON file. The peripheral connection status setting and acquisition method in the general tool interface module is called to obtain the peripheral connection status data in JSON format. Then, the JSON file read and write interface in the general tool interface module is called to generate a JSON file according to the defined path and name of the peripheral connection status data.

[0081] Finally, the ARP information of handheld terminals and PCs within the local area network is output to a JSON file. The ARP cache setting and acquisition method in the general tool interface module is called to obtain the ARP information data of handheld terminals and PCs within the local area network in JSON format. Then, the JSON file read and write interface in the general tool interface module is called to generate a JSON file according to the defined path and name of the ARP information of handheld terminals and PCs within the local area network.

[0082] (6) Data on demand forwarding layer

[0083] When the data on-demand forwarding module is initialized, it parses the user-defined peripheral data flow direction list in the general tool interface module. Based on the source peripheral key-value pair and destination peripheral key-value pair values ​​of each element in the list, it obtains the peripheral data flow direction list data in standard JSON format. Each element has two key-value pairs, and their values ​​represent the source peripheral and the destination peripheral, respectively.

[0084] In a smart park scenario, users can customize the following list of peripheral data flow directions:

[0085] Source peripheral: Wireless panoramic camera; Destination peripheral: PC.

[0086] Source peripheral: handheld terminal; Destination peripheral: voice broadcaster;

[0087] Source peripheral: UAV data transmission module; Destination peripheral: Handheld terminal;

[0088] Source peripheral: AR glasses; Destination peripheral: PC.

[0089] Source peripheral: handheld terminal; destination peripheral: UAV data transmission module.

[0090] Upon entering the business logic of the data on-demand forwarding module, the module creates a sub-thread and separates it, allowing the thread to run independently. This sub-thread then enters a periodic loop. First, it calls the data queue acquisition method in the general tool interface module to retrieve a standard structured data element from the head of the double-ended queue. This element is in standard JSON format, with each element containing three key-value pairs representing the source peripheral, source data, and destination peripheral. If the destination peripheral key-value pair is empty, the peripheral data flow direction list is obtained by considering the source and destination peripheral key-value pairs for each element in the peripheral data flow direction list.

[0091] Next, based on the individual peripheral associated with the destination peripheral, the corresponding peripheral data sending interface is called, the source data is passed as a parameter to the peripheral data sending interface, and the data stream is sent to the destination peripheral.

[0092] Finally, the data queue deletion method in the general tool interface module is called to delete a standard structured data element from the head of the double-ended queue.

[0093] A method for automatic aggregation of multi-source heterogeneous data in smart parks, the specific steps of which are as follows:

[0094] Initialize system logs based on the third-party integration library plog. Generate log files according to the defined paths and names, define the maximum size and number of individual log files, and perform log truncation and log file rolling if the defined threshold is exceeded.

[0095] The initialization sequence of the tool interface module, peripheral management module, connection status management module, and data on-demand forwarding module is executed sequentially. Peripheral modules such as wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal and PC are initialized. If a single module is initialized successfully, the corresponding module's business logic is loaded; otherwise, the module with the error is prompted and the initialization sequence is exited.

[0096] like Figure 3 As shown, during peripheral data reception, processing, and forwarding, each peripheral in the peripheral management layer reads and parses the data according to the peripheral protocol to obtain the source data and the destination peripheral. The name of the peripheral is designated as the source peripheral. The source peripheral, source data, and destination peripheral are then encapsulated into standard structured data in standard JSON format and stored at the tail of a double-ended queue. The data-on-demand forwarding layer retrieves a standard structured data element from the head of the double-ended queue, also in standard JSON format. If the destination peripheral key-value pair is empty, the destination peripheral associated with the source peripheral in the peripheral data flow direction list is used. Based on the individual peripheral associated with the destination peripheral, the corresponding peripheral data sending interface is called, passing the source data as a parameter to the interface to send the data stream to the destination peripheral.

[0097] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0098] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these modifications and improvements all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. An automatic aggregation system for multi-source heterogeneous data in smart parks, characterized in that, It includes an operating system, a general tool interface module, a hardware abstraction module, a peripheral management module, a connection status management module, and a data on-demand forwarding module. Compatible access devices include: wireless panoramic cameras, drone data transmission modules, voice broadcasters, AR glasses, handheld terminals, and PCs. The operating system is used to build network bridging devices, connecting multiple wired and wireless physical network ports into a virtual network segment to achieve network data forwarding and communication; it sets the network bridging devices as wireless access points, and the aggregation system acts as a wireless gateway to support the access of multiple Wi-Fi devices and provide network connectivity services to these Wi-Fi devices, supporting WPA-PSK / WPA2-PSK authentication and encryption; and it assigns IP addresses, subnet masks, gateway addresses, and DNS server parameters to clients in the network. The general-purpose tool interface module provides methods for reading and writing startup parameters. Based on the third-party integration library jsoncpp, it provides interfaces for reading and writing JSON files; functions for obtaining millisecond-level timestamps, detecting network cable connections, discovering wireless LANs, obtaining network interface configurations, and checking successful shell script execution; and methods for setting and obtaining ARP cache settings, setting and obtaining peripheral connection status settings, adding, obtaining, and deleting peripheral file handles, adding, obtaining, and deleting data queues, and setting and obtaining system status monitoring. The hardware abstraction module provides a serial interface library, a network library, and a display management library. The serial interface library provides initialization parameter configuration for serial interface peripherals, supporting baud rate, timeout, data bits, parity bits, stop bits, and flow control configuration. It also provides interfaces for serial interface open status detection, serial interface input buffer refresh, serial interface reading, serial interface writing, and serial interface closing. The network library provides initialization parameter configuration for network peripherals, providing interfaces for connection status detection, network socket reading, and network socket writing. The display management library provides interface settings for display peripherals, including resolution, refresh rate, rotation mode, coordinate position, and specified output port. The peripheral management module is used to parse the peripheral whitelist and load the business logic of wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal and PC based on peripheral name key-value pair and peripheral enable key-value pair. The connection status management module is used to obtain ARP information from handheld terminals and PCs within the local area network (LAN), call the LAN scanning shell script, read the ARP cache file, discard abnormal data, call the ARP cache setting interface in the general tool interface module, and save the ARP cache list in standard JSON format. Each element in the ARP cache list has three key-value pairs, with values ​​representing IP address, online status, and MAC address, respectively. It also outputs the connection status of the wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal, and PC to a JSON file and calls the peripheral connection status function in the general tool interface module. Set the acquisition method to obtain peripheral connection status data in JSON format, then call the JSON file read / write interface in the general tool interface module to generate a JSON file from the peripheral connection status data according to the defined path and name; and output the ARP information of handheld terminals and PCs in the local area network to a JSON file, call the ARP cache setting acquisition method in the general tool interface module to obtain ARP information data of handheld terminals and PCs in JSON format, then call the JSON file read / write interface in the general tool interface module to generate a JSON file from the ARP information of handheld terminals and PCs in the local area network according to the defined path and name; The data on-demand forwarding module calls the data queue acquisition method in the general tool interface module to retrieve a standard structured data element from the head of the double-ended queue. The data element is in standard JSON format, and each element has three key-value pairs, whose values ​​represent the source peripheral, source data, and destination peripheral, respectively. If the destination peripheral key-value pair is empty, the peripheral data flow direction list data is obtained based on the source peripheral key-value pair and destination peripheral key-value pair values ​​of each element in the peripheral data flow direction list. Based on the single peripheral associated with the destination peripheral, the module calls the corresponding peripheral data sending interface, passes the source data as a parameter to the peripheral data sending interface, and sends the data stream to the destination peripheral. Finally, the module calls the data queue deletion method in the general tool interface module to delete a standard structured data element from the head of the double-ended queue.

2. The automatic data aggregation system for smart parks according to claim 1, characterized in that, The wireless panoramic camera connects to the automatic data aggregation system via Wi-Fi; the drone data transmission module connects to the automatic data aggregation system via a USB Type-A to TTL serial interface; the voice broadcaster connects to the automatic data aggregation system via a DB9 RS-232 serial interface; the AR glasses connect to the automatic data aggregation system via a USB Type-C DisplayPort interface; the handheld terminal connects to the automatic data aggregation system via Wi-Fi; and the PC connects to the automatic data aggregation system via an Ethernet RJ45 interface.

3. The automatic data aggregation system for smart parks according to claim 1, characterized in that, Before deploying the automatic data aggregation system, the operating system needs to be modified and adapted, mainly including kernel adaptation, file system adaptation, and system application adaptation, among which: Kernel adaptation: Obtain peripheral drivers, compile drivers, generate driver modules and integrate them into the kernel to ensure that the kernel supports DHCP, firewall configuration and management and network bridging; File system adaptation: Modify the root file system of Linux, Android, and Ubuntu, and configure the username, account password, hostname, and wallpaper; System application adaptation: Deploy dhcpd, hostapd, brctl, and nginx network services and set them to start automatically; deploy gcc, g++, and cmake compilation toolchains; and deploy the mjpg-streamer component.

4. The automatic data aggregation system for smart parks according to claim 1, characterized in that, During the initialization of the general tool interface module, the system's default startup parameters are read from a standard JSON data file according to the defined path and filename. These parameters include the TCP server port number, peripheral whitelist, peripheral connection port list, and peripheral data flow direction list. When users need to modify, add, or remove system parameters, only the JSON file needs to be modified; a complete project recompilation is not required. The following arrays can be used to represent TCP server port numbers: key-value pairs, with names and values ​​separated by colons; peripheral whitelists, which can be expanded to include all elements, with each element being an object containing a peripheral name key-value pair and a peripheral enable / disable key-value pair; peripheral data streams, which can also be expanded to include all elements, with each element being an object containing source and destination peripheral key-value pairs; and peripheral connection ports, which can also be expanded to include all elements, with each element being an object containing peripheral name key-value pairs and peripheral connection port key-value pairs.

5. The automatic data aggregation system for smart parks according to claim 1, characterized in that, During peripheral management module initialization, the peripheral whitelist in the general tool interface module is parsed. Based on the peripheral name key-value pair and peripheral enable / disable key-value pair value for each element in the list, the whitelist peripheral initialization sequence is executed sequentially, initializing the wireless panoramic camera, drone data transmission module, voice broadcaster, AR glasses, handheld terminal, and PC. If initialization fails, an error message is displayed and the initialization sequence is exited. During the initialization of the wireless panoramic camera, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed to the wireless panoramic camera key-value pair. The wireless panoramic camera connection network port key-value pair value is obtained. If the network port is valid, the network port in the automatic aggregation system is enabled; otherwise, an error is displayed and the process ends. After the wireless panoramic camera enters the business logic, it first calls the wireless LAN scan discovery interface of the general tool interface module to determine whether the wireless access point of the wireless panoramic camera has been established. If the wireless access point has been established, the wireless panoramic camera connection network port is controlled to connect to the wireless access point, obtain the IP address, configure the network firewall, and allow network data packets to be forwarded from the wireless panoramic camera to the automatic aggregation system. At this time, the wireless panoramic camera is in a connected state. If the wireless access point has not been established, it waits, and the wireless panoramic camera is in an unconnected state. Finally, the peripheral connection status setting method in the general tool interface module is called to set the connection status of the wireless panoramic camera. During the initialization of the UAV data transmission module, the peripheral name values ​​in the peripheral connection port list of the general tool interface module are parsed to obtain the UAV data transmission module key-value pairs. The serial interface key-value pair value is then retrieved. If the serial interface is valid, the parameter configuration interface of the hardware abstraction module's serial interface library is called to set the baud rate, data bits, stop bits, parity bits, and control flow. The peripheral connection status setting method in the general tool interface module is then called to set the UAV data transmission module status to connected. Otherwise, an error message is displayed and the process terminates. Upon entering the UAV data transmission module's business logic, the first step is to call the read interface of the hardware abstraction module's serial interface library and configure the UAV data transmission module accordingly. The block protocol parses the data to obtain the source data and the destination peripheral. The peripheral is named the source peripheral. Then, the source peripheral, source data, and destination peripheral are encapsulated into standard structured data in standard JSON format. Each element has three key-value pairs, whose values ​​represent the source peripheral, source data, and destination peripheral, respectively. Finally, the data queue addition method of the general tool interface module is called to store the standard JSON data at the tail of the double-ended queue. The UAV data transmission module also provides a data sending interface. The peripheral data sending interface converts the data according to the UAV data transmission module protocol and then calls the write interface of the serial interface library of the hardware abstraction module to send data to the UAV data transmission module. During voice broadcaster initialization, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed into a voice broadcaster key-value pair. The value of the peripheral voice broadcaster connection serial interface key-value pair is obtained. If the serial interface is valid, the parameter configuration interface of the serial interface library of the hardware abstraction module is called to set the baud rate, data bits, stop bits, parity bits, and control flow. The peripheral connection status setting method in the general tool interface module is called to set the peripheral voice broadcaster status to connected. Otherwise, an error message is displayed and the process ends. The voice broadcaster also provides a peripheral data transmission interface. The peripheral data transmission interface converts the data according to the peripheral voice broadcaster protocol and then calls the write interface of the serial interface library of the hardware abstraction module to send data to the voice broadcaster. During AR glasses initialization, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed into an AR glasses key-value pair. The value of the peripheral AR glasses connection projection port key-value pair is obtained. If the projection port is valid, the hardware abstraction module display library parameter configuration interface is called to dynamically adjust and configure parameters such as the automatic convergence system output screen resolution, screen position, and refresh rate. Otherwise, an error is displayed and the process ends. After entering the AR glasses business logic, the peripheral connection status setting method in the general tool interface module is called to set the peripheral AR glasses status to connected. During handheld terminal initialization, the key-value pair of the TCP server port number in the general tool interface module is parsed, and the network socket service initialization is completed by calling the network library of the hardware abstraction module. After entering the handheld terminal business logic, two sub-threads are created: a peripheral connection status sending thread and a network data receiving thread. These two sub-threads are separated so that they can run independently. The peripheral connection status sending thread periodically calls the peripheral connection status setting and obtaining method in the general tool interface module to obtain peripheral connection status data in JSON format, and then calls the peripheral handheld terminal data sending interface to send the peripheral connection status data to the handheld terminal device. The network data receiving thread first calls... The hardware abstraction module (HEP) network library reads data and parses it according to the peripheral handheld terminal protocol to obtain the source data and the destination peripheral. The name of the peripheral is "source peripheral". The source peripheral, source data, and destination peripheral are then encapsulated into standard structured data in standard JSON format. Each element has three key-value pairs, whose values ​​represent the source peripheral, source data, and destination peripheral, respectively. Finally, the data queue addition method of the general utility interface module is called to store the standard JSON data at the tail of a double-ended queue. The handheld terminal also provides a peripheral data sending interface. The peripheral data sending interface converts the data according to the peripheral handheld terminal protocol and then calls the write interface of the HEP network library to send data to the peripheral handheld terminal. During peripheral PC initialization, the peripheral name value in the peripheral connection port list of the general tool interface module is parsed as a PC key-value pair. The value of the peripheral PC's network port key-value pair is obtained. If the network port is valid, the automatic aggregation of the network port in the system is enabled; otherwise, an error is displayed and the process ends. After entering the peripheral PC's business logic, the network cable connection detection interface of the general tool interface module is first called to determine whether a network cable is connected to the PC's network port. If a network cable is connected, the peripheral PC is in a connected state; if no network cable is connected, it waits, and the peripheral PC is in an unconnected state. The peripheral connection status setting method in the general tool interface module is then called to set the peripheral PC's connection status.

6. The automatic data aggregation system for smart parks according to claim 1, characterized in that, When the data on-demand forwarding module is initialized, it parses the user-defined peripheral data flow direction list in the general tool interface module. Based on the source peripheral key-value pair and destination peripheral key-value pair values ​​of each element in the list, it obtains the peripheral data flow direction list data in standard JSON format. Each element has two key-value pairs, and their values ​​represent the source peripheral and the destination peripheral, respectively. In a smart park scenario, the list of custom peripheral data flow directions is as follows: Source peripheral: Wireless panoramic camera; Destination peripheral: PC. Source peripheral: handheld terminal; Destination peripheral: voice broadcaster; Source peripheral: UAV data transmission module; Destination peripheral: Handheld terminal; Source peripheral: AR glasses; Destination peripheral: PC. Source peripheral: handheld terminal; destination peripheral: UAV data transmission module.

7. A method for automatic data aggregation in smart parks, characterized in that, Based on the automatic data aggregation system for smart parks as described in any one of claims 1-6, automatic data aggregation for smart parks is achieved.

8. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it realizes automatic data aggregation for smart parks based on the automatic data aggregation system for smart parks as described in any one of claims 1-6.

9. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, it realizes automatic data aggregation for smart parks based on the automatic data aggregation system for smart parks according to any one of claims 1-6.

Images