High-speed multi-modal data acquisition method and system, edge computing equipment and medium

Abstract

The invention discloses a high-speed multi-modal data acquisition method and system, edge computing equipment and a medium. The high-speed multi-modal data acquisition system comprises at least one sensor and a high-speed data transmission processor, and has high expandability and strong compatibility. A chip selection line is connected between each sensor and the high-speed data transmission processor, and at least one sensor and the high-speed data transmission processor are connected with a data transmission signal line. Wherein each sensor is configured, upon receiving the configuration information, to collect multi-modal data based on the configuration information transmitted by the high-speed data transmission processor through the chip selection line. The high-speed data transmission processor is configured to read a signal of the chip selection line according to a preset sampling parameter, determine a target sensor from the at least one sensor based on the signal of the chip selection line, and read multi-modal data collected by the target sensor through the data transmission signal line, so that the influence caused by bandwidth limitation is effectively reduced.

Description

Technical Field

[0001] The present invention relates to the technical fields of human factors engineering and ergonomics, and particularly to a high-speed multimodal data acquisition method and system, an edge computing device, and a medium. Background Art

[0002] As the system expands gradually, the types of integrated sensors continue to increase. In a multi-sensor system, there are compatibility problems in aspects such as communication protocols, data formats, and power consumption between different sensors, and with the expansion of the system scale, the debugging complexity increases. Summary of the Invention

[0003] The present invention aims to solve at least one of the technical problems in the related art to some extent. For this purpose, the present invention provides a high-speed multimodal data acquisition method and system, an edge computing device, and a medium.

[0004] The present invention provides a high-speed multimodal data acquisition system, the system includes at least one sensor and a high-speed data transmission processor, a chip select line is connected between each sensor and the high-speed data transmission processor, and a data transmission signal line is connected between the at least one sensor and the high-speed data transmission processor, wherein:

[0005] Each sensor is configured to collect multimodal data based on the configuration information when receiving the configuration information, wherein the configuration information is transmitted by the high-speed data transmission processor through the chip select line;

[0006] The high-speed data transmission processor is configured to read the signal of the chip select line according to preset sampling parameters, determine a target sensor from the at least one sensor based on the signal of the chip select line, and read the multimodal data collected by the target sensor through the data transmission signal line.

[0007] In one embodiment, the high-speed data transmission processor is further configured to determine the data type of the read multimodal data in the following manner:

[0008] The high-speed data transmission processor determines the data type of the read multimodal data based on the identifier of the chip select line corresponding to the target sensor, wherein there is a corresponding relationship between the identifier of the chip select line and the data type; or,

[0009] The high-speed data transmission processor reads the electrical signal of the target sensor based on the chip select line, and determines the data type of the read multimodal data based on the electrical signal.

[0010] In one embodiment, the high-speed data transmission processor is further configured to normalize multimodal data of the same data type and packetize the data obtained through the normalization process to form a standardized multimodal data packet.

[0011] In one embodiment, the system further includes:

[0012] A host computer, which is communicatively connected to the high-speed data transmission processor and is configured to receive the standardized multimodal data packet transmitted by the high-speed data transmission processor.

[0013] In one embodiment, the configuration information transmitted by the high-speed data transmission processor through the chip select line includes the sampling frequency of the sensor, and the sampling frequency is less than or equal to the maximum transmission rate of the SPI communication protocol.

[0014] In one embodiment, the first data acquisition rate of the multimodal data acquired by the high-speed data transmission processor from the target sensor through the data transmission signal line is greater than a preset rate threshold and / or greater than a second data acquisition rate, where the second data acquisition rate includes the rate at which the target sensor directly sends the acquired multimodal data to the host computer.

[0015] The present invention provides a high-speed multimodal data acquisition method, and the method includes:

[0016] Transmitting configuration information to a corresponding sensor through a chip select line;

[0017] Reading the signal of the chip select line according to preset sampling parameters, determining a target sensor from at least one sensor based on the signal of the chip select line, and reading the multimodal data acquired by the target sensor through a data transmission signal line; or,

[0018] The method includes:

[0019] Receiving the configuration information transmitted by the high-speed data transmission processor through the chip select line;

[0020] Acquiring multimodal data based on the configuration information.

[0021] The present invention provides a high-speed multimodal data acquisition device, and the device includes:

[0022] A configuration information transmission module, configured to transmit configuration information to a corresponding sensor through a chip select line;

[0023] A multimodal data reading module, configured to read the signal of the chip select line according to preset sampling parameters, determine a target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data acquired by the target sensor through a data transmission signal line; or,

[0024] The device includes:

[0025] A configuration information receiving module, configured to receive configuration information transmitted by a high-speed data transmission processor through a chip select line;

[0026] A multimodal data acquisition module, configured to acquire multimodal data based on the configuration information.

[0027] The present invention provides an edge computing device, which includes: a memory, and one or more processors communicatively connected to the memory; instructions executable by the one or more processors are stored in the memory, and when the instructions are executed by the one or more processors, the one or more processors are caused to implement the steps of the method according to any one of the above embodiments; and / or, the edge computing device includes the high-speed multimodal data acquisition device as described above.

[0028] The present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method according to any one of the above embodiments are implemented.

[0029] The present invention provides a computer program product, which includes instructions, and when the instructions are executed by a processor of a computer device, the computer device is enabled to execute the steps of the method according to any one of the above embodiments.

[0030] In the above embodiments, the high-speed multimodal data acquisition system includes at least one sensor and a high-speed data transmission processor, and has high scalability and strong compatibility. Without modifying the original sensor configuration, it can be conveniently debugged and controlled. A chip select line is connected between each sensor and the high-speed data transmission processor, and at least one sensor and the high-speed data transmission processor are connected with a data transmission signal line for data interaction. Among them, each sensor is configured to, in the case of receiving configuration information, acquire multimodal data based on the configuration information transmitted by the high-speed data transmission processor through the chip select line. The high-speed data transmission processor is configured to read the signal of the chip select line according to preset sampling parameters, determine a target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data acquired by the target sensor through the data transmission signal line, effectively reducing the influence brought by bandwidth limitation. Therefore, the reliability of the high-speed multimodal data acquisition system in a complex environment is improved through the above embodiments.

[0031] Additional aspects and advantages of the present invention will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1a Schematic diagram of the high-speed multi-modal data acquisition system provided by the embodiments of this specification;

[0033] Figure 1b Schematic diagram of the high-speed multi-modal data acquisition system provided by the embodiments of this specification;

[0034] Figure 2 Schematic diagram of the high-speed data transmission processor provided by the embodiments of this specification;

[0035] Figure 3 Schematic diagram of the high-speed multi-modal data acquisition system provided by the embodiments of this specification;

[0036] Figure 4 Flow schematic diagram of the high-speed multi-modal data acquisition method provided by the embodiments of this specification;

[0037] Figure 5 Flow schematic diagram of the high-speed multi-modal data acquisition method provided by the embodiments of this specification;

[0038] Figure 6 Schematic diagram of the high-speed multi-modal data acquisition device provided by the embodiments of this specification;

[0039] Figure 7 Schematic diagram of the high-speed multi-modal data acquisition device provided by the embodiments of this specification;

[0040] Figure 8 Internal structure schematic diagram of the edge computing device provided by the embodiments of this specification. Detailed implementation manners

[0041] The embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0042] As a discipline that studies the relationship among humans, machines, and the environment, human factors engineering and ergonomics comprehensively apply physiology, psychology, hygiene, and anthropometry to study the interaction between humans and other elements of the system, and are attracting increasing attention. It studies the reasonable relationship among humans, machines, and the environment based on factors such as human psychology, physiology, and body structure to ensure that people work safely, healthily, and comfortably and achieve satisfactory work results. Therefore, it is playing an increasingly important role in improving people's physical and mental health, work efficiency, safety, and comfort. In human factors engineering, the data of humans, machines, human-machine interaction, environment, etc. collected during the analysis of human behavior, cognition, and operation processes can be called multimodal data. The instruments and equipment for collecting multimodal data can include various types of sensing devices or other measurement devices to collect various physiological data, psychological data, and behavioral data, etc. Multimodal data is widely involved in various application fields such as health, medical care, and intelligent driving.

[0043] Multimodal data includes human-related data, machine-related data, human-machine interaction-related data, and / or environment-related data. Human-related data includes, but is not limited to, one or a combination of the following: functional near-infrared spectroscopy (fNIRS) data, electroencephalogram (EEG) data, skin conductance and skin temperature data, pulse data, blood pressure data, blood oxygen data, electrocardiogram data, electromyogram data, muscle oxygen data, respiration data, biomechanical data, transcranial stimulation data, heart rate variability data, heart rate data, image / video data, sound data, eye movement data, gesture or motion data. Machine-related data includes, but is not limited to, one or a combination of the following: machine operation data, fault alarm data, machine control data, machine model data, machine communication data, machine location data. Human-machine interaction-related data includes, but is not limited to, one or a combination of the following: human-machine voice interaction data, human-machine text interaction data, human-machine touch interaction data, human-machine gesture or motion interaction data, human-machine EEG interaction data, human-machine eye movement interaction data, human-machine facial expression interaction data. Environment-related data includes, but is not limited to, one or a combination of the following: location data, humidity data, temperature data, chromaticity data, brightness data, weather data, road condition data, traffic data, stimulation signal data, event or signal marking data. These data can be obtained through sensing devices or other types of measurement devices that support the collection of corresponding types of data. The collection of multimodal data often requires continuous collection over a period of time, and the data volume is huge.

[0044] In the process of implementing the embodiments of the present invention, the inventor found that during the multi-modal data acquisition process, as the types of integrated sensors continue to increase, in a multi-sensor system, there are compatibility problems in terms of communication protocols, data formats, power consumption, etc. among different sensors. Moreover, as the system scale expands, the debugging complexity increases. And during the multi-modal data acquisition process, USB full speed faces significant bandwidth limitations, resulting in large data transmission delays or losses.

[0045] Therefore, it is necessary to propose a high-speed multi-modal data acquisition system to make up for the deficiency of bandwidth limitations while taking into account the reliability, scalability, and compatibility of the system.

[0046] It should be noted that the high-speed data transmission processor in the embodiments of this specification can be a High-Speed Universal Serial Bus Microcontroller.

[0047] In the embodiments of this specification, a high-speed multi-modal data acquisition system is provided. Please refer to Figure 1a , the high-speed multi-modal data acquisition system 100 includes at least one sensor 110 and a high-speed data transmission processor 120. A chip select line is connected between each sensor 110 and the high-speed data transmission processor 120, and at least one sensor 110 and the high-speed data transmission processor 120 are connected with data transmission signal lines, where:

[0048] Each sensor 110 is configured to collect multi-modal data based on the configuration information when receiving the configuration information, where the configuration information is transmitted by the high-speed data transmission processor 120 through the chip select line.

[0049] The high-speed data transmission processor 120 is configured to read the signal of the chip select line according to the preset sampling parameters, determine the target sensor from at least one sensor 110 based on the signal of the chip select line, and read the multi-modal data collected by the target sensor through the data transmission signal line.

[0050] Among them, the SPI communication protocol (Serial Peripheral Interface) is a high-speed full-duplex synchronous communication bus, which can enable the MCU to communicate with various peripheral devices in a serial manner.

[0051] In this embodiment, after any sensor 110 is powered on, the high-speed data transmission processor 120 acts as a SPI host (SPIM, Serial Peripheral Interface Master) through the SPI communication protocol, and transmits the configuration information corresponding to the sensor 110 to the sensor 110 through the chip select line. When the sensor 110 receives the configuration information, it updates the configuration parameters, and collects data according to the updated configuration parameters to obtain multimodal data. After obtaining the multimodal data, the sensor 110 will store it in the memory. Among them, the configuration information may include the sampling frequency of the acquisition end, the filter setting, and the impedance detection state.

[0052] It should be noted that, when the sensor stores multimodal data, when the sensor collects new multimodal data again, the new data will overwrite the original stored data to ensure that the latest multimodal data is always retained in the storage. In conjunction with the working mechanism of the high-speed data transmission processor 120, in each reading cycle of the high-speed data transmission processor 120, the high-speed data transmission processor 120 will obtain the updated multimodal data in the sensor in real time without being interfered by the previous data, thereby ensuring the timeliness and accuracy of the data.

[0053] Among them, sensor 110 can be an electroencephalogram sensor (EEG) of various derivatives (such as single-lead, 8-lead, 16-lead, 32 to 256-lead, etc.), a near-infrared spectroscopy sensor (fNIRS), and a multi-lead biosignal sensor (Hub) for monitoring physiological parameters. One or more of the same or different types of physiological signals are collected through the Hub, which can be selected according to actual needs, and the device has strong scalability. The Hub can collect a variety of multimodal data, such as skin electrodermal signals. Sensor 110 can be replaced through a pluggable design, allowing users to choose a suitable sensor according to their needs. Exemplarily, sensor 110 can record the updated configuration parameters into the flash memory of sensor 110 for storage.

[0054] In this embodiment, the high-speed data transmission processor 120 acts as an SPI host (SPIM) through the SPI communication protocol, and traverses the chip select lines periodically according to preset sampling parameters. During the traversal process, the high-speed data transmission processor 120 periodically sends signals of the chip select lines to activate the SPI slave (sensor 110) that matches the current chip select signal. During this process, only the sensor 110 that matches the signal of the chip select line of the current chip responds and becomes the target sensor. Then, in order to ensure the accuracy of the data, before reading the data of the target sensor, the high-speed data transmission processor 120 first determines whether valid multimodal data is stored in the memory of the target sensor. In the case where multimodal data is stored, the high-speed data transmission processor 120 reads the multimodal data collected by the target sensor through the data transmission signal line. The preset sampling parameters may include a sampling rate, a period parameter, and a traversal parameter. For example, at a predetermined sampling rate, the high-speed data transmission processor performs several chip select line traversals per second to ensure that the access frequency and timeliness of each sensor meet the design requirements.

[0055] It should be noted that the high-speed data transmission processor will read the data of a sensor only when the sensor is powered on and correctly connected to the system. If a certain sensor is not connected or not powered on, the high-speed data transmission processor will skip the chip select line during the process of traversing the signals of the chip select lines and will not perform data reading. In this way, the transmission and processing of invalid data are avoided, thereby ensuring the accuracy and efficiency of data acquisition.

[0056] Exemplarily, please refer to Figure 1b , the high-speed data transmission processor 120 acts as an SPI host (SPIM) through the SPI communication protocol, and multiple sensors 110 act as SPI slaves (SPIS, Serial Peripheral Interface Slave) through the SPI communication protocol. A chip select line is connected between each sensor 110 and the high-speed data transmission processor 120. An SPI bus is also connected between the high-speed data transmission processor 120 and the sensors. The multiple sensors 110 include an electroencephalogram sensor (EEG) connected through the chip select line CS1, an electroencephalogram sensor (EEG) connected through the chip select line CS2, an electroencephalogram sensor (EEG) connected through the chip select line CS3, an electroencephalogram sensor (EEG) connected through the chip select line CS4, a functional near-infrared spectroscopy sensor (fNIRS) connected through the chip select line CS5, a multi-channel biosignal sensor (Hub) connected through the chip select line CS6, and a multi-channel biosignal sensor (Hub) connected through the chip select line CS7.

[0057] In the above embodiments, the high-speed multimodal data acquisition system includes at least one sensor and a high-speed data transmission processor, which has high scalability and strong compatibility, and can be conveniently debugged and controlled without modifying the original sensor configuration. A chip select line is connected between each sensor and the high-speed data transmission processor, and at least one sensor and the high-speed data transmission processor are connected with data transmission signal lines for data interaction. Among them, each sensor is configured to collect multimodal data based on the configuration information transmitted by the high-speed data transmission processor through the chip select line when receiving the configuration information. The high-speed data transmission processor is configured to read the signal of the chip select line according to the preset sampling parameters, determine the target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data collected by the target sensor through the data transmission signal line, effectively reducing the impact brought by bandwidth limitation. Therefore, the reliability of the high-speed multimodal data acquisition system in a complex environment is improved through the above embodiments.

[0058] In some embodiments, referring to Figure 1a , the high-speed data transmission processor 120 is further configured to determine the data type of the read multimodal data in the following manner: the high-speed data transmission processor 120 determines the data type of the read multimodal data based on the identifier of the chip select line corresponding to the target sensor, where there is a corresponding relationship between the identifier of the chip select line and the data type.

[0059] In this embodiment, since the sensor 110 can be replaced through a pluggable design, the chip select lines are pre-configured in advance. Each chip select line is designed to access a specific signal type, such as electroencephalogram signals. Each chip select line has its own corresponding identifier, and in this way, a clear corresponding relationship between the identifier of the chip select line and different data types is achieved. This configuration is completed during the system initialization phase to ensure that the relationship between the identifier of the chip select line and the data type is fixed and predictable. Then, during the process of reading multimodal data, the high-speed data transmission processor 120 determines the identifier of the chip select line corresponding to the target sensor, and determines the data type of the read multimodal data according to the corresponding relationship between the identifier of the chip select line and the data type.

[0060] It should be noted that when the data type collected by the inserted sensor does not match the specific signal type specified by the pre-configured chip select line, the data acquisition operation cannot be performed.

[0061] Exemplarily, referring to Figure 1b , the chip select lines CS1 - CS4 can be pre-configured to access EEG signal types, the chip select line CS5 can be pre-configured to access fNIRS signal types, and the chip select lines CS6 - CS7 can be pre-configured to access physiological signals.

[0062] In the above embodiments, the high-speed data transmission processor determines the data type of the read multi-modal data based on the identifier of the chip select line corresponding to the target sensor, providing a basis for subsequent packetization.

[0063] In some embodiments, refer to Figure 1a , the high-speed data transmission processor 120 is further configured to determine the data type of the read multi-modal data in the following manner: the high-speed data transmission processor 120 reads the electrical signal of the target sensor based on the chip select line, and determines the data type of the read multi-modal data based on the electrical signal.

[0064] In this embodiment, since the sensor 110 can be replaced through a pluggable design, it is necessary to determine the data type collected by the current sensor 110 for subsequent data packetization. The high-speed data transmission processor 120 reads the electrical signal of the target sensor in a manner combined with the chip select line. For each chip select line, the electrical signal of the sensor is changed by connecting resistors with different resistance values in the circuit. In actual operation, after determining the chip select line of the target sensor, the high-speed data transmission processor 120 reads the electrical signal of the target sensor based on the chip select line, and looks up the obtained electrical signal of the target sensor in a pre-set relationship table of electrical signal - data type to determine the data type matching the electrical signal of the target sensor, thereby determining the data type of the read multi-modal data. Among them, the electrical signal can be voltage data.

[0065] In the above embodiments, the high-speed data transmission processor reads the electrical signal of the target sensor based on the chip select line, and determines the data type of the read multi-modal data based on the electrical signal, providing a basis for subsequent packetization.

[0066] In some embodiments, refer to Figure 1a , the high-speed data transmission processor 120 is further configured to perform normalization processing on multi-modal data of the same data type, and packetize the data obtained through the normalization processing to form a standardized multi-modal data packet.

[0067] In this embodiment, the high-speed data transmission processor 120 performs normalization processing and packetization of multi-modal data in its built-in processing module. Specifically, the multi-modal data received by the high-speed data transmission processor 120 from the sensor 110 may have problems such as different dimensions and inconsistent data ranges. Therefore, it is necessary to perform normalization processing (such as normalization processing) on multi-modal data of the same data type to effectively reduce the deviation between data and improve the accuracy and consistency of data. The high-speed data transmission processor 120 then further packs the data obtained through the normalization processing into a standardized multi-modal data packet for subsequent storage, analysis, and transmission.

[0068] Exemplarily, refer to Figure 2, the high-speed data transmission processor 120 includes a sensor packetizing module for normalizing multimodal data of the same data type and packetizing the data obtained through the normalization process.

[0069] In the above embodiment, the high-speed data transmission processor is further configured to normalize multimodal data of the same data type and packetize the data obtained through the normalization process to form a standardized multimodal data packet, thereby improving data consistency.

[0070] In some embodiments, please refer to Figure 3 , the high-speed multimodal data acquisition system 100 further includes a host computer 310. The host computer 310 is communicatively connected to the high-speed data transmission processor 120 and is configured to receive the standardized multimodal data packets transmitted by the high-speed data transmission processor 120.

[0071] In this embodiment, the high-speed data transmission processor 120 reads the multimodal data of the sensor 110 through a data transmission signal line, normalizes and packetizes the multimodal data. Then, the host computer 310 and the high-speed data transmission processor 120 establish a high-speed data communication link through a high-speed USB interface (for example, a USB 2.0 interface with a transmission rate of 480M / bit / s or a USB interface with a higher transmission rate), thereby realizing the communication connection between the host computer 310 and the high-speed data transmission processor 120. Specifically, the high-speed data transmission processor 120 acts as a USB slave device and transmits the standardized multimodal data packets to the host computer 310 through the USB interface according to the USB communication protocol. The host computer 310 acts as a USB master device and receives the standardized multimodal data packets from the high-speed data transmission processor 120 through the USB port.

[0072] In some embodiments, after receiving the standardized multimodal data packets, the host computer 310 performs data parsing and processing on the standardized multimodal data packets, such as data cleaning and statistical analysis. The host computer 310 can display the analysis results on the interface of the host computer 310, such as through a graphical interface, including charts (such as line charts, bar charts, pie charts).

[0073] It should be noted that the host computer 310 can be a PC, or various types of devices such as a smart phone, an industrial control computer, a server, etc. Software can be installed on the host computer 310 to perform operations such as data display, analysis, and processing.

[0074] In the above embodiment, the host computer is communicatively connected to the high-speed data transmission processor, and the host computer is configured to receive the standardized multimodal data packets transmitted by the high-speed data transmission processor, effectively reducing the impact brought by bandwidth limitations.

[0075] In some embodiments, the configuration information transmitted by the high-speed data transmission processor 120 via the chip select line includes the sampling frequency of the sensor, and the sampling frequency is less than or equal to the maximum transmission rate of the SPI communication protocol.

[0076] In this embodiment, the high-speed data transmission processor 120 is connected to multiple sensors via the SPI communication protocol, uses the chip select line (CS line) to select a specific sensor to communicate with, and transmits configuration information via the chip select line. The configuration information transmitted by the high-speed data transmission processor 120 via the chip select line includes the sampling frequency of the sensor. To ensure the stability and reliability of multimodal data transmission, the sampling frequency cannot exceed the maximum transmission rate of the SPI communication protocol. If the sampling frequency is too high and exceeds the maximum transmission rate of the SPI communication protocol, it will cause data loss or transmission delay, thereby affecting the real-time performance and performance of the entire system. Exemplarily, the sampling frequency is usually set to 256 Hz or 512 Hz.

[0077] In the above embodiment, the configuration information transmitted by the high-speed data transmission processor via the chip select line includes the sampling frequency of the sensor, and the sampling frequency is less than or equal to the maximum transmission rate of the SPI communication protocol, ensuring the stability and reliability of data transmission and helping to optimize bandwidth utilization.

[0078] In some embodiments, the first data acquisition rate at which the high-speed data transmission processor reads the multimodal data collected by the target sensor via the data transmission signal line is greater than a preset rate threshold and / or greater than a second data acquisition rate.

[0079] Wherein, the second data acquisition rate includes the rate at which the target sensor directly sends the collected multimodal data to the host computer.

[0080] In this embodiment, the high-speed data transmission processor reads the multimodal data collected by the target sensor via the data transmission signal line and transmits the data at the first data acquisition rate. The preset rate threshold is usually set according to actual application requirements, and the purpose is to ensure that the data processing speed can meet the real-time requirements. Since the first data acquisition rate is usually set under the requirements of high-speed transmission processing, in order to avoid data loss or transmission delay, the first data acquisition rate is required to be higher than the preset rate threshold to ensure sufficient bandwidth and processing capacity.

[0081] The second data acquisition rate is the transmission rate at which the target sensor directly sends the collected multimodal data to the host computer. This rate is limited by the interface bandwidth between the target sensor and the host computer, the efficiency of the transmission protocol, and the conditions of the network environment. Therefore, since the first data acquisition rate is usually set under the requirements of high-speed transmission processing, its rate will be greater than the second data acquisition rate.

[0082] It should be noted that the first data acquisition rate at which the high-speed data transmission processor reads the multimodal data collected by the target sensor is greater than the data acquisition rate of the full-speed USB single-chip microcomputer.

[0083] In the above embodiment, the first data acquisition rate at which the high-speed data transmission processor reads the multimodal data collected by the target sensor through the data transmission signal line is greater than the preset rate threshold and / or greater than the second data acquisition rate, reducing the impact brought by bandwidth limitation and improving data transmission efficiency.

[0084] In the embodiments of this specification, a high-speed multimodal multi-data acquisition method is provided. Please refer to Figure 4 , the high-speed multimodal data acquisition method is applied to a high-speed data transmission processor and may include the following steps:

[0085] S410. Transmit configuration information to the corresponding sensor through the chip select line.

[0086] S420. Read the signal of the chip select line according to the preset sampling parameters, determine the target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data collected by the target sensor through the data transmission signal line.

[0087] Specifically, the high-speed data transmission processor uses the SPI communication protocol as the SPI master (SPIM) and traverses the chip select line periodically according to the preset sampling parameters. During the traversal process, the high-speed data transmission processor will periodically send the signal of the chip select line to activate the SPI slave (sensor) that matches the current chip select signal. In this process, only the sensor that matches the signal of the chip select line of the current chip responds and becomes the target sensor. Then, to ensure the accuracy of the data, before reading the data of the target sensor, the high-speed data transmission processor will first determine whether there is valid multimodal data stored in the memory of the target sensor. In the case where there is multimodal data stored, the high-speed data transmission processor reads the multimodal data collected by the target sensor through the data transmission signal line. Among them, the preset sampling parameters may include the sampling rate, cycle parameters, and traversal parameters. For example, at a predetermined sampling rate, the high-speed data transmission processor performs several chip select line traversals per second to ensure that the access frequency and timeliness of each sensor meet the design requirements.

[0088] In the above embodiment, by transmitting configuration information to the corresponding sensor through the chip select line, reading the signal of the chip select line according to the preset sampling parameters, determining the target sensor from at least one sensor based on the signal of the chip select line, and reading the multimodal data collected by the target sensor through the data transmission signal line, the impact brought by bandwidth limitation is effectively reduced.

[0089] In the embodiments of this specification, a high-speed multimodal data acquisition method is provided. Please refer to Figure 5, the high-speed multimodal data acquisition method applied to sensors may include the following steps:

[0090] S510. Receive the configuration information transmitted by the high-speed data transmission processor through the chip select line.

[0091] S520. Acquire multimodal data based on the configuration information.

[0092] Specifically, after any sensor is powered on, the high-speed data transmission processor acts as an SPI host and transmits the configuration information corresponding to the sensor to the sensor through the chip select line. When the sensor receives the configuration information, it updates the configuration parameters and acquires data according to the updated configuration parameters to obtain multimodal data. After obtaining the multimodal data, the sensor stores it in the memory. Among them, the configuration information may include the sampling frequency of the acquisition end, the filtering setting, and the impedance detection state.

[0093] In the above implementation manner, receiving the configuration information transmitted by the high-speed data transmission processor through the chip select line and acquiring multimodal data based on the configuration information can flexibly configure the configuration information of the sensor to adapt to different application scenarios or sensor types.

[0094] An embodiment of this specification provides a high-speed multimodal data acquisition device 600. Please refer to Figure 6 , the device is applied to a high-speed data transmission processor. The high-speed multimodal data acquisition device 600 includes: a configuration information transmission module 610 and a multimodal data reading module 620.

[0095] The configuration information transmission module 610 is used to transmit configuration information to the corresponding sensor through the chip select line;

[0096] The multimodal data reading module 620 is used to read the signal of the chip select line according to the preset sampling parameters, determine the target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data acquired by the target sensor through the data transmission signal line.

[0097] An embodiment of this specification provides a high-speed multimodal data acquisition device 700. Please refer to Figure 7 , the device is applied to sensors. The high-speed multimodal data acquisition device 700 includes: a configuration information receiving module 710 and a multimodal data acquisition module 720.

[0098] The configuration information receiving module 710 is used to receive the configuration information transmitted by the high-speed data transmission processor through the chip select line;

[0099] The multimodal data acquisition module 720 is used to acquire multimodal data based on the configuration information.

[0100] For a detailed description of the high-speed multimodal data acquisition device, reference may be made to the description of the high-speed multimodal data acquisition method and system in the foregoing text, which will not be elaborated herein.

[0101] In the embodiments of this specification, an edge computing device is provided, and its internal structure schematic diagram may be as Figure 8 shown. The edge computing device includes a processor, a memory, and a communication interface connected through a system bus. Among them, the processor of the edge computing device is used to provide computing and control capabilities. The memory of the edge computing device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores a computer program. The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. The communication interface of the edge computing device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, carrier network, NFC (Near Field Communication) or other technologies. When the computer program is executed by the processor, it implements a high-speed multimodal data acquisition method.

[0102] Those skilled in the art can understand that Figure 8 the structure shown in

[0103] is only a block diagram of some structures related to the solution disclosed in this specification, and does not constitute a limitation on the edge computing device to which the solution disclosed in this specification is applied. Specifically, the edge computing device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0104] The embodiments of this specification provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the steps of the method in any of the above embodiments.

[0105] Note that the logic and / or steps represented in the flowchart or described otherwise herein, for example, can be considered as a definite sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch instructions from the instruction execution system, apparatus, or device and execute the instructions), or used in combination with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of the computer-readable medium include the following: an electrical connection part having one or more wirings (electronic device), a portable computer diskette case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or otherwise processing as appropriate, and then stored in a computer memory.

[0106] It should be understood that various parts of this specification can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

[0107] In the description of this specification, the description with reference to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of this specification. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.

[0108] In the description of this specification, it should be understood that the orientation or positional relationships indicated by the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. are based on the orientation or positional relationships shown in the drawings. These are only for the convenience of describing this specification and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation to this specification.

[0109] In addition, the terms "first", "second", etc. used in the embodiments of this specification are only for descriptive purposes and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features indicated in this embodiment. Thus, the features defined with the terms "first", "second", etc. in the embodiments of this specification may explicitly or implicitly indicate that at least one such feature is included in this embodiment. In the description of this specification, the meaning of the word "plural" is at least two or more, such as two, three, four, etc., unless otherwise explicitly and specifically defined in the embodiments.

[0110] In this specification, unless otherwise explicitly specified or limited in the embodiments, the terms "mounted", "connected", "connected to", and "fixed" and the like used in the embodiments should be understood in a broad sense. For example, the connection can be a fixed connection, a detachable connection, or integrated. It can be understood that it can also be a mechanical connection, an electrical connection, etc.; of course, it can also be directly connected, or indirectly connected through an intermediate medium, or it can be the communication inside two elements, or the interaction relationship between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this specification can be understood according to the specific implementation situations.

[0111] In this specification, unless otherwise explicitly specified and limited, the first feature being "on" or "under" the second feature can be that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, the first feature being "above", "over" and "on top of" the second feature can be that the first feature is directly above or obliquely above the second feature, or merely indicates that the first feature has a higher horizontal height than the second feature. The first feature being "under", "beneath" and "underneath" the second feature can be that the first feature is directly below or obliquely below the second feature, or merely indicates that the first feature has a lower horizontal height than the second feature.

[0112] Although the embodiments of the present specification have been shown and described above, it is to be understood that the above embodiments are exemplary and should not be construed as limiting the present specification. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present specification.

Claims

1. A high-speed multimodal data acquisition system, characterized in that: The system comprises at least one sensor and a high-speed data transmission processor, a chip select line is connected between each of the sensors and the high-speed data transmission processor, and a data transmission signal line is connected between the at least one sensor and the high-speed data transmission processor, wherein: Each of the sensors is configured to collect multimodal data based on the configuration information when receiving the configuration information, wherein the configuration information is transmitted by the high-speed data transmission processor through the chip select line; The high-speed data transmission processor is configured to read the signal of the chip select line according to preset sampling parameters, determine the target sensor from the at least one sensor based on the signal of the chip select line, and read the multimodal data collected by the target sensor through the data transmission signal line.

2. The system according to claim 1, characterized in that The high-speed data transmission processor is further configured to determine the data type of the read multimodal data in the following manner: The high-speed data transmission processor determines the data type of the read multimodal data based on the identifier of the chip select line corresponding to the target sensor, wherein the identifier of the chip select line has a corresponding relationship with the data type; or The high-speed data transmission processor reads the electrical signal of the target sensor based on the chip select line, and determines a data type of the read multimodal data based on the electrical signal.

3. The system according to claim 1, characterized in that The high-speed data transmission processor is also used to normalize multimodal data of the same data type, and to package the normalized data to form a standardized multimodal data packet.

4. The system according to claim 3, characterized in that The system further comprises: A host computer is communicatively connected to the high-speed data transmission processor, and is configured to receive the standardized multimodal data packet transmitted by the high-speed data transmission processor.

5. The system according to any one of claims 1 to 4, characterized in that: The configuration information transmitted by the high-speed data transmission processor through the chip select line includes a sampling frequency of the sensor, and the sampling frequency is less than or equal to a maximum transmission rate of the SPI communication protocol.

6. The system according to any one of claims 1 to 4, characterized in that: The first data acquisition rate at which the high-speed data transmission processor reads the multimodal data collected by the target sensor through the data transmission signal line is greater than a preset rate threshold and / or greater than a second data acquisition rate, wherein the second data acquisition rate includes the rate at which the target sensor sends the collected multimodal data directly to the host computer.

7. A high-speed multimodal data acquisition method, characterized in that: The method comprises: Transmit configuration information to the corresponding sensor via chip select lines; Read the signal of the chip select line according to preset sampling parameters, determine the target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data collected by the target sensor through the data transmission signal line; or The method comprises: Receive configuration information transmitted by the high-speed data transmission processor through the chip select line; Multimodal data is collected based on the configuration information.

8. A high-speed multi-modal data acquisition device, characterized in that: The device comprises: A configuration information transmission module, used to transmit configuration information to the corresponding sensor through a chip select line; A multimodal data reading module, configured to read the signal of the chip select line according to preset sampling parameters, determine a target sensor from at least one sensor based on the signal of the chip select line, and read the multimodal data collected by the target sensor through a data transmission signal line; Alternatively, the device comprises: A configuration information receiving module, used for receiving configuration information transmitted by a high-speed data transmission processor via a chip select line; The multimodal data acquisition module is used to acquire multimodal data based on the configuration information.

9. An edge computing device, characterized in that: The edge computing device comprises a processor and a memory, wherein the processor is used to execute a computer program in the memory, and the computer program is capable of executing the method according to claim 7; And / or, the edge computing device includes the high-speed multimodal data acquisition device as described in claim 8.

10. A computer-readable storage medium, characterized in that: Used to store a computer program capable of executing the method according to claim 7.

Images