Man-machine environment data synchronization edge computing device

Abstract

According to the man-machine environment data synchronization edge computing device provided by the embodiment of the invention, a mainboard is separably coupled with at least one event marking board card and at least two acquisition board cards, event marking information is obtained from the event marking board card, at least two kinds of man-machine environment data are obtained from the at least two acquisition board cards, and the man-machine environment data synchronization edge computing device is obtained. According to the man-machine environment data synchronization edge computing device and the man-machine environment data synchronization method, the man-machine environment data synchronization target is achieved, the mainboard and the board card are separably coupled, the man-machine environment data synchronization edge computing device can be connected with more different collection board cards according to requirements, more man-machine environment data are synchronized, and the man-machine environment data synchronization efficiency is improved. And therefore, more man-machine environment data synchronization requirements can be met.

Description

Technical Field

[0001] The present application relates to human factors engineering and ergonomics technology, and in particular to an edge computing device for synchronizing human-machine environment data. Background Art

[0002] Human factors engineering and ergonomics mainly study the relationship between humans, machines, and the environment, and are widely used in health care, sports rehabilitation, intelligent driving and other scenarios. When studying the relationship between humans, machines, and the environment, human factors engineering needs to collect data related to humans, machines, and the environment (i.e., human-machine-environment data) to conduct relevant tests and analyses such as human factors or ergonomics. However, how to synchronously collect different types of relevant data and human-machine-environment data during the test is a technical problem that needs to be solved urgently. Summary of the invention

[0003] An embodiment of the present application provides a human-machine environment data synchronization edge computing device for synchronizing different types of human-machine environment data collected during testing.

[0004] In a first aspect, an embodiment of the present application provides an edge computing device for synchronizing human-machine environment data, comprising a mainboard, at least one event marking board and at least two acquisition boards; the mainboard is detachably coupled to the at least one event marking board and the at least two acquisition boards; the at least one event marking board is used to send event marking information to the mainboard, and the at least two acquisition boards are used to send collected human-machine environment data to the mainboard; the mainboard comprises a power supply circuit, a control module and a first interface; the power supply circuit is used to power the mainboard, the at least one event marking board and the at least one acquisition board; the control module is used to process the event marking information into a form transmittable by the first interface; the first interface is used to couple to a host computer and send event marking information and human-machine environment data to the host computer; the at least one event marking board comprises any one or more of a transistor-transistor logic (TTL) event marking board, an API event marking board, a sound event marking board and a light event marking board; the at least two acquisition boards comprise any two or more of an audio and video acquisition board, an environmental data acquisition board, a BIO data acquisition board, an EXG acquisition board and an EEG acquisition board.

[0005] In a possible implementation, the event marking information includes the first event marking information, and the first interface is also used to receive the first instruction sent by the host computer; the TTL event marking board includes: an input interface, a first switch circuit and a first level conversion circuit; the input interface is used to connect the first external device and receive the first event marking information sent by the first external device; the input end of the first switch circuit is coupled to the input interface, the control end of the first switch circuit is detachably coupled to the control module, the output end of the first switch circuit is coupled to the input end of the first level conversion circuit, and the output end of the first level conversion circuit is detachably coupled to the control module; the control module is used to control the first switch circuit to be turned on or off according to the first instruction, the input end of the first level conversion circuit is low level when the first switch circuit is turned off, and when the first switch circuit is turned on, it is used to send the first event marking information to the first level conversion circuit, and the first level conversion circuit is used to convert the first event marking information from the first level to the second level and then send it to the control module. Exemplarily, in the initial state, the first switch circuit is turned off, and the input end of the first level conversion circuit is low level.

[0006] In a possible implementation, the first interface is also used to receive a second instruction sent by the host computer; the TTL event marking board also includes a second level conversion circuit and a first selection circuit; the second level conversion circuit is used to convert the third level to a fourth level; the first switch circuit is coupled to the input end of the first level conversion circuit and the second circuit conversion circuit through the first selection circuit, and the output end of the second level conversion circuit is detachably coupled to the control module; the first selection circuit is detachably coupled to the control module; the control module is used to control the first selection circuit to select the first level conversion circuit or the second level conversion circuit to be connected to the input interface according to the second instruction. Exemplarily, the third level may be the same as the first level or the second level, or the fourth level may be the same as the first level or the second level.

[0007] In a possible implementation, the above-mentioned TTL event marking board also includes: a first signal conversion circuit; the input end of the first signal conversion circuit is coupled to the first level conversion circuit, and the output end of the first signal conversion circuit is detachably coupled to the control module, and is used to convert the first event marking information from a parallel signal to a serial signal and then send it to the control module.

[0008] In a possible implementation, the above-mentioned TTL event marking board also includes: a first signal conversion circuit; the input end of the first signal conversion circuit is coupled to the first level conversion circuit and the second level conversion circuit, and the output end of the first signal conversion circuit is detachably coupled to the control module, and is used to convert the first event marking information from a parallel signal to a serial signal and then send it to the control module.

[0009] In a possible implementation, the first interface is also used to receive the second event mark information and the third instruction sent by the host computer, and the TTL event mark board also includes: an output interface, a second switch circuit and a third level conversion circuit; the output interface is used to connect the second external device and / or the first external device, and send the second event mark information to the second external device and / or the first external device; the third level conversion circuit is used to convert the second event mark information from the fifth level to the sixth level; the input end of the third level conversion circuit is detachably coupled to the control module, the output end of the third level conversion circuit is coupled to the output interface through the second switch circuit, and the control end of the second switch circuit is detachably coupled to the control module; the control module is also used to control the second switch circuit to be turned on or off according to the third instruction, and send the second event mark information to the third level conversion circuit; the output end of the third level conversion circuit sends the second event mark information to the output interface when the second switch circuit is disconnected, and is a low level when the second switch circuit is disconnected; the output interface is also used to send the second event mark information to the second external device when the second switch circuit is turned on. Exemplarily, the fifth level may be the same as the third level or the fourth level, or the sixth level may be the same as the third level or the fourth level.

[0010] In a possible implementation, the first interface is also used to receive a fourth instruction sent by the host computer, and the TTL event marking board also includes: a fourth level conversion circuit and a second selection circuit; the input ends of the fourth level conversion circuit and the third level conversion circuit are detachably coupled to the control module, the output ends of the fourth level conversion circuit and the third level conversion circuit are coupled to the input end of the second selection circuit, the output end of the second selection circuit is coupled to the third interface through the second switch circuit, and the control end of the second selection circuit is detachably coupled to the control module; the fourth level conversion circuit is used to convert the second event marking information from the seventh level to the eighth level; the control module is used to control the second selection circuit according to the fourth instruction, and select the third level conversion circuit or the fourth level conversion circuit to be connected to the input end of the second switch circuit. Exemplarily, the seventh level may be the same as the fifth level or the sixth level, or the eighth level may be the same as the fifth level or the sixth level.

[0011] In one possible implementation, the above-mentioned TTL event marking board also includes: a second signal conversion circuit; the input end of the second signal conversion circuit is detachably coupled to the control module, and the output end of the second signal conversion circuit is coupled to a third level conversion circuit, which is used to convert the second event marking information from a serial signal to a parallel signal and then send it to the third level conversion circuit.

[0012] In a possible implementation, the above-mentioned TTL event marking board also includes: a second signal conversion circuit; the input end of the second signal conversion circuit is detachably coupled to the control module, and the output end of the second signal conversion circuit is coupled to the third level conversion circuit and the fourth level conversion circuit, and is used to convert the second event marking information from a serial signal to a parallel signal and then send it to the third level conversion circuit and the fourth level conversion circuit.

[0013] In a possible implementation, the first interface is further used to receive a fifth instruction from the host computer, and the control module is further used to set a threshold for the sound event marking board and / or the light event marking board according to the fifth instruction.

[0014] In a possible implementation, the main board further includes a switch circuit, and the switch circuit is connected between the power supply circuit and the control module, at least one event marking board and at least one acquisition board.

[0015] In a possible implementation, the mainboard further includes at least two indicator lights, and the at least two indicator lights are correspondingly arranged on a line for the power supply circuit to supply power to at least one event marking board and at least one acquisition board.

[0016] The human-machine environment data synchronization edge computing device provided in the embodiment of the present application is detachably coupled to at least one event marking board and at least two acquisition boards through a mainboard, obtains event marking information from the event marking board, obtains at least two types of human-machine environment data from at least two acquisition boards, and sends them to a host computer through a first interface, thereby achieving the goal of synchronizing different human-machine environment data. In addition, the mainboard and the board are detachably coupled, so that the human-machine environment data synchronization edge computing device can connect to more different acquisition boards as needed, further synchronize more human-machine environment data, thereby meeting more human-machine environment data synchronization needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 An example of an edge computing device for synchronizing human-machine environment data provided in an embodiment of the present application;

[0019] Figure 2a An embodiment of an environment data acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0020] Figure 2bAnother embodiment of the environment data acquisition board in the human-machine environment data synchronization edge computing device provided in the embodiment of the present application;

[0021] Figure 3a An embodiment of a biological type data acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0022] Figure 3b Another embodiment of a biological type data acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0023] Figure 3c Another embodiment of a biological type data acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0024] Figure 4a An embodiment of a bioelectric data acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0025] Figure 4b Another embodiment of a bioelectric data acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0026] Figure 5a An embodiment of a TTL input event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0027] Figure 5b Another embodiment of a TTL input event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0028] Figure 5c Another embodiment of a TTL input event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0029] Figure 5d Another embodiment of a TTL input event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0030] Figure 5e Another embodiment of a TTL input event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0031] Figure 5f Another embodiment of a TTL event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0032] Figure 6An embodiment of a sound event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0033] Figure 7 An embodiment of an optical event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0034] Figure 8 An embodiment of an API event marking board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0035] Figure 9a An embodiment of a second acquisition board in a human-machine environment data synchronization edge computing device provided in an embodiment of the present application;

[0036] Figure 9b Another embodiment of the second acquisition board in the human-machine environment data synchronization edge computing device provided in the embodiment of the present application;

[0037] Fig.10a A schematic diagram of the internal structure of another edge computing device for synchronizing human-machine environment data provided by an embodiment of the present application;

[0038] Fig.10b A schematic diagram of a front panel in another edge computing device for synchronizing human-machine environment data provided by an embodiment of the present application;

[0039] Fig.10c A schematic diagram of a backplane in another human-machine environment data synchronization edge computing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.

[0041] The human-machine environment data synchronization edge computing device provided in the embodiment of the present application may include a mainboard and an event marking board, and may also include a first acquisition board and / or a second acquisition board, wherein the first acquisition board and / or the second acquisition board are used to collect human-machine environment data. The event marking board, the first acquisition board and / or the second acquisition board may be detachably coupled to the mainboard.

[0042] Exemplarily, the human-machine environment data may include environment-related data and / or human-related data. The environment-related data may include any one or more of position data, humidity data, temperature data, chromaticity data, brightness data, noise data, weather data (such as air pressure, etc.), road condition data, traffic data, stimulus signal data, and event or signal event marker data. Human body related data may include skin electricity data, skin temperature (SKT) data, pulse data (such as photoplethysmography (PPG)), blood pressure (BP) data, blood oxygen data (such as periphery capillary oxygen saturation (SPO2)), electrocardiogram data, electromyography data (such as electrodermal activity (EDA)), muscle oxygen data, respiratory data (such as respiratory rate (RESP)), biomechanical data (such as single point force-sensitive resistor (FSR) value), near-infrared brain imaging data, electroencephalogram data, transcranial stimulation data, heart rate variability data, heart rate data and behavioral data.

[0043] An example of an edge computing device for synchronizing human-machine environment data provided in an embodiment of the present application is as follows: Figure 1 As shown, it includes: a mainboard 10, a first acquisition board 20 and an event marking board 30, and the mainboard 10 is detachably coupled to the first acquisition board 20 and the event marking board 30.

[0044] The mainboard 10 includes a power circuit 11 , a control module 12 and a first interface 13 .

[0045] Power supply circuit 11, control module 12, first interface 13, first acquisition board 20 and event marking board 30. The power supply circuit 11 is used to supply power to the control module 12, the first interface 13, the first acquisition board 20 and the event marking board 30. Exemplarily, the first interface 13 can be a wired interface or a wireless interface. The first interface 13 can be used to connect to a host computer (such as a computer, a mobile phone, a server, an industrial computer, etc.) and receive instructions sent by the host computer. The first acquisition board 20 can be used to collect human-machine environment data. The control module 12 can be used to control the event marking board 30 to transmit event marking information according to the instructions, and can also be used to receive the event marking information of the event marking board 30, and convert the event marking information into a signal that can be transmitted by the first interface 13. For example, the control module 12 can encapsulate the packet header of the communication protocol used by the first interface 13 for the event marking information. The first interface 13 can also be used to transmit the human-machine environment data and the event marking information to the host computer. Exemplarily, the functions of the control module 12 can be implemented by a field programmable gate array (FPGA), a microcontroller unit (MCU), a central processing unit (CPU), etc.

[0046] Exemplarily, the event marker information may refer to information about an event that causes a change in human functions by stimulating human vision, hearing, vibration (touch), smell, taste, etc. For example, such an event may be that sound exceeds a sound threshold, stimulating human hearing, thereby causing a change in human functions; it may also be that light exceeds a light threshold, stimulating human vision, thereby causing a change in human functions; or it may be that temperature exceeds a temperature threshold, stimulating the human body, causing a change in human functions, etc. Exemplarily, the event marker information may also be information generated by a certain behavior triggering the generation of corresponding information, etc.

[0047] The first acquisition board 20 is detachably coupled to the first interface 13. Exemplarily, the first acquisition board 20 can be detachably coupled to the first interface 13 via a Universal Serial Bus (USB) interface. Exemplarily, the USB interface can be a Type-A USB interface, a Type-B USB interface, a Type-C USB interface, etc.

[0048] Exemplarily, there may be one or more first acquisition boards 20. For example, the first acquisition board 20 may be any one of an environmental data acquisition board, a biological data acquisition board, and a bioelectric data acquisition board. When there are multiple first acquisition boards 20, they may be any multiple modules of an environmental data acquisition board, a biological data acquisition board, and a bioelectric data acquisition board.

[0049] The environmental data acquisition board can be used to collect environmental related data. An embodiment of the environmental data acquisition board is as follows Figure 2a The environmental data acquisition board 21 shown. Figure 2a As shown, the environmental data acquisition board 21 may include an output interface 211, a processing unit 212 and an environmental sensor 213. Among them, there may be one or more environmental sensors 213, for example, one or more sensors among temperature sensors, humidity sensors, brightness sensors, chromaticity sensors, noise sensors and air pressure sensors, etc., used to detect one or more data among temperature data, humidity data, brightness data, chromaticity data, noise data and air pressure data at the location of the human-machine environment data synchronization edge computing device. The processing unit 212 is coupled to the output interface 211 and the environmental sensor 213, and is used to process the data detected by the environmental sensor 213 into a signal that can be transmitted by the output interface 211. The signal can carry the data detected by the environmental sensor 213. The output interface 211 is detachably coupled to the first interface, and can be used to transmit the environment-related data collected by the environmental sensor 213 to the first interface, and transmit it to the host computer through the first interface.

[0050] Another embodiment of the environmental data acquisition board is Figure 2b The environmental data acquisition board 22 shown. Figure 2b As shown, the difference between the environmental data acquisition board 22 and the environmental data acquisition board 21 is that it can further include an input interface 221, which is connected to the processing unit 212 and can be used to receive the environment-related data collected by the external environment sensor and transmit it to the processing unit 212 for processing. The processing unit 212 converts the data received by the input interface 221 into a signal that can be transmitted by the output interface. The signal carries the data received by the input interface. The output interface 211 can also be used to transmit the environment-related data collected by the external environment sensor to the first interface, and transmit it to the host computer through the first interface.

[0051] In some embodiments, when the input interface receives an analog signal, the environmental data acquisition board may further include an analog signal processing circuit coupled between the input interface 221 and the processing unit 212 for amplifying, filtering, sampling and other processing of the analog signal received by the input interface 221.

[0052] In some embodiments, the input interface in the environmental data acquisition board may be an aviation plug.

[0053] The biological data acquisition board is used to collect biosensor (Biosensors, BIO) data, such as PPG, EDA, SPO2, SKT, RESP, BP, FSR and other biological data.

[0054] An embodiment of a biological data acquisition board is Figure 3a The BIO data acquisition board 23 shown. Figure 3a As shown, the BIO data acquisition board 23 may include an output interface 231 , a processing unit 232 , an ADC 233 , a multiplexer (MUX) 234 and a plurality of input interfaces 235 .

[0055] The output interface 231 may be a USB port, etc. One end of the output interface 231 is detachably coupled to the first interface, and the other end is coupled to the processing unit 232. The processing unit 232 is also coupled to the input interface 34 through the ADC 233 and the MUX 234.

[0056] Each input interface 235 receives one channel of BIO data, and performs amplification and filtering on the signal carrying the BIO data.

[0057] The MUX 234 selects one BIO data channel to pass through under the control of the processing unit 232. The ADC 233 performs analog-to-digital conversion on the carrier signal of the BIO data passing through the MUX 234.

[0058] The processing unit 232 processes the BIO data into a signal transmittable by the output interface 231. The output interface 231 transmits the BIO data to the first interface.

[0059] In some embodiments, the biological type data acquisition board can omit the ADC and use a processing unit with analog-to-digital conversion function.

[0060] In some embodiments, the biological data acquisition board can also omit the MUX and use a processing unit with more pins to simultaneously receive multiple channels of BIO data.

[0061] In some embodiments, the biological data acquisition board may further include an isolation circuit to further improve signal quality.

[0062] Another embodiment of the biological type data acquisition board is Figure 3b The BIO data acquisition board 24 shown. Figure 3b As shown, the difference between the BIO data acquisition board 24 and the previous embodiment is that it further includes an isolation circuit 241. The isolation circuit 241 is coupled between the output interface 231 and the processing unit 232 to prevent the circuit connected to the output interface 231 from affecting the signal quality in the BIO data acquisition board 24.

[0063] In some embodiments, the biological data acquisition board may further include a storage circuit having a storage function. Another embodiment of the biological data acquisition board is Figure 3c The BIO data acquisition board 25 shown. Figure 3cAs shown, the difference from the above embodiment is that the BIO data acquisition board 25 is transmitted to the first interface through the USB port 251, and also includes a memory 252, a MUX 253, a USB conversion circuit 254 and a USB_MUX 255.

[0064] The USB port 251 is coupled to the processing unit 232 and the USB conversion circuit 254 via the USB_MUX 255. When the host computer obtains real-time BIO data, the USB_MUX 255 switches to the processing unit 232, connecting the USB port 251 and the processing unit 232. The processing unit 232 transmits the real-time collected BIO data to the host computer via the USB port 251.

[0065] The memory 252 is coupled to the processing unit 232 and the USB conversion circuit 254 through the MUX 253. In the offline storage state, the MUX 253 switches to the processing unit 232, connects the processing unit 232 and the memory 252, and the processing unit 232 stores the received BIO data in the memory 252. In the USB disk mode, the BIO data acquisition board 25 can be used as a USB disk of the host computer and coupled to the host computer through the USB port 251. In this mode, the USB_MUX 255 and the MUX 253 are both switched to the USB conversion circuit 254, connected to the memory 252, and the host computer reads the offline stored BIO data from the memory 252.

[0066] In some embodiments, each input interface 235 further includes a detection circuit coupled to the processing unit 232 , and when the input interface 235 is coupled to the BIO, the processing unit 232 can know through the detection circuit.

[0067] Exemplarily, the input interface 235 may be a Type C USB interface. In some embodiments, the processing unit in the biological data acquisition board may know whether the lead wire connected to the BIO is inserted and the signal type of the inserted lead wire through the detection circuit in the input interface 235.

[0068] Bioelectric data acquisition boards can be used to collect electromyography sensor (EMG) data, electrocardiogram sensor (ECG) data, and electroencephalogram sensor (EEG) data, etc. For ease of description, EMG data, ECG data, and EEG data are collectively referred to as EXG data.

[0069] An embodiment of a bioelectric type data acquisition board is Figure 4a The EXG data acquisition board 26 shown. Figure 4aAs shown, the EXG data acquisition board 26 includes an output interface 261, a processing unit 262, an ADC 263, a multiplexer circuit (MUX) 264, an analog signal processing circuit 265, four input interfaces 2661 and two input interfaces 2662 serving as common or reference signals.

[0070] The processing unit 262 is coupled to the output interface 261 and the output end of the ADC 263. The output interface 261 is used to couple with the first interface. The input end of the ADC 263 is coupled with the output end of the MUX 44, the input end of the MUX 44 is coupled with the output end of the analog signal processing circuit 265, and the input end of the analog signal processing circuit 265 is coupled with four input interfaces 2661 and two input interfaces 2662.

[0071] Among them, 4 input interfaces 2661 and 2 input interfaces 2662 can receive 4 EXG data signals. Among them, 1 EXG data signal needs to be represented by the left arm (Left Arm, LA) electrode signal, the right arm (Right Arm, RA) electrode signal and the right leg (Right Leg, RL) electrode signal, among which the RA electrode signal and the RL electrode signal are common or reference end signals, and 4 EXG data signals need 4 LA electrode signals, 1 RA electrode signal and 1 RL electrode signal, a total of 6 electrode signals. The 4 input interfaces 2661 are used to receive 4 LA electrode signals, and the 2 input interfaces 2662 are used to receive RA electrode signals and RL electrode signals respectively.

[0072] The analog signal processing circuit 265 amplifies and filters the EXG data signal received by the input interface. The MUX selects one of the four data signals to be connected to the ADC 263. The ADC 263 performs analog-to-digital conversion on the signal. The processing unit 262 converts the EXG data into a signal that can be transmitted by the output interface 261. The output interface 261 transmits the EXG data to the first interface.

[0073] In some embodiments, the number of input interfaces 2661 may be less than four, such as one, two or three.

[0074] In some embodiments, input interface 2661 and input interface 2662 may be headphone interfaces.

[0075] In some embodiments, the bioelectric data acquisition board may further include a storage circuit having the function of storing EXG data. Figure 3c The storage circuit shown is similar.

[0076] In some embodiments, multiple ADCs connected in a daisy chain manner may be used in biological type data acquisition boards and bioelectric type data acquisition boards to replace the ADC and the MUX that outputs signals to the ADC in the above embodiments to avoid signal crosstalk caused by MUX leakage current.

[0077] Take the bioelectric data acquisition board as an example. Figure 4b As shown, in the EXG data acquisition board 27, three ADCs are connected in a daisy chain manner, and three input interfaces 2661 and two input interfaces 2662 as common ends receive three EXG analog signals, and output three signals after being processed by the analog signal processing circuit 265, which are respectively transmitted to one of the ADCs. The MCU 271 is coupled to the three ADCs 272, and the ADCs 272 are controlled through the serial peripheral interface (SPI) communication protocol. For example, the pins SS1, SS2, and SS3 on the MCU 271 are used to select one of the three ADCs 272, so as to select one EXG data signal from the three EXG data signals accordingly. The pin SCK of the MCU 271 is used to transmit a clock signal to the ADC 272, and the pin MOSI is used to receive the EXG data signal output by the ADC 272 selected by the pins SS1, SS2, and SS3.

[0078] In some embodiments, when the EXG data acquisition board collects EEG sensor data, the input interface in the EXG data acquisition board may be a display port (DisplayPort, DP).

[0079] In some embodiments, there may be two bioelectric type data acquisition boards, one is an EXG data acquisition board for collecting EMG data and / or ECG data, and the other is an EEG data acquisition board for collecting EEG data.

[0080] The event marking board 30 is detachably coupled to the control module 12. For example, the event marking board 30 can be detachably coupled to the control module 12 on the mainboard 10 via a gold finger or other interface.

[0081] Exemplarily, there may be one or more event marker boards 30. When there is one event marker board 30, it may be any one of a TTL event marker board, a sound event marker board, a light event marker board, and an application programming interface (API) event marker board. When there are multiple event marker boards 30, they may be any one of a TTL event marker board, a sound event marker board, a light event marker board, and an API event marker board.

[0082] Exemplarily, the TTL event marker board may include a TTL input event marker board and / or a TTL output event marker board. The TTL input event marker board is used to transmit the event marker information of the external device to the main board 10, and the TTL output event marker board is used to transmit the event marker information issued by the host computer to the external device.

[0083] One embodiment of a TTL input event marker board may be Figure 5a The TTL input event marker board 31 is shown. Figure 5a As shown, the TTL input event mark board 31 may include an input interface 311, a first switch circuit 312 and a first level conversion circuit 313. The input interface 311 is used to couple with a first external device and receive event mark information sent by the first external device. The input end of the first switch circuit 312 is coupled with the input interface 311, the control end of the first switch circuit 312 is detachably coupled with the control module 12, the output end of the first switch circuit 312 is coupled with the input end of the first level conversion circuit 313, and the output end of the first level conversion circuit 313 is detachably coupled with the mainboard 10. The power supply circuit 11 on the mainboard supplies power to the TTL input event mark board 31.

[0084] When the host computer needs to obtain event marker information from the TTL input event marker board 31, a first instruction can be issued to the control module 12 through the first interface 13. The control module 12 can control the first switch circuit 312 to be turned on according to the first instruction, and the input interface 311 is turned on with the first level conversion circuit 313, and the event marker information sent by the first external device is transmitted to the first level conversion circuit 313. The first level conversion circuit 313 converts the event marker information from the first level to the second level and then sends it to the control module 12. The control module 12 can send the event marker information to the host computer through the first interface 13. Among them, the first level can be the signal logic level of the event marker information on the first external device, and the second level is the signal logic level that the control module 12 can process. In order for the control module 12 to correctly transmit the event marker information, it is necessary to convert the logic level of the event marker information from the first level to the second level before the event marker information is transmitted to the control module 12. For example, the high level of the signal carrying the event marker information is converted from 3.3 volts to 5V, etc. When the host computer stops acquiring event marker information from the TTL input event marker board 31, a second instruction may be issued to the control module 12 through the first interface 13. In some embodiments, the second instruction may also be included in the first instruction. For example, the first instruction may include an opening instruction for opening (conducting) the first switch circuit and a condition for executing the opening instruction, and may also include a closing instruction (second instruction) for closing (disconnecting) the first switch circuit and a condition for the closing instruction.

[0085] The control module 12 can control the first switch circuit 312 to disconnect according to the second instruction, disconnect the input interface 311 from the first level conversion circuit 313, stop the input interface 311 from transmitting event mark information to the first level conversion circuit 313, and stop the first interface 13 from transmitting event mark information to the upper computer.

[0086] Exemplarily, when the input interface 311 is disconnected from the first level conversion circuit 313 , the input terminal of the first level conversion circuit 313 may be at a low level, such as grounded.

[0087] Another embodiment of the TTL input event marker board is Figure 5b The TTL input event marker board 32 is shown. Figure 5b As shown, the TTL input event marker board 32 includes a two-pin input interface 321, a switch circuit 322, and a level conversion circuit 323. One pin of the input interface 321 is grounded, and the other pin (signal pin) is connected to the input end of the switch circuit 322. The control end of the switch circuit 322 is detachably coupled to the mainboard 10, the output end of the switch circuit 322 is connected to the input end of the level conversion circuit 323, and the output end of the level conversion circuit 323 is detachably coupled to the mainboard 10.

[0088] The control module 12 sends a control signal Ctrl1 to the switch circuit 322 according to the instruction sent by the host computer. When the host computer needs to obtain event mark information, the switch circuit 322, under the control of the control signal Ctrl1, connects the signal pin of the input interface 321 and the input end of the level conversion circuit 323. The signal D[0] received by the input interface 321 is transmitted to the level conversion circuit 323, and the level conversion circuit 323 converts the logic level of D[0] from the first level Vdd to the second level VDD, and then outputs it to the control circuit 12. When the host computer does not need to obtain event mark information, the switch circuit 322, under the control of the control signal Ctrl1, disconnects the signal pin of the input interface 321 and the input end of the level conversion circuit 323, connects the input end of the level conversion circuit 323 to ground, and the TTL input event mark board 32 stops sending the signal D[0] to the control module 12. Among them, the signal D[0] is used to transmit event mark information.

[0089] Another embodiment of the TTL input event marker board is Figure 5c The TTL input event marker board 33 is shown. Figure 5c As shown, the difference between the TTL input event marking board 33 and the TTL input event marking board 32 is that the level conversion function of the level conversion circuit 331 is realized by a level conversion chip IC.

[0090] In some embodiments, the TTL input event marking board may further include a third level conversion circuit and / or more level conversion circuits for converting the logic level of the event marking information from the first level to the third level and / or more levels, or from the second level to the first level, the third level and / or more levels, and so on, to meet the needs of level conversion between more different devices, so that the human-machine environment data synchronization edge computing device can match more devices.

[0091] Another embodiment of the TTL input event marker board is Figure 5d The TTL input event marker board 34 is shown. Figure 5d As shown, the difference between the TTL input event marker board 34 and the TTL input event marker board 33 is that the TTL input event marker board 34 further includes a selection circuit MUX 341 and a second level conversion circuit 342. The switch circuit 322 is coupled to the first level conversion circuit 313 and the second level conversion circuit 342 through the MUX 341. The second level conversion circuit 342 is used to convert the logic level of the signal from the first level to the third level, or from the second level to the third level or the fourth level, and so on.

[0092] The control module 12 sends a control signal Ctrl2 to the MUX 341 according to the instruction sent by the host computer. When the host computer needs to convert the logic level of the signal D[0] from the first level to the third level, the MUX 341, under the control of the control signal Ctrl2, turns on the switch circuit 322 and the second level conversion circuit 342. When the switch circuit 322, under the control of the control signal Ctrl1, turns on the signal pin of the input interface 321 and the MUX 341, the second level conversion circuit 342 converts the logic level of the signal D[0] from the first level to the third level, or from the second level to the third level or the fourth level, and so on.

[0093] Exemplarily, the event marker information can be carried by a parallel signal. In some embodiments, when the signal carrying the event marker information is a multi-channel parallel signal, the first level conversion circuit may include a multi-channel level conversion circuit to convert the logic level of the multi-channel parallel signal from a first level to a second level.

[0094] Another embodiment of the TTL input event marker board is Figure 5e The TTL input event marker board 35 is shown. Figure 5e As shown, the difference between the TTL input event marking board 35 and the aforementioned TTL input event marking board embodiment is that the event marking information is carried by 4 parallel signals D[0], D[1], D[2] and D[3], and the input interface 351 has 5 pins accordingly, of which 4 signal pins are used for signals D[0], D[1], D[2] and D[3] respectively.

[0095] Accordingly, the transmission switch circuit MUX 352 may include 4 channels, the selection circuit MUX 353 may include 4 two-to-one channels, the first level conversion circuit 354 may include 4 level conversion circuits for converting the logic levels of the 4 signals from Vdd1 to VDD1, and the second level conversion circuit 355 may include 4 level conversion circuits for converting the logic levels of the 4 signals from Vdd2 to VDD2.

[0096] In this embodiment, the control principles of the switch circuit MUX 352 and the selection circuit MUX 353 are the same. Figure 5d The switching circuit and the selection circuit in the illustrated embodiment.

[0097] In some embodiments, when the event marker information is carried by n parallel signals, the switch circuit and the selection circuit may include n channels respectively, and the control principle is the same as that of the above embodiment.

[0098] In some embodiments, when the selection circuit includes n channels, the TTL circuit may further include an IO expansion circuit or a parallel-to-serial conversion circuit. The input end of the IO expansion circuit or the parallel-to-serial conversion circuit may be coupled to the n output ends of the level conversion circuit, and the output port of the IO expansion circuit or the parallel-to-serial conversion circuit may be detachably coupled to the control module.

[0099] In some embodiments, the TTL input event marker board may include n level conversion circuits, such as for converting the logic level Vdd1 of the signal to VDD1, converting the logic level Vdd2 of the signal to VDD2, ..., converting the logic level Vddn of the signal to VDDn. Wherein, n may be greater than 2. Accordingly, each channel in the selection circuit may be n-select-one, or may be a single-pole n-throw, and the control principle is the same as the above embodiment.

[0100] In some embodiments, the TTL output event marker board has a similar structure to the TTL input event marker board in the above embodiments, except that the transmission direction of the event marker information is opposite. The TTL output event marker board receives the event marker information sent by the mainboard 10 from the level conversion circuit and outputs it to the first external device or the second external device through the interface.

[0101] In some embodiments, the TTL event marker board may be a board that combines any TTL input event marker board and any TTL output event marker board in the above embodiments.

[0102] Another embodiment of the TTL event marker board is Figure 5f The TTL event marker board 36 is shown. Figure 5fAs shown, the TTL event marking board 36 may include an input interface 311, a first switch circuit 312, a first selection circuit 361, an output interface 362, a second switch circuit 363, a second selection circuit 364, level conversion circuits a1 to an, level conversion circuits b1 to bn, IO expansion chips 3651 to 3654, and an SPI chip 366, etc.

[0103] The working principle of the second switch circuit 363 can be the same as the switch circuit in the above-mentioned TTL event tag board embodiment, the working principle of the first selection circuit 361 and the second selection circuit 364 can be the same as the selection circuit MUX in the above-mentioned TTL event tag board embodiment, and the working principle of the level conversion circuits a1 to an and the level conversion circuits b1 to bn can be the same as the level conversion circuit in the above-mentioned TTL event tag board embodiment. The control signals Ctrl3 and Ctrl4 are similar to the control signals Ctrl1 and Ctrl2, and are issued by the control module on the mainboard according to the instructions of the host computer to control the second switch circuit 363 and the second selection circuit 364 respectively.

[0104] The TTL event marker board 36 communicates with the control module 12 on the main board 10 via the SPI chip. The IO expansion chips 3651 to 3654 are used to expand the number of pins of the SPI chip 366.

[0105] When the event marker information input by the input interface 311 is carried by multiple parallel signals, the IO expansion chip 3652 can also be used to convert the multiple parallel signals into serial signals and output them to the SPI chip 366. For example, when the event marker information is 8 bits, a total of 255 event marker information can be represented and can be carried by 8 parallel signals. Accordingly, the switch circuit and the selection circuit can both include 8 channels.

[0106] When the event mark information output by the output interface 362 is carried by multiple parallel signals, the IO expansion chip 3652 can also be used to convert the serial signal output by the SPI chip 366 into the multiple parallel signals and output them to the level conversion circuits b1 to bn. In response to the control signal Ctrl4, the second selection circuit 364 selects a circuit conversion circuit from the level conversion circuits b1 to bn to turn on, so that the logic level of the multiple parallel signals output by the output interface 362 matches the external first external device and / or the second external device.

[0107] One embodiment of the sound event marker board is Figure 6 The sound event marker board 37 shown. Figure 6 As shown, the sound event marking board 37 includes an interface 371 , a processing unit 372 , an audio signal output interface 373 and an audio signal input interface 374 .

[0108] When in use, the sound event marking board 37 can be coupled to the mainboard 10 through the interface 371, connected to the speaker through the audio signal output interface 373, and connected to the microphone through the audio signal input interface 374. The mainboard 10 is coupled to the host computer. After power-on, the host computer can respond to the user's operation and set the sound threshold of the sound event marking board. During the experiment, the host computer can convert the audio data used for the experiment into sound through the audio signal output interface 373 in the sound event marking board 37, and then output it to the speaker for playback. The microphone receives the external sound, and the audio signal input interface 374 converts the sound into an electrical signal and sends it to the processing unit 372. The processing unit 372 compares the received electrical signal with the preset sound threshold. When the sound threshold is exceeded, the processing unit 372 informs the control module 12 on the mainboard 10 of this information through the interface 371. The control module 12 generates event marking information based on the information and sends it to the host computer through the first interface 13.

[0109] In some embodiments, there may be two audio signal output interfaces 373 , one for the left channel and the other for the right channel.

[0110] In some embodiments, both the audio signal output interface 373 and the audio signal input interface 374 may be headphone interfaces.

[0111] One embodiment of the optical event marker board is Figure 7 The optical event marker board 38 is shown. Figure 7 As shown, the optical event marker board 38 includes an interface 381 , a processing unit 382 and an optical port 383 .

[0112] When in use, the optical event marking board 38 can be coupled to the main board 10 through the interface 381, and the main board 10 is coupled to the host computer. After power-on, the host computer can respond to the user's operation and set the optical threshold of the optical event marking board. During the experiment, the optical port 383 receives the optical signal, converts the optical signal into an electrical signal and sends it to the processing unit 382. The processing unit 382 compares the received electrical signal with the preset optical threshold. When the optical threshold is exceeded, the processing unit 382 informs the control module 12 on the main board 10 of this information through the interface 381. The control module 12 generates event marking information based on the information and sends it to the host computer through the first interface 13.

[0113] In some embodiments, the optical port 383 may be an aviation plug or the like.

[0114] An embodiment of the API event marker card is Figure 8 The optical event marker board 39 shown. Figure 8 As shown, the optical event marker board 39 includes a second interface 391 , an interface conversion circuit 392 and a third interface 393 .

[0115] The second interface 391 can be used to be detachably coupled to the mainboard, and the third interface 393 can be used to connect a third external device and receive a call API request sent by the third external device. The interface conversion circuit 392 is used to convert the API request from the communication protocol used by the third interface 393 to the communication protocol used by the second interface 391. Exemplarily, the third interface 393 can be a wireless interface, or a wired interface such as a USB port, etc. The third external device can be a smart phone, a desktop computer, a tablet computer, a notebook, etc.

[0116] When in use, the optical event marking board 39 can be coupled to the main board 10 through the second interface 391, and the main board 10 is coupled to the host computer and powered on. During the experiment, when a third device initiates an API call request through the third interface 393, the control module 12 on the main board 10 generates event marking information and reports it to the host computer through the first interface 13.

[0117] Exemplarily, the second interface 391 may be a parallel port (such as a gold finger), or a serial port, and so on.

[0118] Exemplarily, the light event marker board can be combined with the sound event marker board into one board (sound and light event marker board).

[0119] In some embodiments, the human-machine environment data synchronization edge computing device may further include a second acquisition board. The second acquisition board is detachably coupled to the main board and is used to collect behavioral data of the experimental object (subject), such as video data or signals containing information such as expressions, gestures, and movements, and / or audio data or signals containing information such as voice.

[0120] An embodiment of the second acquisition board is: Figure 9a The second acquisition board 41 shown. Figure 9a As shown, the second acquisition board 41 includes: a power interface 411 , two-channel video acquisition circuits 412 and an output interface 413 .

[0121] The power interface 411 can be detachably coupled to the power circuit 11 on the mainboard 10 , so that the second acquisition board 41 obtains electrical energy from the power circuit 11 .

[0122] Each video acquisition circuit 412 includes an input interface 4121, a distribution module 4122, a conversion module 4123 and a loop-out interface 4124. Among them, one end of the input interface 4121 is used for externally connecting to a video acquisition device, and the other end is electrically connected to a first end of the distribution module 4122. The input interface 4121 is used to obtain the video signal of the subject collected by the video acquisition device and transmit the video signal to the distribution module 4122. Exemplarily, the input interface 4121 and the loop-out interface 4124 can be a High Definition Multimedia Interface (HDMI) interface.

[0123] A second end of the distribution module 4122 is electrically connected to one end of the conversion module 4123, and a third end of the distribution module 4122 is electrically connected to the loop-out interface 4124. The distribution module 4122 is used to transmit the video signal acquired by the input interface 4121 to the conversion module 4123 and the loop-out interface 4124 respectively.

[0124] The other end of the conversion module 4123 is electrically connected to one end of the output interface 413. The conversion module 4123 is used to convert the video signal into a target format and transmit it to the output interface 413. The target format may be a data format used by the output interface 413 for data transmission.

[0125] The other end of the output interface 413 is used to connect to an external host computer, and is used to transmit the video information transmitted by the conversion module 4123 to the host computer, so that the experimenter can observe the behavior of the experimental subject.

[0126] Exemplarily, the output interface 413 may be a USB interface, such as a Type-C USB interface.

[0127] The loop-out interface 4124 is used to connect to a fourth external device that can display video signals, and output the video signals to the fourth external device for display, so that the subjects can regulate their behavior according to the experimental requirements with the help of the video or image displayed by the fourth external device, thereby providing data accuracy for the behavior observation experiment.

[0128] In some embodiments, the fourth external device and the third external device may be the same device.

[0129] In some embodiments, the second acquisition board may further include more video acquisition circuits.

[0130] Another embodiment of the second acquisition board is: Figure 9b The second acquisition board 42 shown. Figure 9bAs shown, the difference between the second acquisition board 42 and the second acquisition board in the above embodiment is that it further includes two input interfaces 414 for externally connecting audio acquisition devices, acquiring audio signals acquired by different audio acquisition devices, and uploading the acquired audio signals to the host computer through the output interface 413. For example, different audio acquisition devices acquire audio data for different scenes, and audio data in two different scenes can be acquired through the two input interfaces 414 on the second acquisition board. In this embodiment, the second acquisition board can not only acquire multiple video signals, but also acquire multiple audio signals, and upload them to the host computer, so that the host computer can analyze the video data and audio data based on the behavior of the subjects in different scenes, and obtain the target data more accurately and efficiently.

[0131] Exemplarily, the input interface 414 may be a headphone interface or the like.

[0132] In some embodiments, the human-machine environment data synchronization edge computing device may include multiple second acquisition boards.

[0133] In some embodiments, the human-machine environment data synchronization edge computing device may further include a plurality of indicator lights, which are arranged on the mainboard and correspond to the boards connected to the mainboard. For example, the mainboard may be connected to three boards, and accordingly, three indicator lights may be arranged on the mainboard. When three boards are connected to the mainboard, after power-on, all three indicator lights are on, indicating that the three boards are connected to the mainboard normally. When two boards are connected to the mainboard, after power-on, only two of the three indicator lights are on, and so on.

[0134] In some embodiments, the human-computer environment data synchronization edge computing device may further include a switch for controlling the power circuit to power on or off the mainboard to turn on or off the human-computer environment data synchronization edge computing device.

[0135] In some embodiments, the human-machine environment data synchronization edge computing device may further include a housing for protecting the mainboard and further fixing the above-mentioned board.

[0136] Another embodiment of the human-machine environment data synchronization edge computing device is as follows: Figures 10a to 10c As shown, it may include a housing, a main board 1010 and 8 boards (such as Fig.10a As shown): 2 audio and video acquisition boards (second acquisition boards) 1020 and 1030, 1 TTL and API event marker board 1040, 1 sound and light event marker board 1050, 1 environmental data acquisition board 1060, 1 BIO data acquisition board 1070, 1 EXG data acquisition board 1080 and 1 EEG data acquisition board 1090.

[0137] The two audio and video acquisition boards 1020 and 1030 can be detachably coupled to the mainboard 1010 through the power interface respectively, the TTL and API event marking board 1040 and the sound and light event marking board 1050 can be respectively plugged into the mainboard 1010 through gold fingers, and the environmental data acquisition board 1060, the BIO data acquisition board 1070, the EXG data acquisition board 1080 and the EEG data acquisition board 1090 can be respectively plugged into the mainboard 1010 through the USB interface.

[0138] like Fig.10a As shown, the main board 1010 may include: a power circuit 1011, an MCU 1012, a switch circuit 1013, a USB HUB 1014 and indicator lights 10151 to 10158.

[0139] The switch circuit 1013 is connected between the power circuit 1011 and the interface for connecting the board on the MCU 1012 and the mainboard 1010, and is used to control the opening and closing of the human-machine environment data synchronization edge computing device. The components for user operation on the switch circuit 1013 can be as follows Fig.10b The switch 10131 is shown. Exemplarily, the component for user operation can also be in other forms, which are not limited here.

[0140] USBHUB 1014 may include USB interfaces 10141 to 10146, USB interface 10141 is used to communicate with the host computer, USB interface 10142 is used to communicate with MCU 1012, USB interface 10143 is used to communicate with environmental data acquisition board 1060, USB interface 10144 is used to communicate with BIO data acquisition board 1070, USB interface 10145 is used to communicate with EXG data acquisition board 1080, and USB interface 10145 is used to communicate with EEG data acquisition board 1090.

[0141] The indicator light 10151 is connected between the switch circuit 1013 and the power interface on the mainboard 1010 for connecting the audio and video acquisition board 1020. When the audio and video acquisition board 1020 is detachably coupled to the power interface (not shown) on the mainboard 1010, when the user turns on the switch 10131, the switch circuit 1013 is turned on, and the indicator light 10151 is lit, indicating that the mainboard 1010 is connected to the audio and video acquisition board 1020, or the mainboard 1010 is normally connected to the audio and video acquisition board 1020. The working principle of the indicator light 10152 is the same as that of the indicator light 10151.

[0142] The indicator lights 10153 to 10158 are respectively connected between the switch circuit 1013 and the interface for connecting the TTL and API event marker board 1040, the interface for connecting the sound and light event marker board 1050, the interface for connecting the environmental data acquisition board 1060, the interface for connecting the BIO data acquisition board 1070, the interface for connecting the EXG data acquisition board 1080 and the interface for connecting the EEG data acquisition board 1090 on the main board 1010, and between the TTL and API event marker board 1040, the sound and light event marker board 1050, the environmental data acquisition board 1060, the BIO data acquisition board 1070, the EXG data acquisition board 1080 and the EEG data acquisition board 1090 and the main board 1010. 010 is detachably coupled, when the user turns on the switch 10131, the switch circuit 1013 is turned on, and the indicator lights 10153 to 10158 are respectively lit, indicating that the main board 1010 is connected to the TTL and API event marking board 1040, the sound and light event marking board 1050, the environmental data acquisition board 1060, the BIO data acquisition board 1070, the EXG data acquisition board 1080 and the EEG data acquisition board 1090, or the main board 1010 is normally connected to the TTL and API event marking board 1040, the sound and light event marking board 1050, the environmental data acquisition board 1060, the BIO data acquisition board 1070, the EXG data acquisition board 1080 and the EEG data acquisition board 1090.

[0143] The housing may include a housing (in the figure) for accommodating the mainboard 1010 and the board, and Fig.10b The front panel 1001 shown and Fig.10c Back plate 1002 is shown.

[0144] like Fig.10b As shown, indicator lights 10151 to 10158 , a USB interface 10141 and a switch 10131 can be seen on the front panel 1001 .

[0145] like Fig.10cAs shown, it can be seen from the back panel 1002 that the audio and video acquisition board 1020 may include 4 HDMI interfaces 1021 to 1024, 2 full-function headphone interfaces 1025 and 1 Type-C USB interface 1026. Among them, the HDMI interfaces 1021 and 1022 are used to receive video signals, the HDMI interfaces 1023 and 1024 are used to loop out video signals, the 2 full-function headphone interfaces 1025 are used to receive audio signals, and the Type-C USB interface 1026 can be used to connect to the host computer to send the data carried by the video signals received by the HDMI interfaces 1021 and 1022 and the data carried by the audio signals received by the 2 full-function headphone interfaces 1025 to the host computer. The Type-C USB interface 1026 can also be used to connect to playback software, such as Open Broadcaster Software (OBS), etc., to send audio and video data to the playback software for playback.

[0146] The audio and video acquisition board 1030 may include four HDMI interfaces 1031 to 1034, two full-function headphone interfaces 1035, and one C-type USB interface 1036. Among them, the HDMI interfaces 1031 and 1032 are used to receive video signals, the HDMI interfaces 1033 and 1034 are used to loop out video signals, the two full-function headphone interfaces 1035 are used to receive audio signals, and the C-type USB interface 1036 can be used to connect to a host computer and send the data carried by the video signals received by the HDMI interfaces 1031 and 1032 and the data carried by the audio signals received by the two full-function headphone interfaces 1035 to the host computer. The C-type USB interface 1036 can also be used to connect to playback software such as OBS, etc., and send audio and video data to the playback software for playback.

[0147] The audio and video acquisition boards 1020 and 1030 may further include heat dissipation components. Accordingly, the audio and video acquisition boards 1020 and 1030 may be provided with heat dissipation holes 1028 and 1038, respectively.

[0148] The TTL and API event marker board 1040 may include two DB15 interfaces 1041 and 1042 and one C-type USB interface 1043. The DB15 interface 1041 is used to connect to a first external device and receive event marker information sent by the first external device, and the DB15 interface 1042 is used to connect to the first external device and / or the second external device and send event marker information to the first external device and / or the second external device. The C-type USB interface 1043 is used to connect to a third external device and provide a channel for the third external device to read x information through the API.

[0149] The sound and light event marking board 1050 may include an aviation plug 1051 and three earphone interfaces 1052 to 1054. The aviation plug 1051 may be used to receive optical signals, the earphone interfaces 1052 and 1053 may be used to connect to a sound playback device such as a speaker to output left and right channel audio signals, and the earphone interface 1054 may be used to connect to a microphone to receive audio signals.

[0150] The environmental data acquisition board 1060 may include an aviation plug 1061. The aviation plug 1061 is used to connect an external environmental sensor to receive data detected by the environmental sensor.

[0151] The BIO data acquisition board 1070 may include 8 Type-C USB ports 1071 to 1078 for correspondingly connecting to 8 BIO sensors and receiving PPG, EDA, SPO2, SKT, RESP, BP, FSR and other data collected by the 8 BIO sensors.

[0152] The EXG data acquisition board 1080 may include six headphone interfaces 1081 to 1086 for correspondingly connecting to four EXG sensors and receiving EMG data, ECG data, etc. collected by the four EXG sensors, wherein two headphone interfaces 1085 and 1086 are used for connecting to a common end.

[0153] The EEG data acquisition board 1090 may include two DP interfaces 1091 and 1092 for correspondingly connecting to two EEG sensors such as an electroencephalogram cap and receiving EEG data collected by the two EEG sensors.

[0154] like Fig.10c As shown, the back panel 1002 may also be provided with components 1027, 1037, 1044, 1055, 1062, 1079, 1087 and 1093 for facilitating the removal of boards, which may be used to remove the audio and video acquisition board 1020, the audio and video acquisition board 1030, the TTL and API event marking board 1040, the sound and light event marking board 1050, the environmental data acquisition board 1060, the BIO data acquisition board 1070, the EXG data acquisition board 1080 and the EEG data acquisition board 1090, respectively.

[0155] During use, if the subject is required to be in a closed environment to test the impact of sound volume on human biological type data signals such as (PPG, EDA, SPO2, SKT, RESP, BP, FSR, etc.), the subject can wear the corresponding BIO sensor to detect the corresponding biological type data signal. The closed environment can also be equipped with a camera, a microphone, and a video playback device. The camera is used to obtain the subject's image, the microphone is used to obtain the subject's sound signal, and the video playback device is used for the subject to observe himself.

[0156] In the human-machine environment data synchronization edge computing device, the BIO data acquisition board 1070, the sound and light event marking board 1050, the audio and video acquisition board 1020 and / or 1030 can be connected to the main board 1010, and the wire plug of the corresponding BIO sensor worn by the subject is plugged into the corresponding interface among the C-type USB interfaces 1071 to 1078 on the BIO data acquisition board 1070, and the connection plug of the camera in the closed environment where the subject is located is plugged into the HDMI interfaces 1031 and 1032 on the audio and video acquisition board 1020, and / or , the connection plug of the video playback device configured in the closed environment is plugged into the HDMI interfaces 1031 and 1032 on the audio and video capture board 1030, and / or is plugged into the HDMI interfaces 1033 and 1034 of the audio and video capture board 1030, and the connection plug of the microphone configured in the closed environment is plugged into the full-function headphone interface 1025 of the audio and video capture board 1020, and / or is plugged into the full-function headphone interface 1035 of the audio and video capture board 1030.

[0157] In addition, one connection plug of the host computer is plugged into the USB interface 10141 on the front panel 1001, and the other connection plug is plugged into the Type-C USB interface 1026 on the audio and video acquisition board 1020 or the Type-C USB interface 1036 on the audio and video acquisition board 1030, or the other two connection plugs of the host computer are plugged into the Type-C USB interfaces 1026 and 1036 of the audio and video acquisition board 1020 and the audio and video acquisition board 1030.

[0158] Then, the switch 10131 is operated to turn on the human-machine environment data synchronization edge computing device, and the indicator lights 10151 and / or 10152, the indicator light 10154 and the indicator light 10156 on the front panel 1001 are lit. The host computer is operated to set the sound threshold (volume threshold) of the sound event mark. After that, the experiment is started.

[0159] During the experiment, the host computer can simultaneously obtain audio and video data and BIO data through the human-machine environment data synchronization edge computing device. When the external volume is greater than the set sound threshold, the sound and light event marker board event marker is triggered. The host computer can also obtain event marker information through the human-machine environment data synchronization edge computing device, and obtain BIO data when the external volume is greater than the sound threshold, that is, when the subject receives sound stimulation, so that it can be used to analyze and obtain the impact of sound size on human PPG, EDA, SPO2, SKT, RESP, BP, FSR and other biological data signals.

[0160] In some embodiments, the board position in the human-machine environment data synchronization edge computing device may be different from the position provided in the above embodiments, depending on actual needs.

[0161] In some embodiments, the BIO data acquisition board and the EXG board can be combined into one board.

[0162] In some embodiments, compared with the above embodiments, the main board may include more reserved interfaces (expansion interfaces) for connecting boards and cards. Accordingly, the human-computer environment data synchronization edge computing device may include more boards and cards. For example, based on the above embodiments, the number of boards and cards such as BIO data acquisition boards, EXG data acquisition boards, and EEG data acquisition boards may be further increased, such as increasing the number of BIO data acquisition boards to 8, or, for example, expanding the collected signals on the reserved interface, such as connecting functional near-infrared spectroscopy (fNIRS) on the reserved interface to obtain brain function information, or connecting devices for obtaining biomechanical information, motion capture and other information on the reserved interface, and so on.

[0163] In some embodiments, when the mainboard may include more reserved interfaces for connecting boards, more indicator lights may be further provided on the mainboard accordingly.

[0164] It should be understood that the division of the modules in the above embodiments is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the processor can be a separately established processing element, or it can be integrated in a chip of an electronic device. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, or they can be implemented independently. In the implementation process, the above modules can be completed by the integrated logic circuit of the hardware in the processor element or the instructions in the form of software.

[0165] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c can be single or multiple.

[0166] The above is only a specific implementation of the present application. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A human-machine environment data synchronization edge computing device, characterized in that: It includes a main board, at least one event marking board and at least two acquisition boards; The main board is detachably coupled to the at least one event marking board and the at least two acquisition boards; The at least one event marking board is used to send event marking information to the main board, and the at least two acquisition boards are used to send acquired human-machine environment data to the main board; The mainboard includes a power circuit, a control module and a first interface; The power supply circuit is used to supply power to the main board, the at least one event marking board and the at least one acquisition board; The control module is used to process the event marking information into a form transmittable by the first interface; The first interface is used to couple to a host computer and send the event marking information and the human-machine environment data to the host computer; The at least one event marker board includes any one or more of a TTL event marker board, an API event marker board, a sound event marker board, and an optical event marker board; The at least two acquisition boards include any two or more of an audio and video acquisition board, an environmental data acquisition board, a BIO data acquisition board, an EXG acquisition board and an EEG acquisition board.

2. The device according to claim 1, characterized in that The event marking information includes first event marking information, and the first interface is further used to receive a first instruction sent by the host computer; The TTL event marking board includes: an input interface, a first switch circuit and a first level conversion circuit; The input interface is used to connect to a first external device and receive the first event marking information sent by the first external device; The input end of the first switch circuit is coupled to the input interface, the control end of the first switch circuit is detachably coupled to the control module, the output end of the first switch circuit is coupled to the input end of the first level conversion circuit, and the output end of the first level conversion circuit is detachably coupled to the control module; The control module is used to control the first switch circuit to be turned on or off according to the first instruction. The input end of the first level conversion circuit is at a low level when the first switch circuit is turned off. When the first switch circuit is turned on, the input end of the first level conversion circuit is used to send the first event marking information to the first level conversion circuit. The first level conversion circuit is used to convert the first event marking information from a first level to a second level and then send it to the control module.

3. The device according to claim 2, characterized in that The first interface is also used to receive a second instruction sent by the host computer; The TTL event marker board also includes a second level conversion circuit and a first selection circuit; The second level conversion circuit is used for converting the third level into a fourth level; The first switch circuit is coupled to the input ends of the first level conversion circuit and the second level conversion circuit through the first selection circuit, and the output end of the second level conversion circuit is detachably coupled to the control module; The first selection circuit is detachably coupled to the control module; The control module is used for controlling the first selection circuit to select the first level conversion circuit or the second level conversion circuit to be connected to the input interface according to the second instruction.

4. The device according to claim 2, characterized in that The TTL event marking board also includes: a first signal conversion circuit; The input end of the first signal conversion circuit is coupled to the first level conversion circuit, and the output end of the first signal conversion circuit is detachably coupled to the control module, and is used to convert the first event marker information from a parallel signal to a serial signal and then send it to the control module.

5. The device according to claim 3, characterized in that The TTL event marking board also includes: a first signal conversion circuit; The input end of the first signal conversion circuit is coupled to the first level conversion circuit and the second level conversion circuit, and the output end of the first signal conversion circuit is detachably coupled to the control module, and is used to convert the first event marker information from a parallel signal to a serial signal and send it to the control module.

6. The device according to claim 2, characterized in that The first interface is also used to receive the second event marking information and the third instruction sent by the host computer, and the TTL event marking board also includes: an output interface, a second switch circuit and a third level conversion circuit; The output interface is used to connect to a second external device and / or the first external device, and send the second event marking information to the second external device and / or the first external device; The third level conversion circuit is used for converting the second event mark information from the fifth level to the sixth level; The input end of the third level conversion circuit is detachably coupled to the control module, the output end of the third level conversion circuit is coupled to the output interface through the second switch circuit, and the control end of the second switch circuit is detachably coupled to the control module; The control module is further used to control the second switch circuit to be turned on or off according to the third instruction, and send the second event mark information to the third level conversion circuit; The output end of the third level conversion circuit sends the second event mark information to the output interface when the second switch circuit is disconnected, and is at a low level when the second switch circuit is disconnected; The output interface is further configured to send the second event marking information to the second external device when the second switch circuit is turned on.

7. The device according to claim 6, characterized in that The first interface is also used to receive a fourth instruction sent by the host computer, and the TTL event marking board also includes: a fourth level conversion circuit and a second selection circuit; The input ends of the fourth level conversion circuit and the third level conversion circuit are detachably coupled to the control module, the output ends of the fourth level conversion circuit and the third level conversion circuit are coupled to the input end of the second selection circuit, the output end of the second selection circuit is coupled to the third interface through the second switch circuit, and the control end of the second selection circuit is detachably coupled to the control module; The fourth level conversion circuit is used for converting the second event mark information from the seventh level to the eighth level; The control module is used to control the second selection circuit according to the fourth instruction to select the third level conversion circuit or the fourth level conversion circuit to be connected to the input end of the second switch circuit.

8. The device according to claim 6, characterized in that The TTL event marking board also includes: a second signal conversion circuit; The input end of the second signal conversion circuit is detachably coupled to the control module, and the output end of the second signal conversion circuit is coupled to the third level conversion circuit, for converting the second event mark information from a serial signal to a parallel signal and sending it to the third level conversion circuit.

9. The device according to claim 7, characterized in that The TTL event marking board also includes: a second signal conversion circuit; The input end of the second signal conversion circuit is detachably coupled to the control module, and the output end of the second signal conversion circuit is coupled to the third level conversion circuit and the fourth level conversion circuit, and is used to convert the second event mark information from a serial signal to a parallel signal and send it to the third level conversion circuit and the fourth level conversion circuit.

10. The device according to claim 1, characterized in that The first interface is further used to receive a fifth instruction from the host computer, and the control module is further used to set a threshold for the sound event marking board and / or the light event marking board according to the fifth instruction.

11. The device according to claim 1, characterized in that The main board also includes a switch circuit, which is connected between the power supply circuit and the control module, the at least one event marking board and the at least one acquisition board.

12. The device according to any one of claims 1 to 11, characterized in that The mainboard further comprises at least two indicator lights, and the at least two indicator lights are correspondingly arranged on the circuits through which the power supply circuit supplies power to the at least one event marking board and the at least one acquisition board.

Images