Multi-mode human factor intelligent physiological signal acquisition edge device, system and method and medium

Abstract

The invention discloses a multi-mode human factor intelligent physiological signal acquisition edge device, system and method and a medium wherein the multi-mode human factor intelligent physiological signal acquisition edge device comprises a signal acquisition module comprising at least two signal acquisition ports which are respectively used for acquiring different types of physiological signals, the physiological signal comprises a biological type signal and / or a bioelectricity type signal; the data processing chip comprises a signal receiving port, a first data transmitting port and a second data transmitting port, the signal receiving port is used for receiving the physiological signals acquired from the at least two physiological signal acquisition ports, the first data transmitting port is used for reporting the physiological signals in real time, and the second data transmitting port is used for transmitting the physiological signals to the data processing chip. The second data sending port is used for sending a physiological signal to the local storage chip; and the local storage chip is used for storing the physiological signals. According to the technical scheme provided by the invention, the requirements of various application scenes on various physiological signals can be met.

Description

Technical Field

[0001] The present application belongs to the field of human factors engineering technology, and in particular, relates to a multimodal human factors intelligent physiological signal acquisition edge device, system, method and medium. Background Art

[0002] In the field of human factors engineering, such as health care, sports rehabilitation, intelligent driving and other application scenarios, more and more physiological signal acquisition equipment is needed to collect physiological signals. However, most of the current physiological signal acquisition equipment collects a single type of physiological signal. With the continuous improvement of the demand for various application scenarios, it is usually necessary to collect and analyze multiple types of physiological signals, but the existing physiological signal acquisition equipment cannot meet its needs. Summary of the invention

[0003] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes a multimodal human factors intelligent physiological signal acquisition edge device, a multimodal human factors intelligent physiological signal acquisition system, and a physiological signal acquisition method and computer storage medium based on the multimodal human factors intelligent physiological signal acquisition edge device, which can meet the needs of various application scenarios for multiple physiological signals.

[0004] In a first aspect, the present application provides a multimodal human factors intelligent physiological signal acquisition edge device, including:

[0005] A signal acquisition module, wherein the signal acquisition module comprises at least two signal acquisition ports, wherein the at least two signal acquisition ports are respectively used to acquire different types of physiological signals, wherein the physiological signals comprise biological type signals and / or bioelectric type signals;

[0006] A data processing chip, the data processing chip comprising a signal receiving port, a first data sending port and a second data sending port, wherein the signal receiving port is used to receive the physiological signal collected from the at least two physiological signal collection ports, the first data sending port is used to report the physiological signal in real time, and the second data sending port is used to send the physiological signal to a local storage chip;

[0007] The local storage chip is used to store the above physiological signals.

[0008] In some embodiments, the above-mentioned biological type signal includes at least one of a photoplethysmography signal, a blood oxygen saturation signal, a skin electrical response signal, a breathing signal, a skin temperature signal and a single-point force-sensitive resistor signal; the bioelectric type signal includes at least one of an electromyogram, an electroencephalogram and an electrocardiogram signal.

[0009] In some embodiments, it also includes:

[0010] External communication interface;

[0011] The offline storage circuit includes a first switching switch and a communication conversion chip. The first switching switch is used to select the local storage chip to be connected to the second data transmission port, or to select the local storage chip to be connected to the communication conversion chip. The communication conversion chip is used to report the physiological signals stored in the local storage chip through an external communication interface.

[0012] In some embodiments, the offline storage circuit further includes a second switch, and the second switch is used to select to connect the external communication interface to the first data sending port of the data processing chip, or to select to connect the external communication interface to the communication conversion chip.

[0013] In some embodiments, the above device further comprises:

[0014] A power supply for supplying power to the data processing chip;

[0015] A charging interface, electrically connected to the power source, for charging the power source;

[0016] And one of a first isolation circuit and a second isolation circuit, the first isolation circuit is arranged between the charging interface and the power supply; the second isolation circuit is arranged between the external communication interface and the second switching switch.

[0017] In some embodiments, the external communication interface includes at least one of a wired communication port and / or a wireless communication port.

[0018] In some embodiments, the signal acquisition module includes a biological type signal acquisition submodule and / or a bioelectric type signal acquisition submodule, the biological type signal acquisition submodule is configured with at least two biological type signal acquisition ports, and the bioelectric type signal acquisition submodule is configured with at least two bioelectric type signal acquisition ports.

[0019] In some embodiments, the above-mentioned biological type signal acquisition port includes a first signal transmission terminal and an insertion detection terminal;

[0020] The data processing chip also includes:

[0021] The first insertion detection port is electrically connected to the insertion detection terminal, and the data processing chip is further used to detect whether the insertion detection terminal is connected to a lead wire through the first insertion detection port.

[0022] In some embodiments, the data processing chip is further used to detect the type of the connected lead wire, and the type of the lead wire is set corresponding to the type of the biological type signal.

[0023] In some embodiments, a pull-up resistor is provided on the first insertion detection port, and a pull-down resistor is provided on the connected lead line. The resistance values ​​of the pull-up resistors provided on the first insertion detection port are the same, and the pull-down resistors on the lead lines are different.

[0024] In some embodiments, at least one of the following is also included:

[0025] A first multiplexer is provided between the insertion detection terminals of at least two biological type signal acquisition ports and the first insertion detection port, and is used for selectively connecting the insertion detection terminal of one biological type signal acquisition port and the first insertion detection port;

[0026] A first analog-to-digital converter is provided between the first signal transmission terminals of at least two biological type signal acquisition ports and the first signal receiving port of the data processing chip, and is used to convert the analog biological type signal acquired by the first signal transmission terminal into a digital biological type signal; and / or,

[0027] The second multiplexer is arranged between the first signal transmission terminals of at least two biological type signal acquisition ports and the analog input terminal of the first analog-to-digital converter, and is used for selectively connecting one first signal transmission terminal and the analog input terminal of the first analog-to-digital converter.

[0028] In some embodiments, there are at least two first analog-to-digital converters, and they are arranged one-to-one corresponding to the first signal transmission terminals of the biological type signal acquisition port. At least two first analog-to-digital converters are arranged in a daisy chain manner, and are used to start in sequence according to the selection signal of the data processing chip to convert the analog biological type signal collected by the corresponding first signal transmission terminal into a digital biological type signal.

[0029] In some embodiments, the bioelectric type signal acquisition port includes a second signal transmission terminal and two common terminals;

[0030] The second analog-to-digital converter is arranged between the second signal transmission terminals of at least two bioelectric type signal acquisition ports and the second signal receiving port of the data processing chip, and is used to convert the analog bioelectric type signals collected by the second signal transmission terminal into digital bioelectric type signals.

[0031] In some embodiments, it also includes:

[0032] A third multiplexer is arranged between the second signal transmission terminals of at least two bioelectric type signal acquisition ports and the analog input terminal of the second analog-to-digital converter, and is used for selecting and conducting a second signal transmission terminal and the analog input terminal of the second analog-to-digital converter; and / or, there are at least two second analog-to-digital converters, which are arranged one-to-one with the second signal transmission terminals of the biological type signal acquisition port, and at least two second analog-to-digital converters are arranged in a daisy chain manner, and are used for starting in sequence according to the selection signal of the data processing chip, so as to convert the analog bioelectric type signal collected by the corresponding second signal transmission terminal into a digital bioelectric type signal.

[0033] In the second aspect, an embodiment of the present application provides a multimodal human factors intelligent physiological signal acquisition system, including the above-mentioned multimodal human factors intelligent physiological signal acquisition edge device, as well as a host computer and multiple physiological signal acquisition devices. The multimodal human factors intelligent physiological signal acquisition edge device is used to collect different types of physiological signals from the above-mentioned multiple physiological signal acquisition devices and send them to the host computer.

[0034] The above-mentioned physiological signal acquisition device includes at least one of a wearable device, a portable physiological signal sensor and a bioelectric type signal acquisition device.

[0035] In a third aspect, an embodiment of the present application provides a physiological signal acquisition method based on the above-mentioned multimodal human factors intelligent physiological signal acquisition edge device, the method comprising:

[0036] Sending the physiological signal to the upper computer through the first data transmission port, and simultaneously sending the physiological signal to the local storage chip through the second data transmission port, so as to store the physiological signal in the storage chip;

[0037] When the host computer detects that the received physiological signal is incomplete, the stored physiological signal is exported from the local storage chip, and the physiological signal is resent to the host computer.

[0038] In a fourth aspect, an embodiment of the present application further provides a computer storage medium for storing a computer program, wherein the computer program is used to implement the above-mentioned physiological signal acquisition method when executed by a processor.

[0039] The technical solution provided by the embodiment of the present application, wherein the multimodal human factors intelligent physiological signal acquisition edge device can collect multiple types of physiological signals to meet the application scenarios in the field of human factors engineering for multiple types of physiological signals at the same time; at the same time, a first data transmission port and a second data transmission port are set on the data processing chip of the physiological signal acquisition device, wherein the first data transmission port is used to report the physiological signal in real time, and the second data transmission port is used to send the physiological signal to the local storage chip. Furthermore, in the technical solution provided by the embodiment of the present application, the collected physiological signals can be reported in real time, or stored in the local storage chip, and the physiological signals are stored in an offline manner, or the physiological signals in the local storage chip can be reported later according to actual needs, thereby realizing multiple modes of physiological signal reporting methods, and thus being able to better adapt to the needs of different application scenarios.

[0040] Additional aspects and advantages of the present application provided by the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0042] Figure 1 This is a schematic diagram of the structure of a multimodal human factors intelligent physiological signal acquisition edge device in an embodiment of the present application;

[0043] Figure 2 This is a schematic diagram of the structure of another multimodal human factors intelligent physiological signal acquisition edge device in an embodiment of the present application;

[0044] Figure 3 This is a structural schematic diagram of another multimodal human factors intelligent physiological signal acquisition edge device in an embodiment of the present application;

[0045] Figure 4 This is a structural schematic diagram of another multimodal human factors intelligent physiological signal acquisition edge device in an embodiment of the present application;

[0046] Figure 5 This is a structural schematic diagram of another multimodal human factors intelligent physiological signal acquisition edge device in an embodiment of the present application;

[0047] Figure 6 for Figure 5 Schematic diagram of the biological type signal acquisition submodule in the embodiment shown Figure 1 ;

[0048] Figure 7 for Figure 5Schematic diagram of the biological type signal acquisition submodule in the embodiment shown Figure 2 ;

[0049] Figure 8 for Figure 5 Schematic diagram of the biological type signal acquisition submodule in the embodiment shown Figure 3 ;

[0050] Fig. 9 for Figure 5 Schematic diagram of the biological type signal acquisition submodule in the embodiment shown Figure 4 ;

[0051] Fig.10 A schematic diagram of a first analog-to-digital converter in an embodiment of the present application being arranged in a daisy chain;

[0052] Fig.11 This is a schematic diagram of the structure of the bioelectric type signal acquisition port in the embodiment of the present application;

[0053] Fig.12 This is a schematic diagram of the configuration of the bioelectric type signal acquisition port in the embodiment of the present application;

[0054] Fig.13 for Figure 5 Schematic diagram of the bioelectric type signal acquisition submodule in the embodiment shown Figure 1 ;

[0055] Fig.14 for Figure 5 Schematic diagram of the bioelectric type signal acquisition submodule in the embodiment shown Figure 2 ;

[0056] Fig.15 A schematic diagram of a daisy chain configuration of a second analog-to-digital converter in an embodiment of the present application;

[0057] Fig.16 This is a flow chart of a physiological data collection method based on the multimodal human factors intelligent physiological signal collection device in an embodiment of the present application;

[0058] Fig.17 This is a schematic diagram of the process of collecting physiological signals in an embodiment of the present application;

[0059] Fig.18 This is a structural schematic diagram of a multimodal human factors intelligent physiological signal acquisition system in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as being limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are only for exemplary purposes and are not intended to limit the scope of protection of the present application.

[0061] It should be understood that the various steps described in the method implementation of the present application can be performed in different orders and / or performed in parallel. In addition, the method implementation may include additional steps and / or omit the steps shown. The scope of the present application is not limited in this respect.

[0062] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0063] It should be noted that the concepts such as "first" and "second" mentioned in this application are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0064] It should be noted that the modifications of "one" and "plurality" mentioned in the present application are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0065] As described in the background technology, the existing technology is usually only able to collect a single type of physiological signal, and cannot meet the increasing application scenario requirements in the field of human factors engineering. In order to meet the requirements of the above application scenarios, the present application embodiment provides Figure 1 The technical solution shown, Figure 1 Schematic diagram of the structure of a multi-modal human factor intelligent physiological signal acquisition edge device in an embodiment of the present application, such as Figure 1As shown, the multimodal human factors intelligent physiological signal acquisition edge device includes a signal acquisition module 11, a data processing chip 12 and a local storage chip 13, wherein the signal acquisition module 11 includes at least two signal acquisition ports S1, and the at least two signal acquisition ports S1 are respectively used to collect different types of physiological signals. In some embodiments, the above-mentioned physiological signals can be divided into two types, which include biological type signals and bioelectric type signals. For each type of physiological signal, such as biological type signals or bioelectric type signals, it can include multiple types of physiological signals. In the embodiment of the present application, the physiological signals collected by the above-mentioned at least two signal acquisition ports can include biological type signals and / or bioelectric type signals in terms of type.

[0066] In some embodiments, the physiological signals included in the biological type signals may be at least one of photoplethysmography (PPG) signals, periphery capillary oxygen saturation (SPO2) signals, electrodermal activity (EDA) signals, respiratory rate (RESP) signals, skin temperature signals and force-sensing resistor (FSR) signals; and the physiological signals included in the bioelectric type signals may be at least one of electromyography, electroencephalography and electrocardiography signals, and in the embodiment of the present application, at least two physiological signal acquisition ports S1 can collect at least two of the above-mentioned multiple types of physiological signals.

[0067] For the data processing chip 12, the data processing chip 12 may include a signal receiving port 121, a first data sending port 122 and a second data sending port 123, wherein the signal receiving port 121 is used to receive physiological signals collected from at least two physiological signal collection ports S1, the first data sending port 122 is used to report the physiological signals in real time, and the second data sending port 123 is used to send the physiological signals to the local storage chip 13;

[0068] The local storage chip 13 can be used to store the above-mentioned physiological signals.

[0069] The multimodal human factors intelligent physiological signal acquisition edge device provided in the embodiment of the present application can collect multiple types of physiological signals to meet the needs of multiple types of physiological signals in the application scenarios in the field of human factors engineering at the same time; at the same time, a first data transmission port and a second data transmission port are set on the data processing chip of the multimodal human factors intelligent physiological signal acquisition edge device, wherein the first data transmission port is used to report the physiological signal in real time, and the second data transmission port is used to send the physiological signal to the local storage chip. Furthermore, in the technical solution provided in the embodiment of the present application, the collected physiological signals can be reported in real time, or stored in the local storage chip, and the physiological signals are stored in an offline manner, or the physiological signals in the local storage chip can be reported later according to actual needs, so that multiple modes of physiological signal reporting methods can be realized, and thus the needs of different application scenarios can be better adapted.

[0070] In some embodiments, in order to report physiological signals through multiple modes, such as Figure 2 As shown, the multimodal human factors intelligent physiological signal acquisition edge device further includes:

[0071] The offline storage circuit 14 includes a first switching switch 141 and a communication conversion chip 142. The first switching switch 141 is used to select the local storage chip 13 to be connected to the second data transmission port 123, or to select the local storage chip 13 to be connected to the communication conversion chip 142. The communication conversion chip 142 is used to report the physiological signals stored in the local storage chip 13 through the external communication interface 15. The above-mentioned external communication interface 15 can be used to communicate with the host computer. Through the offline storage circuit 14 in the embodiment of the present application, it is possible to control the local storage chip 13 to be connected to the second data transmission port 123, or to be connected to the communication conversion chip 142. When the physiological signal is collected, the collected physiological signal can be stored in the local storage chip 13, and when the physiological signal stored in the local storage chip 13 needs to be exported, and when the external communication interface 15 communicates with the host computer, it can be reported to the host computer.

[0072] In some embodiments, Figure 3 As shown, it can be Figure 2On the basis of, the above-mentioned offline storage circuit 14 can further include a second switch 143, and the second switch 143 is used to select the external communication interface 15 to be connected to the first data transmission port 122 of the data processing chip 12, or to select the external communication interface 15 to be connected to the communication conversion chip 142. The external communication interface 15 in this embodiment can be connected to the first data transmission port 122 according to the actual transmission requirements of the physiological signal, and the physiological signal can be reported in real time, and the physiological signal derived from the local storage chip 13 can be reported according to the actual requirements. Figure 3 In the illustrated embodiment, the local storage chip 13 and the first data transmission port 122 share the same external communication interface 15 , which can save one external communication interface 15 and thus reduce the equipment cost.

[0073] In some embodiments, the above-mentioned communication conversion chip 142 can be a USB conversion chip, and its corresponding external communication interface 15 can be a USB interface; in addition, the external storage chip 13 in the embodiment of the present application can be an SD card chip.

[0074] In some embodiments, the second switch 143 may not be provided, and two external communication interfaces 15 may be provided to provide external communication interfaces for the local storage chip 13 and the first data transmission port 122 .

[0075] In some embodiments, the external communication interface 15 may include at least one of a wired communication interface and / or a wireless communication interface. When only one external communication interface 15 is provided, it may be a wired communication interface or a wireless communication interface, and when two external communication interfaces 15 are provided, the two external communication interfaces 15 may be of the same type, for example, both may be wired communication interfaces or wireless communication interfaces, or one may be a wired communication interface and the other may be a wireless communication interface.

[0076] The technical solution provided by the embodiment of the present application can be provided with a wired communication interface or a wireless communication interface, that is, physiological signals can be reported in wireless mode or wired mode; at the same time, since a local storage chip is provided, the collected physiological signals can be stored in the local storage chip, thereby realizing offline storage of physiological signals, and the local storage chip can be used as a U disk, and the physiological signals stored therein can be read when needed. The above-mentioned situation where there is a need may include the situation where the physiological signals of the reported host computer are incomplete and the physiological signals need to be re-reported.

[0077] The multimodal human factors intelligent physiological signal acquisition edge device provided in the embodiment of the present application is as follows: Figure 4As shown, a power supply 16 and a charging interface 17 may also be provided, wherein the power supply 16 is used to power the data processing chip; the charging interface 17 is electrically connected to the power supply 16, and is used to charge the power supply 16. For the above-mentioned charging interface 17, or the external communication interface 15, especially the wired communication interface, the external electrical signal may interfere with the physiological signal acquisition or transmission in the internal circuit of the physiological signal acquisition device. Therefore, in the embodiment of the present application, an isolation circuit may be provided, for example, at least one of a first isolation circuit 18 and a second isolation circuit 19 may be provided, wherein the first isolation circuit 18 is provided between the charging interface 17 and the power supply 16, and is used to isolate the interference of the external mains power on the physiological signal acquisition or transmission in the internal circuit, and the first isolation circuit 18 may be an isolated DC-DC converter; the second isolation circuit 19 is provided between the external communication interface 15 and the second switching switch 143, and is used to isolate the interference of the external communication line on the physiological signal acquisition or transmission in the internal circuit, and when the external communication interface 15 is a USB communication interface, the second isolation circuit 19 may be a USB isolator.

[0078] As described in the above embodiments, in the embodiments of the present application, the physiological signals collected by the signal acquisition module can be classified into biological type electrical signals or bioelectric type electrical signals according to their types. For the above different types of physiological signals, the design of the signal acquisition module will also be different. Figure 5 As shown, the signal acquisition module 11 may include at least one of a biological type signal acquisition submodule 111 and a bioelectric type signal acquisition submodule 112, wherein the biological type signal acquisition submodule 111 is configured with at least two biological type signal acquisition ports S2, and the bioelectric type signal acquisition submodule 112 is configured with at least two bioelectric type signal acquisition ports S3, for respectively collecting biological type signals and bioelectric type signals. The above-mentioned biological type signal acquisition port S2 and bioelectric type signal acquisition port S3 are both a type of the above-mentioned physiological signal acquisition port S1.

[0079] In some embodiments, the biological type signal acquisition port can use various types of ports, for example, a Type-C port can be used. In addition, the biological type signal acquisition port can include two types of terminals, one type of terminal is used for signal transmission, and the other type of terminal is used for insertion detection, that is, Figure 6 As shown, the above-mentioned biological type signal acquisition port S2 may include a first signal transmission terminal 21 and an insertion detection terminal 22. The first signal transmission terminal 21 may be electrically connected to the signal receiving port 121 of the data processing chip to transmit the biological type signal; and as for the insertion detection terminal 22, the data processing chip may also include:

[0080] The first insertion detection port 124 is electrically connected to the insertion detection terminal 22, and the data processing chip is further used to detect the connection state of the insertion detection terminal 22, that is, whether the lead wire is connected, through the first insertion detection port 124. Specifically, the number of the above-mentioned first insertion detection ports 124 can be one or more. When multiple first insertion detection ports 124 are provided, they can be provided in a one-to-one correspondence with the insertion detection terminals 22, and the data processing chip 12 is used to detect whether the corresponding insertion detection terminal 22 is connected to the lead wire through each first insertion detection port 124.

[0081] In some embodiments, the data processing chip 12 can also be used to detect the type of connected lead wire. The type of lead wire is set in a one-to-one correspondence with the type of biological type signal. By detecting the type of connected lead wire, the type of biological type signal received through the lead wire can be determined.

[0082] In the embodiment of the present application, a pull-up resistor can be set on the first insertion detection port 124, and a pull-down resistor can be set on the lead line. Moreover, when there are multiple first insertion detection ports 124, the resistance values ​​of the pull-up resistors set thereon are all the same, while the pull-down resistors on the lead lines are all different. At this time, a detection voltage can be output to the first insertion detection port 124. When none of the insertion detection terminals 22 are connected to the lead line, they are in a disconnected state, and the above detection voltage remains unchanged. When the insertion detection terminal 22 is connected to the lead line, a voltage division will be generated due to the joint action of the above pull-up resistor and the pull-down resistor. Therefore, by detecting the voltage value, on the one hand, it can be detected whether the insertion detection terminal 22 is connected to the lead line; on the other hand, the type of the specifically connected lead line can be detected according to the different detected voltage values ​​caused by the different resistance values ​​of the pull-down resistors.

[0083] In some embodiments, in addition to providing a plurality of first insertion detection ports 124 corresponding to the insertion detection terminals 22 on the data processing chip in the above manner, a multiplexer may be provided to detect in a time-sharing manner whether the plurality of insertion detection terminals 22 are connected to lead wires and the types of lead wires. Figure 7 As shown, a first multiplexer 31 may be included, and the first multiplexer 31 is arranged between the insertion detection terminal 22 of at least two biological type signal acquisition ports and the first insertion detection port 124, and is used to select and conduct the insertion detection terminal 22 of one biological type signal acquisition port and the first insertion detection port 124. At this time, the first multiplexer 31 can conduct one insertion detection terminal 22 and the first insertion detection port 124 in a time-sharing manner, so that only one first insertion detection port 124 can be set on the data processing chip, and detection can be performed in a time-sharing manner.

[0084] In the embodiment of the present application, the biological type signal collected by each biological type signal collection port is usually an analog signal, that is, an analog biological type signal. In order to facilitate the analysis, storage and transmission of the biological type signal, it can be converted into a digital signal, that is, a digital biological type signal. Figure 8 As shown, a first analog-to-digital converter 113 can be further provided in the above-mentioned signal acquisition module 11, that is, in the biological type signal acquisition submodule 111. The first analog-to-digital converter 113 is provided between the first signal transmission terminal 21 of at least two biological type signal acquisition ports and the first signal receiving port 121 of the data processing chip, and is used for converting the analog biological type signal collected by the first signal transmission terminal 21 into a digital biological type signal.

[0085] Regarding the number of the first analog-to-digital converters 113, in one implementation manner, Figure 8 As shown, a first analog-to-digital converter 113 may be provided, and in some embodiments, may further include:

[0086] The second multiplexer 114 is provided between the first signal transmission terminals 21 of at least two biological type signal acquisition ports and the analog input terminal of the first analog-to-digital converter 113, and is used to select and conduct one first signal transmission terminal 21 and the analog input terminal of the first analog-to-digital converter 113. Thus, a first analog-to-digital converter 113 can be provided, and the analog biological type signals received from different first signal transmission terminals 21 are analog-to-digital converted by the first analog-to-digital converter 113 in a time-sharing manner, so as to obtain digital biological type signals.

[0087] In some other embodiments, multiple first analog-to-digital converters 113 may be provided, specifically: Fig. 9 As shown, the signal acquisition module 11, which can be the biological type signal acquisition submodule 111, includes at least two first analog-to-digital converters 113, and is arranged one-to-one with the first signal transmission terminal 21 of the biological type signal acquisition port. The at least two first analog-to-digital converters 113 are arranged in a daisy chain, and the first analog-to-digital converters 113 are used to start in sequence according to the selection signal of the data processing chip 12 to convert the analog biological type signal collected by the corresponding first signal transmission terminal 21 into a digital biological type signal. For the schematic diagram of the first analog-to-digital converter 113 arranged in a daisy chain, please refer to Fig.10As shown, the data processing chip 12 can control each first analog-to-digital converter 113 through the SPI communication protocol, and can set selection signal control terminals, namely SS1, SS2 and SS3, for outputting selection signals for each first analog-to-digital converter 113 to start the above-mentioned first analog-to-digital converter 113 in time-sharing manner. In addition, a clock signal terminal SCK and a master input slave output signal terminal (Master In Slave Out, MISO) can also be set to transmit clock signals and other data to the first analog-to-digital converter 113. Compared with the technical solution of using the second multiplexer 114 in the above-mentioned embodiment, due to the existence of the selection switching signal, the selection switching signal may interfere with each channel of the simulated biological signal. Therefore, the technical solution of using a plurality of first analog-to-digital converters 113 in daisy chain can effectively avoid the above-mentioned interference.

[0088] In the above embodiment of the present application, for each bioelectric type signal acquisition port S3, if Fig.11 As shown, it may include a second signal transmission terminal 23 and two common terminals 24. To detect whether the bioelectric type signal acquisition port S3 is connected, it is necessary to simultaneously detect whether the second signal transmission terminal 23 and the two common terminals 24 are both connected. In addition, for the bioelectric type signal acquisition port S3, since each port is provided with two common terminals 24, if there are multiple bioelectric type signal acquisition ports S3, they can share the common terminal 24, for example Fig.12 As shown, when four bioelectric type signal acquisition ports S3 are included, the second signal transmission terminal 23 of each bioelectric type signal acquisition port S3 is separately provided, and a common terminal 24 is shared. In some embodiments, considering the second signal transmission terminal 23 and the common terminal 24 included in the above-mentioned bioelectric type signal acquisition port S3, the structure and implementation method thereof are similar to those of the existing headphone interface. Therefore, in the embodiment of the present application, the bioelectric type signal acquisition port S3 can also be implemented by a headphone interface.

[0089] In the embodiments of the present application, the bioelectric type signal collected by each bioelectric type signal collection port is usually an analog signal, that is, an analog bioelectric type signal. In order to facilitate the analysis, storage and transmission of the bioelectric type signal, it can be converted into a digital signal, that is, a digital bioelectric type signal. In some embodiments, Fig.13 As shown, a second analog-to-digital converter 115 may also be included, which is arranged between the second signal transmission terminal 23 of at least two bioelectric type signal acquisition ports S3 and the second signal receiving port 125 of the data processing chip 12, and is used to convert the analog bioelectric type signal collected by the second signal transmission terminal 23 into a digital bioelectric type signal.

[0090] Regarding the number of the second analog-to-digital converters 115, in one implementation, as described above Fig.13 As shown, a second analog-to-digital converter 115 may be provided in the biological type signal acquisition submodule 111. In some embodiments, the following may also be included:

[0091] The third multiplexer 116 is provided between the second signal transmission terminals 23 of at least two bioelectric type signal acquisition ports S3 and the analog input terminal of the second analog-to-digital converter 115, and is used to select and conduct one second signal transmission terminal 23 and the analog input terminal of the second analog-to-digital converter 115. Thus, a second analog-to-digital converter 115 can be provided, and the analog bioelectric type signals received from different second signal transmission terminals 23 are analog-to-digital converted by the second analog-to-digital converter 115 in a time-sharing manner, so as to obtain digital bioelectric type signals.

[0092] In some other embodiments, multiple second analog-to-digital converters 115 may be provided, specifically, Fig.14 As shown, in the signal acquisition module 11, that is, in the biological type signal acquisition submodule 111, there are at least two second analog-to-digital converters 115, and they are arranged one-to-one with the second signal transmission terminals 23 of the bioelectric type signal acquisition port S3. The at least two second analog-to-digital converters 115 are arranged in a daisy chain, and the second analog-to-digital converters 115 are used to start in sequence according to the selection signal of the data processing chip 12 to convert the analog bioelectric type signal collected by the corresponding second signal transmission terminal 23 into a digital bioelectric type signal. For the schematic diagram of the second analog-to-digital converter 115 arranged in a daisy chain, please refer to Fig.15 As shown, the data processing chip 12 can control each second analog-to-digital converter 115 through the SPI communication protocol, and can set a selection signal control terminal, namely SS1, SS2 and SS3, for outputting a selection signal for each second analog-to-digital converter 115 to start the above-mentioned second analog-to-digital converter 115 in time-sharing manner. In addition, a clock signal terminal SCK and a master input slave output signal terminal (Master In Slave Out, referred to as: MISO) can also be set to transmit clock signals and other data to the second analog-to-digital converter 115 respectively. Wherein. Compared with the technical solution of using the third multiplexer 116 in the above embodiment, due to the existence of the selection switching signal, the selection switching signal may interfere with each analog bioelectric signal. Therefore, the technical solution of using a plurality of second analog-to-digital converters 115 in daisy chain can effectively avoid the above interference.

[0093] In the above embodiment of the present application, a multimodal human factors intelligent physiological signal acquisition edge device is provided, which can collect, store and report physiological signals based on the acquisition edge device, and the technical solution provided in the embodiment of the present application, due to the provision of a local storage chip, can store the reported physiological signals in the local storage chip while reporting the physiological signals to the upper computer in real time, and because the reported physiological signals can be transmitted by wire or wireless transmission methods, the physiological signals may be interfered with during the transmission process, resulting in incomplete signals, in which case the above-mentioned stored physiological signals can be derived from the local storage chip and then resent to the upper computer. Specifically, Fig.16 : is a flow chart of a physiological data collection method based on the multimodal human factors intelligent physiological signal collection edge device in an embodiment of the present application, such as Fig.16 As shown, the following steps are included:

[0094] Step 101: Send the physiological signal to the upper computer through the first data transmission port, and simultaneously send the physiological signal to the local storage chip through the second data transmission port, so as to store the physiological signal in the storage chip;

[0095] Step 102: When the host computer detects that the received physiological signal is incomplete, the stored physiological signal is exported from the local storage chip, and the physiological signal is resent to the host computer.

[0096] In an embodiment of the present application, by setting up a local storage chip, physiological signals can be stored, and when the reported physiological signals are missing due to unstable communication or interference, etc., so that the physiological signals received by the host computer are incomplete, the stored physiological signals can be exported from the local storage chip and the above-mentioned physiological signals can be resent to the host computer, thereby ensuring the integrity of the data.

[0097] Fig.17 This is a schematic diagram of the process of collecting physiological signals in the embodiment of the present application, wherein the multimodal human factors intelligent physiological signal collection edge device can refer to the above Figure 1-Figure 15 Any of the records in the embodiments, such as Fig.17 The method comprises the following steps:

[0098] Step 201, the host computer is turned on;

[0099] Step 202: The host computer detects whether there is a powered-on multimodal human factor intelligent physiological signal acquisition edge device. If yes, execute step 203; otherwise, execute step 206.

[0100] Step 203: The host computer determines that the signal transmission quality with the multimodal human factor intelligent physiological signal acquisition edge device meets the requirements, and then proceeds to step 204;

[0101] Step 204: recording the physiological signals collected by the multimodal human factor intelligent physiological signal collection edge device, that is, the multimodal human factor intelligent physiological signal collection edge device sends the collected physiological signals to the host computer;

[0102] Step 205: After the multimodal human factor intelligent physiological signal acquisition edge device completes the acquisition of the acquired physiological signal, the recording is ended;

[0103] Step 206: If the host computer in the above step 202 detects that the multimodal human factor intelligent physiological signal acquisition edge device is not powered on, the multimodal human factor intelligent physiological signal acquisition edge device may be controlled to be powered on;

[0104] Step 207: In the above step 204, the multimodal human factor intelligent physiological signal acquisition edge device may also store the collected physiological signals in a local storage chip while sending the collected physiological signals to the host computer;

[0105] Step 208: After the multimodal human factor intelligent physiological signal acquisition edge device completes the acquisition of the physiological signal, the storage ends;

[0106] Step 209, determining whether the recorded physiological signal is complete on the host computer, if complete, executing step 212, otherwise notifying the multimodal human factor intelligent physiological signal acquisition edge device to execute step 210, and executing step 211 on the host computer;

[0107] Step 210: After receiving the notification of incomplete physiological signals sent by the host computer, the multimodal human factor intelligent physiological signal acquisition edge device reads the stored physiological signals from the local storage chip and resends them to the host computer;

[0108] Step 211, the host computer receives and imports the physiological signals re-reported by the multimodal human factor intelligent physiological signal acquisition edge device;

[0109] Step 212: Perform data analysis on the physiological signal on the host computer.

[0110] Fig.18 Schematic diagram of the structure of a multi-modal human factor intelligent physiological signal acquisition system in an embodiment of the present application. Fig.18 As shown, the system includes the above Figure 1-Figure 15The multimodal human factor intelligent physiological signal acquisition edge device 21 in any of the embodiments, as well as the host computer 22 and multiple physiological signal acquisition devices 23. Specifically, the multiple physiological signal acquisition devices 23 can be connected to the multimodal human factor intelligent physiological signal acquisition edge device 21 through lead wires, and the multimodal human factor intelligent physiological signal acquisition edge device can be used to collect different types of physiological signals from the above multiple physiological signal acquisition devices and send them to the host computer.

[0111] The multimodal human factors intelligent physiological signal acquisition system provided in the embodiment of the present application can collect multiple types of physiological signals to meet the application scenarios in the field of human factors engineering for multiple types of physiological signals at the same time; at the same time, a first data transmission port and a second data transmission port are set on the data processing chip of the multimodal human factors intelligent physiological signal acquisition edge device, wherein the first data transmission port is used to report the physiological signal in real time, and the second data transmission port is used to send the physiological signal to the local storage chip. Furthermore, in the technical solution provided in the embodiment of the present application, the collected physiological signals can be reported in real time, or stored in the local storage chip, and the physiological signals are stored in an offline manner, or the physiological signals in the local storage chip can be reported later according to actual needs, so that multiple modes of physiological signal reporting methods can be realized, and thus the needs of different application scenarios can be better adapted. For other detailed technical effects, please refer to the introduction in the above-mentioned embodiments.

[0112] In some embodiments, the above-mentioned physiological signal acquisition device may include at least one of a wearable device, a portable physiological signal sensor and a bioelectric type signal acquisition device, wherein the wearable device may include devices such as smart watches, smart bracelets or smart glasses; the portable physiological signal sensor may include a portable sensor for measuring blood pressure, heart rate, blood oxygen saturation, respiratory rate, etc.; the bioelectric type signal acquisition device may include a device for measuring EEG signals, EMG signals, ECG signals, etc., such as an EEG cap for measuring EEG signals.

[0113] The embodiment of the present application also provides a computer storage medium for storing a computer program. When the computer program is executed by a processor, it is used to implement the above-mentioned physiological signal acquisition method. It has the technical effects recorded in the above-mentioned embodiment and will not be repeated in this embodiment.

[0114] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.

[0115] In addition, although each operation is described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or to be performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the application. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0116] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A multimodal human factors intelligent physiological signal acquisition edge device, characterized in that: include: A signal acquisition module, wherein the signal acquisition module comprises at least two signal acquisition ports, wherein the at least two signal acquisition ports are respectively used to acquire different types of physiological signals, wherein the physiological signals comprise biological type signals and / or bioelectric type signals; A data processing chip, the data processing chip comprising a signal receiving port, a first data sending port, and a second data sending port, wherein the signal receiving port is used to receive the physiological signal collected from the at least two physiological signal collection ports, the first data sending port is used to report the physiological signal in real time, and the second data sending port is used to send the physiological signal to a local storage chip; The local storage chip is used to store the physiological signal.

2. The device according to claim 1, characterized in that The biological type signal includes at least one of a photoplethysmography signal, a blood oxygen saturation signal, a skin electrical response signal, a breathing signal, a skin temperature signal and a single-point force-sensitive resistor signal; the bioelectric type signal includes at least one of an electromyogram, an electroencephalogram and an electrocardiogram signal.

3. The device according to claim 1 or 2, characterized in that Also includes: External communication interface; An offline storage circuit, wherein the offline storage circuit comprises a first switching switch and a communication conversion chip, wherein the first switching switch is used to select to connect the local storage chip to the second data transmission port, or to select to connect the local storage chip to the communication conversion chip, and the communication conversion chip is used to report the physiological signal stored in the local storage chip through an external communication interface.

4. The device according to claim 3, characterized in that The offline storage circuit further includes a second switch, and the second switch is used to select to connect the external communication interface to the first data sending port of the data processing chip, or to select to connect the external communication interface to the communication conversion chip.

5. The device according to claim 4, characterized in that The device also includes: A power supply, used to supply power to the data processing chip; A charging interface, electrically connected to the power source, and used to charge the power source; And one of a first isolation circuit and a second isolation circuit, the first isolation circuit is arranged between the charging interface and the power supply; the second isolation circuit is arranged between the external communication interface and the second switching switch.

6. The device according to claim 1 or 2, characterized in that The signal acquisition module includes a biological type signal acquisition submodule and / or a bioelectric type signal acquisition submodule, the biological type signal acquisition submodule is configured with at least two biological type signal acquisition ports, and the bioelectric type signal acquisition submodule is configured with at least two bioelectric type signal acquisition ports.

7. The device according to claim 6, characterized in that The biological type signal acquisition port includes a first signal transmission terminal and an insertion detection terminal; The data processing chip also includes: The first insertion detection port is electrically connected to the insertion detection terminal, and the data processing chip is further used to detect whether the insertion detection terminal is connected to a lead wire through the first insertion detection port.

8. The device according to claim 7, characterized in that The data processing chip is also used to detect the type of the connected lead wire, and the type of the lead wire is set corresponding to the type of the biological type signal.

9. The device according to claim 8, characterized in that The first insertion detection port is provided with a pull-up resistor, and the connected lead line is provided with a pull-down resistor. The pull-up resistors provided on the first insertion detection port have the same resistance value, and the pull-down resistors on the lead lines are different.

10. The device according to claim 7, characterized in that Also includes at least one of the following: A first multiplexer, disposed between the insertion detection terminals of the at least two biological type signal acquisition ports and the first insertion detection port, for selectively connecting the insertion detection terminal of one biological type signal acquisition port and the first insertion detection port; The first analog-to-digital converter is arranged between the first signal transmission terminals of the at least two biological type signal acquisition ports and the first signal receiving port of the data processing chip, and is used to convert the analog biological type signal acquired by the first signal transmission terminal into a digital biological type signal.

11. The device according to claim 10, characterized in that Also includes: A second multiplexer is provided between the first signal transmission terminals of the at least two biological type signal acquisition ports and the analog input terminal of the first analog-to-digital converter, and is used for selectively connecting one first signal transmission terminal and the analog input terminal of the first analog-to-digital converter; and / or, There are at least two first analog-to-digital converters, and they are arranged in a one-to-one correspondence with the first signal transmission terminals of the biological type signal acquisition port. At least two of the first analog-to-digital converters are arranged in a daisy chain manner, and are used to be started in sequence according to the selection signal of the data processing chip to convert the analog biological type signal collected by the corresponding first signal transmission terminal into a digital biological type signal.

12. The device according to claim 6, characterized in that The bioelectric type signal acquisition port includes a second signal transmission terminal and two common terminals; The second analog-to-digital converter is arranged between the second signal transmission terminals of the at least two bioelectric type signal acquisition ports and the second signal receiving port of the data processing chip, and is used to convert the analog bioelectric type signal collected by the second signal transmission terminal into a digital bioelectric type signal.

13. The device according to claim 12, characterized in that Also includes: A third multiplexer is provided between the second signal transmission terminals of the at least two bioelectric type signal acquisition ports and the analog input terminal of the second analog-to-digital converter, and is used for selectively connecting one second signal transmission terminal and the analog input terminal of the second analog-to-digital converter; and / or, There are at least two second analog-to-digital converters, and they are arranged one-to-one corresponding to the second signal transmission terminals of the biological type signal acquisition port. At least two of the second analog-to-digital converters are arranged in a daisy chain manner, and are used to start in sequence according to the selection signal of the data processing chip to convert the analog bioelectric type signal collected by the corresponding second signal transmission terminal into a digital bioelectric type signal.

14. A multimodal human factors intelligent physiological signal acquisition system, characterized in that: It comprises a multimodal human factors intelligent physiological signal acquisition edge device as described in any one of claims 1-13, as well as a host computer and multiple physiological signal acquisition devices, wherein the multimodal human factors intelligent physiological signal acquisition device is used to collect different types of physiological signals from the multiple physiological signal acquisition devices and send them to the host computer.

15. The system according to claim 14, characterized in that The physiological signal acquisition device includes at least one of a wearable device, a portable physiological signal sensor and a bioelectric signal acquisition device.

16. A physiological signal acquisition method based on the multimodal human factor intelligent physiological signal acquisition edge device according to any one of claims 1 to 13, characterized in that: The method comprises: Sending the physiological signal to the upper computer through the first data sending port, and simultaneously sending the physiological signal to the local storage chip through the second data sending port, so as to store the physiological signal in the storage chip; When the host computer detects that the received physiological signal is incomplete, the stored physiological signal is exported from the local storage chip, and the physiological signal is resent to the host computer.

17. A computer storage medium, characterized in that: Used to store a computer program, which is used to implement the physiological signal acquisition method according to claim 16 when executed by a processor.

Images