Respiration monitoring device, respiration monitoring method, and respiration monitoring program

The portable terminal-based respiratory monitoring system addresses the challenge of easily detecting hyperventilation by using a portable terminal with sensors and cameras to assess momentum, respiratory rate, and heart rate, providing a non-invasive and effective solution.

JP2025040749APending Publication Date: 2025-03-25JVC KENWOOD CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023147742
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-09-12
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

Existing respiratory monitoring devices require dedicated equipment and are not effective in easily determining whether a person's breathing is hyperventilated, especially in cases of psychogenic hyperventilation.

Method used

A portable terminal-based respiratory monitoring system that includes a momentum measuring unit, a respiratory rate measuring unit, a heart rate acquisition unit, and a hyperventilation determination unit, which uses acceleration sensors, cameras, and microphones to assess momentum, respiratory rate, and heart rate to determine hyperventilation without the need for dedicated devices.

Benefits of technology

Enables easy and non-invasive determination of hyperventilation without the need for dedicated equipment, effectively addressing the limitations of existing technologies in detecting psychogenic hyperventilation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025040749000001_ABST
    Figure 2025040749000001_ABST
Patent Text Reader

Abstract

To provide a respiration monitoring device capable of easily determining whether a user is experiencing hyperventilation.SOLUTION: A motion amount measurement unit 101 measures a motion amount of a user on the basis of acceleration detected by an acceleration sensor 12 or captured images obtained by imaging the user by a camera 11. A respiration rate measurement unit 102 measures a respiration rate of the user on the basis of the captured images or respiratory sounds of the user collected by a microphone 13. A heart rate acquisition unit 103 acquires a heart rate of the user measured on the basis of the captured images or the heart rate of the user measured by a heart rate meter 21. A hyperventilation determination unit 108 determines that respiration of the user is hyperventilation when the user is not in motion and the respiration rate and the heart rate of the user are equal to or greater than predetermined threshold values.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a respiratory monitoring device, a respiratory monitoring method, and a respiratory monitoring program. [Background technology]

[0002] Patent Document 1 describes determining whether or not a user's breathing is hyperventilation based on the blood flow rate in the brain. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-161246 A [Patent Document 2] JP 2016-142825 A [Patent Document 3] International Publication No. 2020 / 226182 Summary of the Invention [Problem to be solved by the invention]

[0004] If a respiration monitoring device is configured using the technology described in Patent Document 1, it is necessary to use a dedicated device, and it is not easy to determine whether one's own breathing is hyperventilation or not. Hyperventilation can occur as a result of excessive breathing due to intense exercise, but it can also be psychogenic hyperventilation. When it is caused by excessive exercise, it is easy to recognize that one is hyperventilating. On the other hand, when it is psychogenic hyperventilation caused by anxiety or stress, it can be difficult to recognize whether one is hyperventilating or not.

[0005] The present invention aims to provide a breathing monitoring device, a breathing monitoring method, and a breathing monitoring program that can easily determine whether or not a person's own breathing is hyperventilation, without the need for a dedicated device to determine whether or not a person's breathing is hyperventilation. [Means for solving the problem]

[0006] The present invention provides a respiratory monitoring device comprising: an exercise amount measuring unit that measures a user's exercise amount based on acceleration detected by an acceleration sensor provided in a portable terminal carried by the user, or based on an image of the user captured by a camera provided in the portable terminal; a respiratory rate measuring unit that measures the user's respiratory rate based on the captured image or the user's breathing sounds picked up by a microphone provided in the portable terminal; a heart rate acquisition unit that acquires the user's heart rate measured based on the captured image or the user's heart rate measured by a heart rate monitor; and a hyperventilation determination unit that determines that the user's breathing is hyperventilation based on the user's exercise amount measured by the exercise amount measuring unit when the user is not exercising and the user's respiratory rate measured by the respiratory rate measuring unit and the user's heart rate acquired by the heart rate acquisition unit are equal to or higher than a predetermined determination value.

[0007] The present invention provides a breathing monitoring method which measures a user's amount of physical activity based on acceleration detected by an acceleration sensor provided in a mobile terminal carried by the user or based on an image of the user captured by a camera provided in the mobile terminal, measures the user's breathing rate based on the captured image or the user's breathing sounds picked up by a microphone provided in the mobile terminal, obtains the user's heart rate measured based on the captured image or the user's heart rate measured by a heart rate meter, and determines that the user's breathing is hyperventilation based on the user's amount of physical activity when the user is not exercising and the user's breathing rate and the user's heart rate are equal to or greater than a predetermined judgment value.

[0008] The present invention provides a respiratory monitoring program that causes a computer to execute the steps of measuring a user's amount of physical activity based on acceleration detected by an acceleration sensor provided in a portable terminal carried by the user or based on an image of the user captured by a camera provided in the portable terminal; measuring the user's respiratory rate based on the captured image or the user's breathing sounds picked up by a microphone provided in the portable terminal; acquiring the user's heart rate measured based on the captured image or the user's heart rate measured by a heart rate meter; and determining that the user's breathing is hyperventilation when the user is not exercising and the user's respiratory rate and heart rate are equal to or greater than a predetermined judgment value based on the user's amount of physical activity. Effect of the Invention

[0009] According to the respiratory monitoring device, the respiratory monitoring method, and the respiratory monitoring program of the present invention, there is no need for a dedicated device to determine whether one's own breathing is hyperventilation or not, and it is possible to easily determine whether one is hyperventilating or not. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram illustrating a respiratory monitoring device according to one embodiment. [Diagram 2] FIG. 2 is a flowchart showing the operation of a respiratory monitoring device according to an embodiment, a respiratory monitoring method according to an embodiment, and processing realized by a computer (central processing unit) executing a respiratory monitoring program according to an embodiment. [Diagram 3] FIG. 3 is a flowchart showing the details of step S4 in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a respiratory monitoring device, a respiratory monitoring method, and a respiratory monitoring program according to an embodiment will be described with reference to the accompanying drawings. In Fig. 1, a user carries a mobile terminal 100. The mobile terminal 100 is, for example, a smartphone. The user wears a wristwatch-type terminal 200 on his or her wrist.

[0012] The mobile terminal 100 includes a central processing unit 10, a camera 11, an acceleration sensor 12, a microphone 13, a short-range wireless communication unit 14, a GNSS receiving unit 15, a map information storage unit 16, a communication unit 17, a registration unit 18, a display unit 119, and a speaker 120. The central processing unit 10 is provided in a computer such as a microcomputer. The central processing unit 10 includes, as functional components, an exercise amount measuring unit 101, a respiratory rate measuring unit 102, a heart rate acquiring unit 103, an oxygen saturation concentration acquiring unit 104, a breathing method determining unit 105, a position detecting unit 106, a cautionary place determining unit 107, a hyperventilation determining unit 108, a display control unit 109, and an audio output control unit 110.

[0013] The central processing unit 10 executes a respiration monitoring program stored in a non-transitory storage medium (not shown), thereby realizing the functions of the exercise amount measuring unit 101 to the audio output control unit 110.

[0014] The wristwatch type terminal 200 includes a heart rate meter 21, an oxygen saturation meter 22, and a short-range wireless communication unit 23. The heart rate meter 21 measures the user's heart rate, and the short-range wireless communication unit 23 transmits the measured heart rate to the short-range wireless communication unit 14. The oxygen saturation meter 22 measures the oxygen saturation concentration in the user's blood, and the short-range wireless communication unit 23 transmits the measured oxygen saturation concentration to the short-range wireless communication unit 14. Typically, the short-range wireless communication units 14 and 23 adopt Bluetooth (registered trademark) as a short-range wireless communication standard. The mobile terminal 100 may include functions equivalent to the heart rate meter 21 and the oxygen saturation meter 22. The wristwatch type terminal 200 is not essential. As described later, the mobile terminal 100 can measure the heart rate. Furthermore, even if the oxygen saturation concentration cannot be obtained, it is possible to determine whether or not hyperventilation is occurring.

[0015] The camera 11 photographs the user. When the user holds the mobile terminal 100 in his / her hand and points his / her face towards the camera 11, the camera 11 may photograph the user. The exercise amount measuring unit 101 measures the amount of exercise of the user over a predetermined period of time based on the acceleration detected by the acceleration sensor 12 or an image captured by the camera 11 of the user. The respiratory rate measuring unit 102 measures the respiratory rate of the user based on the captured image or the breathing sound of the user picked up by the microphone 13.

[0016] The heart rate acquisition unit 103 acquires the user's heart rate received by the short-range wireless communication unit 14. The heart rate acquisition unit 103 may acquire the user's heart rate measured based on a captured image of the user. The heart rate can be measured based on subtle changes in the red color of the user's skin. The oxygen saturation concentration acquisition unit 104 acquires the user's oxygen saturation concentration received by the short-range wireless communication unit 14.

[0017] Google Inc. of the United States has announced that it has developed a function to estimate a person's heart rate and respiration rate using a smartphone camera. MICIN Corporation has announced that it has developed an application program that captures a person's breathing sounds using a smartphone microphone. Thus, the breathing rate measurement unit 102 can measure the breathing rate based on a captured image or breathing sounds, and the heart rate acquisition unit 103 can acquire the heart rate based on a captured image.

[0018] The breathing method determination unit 105 determines whether the user is performing abdominal breathing or thoracic breathing based on the captured image. As a detailed method for determining whether the user is performing abdominal breathing or thoracic breathing, the method described in Patent Document 2 or 3 can be adopted.

[0019] The GNSS receiver 15 receives radio waves from three or more satellites for a Global Navigation Satellite System (GNSS). An example of the GNSS is the Global Positioning System (GPS). The position detector 106 calculates the position (latitude and longitude) of the mobile terminal 100 based on the GNSS signal received by the GNSS receiver 15.

[0020] The communication unit 17 receives map information corresponding to the position calculated by the position detection unit 106 from the map providing server 400 via the network 300. Typically, the network 300 is the Internet. The map information storage unit 16 stores the received map information. The map information storage unit 16 can be configured with a rewritable memory such as a RAM. The position detection unit 106 detects the user's position by referring to the map information. The user's position is a specific place such as a train station, inside a train, or in a park.

[0021] The communication unit 17 is a telephone line, a wireless LAN, or the like. The map information storage unit 16 is not limited to temporarily storing map information provided by the map providing server 400. The map information storage unit 16 may store map information that has been stored in advance. In this case, the map information storage unit 16 may be a read-only memory such as a ROM.

[0022] The registration unit 18 registers caution places where the user is likely to hyperventilate. The registration unit 18 can be configured with a non-volatile memory. Hyperventilation here refers to hyperventilation syndrome that occurs due to mental stress such as tension and anxiety. The hyperventilation that is the subject of judgment in this embodiment is mainly psychogenic hyperventilation. The caution place may be the name of a facility such as a station or a department store, or may be the name of a place such as a park, or may be a place name. The caution place judgment unit 107 judges whether the position of the user detected by the position detection unit 106 corresponds to a caution place registered in the registration unit 18.

[0023] The hyperventilation determination unit 108 determines whether or not the user's breathing is hyperventilation when the user is not exercising, based on the user's exercise amount measured by the exercise amount measurement unit 101. The hyperventilation determination unit 108 determines that the user's breathing is hyperventilation when the user's breathing rate measured by the breathing rate measurement unit 102 and the user's heart rate acquired by the heart rate acquisition unit 103 are equal to or higher than predetermined determination values ​​set for each.

[0024] The hyperventilation determination unit 108 may change the determination value depending on the oxygen saturation concentration of the user acquired by the oxygen saturation concentration acquisition unit 104. The hyperventilation determination unit 108 may change the determination value depending on the breathing method of the user determined by the breathing method determination unit 105. The hyperventilation determination unit 108 may change the determination value depending on whether the user is in a cautionary place determined by the cautionary place determination unit 107.

[0025] The hyperventilation determination unit 108 is set with a judgment value that is a reference for each of the respiratory rate and the heart rate. When the oxygen saturation concentration of the user acquired by the oxygen saturation concentration acquisition unit 104 is, for example, 97% or more, the hyperventilation determination unit 108 may lower the judgment value by one step. When the breathing method of the user determined by the breathing method determination unit 105 is not abdominal breathing, the hyperventilation determination unit 108 may lower the judgment value by one step. When the user is in a cautionary location, the hyperventilation determination unit 108 may lower the judgment value by one step.

[0026] In this way, when the oxygen saturation concentration is equal to or higher than a predetermined value, the judgment value is preferably set to a lower value than the judgment value when the oxygen saturation concentration is less than the predetermined value, so that the hyperventilation judgment unit 108 is more likely to judge that the user has hyperventilated. If the user's breathing method is thoracic breathing, the judgment value is preferably set to a lower value than the judgment value when the user has abdominal breathing, so that the hyperventilation judgment unit 108 is more likely to judge that the user has hyperventilated. If the user is in a cautionary location, the judgment value is preferably set to a lower value than the judgment value when the user is not in a cautionary location, so that the hyperventilation judgment unit 108 is more likely to judge that the user has hyperventilated.

[0027] When the hyperventilation determination unit 108 determines that the user is hyperventilating, it controls the display control unit 109 to display notification information such as characters and images on the display unit 119 to inform the user that hyperventilation is occurring. The display unit 119 can be configured with a liquid crystal panel or an organic EL panel. Furthermore, when the hyperventilation determination unit 108 determines that the user is hyperventilating, it controls the audio output control unit 110 to inform the user that hyperventilation is occurring by audio output from the speaker 120. Either one of the notification by characters, images, etc. displayed on the display unit 119 or the notification by audio output from the speaker 120 may be used, or both may be used.

[0028] The hyperventilation determination unit 108 may control the display control unit 109 or the audio output control unit 110 to advise the user of the optimal breathing timing by using characters, images, etc. displayed on the display unit 119 or audio output from the speaker 120. The advice may be either or both of the characters, images, etc. displayed on the display unit 119 and audio output from the speaker 120. For example, the advice may be to make the inhalation time and exhalation time 1:2 and to make the exhalation time longer.

[0029] The operation of the mobile terminal 100, a respiration monitoring method executed by the mobile terminal 100, and processing realized by the central processing unit 10 executing a respiration monitoring program will be described with reference to the flowcharts of FIGS.

[0030] 2, when the central processing unit 10 starts executing the respiration monitoring program, the hyperventilation determination unit 108 acquires the amount of exercise of the user in step S1. The hyperventilation determination unit 108 acquires the user's heart rate in step S2, and acquires the user's respiratory rate in step S3. The order of steps S1 to S3 is arbitrary. The hyperventilation determination unit 108 determines the judgment values ​​of the heart rate and the respiratory rate in step S4.

[0031] Fig. 3 shows the details of step S4. In Fig. 3, the hyperventilation determination unit 108 determines whether or not the user is breathing abdominally in step S41. If the user is not breathing abdominally (NO) (i.e., if the user is breathing thoracicly), the hyperventilation determination unit 108 lowers the determination value by one step in step S42 and shifts the process to step S43. If the user is breathing abdominally (YES), the hyperventilation determination unit 108 shifts the process to step S43.

[0032] In step S43, the hyperventilation determination unit 108 determines whether or not the user is in a cautionary location. If the user is in a cautionary location (YES), in step S44, the hyperventilation determination unit 108 lowers the determination value by one step and transitions the process to step S45. If the user is not in a cautionary location (NO), the hyperventilation determination unit 108 transitions the process to step S45.

[0033] In step S45, the hyperventilation determination unit 108 determines whether the oxygen saturation concentration is equal to or greater than a predetermined value. If the oxygen saturation concentration is equal to or greater than the predetermined value (YES), in step S46 the hyperventilation determination unit 108 lowers the determination value by one step and transitions the process to step S47. If the oxygen saturation concentration is not equal to or greater than the predetermined value (NO), the hyperventilation determination unit 108 transitions the process to step S47. If the hyperventilation determination unit 108 is unable to acquire the oxygen saturation concentration in step S45, it transitions the process to step S47. In step S47, the hyperventilation determination unit 108 determines the final determination value.

[0034] The order of steps S41, S43, and S45 is arbitrary. Any one of steps S41, S43, and S45 may be provided. Any two of steps S41, S43, and S45 may be provided.

[0035] Returning to FIG. 2, in step S5, hyperventilation determination unit 108 determines whether the user is not exercising and the heart rate and respiratory rate are equal to or higher than the determination value. If the user is not exercising and the heart rate and respiratory rate are not equal to or higher than the determination value (NO), hyperventilation determination unit 108 returns the process to step S1. If the user is not exercising and the heart rate and respiratory rate are equal to or higher than the determination value (YES), hyperventilation determination unit 108 notifies the user that the respiratory rate is higher in step S6. In step S7, hyperventilation determination unit 108 gives advice on how to breathe. It is not essential to provide step S7, but it is preferable to provide it.

[0036] In step S8, the hyperventilation determination unit 108 determines whether or not to end the respiration monitoring process. If the respiration monitoring process is not to be ended (NO), the hyperventilation determination unit 108 returns the process to step S1. If the respiration monitoring process is to be ended (YES), the hyperventilation determination unit 108 ends the execution of the respiration monitoring program.

[0037] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the gist of the present invention. [Explanation of symbols]

[0038] 10 Central Processing Unit 11 Camera 12 Acceleration Sensor 13 Microphone 14,23 Near field wireless communication department 15 GNSS receiver 16 Map information storage unit 17 Communications Department 18 Registration Department 21 Heart Rate Monitor 22 Oxygen saturation meter 100 Mobile Devices 101 Exercise Measurement Section 102 Respiratory rate measurement unit 103 Heart rate acquisition unit 104 Oxygen saturation concentration acquisition unit 105 Breathing method determination section 106 Position detection unit 107 Caution place determination section 108 Hyperventilation determination section 109 Display control section 110 Audio output control unit 119 Display section 120 Speaker 200 Watch-type terminal 300 Network 400 Map provider server

Claims

1. an exercise amount measuring unit that measures an exercise amount of the user based on acceleration detected by an acceleration sensor provided in a mobile terminal carried by the user or an image of the user captured by a camera provided in the mobile terminal; A respiration rate measuring unit that measures the respiration rate of the user based on the captured image or the breathing sound of the user picked up by a microphone provided in the mobile terminal; a heart rate acquisition unit that acquires the user's heart rate measured based on the captured image or the user's heart rate measured by a heart rate meter; a hyperventilation determination unit that determines that the user is hyperventilating when the user is not exercising based on the amount of exercise of the user measured by the exercise amount measurement unit, and the respiration rate of the user measured by the respiration rate measurement unit and the heart rate of the user acquired by the heart rate acquisition unit are equal to or greater than a predetermined determination value; A respiratory monitoring device comprising:

2. Measure the amount of exercise of the user based on acceleration detected by an acceleration sensor provided in a mobile device carried by the user or an image of the user captured by a camera provided in the mobile device; Measure the respiration rate of the user based on the captured image or the breathing sound of the user picked up by a microphone provided in the mobile terminal; acquiring a heart rate of the user measured based on the captured image or a heart rate of the user measured by a heart rate meter; When the user is not exercising based on the amount of exercise of the user, and the respiration rate and the heart rate of the user are equal to or higher than a predetermined determination value, the respiration of the user is determined to be hyperventilation. Respiratory monitoring methods.

3. On the computer, measuring an amount of exercise of the user based on acceleration detected by an acceleration sensor provided in a mobile terminal carried by the user or an image of the user captured by a camera provided in the mobile terminal; Measuring the respiration rate of the user based on the captured image or the breathing sound of the user picked up by a microphone provided in the mobile terminal; acquiring a heart rate of the user measured based on the captured image or a heart rate of the user measured by a heart rate meter; determining that the user is hyperventilating when the user is not exercising based on the amount of exercise of the user and the respiration rate and the heart rate of the user are equal to or greater than a predetermined determination value; A respiratory monitoring program that

4. The computer includes: determining whether the user is performing abdominal breathing or thoracic breathing based on the captured image; When it is determined that the user is performing thoracic breathing, the determination value is set to a value lower than that when it is determined that the user is performing abdominal breathing; 4. The respiratory monitoring program of claim 3, further comprising:

5. The computer includes: A step of determining whether the user is in a caution location that has been registered in advance; When it is determined that the user is in the caution location, the determination value is set to a value lower than a value when the user is not in the caution location; 5. The respiratory monitoring program according to claim 3, further comprising:

Citation Information

Patent Citations

  • Singing evaluation device and singing evaluation program

    JP2016142825A

  • Information processing device, information processing method, and information processing program

    JP2018161246A

  • Breathing state detection apparatus, breathing state detection method, and breathing state detection program

    WO2020226182A1