Cardiopulmonary resuscitation device and system

Abstract

Provided are a system and a cardiopulmonary resuscitation device that primarily assist with smooth execution of tracheal intubation even during cardiopulmonary resuscitation.　A cardiopulmonary resuscitation device according to the present invention comprises an intubation arm, an imaging unit, a tube, an image processing control unit, and a drive control unit. The intubation arm comprises a flap part. The imaging unit is attached to the intubation arm. The image processing control unit comprises an epiglottis recognition unit and an insertion position determination unit. The drive control unit comprises a flap control unit and a tube contol unit. The epiglottis recognition unit recognizes at least a partial region of an epiglottis in an image or video imaged by the imaging unit. The insertion position determination unit recognizes a glottis region in the image or video and determines an insertion reference position for the tube on the basis of the recognized glottis region. The flap control unit controls the flap part so as to open the recognized epiglottis. The tube control unit controls the insertion of the tube on the basis of the tube insertion reference position.

Description

Cardiopulmonary resuscitation devices and systems

[0001] The present invention relates to cardiopulmonary resuscitation devices and systems.

[0002] Conventionally, devices for assisting tracheal intubation are known.

[0003] Patent document 1 discloses an intubation device that assists intubation by indicating the target site, such as the glottis, in an image displayed on the display unit of the intubation device after the operator inserts the intubation device into the subject's mouth.

[0004] Japanese Patent Application Laid-Open No. 2019-170666

[0005] However, to insert the intubation device to the desired position near the glottis, it is first necessary to identify the epiglottis and then insert the intubation device past the epiglottis. This action also requires specialized skills, and conventional devices are insufficient to support intubation.

[0006] The present invention has been made in view of the above circumstances, and aims to provide a cardiopulmonary resuscitation device and system that primarily supports smooth execution of tracheal intubation during cardiopulmonary resuscitation.

[0007] According to the present invention, the following inventions are provided: [1] A cardiopulmonary resuscitation device comprising an intubation arm, an imaging unit, a tube, an image processing control unit, and a drive control unit, wherein the intubation arm comprises a flap unit, the imaging unit is attached to the intubation arm, the image processing control unit comprises an epiglottis recognition unit and an insertion position determination unit, the drive control unit comprises a flap control unit and a tube control unit, the epiglottis recognition unit recognizes at least a partial region of the epiglottis in an image or video captured by the imaging unit, the insertion position determination unit recognizes a glottis region in the image or video and determines an insertion reference position for the tube based on the recognized glottis region, the flap control unit controls the flap unit to open the recognized epiglottis, and the tube control unit controls insertion of the tube based on the insertion reference position for the tube. [2] The cardiopulmonary resuscitation device according to [1], wherein the epiglottis recognition unit recognizes at least a partial region of the epiglottis in the image or the video based on a first learning model, and the insertion position determination unit recognizes the glottis region in the image or the video based on a second learning model, and determines an insertion reference position for the tube based on the recognized glottis region. [3] The cardiopulmonary resuscitation device according to [2], wherein the first learning model is configured, when the image or the video is input to the first learning model, to recognize the extent of the epiglottis in the image or the video and output at least a partial region of the epiglottis from within the range of the epiglottis, and the second learning model is configured, when the image or the video is input to the second learning model, to recognize the extent of the glottis region in the image or the video and output the glottis region from within the range of the glottis. [4] The cardiopulmonary resuscitation device according to any one of [1] to [3], wherein the flap portion is formed in an alligator mouth shape and has a flap balloon therein, and the flap portion is configured to be opened by the expansion of the flap balloon. [5] The cardiopulmonary resuscitation device according to any one of [1] to [4], wherein the intubation arm comprises a guide unit and a guide portion, the guide unit comprises the flap portion and is formed in a cylindrical shape,a tube control unit that controls the guide unit to move to a position where the flap can open the epiglottis, and a tube control unit that controls the guide unit to move to a position where the flap can open the epiglottis. [6] The cardiopulmonary resuscitation device according to any one of [1] to [5], further comprising an electrocardiogram acquisition unit, an exhaled breath measurement unit, and a treatment decision unit, wherein the electrocardiogram acquisition unit is configured to be able to acquire electrocardiogram data, the exhaled breath measurement unit is configured to measure exhaled breath data, and the treatment decision unit decides whether to perform cardiopulmonary resuscitation on the subject based on the electrocardiogram data and the exhaled breath data. [7] The cardiopulmonary resuscitation device according to any one of [1] to [6], further comprising a holding arm and a holding arm control section, wherein the intubation arm comprises a guide unit, a guide section, and an intubation section, the guide unit comprises the flap section and a fixing balloon, and is formed in a cylindrical shape, the guide section is a rod-shaped member, and the imaging section is attached to a tip thereof, the intubation section is configured to allow the tube to be attached and detached, and the guide unit, the guide section, and the tube are arranged so that the tube is located inside the cylindrical interior of the guide unit and the guide section is located inside the tube, and the flap section and the tube also move in accordance with the movement of the guide section. the tube control unit controls the driving of the guide unit so that the flap unit moves to a position where the epiglottis can be opened, controls the driving of the intubation unit so that the tube is inserted, and determines to detach the tube when a tube detachment condition is satisfied; the flap unit is formed in an alligator mouth shape and has a flap balloon therein; the flap unit is configured to be opened by the flap balloon being inflated; the fixing balloon is provided adjacent to the flap unit and is inflatable; the holding arm holds the intubation arm; and the holding arm control unitIt is possible to determine to detach the guide unit based on a guide unit detachment condition, and the epiglottis recognition unit recognizes at least a partial region of the epiglottis in the image or the video based on a first learning model, and the first learning model is configured to recognize the range of the epiglottis in the image or the video when the image or the video is input to the first learning model, and output at least a partial region of the epiglottis from within the range of the epiglottis, and the insertion position determination unit recognizes a glottis region in the image or the video based on a second learning model, and and determining a reference position for insertion of the tube, and a second learning model configured to recognize the extent of the glottis region in the image or the video when the image or the video is input to the second learning model and output the glottis region from within the extent of the glottis region, and the cardiopulmonary resuscitation device further comprises an electrocardiogram acquisition unit, an exhaled breath measurement unit, and a treatment decision unit, wherein the electrocardiogram acquisition unit is configured to be able to acquire electrocardiogram data, the exhaled breath measurement unit is configured to be able to measure exhaled breath data, and the treatment decision unit decides whether to perform cardiopulmonary resuscitation on the subject based on the electrocardiogram data and the exhaled breath data. [8] A system comprising an imaging unit, a flap unit, an epiglottis recognition unit, and a flap control unit, wherein the epiglottis recognition unit recognizes at least a partial region of the epiglottis in the image or video captured by the imaging unit, and the flap control unit controls the flap unit to open the recognized epiglottis. [9] The system according to [8] further comprises a tube, an insertion position determination unit, and a tube control unit, wherein the epiglottis recognition unit recognizes at least a partial region of the epiglottis in the image or the video based on a first learning model, and the first learning model is configured to recognize the range of the epiglottis in the image or the video when the image or the video is input to the first learning model, and output at least a partial region of the epiglottis from within the range of the epiglottis, and the insertion position determination unit recognizes the glottis region in the image or the video based on a second learning model, and determines an insertion reference position of the tube based on the recognized glottis region, and the second learning model is configured to recognize the glottis region in the image or the video when the image or the video is input to the second learning model.The system is configured to recognize the extent of the glottis region in the image or the video and output the glottis region from within the glottis region, and the tube control unit controls insertion of the tube based on an insertion reference position of the tube.

[0008] 5 is a schematic perspective view of the cardiopulmonary resuscitation device 10 according to the first embodiment of the present invention. FIG. 6 is a schematic side view of the cardiopulmonary resuscitation device 10 before an intubation step SC is performed using the cardiopulmonary resuscitation system 1 according to the first embodiment of the present invention. FIG. 7 is a schematic side view of the cardiopulmonary resuscitation device 10 when an intubation step SC is performed using the cardiopulmonary resuscitation system 1 according to the first embodiment of the present invention. FIG. 8 is an exploded view of the frame unit 100 in FIG. 2. FIG. 9 is an enlarged view of an area A in FIG. 1 before an intubation step SC is performed using the cardiopulmonary resuscitation system 1 according to the first embodiment of the present invention. FIG. 11 is an enlarged view of an area A in FIG. 1 when an intubation step SC is performed using the cardiopulmonary resuscitation system 1 according to the first embodiment of the present invention. FIG. 12 is a schematic side view of the intubation arm 122 according to the first embodiment of the present invention. FIG. 13 is a schematic cross-sectional view taken along the cross-sectional line B-B in FIG. 5. FIG. 14 is a block diagram showing the hardware configuration of an information processing unit 170 of the cardiopulmonary resuscitation device 10 according to the first embodiment of the present invention. FIG. 15 is a block diagram showing the hardware configuration of an information processing device 20 according to the first embodiment of the present invention. FIG. 16 is a block diagram showing the functional configuration of the information processing device 20 according to the first embodiment of the present invention. FIG. 17 is an example of an image including the epiglottis captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10 according to the first embodiment of the present invention. FIG. 13A is an example of an image displaying the lower edge E of the epiglottis recognized by the epiglottis recognition unit 202a of the information processing device 20 according to the first embodiment of the present invention. FIG. 13B is an example of an image displaying a portion of the lower edge of the epiglottis recognized by the epiglottis recognition unit 202a of the information processing device 20 according to the first embodiment of the present invention. FIG. 13B is an example of an image including the glottis captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10 according to the first embodiment of the present invention. FIG. 15A is an example of an image displaying the trachea T ​​recognized by the insertion position determination unit 202b of the information processing device 20 according to the first embodiment of the present invention. FIG. 15B is an example of an image displaying the trachea recognized by the insertion position determination unit 202b of the information processing device 20 according to the first embodiment of the present invention. FIG. 15C is an example of an image displaying the vocal cords recognized by the insertion position determination unit 202b of the information processing device 20 according to the first embodiment of the present invention. FIG. 13C is an example of an image displaying the insertion reference position R recognized by the insertion position determination unit 202b of the information processing device 20 according to the first embodiment of the present invention. 1 is a schematic diagram of the flow of a cardiopulmonary resuscitation method in a cardiopulmonary resuscitation system 1 according to a first embodiment of the present invention.25A and 25B are schematic diagrams showing the processing flow of an intubation step SC in the cardiopulmonary resuscitation system 1 according to the first embodiment of the present invention. FIG. 25B is a block diagram showing the hardware configuration of an information processing unit 370 of the cardiopulmonary resuscitation device 10 according to the second embodiment of the present invention. FIG. 25C is a block diagram showing the functional configuration of the information processing unit 370 of the cardiopulmonary resuscitation device 10 according to the second embodiment of the present invention. FIG. 25D is a block diagram showing the hardware configuration of an image processing device 40 according to the third embodiment of the present invention. FIG. 25E is a block diagram showing the functional configuration of the image processing device 40 according to the third embodiment of the present invention. FIG. 25F is a block diagram showing the functional configuration of the drive processing device 50 according to the third embodiment of the present invention. FIG. 25F is a schematic diagram showing the state in which the flap portion of the intubation arm according to the fourth embodiment of the present invention is closed. FIG. 25C is a schematic diagram showing the state in which the flap portion of the intubation arm according to the fourth embodiment of the present invention is open. FIG. 25D is a schematic cross-sectional view taken along the cross-sectional line C-C in FIG. 25B. FIG. 25F is a block diagram showing the functional configuration of an information processing device 20 according to the fifth embodiment of the present invention. FIG. 25F is a schematic diagram showing the flow of a cardiopulmonary resuscitation method in the cardiopulmonary resuscitation system 1 according to the fifth embodiment of the present invention. FIG. 25F is a schematic diagram showing the frame unit 800 according to the sixth embodiment of the present invention. FIG. 25F is a schematic diagram explaining a cardiopulmonary resuscitation method according to the sixth embodiment of the present invention. FIG. 25F is a schematic diagram explaining a cardiopulmonary resuscitation method according to the sixth embodiment of the present invention. FIG. 10 is a schematic diagram illustrating a cardiopulmonary resuscitation method according to a sixth embodiment of the present invention.

[0009] The following describes embodiments of the present invention. The various features shown in the following embodiments can be combined with each other. Furthermore, each feature can be an independent invention.

[0010] 1. First Embodiment A cardiopulmonary resuscitation system 1 according to one embodiment of the present invention is a system primarily for smoothly performing tracheal intubation, and includes an imaging unit 150, a flap unit 122b, an epiglottis recognition unit 202a, and a flap control unit 203c.

[0011] In this embodiment, a system including a cardiopulmonary resuscitation device 10 and an information processing device 20 will be described as an example of the cardiopulmonary resuscitation system 1. The cardiopulmonary resuscitation device 10 includes an imaging unit 150 and a flap unit 122b, and the information processing device 20 includes an epiglottis recognition unit 202a and a flap control unit 203c.

[0012] The cardiopulmonary resuscitation device 10 and the information processing device 20 are configured to be able to communicate with each other via a communication line.

[0013] 1 shows a schematic perspective view of a cardiopulmonary resuscitation device 10 according to a first embodiment of the present invention. The cardiopulmonary resuscitation device 10 includes a frame unit 100, an opening 110, an arm unit 120, a drive unit (not shown), an oral balloon 130, a gas-filled unit (not shown), a tube 140, an imaging unit 150, a head and neck support unit 160, an artificial respirator (not shown), and an information processing unit 170.

[0014] In the following description, the up-down direction, the left-right direction, and the front-rear direction are defined as shown in FIGS.

[0015] 1.1.1 Frame Unit 100 The frame unit 100 is configured to be adjustable in position of the opening 110 (and / or arm unit 120). The frame unit 100 is configured to be adjustable in relative position between the opening 110 (and / or arm unit 120) and the mouth of the subject 2 fixed to the head and neck fixing unit 160. An example of the frame unit 100 will be described with reference to FIGS. 1 to 4.

[0016] The frame unit 100 supports (at least some of) the other components of the cardiopulmonary resuscitation apparatus 10 and includes a first frame 101, a second frame 102, and a third frame 103. In the illustrated example, the first frame 101, the second frame 102, and the third frame 103 are shown as rectangular in shape, but may have any shape as long as they can achieve the functions described below. For convenience, the following description will be given assuming that the first frame 101, the second frame 102, and the third frame 103 are rectangular in shape.

[0017] The first frame 101 constitutes the base of the cardiopulmonary resuscitation apparatus 10 and is therefore installed horizontally relative to an installation surface such as the ground or a floor. One side of the first frame 101 is connected to the head and neck fixing part 160. Preferably, the first frame 101 is connected to the head and neck fixing part 160 on the head side of the subject 2 fixed by the head and neck fixing part 160. In this specification, the term "subject" refers to the person on whom cardiopulmonary resuscitation is performed.

[0018] The second frame 102 is connected to the first frame 101 so as to be movable in the front-rear direction of the first frame 101. In the illustrated example, the second frame 102 includes a frame that moves in the front-rear direction along the first frame 101, and a frame that connects to the third frame 103. This movable configuration allows the second frame 102 to align the opening 110 held by the third frame 103 with the mouth of the subject 2 in the front-rear direction ( FIG. 3 ).

[0019] The third frame 103 is connected to the second frame 102 so as to be movable in the up-down direction of the second frame 102. In the illustrated example, the third frame 103 includes a frame that moves in the up-down direction along the second frame 102 and a frame that includes an opening installation portion 103a. The opening installation portion 103a is connected to the opening 110 and the third frame 103 (FIG. 5). This configuration allows the third frame 103 to move and also allows the opening 110 to be aligned in the up-down direction with respect to the mouth of the subject 2 (FIG. 3).

[0020] The movement mechanism for the second frame 102 and the third frame 103 can be any mechanism that can be fixed in an aligned position. For example, the frame edges that serve as the movement axis can be configured as rails, and the frames can be fixed in a suitable position using screws. Alternatively, the frame edges that serve as the movement axis can be configured as ratchet-type, and the frames can be fixed in a suitable position. The movement mechanism for the frame unit 100 can be configured to be operated manually or mechanically.

[0021] 1.1.2 Opening 110 The opening 110 will be described with reference to Figure 5. The opening 110 is removably provided in the opening installation portion 103a of the third frame 103. The opening 110 includes an upper jaw fixing portion 111 and a lower jaw moving portion 112. The lower jaw moving portion 112 includes an oral insertion portion. The opening is achieved by inserting the upper jaw fixing portion 111 and the oral insertion portion of the lower jaw moving portion 112 between the upper and lower jaws of the subject 2 and moving the lower jaw moving portion 112 in the forward direction.

[0022] The upper jaw fixing portion 111 can be a plate-shaped member and is attached to the opening installation portion 103a. The lower jaw moving portion 112 has a plate-shaped oral insertion portion and is attached to the opening installation portion 103a so that it can move back and forth in the front-to-back direction. The oral insertion portion may be configured in other shapes as long as it can achieve the function of retracting the tongue. Furthermore, the oral insertion portion may be shaped to be longer downward than the upper jaw fixing portion 111, which allows the tongue to be retracted and the field of view inside the mouth to be expanded.

[0023] The lower jaw moving part 112 can be, for example, a rectangular member having a through-hole as shown in Fig. 5, with one side being an intraoral insertion part that is inserted between the upper and lower jaws. In the configuration shown in Fig. 5, the through-hole can be opened by inserting a hand into the through-hole and moving the lower jaw moving part 112 forward. Note that the opening 110 in Fig. 5 is shown in a state in which the lower jaw moving part 112 has already moved forward.

[0024] During intubation, the subject's 2 mouth may be tightly closed, making it difficult for a non-medical professional to open the mouth, and even for a medical professional, it may not be easy, and there is a risk of fingers getting caught. The above-described configuration of the opening 110 allows the user to easily and safely assist in opening the mouth. Note that, in this specification, the term "user" refers to a person who performs CPR using the CPR system 1, and therefore refers to a person other than the subject 2 on whom CPR is being performed.

[0025] The opening 110 can be made of, for example, fiber-reinforced plastic, and can be covered with a cover made of a soft material such as silicone that will not injure the inside of the mouth.

[0026] 1.1.3 Arm Unit 120 The arm unit 120 is configured to be able to hold the tube 140 and intubate the subject 2. The arm unit 120 includes a holding arm 121 and an intubation arm 122. The arm unit 120 is also connected to a drive unit. Figure 5 shows the state of the arm unit 120 in its initial position before intubation, and Figure 6 shows the state of the arm unit 120 during intubation.

[0027] The holding arm 121 includes a holding portion 121a and a frame attachment portion 121b. The holding portion 121a is provided at a predetermined position on the holding arm 121, connected to the intubation arm 122, and configured to hold the oral balloon 130, the intubation arm 122, and the tube 140 attached to the intubation arm 122. Here, the predetermined position of the holding arm 121 can be any position at which the intubation arm 122 and the oral balloon 130 can be inserted between the upper jaw fixing portion 111 and the lower jaw moving portion 112 (i.e., between the upper and lower jaws of the user) when the holding arm 121 moves in the direction of arrow X in FIG. 2 . In the illustrated example, the holding portion 121a is provided at the tip of the holding arm 121.

[0028] The holding arm 121 can be configured to allow the oral balloon 130 to be attached to and detached from the holding portion 121 a. The holding arm 121 may be configured to allow the oral balloon 130 to be attached and detached mechanically based on a command from a holding arm control unit 203 a (described later), or may be configured to allow the oral balloon 130 to be attached and detached manually by a user.

[0029] The frame attachment part 121b is attached to one side of the third frame 103 on the head and neck support part 160 side (front direction), and the holding arm 121 is configured to be rotatable around this side in the direction of arrow X in Fig. 2. By controlling the frame attachment part 121b based on a command from the holding arm control part 203a, the holding arm 121 can be moved to the intubation start position (Fig. 6). Alternatively, the holding arm 121 may be configured to be moved manually.

[0030] The intubation arm 122 includes a guide section 122a, a flap section 122b, an imaging section installation section 122c, and an intubation section 122d (FIG. 7). The intubation arm 122 can perform intubation by controlling the operations of the guide section 122a, the intubation section 122d, and the flap section 122b using a tube control section 203b and a flap control section 203c.

[0031] The guide portion 122a may be configured in any shape that can pass through the inside of the intubation tube. The guide portion 122a may be formed, for example, in a rod shape. The base of the guide portion 122a is connected to the intubation portion 122d, and a flap portion 122b is attached to the tip of the guide portion 122a. The guide portion 122a may have multiple joints. In this case, the guide portion 122a is configured to be bendable in various directions and can be controlled by the tube control portion 203b.

[0032] The flap portion 122b is provided at the tip of the guide portion 122a and is configured to be movable so as to open the epiglottis in a cardiopulmonary resuscitation method described below. The shape of the flap portion 122b can be any shape that can open the epiglottis, such as a spatula shape or an alligator mouth shape. Figure 7 is a side view of the intubation arm 122 when the spatula-shaped flap portion 122b is provided. The flap portion 122b configured in this manner is configured to be movable in the direction of arrow Y, which represents the epiglottis opening operation, with the point at the tip of the guide portion 122a to which the flap portion 122b is provided as a fulcrum F. The epiglottis opening operation is performed based on a command from a flap control unit 203c described below.

[0033] Specifically, the flap portion 122b is inserted so as to slip under the epiglottis based on at least a partial region of the epiglottis recognized by the epiglottis recognition unit 202a. Next, the epiglottis can be opened by moving (in the direction of arrow Y) so as to lift the epiglottis from the lower edge side of the epiglottis.

[0034] The imaging unit installation section 122c is a member for installing the imaging unit 150, and can be installed at any position so that the imaging unit 150 can capture images of the moving direction of the intubation arm 122 during intubation. For example, it may be installed at the tip of the guide section 122a (FIG. 8), the tip of the flap section 122b, or both.

[0035] The intubation section 122d is connected to the holding section 121a. The intubation section 122d includes a tube support section 122a1, which can support the connector-side end of the tube 140 and is configured to allow the tube 140 to be attached and detached. The tube 140 may be attached and detached mechanically or manually.

[0036] The intubation unit 122d is configured to push or retract both the tube 140 and the guide unit 122a. The intubation unit 122d may have any configuration as long as it can perform this function. For example, the intubation unit 122d may be configured as a ratchet. Specifically, the operation of the intubation unit 122d is configured to be drivable to push or retract the tube 140 supported by the tube support unit 122a1 and the guide unit 122a connected to the intubation unit 122d based on a command from the tube control unit 203b. Therefore, intubation can be performed by moving the tube 140 forward or backward as the intubation unit 122d is driven.

[0037] The intubation arm 122 may also be provided with an illumination source (not shown). This may be provided at any position that can illuminate the direction in which the intubation arm 122 moves during intubation. Therefore, for example, the illumination source may be built into the imaging unit 150, or may be provided at the position where the imaging unit installation unit 122c is provided or in the vicinity of this position. The illumination source may be, for example, an LED.

[0038] 1.1.4 Drive Unit The drive unit is configured to be capable of driving other components of the cardiopulmonary resuscitation device 10. The drive unit can be any actuator that can drive the arm unit 120, the ventilator, and the gas-filling unit based on various commands from the control unit 171. For example, the drive unit can drive the flap unit 122b and the guide unit 122a and the intubation unit 122d to move the tube 140 based on commands obtained from the information processing device 20. The actuators can be powered by any power source or mechanism known in the art that can drive the arm unit 120, the ventilator, and the gas-filling unit to perform their operating functions. The power source can be, for example, electricity, air, or hydraulics.

[0039] 1.1.5 Oral Balloon 130 The oral balloon 130 is configured to be inflatable inside the mouth of the subject 2. The oral balloon 130 includes a tube portion 131, a gas inlet (not shown), and a cuff 132 ( FIG. 5 ). The oral balloon 130 is attached so that the holding portion 121 a of the holding arm 121 holds the end of the oral balloon 130 that is not on the cuff 132 side, and the intubation arm 122 connected to the tip of the holding arm 121 and the tube 140 supported by the intubation arm 122 are passed through the tube portion 131 ( FIG. 8 ).

[0040] The gas inlet is connected to the gas filling unit and the cuff 132. The gas inlet introduces gas sent from the gas filling unit into the cuff 132. The cuff 132 is configured to be inflated by the gas introduced from the gas inlet filling the cuff 132.

[0041] Although the cardiopulmonary resuscitation method will be described in detail later, when intubating during cardiopulmonary resuscitation, the cuff 132 is placed in the oral cavity of the subject 2. When the cuff 132 is inflated in the oral cavity of the subject 2, the position of the oral balloon 130 in the oral cavity is fixed, which makes it easier to stably move the intubation arm 122 that is passed through the tube portion 131 of the oral balloon 130. Therefore, by providing the oral balloon 130, intubation can be performed more smoothly.

[0042] The oral balloon 130 also functions as a supraglottic device, and simple artificial respiration is possible by connecting the oral balloon 130 in the oral cavity to an artificial respirator. Therefore, if intubation of the tube 140 is not successful, the cardiopulmonary resuscitation system 1 can be used as an assisted ventilation device.

[0043] 1.1.6 Gas Filling Unit The gas filling unit is configured to be able to inject and suck gas. The gas filling unit is connected to the drive unit and the gas inlet of the oral balloon 130 (and the gas inlet of the cuffed tube 140). The gas filling unit can fill the oral balloon 130 with gas via the gas inlet, or evacuate gas from the oral balloon 130 via the gas inlet, based on commands from the balloon control unit 203d. The gas filling unit can be any member that can inject and suck gas into the gas inlet. The gas filling unit can be, for example, a syringe.

[0044] 1.1.7 Camera Unit 150 The camera unit 150 may be one or more cameras capable of capturing still or video images. The camera unit 150 may be mounted on the camera unit mounting unit 122c provided on the intubation arm 122. Alternatively, the camera unit 150 may be directly attached to the tip of the tube 140, or may be juxtaposed to the outer periphery of the tip of the tube 140. The camera unit 150 may also include a distance sensor. Any sensor capable of measuring distance and angle may be used as the distance sensor. For example, the distance sensor may be an infrared distance sensor.

[0045] 1.1.8 Tube 140 An existing intubation tube commonly used for tracheal intubation can be used as the tube 140. The tube 140 preferably includes a cuff. The cuffed tube 140 includes a gas inlet, and the gas inlet is connected to a gas filling unit so that the cuff can be inflated.

[0046] 1.1.9 Head and Neck Fixing Unit 160 The head and neck fixing unit 160 may have any configuration capable of fixing the head and neck and assisting in securing an airway. By fixing the head and neck and securing an airway with the head and neck fixing unit 160, intubation can be performed more smoothly. For example, the head and neck fixing unit 160 can be configured to fix the head so as to press the head downward to perform a jaw lift, or to maintain the mandibular angle as shown in FIG. 1 . An existing device, such as a jaw lift device manufactured by Hypnoz Therapeutic Devices, Inc., may be used.

[0047] 1.1.10 Artificial Ventilator The artificial ventilator is connected to the tube 140 and the drive unit and configured to be able to perform artificial respiration on the subject 2. The artificial ventilator may have the same configuration as that of a commonly used artificial ventilator, but is configured to be able to perform artificial respiration based on a command from the artificial ventilator control unit 203e. The artificial ventilator is equipped with a sensor. The sensor may be, for example, a sensor for measuring CO ２ The sensor can be any sensor capable of determining the breathing state of the subject 2 and whether the airway is properly secured, such as a detector or flow sensor.

[0048] 9 is a block diagram showing the hardware configuration of the information processing unit 170. The information processing unit 170 includes a control unit 171, a storage unit 172, a communication unit 173, and an input unit 174. The information processing unit 170 may further include an output unit (not shown).

[0049] The control unit 171 may include a processor such as a central processing unit (CPU), a digital signal processor, a microprocessor, a microcontroller, an application specific integrated circuit (ASIC), a programmable logic device (PLD), etc. The control unit 171 can perform the intubation process SC by obtaining commands from the information processing device 20 and controlling the movement of the drive unit.

[0050] The storage unit 172 may include a volatile memory or a non-volatile memory. Examples of the volatile memory include a RAM (Random Access Memory) and a DRAM (Dynamic Random Access Memory), which are used as a work area when the control unit 171 executes processes based on various programs. Examples of the non-volatile memory include a ROM (Read Only Memory) and a flash memory, which are used to store various data and programs used in the processes of the control unit 171. The storage unit 172 may also include an external storage device such as an HDD (Hard Disk Drive).

[0051] The programs stored in the memory unit 172 include, for example, an OS (Operating System) for realizing the basic functions of the information processing unit 170, drivers for controlling various hardware, programs for realizing various functions, etc., and include the computer program related to this embodiment.

[0052] The communication unit 173 is configured to be capable of transmitting and receiving data and has a function of connecting to a communication line. The communication unit 173 is preferably configured to be able to communicate with the information processing device 20 without connecting to the Internet. The communication unit 173 can preferably have a function that enables short-range wireless communication such as Bluetooth (registered trademark) or infrared communication, or a function that enables a wired connection.

[0053] For example, the input unit 174 allows a user to input information for activating the cardiopulmonary resuscitation device 10. The input unit 174 may include one or more of a keyboard, a keypad, a mouse, a microphone, a touch screen, a button, and the like.

[0054] The drive unit and the information processing unit 170 are connected to each other by a communication bus 600 .

[0055] 1.2 Information Processing Device 20 1.2.1 Hardware Configuration of Information Processing Device 20 Fig. 10 is a diagram showing the hardware configuration of the information processing device 20 according to the present invention. The information processing device 20 according to the present invention includes a control unit 200, a storage unit 210, a communication unit 220, an input unit 230, and an output unit 240.

[0056] The control unit 200 may include a processor such as a central processing unit (CPU), digital signal processor, microprocessor, microcontroller, application specific integrated circuit (ASIC), programmable logic device (PLD), or the like.

[0057] The storage unit 210 may include a volatile memory or a non-volatile memory. Examples of the volatile memory include a RAM (Random Access Memory) and a DRAM (Dynamic Random Access Memory), which are used as a work area when the control unit 200 executes processes based on various programs. Examples of the non-volatile memory include a ROM (Read Only Memory) and a flash memory, which are used to store various data and programs used in the processing of the control unit 200. The storage unit 210 may also include an external storage device such as an HDD (Hard Disk Drive).

[0058] The programs stored in the memory unit 210 include, for example, an OS (Operating System) for realizing the basic functions of the information processing device 20, drivers for controlling various hardware, programs for realizing various functions, etc., and include the computer program related to this embodiment.

[0059] The communication unit 220 is configured to be capable of transmitting and receiving data and has a function of connecting to a communication line. The communication unit 220 is preferably configured to be able to communicate with the cardiopulmonary resuscitation device 10 without connecting to the Internet. The communication unit 220 preferably has a function that enables short-range wireless communication such as Bluetooth (registered trademark) or infrared communication, or a function that enables wired connection.

[0060] For example, a user can input instruction information for performing the intubation process SC to the input unit 230. The instruction information can include, for example, instructions for starting or ending the intubation process SC or for starting or ending each step in the intubation process SC.

[0061] The input unit 230 may include one or more of a keyboard, a keypad, a mouse, a microphone, a touch screen, buttons, and the like.

[0062] The output unit 240 can display, for example, images and videos captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10, and images and videos generated by the epiglottis recognition unit 202a and the insertion position determination unit 202b. The output unit 240 can also output, for example, images, videos, and / or sounds that instruct the user on the work to be done when cardiopulmonary resuscitation is performed using the cardiopulmonary resuscitation system 1.

[0063] The output unit 240 can be, for example, any display and / or speaker.

[0064] The control unit 200 , the storage unit 210 , the communication unit 220 , the input unit 230 and the output unit 240 are connected to one another by a communication bus 600 .

[0065] The information processing device 20 may be, for example, a personal computer, a smartphone, a tablet, a smart watch, or smart glasses.

[0066] 1.2.2 Functional configuration of the information processing device 20 The information processing device 20 is configured to be able to communicate with the cardiopulmonary resuscitation device 10 via a communication line. The information processing device 20 performs various information processes in the intubation process SC. That is, the information processing device 20 can determine the start and end of the intubation process SC based on signals input by the input unit 230, and can determine the operations of the components of the cardiopulmonary resuscitation device 10 involved in the series of intubation processes SC based on images and videos captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10, data acquired by a distance sensor, and data acquired by a sensor of the artificial respirator.

[0067] Details will be described later, but for example, the information processing device 20 can transmit to the cardiopulmonary resuscitation device 10, based on images or video captured by the imaging unit 150, commands to recognize at least a portion of the epiglottis and control the operation of the flap portion 122b, and commands to recognize the glottis region and control the operation of the guide portion 122a and the intubation portion 122d.

[0068] 11 is a block diagram showing the functional configuration of the information processing device 20 according to the present invention. The control unit 200 of the information processing device 20 includes an acquisition unit 201, an image processing control unit 202, and a drive control unit 203.

[0069] (1) Acquisition unit 201 The acquisition unit 201 acquires images and videos (hereinafter, captured images) captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10, distance and angle data (hereinafter, distance data) captured by the distance sensor, information regarding the status of the operation performed by the drive unit of the cardiopulmonary resuscitation device 10 in response to commands from the drive control unit 203 (hereinafter, operation information), data such as the respiratory condition of the subject 2 captured by the sensor of the ventilator (hereinafter, respiratory data), and information regarding instructions input by the input unit 230 (hereinafter, instruction information).

[0070] The captured image, distance data, breathing data, and operation information can be acquired by communicating with the cardiopulmonary resuscitation device 10 via the communication unit 220. The instruction information can be acquired by directly acquiring information input by the user via the input unit 230, or by acquiring it from a recording unit that records information input by the user via the input unit 230.

[0071] (2) Image Processing Control Unit 202 The image processing control unit 202 includes an epiglottis recognition unit 202 a and an insertion position determination unit 202 b. The image processing control unit 202 performs image processing using the epiglottis recognition unit 202 a and the insertion position determination unit 202 b based on the captured image and distance data acquired by the acquisition unit 201.

[0072] The epiglottis recognition unit 202a is configured to be able to recognize the epiglottis in the photographed image using the first learning model. The epiglottis recognition unit 202a can generate an image in which the recognized epiglottis is displayed on the photographed image (hereinafter referred to as an epiglottis display image). Alternatively, the epiglottis recognition unit 202a may be configured to display the recognized epiglottis superimposed on the photographed image.

[0073] Here, "recognizing the epiglottis" does not require recognizing the entire epiglottis, but only requires recognizing at least a partial region of the epiglottis. The at least partial region of the epiglottis recognized by the epiglottis recognition unit 202a can be any region that serves as a reference for determining the operation of opening the epiglottis by the tube control unit 203b and the flap control unit 203c. For example, the recognition target can be the lower edge of the epiglottis ( FIG. 13A ), a part of the lower edge of the epiglottis ( FIG. 13B ), the center point of the epiglottis, etc.

[0074] In the configuration for recognizing the lower edge of the epiglottis, the epiglottis recognition unit 202a can use a photographed image ( FIG. 12 ) including the epiglottis of the subject 2 to generate an epiglottis display image ( FIG. 13A ) in which the lower edge E of the epiglottis recognized based on the photographed image is displayed on the image. The epiglottis can be displayed in any manner in the epiglottis display image. For example, the recognized epiglottis may be displayed as a line (including a dashed line, etc.) as shown in FIG. 13A , or the recognized epiglottis may be displayed by filling it in as shown in FIG. 13B .

[0075] The insertion position determination unit 202b is configured to be able to recognize the glottis region in the photographed image using the second learning model. The insertion position determination unit 202b can generate an image (glottis display image) in which the recognized glottis region is displayed on the photographed image. Alternatively, the insertion position determination unit 202b may be configured to display the recognized glottis region superimposed on the photographed image.

[0076] For example, examples of the glottis region recognized by the insertion position determination unit 202b include the vocal cords in the photographed image ( FIG. 15C ) and the trachea between the vocal cords ( FIGS. 15A and 15B ). In a configuration for recognizing the trachea, the insertion position determination unit 202b can use a photographed image ( FIG. 14 ) including the glottis of the subject 2 to generate a glottis display image in which the trachea T ​​recognized based on the photographed image is displayed on the image ( FIG. 15A or 15B ). The display of the glottis region in the glottis display image can be in any manner. For example, the glottis region may be solid-colored as shown in FIG. 15A , or the glottis region may be displayed by being surrounded by a line as shown in FIGS. 15B and 15C .

[0077] Furthermore, the insertion position determination unit 202b can determine an insertion reference position of the tube 140 based on the recognized glottis region and the distance data acquired by the acquisition unit 201, and generate an image (reference position display image) in which the determined insertion reference position is displayed on the photographed image or the glottis display image. Alternatively, the insertion position determination unit 202b may be configured to display the determined insertion reference position superimposed on the photographed image or the glottis display image.

[0078] The insertion reference position can be, for example, the center point of the recognized glottis region. For example, an image displaying the insertion reference position R can be generated (FIG. 16) based on the glottis region in the glottis display image (FIG. 15).

[0079] The images generated by the epiglottis recognition unit 202a and the insertion position determination unit 202b, or the recognized area and the determined position superimposed on the captured image, etc., can be displayed on the output unit 240 of the information processing device 20. Preferably, they are displayed in real time while the intubation step SC is being performed.

[0080] (3) Drive control unit 203 The drive control unit 203 controls the operation of each component connected to the drive unit of the cardiopulmonary resuscitation device 10 based on the various information acquired by the acquisition unit 201. The drive control unit 203 includes a holding arm control unit 203a, a tube control unit 203b, a flap control unit 203c, a balloon control unit 203d, and an artificial respirator control unit 203e ( FIG. 11 ).

[0081] The holding arm control unit 203a controls the holding arm 121 based on the instruction information acquired by the acquisition unit 201. For example, the operation controlled by the holding arm control unit 203a can include an operation of moving the holding arm 121 to an initial position or an intubation start position.

[0082] Furthermore, for example, the operations controlled by the holding arm control unit 203a may include the operation of attaching and detaching the oral balloon 130. In this case, specifically, when an oral balloon detachment condition is satisfied, the holding arm control unit 203a may decide to detach the oral balloon 130. The oral balloon detachment condition may include, for example, any one of the following conditions: when the epiglottis recognition unit 202a fails to recognize the epiglottis region; when the insertion position determination unit 202b fails to recognize the glottis region; when the insertion reference position cannot be determined; and when the tube 140 is detached; or all of these conditions may be satisfied.

[0083] When it is decided to detach the oral balloon 130, the detachment operation may be performed automatically or manually. In the case of manual operation, the holding arm control unit 203a (or the control unit 200) may control the operation so that the operating instructions to the user are transmitted via an output unit such as a speaker or display that may be possessed by any of the devices constituting the cardiopulmonary resuscitation system 1 (e.g., the cardiopulmonary resuscitation device 10 or the information processing device 20).

[0084] The tube control unit 203b controls the guide unit 122a and the intubation unit 122d based on various information, thereby controlling the insertion of the tube 140. The various information includes, for example, instruction information and operation information acquired by the acquisition unit 201, epiglottis recognition information from the epiglottis recognition unit 202a, and insertion reference position information from the insertion position determination unit 202b.

[0085] Based on various information, the tube control unit 203b controls the driving of the guide unit 122a so that the flap unit 122b moves to a position where the epiglottis can be opened. Based on various information, the tube control unit 203b also controls the driving of the intubation unit so that the tube 140 is inserted. The tube control unit 203b also determines to detach the tube 140 when a tube detachment condition is satisfied. The tube detachment condition may include, for example, completion of insertion of the tube 140 (see the second insertion step S9 described below), and satisfaction of this condition may be set as a condition.

[0086] When it is decided to detach the tube 140, the detachment operation may be performed automatically or manually, but in the case of manual operation, the tube control unit 203b (or the control unit 200) may control the tube 140 to transmit operation instructions to the user via an output unit such as a speaker or display that may be possessed by any of the devices constituting the cardiopulmonary resuscitation system 1 (e.g., the cardiopulmonary resuscitation device 10 or the information processing device 20).

[0087] The tube control unit 203b can determine the start or end of the operations of the guide unit 122a and the intubation unit 122d. For example, the instruction information is instruction information for starting the insertion process input by the user to the input unit 230. When the acquisition unit 201 acquires the instruction information, the tube control unit 203b can determine the start of the operations of the guide unit 122a and the intubation unit 122d based on the acquired instruction information. Alternatively, for example, the operation information is operation information indicating that gas filling into the balloon has been completed or operation information indicating that movement of the holding arm 121 to the intubation start position has been completed. When the acquisition unit 201 acquires the operation information, the tube control unit 203b can determine the start of the operations of the guide unit 122a and the intubation unit 122d based on the operation information.

[0088] Furthermore, the operation of the guide unit 122a controlled by the tube control unit 203b can include a bending operation in the longitudinal direction of the tube 140. Furthermore, the operation of the intubation unit 122d controlled by the tube control unit 203b can include a pushing operation or a pulling operation of the tube 140 relative to the trachea of ​​the subject 2, or an attachment / detachment operation of the tube 140. Specific control contents of the tube control unit 203b include, for example, the following.

[0089] The tube control unit 203b determines to cause the intubation unit 122d to perform a pushing operation and / or to cause the guide unit 122a to perform a bending operation so that the epiglottis recognition unit 202a can recognize the desired region of the epiglottis. Based on the region of the epiglottis recognized by the epiglottis recognition unit 202a, the tube control unit 203b determines to cause the intubation unit 122d to perform a pushing operation and / or to cause the guide unit 122a to perform a bending operation so that the guide unit 122a is positioned so that the flap unit 122b can open the epiglottis. Based on operation information of the flap unit 122b acquired by the acquisition unit 201 (e.g., completion of the epiglottis opening operation), the tube control unit 203b determines to cause the intubation unit 122d to perform a pushing operation and / or to cause the guide unit 122a to perform a bending operation. The tube control unit 203b determines to cause the intubation unit 122d to perform a pushing operation and / or the guide unit 122a to perform a bending operation based on the insertion reference position determined by the insertion position determining unit 202b.

[0090] The tube control unit 203b determines to detach the tube 140 from the tube support unit 122a1 based on the operation information that the operations of the intubation unit 122d and the guide unit 122a based on the insertion reference position have been completed.

[0091] The flap control unit 203c can control the flap unit 122b to open the epiglottis based on information from the epiglottis recognition unit 202a. For example, the flap control unit 203c can determine to move the flap unit 122b in the direction of arrow Y based on at least a partial region of the epiglottis displayed in the epiglottis display image.

[0092] The balloon control unit 203d can control the gas filling unit. For example, the operations controlled by the balloon control unit 203d include injecting gas into the gas inlet or suctioning gas from the gas inlet.

[0093] The ventilator control unit 203e can control the operation of the ventilator based on the respiratory data acquired by the acquisition unit 201. For example, the ventilator control unit 203e can determine the start or end of artificial respiration based on the respiratory data acquired by the acquisition unit 201. Furthermore, the ventilator control unit 203e can determine the setting and switching of the operation mode of the ventilator based on the respiratory data acquired by the acquisition unit 201. Furthermore, the artificial respiration operation of the ventilator controlled by the ventilator control unit 203e can be performed using technology similar to that of a drive mechanism used in general ventilators.

[0094] 1.3 Cardiopulmonary resuscitation method using cardiopulmonary resuscitation system 1 A method for performing cardiopulmonary resuscitation using the cardiopulmonary resuscitation system 1 according to the first embodiment will be described. The method for performing cardiopulmonary resuscitation using the cardiopulmonary resuscitation system 1 includes an airway securing step SA, an opening step SB, and an intubation step SC ( FIG. 17 ). Each step will be described below.

[0095] Among the subjects 2, the cardiopulmonary resuscitation method according to this embodiment is applied to patients in cardiac arrest or respiratory arrest. These patients include, for example, patients who are not in a life-threatening state, such as cardiac arrest or respiratory arrest due to anesthesia, but who require treatment.

[0096] Before starting the cardiopulmonary resuscitation method using the cardiopulmonary resuscitation system 1, the user can activate each device using the input unit 174 of the cardiopulmonary resuscitation device 10 and the input unit 230 of the information processing device 20.

[0097] Furthermore, the cardiopulmonary resuscitation method using the cardiopulmonary resuscitation system 1 described below can be started in a state in which the oral balloon 130 is attached to the holding portion 121a, the tube 140 is attached to the tube support portion 122a1, and the artificial ventilator is attached to the tube 140. When each device is activated, the output unit 240 may be configured to instruct the user to attach the oral balloon 130 and the tube 140 to the arm portion 120, respectively.

[0098] First, an airway securing step SA is performed. In the airway securing step SA, the user places the subject 2 in the head and neck holding unit 160 of the cardiopulmonary resuscitation apparatus 10 and performs a jaw lift of the subject 2. The output unit 240 of the information processing device 20 may instruct the user on the operation of the airway securing step SA to be performed by the user.

[0099] Next, the opening step SB is performed. In the opening step SB, the user moves the second frame 102 of the cardiopulmonary resuscitation apparatus 10 in the front-to-back direction and moves the third frame 103 in the up-and-down direction, and aligns the upper jaw fixing portion 111 of the opening 110 and the oral insertion portion of the mandibular movement portion 112 so that they are inserted between the upper jaw and lower jaw of the subject 2. Once the alignment is complete, the second frame 102 and the third frame 103 are fixed. After fixing, the mandibular movement portion 112 is moved forward to open the mouth. The output unit 240 of the information processing device 20 may instruct the user on the operation of the opening step SB to be performed by the user.

[0100] Next, the intubation process SC is performed. In the intubation process SC, the user inputs instruction information for starting the intubation process SC to the input unit 230 of the information processing device 20. Thereafter, the information processing device 20 controls the cardiopulmonary resuscitation device 10 based on the instruction information, thereby enabling automatic intubation. The output unit 240 of the information processing device 20 may instruct the user on the operation of the intubation process SC to be performed by the user.

[0101] For example, in the insertion position determination process S7 described below, when the information processing device 20 receives operation information that the operation of the intubation section 122d has been completed, the output section 240 can instruct the subject 2 to fix the oral balloon 130 and the tube 140 to the subject 2 with tape or the like before the removal process S10 is started.

[0102] Hereinafter, a specific processing flow of the intubation process SC in the information processing device 20 and the cardiopulmonary resuscitation device 10 will be described with reference to FIG.

[0103] The intubation process SC includes a preparation process S1, a balloon inflation process S2, an epiglottis recognition process S3, a first adjustment process S4, a first insertion process S5, an epiglottis opening process S6, an insertion position determination process S7, a second adjustment process S8, a second insertion process S9, a removal process S10, and an artificial respiration start process S11.

[0104] First, a preparation step S1 is executed. In the preparation step S1, the holding arm 121 is set to an intubation start position. In the information processing device 20, the holding arm control unit 203a can determine to move the holding arm 121 to the intubation start position based on the instruction information from the user to start the intubation step SC. In the cardiopulmonary resuscitation device 10, the drive unit moves the holding arm 121 to the intubation start position in accordance with the command from the holding arm control unit 203a, and can transmit operation information indicating that the movement to the intubation start position has been completed to the information processing device 20 via the information processing unit 170.

[0105] When the information processing device 20 receives operation information indicating that movement to the intubation start position has been completed, the balloon inflation step S2 is executed. Here, the oral balloon 130 is positioned in the oral cavity of the subject 2 as a result of the holding arm 121 being set to the intubation start position. In the balloon inflation step S2, the oral balloon 130 is inflated. In the information processing device 20, the balloon control unit 203d can determine to introduce gas into the gas inlet of the oral balloon 130. In the cardiopulmonary resuscitation device 10, the driving unit can drive the gas filling unit in accordance with a command from the balloon control unit 203d, thereby filling the balloon with gas. The cardiopulmonary resuscitation device 10 can transmit operation information indicating that gas filling has been completed to the information processing device 20 via the information processing unit 170.

[0106] When the information processing device 20 receives the operation information indicating that gas filling has been completed, an epiglottis recognition step S3 is executed. In the epiglottis recognition step S3, at least a part of the epiglottis region in the captured image is recognized using the first learning model.

[0107] The first learning model is a model that has been machine-trained using various images of the epiglottis as learning data. Specifically, when a captured image is input to the first learning model, the first learning model is configured to recognize the extent of the epiglottis in the captured image and output at least a partial region of the epiglottis from within the extent of the epiglottis. The extent of the epiglottis is identified, for example, using a bounding box.

[0108] As the first learning model, various learning models can be used as long as they are capable of detecting an object and outputting the area of ​​that object. However, it is preferable to use a model with a fast processing speed so that images can be displayed in real time while the intubation procedure SC is being performed. As a model with a fast processing speed, for example, a model using YOLO for object detection and U-net as the segmentation network structure can be used. In this case, the area of ​​the epiglottis can be recognized using YOLO, and at least a partial area of ​​the epiglottis can be output from within the area of ​​the epiglottis using U-net.

[0109] In the epiglottis recognition step S3, if the epiglottis is successfully recognized, an epiglottis display image is output onto the output unit 240.

[0110] The epiglottis recognition step S3 can be preset to be repeated a predetermined number of times. If the desired epiglottis region cannot be recognized in the epiglottis recognition step S3 and the epiglottis recognition step S3 has not been repeated a predetermined number of times, a first adjustment step S4 is executed. In the first adjustment step S4, the position of the guide unit 122a is adjusted so that the epiglottis recognition unit 202a can recognize the desired epiglottis region. In the information processing device 20, the tube control unit 203b can determine whether to cause the intubation unit 122d to perform a pushing motion and / or the guide unit 122a to perform a bending motion. Specifically, the guide unit 122a can move freely across a horizontal plane perpendicular to the direction of intubation. In the cardiopulmonary resuscitation device 10, the drive unit can drive the intubation unit 122d and the guide unit 122a according to commands from the tube control unit 203b. During or after the intubation unit 122d and the guide unit 122a are driven, the epiglottis recognition step S3 is performed again based on the captured image. If the epiglottis recognition unit 202a still does not recognize the desired epiglottis area after the epiglottis recognition step S3 is repeated a predetermined number of times, the process proceeds to the detachment step S10. In this case, the cardiopulmonary resuscitation system 1 can be used as an assisted ventilation device.

[0111] If the epiglottis is successfully recognized in the epiglottis recognition step S3, a first insertion step S5 is executed. In the first insertion step S5, the intubation unit 122d and the guide unit 122a are driven to insert the tube 140 toward the airway in order to move the flap unit 122b to a position where the flap unit 122b can open the epiglottis. For example, when the epiglottis recognition unit 202a recognizes the lower edge or a portion of the lower edge of the epiglottis, the intubation unit 122d and the guide unit 122a can move so that the flap unit 122b is positioned below the recognized lower edge or portion of the lower edge (referring to below in FIG. 13 ). When the epiglottis recognition unit 202a recognizes the center point of the epiglottis, the intubation unit 122d and the guide unit 122a are configured so that the flap unit 122b is positioned below the center point recognized by the epiglottis recognition unit 202a by a predetermined distance.

[0112] In the first insertion step S5, the information processing device 20 can determine that the tube control unit 203b causes the intubation unit 122d to perform a pushing operation and / or the guide unit 122a to perform a bending operation. In the cardiopulmonary resuscitation device 10, the drive unit can drive the intubation unit 122d and the guide unit 122a in accordance with commands from the tube control unit 203b. The cardiopulmonary resuscitation device 10 can transmit operation information that the drive of the intubation unit 122d and the guide unit 122a has been completed to the information processing device 20 via the information processing unit 170.

[0113] When the information processing device 20 receives operation information indicating that the driving of the intubation unit 122d and the guide unit 122a has been completed, an epiglottis opening step S6 is executed. In the epiglottis opening step S6, the epiglottis is opened by the flap unit 122b. In the information processing device 20, the flap control unit 203c determines to perform the opening operation of the flap unit 122b. In the cardiopulmonary resuscitation device 10, the drive unit can perform the opening operation of the flap unit 122b in accordance with the command from the flap control unit 203c. The cardiopulmonary resuscitation device 10 can transmit operation information indicating that the opening operation of the flap unit 122b has been completed to the information processing device 20 via the information processing unit 170.

[0114] When the information processing device 20 receives the operation information indicating that the opening operation has been completed, an insertion position determination step S7 is executed. In the insertion position determination step S7, the glottis region in the captured image is recognized using the second learning model, and an insertion reference position is determined.

[0115] The second learning model is a model that has been machine-learned using various glottis images as learning data. Specifically, when a captured image is input to the second learning model, the second learning model is configured to recognize the extent of the glottis region in the captured image and output the glottis region from within the glottis region. The extent of the glottis region is identified, for example, using a bounding box ( FIGS. 15B and 15C ).

[0116] As the second learning model, various learning models can be used as long as they are capable of detecting objects and outputting the area of ​​those objects. However, it is preferable to use a model with a fast processing speed so that images can be displayed in real time while the intubation procedure SC is being performed. For example, a model using YOLO for object detection and U-net as the segmentation network structure can be used. In this case, the range of the glottis region can be recognized using YOLO, and the glottis region can be output from within the range of the glottis region using U-net.

[0117] In the insertion position determination step S7, if the glottal area is successfully recognized, a glottal table image is output to the output unit 240. Next, in the insertion position determination step S7, an insertion reference position is determined based on the recognized glottal area and the distance and angle data acquired by the distance sensor, and a reference position display image is output to the output unit 240. Here, if the insertion reference position cannot be determined, the process proceeds to the detachment step S10. In this case, the cardiopulmonary resuscitation system 1 can be used as an assisted ventilation device.

[0118] The insertion position determination step S7 can be set to be repeated a predetermined number of times. If the desired glottis region cannot be recognized in the insertion position determination step S7 and the repetition of the insertion position determination step S7 has not reached the predetermined number of times, a second adjustment step S8 is executed. In the second adjustment step S8, the position of the guide unit 122a is adjusted so that the insertion position determination unit 202b can recognize the desired glottis region. In the information processing device 20, the tube control unit 203b can determine to cause the intubation unit 122d to perform a pushing action and / or the guide unit 122a to perform a bending action. In the cardiopulmonary resuscitation device 10, the drive unit can drive the intubation unit 122d and the guide unit 122a in accordance with commands from the tube control unit 203b. During or after the intubation unit 122d and the guide unit 122a are driven, the insertion position determination step S7 is executed again based on the captured image. If the insertion position determination unit 202b still does not recognize the desired glottis region after repeating the insertion position determination step S7 a predetermined number of times, the process proceeds to the detachment step S10. In this case, the cardiopulmonary resuscitation system 1 can be used as an assisted ventilation device.

[0119] If the glottis region is successfully recognized and the insertion reference position is determined in the insertion position determination step S7, a second insertion step S9 is executed. In the second insertion step S9, the intubation unit 122d and the guide unit 122a are driven toward the trachea based on the insertion reference position, and the tube 140 is inserted toward the glottis. In the information processing device 20, the tube control unit 203b can determine whether to cause the intubation unit 122d to perform a pushing action and / or the guide unit 122a to perform a bending action. In the cardiopulmonary resuscitation device 10, the drive unit can drive the intubation unit 122d and the guide unit 122a in accordance with commands from the tube control unit 203b.

[0120] The cardiopulmonary resuscitation device 10 can transmit operation information indicating that insertion of the tube 140 has been completed, i.e., that driving of the intubation section 122d and the guide section 122a has been completed, to the information processing device 20 via the information processing section 170. If the tube 140 cannot be inserted, the second insertion step S9 ends at this point and the process proceeds to the removal step S10. In this case, the cardiopulmonary resuscitation system 1 can be used as an assisted ventilation device.

[0121] Here, in the case where a cuffed tube 140 is used, when the information processing device 20 receives operation information that the driving of the intubation unit 122d and the guide unit 122a has been completed, a step of inflating the cuff of the tube 140 is executed (not shown). In the information processing device 20, the balloon control unit 203d can determine to introduce gas into the gas inlet of the tube 140.

[0122] When the information processing device 20 receives operation information indicating that the driving of the intubation unit 122d and the guide unit 122a in the second insertion step S9 has been completed, or when the information processing device 20 fails to recognize the epiglottis in the epiglottis recognition step S3, fails to recognize the glottis region in the insertion position determination step S7, fails to determine the insertion reference position, or fails to insert the tube 140 in the second insertion step S9, the detachment step S10 is executed. In the detachment step S10, if the process has progressed to the second insertion step S9, the tube 140 is detached from the tube support unit 122a1, the oral balloon 130 is detached from the holding arm 121, and the holding arm 121 returns to its initial position. When the process has progressed to the detachment step S10 after failing to insert the tube 140 in the epiglottis recognition step S3, the insertion position determination step S7, or the second insertion step S9, only the oral balloon 130 is detached without detaching the tube 140 from the tube support unit 122a1.

[0123] In the information processing device 20, the tube control unit 203b can determine the operation of detaching the tube 140 from the tube support unit 122a1. In the cardiopulmonary resuscitation device 10, the drive unit can detach the tube 140 from the tube support unit 122a1 in accordance with a command from the tube control unit 203b. The information processing unit 170 of the cardiopulmonary resuscitation device 10 can transmit operation information indicating that detachment of the tube 140 has been completed to the information processing device 20.

[0124] When the information processing device 20 receives operation information that the detachment operation of the tube 140 has been completed, or when the process proceeds from the epiglottis recognition step S3 or the insertion position determination step S7 to the detachment step S10, the holding arm control unit 203a can determine the detachment operation of the oral balloon 130 from the holding arm 121 and the movement of the holding arm 121 to its initial position. In the cardiopulmonary resuscitation device 10, the drive unit can detach the oral balloon 130 from the holding arm 121 and move the holding arm 121 to its initial position in accordance with a command from the holding arm control unit 203a. In the cardiopulmonary resuscitation device 10, operation information that the movement of the holding arm 121 to its initial position has been completed can be transmitted to the information processing device 20 via the information processing unit 170.

[0125] When the information processing device 20 receives operation information indicating that the movement of the holding arm 121 to the initial position has been completed, an artificial respiration initiation step S11 is executed. In the artificial respiration initiation step S11, artificial respiration is performed on the subject 2 based on the breathing data. In the information processing device 20, the artificial respiration control unit 203e can determine to start artificial respiration using the artificial respirator based on the breathing data acquired by the acquisition unit 201. In the cardiopulmonary resuscitation device 10, the drive unit drives the artificial respirator and starts artificial respiration in accordance with a command from the artificial respirator control unit 203e.

[0126] In the artificial respiration initiation step S11, the operation mode of the artificial respirator is set or switched as appropriate based on the breathing data. In the information processing device 20, the artificial respirator control unit 203e can determine the setting or switching of the operation mode of the artificial respirator as appropriate based on the breathing data. In the cardiopulmonary resuscitation device 10, the drive unit drives the artificial respirator in the set or switched operation mode in accordance with the command of the artificial respirator control unit 203e.

[0127] When artificial respiration is started in the artificial respiration start step S11, the oral balloon 130 connected to the ventilator remains in the oral cavity of the subject 2, and if the second insertion step S9 has been performed, the oral balloon 130 and the tube 140 remain, and the intubation step SC according to this embodiment is completed.

[0128] In the processing flow of the intubation process SC described here, except for the initial preparation process S1, the start of the next process is determined based on operation information that the previous process has been completed, but the start of each process may be determined by the user inputting the start of each process into the input unit 230. In this case, the output unit 240 of the information processing device 20 may instruct the user to perform operations such as inputting instruction information.

[0129] Among cardiopulmonary resuscitation procedures, tracheal intubation in particular requires specialized skills from a physician. The cardiopulmonary resuscitation method using the cardiopulmonary resuscitation system 1 uses image recognition technology based on machine learning to smoothly perform intubation. Furthermore, this configuration allows for automatic intubation without the user having to perform the work themselves. The automatic intubation configuration allows for intubation to be performed even in situations where a physician is not present, such as at an emergency scene, thereby improving the chances of saving a life. Furthermore, the automatic intubation configuration can contribute to reducing the risk of medical accidents and infection during intubation.

[0130] 2. Second Embodiment The cardiopulmonary resuscitation system 1 according to this embodiment includes a cardiopulmonary resuscitation device 10. The cardiopulmonary resuscitation system 1 according to this embodiment differs from the first embodiment in that drive control and image processing are performed by a control unit 371 of an information processing unit 370 of the cardiopulmonary resuscitation device 10. The following description will focus on the differences from the first embodiment.

[0131] The information processing unit 370 of the cardiopulmonary resuscitation device 10 has a hardware configuration including a control unit 371, a storage unit 372, an input unit 373, and an output unit 374 ( FIG. 19 ). The control unit 371, the storage unit 372, the input unit 373, and the output unit 374 are interconnected by a communication bus 600. The information processing unit 370 and the drive unit are also interconnected by the communication bus 600. The hardware configuration of the information processing unit 370 can be a processor similar to that used in the control unit 200 of the information processing device 20 of the first embodiment.

[0132] The control unit 371 also includes, as functional components, an acquisition unit 371a, an image processing control unit 371b, and a drive control unit 371c (FIG. 20). The image processing control unit 371b and the drive control unit 371c correspond to the image processing control unit 202 and the drive control unit 203 of the information processing device 20 in the first embodiment.

[0133] The acquisition unit 371a acquires images and videos (hereinafter referred to as captured images) captured by the imaging unit 150, distance and angle data (hereinafter referred to as distance data) captured by the distance sensor, information regarding the status of the operation performed by the drive unit in response to commands from the drive control unit 371c, data such as the breathing condition of the subject 2 captured by the ventilator sensor, and instruction information input by the input unit 373 (hereinafter referred to as instruction information).

[0134] The image processing control unit 371b includes an epiglottis recognition unit 371b1 and an insertion position determination unit 371b2. The image processing control unit 371b performs image processing using the epiglottis recognition unit 371b1 and the insertion position determination unit 371b2 based on the captured image and distance data acquired by the acquisition unit 371a.

[0135] The drive control unit 371c controls the operation of each component based on the various information acquired by the acquisition unit 371a. The drive control unit 371c includes a holding arm control unit 371c1, a tube control unit 371c2, a flap control unit 371c3, a balloon control unit 371c4, and an artificial respirator control unit 371c5.

[0136] The storage unit 372 may include a volatile memory or a non-volatile memory similar to the storage unit 210 of the information processing device 20 of the first embodiment. The programs stored in the storage unit 372 include an OS (Operating System) for realizing the functions of the control unit 371, drivers for controlling various hardware, programs for realizing various functions, and the like, and include the computer program according to this embodiment.

[0137] The input unit 373 and the output unit 374 can be devices similar to those used in the input unit 230 and the output unit 240 of the information processing apparatus 20 of the first embodiment.

[0138] 3. Third Embodiment The cardiopulmonary resuscitation system 1 according to this embodiment differs from the first embodiment in that it includes an image processing device 40 and a drive processing device 50. The cardiopulmonary resuscitation device 10, the image processing device 40, and the drive processing device 50 are configured to be able to communicate with each other via a communication line. The following description will focus on the differences from the first embodiment.

[0139] The hardware configuration of the information processing unit 170 of the cardiopulmonary resuscitation device 10 is the same as that of the information processing unit 170 of the first embodiment. The communication unit 173 included in the information processing unit 170 is configured to be capable of transmitting and receiving information and has a function of connecting to a communication line. The communication unit 173 is preferably configured to be able to communicate with the image processing device 40 and the drive processing device 50 without connecting to the Internet. The communication unit 173 can preferably have a function that enables short-range wireless communication such as Bluetooth (registered trademark) or infrared communication, or a function that enables a wired connection, for example.

[0140] The image processing device 40 has a hardware configuration including a control unit 400, a storage unit 410, a communication unit 420, an input unit 430, and an output unit 440 (FIG. 21). The control unit 400, the storage unit 410, the communication unit 420, the input unit 430, and the output unit 440 are interconnected by a communication bus 600. The hardware configuration of the image processing device 40 can be a processor similar to that used in the information processing device 20 of the first embodiment.

[0141] The communication unit 420 of the image processing device 40 is configured to be capable of transmitting and receiving data and has a function of connecting to a communication line. The communication unit 420 is preferably configured to be able to communicate with the cardiopulmonary resuscitation device 10 and the drive processing device 50 without connecting to the Internet. The communication unit 420 preferably has a function that enables short-range wireless communication such as Bluetooth (registered trademark) or infrared communication, or a function that enables wired connection.

[0142] The image processing device 40 includes, as functional components, an acquisition unit 401 and an image processing control unit 402 (FIG. 22).

[0143] The acquisition unit 401 of the image processing device 40 acquires images and videos (hereinafter referred to as captured images) captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10, distance and angle data (hereinafter referred to as distance data) captured by the distance sensor, and instruction information (hereinafter referred to as instruction information) input by the input unit 430.

[0144] The image processing control unit 402 includes an epiglottis recognition unit 402a and an insertion position determination unit 402b. The image processing control unit 402 performs image processing using the epiglottis recognition unit 402a and the insertion position determination unit 402b based on the captured image and distance data acquired by the acquisition unit 401. The image processing control unit 402 can have the same functions as the image processing control unit 202 of the first embodiment.

[0145] The drive processing device 50 has a hardware configuration including a control unit 500, a storage unit 510, a communication unit 520, and an input unit 530 (FIG. 23). The control unit 500, the storage unit 510, the communication unit 520, and the input unit 530 are interconnected by a communication bus 600. The hardware configuration of the drive processing device 50 can be a processor similar to that used in the information processing device 20 of the first embodiment.

[0146] The communication unit 520 of the drive processing device 50 is configured to be capable of transmitting and receiving data and has a function of connecting to a communication line. The communication unit 520 is preferably configured to be able to communicate with the cardiopulmonary resuscitation device 10 and the image processing device 40 without connecting to the Internet. The communication unit 520 preferably has a function that enables short-range wireless communication such as Bluetooth (registered trademark) or infrared communication, or a function that enables wired connection.

[0147] The drive processing device 50 includes, as its functional components, an acquisition unit 501 and a drive control unit 502 (FIG. 24).

[0148] The acquisition unit 501 of the drive processing device 50 acquires images and videos captured by the imaging unit 150 of the cardiopulmonary resuscitation device 10, distance and angle data acquired by the distance sensor, information regarding the status of the operations performed by the drive unit of the cardiopulmonary resuscitation device 10, data such as the breathing condition of the subject 2 acquired by the ventilator sensor, images and videos generated by the image processing device, and instruction information input by the input unit (hereinafter referred to as instruction information).

[0149] The drive control unit 502 controls the operation of each component of the cardiopulmonary resuscitation apparatus 10 based on the various information acquired by the acquisition unit 501. The drive control unit 502 includes a holding arm control unit 502a, a tube control unit 502b, a flap control unit 502c, a balloon control unit 502d, and an artificial respirator control unit 502e. The drive control unit 502 can have the same functions as the drive control unit 203 of the first embodiment.

[0150] 4. Fourth Embodiment The cardiopulmonary resuscitation system 1 according to this embodiment differs from the first embodiment mainly in the structure around the intubation arm 122. The following description will focus on the differences from the first embodiment.

[0151] 25 , the intubation arm 722 according to this embodiment includes a guide section 722a, an imaging section installation section 722b, an intubation section (not shown), and a guide unit 723. The guide section 722a, the imaging section installation section 722b, and the intubation section can have the same functions as the guide section 122a, the imaging section installation section 122c, and the intubation section 122d according to the first embodiment. Furthermore, the imaging section installation section 722b is preferably provided at the tip of the guide section 722a.

[0152] The guide unit 723 has a function similar to that of the oral balloon 130 and the flap portion 122b in the first embodiment integrated together. Therefore, in the intubation arm 722 according to this embodiment, unlike the first embodiment, the flap portion 723b is not attached to the guide portion 722a. Note that the oral balloon 130 in the first embodiment can be read as the guide unit 723, and the oral balloon detachment condition as the guide unit detachment condition.

[0153] 25 , the guide unit 723 can include a main body portion 723a, a flap portion 723b, and an inlet portion 723c. The guide unit 723 is formed in a cylindrical shape, and is configured so that the guide portion 722a and the tube 140 can be disposed inside the guide unit 723 from the inlet portion 723c. Specifically, the tube 140 is disposed inside the cylindrical interior of the guide unit 723, and the guide portion 722a is disposed inside the tube 140.

[0154] With this configuration, the intubation arm 722 according to this embodiment is configured such that the drive of the guide portion 722a is controlled by the tube control unit 203b, and when the guide portion 722a moves, the flap portion 723b and the tube 140 move in accordance with the movement of the guide portion 722a. Furthermore, the guide portion 722a and the guide unit 723 are configured to be fixed in the direction of intubation progression after their positions are adjusted in the first insertion step S5. That is, in the epiglottis opening step S6 and thereafter, only the tube 140 is configured to move forward and / or backward.

[0155] The main body 723a includes a fixing balloon 723a1. The fixing balloon 723a1 plays the role of the oral balloon 130 in the first embodiment. The fixing balloon 723a1 is configured to be inflatable inside the mouth of the subject 2. The fixing balloon 723a1 is disposed at a position 40 to 60 mm from the tip of the flap portion 723b of the intubation arm 722. Specifically, the position at which the fixing balloon 723a1 is disposed may be, for example, 20, 25, 30, 35, 40, 42, 44, 46, 48, 50, 52, 54, 56, 58, 60, 65, 70, 75, or 80 mm from the tip of the flap portion 723b, or may be within a range between any two of the numerical values ​​exemplified here.

[0156] When the intubation arm 722 is positioned in the oral cavity of the subject 2, the fixing balloon 723a1 is inflated to fix the position of the intubation arm 722 in the oral cavity of the subject 2, thereby enabling smooth intubation. The fixing balloon 723a1 has a gas inlet (not shown) and is driven by the gas filling unit via the gas inlet. The gas inlet is, for example, tubular and extends along the main body 723a to the inlet 723c.

[0157] The flap portion 723b is adjacent to the fixing balloon 723a1 and is formed continuously with the main body portion 723a (FIG. 27). The flap portion 723b is a portion formed in a tapered shape that narrows from the main body portion 723a toward the tip of the guide unit 723 (FIG. 26). The flap portion 723b has cuts formed in the left-right direction, forming it in an alligator-like shape.

[0158] The flap portion 723b includes a flap balloon 723b1 therein (FIG. 28). The flap portion 723b is configured to open and close by driving the flap balloon 723b1. Specifically, the flap portion 723b is opened by the expansion of the flap balloon 723b1 (FIG. 26), and closed by the contraction of the flap balloon 723b1 (FIG. 25).

[0159] The epiglottis can be opened by opening the flap portion 723b in the oral cavity of the subject 2. The flap balloon 723b1 has a gas inlet (not shown) and is driven by the gas filling portion via the gas inlet. The gas inlet is, for example, tubular and extends along the inside of the main body portion 723a to the inlet portion 723c.

[0160] The flap portion 723b may further include a band portion 723b2 (FIGS. 25 and 26). The band portion 723b2 is a member for closing the flap portion 723b and maintaining the flap portion 723b in a closed state. This prevents the flap portion 723b from opening and getting caught in the oral cavity of the subject 2. Furthermore, the intubation tube 140 can be more reliably fixed after the intubation step SC is completed.

[0161] The band portion 723b2 can be made of any elastic material, such as rubber. The elasticity of the band portion 723b2 can be such that the flap portion 723b can be maintained in a closed state and that the flap portion 723b can be opened by inflating the flap balloon 723b1. In the illustrated example, the band portion 723b2 is provided so as to wrap around the flap portion 723b in a direction perpendicular to the longitudinal direction of the guide unit 723.

[0162] The width T of the band portion 723b2 is preferably 10 to 40% of the length L of the flap portion 723b. Specifically, for example, the width T of the band portion 723b2 may be 10, 15, 20, 25, 30, 35, or 40% of the length L of the flap portion 723b, or may be within a range between any two of the numerical values ​​exemplified here.

[0163] The band portion 723b2 is preferably disposed at a position from the tip of the flap portion 723b that is 50 to 90% of the length L of the flap portion 723b. Specifically, for example, the position at which the band portion 723b2 is disposed may be 50, 55, 60, 65, 70, 75, 80, 85, or 90% of the length L of the flap portion 723b from the tip of the flap portion 723b, or may be within a range between any two of the numerical values ​​exemplified here.

[0164] Furthermore, it is preferable that a notch 723b3 is formed at the tip of the flap portion 723b. By forming the notch 723b3, the imaging unit 150 can capture images in the direction of travel even when the flap portion 723b is closed. The notch 723b3 can be formed in any shape, but in the example shown, the notch 723b3 is formed in a substantially U-shape. The material of the main body portion 723a and the flap portion 723b can be any elastomer that is not harmful to the human body, such as silicone or styrene ethylene butylene styrene (SEBS).

[0165] The gas filling section is connected to the gas inlet of the fixing balloon 723a1 and the gas inlet of the flap balloon 723b1, respectively. The gas filling section can fill the fixing balloon 723a1 and the flap balloon 723b1 with gas via the respective gas inlets, or can evacuate the fixing balloon 723a1 and the flap balloon 723b1 from the gas inlet.

[0166] The flap control unit 203c can control the flap balloon 723b1 via the gas inlet. The flap control unit 203c controls the gas filling unit so that the flap balloon 723b1 is inflated to a predetermined pressure. The predetermined pressure is, for example, 20 to 35 cmH. ２ It is O.

[0167] The balloon control unit 203d can control the fixing balloon 723a1 via the gas inlet. The balloon control unit 203d controls the gas filling unit so that the fixing balloon 723a1 is inflated to a predetermined pressure. The predetermined pressure is, for example, 15 to 30 cmH. ２ It is O.

[0168] 4.2 Cardiopulmonary resuscitation method using cardiopulmonary resuscitation system 1 In the cardiopulmonary resuscitation method according to this embodiment, the fixing balloon 723a1 is inflated instead of the oral cavity balloon 130 in the balloon inflation step S2.

[0169] Furthermore, in the epiglottis opening step S6, the flap control unit 203c can determine to introduce gas into the gas inlet of the flap balloon 723b1. In the cardiopulmonary resuscitation apparatus 10, the drive unit drives the gas filling unit in accordance with a command from the flap control unit 203c, thereby filling the flap balloon 723b1 with gas. This causes the flap unit 723b to open.

[0170] 5. Fifth Embodiment The cardiopulmonary resuscitation system 1 according to this embodiment differs from the first embodiment in that the cardiopulmonary resuscitation device 10 further includes an electrocardiogram acquisition unit 180, a breath measurement unit 181, and a cardiac massage unit 190, and the information processing device 20 further includes a treatment determination unit 204 and a cardiac massage control unit 205. The following description will focus on the differences from the first embodiment.

[0171] 5.1 Cardiopulmonary resuscitation device 10 5.1.1 Electrocardiogram acquisition unit 180 The electrocardiogram acquisition unit 180 is configured to be capable of acquiring electrocardiogram data. The electrocardiogram acquisition unit 180 can be any component as long as it has such a function. For example, the electrocardiogram acquisition unit 180 may be an existing monitor electrocardiogram. The electrocardiogram acquisition unit 180 is configured to be capable of transmitting electrocardiogram data to the information processing device 20 via the communication unit 173 provided in the information processing unit 170. It is preferable that the electrocardiogram acquisition unit 180 is configured to constantly acquire electrocardiogram data while the cardiopulmonary resuscitation device 10 is running.

[0172] The electrocardiogram acquisition unit 180 is installed in the head and neck fixing unit 160. Specifically, the electrocardiogram acquisition unit 180 is installed in a position in the head and neck fixing unit 160 where it can come into contact with the head, neck, and / or back of the subject 2 when the subject 2 is placed on the head and neck fixing unit 160. By arranging the electrocardiogram acquisition unit 180 in this manner, the user can acquire an electrocardiogram by simply placing the subject 2 on the cardiopulmonary resuscitation device 10, without having to attach additional electrode pads or the like.

[0173] 5.1.2 Breath Measurement Unit 181 The breath measurement unit 181 is a component capable of measuring breath data, and any component having such a function can be used. ２ In this case, the breath data may be recorded in the ETCO ２ The exhaled breath data is configured to be able to be transmitted to the information processing device 20 via the communication unit 173 included in the information processing unit 170. It is preferable that the exhaled breath measurement unit 181 is configured to constantly acquire the exhaled breath data while the cardiopulmonary resuscitation device 10 is activated.

[0174] The breath measurement unit 181 can be provided at any location as long as it is capable of measuring the breath of the subject 2. For example, the breath measurement unit 181 can be provided adjacent to the opening 110. By arranging the breath measurement unit 181 in this manner, the frame unit 100 can adjust the position of the opening 110 and the mouth of the subject 2, and at the same time, the breath measurement unit 181 can adjust its position to a position where it measures the breath from the mouth or nose of the subject 2.

[0175] 5.1.3 Cardiac massage unit 190 The cardiac massage unit 190 is a component capable of automatically performing cardiac massage. Any component can be used for the cardiac massage unit 190 as long as it has the relevant function. For example, an existing automatic cardiac massage device such as the Clover 3000 manufactured by Koken Medical Co., Ltd. may be used as the cardiac massage unit 190. The cardiac massage unit 190 is controlled to start or stop cardiac massage based on commands from a cardiac massage control unit 205 (described later).

[0176] 29 is a block diagram showing the functional configuration of the information processing device 20 according to the present invention. The information processing device 20 further includes a treatment determination unit 204 and a cardiac massage control unit 205. In addition, the output unit 240 outputs an electrocardiogram waveform and an ETCO waveform using the electrocardiogram data and the exhalation data acquired from the electrocardiogram acquisition unit 180 and the exhalation measurement unit 181. ２ The waveform can also be displayed.

[0177] (1) Treatment decision unit 204 The treatment decision unit 204 includes an electrocardiogram analysis unit 204a and an exhalation analysis unit 204b. The treatment decision unit 204 decides whether or not to perform cardiopulmonary resuscitation treatment on the subject 2 based on the electrocardiogram data and exhalation data acquired by the acquisition unit 201. Hereinafter, a state in which cardiopulmonary resuscitation treatment is required is referred to as a treatment-requiring state. Note that in this specification, a treatment-requiring state refers to a state of cardiac arrest and / or a state of respiratory arrest.

[0178] The electrocardiogram analysis unit 204a analyzes the electrocardiogram data acquired from the electrocardiogram acquisition unit 180 via the acquisition unit 201 of the control unit 200. The electrocardiogram analysis unit 204a can determine whether the subject 2 is in a state of cardiac arrest (or asystole) using the electrocardiogram data.

[0179] The breath analysis unit 204b analyzes the breath data acquired from the breath measurement unit 181 via the acquisition unit 201 of the control unit 200. The breath analysis unit 204b can use the breath data to determine whether the subject 2 is in a state of respiratory arrest.

[0180] (2) Cardiac Massage Control Unit 205 The cardiac massage control unit 205 controls the driving of the cardiac massage unit 190 based on information from the treatment decision unit 204. Specifically, for example, when the cardiac massage unit 190 receives information from the treatment decision unit 204 that the subject 2 is still in a condition requiring treatment after being connected to an artificial respirator, the cardiac massage unit 190 can control cardiac massage so that the cardiac massage unit 190 starts driving. Also, for example, the cardiac massage control unit 205 may be configured to stop driving the cardiac massage unit 190 after performing cardiac massage for a certain period of time.

[0181] 5.1.3 Cardiopulmonary resuscitation method using cardiopulmonary resuscitation system 1 The cardiopulmonary resuscitation method according to this embodiment further includes a first treatment decision step SD, a second treatment decision step SE, and a cardiac massage step SF. The cardiopulmonary resuscitation method is performed in the following order: airway management step SA, first treatment decision step SD, opening step SB, intubation step SC, second treatment decision step SE, and cardiac massage step SF. The first treatment decision step SD, second treatment decision step SE, and cardiac massage step SF will be mainly described below with reference to FIG. 30 .

[0182] Before starting the cardiopulmonary resuscitation method using the cardiopulmonary resuscitation system 1, the user attaches the cardiac massage unit 190 to the subject 2.

[0183] [First Treatment Decision Step SD] The first treatment decision step SD is performed after the airway management step SA. In the first treatment decision step SD, first, the electrocardiogram acquisition unit 180 acquires electrocardiogram data of the subject 2 and transmits the data to the information processing device 20 via the information processing unit 170.

[0184] Furthermore, in the first treatment determination process SD, the user moves the frame unit 100 to adjust the position so that the breath measurement unit 181 is positioned near the mouth of the subject 2. When the position adjustment is complete, the breath measurement unit 181 acquires breath data of the subject 2 and transmits it to the information processing device 20 via the information processing unit 170.

[0185] In the treatment decision unit 204 of the information processing device 20, when the electrocardiogram analysis unit 204a and the exhalation analysis unit 204b receive the electrocardiogram data and the exhalation data, they analyze the electrocardiogram data and the exhalation data, respectively. The treatment decision unit 204 determines whether the subject 2 is in a state requiring treatment based on the analysis results. If the treatment decision unit 204 determines that the subject 2 is not in a state requiring treatment, it can determine that cardiopulmonary resuscitation treatment is unnecessary and decide to end the cardiopulmonary resuscitation method. If the treatment decision unit 204 determines that the subject 2 is in a state requiring treatment, the process proceeds to an opening step SB.

[0186] [Second Treatment Decision Step SE] The second treatment decision step SE is performed after the intubation step SC. In the second treatment decision step SE, similar to the first treatment decision step SD, it is determined whether the subject 2 is in a state requiring treatment. If the treatment decision unit 204 determines that the subject 2 is not in a state requiring treatment, it can determine that the subsequent cardiac massage step SF is unnecessary and decide to end the cardiopulmonary resuscitation method. If the treatment decision unit 204 still determines that the subject 2 is in a state requiring treatment, it proceeds to the cardiac massage step SF.

[0187] [Cardiac Massage Step SF] In the cardiac massage step SF, the cardiac massage control unit 205 controls the cardiac massage unit 190 to start cardiac massage on the subject 2. The cardiac massage step SF may be configured to end after cardiac massage has been performed for a certain period of time.

[0188] Furthermore, the cardiac massage step SF may be configured to determine whether the subject 2 is in a state requiring treatment after performing cardiac massage for a certain period of time, similar to the first treatment decision step SD and the second treatment decision step SE. In this case, if it is determined that the subject 2 is not in a state requiring treatment, the cardiac massage control unit 205 stops driving the cardiac massage unit 190. Furthermore, the cardiac massage step SF may be ended by receiving an instruction to stop driving the cardiac massage unit 190 from the user via the input unit 174.

[0189] When the cardiac massage step SF is completed, the cardiopulmonary resuscitation method is completed.

[0190] 6. Sixth Embodiment The cardiopulmonary resuscitation system 1 according to this embodiment differs from the first embodiment mainly in the structure of the frame unit 100. Unlike the first embodiment in which the frames 101 to 103 are aligned in various directions, the frame unit 800 of this embodiment is configured to surround the head of the subject 2 like a helmet. Furthermore, the frame unit 800 of this embodiment also has the function of a head and neck fixing unit 160. The following description will focus on the differences from the first embodiment.

[0191] 6.1 Cardiopulmonary resuscitation device 10 The frame portion 800 according to this embodiment will be described with reference to Fig. 31. The frame portion 800 includes a head fixing portion 801, a chin holder portion 802, and an installation frame 803 portion.

[0192] (1) Head fixing unit 801 The head fixing unit 801 is a base for holding the head of the subject 2. In the illustrated example, the external shape of the head fixing unit 801 is a rectangular parallelepiped, but the external shape can be any shape as long as it can ensure stability as a base.

[0193] The head fixing unit 801 is formed with a head placement surface 801a for placing the head of the subject 2. The head placement surface 801a is configured to have a shape that fits the shape of a human head. In addition, in this embodiment, if the electrocardiogram acquisition unit 180 in the fifth embodiment is provided, the electrocardiogram acquisition unit 180 is placed on the head placement surface 801a.

[0194] (2) Chin holder 802 The chin holder 802 maintains the chin of the subject 2 in a lifted position to secure the airway. The chin holder 802 is a member connected to the head fixing unit 801 for fixing the chin of the subject 2. The chin holder 802 includes an extension portion 802a and a chin placement portion 802b. The extension portion 802a is provided so as to extend from the end of the head fixing unit 801 located on the top side of the head of the subject 2 when the subject 2 is placed on the head fixing unit 801, and is configured to be rotatable in the direction of arrow Z in FIG. 31 .

[0195] The chin mounting portion 802b is connected to the extension portion 802a. The chin mounting portion is a portion that comes into contact with the chin of the subject 2 to fix the chin, and therefore preferably has a shape that conforms to the shape of a human jaw. In the example shown, the chin mounting portion 802b is configured in a substantially U-shape. The chin mounting portion 802b is connected to the extension portion 802a so that it can move in the longitudinal direction (the direction of arrow W in FIG. 32 ). This allows the chin to be lifted and fixed regardless of the size of the subject 2's face.

[0196] (3) Installation Frame 803 The installation frame 803 extends from the end of the head fixing part 801 similar to the chin holder 802, and is provided rotatable in the direction of arrow Z in Fig. 31 similar to the chin holder 802. The installation frame 803 has the same function as the third frame 103 according to the first embodiment. That is, the opening 110 and the arm part 120 are attached to the installation frame 803.

[0197] 6.2 Cardiopulmonary resuscitation method using cardiopulmonary resuscitation system 1 Here, the airway securing step SA and opening step SB using the frame unit 800 according to this embodiment will be mainly described. In the airway securing step SA, the user first places the head of the subject 2 on the head placement surface 801a of the head fixing unit 801. Next, as shown in FIG. 32 , the user rotates the extension unit 802a to align the chin placement unit 802b of the chin holder 802 so that the chin placement unit 802b is positioned so that the chin of the subject 2 can be fixed.

[0198] In the opening step SB, the user rotates the installation frame 803 and aligns the upper jaw fixing portion 111 of the opening 110 and the oral insertion portion of the lower jaw moving portion 112 so that they are inserted between the upper jaw and lower jaw of the subject 2. After fixing, the lower jaw moving portion 112 is moved forward to open the mouth ( FIG. 33 ).

[0199] Next, in the intubation step SC, as shown in FIG. 34, the holding arm 121 is set to the intubation start position, and various operations are performed, similarly to the first embodiment.

[0200] 7. Other Embodiments 7.1 Computer Program A computer program according to one embodiment of the present invention is a program that causes a computer to execute the processes performed by the information processing device 20 in the preparation step S1, the balloon inflation step S2, the epiglottis recognition step S3, the first adjustment step S4, the first insertion step S5, the epiglottis opening step S6, the insertion position determination step S7, the second adjustment step S8, the second insertion step S9, the detachment step S10, and the artificial respiration initiation step S11 of the cardiopulmonary resuscitation method of the first embodiment.

[0201] The computer on which the program is executed may be an information processing device such as a personal computer, smartphone, tablet, smart watch, or smart glasses, and may be the information processing device 20 described in the first embodiment, etc., or an information processing device having a similar hardware configuration.

[0202] 7.2 Information Processing Device 20 The information processing device 20 (as well as the image processing device 40 and the drive processing device 50) can also be realized as a computer-readable non-transitory recording medium storing a program related to the information processing functions of each embodiment, or a computer-readable recording medium storing the above-mentioned program.

[0203] In addition, in all the embodiments in this specification, the functions performed by the information processing device 20 can be realized by the information processing unit 170 provided in the cardiopulmonary resuscitation device 10.

[0204] 7.3 Imaging Unit 150 In the first embodiment, a tip-movable endoscope can be used as the imaging unit 150. When such an endoscope is used, the epiglottis may be opened by the operation of the endoscope instead of the flap portion 122b. The endoscope can be connected to a driving unit and controlled by the driving control unit 203.

[0205] In the fourth embodiment, a tip-movable endoscope can be used as the imaging unit 150 and the guide unit 722a. The endoscope can move freely across a horizontal plane perpendicular to the direction of intubation. In this case, in the first insertion step S5, the endoscope can be driven to control the movement of the flap unit 723b to a position where the epiglottis can be opened. In addition, in the second insertion step S9, the endoscope can be driven based on the insertion reference position, thereby controlling the movement of the tube 140 to a position toward the trachea.

[0206] 7.4 Cardiopulmonary Resuscitation Method The intubation step SC in the cardiopulmonary resuscitation method using the cardiopulmonary resuscitation system 1 does not have to include the epiglottis opening step S6. In this case, in the first insertion step S5, the tube control unit 203b can be configured to be able to control the guide unit 122a so that the guide unit 122a itself is inserted toward the trachea so as to slip under the epiglottis (indicating the downward direction in FIG. 13 ).

[0207] For example, when the epiglottis recognition unit 202a recognizes the lower edge or a portion of the lower edge of the epiglottis, the guide unit 122a can move toward a portion below the recognized lower edge or portion of the lower edge. When the epiglottis recognition unit 202a recognizes the center point of the epiglottis, the guide unit 122a can move to a position below the recognized center point a predetermined distance away. In this embodiment, when the first insertion step S5 is completed, the insertion position determination step S7 is started.

[0208] In the fifth embodiment, the electrocardiogram data and the exhalation data can be displayed by the output unit 240 of the information processing device 20. However, a separate output unit for displaying the electrocardiogram data and the exhalation data may be provided. The output unit may be provided at any location in the cardiopulmonary resuscitation device 10 or the information processing device 20.

[0209] 8. Other Effects From another perspective, in assisting cardiopulmonary resuscitation, fixing the head of the subject 2 in an appropriate position during intubation can be a problem. The cardiopulmonary resuscitation device according to the present invention provides a head and neck fixing unit that fixes the head by pressing it downward. This makes it possible to fix the head and simultaneously perform jaw lift, making it possible to smoothly assist intubation.

[0210] From another perspective, when assisting cardiopulmonary resuscitation, the opening operation of the subject 2 can be problematic. The cardiopulmonary resuscitation device according to the present invention provides an opening that includes an upper jaw fixing unit and a lower jaw moving unit. This allows the user to perform the opening operation without inserting their fingers into the mouth of the subject 2, making it possible to perform the opening operation easily and safely.

[0211] From another perspective, intubation requires specialized skills, and conventional devices have sometimes been insufficient to support intubation. The intubation arm of the present invention provides a guide unit having a flap portion and a fixing balloon, and a guide portion. This makes it possible to open the epiglottis while fixing the position of the tube when performing intubation, thereby enabling smooth support for intubation.

[0212] From another perspective, intubation varies greatly depending on the user's skill level, and it is necessary to make the airway easier to see in order to perform intubation at a consistent level. The frame unit 800 according to the sixth embodiment of the present invention provides a head fixation unit and a chin holder. This allows the subject's lower jaw to be lifted and the airway to be uniformly aligned in a straight line, making it possible to perform intubation mechanically using the cardiopulmonary resuscitation system 1.

[0213] 2: Subject, 10: Cardiopulmonary resuscitation device, 122: Intubation arm, 122a: Guide unit, 122b: Flap unit, 140: Tube, 150: Photography unit, 171: Control unit, 180: Electrocardiogram acquisition unit, 181: Breath measurement unit, 200: Control unit, 201: Acquisition unit, 202: Image processing control unit, 202a: Epiglottis recognition unit, 202b: Insertion position determination unit, 203: Drive control unit, 203b: Tube control unit, 203c: Flap control unit, 204: Treatment determination unit, 722: Intubation arm, 722a: Guide unit, 723: Guide unit, 723b: Flap unit, 723b1: Flap balloon, R: Insertion reference position

Claims

1. A cardiopulmonary resuscitation device comprising: an intubation arm, an imaging unit, a tube, an image processing control unit, and a drive control unit; the intubation arm comprises a flap unit; the imaging unit is attached to the intubation arm; the image processing control unit comprises an epiglottis recognition unit and an insertion position determination unit; the drive control unit comprises a flap control unit and a tube control unit; the epiglottis recognition unit recognizes at least a portion of the epiglottis in an image or video captured by the imaging unit; the insertion position determination unit recognizes the glottis area in the image or video and determines an insertion reference position for the tube based on the recognized glottis area; the flap control unit controls the flap unit to open the recognized epiglottis; and the tube control unit controls insertion of the tube based on the insertion reference position for the tube.

2. A cardiopulmonary resuscitation device as described in claim 1, wherein the epiglottis recognition unit recognizes at least a portion of the epiglottis in the image or video based on a first learning model, and the insertion position determination unit recognizes the glottis area in the image or video based on a second learning model, and determines the insertion reference position of the tube based on the recognized glottis area.

3. A cardiopulmonary resuscitation device as described in claim 2, wherein a first learning model is configured to recognize the extent of the epiglottis in the image or video when the image or video is input to the first learning model, and to output at least a partial area of ​​the epiglottis from within the range of the epiglottis, and a second learning model is configured to recognize the extent of the glottis region in the image or video when the image or video is input to the second learning model, and to output the glottis region from within the range of the glottis region.

4. A cardiopulmonary resuscitation device as described in claim 1, wherein the flap portion is formed in an alligator mouth shape and has a flap balloon therein, and the flap portion is configured to be opened by inflating the flap balloon.

5. A cardiopulmonary resuscitation device as described in claim 1, wherein the intubation arm comprises a guide unit and a guide section, the guide unit comprises the flap section and is formed in a cylindrical shape, the guide section is a rod-shaped member and has the imaging section attached to its tip, the intubation arm is configured such that the tube is located inside the cylindrical interior of the guide unit and the guide section is located inside the tube, so that the flap section and the tube also move in accordance with the movement of the guide section, and the tube control section drives the guide section so that the flap section moves to a position where it can open the epiglottis.

6. A cardiopulmonary resuscitation device as described in claim 1, further comprising an electrocardiogram acquisition unit, an exhaled breath measurement unit, and a treatment decision unit, wherein the electrocardiogram acquisition unit is configured to be capable of acquiring electrocardiogram data, the exhaled breath measurement unit is configured to be capable of measuring exhaled breath data, and the treatment decision unit decides whether or not to perform cardiopulmonary resuscitation treatment on a subject based on the electrocardiogram data and the exhaled breath data.

7. A cardiopulmonary resuscitation device according to claim 1, further comprising a holding arm and a holding arm control unit, wherein the intubation arm comprises a guide unit, a guide section, and an intubation section, wherein the guide unit comprises the flap section and a fixing balloon, and is formed in a cylindrical shape, the guide section is a rod-shaped member, and the imaging section is attached to a tip of the guide section, wherein the intubation section is configured to allow the tube to be attached and detached, wherein the guide unit, the guide section, and the tube are arranged such that the tube is located inside the cylindrical interior of the guide unit, and the guide section is located inside the tube, and wherein the flap section and the tube also move in accordance with the movement of the guide section, wherein the tube control unit controls the drive of the guide section so that the flap section moves to a position where the epiglottis can be opened, and controls the drive of the intubation section so that the tube is inserted, and determines to detach the tube when a tube detachment condition is satisfied, wherein the flap section is formed in an alligator mouth shape, and is provided with a flap balloon therein, the flap portion is configured to be opened by the expansion of the flap balloon, the fixing balloon is provided adjacent to the flap portion and is configured to be expandable, the holding arm holds the intubation arm, the holding arm control unit can determine to detach the guide unit based on a guide unit detachment condition, the epiglottis recognition unit recognizes at least a partial area of ​​the epiglottis in the image or the video based on a first learning model, the first learning model is configured to recognize the range of the epiglottis in the image or the video when the image or the video is input to the first learning model, and output at least a partial area of ​​the epiglottis from within the range of the epiglottis, the insertion position determination unit recognizes a glottis area in the image or the video based on a second learning model, and determines an insertion reference position of the tube based on the recognized glottis area,The second learning model is configured to recognize the range of the glottal area in the image or video when the image or the video is input into the second learning model, and to output the glottal area from within the range of the glottal area; the cardiopulmonary resuscitation device further comprises an electrocardiogram acquisition unit, an exhaled breath measurement unit, and a treatment decision unit, wherein the electrocardiogram acquisition unit is configured to be capable of acquiring electrocardiogram data, the exhaled breath measurement unit is configured to be capable of measuring exhaled breath data, and the treatment decision unit decides whether to perform cardiopulmonary resuscitation treatment on a subject based on the electrocardiogram data and the exhaled breath data.

8. A system comprising an imaging unit, a flap unit, an epiglottis recognition unit, and a flap control unit, wherein the epiglottis recognition unit recognizes at least a portion of the epiglottis in an image or video captured by the imaging unit, and the flap control unit controls the flap unit to open the recognized epiglottis.

9. A system as described in claim 8, further comprising a tube, an insertion position determination unit, and a tube control unit, wherein the epiglottis recognition unit recognizes at least a partial area of ​​the epiglottis in the image or video based on a first learning model, the first learning model being configured to recognize the extent of the epiglottis in the image or video and output at least a partial area of ​​the epiglottis from within the range of the epiglottis when the image or video is input to the first learning model, the insertion position determination unit recognizes the glottis area in the image or video based on a second learning model and determines an insertion reference position of the tube based on the recognized glottis area, and the second learning model being configured to recognize the extent of the glottis area in the image or video and output the glottis area from within the range of the glottis when the image or video is input to the second learning model, and the tube control unit controls the insertion of the tube based on the insertion reference position of the tube.

Images