Information processing device, information processing system, information processing method, and information processing program

Abstract

In order to enable a user to confirm whether they are performing diaphragm breathing, an information processing device (1) comprises: an image acquisition means (11) for acquiring image data of the user; a calculation means (12) for calculating the user's chest respiratory-cycle and abdomen respiratory-cycle by referring to information contained in the image data; and an output means (14) for outputting the degree of synchronization between the chest respiratory-cycle and the abdomen respiratory-cycle.

Description

Information processing device, information processing system, information processing method, information processing program, and recording medium

[0001] The present invention relates to an information processing device, an information processing system, an information processing method, an information processing program, and a recording medium.

[0002] Devices that measure human respiration from images are known. For example, Patent Document 1 discloses a respiratory function measuring device that measures respiratory function to diagnose obstructive pulmonary disease, restrictive pulmonary disease, etc. This device measures chest and abdominal movements, calculates the respiratory time difference between the time when the abdominal volume decrease rate due to exhalation is at its maximum and the time when the chest volume decrease rate due to exhalation is at its maximum, and detects cases of decreased pulmonary function, for example.

[0003] Furthermore, Patent Document 2 discloses an apparatus for determining and evaluating a plurality of different AC signals corresponding to vital sign information of a subject from a plurality of different regions of an imaging field based on a motion pattern of image data, and determining a plurality of different respiratory signals from the subject based on the different AC signals determined from the different regions of the imaging field. According to this apparatus, respiratory signals from different parts of the subject, such as the thorax and abdomen, can be determined corresponding to different respiratory techniques to increase the accuracy of respiratory detection and to determine additional information from the subject's respiration. In this way, additional diagnosis can be performed, resulting in more reliable and accurate respiratory detection.

[0004] Japanese Patent Publication No. 2008-154655 Japanese Special Publication No. 2016-518191

[0005] The device described in Patent Document 1 aims to detect diseases such as decreased pulmonary function, while the device described in Patent Document 2 aims to perform highly reliable and accurate respiration detection.

[0006] In recent years, teleworking has become widespread, leading to long working hours in environments not designed for working from home, and appropriate refreshment is necessary. Abdominal breathing, in particular, is said to correct thoracic movement, reduce the work of breathing and dyspnea, and improve ventilation efficiency. It has also been reported that conscious abdominal breathing activates the parasympathetic nervous system, allowing a relaxed state to be maintained. However, it is difficult to check for oneself whether abdominal breathing is being performed properly. The devices disclosed in Patent Documents 1 and 2 do not detect whether abdominal breathing is being performed properly.

[0007] One aspect of the present invention has been made in consideration of the above-mentioned problems, and one example of its purpose is to provide a technology that allows a user to check whether they are performing abdominal breathing.

[0008] An information processing device according to one aspect of the present invention includes an image acquisition means for acquiring image data of a user, a calculation means for calculating the user's chest respiratory cycle and abdominal respiratory cycle by referring to information contained in the image data, and an output means for outputting the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0009] An information processing system according to one aspect of the present invention includes an imaging device that captures an image of a user, an image acquisition means that acquires image data of the image, a calculation means that calculates the user's chest respiratory cycle and abdominal respiratory cycle by referring to information contained in the image data, and an output means that outputs the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0010] An information processing method according to one aspect of the present invention includes acquiring image data of a user, calculating the user's chest respiratory cycle and abdominal respiratory cycle by referring to information contained in the image data, and outputting the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0011] An information processing program according to one aspect of the present invention causes a computer to execute an acquisition process for acquiring image data of a user, a calculation process for calculating the user's chest respiratory cycle and abdominal respiratory cycle by referring to information contained in the image data, and an output process for outputting the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0012] According to one aspect of the present invention, a user can check whether or not he or she is performing abdominal breathing.

[0013] 1 is a block diagram showing the configuration of an information processing device 1 according to a first exemplary embodiment of the present invention. FIG. 2 is a flow diagram showing the flow of an information processing method S1 according to the first exemplary embodiment. FIG. 3 is a block diagram showing the configuration of an information processing system 2 according to the first exemplary embodiment. FIG. 4 is a block diagram showing the configuration of an information processing device 1A according to a second exemplary embodiment of the present invention. FIG. 5 is an example showing an area defined as the chest and abdomen from an image of a user by an image analysis unit. FIG. 6 is a graph showing the respiratory cycle of the user's chest and abdomen calculated by a calculation unit. FIG. 7 is an example of advice selected by a determination unit. FIG. 8 is a block diagram showing the configuration of an activation estimation unit. FIG. 9 is an example of changes in vital values ​​that appear when relaxing by abdominal breathing. FIG. 10 is a block diagram showing the configuration of an information processing system 2A. FIG. 11 is a configuration diagram for realizing an information processing device by software. FIG. 12 is a block diagram showing the configuration of an information processing device 1B according to a fourth exemplary embodiment of the present invention. FIG. 13 is a flow diagram showing the flow of an information processing method S2 according to the fourth exemplary embodiment. FIG. 14 is a block diagram showing the configuration of an information processing system 2B according to the fourth exemplary embodiment.

[0014] [First Exemplary Embodiment] A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described below.

[0015] (Configuration of Information Processing Device 1) The configuration of the information processing device 1 according to this exemplary embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the configuration of the information processing device 1. The information processing device 1 is a device that allows a user to check for themselves whether they are performing abdominal breathing. The information processing device 1 may be configured as, for example, a personal computer, or as a mobile device such as a smartphone. Alternatively, it may be configured as a dedicated device that allows a user to check for themselves whether they are performing abdominal breathing. As shown in FIG. 1, the information processing device 1 includes an image acquisition unit 11, a calculation unit 12, a derivation unit 13, and an output unit 14.

[0016] The image acquisition unit 11 acquires image data of the user. The image data may be image data captured by an imaging device (not shown). The imaging device may be a digital camera capable of capturing RGB (Red, Green, Blue) moving images. Alternatively, the imaging device may be a device incorporating a distance measuring device capable of acquiring distance information. The imaging device may be incorporated into the information processing device 1. For example, it may be a camera incorporated into a personal computer (hereinafter referred to as a "PC"), a mobile device, or a dedicated device. Alternatively, the imaging device may be a camera located at a distance from the information processing device 1. In this case, the image data may be transmitted from the imaging device to the information processing device 1 wirelessly or the like. The image acquisition unit 11 is one form of image acquisition means recited in the claims.

[0017] The calculation unit 12 calculates the user's chest respiratory cycle and abdominal respiratory cycle by referring to information included in the image data acquired by the image acquisition unit 11. The information included in the image data is, for example, brightness information or distance information. Brightness information can be acquired for each pixel. Distance information is distance information to each point if the imaging device is capable of acquiring point cloud data as distance information. The calculation unit 12 is one form of calculation means described in the claims.

[0018] The calculation unit 12 calculates the respiratory cycle of the user's chest using brightness information, distance information, etc. of the user's chest. The calculation unit 12 also calculates the respiratory cycle of the user's abdomen using brightness information, distance information, etc. of the user's abdomen. The chest refers to the area around the ribs, and the abdomen refers to the area below the ribs or solar plexus. The regions of the chest and abdomen do not need to be defined precisely. The calculation unit 12 can roughly identify the chest region and the abdomen region using, for example, a known skeletal structure estimation application that estimates a person's skeleton from an image. The chest region and the abdomen region may each be multiple regions. An example of defining multiple regions will be described later.

[0019] In the following description, it is assumed that a user is working using a computer equipped with a camera. In such cases, there is often a light above the user. When there is a light above the user, the upper body bends backward when the user inhales, increasing the brightness of the chest and abdomen. When the user exhales, the upper body returns to its original position, decreasing the brightness. Therefore, the calculation unit 12 can calculate the breathing cycle of inhalation and exhalation by, for example, calculating the period of change in the average brightness of the user's chest region. The calculation unit 12 can also calculate the breathing cycle of inhalation and exhalation by calculating the period of change in the average brightness of the user's abdominal region. The calculation unit 12 may also calculate the optical flow of the chest and abdomen, respectively. In this exemplary embodiment, the optical flow is the movement of pixel brightness. For example, the calculation unit 12 may acquire the average direction of change in brightness of pixels in the chest region and abdominal region. The optical flow can be acquired using a known application. The calculation unit 12 can acquire the breathing cycle by calculating the period of change in the optical flow.

[0020] It is preferable for the user to adjust the position of the camera or themselves so that the chest and abdomen are within the field of view of the onboard camera. This allows images of the chest and abdomen to be acquired with one camera. When acquiring image data of the chest and abdomen using two cameras, respectively, it is necessary to acquire two sets of image data with the same time axis.

[0021] Alternatively, the calculation unit 12 may calculate the respiratory cycle of the user's chest and abdomen, respectively, using distance information between the user's chest and abdomen. Specifically, for example, when distance information between the chest and abdomen is acquired from the front of the user, it can be determined that the user has exhaled when the distance to the chest or abdomen becomes relatively large. Also, it can be determined that the user has inhaled when the distance to the chest or abdomen becomes relatively small. The calculation unit 12 can calculate the respiratory cycle of the chest and abdomen, respectively, from the change period of such distance information.

[0022] The derivation unit 13 derives the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. It is known that abdominal breathing synchronizes the chest and abdominal respiratory cycles. In other words, the stronger the synchronization—that is, the abdominal expands when the chest expands, and contracts when the chest contracts—the more effective the abdominal breathing is. Therefore, the degree of synchronization serves as an index for determining whether abdominal breathing is being performed appropriately. The effect of abdominal breathing is relaxation, or the parasympathetic nervous system becoming more dominant over the sympathetic nervous system. While the method for deriving the degree of synchronization of the respiratory cycles is not particularly limited, for example, when the chest respiratory cycle and the abdominal respiratory cycle are each represented by a graph, the squared error between the two may be calculated. In this case, the smaller the squared error, the greater the degree of synchronization is determined to be. The derivation unit 13 is one form of derivation means described in the claims.

[0023] The output unit 14 outputs the derived degree of synchronization. Specifically, the output unit 14 generates output data of the degree of synchronization derived by the derivation unit 13 and outputs it to the outside. The outside is outside the information processing device 1, and is, for example, a display of a personal computer including the information processing device 1, a printing device, another personal computer, another mobile device, etc. The information processing device 1 may be provided with an input / output interface that communicates information with the outside via a wired or wireless connection. The output unit 14 is one form of output means recited in the claims.

[0024] The image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 may be partly or entirely located in different housings. The image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 may be partly or entirely located on the cloud. In such a case, the units are connected to each other so that they can communicate information with each other. This also applies to the information processing devices according to the following exemplary embodiments.

[0025] As described above, the information processing device 1 according to this exemplary embodiment includes an image acquisition unit that acquires image data of a user, a calculation unit that calculates the user's chest respiratory cycle and abdominal respiratory cycle by referencing information included in the image data, a derivation unit that derives the degree of synchronization between the chest respiratory cycle and abdominal respiratory cycle, and an output unit that outputs the derived degree of synchronization. The user can appropriately activate the information processing device 1 and capture an image of themselves to determine the degree of synchronization between the chest and abdominal respiratory cycles. Therefore, the information processing device 1 according to this exemplary embodiment has the advantage of allowing the user to confirm whether they are performing abdominal breathing.

[0026] (Flow of Information Processing Method) The flow of the information processing method S1 according to this exemplary embodiment will be described with reference to Fig. 2. Fig. 2 is a flow chart showing the flow of the information processing method S1.

[0027] As shown in the figure, the information processing method S1 includes steps S11 to S14. Step S11 is a step in which at least one processor (image acquisition unit 11) acquires image data of a user. The meaning of image data is as explained in the information processing device 1.

[0028] In step S12, at least one processor (calculation unit 12) refers to information included in the image data and calculates the chest respiratory cycle and the abdominal respiratory cycle of the user. The meanings of the chest respiratory cycle and the abdominal respiratory cycle are as described in the information processing device 1.

[0029] In step S13, at least one processor (deriving unit 13) derives the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. The meaning of "synchronization of the respiratory cycle" is as described in the information processing device 1.

[0030] In step S14, at least one processor (output unit 14) outputs the derived degree of synchronization. The meaning of the output is as explained in the information processing device 1.

[0031] As described above, the information processing method S1 according to this exemplary embodiment employs a configuration including acquiring image data of a user, calculating the user's chest respiratory cycle and abdominal respiratory cycle based on information included in the image data, deriving the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle, and outputting the derived degree of synchronization. Therefore, the information processing method S1 according to this exemplary embodiment has the effect of enabling the user to confirm whether or not they are performing abdominal breathing.

[0032] (Configuration of Information Processing System 2) The configuration of the information processing system 2 according to this exemplary embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing system 2. As shown in the figure, the information processing system 2 includes an imaging device 30 and a control unit 10.

[0033] The control unit 10 includes an image acquisition unit 11, a calculation unit 12, a derivation unit 13, an output unit 14, at least one processor 21, and a memory 22. The processor 21 can be configured using a general-purpose processor such as at least one MPU (Micro Processing Unit) or CPU (Central Processing Unit). The processor 21 may also include a dedicated processor configured using an ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), PLD (Programmable Logic Device), or the like.

[0034] The memory 22 may include multiple types of memory, such as a read-only memory (ROM) and a random access memory (RAM). The memory 22 may also include an internal or external memory, such as a hard disk drive (HDD) or a solid state drive (SSD). As an example, the processor 21 implements the functions of the image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 by loading various control programs recorded in the ROM of the memory 22 into the RAM and executing them.

[0035] The imaging device 30 captures an image of the user. The imaging device 30 transmits image data of the captured image to the control unit 10. The transmitted image data is stored in the memory 22. The image acquisition unit 11 acquires image data of the image captured by the imaging device 30. For example, the image acquisition unit 11 acquires image data of the user stored in the memory 22. The calculation unit 12 calculates the user's chest respiratory cycle and abdominal respiratory cycle by referring to information included in the image data. The derivation unit 13 derives the degree of synchronization between the chest respiratory cycle and abdominal respiratory cycle. The output unit 14 outputs the derived degree of synchronization. The detailed functions of each unit are the same as those described for each unit of the information processing device 1, and therefore will not be described here.

[0036] The image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 may be partly or entirely located on the cloud. In this case, the units are connected to each other so that information can be communicated. This also applies to the information processing systems according to the following exemplary embodiments.

[0037] As described above, the information processing system 2 according to this exemplary embodiment is configured to include an imaging device that captures an image of a user, an image acquisition unit that acquires image data of the image, a calculation unit that calculates the user's chest respiratory cycle and abdominal respiratory cycle by referring to information included in the image data, a derivation unit that derives the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle, and an output unit that outputs the derived degree of synchronization. Therefore, the information processing system 2 according to this exemplary embodiment has the effect of allowing the user to check whether they are performing abdominal breathing.

[0038]

[0033] A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first exemplary embodiment are denoted by the same reference numerals, and their description will be omitted as appropriate.

[0039] (Configuration of Information Processing Device 1A) The configuration of the information processing device 1A according to this exemplary embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the information processing device 1A. As shown in the figure, the information processing device 1A includes an image acquisition unit 11, a calculation unit 12, a derivation unit 13, and an output unit 14. The basic functions of the image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 are similar to the functions of the image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 described in exemplary embodiment 1, but new functions may also be included.

[0040] The information processing device 1A may include an image analysis unit 15. The image analysis unit 15 may estimate the user's skeleton from the image data acquired by the image acquisition unit 11 and define a chest region and an abdominal region. FIG. 5 is a schematic diagram showing the user's chest region and abdominal region defined by the image analysis unit 15. Image 50 is an image of the user acquired by the imaging device 30, and shows the determined chest and abdominal regions (regions of interest) therein. Region information of the chest region and abdominal region may be transmitted to the calculation unit.

[0041] In the example shown in FIG. 5 , the image analysis unit 15 divides the chest region into two regions: chest A on the left side and chest B on the right side. The image analysis unit 15 also divides the abdominal region into two regions: abdomen A on the left side and abdomen B on the right side. Basically, the patterns of changes in brightness, optical flow, distance, etc. (hereinafter, "brightness, optical flow, distance, etc.") of the chest and abdomen due to breathing are similar on the right and left sides. Therefore, dividing the regions into right and left sides is sufficient. However, by dividing the regions into right and left sides, it is possible to determine whether the user is in a stationary state facing forward. In other words, if the patterns of changes in brightness, etc., are different on the right and left sides, it can be determined that the user is not in a stationary state, such as when the user is facing sideways. The image analysis unit 15 may transmit the change patterns of the right and left sides of at least either the chest or abdomen to the calculation unit 12. The calculation unit 12 may calculate the degree of coincidence between the patterns of change between the right and left sides of the chest or abdomen, and if the degree of coincidence is equal to or less than a predetermined value, may determine that the posture is inappropriate for evaluating abdominal breathing and may stop calculating the respiratory cycle. Also, the calculation unit 12 may notify the user that the posture is inappropriate for evaluating abdominal breathing.

[0042] Furthermore, the image analysis unit 15 may analyze information such as brightness included in the image data to derive temporal changes in brightness, etc. The derived temporal changes in brightness, etc. are transmitted to the calculation unit 12. The calculation unit 12 may calculate the user's chest respiratory cycle and abdominal respiratory cycle from the analysis information such as brightness of the chest and abdomen acquired from the image analysis unit 15.

[0043] 6 is a graph showing the respiratory cycles of the user's chest and abdomen calculated by the calculation unit 12. In the figure, the solid line represents the respiratory cycle of the abdominal region, and the dotted line represents the respiratory cycle of the chest region. The derivation unit 13, for example, calculates the squared error between the solid line graph and the dotted line graph, and derives the degree of synchronization between the respiratory cycles of the chest and abdomen as an evaluation value from this. The output unit 14 may also output the respiratory cycle graph to the user's display. Specifically, the output unit 14 may output the respiratory cycles of the user's chest and abdomen in a manner that allows them to be compared. This allows the user to visually recognize whether the respiratory cycles of the chest and abdomen are synchronized.

[0044] The graph in Fig. 6 may, for example, display only frequency components close to the respiratory frequency through a band-pass filter. The horizontal axis may represent time, and the vertical axis may represent standardized values, for example, so that the average is 0 and the standard deviation is 1 within the display range of the graph. The display range of the graph is arbitrary, but taking into account the standard respiratory cycle, it may be displayed while moving a time range of, for example, 10 to 20 seconds. Furthermore, marks may be displayed on the convex portions of the graph to make it easier to visually compare the cycles.

[0045] The information processing device 1A may include a determination unit 16. The determination unit 16 compares the degree of synchronization derived by the derivation unit 13 with a threshold value to determine the degree. The determination result may be an evaluation value indicating the degree of synchronization. The evaluation value may be, for example, a numerical value of squared error, or an evaluation value ranging from 0% to 100%. Alternatively, the evaluation value may be a qualitative expression such as good, average, or poor. The output unit 14 may output the determination result determined by the determination unit 16. The determination unit 16 is one form of the determination means described in the claims.

[0046] For example, the determination unit 16 may determine that abdominal breathing is being performed appropriately if the degree of synchronization is greater than a predetermined threshold. Conversely, the determination unit 16 may determine that abdominal breathing is not being performed appropriately if the degree of synchronization is equal to or less than a predetermined threshold. There may be multiple thresholds. That is, the determination unit 16 may determine the degree of synchronization by dividing it into three or more ranges using multiple thresholds. For example, the determination unit 16 may set a first threshold and a second threshold that is greater than the first threshold. In this case, the degree of synchronization is divided into three ranges: a range equal to or less than the first threshold, a range greater than the first threshold and equal to or less than the second threshold, and a range greater than the second threshold. Then, for each range, abdominal breathing may be determined to be good, normal, poor, etc.

[0047] The determination unit 16 may select advice for the user's abdominal breathing as the determination result based on the level of the evaluation value. That is, the determination result may include at least one of an evaluation value indicating the degree of synchronization and advice for the user's abdominal breathing. FIG. 7 shows an example of advice selected by the determination unit 16. FIG. 7 illustrates an example in which the determination unit 16 selects advice on four levels. For example, when the evaluation value is "bad," advice such as "You seem not to be able to perform abdominal breathing" or "Please take a short break" is selected. When the evaluation value is "slightly bad," advice such as "You seem to be a little tense" is selected. When the evaluation value is "slightly good," advice such as "You are relaxed" is selected. When the evaluation value is "good," advice such as "You are performing ideal abdominal breathing" is selected. The output unit 14 may output advice instead of or in addition to the evaluation value of the determination unit 16.

[0048] The information processing device 1A may include a change unit 17. The change unit 17 changes the threshold value depending on the situation when the user's image data is acquired. Specifically, the change unit 17 may estimate the user's work environment from the user's image data and change the threshold value according to the estimated work environment. For example, the threshold value may be changed depending on whether the user is working at home or working in an office with many other workers. The change unit 17 may also change the threshold value depending on the number of times the degree of respiratory synchronization is evaluated. For example, the threshold value may be increased as the number of times increases, as the user becomes more accustomed to abdominal breathing. The change unit 17 may also change the threshold value to be higher as the measurement time increases. The information processing device 1A may be configured to allow the user to change the threshold value. Alternatively, the information processing device 1A may be configured to allow the user to select the situation or environment in which the measurement is performed. The change unit 17 is one form of a change means described in the claims.

[0049] The information processing device 1A may include an activation estimation unit 18. The activation estimation unit 18 estimates activation of the user's parasympathetic nerves. FIG. 8 is a block diagram showing the configuration of the activation estimation unit 18. As shown in the figure, the activation estimation unit 18 includes a vital sign estimation unit 181, a vital sign change calculation unit 182, and a vital sign change determination unit 183. The activation estimation unit 18 is one form of activation estimation means recited in the claims.

[0050] In this exemplary embodiment, vital values ​​include, for example, the RR interval, CVRR, blood pressure, and SpO2. SpO2 is percutaneous arterial oxygen saturation. The RR interval is the time from one ventricular excitation to the next, and the number of ventricle contractions per minute is calculated by dividing 60 seconds by the RR interval (seconds). The CVRR is calculated by calculating the average value and standard deviation of the RR intervals of consecutive heartbeats using the following formula (1): CVRR = (standard deviation / average value) x 100 (%)... formula (1)

[0051] Such vital values ​​can be estimated using image data or estimated (measured) using a vital value measuring device. Therefore, the vital value estimation unit 181 may estimate the user's vital values ​​using image data or vital value measurement information. Publicly known applications that calculate vital values ​​from image data or measuring devices that are worn on the human body to measure vital values ​​can be used.

[0052] The vital sign change calculation unit 182 calculates changes in the vital signs estimated by the vital sign estimation unit 181. The vital sign change determination unit 183 estimates changes in the activity level of the user's parasympathetic nerves by referring to the changes in the estimated vital signs. FIG. 9 shows an example of changes in vital signs that occur when the user relaxes through abdominal breathing. For example, when the parasympathetic nerves are activated (become dominant), the RR interval increases, the CVRR increases, the blood pressure decreases, and the SpO2 increases. Conversely, when the parasympathetic nerves are deactivated (become subordinate), the RR interval, CVRR, blood pressure, and SpO2 change in the opposite manner. The vital sign change determination unit 183 estimates that the user's parasympathetic nerves have been activated or deactivated as described above by referring to the changes in the vital signs calculated by the vital sign change calculation unit 182. The output unit 14 may output the estimated change in the activity level of the parasympathetic nerves. Furthermore, the determination unit 16 may determine the effectiveness of abdominal breathing based on whether or not the effect of abdominal breathing is being observed and to what extent the effect is being observed, by referring to the change in the estimated vital values.

[0053] The information processing device 1A may include a respiratory rhythm presentation unit 19. When the user attempts to check whether or not they are performing appropriate abdominal breathing, the respiratory rhythm presentation unit 19 displays the periodic rhythm of inhalation and exhalation times on a user display (not shown). The display format is not limited, and may be, for example, a curve that changes like a sine curve, or a graphic whose height rises and falls like a bar graph. Alternatively, the display may be presented by music, audio, or the like through a speaker or headphones (not shown). This period is a rhythm considered to be suitable for abdominal breathing. Displaying such a rhythm can assist the user in performing appropriate abdominal breathing.

[0054] As shown in FIG. 4 , the information processing device 1A may use a trained artificial intelligence (AI) 40. For example, the calculation unit 12 may use the AI ​​40 to analyze an image and calculate the user's chest respiratory cycle and abdominal respiratory cycle, respectively. Furthermore, the derivation unit 13 may use the AI ​​40 to derive the degree of synchronization between the chest respiratory cycle and abdominal respiratory cycle. Furthermore, the processing performed by the calculation unit 12 and the derivation unit 13 may be performed using the AI ​​40. The AI ​​40 may be trained using images of chest and abdominal movements of a person skilled in abdominal breathing and chest and abdominal movements of a person not skilled in abdominal breathing.

[0055] In addition, AI 40 may be used to perform the process of defining the user's chest and abdomen from an image (at least part of the process performed by the image analysis unit 15), or the process of determining the effectiveness of abdominal breathing by referring to changes in vital values ​​(at least part of the process performed by the activation estimation unit 18).

[0056] (Effects of Information Processing Device 1A) As described above, the information processing device 1A according to this exemplary embodiment includes a determination unit 16 in addition to the information processing device 1 according to the exemplary embodiment. Therefore, in addition to the effects of the information processing device 1 according to the exemplary embodiment 1, the information processing device 1A according to this exemplary embodiment can determine whether a user is performing appropriate abdominal breathing. Furthermore, by including a change unit 17 that changes the determination threshold, the threshold can be changed according to the situation, allowing for more detailed determination of abdominal breathing. Furthermore, by further including an activation estimation unit 18, abdominal breathing can be determined by referring to the specific result of parasympathetic nerve activation. Furthermore, by including a respiratory rhythm presentation unit 19, assistance can be provided to the user to perform appropriate abdominal breathing.

[0057]

[0033] A third exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first or second exemplary embodiment are denoted by the same reference numerals, and their description will not be repeated.

[0058] (Configuration of Information Processing System 2A) The configuration of the information processing system 2A according to this exemplary embodiment will be described with reference to the drawings. Fig. 10 is a block diagram showing the configuration of the information processing system 2A. As shown in the figure, the information processing system 2A includes a control unit 10A, an imaging device 30, and an AI 40.

[0059] The control unit 10A includes an image acquisition unit 11, a calculation unit 12, a derivation unit 13, an output unit 14, at least one processor 21, and a memory 22. The basic functions of the image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 are similar to the functions of the image acquisition unit 11, the calculation unit 12, the derivation unit 13, and the output unit 14 described in exemplary embodiment 1, but may further include new functions. The processor 21 and the memory 22 may have the same configurations as the processor 21 and the memory 22 described in exemplary embodiment 1.

[0060] The information processing system 2A may include an image analysis unit 15, a determination unit 16, a change unit 17, an activation estimation unit 18, or a respiratory rhythm presentation unit 19. The functions of these units are similar to those of the units described in the information processing device 1A of the second exemplary embodiment, and therefore will not be described here.

[0061] (Effects of Information Processing System 2A) As described above, the information processing system 2A according to this exemplary embodiment includes the image analysis unit 15, the determination unit 16, the change unit 17, the activation estimation unit 18, and the respiratory rhythm presentation unit 19 in addition to the components of the information processing system 2 according to exemplary embodiment 1. Therefore, the information processing system 2A according to this exemplary embodiment achieves the effect of determining whether a user is performing appropriate abdominal breathing, in addition to the effects of the information processing system 2 according to exemplary embodiment 1. Furthermore, by including the change unit 17 that changes the determination threshold, the threshold can be changed depending on the situation, allowing for more detailed determination of abdominal breathing. Furthermore, by further including the activation estimation unit 18, abdominal breathing can be determined by referring to the specific result of parasympathetic nerve activation. Furthermore, by including the respiratory rhythm presentation unit 19, assistance can be provided to the user to perform appropriate abdominal breathing.

[0062]

[0043] A fourth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to third exemplary embodiments are denoted by the same reference numerals, and their description will not be repeated.

[0063] (Configuration of Information Processing Device 1B) The configuration of the information processing device 1B according to this exemplary embodiment will be described with reference to FIG. 12. FIG. 12 is a block diagram showing the configuration of the information processing device 1B according to exemplary embodiment 4. The information processing device 1B includes an image acquisition unit 11, a calculation unit 12, and an output unit 14. The image acquisition unit 11 and the calculation unit 12 have the same functions as the image acquisition unit 11 and the calculation unit 12 described in exemplary embodiment 1, and therefore their description will be omitted. The output unit 14 outputs the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. In this manner, the output unit 14 may derive and output the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. Furthermore, one or both of the process performed by the calculation unit 12 to calculate the chest respiratory cycle and the abdominal respiratory cycle of the user and the process performed by the output unit 14 to derive the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle may be performed by AI.

[0064] According to the information processing device 1B having the above configuration, it is possible to obtain an effect that the user can check whether or not he or she is performing abdominal breathing.

[0065] (Flow of Information Processing Method S2) The flow of the information processing method S2 according to this exemplary embodiment will be described with reference to Fig. 13. Fig. 13 is a flow diagram showing the flow of the information processing method S2.

[0066] As shown in the figure, the information processing method S1 includes steps S21 to S23. Step S21 is a step in which at least one processor (image acquisition unit 11) acquires image data of a user. The meaning of image data is as explained in the information processing device 1.

[0067] In step S22, at least one processor (calculation unit 12) refers to information included in the image data and calculates the chest respiratory cycle and the abdominal respiratory cycle of the user. The meanings of the chest respiratory cycle and the abdominal respiratory cycle are as described in the information processing device 1.

[0068] In step S23, at least one processor (output unit 14) outputs the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. The meaning of the synchronization of the respiratory cycles and the meaning of the output are as described in the information processing device 1.

[0069] According to the information processing method S2 configured as above, it is possible to obtain an effect that the user can check whether or not he or she is performing abdominal breathing.

[0070] (Configuration of Information Processing System 2B) The configuration of the information processing system 2B according to this exemplary embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the configuration of the information processing system 2B. As shown in the figure, the information processing system 2B includes an imaging device 30 and a control unit 10. The imaging device 30 is the same as described in the first exemplary embodiment, and therefore a description thereof will be omitted.

[0071] The control unit 10 includes an image acquisition unit 11, a calculation unit 12, an output unit 14, at least one processor 21, and a memory 22. The image acquisition unit 11 and the calculation unit 12 have the same functions as the image acquisition unit 11 and the calculation unit 12 described in exemplary embodiment 1, and therefore their description will be omitted. The output unit 14 outputs the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. In this manner, the output unit 14 may derive and output the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. Furthermore, one or both of the process performed by the calculation unit 12 to calculate the chest respiratory cycle and the abdominal respiratory cycle of the user and the process performed by the output unit 14 to derive the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle may be performed by AI. The configurations of the processor 21 and the memory 22 are as described in exemplary embodiment 1.

[0072] According to the information processing system 2B having the above-described configuration, it is possible to obtain an effect that the user can check whether or not he or she is performing abdominal breathing.

[0073] [Example of implementation by software] Some or all of the functions of the information processing devices 1, 1A, 1B and the information processing systems 2, 2A, 2B (hereinafter referred to as "information processing devices 1, etc.") may be implemented by hardware such as an integrated circuit (IC chip), or by software.

[0074] In the latter case, the information processing device 1, etc., is realized, for example, by a computer that executes instructions of a program, which is software that realizes each function. An example of such a computer (hereinafter referred to as computer C) is shown in FIG. 11. The computer C includes at least one processor C1 and at least one memory C2. The memory C2 stores a program P for operating the computer C as the information processing device 1, etc. In the computer C, the processor C1 reads and executes the program P from the memory C2, thereby realizing each function of the information processing device 1, etc.

[0075] The processor C1 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a tensor processing unit (TPU), a quantum processor, a microcontroller, or a combination thereof. The memory C2 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof.

[0076] The computer C may further include a RAM (Random Access Memory) for expanding the program P during execution and for temporarily storing various data. The computer C may also include a communication interface for transmitting and receiving data to and from other devices. The computer C may also include an input / output interface for connecting input / output devices such as a keyboard, a mouse, a display, and a printer.

[0077] The program P can also be recorded on a non-transitory, tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can acquire the program P via such a recording medium M. The program P can also be transmitted via a transmission medium. Such a transmission medium can be, for example, a communication network or broadcast waves. The computer C can also acquire the program P via such a transmission medium.

[0078] [Additional Note 1] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiments are also included in the technical scope of the present invention.

[0079] [Additional Note 2] Part or all of the above-described embodiment can also be described as follows: However, the present invention is not limited to the following described aspects.

[0080] (Supplementary Note 1) An information processing device comprising: an image acquisition means for acquiring image data of a user; a calculation means for calculating the chest respiratory cycle and the abdominal respiratory cycle of the user by referring to information included in the image data; and an output means for outputting the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0081] According to the above configuration, the user can check whether or not he or she is performing abdominal breathing.

[0082] (Supplementary Note 2) The information processing device according to Supplementary Note 1, further comprising: a determination unit that compares the derived degree of synchronization with a threshold value to make a determination.

[0083] According to the above configuration, it is possible to determine whether the user is performing appropriate abdominal breathing.

[0084] (Supplementary Note 3) The information processing device according to Supplementary Note 2, further comprising: a change unit that changes the threshold value depending on a situation when the image data of the user is acquired.

[0085] According to the above configuration, the threshold value can be changed depending on the situation, and abdominal breathing can be determined in a more detailed manner.

[0086] (Supplementary Note 4) The information processing device according to Supplementary Note 2 or 3, wherein the output unit outputs a determination result determined by the determination unit.

[0087] According to the above configuration, the user can check the determination result.

[0088] (Supplementary Note 5) The information processing device according to any one of Supplementary Notes 2 to 4, wherein the determination result includes at least one of an evaluation value indicating a degree of synchronization and advice on abdominal breathing for the user.

[0089] According to the above configuration, the user can easily understand how appropriately he or she is performing abdominal breathing.

[0090] (Supplementary Note 6) The information processing device according to any one of Supplementary Notes 2 to 5, further comprising activation estimation means for estimating activation of the parasympathetic nerves of the user.

[0091] According to the above configuration, abdominal breathing can be determined by referring to the specific result of activation of the parasympathetic nerves.

[0092] (Supplementary Note 7) The information processing device according to Supplementary Note 6, wherein the activation estimation means estimates the vital value of the user using the image data or vital value measurement information.

[0093] According to the above configuration, activation of the parasympathetic nerves can be determined based on specific vital values, and a scientifically proven determination can be made.

[0094] (Supplementary Note 8) The information processing device according to Supplementary Note 7, wherein the determining means determines an effect of abdominal breathing of the user by referring to a change in the estimated vital value.

[0095] According to the above configuration, activation of the parasympathetic nerves can be determined based on a specific change in vital values, and a scientifically proven determination can be made.

[0096] (Supplementary Note 9) The information processing device according to any one of Supplementary Notes 1 to 8, wherein the output means outputs the chest respiratory cycle and the abdominal respiratory cycle of the user in a manner that allows them to be compared.

[0097] According to the above configuration, the user can visually understand how well he or she is performing abdominal breathing.

[0098] (Supplementary Note 10) An information processing system comprising: an imaging device that captures an image of a user; an image acquisition means that acquires image data of the image; a calculation means that calculates the chest respiratory cycle and the abdominal respiratory cycle of the user by referring to information included in the image data; and an output means that outputs the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0099] According to the above configuration, the user can check whether or not he or she is performing abdominal breathing.

[0100] (Supplementary Note 11) The information processing system according to Supplementary Note 10, further comprising a determination unit that compares the derived degree of synchronization with a threshold value to make a determination.

[0101] According to the above configuration, it is possible to determine whether the user is performing appropriate abdominal breathing.

[0102] (Supplementary Note 12) The information processing system according to Supplementary Note 11, further comprising a change unit that changes the threshold value depending on the situation when the image data of the user is acquired.

[0103] According to the above configuration, the threshold value can be changed depending on the situation, and abdominal breathing can be determined in a more detailed manner.

[0104] (Supplementary Note 13) The information processing system according to Supplementary Note 11 or 12, wherein the output unit outputs a determination result determined by the determination unit.

[0105] According to the above configuration, the user can check the determination result.

[0106] (Supplementary Note 14) The information processing system according to Supplementary Note 13, wherein the determination result includes at least one of an evaluation value indicating a degree of synchronization and advice on abdominal breathing for the user.

[0107] According to the above configuration, the user can easily understand how appropriately he or she is performing abdominal breathing.

[0108] (Supplementary Note 15) The information processing system according to any one of Supplementary Notes 11 to 14, further comprising activation estimation means for estimating activation of the parasympathetic nerves of the user.

[0109] According to the above configuration, abdominal breathing can be determined by referring to the specific result of activation of the parasympathetic nerves.

[0110] (Supplementary Note 16) The information processing system according to Supplementary Note 15, wherein the activation estimation means estimates the vital value of the user using the image data or vital value measurement information.

[0111] According to the above configuration, activation of the parasympathetic nerves can be determined based on specific vital values, and a scientifically proven determination can be made.

[0112] (Supplementary Note 17) The information processing system according to Supplementary Note 16, wherein the determining means determines an effect of abdominal breathing of the user by referring to a change in the estimated vital value.

[0113] According to the above configuration, activation of the parasympathetic nerves can be determined based on a specific change in vital values, and a scientifically proven determination can be made.

[0114] (Supplementary Note 18) An information processing method including: acquiring image data of a user; calculating a chest respiratory cycle and an abdominal respiratory cycle of the user by referring to information included in the image data; and outputting a degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle.

[0115] According to the above method, the user can check whether or not he or she is performing abdominal breathing.

[0116] (Supplementary Note 19) An information processing program for causing a computer to function as the information processing device described in Supplementary Note 1, the information processing program causing the computer to function as the image acquisition means, the image acquisition means, and the output means.

[0117] (Supplementary Note 20) A computer-readable non-transitory recording medium having the information processing program according to Supplementary Note 19 recorded thereon.

[0118] (Supplementary Note 21) An information processing device described in any one of Supplementary Notes 1 to 9, further comprising a derivation means for deriving a degree of synchronization between the respiratory cycle of the chest and the respiratory cycle of the abdomen, and the output means for outputting the degree of synchronization derived by the derivation means.

[0119] (Appendix 22) An information processing system described in any of Appendices 10 to 17, further comprising a derivation means for deriving a degree of synchronization between the respiratory cycle of the chest and the respiratory cycle of the abdomen, and the output means outputs the degree of synchronization derived by the derivation means.

[0120] (Supplementary Note 23) The information processing method described in Supplementary Note 18, further comprising, after calculating the respiratory cycle of the chest and the respiratory cycle of the abdomen, deriving a degree of synchronization between the respiratory cycle of the chest and the respiratory cycle of the abdomen.

[0121] [Additional Note 3] Part or all of the above-described embodiment can also be expressed as follows.

[0122] An information processing device including at least one processor that executes an acquisition process for acquiring image data of a user, a calculation process for calculating a chest respiratory cycle and an abdominal respiratory cycle of the user by referring to information included in the image data, and an output process for outputting a degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle. The information processing device may further include a memory that stores a program for causing the processor to execute the acquisition process, the calculation process, and the output process. The program may also be recorded on a computer-readable, non-transitory, tangible recording medium.

[0123] DESCRIPTION OF SYMBOLS 1, 1A... Information processing device 10, 10A... Control unit 11... Image acquisition unit 12... Calculation unit 13... Derivation unit 14... Output unit 15... Image analysis unit 16... Determination unit 17... Change unit 18... Activation estimation unit 181... Vital sign estimation unit 182... Vital sign change calculation unit 183... Vital sign change determination unit 19... Respiratory rhythm presentation unit 2, 2A... Information processing system 21... Processor 22... Memory 30... Imaging device 40... AI

Claims

1. image acquisition means for acquiring image data of a user; a calculation means for calculating a chest respiratory cycle and an abdominal respiratory cycle of the user by referring to information included in the image data; an output means for outputting the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle; An information processing device comprising:

2. An information processing device as described in claim 1, further comprising a determination means for determining the degree of synchronization by comparing it with a threshold value.

3. The information processing apparatus according to claim 2 , further comprising: a change unit that changes the threshold value depending on a situation when the image data of the user is acquired.

4. The information processing apparatus according to claim 2 , wherein the output means outputs a determination result determined by the determination means.

5. The information processing device according to claim 4 , wherein the determination result includes at least one of an evaluation value indicating the degree of synchronization and advice on abdominal breathing for the user.

6. The information processing device according to claim 2 , further comprising activation estimation means for estimating activation of the parasympathetic nerves of the user.

7. The information processing device according to claim 6 , wherein the activation estimation means estimates the vital value of the user using the image data or the vital value measurement information.

8. an imaging device that captures an image of a user; image acquisition means for acquiring image data of the image; a calculation means for calculating a chest respiratory cycle and an abdominal respiratory cycle of the user by referring to information included in the image data; an output means for outputting the degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle; An information processing system comprising:

9. A computer comprising: obtaining image data of a user; calculating a chest respiratory cycle and an abdominal respiratory cycle of the user by referring to information included in the image data; outputting a degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle; An information processing method that performs the above.

10. A computer comprising: Acquiring user image data; a process of calculating a chest respiratory cycle and an abdominal respiratory cycle of the user by referring to information included in the image data; outputting a degree of synchronization between the chest respiratory cycle and the abdominal respiratory cycle; An information processing program that executes the above.