Body sound acquisition support system

Abstract

To provide a system for acquiring biological sound by using a portable terminal such as a smartphone.SOLUTION: The present invention relates to a biological sound acquisition support system for supporting acquisition by a user of biological sound by using a user terminal, the biological sound acquisition support system including: a sound data acquisition unit for acquiring sound data including the biological sound; a determination unit for determining whether the sound data agrees with a condition of acquiring the biological sound; and a notification unit for outputting the result of determination to the user terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a body sound acquisition support system. [Background technology]

[0002] Telemedicine can be performed by communicating via videophone between the doctor's terminal and the patient's terminal. A remote medical support system has been proposed.

[0003] Patent Document 1 describes a system that provides a means for remote medical appointments and video calls between doctors and patients. An information processing device is disclosed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6574391 Summary of the Invention [Problem to be solved by the invention]

[0005] In remote medical care, patients themselves collect various vital data necessary for a doctor's examination, and the doctor In addition, with the recent increase in health consciousness, There is also a growing demand for this.

[0006] Therefore, the present invention provides a system for acquiring body sounds using a mobile terminal such as a smartphone. One object of the present invention is to provide a stem. [Means for solving the problem]

[0007] According to the present invention, a biomedical device that assists a user to acquire body sounds using a user terminal is provided. A sound acquisition support system, comprising: a sound data acquisition unit that acquires sound data including body sounds; a sound evaluation unit that evaluates specific sound components from the acquired sound data; and a sound evaluation unit that determines whether or not it is possible to acquire body sounds. a condition storage unit that stores conditions to be judged; and a judgment unit that judges whether the conditions are met; A body sound acquisition support system including a notification unit that outputs the determination result to the user terminal. Obtained. [Effects of the Invention]

[0008] According to the present invention, a user can smoothly record body sounds using a device such as a smartphone. It can be obtained. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the configuration of a system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a user terminal according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram illustrating an example of a software configuration according to an embodiment of the present invention. [Figure 5] FIG. 3 is a diagram illustrating an example of a configuration of a condition storage unit according to the embodiment of the present invention. [Figure 6] FIG. 2 is a diagram illustrating an example of a configuration of a notification information storage unit according to the embodiment of the present invention. [Figure 7] FIG. 1 is a diagram showing an example of a processing flow according to an embodiment of the present invention. [Figure 8] FIG. 2 is a diagram illustrating an example of a software configuration according to an embodiment of the present invention. [Figure 9] 1 is a diagram illustrating an embodiment of the present invention. [Figure 10] FIG. 3 is a diagram illustrating an example of a configuration of a condition storage unit according to the embodiment of the present invention. [Figure 11] 1 is a diagram illustrating an embodiment of the present invention. [Figure 12]FIG. 2 is a diagram illustrating an example of a configuration of a notification information storage unit according to the embodiment of the present invention. [Figure 13] FIG. 2 is a diagram illustrating an example of a software configuration according to an embodiment of the present invention. [Figure 14] 1 is a diagram illustrating an embodiment of the present invention. [Figure 15] FIG. 2 is a diagram illustrating an example of a configuration of a notification information storage unit according to the embodiment of the present invention. [Figure 16] FIG. 2 is a diagram illustrating an example of a configuration of a notification information storage unit according to the embodiment of the present invention. [Figure 17] FIG. 2 is a diagram illustrating an example of a software configuration according to an embodiment of the present invention. [Figure 18] FIG. 2 is a diagram illustrating an example of a software configuration according to an embodiment of the present invention. [Figure 19] 1 is a diagram illustrating an embodiment of the present invention. [Figure 20] FIG. 2 is a diagram illustrating an example of a software configuration according to an embodiment of the present invention. [Figure 21] FIG. 10 is a diagram showing an example of the configuration of acquisition instruction information according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present invention will be described below by listing the contents of the embodiments. The present invention has the following configuration. [Item 1] A body sound acquisition support system that supports users to acquire body sounds by using a user terminal. It is a sound data acquisition unit that acquires sound data including the body sounds; a determination unit that determines whether or not the body sound acquisition condition is met; a notification unit that outputs the determination result to the user terminal. [Item 2] a sound evaluation unit that evaluates a specific sound component from the acquired sound data; The determination unit determines whether or not the body sound acquisition condition is met based on the evaluation result. 2. The body sound acquisition support system according to item 1, [Item 3] the sound evaluation unit evaluates the volume of a target body sound component; the acquisition conditions include conditions related to the volume of the body sound components, The determination unit determines whether the volume of the body sound component satisfies the acquisition condition. Item 3. A body sound acquisition support system according to item 2. [Item 4] the sound evaluation unit evaluates the volume of a noise component; the acquisition conditions include a condition related to the volume of the noise component; The determination unit determines whether or not the volume of the noise component satisfies the acquisition condition. 4. The body sound acquisition support system according to item 2 or 3, [Item 5] further comprising an angle data acquisition unit that acquires angle data of the user terminal; the acquisition conditions include appropriate angle conditions of the user terminal when acquiring the body sound, The determining unit determines whether the angle data matches the angle condition. 5. The body sound acquisition support system according to any one of items 1 to 4. [Item 6] a position calculation unit that calculates terminal position information associated with movement of the user terminal; the acquisition condition includes acquisition position information of the body sound, The determination unit determines whether the terminal location information matches the acquired location information. 6. A body sound acquisition support system according to any one of items 1 to 5, characterized by: [Item 7] and receiving instruction information from an expert regarding a position where the user's body sound is to be acquired. Further provided with an information input unit, The acquired position information is generated based on the instruction information. This is a biological sound acquisition support system. [Item 8] a body type estimation unit that estimates a body type of the user based on input information of the user; The method further includes an acquisition instruction information adjustment unit that adjusts the acquisition position information according to the body type. 7. The body sound acquisition support system according to claim 6,

[0011] <Details of implementation form> Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0012] <Summary> FIG. 1 is a diagram illustrating an outline of a body sound acquisition system according to an embodiment of the present invention. As shown in the figure, the body sound acquisition system includes a user terminal 2 and a user terminal 2 connected to a network. The server 1 is connected via the Internet. The doctor terminal 3 may be connected to a network. users' terminals can be connected.

[0013] The body sound acquisition system according to the embodiment of the present invention is a system for remotely transmitting body sounds acquired by a user terminal 2. In some cases, the information is provided to the doctor's terminal 3 by linking with the remote medical care system, and in other cases, the information is provided to the doctor's terminal 3 by the user. It is used in cases where vital sounds are acquired for health management.

[0014] In this embodiment, the user terminal 2 is a smartphone, which is a portable information terminal, a computer, These are devices that can connect to the Internet, such as computers and tablet terminals. The device 2 is equipped with a microphone for capturing voice and various sensors for measuring acceleration and device angle. It is preferable that the device is a smartphone.

[0015] FIG. 2 is a diagram illustrating an outline of the hardware configuration of the user terminal 2. As shown in the figure, The user terminal 2 includes a control unit 10, a memory 11, a storage 12, a transmission / reception unit 13, an input / output unit 1 4, a sensor 16, a microphone 17, and a display unit 18 as main components, via a bus 15.

[0016] The control unit 10 controls the operation of the user terminal 2, and controls the transmission and reception of data between each element. The processor is a computing device that performs the processes necessary to execute application programs.

[0017] In this embodiment, the control unit 10 is, for example, a CPU (Central Processor). It is stored in the storage 12 (described later) and expanded in the memory 11. The application program is executed to perform each process.

[0018] Memory 11 is a DRAM (Dynamic Random Access Memory ), and flash memory and HDD (Har It is equipped with an auxiliary storage device consisting of a non-volatile storage device such as a 3D Disc Drive.

[0019] This memory 11 is used as a work area for the control unit 10, and is also used for starting up the computer. BIOS (Basic Input / Output System) that runs at m), and various setting information, etc. are stored.

[0020] The storage 12 stores programs, data used in various processes, and the like. The programs stored in the storage 12 will be described in detail later. Range 12 is available and connected using cloud computing technology. good.

[0021] The transmitting / receiving unit 13 connects the user terminal 2 to the Internet network. Bluetooth (registered trademark) and BLE (Bluetooth Low Energy) It may also be equipped with a short-range communication interface.

[0022] The input / output unit 14 may include information input devices such as a keyboard and a mouse, and a display, as needed. Output devices such as players are connected.

[0023] The bus 15 connects the control unit 10, memory 11, storage 12, transceiver unit 13, and input / output unit 14. Between the output section 14, for example, address signals, data signals and various control signals are transmitted. do.

[0024] The sensor 16 includes an acceleration sensor, a tilt sensor (geomagnetic sensor or gyro sensor), a proximity sensor, The sensor may be any of various types.

[0025] The microphone 17 is a sound collecting device mounted on the user terminal 2. 7 converts the voice input to the terminal 2 into a voice signal. A hearing aid may also be used.

[0026] FIG. 3 is a diagram illustrating an outline of the hardware configuration of the server 1. As shown in the figure, the server 1 The main components are a control unit 20, a memory 21, a storage 22, a transmission / reception unit 23, and an input / output unit 24. These are electrically connected to each other via a bus 25. The explanation for this is the same as for the user terminal 2, so it will be omitted.

[0027] <Embodiment 1> In the first embodiment, sound data acquired by the microphone 17 is used to measure the biological Determine whether it is suitable for sound acquisition. Specifically, analyze the acquired sound data. This allows us to determine whether the biological sound data contained in the sound data has been acquired with sufficient quality. Determine.

[0028] FIG. 4 is a diagram showing an example of the software configuration of the user terminal 2 according to the first embodiment of the present invention. The user terminal 2 of the present invention includes a condition storage unit 121 and a notification information storage unit 122 as storage devices. , a sound data storage unit 123, a data transmission / reception unit 111 as a processing unit, a sound data acquisition unit 112, a sound evaluation unit 113, a determination unit 114, a display control unit 115, and a notification unit 116. A data transmission / reception unit 111, a sound data acquisition unit 112, a sound evaluation unit 113, a determination unit 114, and a table The display control unit 115 and the notification unit 116 are configured to control the program stored in the storage 12 by the control unit 10. The program is read into the memory 11 and executed. The information storage unit 122 and the sound data storage unit 123 are at least the memory 11 and the storage 12. may be implemented as part of the storage area provided by either

[0029] The condition storage unit 121 stores conditions for determining whether or not the device is suitable for acquiring body sounds. FIG. 5 shows an example of the configuration of condition information stored in the condition storage unit 121. In this case, the conditions for the quality of the biological sounds contained in the acquired sound data are determined. For example, the threshold value may be a volume, and may be expressed as an index such as a decibel value, but is not limited to this. All of these conditions are based on the type of biological sound you want to acquire (heart sounds, breathing sounds, lung sounds, peristalsis sounds, swallowing sounds). etc., the area where the data was obtained (right breast, left breast, stomach, intestines, etc.), the purpose of obtaining the data (provision to a doctor, self-health management, etc.) ) and multiple settings can be set depending on the

[0030] The notification information storage unit 122 stores the content of the notification output by the notification unit 116 in accordance with the determination result. FIG. 6 shows an example of the structure of the notification information stored in the notification information storage unit 122. The notification information is This includes the setting of notification contents for each judgment result. For example, if the judgment result is OK (suitable for acquiring biological sounds), Set the notification sound depending on whether the device is suitable (YES) or not (NO). For example, notification 1 is a voice message such as "You can get biometric sounds," and sound notification 2 is The notification by sound may be a voice message such as "Bio-sound acquisition is not possible." The notification sound is not limited to voice, but may be a predetermined notification sound. The notification sound may be set to any pitch or pattern (beep beep, boom Notifications can be expressed by sounds such as voice or sound. The notification is not limited to light, but may be light, vibration, or a combination of these. The output is from the terminal 2 screen and light-emitting function, and the light color, lighting / flashing pattern, The vibration notification can be expressed by the strength of the device. The output can be expressed by the vibration pattern, strength, etc. The notification information storage unit 122 stores the contents of the sound notification, light notification, and vibration notification according to each determination result. The notification information storage unit 122 can store the voice data itself. Alternatively, output instruction information for various notifications may be stored.

[0031] The sound data storage unit 123 stores the acquired sound data. The type of biological sound acquired (heart sound, respiratory sound, lung sound, peristaltic sound, etc.), acquisition site (anterior chest, neck, back) The acquired part can be stored together with information such as the location of the acquired part. For example, the position information may be expressed by coordinate information from a reference position as described below. It may also include information on the purpose of acquisition, such as for medical examinations or self-management. Furthermore, if necessary, the information may include information indicating the state of the user when the sound data was acquired. For example, subjective symptoms such as shortness of breath or fatigue, or images of the user's face, body, or affected area may be used. Image data obtained by the device, and pulse and blood pressure data obtained by various measuring devices such as wearable devices The sound data may include vital data such as pressure, body temperature, etc. Alternatively, the data may be data processed by the sound evaluation unit 113 described below.

[0032] The data transmission / reception unit 111 transmits various data to the server 1 or the doctor using the transmission / reception unit 13. Send to terminal 3.

[0033] The sound data acquisition unit 112 receives sound collected by the microphone 17 provided in the user terminal 2. The acquired sound data is stored in the sound data storage unit 123 and transmitted to the sound evaluation unit 113. do.

[0034] The sound evaluation unit 113 evaluates the volume and quality of a specific sound component. The sound evaluation unit 113 can evaluate the volume and quality of the body sound components. The body sound components and noise components other than body sound are separated from the data by a predetermined process. The extraction process is performed to extract body sound data by removing the noise portion. If the processing method and parameters differ depending on the type of input body sound and the acquisition location, The processing method and parameters are selected based on the location of the object, and the extraction process is carried out. Any known method can be used, for example, by filtering the audio data. The noise component can be removed by converting the sound data into a spectrogram. It is also possible to remove noise by masking specific components. If necessary, the sound data may be subjected to a predetermined pre-processing before being converted into a spectrogram. The input data is sound data containing both biological and noise components, and the input data is a biological sound data containing only biological sound components. A learning model is created using biological sound data, including noise components, as training data. Body sound data may be extracted by applying sound data to the created learning model. The input data for the learning model can be sound data if it can be restored to waveform data. The output data may also be waveform data. In addition, the same method can be used to convert the biological sound data into spectrograms that can be reconstructed into biological sound data. The noise component is extracted from the sound data containing the noise component, and the other components are treated as biological sound data. It is also possible to extract the information.

[0035] The determination unit 114 determines whether the situation is suitable for acquiring body sounds based on the evaluation result of the sound evaluation unit 113. In other words, it is determined whether the target body sounds are being acquired sufficiently.

[0036] The notification unit 116 notifies the result of the determination. The notification unit 116 notifies the result of the determination by using, for example, sound, light, or vibration. The user terminal 2 may transmit one of the above signals or a combination thereof. The determination unit 114 issues a command to the sound generating means, light generating means, vibration generating means, etc. Depending on the result, the notification information registered in the notification information storage unit 122 is read out and a notification is output. Perform processing.

[0037] The notification is made by displaying a predetermined message or image on the screen of the user terminal 2. In this case, the notification unit 116 may display a predetermined image based on the result of the determination unit 114. By controlling the display control unit 115 to display images and messages on the screen, When the user terminal 2 is held against the user's body, In some cases, users may not be able to see the device screen themselves, so if this is the case, In this case, notification by sound, light, or vibration is preferable to notification by display.

[0038] As described above, in the first embodiment, the biological sound data in the acquired sound data is evaluated, It is determined whether sufficient biological sound data has been acquired. The biological sound data was evaluated, but the noise component was evaluated, and for example, the noise component was evaluated if its magnitude was greater than a predetermined value. In this case, the user may determine that the microphone 17 of the user terminal 2 is By doing this, sound is acquired in the environment where biological sounds are to be acquired. The microphone 17 may be placed against the body as in the case of actually acquiring body sounds, but it is not necessary. The sound may be acquired without contacting the body. The magnitude and quality of the noise component are evaluated, and the decision unit 114 decides whether the noise component satisfies a predetermined condition. The predetermined condition is, for example, the volume. The notification unit 116 determines whether the determination result is good (good). If the result is positive (low noise), a notification is sent to inform the user that biological sounds can be acquired. If the environment is poor (too noisy), you will be notified and advised to change the location or take other measures to improve the environment. Encourage change.

[0039] FIG. 7 shows the operation flow in the first embodiment. Unless otherwise specified, each step is as follows: The order may be reversed.

[0040] First, the user starts the application on his / her mobile terminal (user terminal 2) (S101). In some cases, the user inputs the type of body sound to be acquired and the body part to be acquired. The guidance screen for the user can be displayed on the screen of Terminal 2 or output as voice. (S102).

[0041] The user places the microphone 17 of the user terminal 2 against the part of the body where sound is to be acquired, and starts acquiring sound data. The sound evaluation unit 113 evaluates the target body sound component from the acquired sound data (S103). Furthermore, the sound evaluation unit 113 generates a sound by performing predetermined processing on the acquired sound data as needed. The sound evaluation unit 113 may extract the body sound components and then evaluate them. The determination unit 114 provides the acquired sound for analysis by a doctor for diagnosis or disease estimation. In other words, it is determined whether the extracted biometric information is suitable for use (S104). It is determined whether the sound data satisfies the criteria stored in the condition storage unit 121. For example, it determines whether the volume of the body sound data is equal to or greater than a predetermined value.

[0042] If the result is NG (sufficient biological sounds have not been acquired) (S104=No ), the notification unit 116 notifies the user to request re-acquisition (S105). "Vital sounds could not be obtained. Try again." "Move to a quieter place." This can be done by voice messages such as "OK" or by displaying on the screen. If it is determined that the body sounds have been acquired sufficiently (S104=Yes), the notification unit 116 A notification is given that the sound has been acquired (S106). In addition, the acquired sound data (waveform) is also sent as needed. The data (which may include analytical data such as shape data) is sent to the server (S107).

[0043] In the first embodiment, the sound evaluation unit 113, the determination unit 114, and other calculation processing units and condition storage units The user terminal 2 is provided with storage units such as a storage unit 121, a notification information storage unit 122, and a sound data storage unit 123. However, these may be provided in the server 1. The sound data acquired by the data acquisition unit 112 is transmitted to the server 1, and the server 1 analyzes and judges the sound. The determination result may be transmitted to the user terminal 2.

[0044] <Embodiment 2> In the second embodiment, it is determined whether the angle of the user terminal 2 is suitable for acquiring body sounds. That is, a microphone mounted on the user terminal 2 such as a smartphone is attached to the user's body. When acquiring biological sounds by contacting the device, if the angle of the device relative to the body is within a certain range, the biological sounds In addition, it may be easier to obtain biological sounds at a certain angle. In some cases, it may be preferable to acquire the same information in a unified manner. The angle of the user terminal 2 is grasped from the sensor data, and the range of the terminal angle registered in advance is It determines whether or not the value is in the range.

[0045] FIG. 8 shows an example of the software configuration of the user terminal 2 in the second embodiment. In addition to the software configuration in the first embodiment, a sensor input control unit 117 is further provided. The user terminal 2 is equipped with a tilt sensor that can detect the angle of the terminal 2. Anything that can detect the tilt angle in each direction of the terminal is sufficient. These sensors include a gyro sensor, an acceleration sensor, etc. As shown in Figure 9, the angle is the x-axis pointing to the right of the screen, the y-axis pointing upward in the longitudinal direction, and the y-axis pointing vertically upward to the screen. The z-axis is used as the rotational axis, and the x-axis rotation is the pitch, the y-axis rotation is the azimuth, and the z-axis rotation is the Axial rotation is expressed as roll, etc.

[0046] The condition storage unit 121 in the second embodiment stores the body sound acquisition site (right chest, left chest, stomach, intestines, etc.) ) or disease, or by type of vital sounds (heart sounds, respiratory sounds, lung sounds, peristalsis sounds, swallowing sounds, etc.), An appropriate angle range for the user terminal 2 is registered in advance. For example, when measuring heart sounds, the condition information is stored as shown in Figure 11. , face the bottom of Device 2 (microphone part) towards your body and make sure the orientation of the screen of Device 2 (Z axis) is horizontal. The optimum condition is to hold the tilt angle at 90° and The conditions for implementation may be set within a predetermined allowable range. For example, The oblique angle may be 85° to 95° and the azimuth angle may be 85° to 95°. When determining the angle of inclination, azimuth, and rotation, the values ​​and ranges of the angle of rotation are used as conditions. In addition, the type of biological sound to be acquired (heart sound, breathing sound, lung sound, peristalsis sound, swallowing sound, etc.), disease, treatment, etc. Parts obtained (right breast, left breast, stomach, intestines, etc.), purpose of acquisition (donation to doctors, self-health management), number of times acquired Multiple settings can be made depending on the number of times (1st, 2nd, etc.).

[0047] The notification information storage unit 122 of the second embodiment stores the notification information output by the notification unit 116 according to the determination result. FIG. 12 shows an example of the structure of the notification information stored in the notification information storage unit 122. The notification information includes the notification content settings for each judgment result. Notifications are not limited to voice notifications. The notification may be sound, light, vibration, display, or a combination of these. When making a judgment based on the angle of 2, if the judgment is OK (the terminal angle is within the specified range), In the same way as in the first embodiment, notifications can be registered for when the judgment is NG and when the judgment is NG. If the result is NG, the device angle measurement value is compared with the threshold value as shown in Figure 12. Further notifications may be set depending on the magnitude relationship. For example, if the tilt angle is smaller than a threshold value, Do not issue a voice message (sound notification 3) such as "Please tilt the device a little further back." Also, when the angle of the user terminal 2 is within a predetermined range, a predetermined sound, light, It may emit vibrations and stop these outputs when it is out of range. When the angle of the user terminal 2 is outside a predetermined range, a predetermined sound, light, or vibration is emitted. When the output is stopped, the output may be stopped.

[0048] The sensor input control unit 117 controls the user's input acquired by the tilt sensor mounted on the user terminal 2. The angle data of the user terminal 2 is transmitted to the determination unit 114. The tilt sensor may be, for example, a geomagnetic sensor, The gyro sensor and acceleration sensor measure the angle of the user terminal 2 as the tilt angle (Pitch) and rotation angle (T). It can be expressed as roll and azimuth.

[0049] The determination unit 114 selects a body sound from the condition storage unit 121 according to the body part and type of the body sound to be acquired. If the body part and type of biological sound you want to acquire are predetermined, If so, the user can input the body part and type of body sound. In this case, the conditions are read out according to the input. If the input angle of the user terminal 2 satisfies the condition, it is suitable for acquiring body sounds. If it is not applicable, it is judged as unsuitable.

[0050] The notification unit 116 notifies the result of the determination. The content is read from the notification information storage unit 122 and the notification is output.

[0051] <Embodiment 3> In the third embodiment, whether the position of the user terminal 2 is suitable for acquiring body sounds is determined. To obtain biological sounds, the location where the microphone should be placed is determined depending on the purpose. When users acquire biological sounds by themselves, it is necessary to place the microphone in an appropriate position. Therefore, in the third embodiment, the user terminal 2 It is determined whether the position is at a predetermined set position.

[0052] FIG. 13 shows an example of the software configuration of the user terminal 2 in the third embodiment. In addition to the software configuration in form 1, a sensor input control unit 117 and a position calculation unit Equipped with 118.

[0053] The condition storage unit 121 of the third embodiment stores the condition information when the terminal 2 is placed at an acquisition position suitable for acquiring body sounds. For example, the conditions for determining whether each measurement position is in accordance with the reference position are stored. The conditions are the distance to the target and the direction of movement. The type of biological sound you want to acquire (heart sound, breathing sound, lung sound, Movement sounds, swallowing sounds, etc.), disease, acquisition site (right chest, left chest, stomach, intestines, etc.), acquisition purpose (to the doctor) It is possible to set multiple conditions depending on the condition, such as providing health information, self-health management, etc. 14(a) shows an example of the configuration of the condition information stored in 121. The acquisition position condition is The image data may be plotted on the body to indicate the acquisition position and order. For example, the coordinate information may be a user's location information as a condition for the terminal location. The relative coordinates of the second position with respect to the reference position (first position) on the body are stored. For example, suppose the first location is the solar plexus and the second location is the first The position where the body sound is acquired is the first position (above the right clavicle). In this case, coordinate information of the second position relative to the first position (for example, 0 to 0 in the X direction and 0 in the Y direction) In addition, body sounds can be acquired continuously at multiple positions. In this case, the next acquisition position (third position) is set to the coordinate of the third position relative to the second position described above. This can be determined by marking information.

[0054] The notification information storage unit 122 stores the content of the notification output by the notification unit 116 in accordance with the determination result. FIG. 15 shows an example of the structure of the notification information stored in the notification information storage unit 122. User terminal When making a judgment based on the position of 2, if the object is not within the coordinate range of the set acquisition position, When the location is within the coordinate range, different sounds (notifications 9 and 10) are output. For example, device 2 can emit a sound continuously and notify the user when the device enters the coordinate range of the acquired location. You can change the sound when you enter the coordinate range (notification 9 → notification 10). Or, it may emit a predetermined sound only when the target approaches the coordinate range of the acquired position (notification 10 only). Different notifications may be issued when the user is approaching the target and when the user is moving away from the target. By doing so, the user can easily adjust the position where the terminal 2 is placed.

[0055] The sensor input control unit 117 converts information input from each sensor such as an acceleration sensor into position information. The calculation unit 118 and the determination unit 114 are notified.

[0056] The position calculation unit 118 uses data obtained from an acceleration sensor mounted on the user terminal 2. The position calculation unit 118 calculates the position information of the terminal 2 from the acceleration data. Calculate the distance traveled. The distance traveled is calculated by using the acceleration sensor value with a known method such as trapezoidal integration. As an example, the reference position on the user's body can be calculated by integrating the After the user terminal 2 is placed at the first position, the user sets a position (first position) different from the first position. When the terminal 2 is moved to a second position where the moving direction and the moving distance are From this, the coordinates of the second position (relative to the first position) can be derived. The method for determining the location of the terminal 2 is not limited to this, and any known method may be used.

[0057] The determination unit 114 determines a position on the user's body that is suitable for the user terminal 2 to acquire body sounds. As an example, it is determined whether the sensor is located at a reference position on the body (first position). The first position is determined in a way that is easy for the user to understand and unique. For example, the solar plexus or collarbone can be specified. First, the user terminal is Then, the terminal 2 is stopped for a predetermined time. The user terminal 2 is moved from the target position to a position (second position) where the body sound is acquired, and the acceleration data during that time is The position calculation unit 118 calculates the moving direction and moving distance of the terminal 2 from the acceleration data. and calculates the coordinates of the user terminal 2 relative to the first position.

[0058] The notification unit 116 notifies the result of the determination. When the device enters the range of the biological sound acquisition position (second position) stored in the The user can move the terminal 2 to move out of the range of the acquired position. When the predetermined sound, light, or vibration is stopped, the generation of the predetermined sound, light, or vibration may be stopped. If the location of terminal 2 is outside the range of the acquired location, the location is deemed to be inappropriate. The device emits a sound, light, or vibration to indicate the movement of the object, and the sound, light, or vibration stops when the object is moved to the appropriate position. In addition, when the user terminal 2 is moving, the position of the terminal 2 may be determined based on the biometric information. The first notification is sent when the device is approaching the sound acquisition location range, and the second notification is sent when the device is far away. The first notification may be, for example, a notification to encourage the user to continue moving. The first notification is a notification to correct the direction, and the second notification is a notification to correct the direction. The notification may be a voice message, sound, light, or vibration. For example, the first notification may be omitted and the second notification may be omitted. A second notice may be sent only if necessary to prompt correction.

[0059] <Embodiment 4> In the fourth embodiment, the user terminal 2 is in a state where it can acquire the loudest body sound. The state of the user terminal 2 is determined based on, for example, the angle and position of the user's body. In the second and third embodiments, the angle and position of the user terminal 2 are set in advance. In the fourth embodiment, it is determined whether the body sound is within a predetermined range. It determines angles and positions relatively.

[0060] The software configuration example of the user terminal 2 in the fourth embodiment is the same as that in the fourth embodiment. In addition to the software configuration in the first embodiment, a sensor input control unit 117, a position calculation It has an outlet 118.

[0061] In the fourth embodiment, the state of the terminal 2 that can acquire body sounds most favorably is relatively determined. Therefore, it is necessary to establish conditions for determining whether or not the device is suitable for acquiring biological sounds. For example, as in the first embodiment, Establish conditions for determining whether the volume of body sounds is above a certain level or whether noise is low. In addition, the angle and position of the terminal 2 can be determined in the same manner as in the second and third embodiments. In the fourth embodiment, on the premise that these conditions are met, Alternatively, an optimum state may be selected based on the volume of the biological sound.

[0062] The notification information storage unit 122 of the fourth embodiment stores the notification information that the notification unit 116 outputs in accordance with the determination result. FIG. 16 shows an example of the structure of the notification information stored in the notification information storage unit 122. Notification (notification 11) when the state of acquiring vital sounds changes favorably as the terminal 2 moves. ), and notifications (notification 12) when the vital sound acquisition status is deteriorating. The notification may be sound, light, vibration, or a combination thereof, for example, Notification 1 Notification 1 and Notification 12 are different in that they allow you to register notification sounds with different tones and volumes, and optical communication devices with different light colors and intensities. You can register notifications with different vibration strengths, tempos, and patterns. In this way, the notification changes depending on the result of the determination unit 114, so that the user can You can intuitively determine whether the direction in which you are moving the second end is correct or not.

[0063] The sound data acquisition unit 112 acquires sound from the microphone 17 provided in the user terminal 2 for a predetermined period of time. At this time, the user terminal 2 is placed in the user's hand, just like when acquiring actual body sounds. After placing the user terminal 2 so that it is in contact with the body, the angle of the user terminal 2 and the acquisition position on the body are changed. The sound data is continuously acquired from the device, and the sound at a certain point in time is compared with the sound at the previous point in time for analysis. This allows us to identify the angle and location on the body that is most suitable for acquiring biological sounds.

[0064] The sound may be acquired continuously or at predetermined time intervals. The device is moved slowly around the target area to capture the sound. The optimal device angle is identified. To do this, simply rotate the device 2 while it is in contact with your body and change the angle to capture the sound. When identifying an appropriate terminal position, the terminal 2 is moved on the body while acquiring sounds.

[0065] The sound evaluation unit 113 evaluates the volume of the body sound data included in the sound data in the same manner as in the first embodiment. If necessary, processing may be performed to extract target biological sound data from the sound data. .

[0066] The determination unit 114 determines whether the n The biological sound data acquired at time T n A time later than T n+ Compare the biological sound data acquired in 1 with the newer time T n+1 Biosound data acquired by is time T n If the biological sound data is larger than the n+1 the angle of terminal 2 in The position is at time T n The angle or position of the terminal 2 in the Conversely, at a more recent time T n+1 The biological sound data acquired at time T n Biosound Day If the time T n+1 The angle or position of the terminal 2 at time T n in It is determined that the angle or position of the terminal 2 is not appropriate for acquiring body sounds. n and T n+1 The intervals may be predetermined, for example, every 0.1 to 1 second. Time T n , T n+1 may be a predetermined time span, in which case the sound data during that time span The volume of the biological sound data can be compared. , the magnitude of the noise component may be compared.

[0067] The notification unit 116 notifies the n+1 Sound data and time T n Based on the results of comparison with the sound data As an example, the user terminal 2 may continuously emit a notification sound and T n+1 The sound data is n It was determined that this data is more suitable for capturing biological sounds than the sound data from In this case, the tone and volume of the notification sound can be changed. Light is emitted from the n+1 The sound data is n It is more suitable for acquiring biological sounds than other sound data. If it is determined that the user is using the device, the color and intensity of the light can be changed. The user terminal 2 vibrates at time T n+1 The sound data is n Live sound data If it is determined that the sound is suitable for acquiring body sounds, the strength, tempo, and pattern of the vibrations are changed. For example, changing the volume means that when the judgment result is good, the volume is Gradually increase the volume, or gradually decrease the volume in the opposite case. Also, at time T n+1 The sound data is n Biomedical sound data is better than If it is determined that the acquisition is appropriate, a notification such as a notification sound, light, or vibration is issued. n+1 The sound data is n It was determined that the sound data was less suitable for acquiring biological sounds than the sound data from Alternatively, you can set the notification sound not to be emitted when the time T n+1 The sound data of Time T n If the sound data is judged to be less suitable for acquiring biological sounds than the sound data of the , a notification such as vibration is issued, and conversely, at time T n+1 The sound data is n Rather than sound data, It is also possible to configure the device so that if it is determined that the sound is suitable for acquisition, the notification sound is not emitted. By such a notification, the user can move the terminal 2 and wait until the terminal 2 is in a suitable state for acquiring body sounds. Are you able to move the last two or are you correcting your trajectory to a different direction or angle? You can find out in real time what you should do.

[0068] The determination unit 114 may further determine whether the sound data satisfies a predetermined condition. For example, the condition is that the volume of the biological sound included in the sound data is greater than a predetermined value. At the same time as determining whether the condition is satisfied, the time Tn+1 Sound data and time T n The sound data is compared to determine whether the direction of movement and the accuracy of movement are correct. , 3, the terminal 2 is placed within a predetermined angle range or position range of the terminal 2. At the same time as determining that n+1 Sound data and time T n Sound data It is also possible to compare the moving direction and moving accuracy to determine whether they are correct.

[0069] As described above, the notification unit 116 notifies the terminal 2 at time T n+1 Sound data and time Time T n If the sound data meets certain conditions, the system notifies the user of the results of the comparison with the sound data. For example, if the user moves the terminal 2 in a certain direction toward the appropriate acquisition position, If the n+1 The sound data is at time T n It is more suitable for acquiring biological sounds than other sound data. It is judged that the user is using the device, so by issuing a predetermined notification such as gradually increasing the volume of the notification sound, , inform the user that the direction of movement is correct. Then, the sound data acquired at a recent time When a predetermined condition is met (for example, when the biological sound is louder than a certain level), the terminal may issue a notice to cease such use.

[0070] <Embodiment 5> In the fifth embodiment, a doctor instructs the location where the body sounds are to be acquired. The location, order, and number of times that a doctor needs to acquire vital sounds for a medical examination, depending on age, illness, constitution, etc. The measurement method may differ depending on the user's gender, body size, and body type. Therefore, in the fifth embodiment, the position where the user's body sounds are obtained may be slightly different. Image data including the acquired body sounds is provided to the doctor's terminal 3, and the doctor acquires the body sounds. Regarding how to get instructions on how to do it.

[0071] FIG. 17 shows an example of the software configuration of the user terminal 2 in the fifth embodiment. The software configuration in the first embodiment further includes a sensor input control unit 117, a position calculation unit 118, and an image data acquisition unit 119.

[0072] FIG. 18 shows an example of the software configuration of the doctor terminal 3 in the fifth embodiment. The processing device includes a data transmission / reception unit 211, an instruction information input unit 212, an instruction image generation unit 213, A location information generating unit 214 may be provided.

[0073] In the fifth embodiment, first, a live image of the user is captured by a camera or the like mounted on the user terminal 2. An image of the body including the body sound acquisition area is taken. The image is taken using a camera mounted on the user terminal 2. The image data acquisition unit 119 of the user terminal 2 may be an image capture unit other than the camera. The captured image data is acquired. The image data may be a still image or a video. stomach.

[0074] The data transmission / reception unit 111 of the user terminal 2 transmits the image data to the doctor terminal 3. The data transmission / reception unit 211 of the user terminal 2 acquires the image data. The unit 111 transmits the image data to the server 1, and the server 1 transmits the image data to the doctor terminal 3. In addition, along with the user's image data, the user's information (name, age, sex, illness, etc.) It is preferable that the user transmits the information (such as the patient) to the doctor terminal 3. If you have been examined at a medical institution, you may include identifying information such as your patient number. stomach.

[0075] FIG. 19 is a diagram showing how a doctor inputs instruction information. As shown in FIG. 19(a), A user image 51 and user information 52 are displayed on the screen display unit (display, etc.) of the terminal 3. The doctor looks at the user image 51 and user information 52 acquired on the doctor terminal 3 and checks the vital sound. As shown in FIG. 19(b), the instruction information input unit 212 of the doctor terminal 3 determines the acquisition conditions. The system accepts input of instructions regarding the conditions for acquiring biological sounds from the user. For example, the input of instructions can be The acquisition position may be selected by the physician in the Specify the acquisition position directly by aligning the cursor or touching the touch panel. In addition, you can input information such as the number of acquisitions and the order of acquisition according to the acquisition position. This can be done.

[0076] The instruction image generation unit 213 generates an acquisition instruction image based on the information received by the instruction information input unit 212. The acquisition instruction image is generated on the image 51 showing the user's body, as shown in FIG. 19(c). The image may include a superimposed image on which a display (such as a mark) 53 indicating the acquisition position is superimposed. The superimposed image may further include information such as the order and number of times of acquisition.

[0077] The position information generating unit 214 generates a position information including coordinates representing the acquisition position based on the instruction information input by the doctor. The acquired location information is converted into location information including the location information in the same manner as in the third embodiment, as shown in the table in FIG. Similarly, it may include relative coordinates of the acquired position relative to a reference position on the user's body.

[0078] The data transmission / reception unit 211 of the doctor terminal 3 receives the acquisition instruction image 5 generated by the instruction image generation unit 213. 4 and the acquired location information generated by the location information generating unit 214. Alternatively, the information may be transmitted to the user terminal 2 via the server 1.

[0079] The user terminal 2 stores the received acquisition instruction image 54 and acquisition position information in the condition storage unit 121 or the like. The acquired body sound can be stored in the storage unit and used the next time body sound is acquired. The image 54 is read and displayed on the user terminal 2. In addition, as in the third embodiment, When making a judgment based on the position of 2, the acquired position information can be read and used to make the judgment. .

[0080] In this embodiment, the doctor terminal 3 includes an instruction image generating unit 213 and a position information generating unit 21 4, but some of these may be provided in the server 1. In that case, The input information of the instruction information is sent to the server 1, and the server 1 generates the instruction image and the position information. Then, the generated acquisition instruction image and acquisition position information are transmitted to the user terminal 2. This can be done.

[0081] <Embodiment 6> In the sixth embodiment, the server 1 indicates the body sound acquisition position according to the user's body type. In the sixth embodiment, the server 1 stores a list of users in advance according to illness, purpose of income, etc. The device also has acquisition instruction information such as the location, order, and number of times of acquiring body sounds. In the sixth embodiment, the standard acquisition instruction information needs to be modified depending on the user's body type. The standard acquisition instruction information is corrected based on the image data including the body sound acquisition area of ​​the user. be.

[0082] The software configuration example of the user terminal 2 in the sixth embodiment is the same as that in the fifth embodiment. The software configuration in the first embodiment further includes a sensor input control unit 117 and a position calculation unit 11 8, and an image data acquisition unit 119.

[0083] FIG. 20 shows an example of the software configuration of the server 1 in the sixth embodiment. The server includes an acquisition instruction information storage unit 321, a data transmission / reception unit 311, an image analysis unit 312, an acquisition instruction information storage unit 322, an acquisition instruction information storage unit 323, an acquisition instruction information storage unit 324, an acquisition instruction information storage unit 325, an acquisition instruction information storage unit 326, an acquisition instruction information storage unit 327, an acquisition instruction information storage unit 328, an acquisition instruction information storage unit 329, an acquisition instruction information The display information adjustment unit 313 is provided.

[0084] The acquisition instruction information storage unit 321 of the server 1 can store a plurality of pieces of acquisition instruction information. Fig. 21 shows an example of the configuration of acquisition instruction information. The acquisition instruction information includes the acquisition part, order, number of times, etc. The acquired part may be expressed by the relative coordinates of the acquired position with respect to the reference position. The acquisition instruction information may include an instruction image in which the acquisition position is plotted on the image of the body. A plurality of pieces of instruction information may be provided for each type of body sound or each disease. It is possible to have acquisition instruction information that adjusts the acquisition site according to the type. The type is divided into multiple types such as thin type A, slightly thin type B, normal type C, slightly obese type D, obese type E, etc. The acquired location information for each is registered.

[0085] In the sixth embodiment, first, a live image of the user is captured by a camera or the like mounted on the user terminal 2. An image of the body including the body sound acquisition area is taken. The image is taken using a camera mounted on the user terminal 2. The image data acquisition unit 119 of the user terminal 2 may be an image capture unit other than the camera. The captured image data is acquired. The image data may be a still image or a video. stomach.

[0086] The data transmission / reception unit 111 of the user terminal 2 transmits the image data to the server 1, and the server 1 The data transmitting / receiving unit 311 acquires the image data.

[0087] The image analysis unit 312 of the server 1 analyzes the acquired image data to It is determined whether the image corresponds to any of the body types registered in the condition storage unit 121. The analysis method is not particularly limited, and known methods can be used. For example, the body circumference can be determined from the image. The contour line may be extracted and the type may be determined using the length and ratio of a predetermined part, or machine learning may be used. The images may be classified according to the following criteria:

[0088] The acquisition instruction information adjustment unit 313 adjusts the acquisition instruction information based on the body type selected by the image analysis unit 312. The corresponding body type acquisition instruction information is selected from the display information storage unit 321.

[0089] The server 1 transmits the selected acquisition instruction information to the user terminal 2. The user terminal 2 When acquiring body sounds, the device reads out the received acquisition instruction information. If included, an instruction image can be displayed on the user terminal 2. Based on the information, a determination based on the location information of the terminal 2 in the third embodiment can be made. do.

[0090] In addition, the acquisition instruction information storage unit 321 stores only the acquisition instruction information for the standard body type, and In this case, the image analysis unit 312 can analyze the user's image to determine the user's body shape. The acquisition instruction information adjustment unit 313 then calculates the difference between the user's body type and the standard body type. The acquisition instruction information is corrected according to the difference. The method for calculating the difference between the user's body type and the standard body type is not particularly specified. There are no restrictions on the length of the body, and the size can be determined by comparing the length of a specific part, such as the shoulder width or chest width. It may be determined.

[0091] In the above description, the image analysis unit 312 determines the body type based on the image of the user. For example, the user's body shape may be estimated using an acceleration sensor of the user terminal 2. It is also possible to estimate the body type by measuring the distance between specific parts of the body. Specifically, the user terminal 2 is moved between predetermined areas (for example, between the left and right shoulders) and the acceleration sensor detects the movement of the user terminal 2. Therefore, by measuring the moving distance of the terminal 2, the length of the predetermined area can be calculated. The specified area is not limited to the area between the left and right shoulders, but can be any part of the body that can be used to estimate the body shape. Then, the body type can be estimated based on the length of the predetermined part. are prepared for each body type, the acquisition instruction information adjustment unit 313 selects the body type that is closest to the In addition, if only the standard body type is prepared as the acquisition instruction information, the acquisition instruction information adjustment unit 313 corrects the acquisition instruction information according to the difference between the standard body type and the estimated body type of the user. do.

[0092] As described above, it has been determined whether the body sound acquisition program of the present invention is suitable for acquiring body sounds by various methods. Therefore, when a user wants to acquire biological sounds using his / her own terminal 2, The methods described in the first to sixth embodiments are each capable of providing appropriate guidance. The above may be implemented in combination.

[0093] In any of the above-described embodiments, a part of each software function unit is As long as the purpose can be realized, any of the user terminal 2, doctor terminal 3, and server 1 It may be provided in any of the above positions.

[0094] The above-described embodiment is merely an example for facilitating understanding of the present invention, and does not limit the present invention. The present invention is not intended to be construed as a modification or improvement without departing from the spirit of the invention. It goes without saying that the present invention includes equivalents thereof. [Explanation of symbols]

[0095] 1 server 2. User terminal 3. Doctor's terminal

Claims

1. A body sound acquisition support system that supports a user in acquiring body sounds using a user terminal, comprising: a sound data acquisition unit that acquires sound data including the body sounds; a determination unit that determines whether or not the body sound acquisition position information matches the body sound acquisition condition; a transmitting unit that transmits the sound data to a doctor terminal of a doctor when the acquisition condition is satisfied; A biological sound acquisition support system comprising:

2. The body sound acquisition support system according to claim 1 , wherein the transmitting unit converts the sound data into a spectrogram and transmits the spectrogram to the doctor terminal.

3. a sound evaluation unit that evaluates a specific sound component from the acquired sound data; The body sound acquisition support system according to claim 1 , wherein the determination unit determines whether or not the body sound acquisition conditions are met based on the evaluation result by the sound evaluation unit.

4. the sound evaluation unit evaluates the volume of a target body sound component; the acquisition conditions include conditions related to the volume of the body sound components, The body sound acquisition support system according to claim 3 , wherein the determining unit determines whether or not the volume of the body sound component satisfies the acquisition condition.

5. the sound evaluation unit evaluates the volume of a noise component; the acquisition conditions include a condition related to the volume of the noise component; The body sound acquisition support system according to claim 3 , wherein the determination unit determines whether or not the volume of the noise component satisfies the acquisition condition.

6. a position calculation unit that calculates terminal position information associated with movement of the user terminal; The body sound acquisition support system according to claim 1 , wherein the determination unit determines whether the terminal location information matches the acquired location information.

7. the doctor terminal accepts input of instruction information regarding an acquisition position of the user's body sound by the doctor; The body sound acquisition support system according to claim 1 , wherein the determination unit determines whether the acquisition position information matches the instruction information.

8. 8. The body sound acquisition support system according to claim 7, wherein the instruction information includes the acquisition position information and at least one of the number of acquisitions and the order of acquisitions.

9. The body sound acquisition support system according to claim 7 , wherein the doctor terminal allows the doctor to select the acquisition position on a displayed image.

10. 2. The body sound acquisition support system according to claim 1, wherein the acquisition condition is an image in which acquisition positions are plotted on the body.

11. The body sound acquisition support system according to claim 10 , wherein the acquisition condition is that the acquisition positions and acquisition order are plotted on the image.

12. 2. The body sound acquisition support system according to claim 1, wherein the acquisition conditions include a distance and a direction from a reference position, and the determination unit detects the distance and the direction of movement of the acquired position information from the reference position.

13. 2. The body sound acquisition support system according to claim 1, wherein the acquisition conditions include a distance and a direction from a position, and the determination unit determines whether a second position to which the body sound has been moved from a first position that is a reference position satisfies the acquisition conditions, and after acquiring the body sound at the second position, determines whether a third position to which the body sound has been moved from the second position satisfies the acquisition conditions.

14. 2. The body sound acquisition support system according to claim 1, wherein the acquisition conditions are set for each type of body sound, disease, acquisition site, and acquisition purpose.

Images