Method and device for determining auscultation position, storage medium and electronic device
By detecting the effective signal quality of auscultation audio data and providing adjustment prompts, it helps users determine the accurate auscultation location, solving the problem that non-professionals have difficulty accurately placing the stethoscope, and improving the accuracy and efficiency of auscultation results.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
- Filing Date
- 2023-07-28
- Publication Date
- 2026-04-28
AI Technical Summary
Non-professionals often find it difficult to accurately determine the auscultation location, leading to inaccurate auscultation results. Existing human body diagram reference methods have limited effectiveness for ordinary users.
By acquiring audio data at candidate auscultation locations, detecting the quality of effective signals, and generating adjustment prompts when the quality is insufficient, the actual auscultation location is determined until a preset threshold is reached.
It improves the accuracy and efficiency of auscultation location, ensures that quality determination is only performed when a valid signal is available, and reduces invalid operations.
Smart Images

Figure CN119446191B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of medical technology, and more specifically, to a method for determining auscultation location, a device for determining auscultation location, a computer-readable storage medium, and an electronic device. Background Technology
[0002] Auscultation, as a specialized medical diagnostic method, requires precise placement of the auscultator probe. Typically, only qualified physicians can accurately determine the auscultation position to obtain accurate auscultation signals. Incorrect auscultation placement will lead to inaccurate results.
[0003] Auscultation products in related technologies often include a human body diagram and indicate recommended auscultation locations for reference. However, determining the auscultation location involves the anatomical structure of the human body, and it is still difficult for non-professionals to find the accurate auscultation location using only diagrams.
[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention
[0005] The purpose of this disclosure is to provide a method, apparatus, computer-readable storage medium, and electronic device for determining auscultation location, thereby improving the accuracy of auscultation location determination to at least a certain extent.
[0006] According to a first aspect of this disclosure, a method for determining an auscultation location is provided, comprising: acquiring candidate auscultation audio data at a candidate auscultation location; determining the effective signal quality of the candidate auscultation audio data when it is determined that the candidate auscultation audio data contains effective signal data, wherein the effective signal data is determined according to the item to be auscultated; generating adjustment prompt information for the candidate auscultation location when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, updating the candidate auscultation location based on the adjustment prompt information, until the effective signal quality of the candidate auscultation audio data at the candidate auscultation location is greater than the preset signal quality threshold, thereby determining an actual auscultation location for auscultating the item to be auscultated.
[0007] According to a second aspect of this disclosure, an auscultation location determination apparatus is provided, comprising: a candidate auscultation audio data acquisition module configured to acquire candidate auscultation audio data at a candidate auscultation location; a signal quality determination module configured to determine the effective signal quality of the candidate auscultation audio data when it is determined that the candidate auscultation audio data contains effective signal data, wherein the effective signal data is determined according to the item to be auscultated; and an actual auscultation location determination module configured to generate adjustment prompt information for the candidate auscultation location when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, update the candidate auscultation location based on the adjustment prompt information, until the effective signal quality of the candidate auscultation audio data at the candidate auscultation location is greater than the preset signal quality threshold, and determine an actual auscultation location for auscultating the item to be auscultated based on the current candidate auscultation location.
[0008] According to a third aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method for determining the auscultation location described in the first aspect above.
[0009] According to a fourth aspect of this disclosure, an electronic device is provided, characterized in that it includes: one or more processors; and a memory for storing one or more programs, which, when executed by the one or more processors, cause the one or more processors to implement the method for determining the auscultation location described in the first aspect.
[0010] According to a fifth aspect of this disclosure, a computer program product comprising instructions is provided, which, when run on a computer, causes the computer to perform the steps of the method for determining the auscultation location as described in the first aspect.
[0011] The technical solution disclosed herein has the following beneficial effects:
[0012] In this disclosure, on the one hand, by detecting effective signals and determining signal quality in auscultation audio data, users can be assisted in determining the accurate auscultation location, thereby improving the accuracy of auscultation location determination and auscultation results; on the other hand, this disclosure determines the quality of the effective signal only when the existence of an effective signal is confirmed, so as to determine the actual auscultation location based on the quality of the effective signal, without having to determine the quality of the effective signal every time, thus improving the efficiency of auscultation location determination.
[0013] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0014] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:
[0015] Figure 1 A schematic diagram of a system architecture to which exemplary embodiments of the present disclosure may be applied is shown;
[0016] Figure 2 A flowchart illustrating a method for determining auscultation location according to an exemplary embodiment of this disclosure is shown.
[0017] Figure 3 This diagram illustrates a flowchart of a method for determining candidate auscultation locations according to an exemplary embodiment of the present disclosure.
[0018] Figure 4 This diagram illustrates a target auscultation location indicator for heart sounds according to an exemplary embodiment of this disclosure.
[0019] Figure 5 This diagram illustrates a lung sound target auscultation location indicator according to an exemplary embodiment of the present disclosure;
[0020] Figure 6 A display interface diagram illustrating a target auscultation location indication according to an exemplary embodiment of the present disclosure is shown;
[0021] Figure 7 The diagram illustrates a flowchart of a signal-to-noise ratio calculation method based on filtering and noise reduction in an exemplary embodiment of this disclosure.
[0022] Figure 8 The diagram illustrates a flowchart of a signal-to-noise ratio calculation method based on signal envelope according to an exemplary embodiment of this disclosure.
[0023] Figure 9 This diagram illustrates the location of a second preset collection point in an example embodiment of the present disclosure.
[0024] Figure 10 This diagram illustrates a stethoscope signal quality display interface according to an exemplary embodiment of the present disclosure;
[0025] Figure 11 This diagram illustrates a display interface for adjusting the auscultation position according to an exemplary embodiment of the present disclosure.
[0026] Figure 12 This diagram illustrates a stethoscope location prompting interface according to an exemplary embodiment of the present disclosure;
[0027] Figure 13 A flowchart illustrating another method for determining the auscultation location according to an exemplary embodiment of this disclosure is shown.
[0028] Figure 14 This diagram illustrates a video-based auscultation location determination method according to an exemplary embodiment of the present disclosure.
[0029] Figure 15 This diagram illustrates the composition of a device for determining auscultation location according to an exemplary embodiment of the present disclosure;
[0030] Figure 16 A schematic diagram of an electronic device to which exemplary embodiments of the present disclosure may be applied is shown. Detailed Implementation
[0031] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0032] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.
[0033] Auscultation, as a specialized medical diagnostic method, requires precise placement of the auscultator probe. Typically, only qualified physicians can accurately determine the auscultation position to obtain accurate results. Incorrect placement can negatively impact the accuracy of the auscultation findings.
[0034] In related technologies, a standard human anatomy diagram is attached to the stethoscope, marking recommended auscultation locations for reference. However, determining the auscultation location involves the anatomical structure of the human body, and the auscultation location varies for the same auscultation procedure depending on the individual's body size. For ordinary users without medical expertise or inexperienced medical practitioners, it is still difficult to find the accurate auscultation location using only the recommended locations in the standard human anatomy diagram, thus affecting the accuracy of the auscultation results.
[0035] In view of the above problems, an exemplary embodiment of this disclosure provides a method for determining the auscultation location.
[0036] Below, some of the technical terms used in this disclosure will be explained to facilitate a better understanding of its contents.
[0037] Candidate auscultation location: The location the auscultator deems the current correct auscultation location. For example, if the auscultator places the auscultation device at location A on the body part to be auscultated and deems it appropriate to perform auscultation, then location A is a candidate auscultation location. In some embodiments, a candidate auscultation location can be understood as any location where the user wants to auscultate the body part. For example, when the user places the auscultation device at a certain auscultation location, the auscultation device can collect relevant physiological signals at that location.
[0038] The true auscultation location: This refers to the actual and correct auscultation location corresponding to the item to be auscultated. It can be one or more, depending on the item being auscultated. For example, regarding heart sounds, according to the 9th edition of *Diagnostics*, heart sounds need to be heard in the mitral valve area, aortic valve area, second aortic valve auscultation area, pulmonary valve area, and tricuspid valve area. Therefore, the mitral valve area, aortic valve area, second aortic valve auscultation area, pulmonary valve area, and tricuspid valve area are all the true auscultation locations for heart sounds. In other words, there are multiple true auscultation locations corresponding to the item "heart sounds".
[0039] Target auscultation location: The actual auscultation location to be detected for the auscultation item. The target auscultation location can be one of the actual auscultation locations currently being detected, such as the first actual auscultation location to be detected among multiple actual auscultation locations. After the current target auscultation location is detected, the next actual auscultation location to be detected can also be understood as the target auscultation location, until all actual auscultation locations corresponding to the auscultation item have been detected. For example, for the auscultation item "heart sounds," if the current actual auscultation location is the mitral valve area, then the mitral valve area is the current target auscultation location for the auscultation item "heart sounds."
[0040] Understandably, different auscultation items may have different actual auscultation locations, and the first target auscultation location may also be different for different auscultation items. In some embodiments, the auscultation order of each actual auscultation location can be determined according to the importance of different actual auscultation locations in the auscultation item. For example, the auscultation order of important auscultation locations can be placed first, such as selecting the actual auscultation location with the largest proportion for the auscultation item as the first target auscultation location, or selecting the actual auscultation location that the user can most easily locate as the first target auscultation location. The detection order of other actual auscultation locations can be determined based on logic such as the shortest movement path and decreasing the importance of the auscultation location. In other embodiments, the target auscultation location can also be determined from multiple actual auscultation locations of the auscultation item according to the user's selection, such as for heart sounds. For auscultation projects, if the user selects the aortic valve area as the actual auscultation location before starting the measurement, then the target auscultation location in the current auscultation process is only the aortic valve area. If the user selects both the aortic valve area and the mitral valve area before starting the measurement, then the target auscultation locations in the current auscultation process include both the aortic valve area and the mitral valve area. If the mitral valve area is auscultated first and the aortic valve area is auscultated later based on the order of importance, then in the current auscultation process, the mitral valve area is used as the target auscultation location first. After the auscultation data of the mitral valve area is collected, the aortic valve area is used as the next target auscultation location. Alternatively, if the user selects the aortic valve area first and then the mitral valve area, then the aortic valve area is the first target auscultation location in the current measurement process, and the mitral valve area is the second target auscultation location. Of course, the order of the target auscultation locations can also be determined by combining the above logic.
[0041] Actual auscultation location: The actual auscultation location used during a specific auscultation session. For example, if the effective signal quality at location B is determined to be greater than or equal to a preset signal quality threshold, the auscultation can be performed based on location B; therefore, location B is the actual auscultation location. During auscultation, the actual auscultation location may completely coincide with the target auscultation location, or it may differ slightly from the target auscultation location, but this difference is within an acceptable range, ensuring the accuracy of the auscultation results.
[0042] Next, combined Figure 1 The system architecture of the operating environment for this exemplary embodiment is described in an exemplary manner.
[0043] Figure 1A schematic diagram of the system architecture is shown. System architecture 100 may include a terminal 110 and an electronic stethoscope 120. The terminal 110 may be a smartphone, tablet, smart wearable electronic device (such as a smartwatch), or other terminal device. The terminal 110 is equipped with a display screen that can display an indication of the auscultation location. The electronic stethoscope 120 may also be equipped with a processor capable of providing services related to the auscultation location determination method in this exemplary embodiment. The terminal 110 and the electronic stethoscope 120 can be connected via a wired or wireless communication link for data exchange. For example, the terminal 110 can connect to the electronic stethoscope 120 via Bluetooth to obtain auscultation audio data obtained from the electronic stethoscope 120.
[0044] In one exemplary embodiment, the auscultation location determination method of this disclosure can be executed by terminal 110. For example, terminal 110 can acquire candidate auscultation audio data at a candidate auscultation location, and then determine whether the candidate auscultation audio data contains valid signal data. If so, the quality of the valid signal data in the candidate auscultation audio data is determined. If the quality of the valid signal data is less than a preset signal quality threshold, an adjustment prompt message for the candidate auscultation location is generated to prompt the user to adjust the candidate auscultation location, thereby updating the candidate auscultation location. The updated candidate auscultation location is then re-detected for valid signal and the quality of valid signal data is re-determined until the quality of the valid signal data of the candidate auscultation audio data at the candidate auscultation location is greater than or equal to the preset signal quality threshold. In this way, the current candidate auscultation location is determined as the actual auscultation location, so that the auscultation item to be auscultated can be performed based on the actual auscultation location.
[0045] In another exemplary embodiment, the auscultation location determination method of this disclosure can also be performed by the electronic stethoscope 120. For example, the electronic stethoscope 120 can acquire candidate auscultation audio data at a candidate auscultation location and detect whether the candidate auscultation audio data contains valid signal data. If it does, it further determines whether the valid signal quality of the candidate auscultation audio data is greater than or equal to a preset signal quality threshold. If not, it generates an adjustment prompt message for the candidate auscultation location to prompt the user to adjust the candidate auscultation location. Based on the adjustment result, the candidate auscultation location is updated, and the detection is repeated to determine whether the candidate auscultation audio data at the updated candidate auscultation location contains valid signal data and whether the valid signal quality is greater than or equal to the preset signal quality threshold. This process is repeated until the candidate auscultation audio data at the updated candidate auscultation location contains valid signal data and the valid signal quality is greater than the preset signal quality threshold. Then, the candidate auscultation location is determined as the actual auscultation location, and the auscultation of the item to be auscultated is performed based on the actual auscultation.
[0046] In yet another exemplary embodiment, the method for determining the auscultation location in this disclosure may also be performed jointly by the terminal 110 and the electronic stethoscope 120. For example, the electronic stethoscope 120 can acquire candidate auscultation audio data at a candidate auscultation location and then send the candidate auscultation audio data to the terminal 110. The terminal 110 determines whether the candidate auscultation audio data contains valid signal data. If it does, the terminal 110 further determines whether the valid signal quality of the candidate auscultation audio data is greater than or equal to a preset signal quality threshold. If not, it generates an adjustment prompt message for the candidate auscultation location to prompt the user to adjust the candidate auscultation location. Based on the adjustment result, the candidate auscultation location is updated. The electronic stethoscope 120 reacquires the candidate auscultation audio data at the updated candidate auscultation location and sends it to the terminal 110 again. The terminal 110 re-determines whether the candidate auscultation audio data at the updated candidate auscultation location contains valid signal data and whether the valid signal quality is greater than or equal to the preset signal quality threshold. The above process is repeated until the terminal 110 determines that the candidate auscultation audio data at the updated candidate auscultation location contains valid signal data and the valid signal quality is greater than the preset signal quality threshold. Then, the candidate auscultation location is determined as the actual auscultation location, and the auscultation of the item to be auscultated is performed based on the actual auscultation.
[0047] As can be seen from the above, the execution subject of the method for determining the auscultation location in this exemplary embodiment can be the aforementioned terminal 110, the aforementioned electronic stethoscope 120, or both the terminal 110 and the electronic stethoscope 120. This disclosure does not limit the subject in this regard.
[0048] The following is combined with Figure 2 A method for determining the auscultation location in this exemplary embodiment will be described. Figure 2 An exemplary flow diagram of a method for determining the auscultation location is shown, which may include:
[0049] In step S210, candidate auscultation audio data at the candidate auscultation location is obtained;
[0050] In step S220, if it is determined that the candidate auscultation audio data contains valid signal data, the valid signal quality of the candidate auscultation audio data is determined, and the valid signal data is determined according to the item to be auscultated.
[0051] In step S230, if the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, an adjustment prompt message for the candidate auscultation position is generated to update the candidate auscultation position based on the adjustment prompt message until the effective signal quality of the candidate auscultation audio data at the candidate auscultation position is greater than the preset signal quality threshold. Based on the current candidate auscultation position, the actual auscultation position for auscultating the item to be auscultated is determined.
[0052] Based on the above method, on the one hand, by detecting effective signals and determining signal quality in the auscultation audio data, users can be assisted in determining the accurate auscultation location, thereby improving the accuracy of auscultation location determination and auscultation results; on the other hand, this disclosure determines the effective signal quality only when an effective signal is confirmed to exist, so as to determine the actual auscultation location based on the effective signal quality, without having to determine the effective signal quality every time, thus improving the efficiency of auscultation location determination.
[0053] The following is about Figure 2 The steps shown will be explained in detail.
[0054] In step S210, candidate auscultation audio data at the candidate auscultation location is obtained.
[0055] In one exemplary implementation, the candidate auscultation location is determined based on the items to be auscultated. The items to be auscultated may include human sounds that can be examined with a stethoscope, including but not limited to heart sounds, lung sounds, tracheal breath sounds, and gastrointestinal motility sounds. As mentioned above, the candidate auscultation location may be determined by the auscultator adjusting the position of the stethoscope based on prompts generated by the auscultator regarding the target auscultation location of the item to be auscultated, thereby establishing the correct auscultation location as perceived by the auscultator. The stethoscope may include the auscultation probe of a stethoscope.
[0056] For example, prompts can be generated based on the target auscultation location of the item to be auscultated in a human anatomy diagram. This prompts the auscultator to place the auscultation device on the body part of the subject, thus generating candidate auscultation locations based on the auscultator's perceived correct placement. Candidate auscultation locations can also include any location the user intends to auscultate, not necessarily the location specified in the prompt.
[0057] For example, Figure 3 This diagram illustrates a flowchart of a method for determining candidate auscultation locations according to an exemplary embodiment of this disclosure. (See also:) Figure 3 The method may include steps S310 to S330. Wherein:
[0058] In step S310, in response to the selection operation of the item to be auscultated, a first prompt message of the starting auscultation position pre-associated with the item to be auscultated is generated.
[0059] For example, for each auscultation item, the target auscultation location associated with each item can be determined in advance based on its actual auscultation location on a human anatomy diagram. For instance, when the auscultation item is heart sounds, i.e., cardiac audio frequencies, the target auscultation location can be determined based on... Figure 4The indicated target auscultation locations suggest that the user should ultimately place the auscultation device in the mitral valve area, aortic valve area, second aortic valve auscultation area, pulmonary valve area, or tricuspid valve area. Figure 4 The A, B, E, T, and M in the auscultation scale. When the item to be auscultated is lung sounds, i.e., lung audio frequencies, it can be determined according to... Figure 5 The indicated target auscultation positions suggest that the user place the auscultation device on the anterior chest along the midclavicular line and anterior axillary line, on the lateral chest along the midaxillary line and posterior axillary line, and on the back along the scapular line (in the scapular region, move the auscultation point 1-3cm towards the midline of the body to avoid the scapula), and auscultate symmetrically on both sides of each intercostal space from top to bottom. Figure 5 (Only some points are shown in the drawing). Figure 4 and Figure 5 The target auscultation location is based on "Diagnostics, Ninth Edition".
[0060] In other words, for each auscultation item, the actual auscultation location may include one or more. Correspondingly, the target auscultation location for each auscultation item may also include one or more. In practice, the auscultator can choose to auscultate based on some of the target auscultation locations according to needs or the instructions or recommendations of a professional physician, thereby simplifying the complexity of auscultation and reducing the measurement time during auscultation.
[0061] In one exemplary implementation, an easily locating human body location can be selected as the starting auscultation location for the auscultation item. The starting auscultation location can be different for each auscultation item, and the selection criteria for the starting location may include ease of location and proximity to the target auscultation location of the item. For example... Figure 6 Taking 63 as the target auscultation location as an example, the starting auscultation location can be as follows: Figure 6 As shown in Figure 61. Easily locating locations may include clearly defined body locations such as the infraclavicular fossa on both sides and the nipples.
[0062] It should be noted that for different target auscultation locations of the same auscultation item, the same starting auscultation location can be pre-associated. Of course, different starting auscultation locations can also be pre-associated for different target auscultation locations of the same auscultation item. This exemplary embodiment does not impose any special limitations on this.
[0063] For example, after pre-associating a starting auscultation position with the item to be auscultated, when the auscultator selects the item to be auscultated and a target auscultation position for that item, a first prompt message can be generated based on the pre-associated starting auscultation position of the target auscultation position selected by the auscultator. This first prompt message instructs the auscultator to place the auscultation device in the first position on the body part of the object to be auscultated, corresponding to the starting auscultation position. For example, if the starting position is the scapula, the first prompt message could include something like "Please place the auscultation device on the scapula first."
[0064] In step S320, in response to detecting the stethoscope at a first position indicated by the first prompt information on the body part of the subject to be auscultated, a second prompt information with a preset movement direction pre-associated with the subject to be auscultated is generated.
[0065] In one exemplary embodiment, a preset movement direction is used to indicate the movement route for moving the auscultation device from a first position to a second position in the body part of the object to be auscultated. The first position corresponds to the starting auscultation position, and the second position corresponds to a target auscultation position pre-associated with the object to be auscultated. The target auscultation position is determined based on the actual auscultation position of the object to be auscultated.
[0066] In other words, the first position is the location of the initial auscultation position within the body part of the person to be auscultated. For example, if the initial auscultation position is the scapula, then the first position is the scapula within the body part of the person to be auscultated. Similarly, the second position is the location of the target auscultation position within the body part of the person to be auscultated. For example, if the target auscultation position is the mitral valve area, then the second position is the mitral valve area within the body part of the person to be auscultated.
[0067] For example, taking the same starting position for the same auscultation item as an example, when there are multiple actual auscultation positions for the item, there can also be multiple corresponding target auscultation positions. For each target auscultation position, the starting position of the item to be auscultated and the movement route of the target auscultation position can be predetermined, thereby determining the preset movement direction of the target auscultation position of the item to be auscultated. Then, the preset movement direction corresponding to each target auscultation position is pre-associated with the target auscultation position identifier. In this way, when the auscultation device is detected at the first position corresponding to the starting auscultation position on the body part of the object to be auscultated, it indicates that the auscultator has placed the auscultation device at the starting auscultation position, and the preset movement direction pre-associated with the first target auscultation position of the item to be auscultated can be obtained, and then a second prompt message can be generated based on the preset movement direction. As mentioned above, the first target auscultation position can be determined according to the importance of the multiple actual auscultation positions of the item to be auscultated or the user's selection, or it can be determined by other means. This exemplary embodiment does not impose any special limitations on this.
[0068] For example, preset movement directions between different target auscultation locations for the same auscultation item can also be generated. The preset movement directions between two target auscultation locations are then associated with the auscultation order of these two target auscultation locations. For instance, if the actual auscultation locations for a certain auscultation item include location 1, location 2, location 3, and location 4, then its corresponding target auscultation locations can also include location 1, location 2, location 3, and location 4. Based on the order of importance, the auscultation order of the target auscultation locations is determined to be location 1, location 2, location 3, and location 4. Location 1 is then the first target auscultation location. A preset movement direction 1 for moving from location 1 to location 2 can be generated and associated with the movement from location 1 to location 2. Similarly, a preset movement direction 2 for moving from location 2 to location 3 can be generated and associated with the movement from location 2 to location 3. Finally, a preset movement direction 3 for moving from location 3 to location 4 can be generated and associated with the movement from location 3 to location 4. Thus, when auscultating the subject, if the auscultation device is detected at the first position indicated by the starting position of the auscultation item on the body part to be auscultated, a prompt message related to the first target auscultation position, i.e., position 1, can be generated to prompt the user to move the auscultation device from the current position to the first target auscultation position according to the preset movement direction associated with position 1 (i.e., the preset movement direction from the starting position to position 1). After auscultating the first target auscultation position, i.e., position 1, is completed (i.e., when the actual auscultation position corresponding to position 1 is determined and the audio data corresponding to the actual auscultation position corresponding to position 1 is collected, it is determined that the auscultation of position 1 is completed), a prompt message can be generated again according to the preset movement direction 1 to prompt the user to move the auscultation device from the current position to the target auscultation position 2. After auscultating the target auscultation position 2, the user is prompted to move the auscultation device from the current position to position 3, and so on, until all the target auscultation positions corresponding to the actual auscultation positions of the subject have been auscultated.
[0069] For example, preset movement directions can be generated for auscultating any two target auscultation positions of the same auscultation item in any order, and the auscultation order can be associated with the corresponding preset movement directions. If the target auscultation positions of a certain auscultation item include positions 5 and 6, the starting position of the auscultation item and the preset movement direction 5 for position 5 can be generated in advance, and the preset movement direction 5 can be associated with position 5. Similarly, the starting position of the auscultation item and the preset movement direction 6 for position 6 can be generated in advance, and the preset movement direction 6 can be associated with position 6. Furthermore, a preset movement direction 7 for moving from position 5 to position 6 can be generated in advance, and the preset movement direction 7 can be associated with the position movement information from position 5 to position 6. Finally, a preset movement direction 8 for moving from position 6 to position 5 can be generated in advance, and the preset movement direction 8 can be associated with the position movement information from position 6 to position 5. Simultaneously, based on the degree of importance, the auscultation order of positions 5 and 6 is determined to be position 5 first, then position 6.
[0070] Thus, when the user does not select the auscultation order of the target auscultation positions, both positions 5 and 6 can be used as target auscultation positions, with position 5 being the first target auscultation position and position 6 being the second target auscultation position. When the auscultation device is detected at the first position indicated by the starting auscultation position of the item to be auscultated on the body part of the subject, a prompt message can be generated first according to the preset movement direction 5 associated with position 5 to prompt the user to move the auscultation device from the current position to position 5. After the measurement at position 5 is completed, a prompt message is generated again according to the preset movement direction 7 associated with the position movement information from position 5 to position 6 to prompt the user to move the auscultation device from the current position to position 6, thereby realizing the auscultation measurement of all target auscultation positions of the item to be auscultated.
[0071] When a user selects the auscultation order for the target auscultation location, such as auscultation location 6 followed by auscultation location 5, when the auscultation device is detected at the first position indicated by the starting auscultation location of the auscultation item on the body part of the object to be auscultated, a prompt message can be generated first according to the preset movement direction 6 associated with location 6 to prompt the user to move the auscultation device from the current position to location 6. After the measurement at location 6 is completed, a prompt message is generated again according to the preset movement direction 8 associated with the position movement information from location 6 to location 5 to prompt the user to move the auscultation device from the current position to location 5. This enables the auscultation measurement of the auscultation item to be auscultated according to the user's selection.
[0072] The preset movement direction can be determined based on the vertical up-and-down movement direction and / or the horizontal left-and-right movement direction. In other words, when determining the movement route from the starting auscultation position to the target auscultation position, the shortest route is selected from the vertical up-and-down movement direction and the horizontal left-and-right movement direction. Because vertical up-and-down movement or horizontal left-and-right movement is relatively easy for any user to operate and will not result in deviation, this disclosure can assist users in quickly and accurately locating the target auscultation position of the auscultation item by using the starting auscultation position and the preset movement direction.
[0073] As Figure 6 Taking the initial auscultation position 61 and the target auscultation position 63 as examples, the preset movement direction can be as follows: Figure 6 As shown by the dashed arrow in the diagram. As mentioned earlier, the preset movement direction is determined based on the vertical up-and-down movement direction and the horizontal left-and-right movement direction. That is, it is not a direct direction from the starting auscultation position to the target auscultation position, so an intermediate position is needed, such as... Figure 6 The transit point is shown at position 62.
[0074] For example, when determining the auscultation location, the auscultator can be asked to first place the auscultation probe at the initial auscultation position on the body part to be auscultated, and then use left-right or up-down lateral movement indicators to assist the auscultator in finding the target auscultation location. For instance, when auscultating the mitral valve area, the user can be prompted to first place the auscultation probe in the left infraclavicular fossa (i.e., the initial auscultation position). Once the auscultation device is detected in the left infraclavicular fossa of the patient, the user can be prompted to move the auscultation device vertically downwards to below the nipple (i.e., the intermediate position). Once the auscultation device is detected in the corresponding intermediate position on the patient's body, the user can be prompted to move the probe horizontally to the right to reach the mitral valve auscultation location (i.e., the target auscultation location). Throughout the process, the user's operation can be guided through voice, text, and arrows indicating the direction of movement on the image.
[0075] In one exemplary implementation, audio standard data corresponding to each starting auscultation position can be pre-stored. When the auscultation audio currently acquired by the auscultation device in the body part of the subject to be auscultated is successfully matched with the audio standard data of the starting auscultation position, it is determined that the auscultation device has been detected at the first position in the body part of the subject to be auscultated corresponding to the starting auscultation position.
[0076] In another exemplary embodiment, visual markings can also be made on the auscultation device, such as drawing a triangle on the auscultation device. When the position of the captured triangle in the body part of the subject to be auscultated coincides with the first position indicated by the starting auscultation position, or when the distance between the position of the captured triangle in the body part of the subject to be auscultated and the first position indicated by the starting auscultation position is less than a preset distance, it is determined that the auscultation device is detected at the first position in the body part of the subject to be auscultated corresponding to the starting auscultation position.
[0077] In another exemplary embodiment, the coordinates of the starting position in the body part of the subject to be auscultated can be predetermined, and the coordinates of the auscultation device in the body part of the subject to be auscultated can be detected by the IMU of the auscultation device. When the current coordinates of the auscultation device detected by the IMU coincide with the coordinates of the starting position in the body part of the subject to be auscultated, or the difference between the two is less than a preset distance, it is determined that the auscultation device is detected at a first position in the body part of the subject to be auscultated corresponding to the starting auscultation position.
[0078] Of course, other methods can also be used to determine whether the auscultation device is detected at the first position corresponding to the starting auscultation position on the body part of the subject to be auscultated. This exemplary embodiment does not impose any special limitations on this.
[0079] In one exemplary embodiment, the starting auscultation position, the real-time position of the auscultation device, the target auscultation position, and the preset movement direction may also be displayed in the human body diagram; the human body diagram includes a reference human body diagram or a human body diagram obtained by photographing the body parts of the object to be auscultated.
[0080] For example, this disclosure allows the stethoscope to be equipped with a dedicated display screen, or the stethoscope to be wirelessly or wiredly connected to terminals with display screens such as mobile phones or computers. The display screen can show a diagram of the human body, and the aforementioned starting auscultation position, target auscultation position, and preset movement direction at the corresponding body location within the diagram. It can also display the real-time position of the auscultation device. In this way, images can more objectively assist the user in determining the auscultation position.
[0081] One approach is to embed an IMU (Inertial Measurement Unit) sensor within the auscultation device, specifically the auscultation probe. After the patient places the probe in the initial auscultation position, the IMU sensor detects the horizontal and vertical movement direction and distance of the probe, thereby determining its real-time position and displaying it in a human anatomy diagram. Figure 6 The current probe position 64 is displayed to indicate to the user that it is easier to find the target auscultation location.
[0082] In one exemplary embodiment, the human body diagram may include a pre-configured standard reference human body diagram, or it may include a real human body diagram of the person to be auscultated. For example, before starting auscultation, the body parts of the person to be auscultated may be photographed to obtain an image including the body parts of the person to be auscultated, and the image may be determined as the human body diagram displayed on the display screen.
[0083] In step S330, the positional movement of the auscultation device under the instruction of the second prompt information is detected, and the candidate auscultation position is determined based on the detected positional movement result of the auscultation device.
[0084] For example, the auscultator can start moving the auscultation device based on the initial auscultation position according to the second prompt information mentioned above, and determine the auscultation position that the auscultator considers correct, i.e., the candidate auscultation position, based on the result of the movement.
[0085] In other words, after the second prompt information is generated, the person listening to the auscultation can move the auscultation device according to the instructions of the second prompt information, thereby changing the position of the auscultation device. The aforementioned terminal or electronic stethoscope can detect the position movement of the auscultation device and determine the candidate auscultation position based on the detected position movement result.
[0086] For example, the IMU unit of the stethoscope can detect the movement of the stethoscope in response to the second prompt. The IMU sensor can detect the horizontal and vertical movement direction and distance of the stethoscope, thereby determining its current position within the body part of the patient being examined in real time, thus obtaining the positional movement information. When the stethoscope stops moving, the positional movement result is determined. If the position of the stethoscope does not change within a preset time period, it can be determined that the stethoscope has stopped moving. Based on the position of the stethoscope when it stops moving, the positional movement result is determined, and this position is then identified as a candidate auscultation location.
[0087] For example, visual markers can be added to the stethoscope, such as drawing a triangle on it. The position of the stethoscope can be detected by observing the changes in the triangle's position within the body part of the patient. The position of the stethoscope is determined when the triangle stops moving. If the triangle's position remains unchanged for a preset time period, it is considered to have stopped moving. Based on the triangle's position at the point of cessation, the position of the stethoscope is determined and identified as a candidate auscultation location.
[0088] Of course, other methods can also be used to detect the positional movement of the auscultation device under the instruction of the second prompt information, and the candidate auscultation position can be determined based on the positional movement result of the auscultation device. This exemplary embodiment does not impose any special limitations on this.
[0089] In one exemplary embodiment, at least one candidate auscultation location in this disclosure is determined by the auscultator based on... Figure 3 The steps shown are determined, for example, when the auscultator first places the stethoscope in the body part of the person to be auscultated according to the items to be auscultated, it can be based on... Figure 3 The steps shown assist the user in determining candidate auscultation locations. When the auscultator adjusts the candidate auscultation locations based on the adjustment prompts generated in subsequent step S230, they can also... Figure 3 The steps shown help users redetermine candidate auscultation locations. Alternatively, these steps can be performed each time a candidate auscultation location is determined. Figure 3 The steps shown help users determine candidate auscultation locations, and this exemplary embodiment does not impose any special limitations on them.
[0090] Through steps S310 to S330 described above, the initial auscultation position and preset movement direction can assist the auscultator in quickly and accurately finding the target auscultation position. Since the auscultation position movement is performed manually, and each person being auscultated has a different body size, the target auscultation position found by the auscultator may not be accurate. Therefore, the auscultator's perceived target auscultation position can be first determined as a candidate auscultation position, and then, according to subsequent steps S220 to S240, the actual auscultation position used for auscultation can be determined.
[0091] For example, one specific implementation of step S210 may include: acquiring candidate auscultation audio data at the candidate auscultation location after confirming that the auscultation device is placed at the candidate auscultation location.
[0092] In one exemplary implementation, confirming that the auscultation device is placed at a candidate auscultation position includes: confirming that the auscultation device is placed at a candidate auscultation position in response to a triggering operation of a first control for confirming the candidate auscultation position; or confirming that the auscultation device is placed at a candidate auscultation position in response to the auscultation device being in the same auscultation position for a preset duration; or confirming that the auscultation device is placed at a candidate auscultation position in response to a triggering operation of a start measurement control.
[0093] For example, a first control can be configured on the stethoscope or display screen to confirm that the patient has placed the stethoscope at what they believe to be the correct target auscultation location (i.e., the candidate auscultation location) according to the prompts. When the patient believes they have placed the stethoscope at the correct target auscultation location, the first control can be triggered, such as by clicking or double-clicking it. When the first control is triggered, it confirms that the stethoscope has been placed at the candidate auscultation location. Alternatively, when the patient believes they have placed the stethoscope at the correct target auscultation location, they can keep the stethoscope in that position. If the position of the stethoscope remains unchanged for a preset time period, such as 0.5 seconds, it can be confirmed that the stethoscope has been placed at the candidate auscultation location, and this position is determined as the candidate auscultation location. Alternatively, when the auscultator believes that they have placed the auscultation device at the correct target auscultation location according to the prompts, they can trigger the start measurement control to request that the measurement be started based on that location. Therefore, when the start measurement control is triggered, it can be assumed that the auscultation device has been placed at the candidate auscultation location.
[0094] In one exemplary implementation, after the auscultator determines the candidate auscultation position for the first time according to the above steps S310 to S330 during a certain auscultation process, the first control is triggered to confirm the candidate auscultation position. When the candidate auscultation position is subsequently adjusted and updated, it is not necessary to trigger the first control again. Instead, it is detected whether the placement time of the auscultation device at a certain position is greater than the preset time. If so, the position is automatically confirmed as the candidate auscultation position, thereby obtaining the candidate auscultation audio data at the candidate auscultation position, so as to continue to execute the subsequent steps S220 to S230.
[0095] In another exemplary implementation, after the auscultator determines the candidate auscultation position for the first time according to the above steps S310 to S330 during a certain auscultation process, the candidate auscultation position is confirmed by triggering the start measurement control. When the candidate auscultation position is subsequently adjusted and updated, it is not necessary to trigger the start measurement control again. Instead, it is detected whether the placement time of the auscultation device at a certain position is greater than the preset time. If so, the position is automatically confirmed as the candidate auscultation position, thereby obtaining the candidate auscultation audio data at the candidate auscultation position, so as to continue to execute the subsequent steps S220 to S230.
[0096] Once it is confirmed that the auscultation equipment has been placed at the candidate auscultation location, the auscultation audio data obtained at the candidate auscultation location can be acquired and used as the candidate auscultation audio data. Simultaneously, valid signal detection can be performed on the candidate auscultation audio data to determine whether it contains valid signal data.
[0097] For example, the signal-to-noise ratio (SNR) of candidate auscultation audio data can be calculated to determine whether it contains valid signal data. Alternatively, a pre-set machine learning model can be used to identify valid signals in the candidate auscultation audio data to determine whether it contains valid signal data. Furthermore, the extreme points of the Fast Fourier Transform (FFT) curve of the envelope of the candidate auscultation audio data can be used to determine whether it contains valid signal data. For example, taking heart sounds or lung sounds as an example, the envelope of the candidate auscultation audio can be obtained using methods such as Hilbert transform and RMS (Root Mean Square), and FFT calculation can be performed on the envelope. The extreme points of the FFT curve can be analyzed to determine whether the effective heart rate and respiratory rate can be calculated from the frequency response curve of the envelope. Alternatively, the distance between the candidate auscultation location and the target auscultation location can be used to determine whether it contains valid signal data. Of course, other methods can also be used to determine whether the candidate auscultation audio data contains valid signal data, and this exemplary embodiment does not impose any special limitations on this.
[0098] In another exemplary embodiment, the candidate auscultation position may also include the position directly placed by the auscultator. For example, if the auscultator does not place the auscultation device on the body part of the subject according to the first and second prompts, but directly places the auscultation device on position C on the body part of the subject, and considers position C to be the correct auscultation position, then position C is the candidate auscultation position.
[0099] Based on this, an exemplary embodiment of step S210 may include: acquiring auscultation audio data at the current location of the auscultation device, and determining the auscultation audio data at the current location as candidate auscultation audio data. In other words, the current location of the auscultation device can be used as a candidate auscultation location, thereby directly acquiring the auscultation audio data at the current location and using it as candidate auscultation audio data. That is, in this disclosure, it is also possible not to confirm whether the auscultation device has been placed at a candidate auscultation location, but to directly acquire the auscultation audio data at the current location of the auscultation device and use it as candidate auscultation audio data.
[0100] In step S220, if it is determined that the candidate auscultation audio data contains valid signal data, the valid signal quality of the candidate auscultation audio data is determined.
[0101] The effective signal data is determined based on the item to be auscultated. For example, if the item to be auscultated is heart sounds, then the effective signal data is the heart sound audio data; if the item to be auscultated is lung sounds, then the effective signal data is the lung sound data.
[0102] In one exemplary embodiment, determining that the candidate auscultation audio data contains valid signal data includes: determining that the candidate auscultation audio data contains valid signal data when the signal-to-noise ratio of the candidate auscultation audio data is greater than a first preset value; or determining that the candidate auscultation audio data contains valid signal data when the recognition result of the candidate auscultation audio data by a preset machine learning model indicates that the candidate auscultation audio data contains valid signal data; or performing a fast Fourier transform on the candidate auscultation audio data, and determining that the candidate auscultation audio data contains valid signal data when the extreme point of the Fourier transform curve satisfies a preset condition; or determining the distance between the candidate auscultation position and the target auscultation position of the item to be auscultated, and determining that the candidate auscultation audio data contains valid signal data when the distance is less than a preset valid signal distance.
[0103] The method for determining the distance between a candidate auscultation location and the target auscultation location can include: pre-collecting the first signal intensity of different candidate auscultation locations and the second signal intensity of the target auscultation location from a sufficient number of samples; determining the signal intensity difference between the first signal intensity of different candidate auscultation locations and the second signal intensity of the target auscultation location, as well as the distance between different candidate auscultation locations and the target auscultation location; and establishing a mapping relationship between the signal intensity difference and the distance based on the collected data. In this way, the signal intensity difference between the current candidate auscultation location and the target auscultation location can be substituted into the above mapping relationship to determine the distance between the current candidate auscultation location and the target auscultation location. Alternatively, pre-collecting the first signal intensity of different candidate auscultation locations of a sufficient number of samples from auscultation locations, as well as the distance between the candidate auscultation location and the target auscultation location, allows the distance to the target auscultation location to be determined based on the currently collected signal intensity.
[0104] Furthermore, the accuracy of the movement direction can be determined based on changes in the acquired signal strength. For example, a gradual increase in signal strength indicates the movement is moving closer to the target auscultation location, while a decrease indicates it is moving further away. Alternatively, the movement direction can be determined by changes in the signal strength difference between the current candidate auscultation location and the target auscultation location. For instance, a decrease in the signal strength difference indicates the movement is moving closer to the target auscultation location, while an increase indicates it is moving further away.
[0105] By collecting signal strength as described above, the current auscultation position of the auscultation device can be determined, thereby providing corresponding instructions or identifying the candidate auscultation position of the auscultation device during its movement.
[0106] For example, determining that the candidate auscultation audio data does not contain valid signal data includes: determining that the candidate auscultation audio data does not contain valid signal data when the signal-to-noise ratio of the candidate auscultation audio data is less than or equal to a first preset value; or determining that the candidate auscultation audio data does not contain valid signal data when the recognition result of the candidate auscultation audio data by the preset machine learning model indicates that the candidate auscultation audio data does not contain valid signal data; or performing a fast Fourier transform on the candidate auscultation audio data, and determining that the candidate auscultation audio data does not contain valid signal data when the extreme point of the Fourier transform curve does not meet the preset condition; or determining the distance between the candidate auscultation position and the target auscultation position of the item to be auscultated, and determining that the candidate auscultation audio data does not contain valid signal data when the distance is greater than or equal to a preset valid signal distance.
[0107] The extreme points of the Fourier transform curve must meet the following preset conditions: the difference between the extreme point and the values of other points must be greater than a preset value, and the extreme point must appear within a preset frequency range. For example, the value of the extreme point must exceed the values of other points by a certain multiple, and the extreme point must appear within a reasonable frequency range.
[0108] In one exemplary implementation, determining the effective signal quality of the candidate auscultation audio data includes: determining the effective signal quality of the candidate auscultation audio data based on the signal-to-noise ratio of the candidate auscultation audio data, and / or based on the energy proportion of the effective signal data in the candidate auscultation audio data.
[0109] For example, the signal-to-noise ratio (SNR) of candidate auscultation audio data can be calculated, and the SNR value can be determined as the effective signal quality value. Alternatively, the energy proportion of effective signal data in the candidate auscultation audio data can be calculated, and this ratio can be determined as the effective signal quality. Furthermore, after calculating the SNR and the energy proportion of effective signal data, they can be normalized to the same numerical range, and then a weighted average can be taken of the normalized values to determine the effective signal quality.
[0110] For example, Figure 7 This diagram illustrates a flowchart of a signal-to-noise ratio calculation method based on filtering and noise reduction according to an exemplary embodiment of this disclosure. (See reference) Figure 7 The method may include steps S710 to S740. Specifically: in step S710, candidate auscultation audio data is truncated to obtain candidate auscultation audio segments of length n; in step S720, the candidate auscultation audio segments are filtered to obtain a filtering result; in step S730, the filtering result is denoised to obtain a target signal segment; and in step S740, the signal-to-noise ratio of the candidate auscultation audio data is determined based on the target signal segment and the candidate auscultation audio segments.
[0111] For example, a window function of length n can be used to extract candidate auscultation audio data in real time to obtain candidate auscultation audio segments x(n). After filtering and denoising x(n), the signal y(n) is obtained. Then, the signal-to-noise ratio is calculated using the following formula (1):
[0112]
[0113] The filtering module sets a passband range for the type of signal to be measured. For example, one exemplary passband range is: heart sounds 20Hz-200Hz, lung sounds 100Hz-500Hz; another exemplary passband range is: heart sounds 20Hz-1000Hz, lung sounds 20Hz-2000Hz. The denoising module includes, but is not limited to, using: LMS (Least Mean Square) adaptive noise reduction, differential noise reduction combined with multiple microphones, wavelet denoising, etc.
[0114] For example, Figure 8 This diagram illustrates a flowchart of a signal-to-noise ratio (SNR) calculation method based on signal envelope, according to an exemplary embodiment of this disclosure. (See reference...) Figure 8 The method may include steps S810 to S850. Specifically: in step S810, audio data of duration t is extracted from the candidate auscultation audio data; in step S820, the envelope of the extracted audio data is calculated; and in step S830, the amplitude of the signal's maximum point is calculated. In step S840, based on the magnitude of the maximum point... Calculate the amplitude hnoise at the noise location; in step S850, calculate the signal-to-noise ratio based on the amplitude hsig at the maximum point and the amplitude hnoise at the noise location.
[0115] For example, during auscultation, for candidate auscultation audio data, a segment of audio data with a duration of t can be extracted (t must be greater than the period of the candidate auscultation audio data to ensure that the extracted audio data includes at least one complete signal period). The envelope e(i) of the audio data segment with a duration of t is calculated. The methods for calculating the envelope e(i) include Hilbert transform, RMS, etc. Based on the envelope, the extreme points of the extracted audio data are calculated, and the amplitude is... Select both sides of the extreme point The duration of the signal is used as a signal segment. Based on... The slope threshold is used to determine the location of the noise segment; for example, the segment closest to the left of the extreme point and with an amplitude less than [value missing]. And left and right The average slope over the time period is less than The point is the noise point, and the left and right sides of the noise point are... The signal during the time period is considered a noise segment. The signal-to-noise ratio is determined using the following formula (2):
[0116]
[0117] In another exemplary embodiment, the energy P of the effective signal component can be obtained by methods such as wavelet decomposition and EMD (Empirical Mode Decomposition). S and noise signal component P N The signal-to-noise ratio is calculated using the following formula (3):
[0118]
[0119] For example, regarding the energy proportion of effective signal data, depending on the auscultation item, the types of signals included in the auscultation signal include heart sounds, lung sounds, device noise floor, and environmental noise, etc., and the frequency ranges of different signals are different. After performing FFT transformation on the candidate auscultation audio data, the amplitude of each frequency component is obtained. The energy percentage of the effective signal data can be calculated by taking the ratio of the effective signal frequency component to the total energy of the entire frequency band. The effective signal is determined based on the auscultation item; for example, if the auscultation item is heart sound, the effective signal is the heart sound signal; if the auscultation item is lung sound, the effective signal is the lung sound signal. For instance, the energy percentage of the effective signal data can be calculated using the following formula (4):
[0120]
[0121] In formula (4), sr Sampling rate, and These are the lower and upper limits of the effective signal frequency range, respectively. As mentioned earlier, for example, the frequency range of lung sound signals is 100Hz-500Hz, and the frequency range of heart sound signals is 20Hz-200Hz, which can be pre-configured based on experience.
[0122] In another exemplary embodiment, the energy P of the effective signal component is also obtained by methods such as wavelet decomposition and EMD decomposition. S Then, the energy percentage of the effective signal data is calculated using the following formula (5):
[0123]
[0124] In formula (5), P T The total energy of the candidate auscultation audio data.
[0125] In one exemplary implementation, if it is determined that the candidate auscultation audio data does not contain valid signal data, noise is identified in the candidate auscultation audio data, and reference adjustment prompt information for adjusting the candidate auscultation position is generated based on the identified noise.
[0126] The reference adjustment prompts include one or more of the following: Please take the measurement in a quiet environment; Please hold the stethoscope steadily; Please avoid friction between the stethoscope and clothing; Please avoid direct contact with the skin during measurement; Please reposition the stethoscope.
[0127] For example, if the candidate auscultation audio data does not contain valid signal data, a prompt message can be generated to indicate the reason for the measurement failure to the auscultator, allowing the auscultator to adjust the measurement process and retake the measurement based on the reason for the failure. Reasons for measurement failure provided to the auscultator include, but are not limited to: being in a noisy environment, prompting the user to measure in a quiet environment; excessive friction between the hand and the probe during the test, prompting the user to hold the stethoscope steadily; excessive friction between the probe and clothing or skin during the test, prompting the user to avoid friction between the probe and clothing, or to measure directly against the skin; the test site being too far from the designated auscultation point, prompting the user to refer to the reference diagram and reposition the probe.
[0128] For example, machine learning or deep learning methods can be used to identify the main sound type in the audio file when no effective heart and lung sound signal is detected. This can be one or more of the following: environmental interference, friction sound between the hand and the probe, friction sound between clothing and the probe, or electrical noise of human skin. Based on the noise type, accurate prompts can be given for the above reasons.
[0129] For example, audio signals corresponding to the different causes mentioned above can be pre-collected, and each audio signal can be labeled to generate a training dataset. This training dataset can then be used to train an initial classification machine learning model to obtain a target machine learning model. The target machine learning model can then be used to identify the collected audio signals, determining which category of noise they belong to, and generating corresponding prompts based on the noise category.
[0130] Continue to refer to Figure 2 In step S230, if the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, an adjustment prompt message for the candidate auscultation position is generated, and the candidate auscultation position is updated based on the adjustment prompt message until the effective signal quality of the candidate auscultation audio data at the candidate auscultation position is greater than the preset signal quality threshold. The actual auscultation position for auscultating the item to be auscultated is determined based on the current candidate auscultation position.
[0131] For example, different signal quality thresholds can be set for different signal qualities. If signal quality is determined based on the signal-to-noise ratio (SNR), the preset signal quality threshold can be a second preset value. If the SNR is less than the second preset value, the signal quality is considered poor, and the user is reminded to adjust the candidate auscultation position. The second preset value is greater than the first preset value used to determine whether valid signal data is included; that is, the SNR threshold for measuring whether a valid signal is included is less than the SNR threshold for measuring the quality of the valid signal. If signal quality is determined based on the energy percentage of valid signal data, the preset signal quality threshold can be a third preset value. If the energy percentage of valid signal data is less than the third preset value, the currently acquired auscultation audio data signal quality is considered poor, and the user is reminded to adjust the candidate auscultation position.
[0132] In one exemplary embodiment, the method for determining the preset signal quality threshold includes: pre-collecting signals from a first preset collection point in the body part of the subject to be auscultated, and determining the preset signal quality threshold corresponding to the subject to be auscultated based on the audio signal from the first preset collection point, wherein the noise included in the audio signal collected from the first preset collection point is greater than a second preset value; or pre-collecting signals from a second preset collection point in the body part of the subject to be auscultated, and determining the preset signal quality threshold corresponding to the subject to be auscultated based on the effective signal quality weighting value of each second preset collection point, wherein the noise included in the audio signal collected from the second preset collection point is less than a third preset value, wherein the third preset value is less than or equal to the second preset value.
[0133] For example, a pre-acquisition process can be added, requesting the auscultator to collect audio data at easily identifiable locations on the body of the person to be auscultated. Based on the collected audio data, a noise ratio threshold or effective signal energy ratio threshold suitable for the person to be auscultated can be calculated. This threshold can then be used to assess the signal quality of the auscultated audio obtained when auscultating the person. For instance, before collecting effective heart and lung sounds, a "pre-acquisition" step can be performed, selecting easily understood locations for acquisition, such as the bilateral infraclavicular fossa, medial nipple, bilateral axillae, lateral upper arm, and anterior lower leg. During the acquisition process, the corresponding locations on the schematic image are highlighted sequentially, and the user is requested to measure these locations sequentially as prompted. This measurement is used to calculate the threshold, and the calculated threshold is then used to assess the quality of the user's heart and lung sound signal.
[0134] The first preset acquisition point can include a point that is easy to locate and where the audio signal acquired from that point consists only of human skin contact noise, or a point that is easy to locate and where the audio signal acquired from that point is mostly human skin contact noise. Examples include auscultation locations such as the outer side of the upper arm and the front of the lower leg. Based on the first preset acquisition point, the noise floor used to evaluate the auscultation signal can be obtained, such as the aforementioned P.N For example, the background noise of the object to be auscultated is obtained by weighted average of the noise signals collected at each of the first preset acquisition points, and the signal-to-noise ratio threshold or the effective signal energy ratio threshold of the object to be auscultated is determined based on the background noise.
[0135] For example, a corresponding standard noise ratio threshold or standard effective signal energy ratio threshold can be pre-configured based on a standard noise floor. Then, the ratio of the noise floor of the object to be auscultated to the standard noise floor is used as a scaling factor to adjust the standard noise ratio threshold or standard effective signal energy ratio threshold, thereby obtaining a signal-to-noise ratio threshold or effective signal energy ratio threshold that is suitable for the object to be auscultated. Generally, the higher the noise floor, the lower the corresponding signal-to-noise ratio threshold or effective signal energy ratio threshold.
[0136] The second preset acquisition point can include a location that is easy to locate and from which corresponding effective signals (such as heart sounds and lung sounds) can be acquired, such as the bilateral infraclavicular fossa, the inner side of the nipple, and the bilateral axillae, or other locations. Figure 9 The four points ①, ②, ③, and ④ are shown. For example, the signal-to-noise ratio (SNR) of each second preset acquisition point can be calculated: SNR1, SNR2, ..., SNR n Then, the signal-to-noise ratio threshold is determined using the following formula (6):
[0137]
[0138] In formula (6), The weight is determined based on the distance of each second preset acquisition point from the target auscultation location of the valid signal. For example, if the valid signal is a heart sound signal, the weight of the second preset acquisition point is greater the closer it is to the target auscultation location of the heart sound.
[0139] Similarly, the effective signal energy percentage of each second preset acquisition point can be calculated using a similar method, and the effective signal energy percentage threshold can be determined based on the weighted average of the effective signal energy percentages.
[0140] In another exemplary embodiment, target auscultation audio data can be collected at target auscultation locations in different human bodies under the guidance of professionals, and the effective signal quality of the target auscultation audio data can be determined. A preset signal quality threshold is determined based on the average effective signal quality threshold of the target auscultation audio data in different human bodies. For example, the preset signal quality threshold is determined by multiplying the average effective signal quality threshold of the target auscultation audio data in different human bodies by 0.9. In one exemplary embodiment of this disclosure, the signal quality score can be displayed in real time through an interactive interface, and a prompt and measurement start can be initiated when the signal quality meets the requirements. Figure 10As shown, the current test point and signal quality score can be highlighted. The signal quality score can be the signal-to-noise ratio (SNR) mentioned above, the energy percentage of the effective signal components, or a weighted calculation of both. Signal strength is displayed using the number of signal bars based on the signal quality score. Alternatively, halos or flashing lights can be used near the highlighted auscultation points to indicate signal strength; the higher the signal strength, the brighter the halo or the faster the flashing. Gradual increases in sound or voice prompts can also be used to inform the user of signal strength and whether the signal requirements have been met.
[0141] In one exemplary embodiment of this disclosure, when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, generating adjustment prompt information for the candidate auscultation position includes: generating prompt information for the adjustment range of the candidate auscultation position based on the difference between the effective signal quality of the candidate auscultation audio data and the preset signal quality threshold.
[0142] For example, the adjustment range of the stethoscope can be determined based on the difference between the current signal quality and the target signal quality (i.e., the preset signal quality threshold). When the difference is large, it is recommended that the stethoscope move a larger radius, and when the difference is small, it is recommended that the stethoscope move a smaller radius. For example, the adjustment range can be determined by the following formula (7):
[0143]
[0144] In formula (7), k This is an empirical coefficient. This is a signal-to-noise ratio (SNR) threshold used to evaluate signal quality, or another preset value larger than this SNR threshold. This represents the signal-to-noise ratio at the current candidate auscultation location.
[0145] In one exemplary embodiment of this disclosure, the adjustment range is displayed in a human body diagram, which includes a reference human body diagram or a human body diagram obtained by photographing the body parts of the subject to be auscultated; in response to the adjustment distance of the candidate auscultation position exceeding the adjustment range, a third prompt message is generated, which is used to prompt the adjustment range of the candidate auscultation position to be reduced or to return to the candidate auscultation position for readjustment.
[0146] For example, the suggested area for moving the stethoscope can be shown in a human body diagram, such as... Figure 11 As shown, this indicates the range of adjustment the user can make to the candidate auscultation position.
[0147] In one exemplary application scenario of this disclosure, the auscultation device includes an IMU sensor that can detect the distance the auscultation device moves in the horizontal and vertical directions. When the distance moved from the original auscultation position exceeds the recommended adjustment range, the device provides voice, text, or image prompts, asking the user to reduce the adjustment range or return to the original position to readjust.
[0148] In one exemplary embodiment of this disclosure, when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, generating adjustment prompt information for the candidate auscultation position includes: when the effective signal quality of the candidate auscultation audio data is less than the preset signal quality threshold, connecting and displaying an indicator arrow in a human body diagram pointing from the candidate auscultation position to the target auscultation position of the item to be auscultated, so as to generate adjustment prompt information for the candidate auscultation position.
[0149] For example, if the candidate auscultation audio data contains valid signal data, but the quality of the valid signal data is poor, it indicates that the distance between the candidate auscultation location and the target auscultation location is relatively short. Therefore, the user can be guided to move based on the arrows indicating the current candidate auscultation location and the target location. Figure 12 As shown, the arrow connecting the current auscultation position 122 and the target auscultation position 121 instructs the auscultator to move the auscultation device in the direction of the arrow.
[0150] The process of updating the candidate auscultation position based on the adjustment result of the candidate auscultation position based on the indicator arrow can be understood as follows: in response to the auscultation device being moved based on the indicator arrow and the auscultation device being in the same auscultation position for a preset period of time, the position is updated as the candidate auscultation position.
[0151] For example, after updating the candidate auscultation location, steps S210 to S220 can be repeated to recalculate the effective signal quality at the updated candidate auscultation location. If the signal quality of the candidate auscultation audio data corresponding to the current updated candidate auscultation location is less than a preset signal quality threshold, then step S230 is executed until the effective signal quality of the candidate auscultation audio data corresponding to the current updated candidate auscultation location is greater than or equal to the preset signal quality threshold, thereby determining the actual auscultation location for auscultating the item based on the current updated candidate auscultation location.
[0152] For example, after determining the actual auscultation location for auscultating the item to be auscultated, a fourth prompt message can be generated, which is used to instruct the auscultation of the item to be auscultated according to the actual auscultation location; and to record the actual auscultation audio data obtained based on the actual auscultation location.
[0153] For example, if the effective signal quality of the current candidate auscultation location is greater than or equal to a preset signal quality threshold, the candidate auscultation location can be determined as the actual auscultation location. Auscultation measurements of the items to be auscultated can then be performed based on the actual auscultation location, and the acquired auscultation audio data can be recorded and saved to facilitate further analysis and processing of the auscultation results.
[0154] In other words, when the user moves the stethoscope, the signal quality score and signal quality icon displayed on the graphical user interface can be calculated and refreshed based on the movement result, so as to adjust the prompt signal according to the signal quality. When the signal quality score is higher than a certain threshold, the user can be prompted that the signal quality is good, the measurement is starting, and the auscultation audio acquired by the measurement is automatically recorded. Alternatively, the user can be prompted that the measurement can start and whether to record the auscultation audio. The recording of auscultation audio data is determined based on the user's selection. This exemplary embodiment does not impose any special limitations on this.
[0155] In one exemplary embodiment, the step of generating adjustment prompt information for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, and updating the candidate auscultation position based on the adjustment prompt information, includes: generating adjustment prompt information for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold; detecting the positional change of the auscultation device under the instruction of the adjustment prompt information; and updating the candidate auscultation position according to the detection result.
[0156] For example, after generating adjustment prompts, the person listening to the auscultation can move the auscultation device according to the instructions in the prompts, thereby changing the position of the auscultation device. The aforementioned terminal or electronic stethoscope can detect the position movement of the auscultation device and update the candidate auscultation position based on the detected position movement results.
[0157] For example, the IMU unit of the stethoscope can detect the movement of the stethoscope in response to adjustment prompts. The IMU sensor can detect the horizontal and vertical movement direction and distance, thus determining the stethoscope's current position within the body part to be listened to in real time. When the stethoscope's position stops changing, the result of its movement is determined. If the stethoscope's position does not change within a preset time period, it is determined that the stethoscope has stopped moving. Based on the position of the stethoscope at the time of cessation, the result of the movement based on the adjustment prompts is determined, and this position is then identified as a new candidate auscultation location.
[0158] For example, visual markers can be added to the auscultation device, such as drawing a triangle on it. Based on the captured image of the triangle's position within the body part of the patient being auscultated, the device's positional movement is detected in response to adjustment prompts. When the triangle's position stops changing, the positional movement of the auscultation device under the adjustment prompts is determined. If the triangle's position does not change within a preset time period, it is determined that the triangle has stopped moving. Based on the triangle's position when it stops moving, the position of the auscultation device under the adjustment prompts is determined, and this position is then identified as a new candidate auscultation location.
[0159] Of course, other methods can also be used, such as the method in the foregoing embodiment based on the collected signal strength, to detect the positional change of the stethoscope under the instruction of the adjustment prompt information. This exemplary embodiment does not specifically limit this method. Figure 13 A flowchart illustrating another method for determining the auscultation location according to an exemplary embodiment of this disclosure is shown. (See reference) Figure 13 The method may include steps S1310 to S1390. Specifically: in step S1310, in response to the user's selection operation, the item to be auscultated is determined; in step S1320, the user is prompted to place the auscultation device in the recommended auscultation position shown in the human anatomy diagram; in step S1330, the auscultation audio at the user-placed auscultation position is acquired; in step S1340, it is determined whether the acquired auscultation audio contains a valid signal; if so, proceed to step S1350, otherwise proceed to step S1390; in step S1350, the valid signal quality of the acquired auscultation audio is calculated; in step S1... In step 360, it is determined whether the effective signal quality is greater than the preset signal quality threshold. If so, proceed to step S1370; otherwise, proceed to step S1380. In step S1370, the user is prompted that the current auscultation position is accurate and to perform auscultation measurement based on the current auscultation position. In step S1380, an adjustment prompt message is generated to prompt the user to adjust the measurement position, and then proceed to step S1330. In step S1390, the reason for the measurement failure is indicated, and the user is prompted to adjust the measurement process and re-determine the auscultation position, and then proceed to step S1330.
[0160] In another exemplary embodiment, another method for determining the auscultation location in this disclosure may include: upon confirming that the auscultation device is placed at a candidate auscultation location, acquiring candidate auscultation audio data at the candidate auscultation location; determining the signal quality of the candidate auscultation audio data; if the signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, generating adjustment prompt information for the candidate auscultation location, updating the candidate auscultation location based on the adjustment prompt information, until the effective signal quality of the candidate auscultation audio data at the candidate auscultation location is greater than or equal to the preset signal quality threshold, and determining the actual auscultation location for auscultating the item to be auscultated based on the current candidate auscultation location.
[0161] The methods for confirming that the auscultation device is placed at the candidate auscultation position, the methods for determining at least one candidate auscultation position, the methods for determining signal quality (refer to the methods for determining effective signal quality), and the methods for determining the preset signal quality threshold have been described in the foregoing embodiments and will not be repeated here.
[0162] In other words, this disclosure allows for the direct determination of the signal quality of candidate auscultation audio data, without needing to determine the signal quality only after confirming that the candidate auscultation audio data contains valid signal data. In one exemplary application scenario, the auscultation location can be determined based on video or images. For example, a user can use the camera of a mobile phone or other device to capture an image of the area to be auscultated; if the area is the heart, an image of the upper body of the person to be auscultated can be captured. Alternatively, real-time video auscultation can be performed using a mobile phone or other device, allowing for the identification of human body features and the current position of the auscultation device based on the image.
[0163] It should be noted that, without conflict, the technical features and solutions in the other embodiments described above can be combined with or replaced with the technical solutions and features in this embodiment, including but not limited to any of the aforementioned solutions regarding how to prompt the user, how to determine the direction of movement, and how to determine the location of the auscultation device.
[0164] For example, Figure 14 This diagram illustrates a video-based auscultation location determination method according to an exemplary embodiment of this disclosure. (See reference...) Figure 14The method may include steps S1401 to S1407. Specifically: In step S1401, the user is requested to enable the video-assisted auscultation function; in step S1402, after successful activation, the location of the human features of the object to be auscultated and the current position of the auscultation device are identified and represented on the image of the object; in step S1403, the user is prompted to select the auscultation item; in step S1404, it is determined whether the current position of the auscultation device is within a reasonable range; if so, proceed to step S1405, otherwise proceed to step S1408; in step S1405, it is determined whether the signal quality at the current position reaches a preset signal quality threshold; if so, proceed to step S1406, otherwise proceed to step S1407; in step S1406, the user is prompted that the current position is accurate and the signal quality is qualified, and to begin auscultation measurement; in step S1407, the user is prompted to fine-tune the position of the auscultation device; in step S1408, the user is prompted to adjust the auscultation position.
[0165] For example, in video consultations, users can be asked to enable video-assisted positioning. After enabling this function, the system can identify the location of human features and the current auscultation position in the captured image. For instance, machine learning or deep learning algorithms can be used to identify human feature points, lines, and regions, including but not limited to: the suprasternal notch, supraclavicular fossa, infraclavicular fossa, sternal line, anterior midline, midclavicular line, interscapular region, suprascapular region, scapular region, posterior midline, infrascapular region, scapular line, anterior axillary line, axilla, midaxillary line, posterior axillary line, oblique fissure, lower border of the left lung, and lower border of the right lung. The probe position can also be identified using machine learning or deep learning algorithms. Visual markings on the probe can assist the algorithm in accurately identifying its position; for example, adding a special pattern to the probe and determining the probe's location based on the position of the captured pattern.
[0166] After the user selects a specific auscultation item, the system obtains the target auscultation location for that item. It then calculates the relative distance between the target location and the current auscultation location to determine if the auscultation device is within a reasonable range. If not, the user is prompted to adjust the measurement location. If so, the signal quality of the auscultated audio obtained at the current location is calculated. If the signal quality is lower than a preset signal quality threshold, the user is prompted to fine-tune the auscultation location. Fine-tuning involves moving the device a small distance in each direction from the current location, and the system re-checks the location after each movement to ensure it is within a reasonable range. When the location is within a reasonable range and the signal quality reaches the preset signal quality threshold, the user is informed that the auscultation is normal and subsequent operations such as auscultation measurement or recording can proceed.
[0167] Signal quality can be determined by the signal-to-noise ratio or the energy proportion of the effective signal components, or by a weighted sum of the two.
[0168] In one exemplary implementation, the relative distance between a target auscultation location and the current auscultation location can be calculated using human feature points. For example, the coordinates of the target auscultation location and a first relative distance to the human feature points can be pre-stored. Then, a second relative distance between the coordinates of the current auscultation location and the human feature points can be calculated. Finally, the relative distance between the target auscultation location and the current auscultation location can be calculated based on the first and second relative distances.
[0169] In another exemplary implementation, the critical distance at which a valid signal can be measured can be determined in advance through experiments, a reasonable range can be determined based on the critical distance, and the reasonable range can be displayed in the interactive interface.
[0170] In one exemplary implementation, when the relative distance between the target auscultation position and the current auscultation position is within a reasonable range, the auscultation position is considered to be reasonably positioned, and the auscultation signal quality can be determined. When the relative distance exceeds the reasonable range, the auscultation position is considered to deviate significantly from the target position, and the user is prompted to move the auscultation probe and adjust the measurement position.
[0171] In one application scenario, as mentioned above, an arrow connecting the probe placement position and the target auscultation position can guide the user in the direction to move the auscultation device.
[0172] In another application, the auscultation device or the system carrying the auscultation device includes an IMU sensor. The IMU sensor can be used to calculate the direction and distance of movement of the auscultation device, thus determining its current auscultation position. This can be combined with a vision-based probe position recognition method to update and display the current position of the auscultation device in real time. For example, the first position coordinates determined by the IMU and the second position coordinates determined by the vision-based method are weighted to determine the current position coordinates of the auscultation device, thereby obtaining its current location.
[0173] In one exemplary implementation, the currently determined actual auscultation location can also be saved. This way, when the user performs auscultation next time, the actual auscultation location can be directly recommended to the user to improve auscultation efficiency.
[0174] In this disclosure, by testing the effectiveness and quality of auscultation signals, non-professional users and inexperienced medical practitioners can be assisted in finding accurate auscultation locations, ensuring auscultation effectiveness, avoiding misdiagnosis, and improving the accuracy of auscultation location determination.
[0175] Furthermore, by providing guidance on the adjustment range and determination method of candidate auscultation locations, the efficiency of auscultation location determination can be improved.
[0176] It should be noted that the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of this disclosure, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.
[0177] Further reference Figure 15 As shown, this example embodiment also provides an auscultation location determination device 1500, which may include a candidate auscultation audio data acquisition module 1510, a signal quality determination module 1520, and an actual auscultation location determination module 1530. Wherein:
[0178] The candidate auscultation audio data acquisition module 1510 is configured to acquire candidate auscultation audio data at the candidate auscultation location;
[0179] The signal quality determination module 1520 is configured to determine the effective signal quality of the candidate auscultation audio data when it is determined that the candidate auscultation audio data contains effective signal data, wherein the effective signal data is determined according to the auscultation item.
[0180] The candidate auscultation position adjustment and update module 1530 is configured to generate adjustment prompt information for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, so as to update the candidate auscultation position based on the adjustment prompt information until the effective signal quality of the candidate auscultation audio data at the candidate auscultation position is greater than the preset signal quality threshold.
[0181] The actual auscultation location for auscultating the item to be auscultated is determined based on the current candidate auscultation locations.
[0182] In one exemplary implementation, based on the foregoing embodiments, the candidate auscultation audio data acquisition module 1510 may be specifically configured to: acquire candidate auscultation audio data at the candidate auscultation location when it is confirmed that the auscultation device is placed at the candidate auscultation location, wherein the candidate auscultation location is determined according to the item to be auscultated; the method of confirming that the auscultation device is placed at the candidate auscultation location includes: confirming that the auscultation device is placed at the candidate auscultation location in response to a trigger operation of a first control for confirming the candidate auscultation location; or confirming that the auscultation device is placed at the candidate auscultation location in response to the auscultation device being in the same auscultation location for a preset time period; or confirming that the auscultation device is placed at the candidate auscultation location in response to a trigger operation of a start measurement control.
[0183] In one exemplary implementation, based on the foregoing embodiments, the method for determining at least one candidate auscultation location includes: in response to a selection operation of an item to be auscultated, generating a first prompt message for a starting auscultation location pre-associated with the item to be auscultated; in response to detecting the auscultation device at a first location indicated by the first prompt message in the body part of the object to be auscultated, generating a second prompt message for a preset movement direction pre-associated with the item to be auscultated; detecting the positional movement of the auscultation device under the indication of the second prompt message, and determining the candidate auscultation location based on the detected positional movement result of the auscultation device; wherein, the preset movement direction is used to indicate a movement route for moving the auscultation device from the first location in the body part of the object to be auscultated to a second location, the first location corresponds to the starting auscultation location, the second location corresponds to a target auscultation location pre-associated with the item to be auscultated, and the target auscultation location is determined based on the actual auscultation location of the item to be auscultated.
[0184] In one exemplary embodiment, based on the foregoing embodiments, the device 1500 further includes a display module, which can be configured to: display one or more of the following in a human body diagram: the initial auscultation position, the real-time position of the auscultation device, the target auscultation position, and the preset movement direction; the human body diagram includes a reference human body diagram or a human body diagram obtained by photographing the body parts of the object to be auscultated.
[0185] In one exemplary implementation, based on the foregoing embodiments, determining that the candidate auscultation audio data contains valid signal data includes: determining that the candidate auscultation audio data contains valid signal data when the signal-to-noise ratio of the candidate auscultation audio data is greater than a first preset value; or determining that the candidate auscultation audio data contains valid signal data when the recognition result of the candidate auscultation audio data by a preset machine learning model indicates that the candidate auscultation audio data contains valid signal data; or performing a fast Fourier transform on the candidate auscultation audio data, and determining that the candidate auscultation audio data contains valid signal data when the extreme point of the Fourier transform curve satisfies a preset condition; or determining the distance between the candidate auscultation position and the target auscultation position of the item to be auscultated, and determining that the candidate auscultation audio data contains valid signal data when the distance is less than a preset valid signal distance.
[0186] In one exemplary embodiment, based on the foregoing embodiments, the device 1500 further includes a measurement failure reason prompting module, which can be configured to: when it is determined that the candidate auscultation audio data does not contain valid signal data, perform noise identification on the candidate auscultation audio data, and generate reference adjustment prompt information for adjusting the candidate auscultation position based on the identified noise; the reference adjustment prompt information includes one or more of the following: please perform the measurement in a quiet environment, please hold the auscultation device stably, please avoid friction between the auscultation device and clothing, please avoid direct contact with the skin for measurement, and please reposition the auscultation device.
[0187] In one exemplary implementation, based on the foregoing embodiments, determining the effective signal quality of the candidate auscultation audio data includes: determining the effective signal quality of the candidate auscultation audio data based on the signal-to-noise ratio of the candidate auscultation audio data, and / or based on the energy proportion of the effective signal data in the candidate auscultation audio data.
[0188] In one exemplary implementation, based on the foregoing embodiments, the candidate auscultation position adjustment and update module 1530 may be specifically configured to: generate a prompt message indicating the adjustment range of the candidate auscultation position based on the difference between the effective signal quality of the candidate auscultation audio data and the preset signal quality threshold.
[0189] In one exemplary implementation, based on the foregoing embodiments, the display module may further be configured to: display the adjustment range in a human body diagram, the human body diagram including a reference human body diagram or a human body diagram obtained by photographing the body parts of the object to be auscultated; and generate a third prompt message in response to the adjustment distance of the candidate auscultation position exceeding the adjustment range, the third prompt message being used to prompt to reduce the adjustment range of the candidate auscultation position or return to the candidate auscultation position for readjustment.
[0190] In one exemplary implementation, based on the foregoing embodiments, the method for determining the preset signal quality threshold includes: pre-collecting signals from a first preset collection point in the body part of the subject to be auscultated, and determining the preset signal quality threshold corresponding to the subject to be auscultated based on the audio signal from the first preset collection point, wherein the noise included in the audio signal collected from the first preset collection point is greater than a second preset value; or pre-collecting signals from a second preset collection point in the body part of the subject to be auscultated, and determining the preset signal quality threshold corresponding to the subject to be auscultated based on the effective signal quality weighting value of each second preset collection point, wherein the noise included in the audio signal collected from the second preset collection point is less than a third preset value, wherein the third preset value is less than or equal to the second preset value.
[0191] In one exemplary implementation, based on the foregoing embodiments, when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, generating adjustment prompt information for the candidate auscultation position includes: when the effective signal quality of the candidate auscultation audio data is less than the preset signal quality threshold, connecting and displaying an indicator arrow in a human body diagram pointing from the candidate auscultation position to the target auscultation position of the item to be auscultated, thereby generating adjustment prompt information for the candidate auscultation position.
[0192] In one exemplary embodiment, based on the foregoing embodiments, the device 1500 further includes a recording module, which can be configured to: generate a fourth prompt message, the fourth prompt message being used to instruct the auscultation of the item to be auscultated according to the actual auscultation location; and record the actual auscultation audio data obtained based on the actual auscultation location.
[0193] In one exemplary implementation, based on the foregoing embodiments, the step of generating adjustment prompt information for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, and updating the candidate auscultation position based on the adjustment prompt information, includes: generating adjustment prompt information for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold; detecting the positional change of the auscultation device under the instruction of the adjustment prompt information; and updating the candidate auscultation position according to the detection result.
[0194] For example, another auscultation location determination device in this disclosure may include: a first candidate auscultation audio data acquisition module and an auscultation location determination module. Wherein:
[0195] The first candidate auscultation audio data acquisition module is configured to acquire candidate auscultation audio data at the candidate auscultation location when it is confirmed that the auscultation device is placed at the candidate auscultation location, wherein the candidate auscultation location is determined according to the item to be auscultated; the auscultation location determination module is configured to generate adjustment prompt information for the candidate auscultation location when the signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, so as to update the candidate auscultation location based on the adjustment prompt information until the signal quality of the candidate auscultation audio data at the candidate auscultation location is greater than the preset signal quality threshold, and determine the actual auscultation location for auscultating the item to be auscultated based on the current candidate auscultation location.
[0196] In one exemplary implementation, based on the foregoing embodiments, the method of confirming that the auscultation device is placed in a candidate auscultation position includes: confirming that the auscultation device is placed in a candidate auscultation position in response to a triggering operation of a first control for confirming the candidate auscultation position; or confirming that the auscultation device is placed in a candidate auscultation position in response to the auscultation device being in the same auscultation position for a preset time period; or confirming that the auscultation device is placed in a candidate auscultation position in response to a triggering operation of a start measurement control.
[0197] In one exemplary implementation, based on the foregoing embodiments, the method for determining at least one candidate auscultation location includes: in response to a selection operation of an item to be auscultated, generating a first prompt message for a starting auscultation location pre-associated with the item to be auscultated; in response to detecting the auscultation device at a first location indicated by the first prompt message in the body part of the object to be auscultated, generating a second prompt message for a preset movement direction pre-associated with the item to be auscultated; detecting the positional movement of the auscultation device under the indication of the second prompt message, and determining the candidate auscultation location based on the detected positional movement result of the auscultation device; wherein, the preset movement direction is used to indicate a movement route for moving the auscultation device from the first location in the body part of the object to be auscultated to a second location, the first location corresponds to the starting auscultation location, the second location corresponds to a target auscultation location pre-associated with the item to be auscultated, and the target auscultation location is determined based on the actual auscultation location of the item to be auscultated.
[0198] In one exemplary embodiment, based on the foregoing embodiments, the device further includes a display module, which can be configured to: display one or more of the following in a human body diagram: the initial auscultation position, the real-time position of the auscultation device, the target auscultation position, and the preset movement direction; the human body diagram includes a reference human body diagram or a human body diagram obtained by photographing the body parts of the object to be auscultated.
[0199] In one exemplary embodiment, based on the foregoing embodiments, the device further includes a measurement failure reason prompting module, which can be configured to: when it is determined that the candidate auscultation audio data does not contain valid signal data, perform noise identification on the candidate auscultation audio data, and generate reference adjustment prompt information for adjusting the candidate auscultation position based on the identified noise; the reference adjustment prompt information includes one or more of the following: please perform the measurement in a quiet environment, please hold the auscultation device stably, please avoid friction between the auscultation device and clothing, please avoid direct contact with the skin for measurement, and please reposition the auscultation device.
[0200] In one exemplary implementation, based on the foregoing embodiments, determining the signal quality of the candidate auscultation audio data includes: determining the signal quality of the candidate auscultation audio data based on the signal-to-noise ratio of the candidate auscultation audio data, and / or based on the energy proportion of effective signal data in the candidate auscultation audio data.
[0201] In one exemplary implementation, based on the foregoing embodiments, the auscultation location determination module can be specifically configured to: generate a prompt message indicating the adjustment range of the candidate auscultation location based on the difference between the signal quality of the candidate auscultation audio data and the preset signal quality threshold.
[0202] In one exemplary implementation, based on the foregoing embodiments, the display module may further be configured to: display the adjustment range in a human body diagram, the human body diagram including a reference human body diagram or a human body diagram obtained by photographing the body parts of the object to be auscultated; and generate a third prompt message in response to the adjustment distance of the candidate auscultation position exceeding the adjustment range, the third prompt message being used to prompt to reduce the adjustment range of the candidate auscultation position or return to the candidate auscultation position for readjustment.
[0203] In one exemplary implementation, based on the foregoing embodiments, the method for determining the preset signal quality threshold includes: pre-collecting signals from a first preset collection point in the body part of the subject to be auscultated, and determining the preset signal quality threshold corresponding to the subject to be auscultated based on the audio signal from the first preset collection point, wherein the noise included in the audio signal collected from the first preset collection point is greater than a second preset value; or pre-collecting signals from a second preset collection point in the body part of the subject to be auscultated, and determining the preset signal quality threshold corresponding to the subject to be auscultated based on the effective signal quality weighting value of each second preset collection point, wherein the noise included in the audio signal collected from the second preset collection point is less than a third preset value, wherein the third preset value is less than or equal to the second preset value.
[0204] In one exemplary implementation, based on the foregoing embodiments, when the signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, generating adjustment prompt information for the candidate auscultation position includes: when the signal quality of the candidate auscultation audio data is less than the preset signal quality threshold, connecting and displaying an indicator arrow in a human body diagram pointing from the candidate auscultation position to the target auscultation position of the item to be auscultated, so as to generate adjustment prompt information for the candidate auscultation position.
[0205] In one exemplary embodiment, based on the foregoing embodiments, the device further includes a recording module, which can be configured to: generate a fourth prompt message, the fourth prompt message being used to instruct the auscultation of the item to be auscultated according to the actual auscultation location; and record the actual auscultation audio data obtained based on the actual auscultation location.
[0206] In one exemplary implementation, based on the foregoing embodiments, the step of generating adjustment prompt information for the candidate auscultation position when the signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, and updating the candidate auscultation position based on the adjustment prompt information, includes: generating adjustment prompt information for the candidate auscultation position when the signal quality of the candidate auscultation audio data is less than a preset signal quality threshold; detecting the positional change of the auscultation device under the instruction of the adjustment prompt information; and updating the candidate auscultation position according to the detection result.
[0207] The specific details of each module in the above-mentioned device have been described in detail in the method section of the implementation plan. For any undisclosed details, please refer to the implementation plan of the method section, and therefore will not be repeated here.
[0208] An exemplary embodiment of this disclosure also provides an electronic device for performing the above-described method for determining the auscultation location. This electronic device may be the aforementioned terminal 110. Generally, the electronic device may include a processor and a memory, the memory storing executable instructions of the processor, and the processor configured to perform the above-described method for determining the auscultation location by executing the executable instructions.
[0209] The following is based on Figure 16 Taking the mobile terminal 1600 as an example, the construction of this electronic device will be described by way of example. Those skilled in the art will understand that, apart from components specifically designed for mobile purposes, Figure 16 The structure can also be applied to fixed types of equipment.
[0210] like Figure 16 As shown, the mobile terminal 1600 may specifically include: a processor 1601, a memory 1602, a bus 1603, a mobile communication module 1604, an antenna 1, a wireless communication module 1605, an antenna 2, a display screen 1606, a camera module 1607, an audio module 1608, a power module 1609, and a sensor module 1610.
[0211] Processor 1601 may include one or more processing units, such as: application processor (AP), modem processor, GPU (Graphics Processing Unit), ISP (Image Signal Processor), controller, encoder, decoder, DSP (Digital Signal Processor), baseband processor and / or NPU (Neural-Network Processing Unit), etc.
[0212] The processor 1601 can be connected to the memory 1602 or other components via the bus 1603.
[0213] The memory 1602 can be used to store computer executable program code, which includes instructions. The processor 1601 executes various functional applications and data processing of the mobile terminal 1600 by running the instructions stored in the memory 1602. The memory 1602 can also store auscultation audio data obtained when auscultating at the actual auscultation position determined by the auscultation position determination method of this disclosure.
[0214] The communication functions of mobile terminal 1600 can be implemented through mobile communication module 1604, antenna 1, wireless communication module 1605, antenna 2, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 1604 can provide 2G, 3G, 4G, and 5G mobile communication solutions for mobile terminal 1600. Wireless communication module 1605 can provide wireless communication solutions such as wireless LAN, Bluetooth, and near-field communication for mobile terminal 1600.
[0215] For example, the mobile terminal 1600 can communicate with the electronic stethoscope through a wireless communication module, thereby processing the auscultation audio data obtained from the electronic stethoscope to determine the actual auscultation location.
[0216] The display screen 1606 is used to implement display functions, such as displaying various auscultation location prompt interfaces as described in this disclosure. The camera module 1607 is used to implement image capture functions, such as capturing images and videos, including images of the body parts to be auscultated. The audio module 1608 is used to implement audio functions, such as playing audio and capturing voice. The power module 1609 is used to implement power management functions, such as charging the battery, supplying power to the device, and monitoring battery status. The sensor module 1610 may include a depth sensor 16101, a speed sensor 16102, a gyroscope sensor 16103, a barometric pressure sensor 16104, etc., to implement corresponding sensing and detection functions.
[0217] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."
[0218] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable storage medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network, and / or installed on a removable medium. When the computer program is executed by a central processing unit (CPU), it performs the various functions defined in the methods and apparatus of this application.
[0219] Exemplary embodiments of this disclosure also provide a computer-readable storage medium storing a program product capable of implementing the methods described above. In some possible embodiments, various aspects of this disclosure can also be implemented as a program product including program code that, when run on a terminal device, causes the terminal device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure, such as executing... Figure 2 Any one or more steps in the above method or any one or more steps in another auscultatory position determination method of this disclosure.
[0220] The computer-readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.
[0221] In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transfer a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wireline, optical fiber, RF, etc., or any suitable combination thereof.
[0222] Furthermore, program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0223] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.
[0224] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A method for determining the auscultation location, characterized in that, include: Acquire candidate auscultation audio data at candidate auscultation locations; If it is determined that the candidate auscultation audio data contains valid signal data, the valid signal quality of the candidate auscultation audio data is determined, and the valid signal data is determined according to the item to be auscultated; If the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, an adjustment prompt message for the candidate auscultation position is generated, and the candidate auscultation position is updated based on the adjustment prompt message until the effective signal quality of the candidate auscultation audio data at the candidate auscultation position is greater than or equal to the preset signal quality threshold. Based on the current candidate auscultation position, the actual auscultation position for auscultating the item to be auscultated is determined. The step of generating adjustment prompts for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold includes: generating prompts for the adjustment range of the candidate auscultation position based on the difference between the effective signal quality of the candidate auscultation audio data and the preset signal quality threshold; displaying the adjustment range in a human body diagram, the human body diagram including a reference human body diagram or a human body diagram obtained by photographing the body parts of the subject to be auscultated; generating a third prompt in response to the adjustment distance of the candidate auscultation position exceeding the adjustment range, the third prompt being used to prompt reducing the adjustment amplitude of the candidate auscultation position or returning to the candidate auscultation position for readjustment; the adjustment range being used to indicate the movement radius of the auscultation device.
2. The method for determining the auscultation location according to claim 1, characterized in that, Once it is confirmed that the auscultation device is placed at the candidate auscultation location, candidate auscultation audio data at the candidate auscultation location is acquired, wherein the candidate auscultation location is determined according to the item to be auscultated. The methods for confirming that the auscultation device is placed at the candidate auscultation location include: In response to a triggering operation of a first control used to confirm a candidate auscultation location, it is confirmed that the auscultation device is placed at the candidate auscultation location; or In response to the auscultation device remaining in the same auscultation position for a preset period of time, confirm that the auscultation device has been placed in the candidate auscultation position; or In response to the triggering operation of the start measurement control, confirm that the stethoscope is placed at the candidate auscultation position.
3. The method for determining the auscultation location according to claim 1, characterized in that, Methods for determining at least one candidate auscultation location include: In response to the selection of auscultation items, a first prompt message of the starting auscultation position pre-associated with the auscultation item is generated; In response to detecting the stethoscope at a first position indicated by the first prompt information in the body part of the subject to be auscultated, a second prompt information with a preset movement direction pre-associated with the subject to be auscultated is generated; The positional movement of the auscultation device is detected under the instruction of the second prompt information, and the candidate auscultation position is determined based on the detected positional movement of the auscultation device. The preset movement direction is used to indicate the movement route of moving the auscultation device from a first position to a second position in the body part of the object to be auscultated. The first position corresponds to the starting auscultation position, and the second position corresponds to the target auscultation position pre-associated with the item to be auscultated. The target auscultation position is determined according to the actual auscultation position of the item to be auscultated.
4. The method for determining the auscultation location according to claim 3, characterized in that, The method further includes: The human body diagram shows one or more of the following: the initial auscultation position, the real-time position of the auscultation device, the target auscultation position, and the preset movement direction; The human body diagram includes a reference human body diagram or a human body diagram obtained by photographing the body parts of the person to be auscultated.
5. The method for determining the auscultation location according to claim 1, characterized in that, The methods for determining that the candidate auscultation audio data contains valid signal data include: If the signal-to-noise ratio of the candidate auscultation audio data is greater than a first preset value, it is determined that the candidate auscultation audio data contains valid signal data; or If the recognition result of the candidate auscultation audio data by the preset machine learning model indicates that the candidate auscultation audio data contains valid signal data, then it is determined that the candidate auscultation audio data contains valid signal data; or Perform a Fast Fourier Transform on the candidate auscultation audio data. If the extreme points of the Fourier Transform curve meet preset conditions, it is determined that the candidate auscultation audio data contains valid signal data; or Determine the distance between the candidate auscultation location and the target auscultation location of the item to be auscultated. If the distance is less than a preset effective signal distance, determine that the candidate auscultation audio data contains effective signal data.
6. The method for determining the auscultation location according to claim 1, characterized in that, The method further includes: If it is determined that the candidate auscultation audio data does not contain valid signal data, noise identification is performed on the candidate auscultation audio data, and reference adjustment prompt information for adjusting the candidate auscultation position is generated based on the identified noise. The reference adjustment prompts include one or more of the following: Please take the measurement in a quiet environment; Please hold the stethoscope steadily; Please avoid friction between the stethoscope and clothing; Please avoid direct contact with the skin during measurement; Please reposition the stethoscope.
7. The method for determining the auscultation location according to claim 1, characterized in that, The method for determining the preset signal quality threshold includes: Signals from a first preset acquisition point on the body part of the subject to be auscultated are pre-acquired. A preset signal quality threshold corresponding to the subject is determined based on the audio signal from the first preset acquisition point. The noise included in the audio signal acquired from the first preset acquisition point is greater than a second preset value; or Signals from a second preset acquisition point on the body part of the subject to be auscultated are pre-acquired. A preset signal quality threshold corresponding to the subject to be auscultated is determined based on the effective signal quality weighting value of each second preset acquisition point. The noise included in the audio signal acquired by the second preset acquisition point is less than a third preset value, and the third preset value is less than or equal to the second preset value.
8. The method for determining the auscultation location according to claim 1, characterized in that, If the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, the generation of adjustment prompts for the candidate auscultation location includes: If the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, an indicator arrow pointing from the candidate auscultation position to the target auscultation position of the item to be auscultated is connected and displayed in the human body diagram to generate an adjustment prompt message for the candidate auscultation position.
9. The method for determining the auscultation location according to claim 1, characterized in that, After determining the actual auscultation location for auscultating the items to be auscultated, the method further includes: A fourth prompt message is generated, which is used to instruct the auscultation of the item to be auscultated according to the actual auscultation location; Record the actual auscultation audio data obtained based on the actual auscultation location.
10. The method for determining the auscultation location according to claim 1, characterized in that, When the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, generating adjustment prompt information for the candidate auscultation position, and updating the candidate auscultation position based on the adjustment prompt information, includes: If the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, an adjustment prompt message for the candidate auscultation position is generated. The positional changes of the auscultation device are detected under the indication of the adjustment prompt, and the candidate auscultation position is updated based on the detection results.
11. A device for determining the auscultation location, characterized in that, include: The candidate auscultation audio data acquisition module is configured to acquire candidate auscultation audio data at candidate auscultation locations; The signal quality determination module is configured to determine the effective signal quality of the candidate auscultation audio data when it is determined that the candidate auscultation audio data contains effective signal data, wherein the effective signal data is determined according to the auscultation item; The actual auscultation location determination module is configured to generate adjustment prompt information for the candidate auscultation location when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold, so as to update the candidate auscultation location based on the adjustment prompt information until the effective signal quality of the candidate auscultation audio data at the candidate auscultation location is greater than the preset signal quality threshold, and determine the actual auscultation location for auscultating the item to be auscultated based on the current candidate auscultation location; The step of generating adjustment prompts for the candidate auscultation position when the effective signal quality of the candidate auscultation audio data is less than a preset signal quality threshold includes: generating prompts for the adjustment range of the candidate auscultation position based on the difference between the effective signal quality of the candidate auscultation audio data and the preset signal quality threshold; displaying the adjustment range in a human body diagram, the human body diagram including a reference human body diagram or a human body diagram obtained by photographing the body parts of the subject to be auscultated; generating a third prompt in response to the adjustment distance of the candidate auscultation position exceeding the adjustment range, the third prompt being used to prompt reducing the adjustment amplitude of the candidate auscultation position or returning to the candidate auscultation position for readjustment; the adjustment range being used to indicate the movement radius of the auscultation device.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 10.
13. An electronic device, characterized in that, include: One or more processors; as well as A memory for storing one or more programs, which, when executed by one or more processors, cause the one or more processors to implement the method as described in any one of claims 1 to 10.
Citation Information
Patent Citations
Methods and systems for automated clinical workflows
US20230096006A1
Auscultation position indication method and device
WO2022068650A1
Handheld auscultation systems, devices, and methods
WO2022232131A1