Method and device for indicating auscultation position

Abstract

The embodiments of the present application disclose a method and device for indicating an auscultation position, which relate to the field of electronic devices. The electronic device can collect and display a user image, and recognize the user image to indicate the auscultation site corresponding to the user's body part to be tested on the user image. The electronic device can adapt to the differences in the auscultation sites of different users for different users, and reduce the position error of the indicated auscultation site. The specific solution is: when the user needs to perform an auscultation examination on the body part to be tested, the user image is collected and displayed by the electronic device. The user image includes an image of the user's body part to be tested. The electronic device can recognize the auscultation site on the body part to be tested based on the user image, and display a mark corresponding to the auscultation site on the user image, such as a first mark. The position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be tested, and is used to instruct the user to place the auscultation device at the auscultation site.

Description

Technical Field

[0001] The present invention relates to the field of electronic equipment, and more particularly to a method and device for indicating a stethoscope position. Background Art

[0002] The stethoscope is one of the most commonly used examination devices for physicians. Using a stethoscope, a variety of examinations can be performed, including heart sounds, lung sounds, and bowel sounds. Heart sounds refer to the heart sound signals composed of the contraction and relaxation of the heart, the opening and closing of valves, and abnormal noise signals. Auscultation of heart sounds can provide a preliminary assessment of the opening and closing status of heart valves, thereby enabling initial diagnosis of heart diseases such as valvular heart disease. Typical locations for auscultation of heart sounds include: the aortic valve auscultation area, the pulmonary valve auscultation area, the second aortic valve auscultation area, the tricuspid valve auscultation area, and the mitral valve auscultation area.

[0003] Since manual stethoscopes require personnel with professional medical knowledge to use, otherwise it is impossible to make a more accurate judgment on the heart sounds heard. Therefore, smart stethoscopes are widely used among home users. Smart stethoscopes are usually equipped with auscultation sensors, such as heart sound sensors, for auscultation detection. When in use, the user can place the smart stethoscope in the corresponding auscultation position so that the smart stethoscope can perform auscultation detection on the corresponding position. The smart stethoscope can send the auscultation data it detects to a terminal such as a mobile phone via Bluetooth or wired transmission. Mobile phones and other terminals can make preliminary judgments on heart sounds, etc. based on the received auscultation data. At present, when using a smart stethoscope, users need to determine their corresponding auscultation position based on a pre-provided auscultation position indicator map or video.

[0004] For example, Figure 1 As shown, an auscultation position indicator diagram 100 is displayed on a terminal such as a mobile phone. The auscultation position indicator diagram 100 may include a schematic diagram of the upper body of a human body, with corresponding positions on the upper body diagram indicating auscultation positions such as the aortic valve auscultation area 101, the pulmonary valve auscultation area 102, the second aortic valve auscultation area 103, the tricuspid valve auscultation area 104, and the mitral valve auscultation area 105. Users can refer to the auscultation positions in the above schematic diagram to find the corresponding auscultation position for themselves. Summary of the Invention

[0005] Embodiments of the present application provide a method and device for indicating auscultation locations. An electronic device can capture and display a user image, recognize the user image, and indicate auscultation locations corresponding to the user's body part to be measured on the user image. This allows the electronic device to adapt to the differences in auscultation locations for different users, reducing positional errors in the indicated auscultation locations.

[0006] In order to achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0007] In a first aspect, an embodiment of the present application provides a method for indicating an auscultation position, which can be applied to an electronic device. The method includes: when a user needs to perform an auscultation examination on a body part to be tested, a user image can be collected and displayed by an electronic device. The user image may include an image of the user's body part to be tested. The electronic device can identify the auscultation site on the body part to be tested based on the user image, and display a mark corresponding to the auscultation site on the user image, such as a first mark. The position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be tested, and is used to instruct the user to place the auscultation device at the auscultation site.

[0008] Using the above technical solution, when a user performs an auscultation examination on a body part to be tested and needs to place the auscultation device at the auscultation site, the user can use the electronic device to capture and display a user image including the body part to be tested, and the electronic device can correspondingly indicate the auscultation site for the user's body part to be tested. Therefore, when different users perform auscultation examinations, the electronic device can adapt to the differences in the auscultation sites of different users and reduce the position error of the indicated auscultation site.

[0009] In one possible implementation, when a user places a stethoscope on a body part to be measured, the user image also includes an image of the stethoscope. The position of the stethoscope image on the user image can move as the user moves the stethoscope over the body part to be measured. This allows the user to determine whether the stethoscope is accurately placed at the stethoscope site based on whether the stethoscope image in the user image overlaps with the first marker. This improves the accuracy of the user's placement of the stethoscope at the stethoscope site.

[0010] In another possible implementation, the electronic device is communicatively connected to the auscultation device; the first mark includes a first mark to be auscultated, and the first mark to be auscultated is a mark to be auscultated corresponding to a first auscultation site that has not been auscultated among the identified auscultation sites; after the electronic device displays the first mark on the user image, the method further includes: the electronic device outputs a first prompt information, and the first prompt information is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated; after the user moves the auscultation device according to the first prompt information, the electronic device stores the auscultation data received from the auscultation device when it is determined that the image of the auscultation device coincides with the first mark to be auscultated. In this way, the user can conveniently place the auscultation device on the corresponding auscultation site according to the guidance of the electronic device. This reduces the user's learning cost, makes the operation more intuitive, and improves the user experience.

[0011] In another possible implementation, the first marker also includes awaiting-auscultation markers corresponding to other unaccustomed auscultation sites among the identified auscultation sites, with the first awaiting-auscultation marker being closest to the image of the auscultation device among the awaiting-auscultation markers. This allows the user to be preferentially guided to the auscultation site closest to the auscultation device, saving the user time in moving the auscultation device and improving the user experience.

[0012] In another possible implementation, the first prompt includes an arrow pointing from an image of the stethoscope device to the first mark to be auscultated. This allows the user to more conveniently move the stethoscope device toward the auscultation site according to the path or direction indicated by the arrow. This approach provides more intuitive user guidance, a better user experience, and a lower learning curve.

[0013] In another possible implementation, the method further includes: the electronic device displaying a second marker corresponding to each mark to be auscultated, the second marker being used to indicate the order in which each auscultation site should be auscultated. In this way, the user can more clearly know the order in which the auscultation sites should be auscultated based on the second marker, thereby knowing the location of the next auscultation site, and facilitating the user to move the auscultation device to the corresponding auscultation site in sequence according to the auscultation order, thereby completing the auscultation examination of all auscultation sites.

[0014] In another possible implementation, the first prompt includes a voice message instructing the user to move the stethoscope toward the first auscultation location corresponding to the first mark to be auscultated. This allows the user to move the stethoscope toward the auscultation location based on the voice message, making it easier for users with poor vision to receive the first prompt, thereby improving the user experience.

[0015] In another possible implementation, after the electronic device determines that the image of the stethoscope device overlaps with the first mark to be auscultated, and after storing the auscultation data received from the stethoscope device, the method further includes: the electronic device re-identifying the first auscultation site based on the auscultation data; and the electronic device updating and displaying the first mark to be auscultated based on the re-identified first auscultation site, and re-outputting the first prompt information. In this way, by updating the first auscultation site, the accuracy of the electronic device in guiding the user to the corresponding auscultation site can be improved, thereby improving the accuracy of the final auscultation result.

[0016] In another possible implementation, the electronic device identifies an auscultation site of a body part to be measured based on a user image, including: obtaining a clavicle length of the body part to be measured based on the user image; and determining the auscultation site based on the clavicle length, the user image, and the auscultation site characteristic. Using the obtained clavicle length of the user's body part to be measured, the proportional relationship between the body part to be measured and the various distribution dimensions in the auscultation site characteristic can be calculated. This allows the identified auscultation site to be more closely matched to the user, reducing errors in auscultation site identification.

[0017] In another possible implementation, when an electronic device displays an image of a stethoscope over an image of a user, the electronic device obtains the clavicle length of the body part to be measured based on the user image. This includes: when the user moves the stethoscope over the body part to be measured, the electronic device obtains displacement data from the stethoscope, the displacement data being collected by the stethoscope as the stethoscope moves from one end of the clavicle to the other; and the electronic device determines the user's clavicle length based on the displacement data. In this way, the clavicle length can be measured using the stethoscope, thereby improving the accuracy of the obtained clavicle length.

[0018] In another possible implementation, the displacement data is collected by the stethoscope through a motion sensor. The stethoscope can collect the displacement data quickly and easily through the motion sensor and send it to the electronic device. In this way, the stethoscope structure is relatively simple and easy to set up.

[0019] In another possible implementation, before the electronic device obtains the clavicle length of the body part to be measured based on the user image, the method further includes: the electronic device outputting a second prompt message, the second prompt message being used to instruct the user to move the stethoscope device from one end of the clavicle to the other end of the body part to be measured. In this way, the user can conveniently complete the clavicle length measurement based on the second prompt message, thereby reducing the user's learning cost and improving the user experience.

[0020] In another possible implementation, the display screen of an electronic device includes a first area and a second area; the electronic device captures and displays a user image, including: the electronic device captures and displays the user image in the first area; and the method further includes: the electronic device displays auscultation data from an auscultation device in the second area. In this way, in addition to displaying the user image and providing user guidance, the electronic device can also display auscultation data, such as heart sound waveforms and electrocardiogram waveforms, in the second area, thereby facilitating the user's access to more parameter data related to the auscultation examination.

[0021] In a second aspect, an embodiment of the present application provides a device for indicating the position of auscultation, which can be applied to an electronic device to implement the method of the first aspect described above. The functions of the device can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, such as a display module, an identification module, a prompt module, a processing module, etc.

[0022] Among them, the display module is used to collect and display the user image, which includes the image of the user's body part to be measured; the identification module is used to identify the auscultation site of the body part to be measured based on the user image; the display module is also used to display a first mark on the user image, and the position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured, and is used to instruct the user to place the stethoscope device at the auscultation site.

[0023] In one possible implementation, when the user places the stethoscope on the body part to be measured, the user image further includes: an image of the stethoscope; and a position of the image of the stethoscope on the user image that moves as the user moves the stethoscope on the body part to be measured.

[0024] In another possible implementation, the electronic device is communicatively connected to the auscultation device; the first mark includes a first mark to be auscultated, which is a mark to be auscultated corresponding to a first auscultation site that has not been auscultated among the identified auscultation sites; a prompt module is used to output a first prompt information, which is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated; and a processing module is used to store the auscultation data received from the auscultation device when it is determined that the image of the auscultation device coincides with the first mark to be auscultated.

[0025] In another possible implementation, the first mark further includes marks to be auscultated corresponding to other unauscultated auscultation sites among the identified auscultation sites, and the first mark to be auscultated is closest to the image of the auscultation device among the marks to be auscultated.

[0026] In another possible implementation, the first prompt information includes: an arrow pointing from the image of the stethoscope device to the first mark to be auscultated.

[0027] In another possible implementation, the display module is further configured to display a second mark corresponding to each mark to be auscultated, where the second mark is configured to indicate the auscultation order of each auscultation site.

[0028] In another possible implementation, the first prompt information includes: a voice for instructing the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated.

[0029] In another possible implementation, the identification module is further used to re-identify the first auscultation site based on the auscultation data; the display module is further used to update and display the first mark to be auscultated based on the re-identified first auscultation site; and the prompt module is further used to re-output the first prompt information.

[0030] In another possible implementation, the recognition module is specifically configured to obtain the clavicle length of the body part to be measured based on the user image; and determine the auscultation site based on the clavicle length, the user image, and the auscultation position characteristics.

[0031] In another possible implementation, the identification module is specifically used to obtain displacement data from the stethoscope when the user moves the stethoscope on the body part to be measured. The displacement data is data collected by the stethoscope when the stethoscope moves from one end of the clavicle to the other end; and determine the user's clavicle length based on the displacement data.

[0032] In another possible implementation, the displacement data is collected by a stethoscope device through a motion sensor.

[0033] In another possible implementation, the prompt module is further configured to output a second prompt message, where the second prompt message is configured to instruct the user to move the stethoscope device from one end of the clavicle to the other end of the body part to be measured.

[0034] In another possible implementation, the display screen of the electronic device includes a first area and a second area; the display module is specifically configured to capture and display a user image in the first area; and display auscultation data from the auscultation device in the second area.

[0035] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor and a memory for storing instructions executable by the processor. The processor is configured to, when executing the instructions, cause the electronic device to implement the method for indicating a stethoscope position as described in the first aspect or any possible implementation of the first aspect.

[0036] In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by an electronic device, the electronic device implements the method for indicating a stethoscope position as described in the first aspect or any possible implementation of the first aspect.

[0037] In a fifth aspect, an embodiment of the present application provides a computer program product comprising a computer-readable code, which, when executed in an electronic device, enables the electronic device to implement a method for indicating auscultation position as described in the first aspect or any one of the possible implementations of the first aspect.

[0038] It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of a feature or beneficial effect means that a specific technical feature, technical solution or beneficial effect is included in at least one embodiment. Therefore, the description of a technical feature, technical solution or beneficial effect in this specification does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in the present embodiment can also be combined in any appropriate manner. Those skilled in the art will understand that the embodiment can be implemented without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in specific embodiments that do not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of an interface when applying a method for indicating auscultation position provided by the prior art;

[0040] Figure 2 A diagram illustrating an application scenario of a method for indicating auscultation position provided in an embodiment of the present application;

[0041] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0042] Figure 4 A flowchart of a method for indicating auscultation position provided in an embodiment of the present application;

[0043] Figure 5 A schematic diagram of an interface when applying a method for indicating auscultation position provided in an embodiment of the present application;

[0044] Figure 6 A schematic diagram of a distribution feature of auscultation points provided in an embodiment of the present application;

[0045] Figure 7 A schematic diagram of an interface when another method for indicating auscultation position provided in an embodiment of the present application is applied;

[0046] Figure 8 A schematic diagram of an interface when another method for indicating auscultation position provided in an embodiment of the present application is applied;

[0047] Figure 9 A schematic diagram of an interface when another method for indicating auscultation position provided in an embodiment of the present application is applied;

[0048] Figure 10 A schematic diagram of an interface when another method for indicating auscultation position provided in an embodiment of the present application is applied;

[0049] Figure 11 A flowchart of another method for indicating auscultation position provided in an embodiment of the present application;

[0050] Figure 12 A flowchart of another method for indicating auscultation position provided in an embodiment of the present application;

[0051] Figure 13 A flowchart of another method for indicating auscultation position provided in an embodiment of the present application;

[0052] Figure 14 A flowchart of another method for indicating auscultation position provided in an embodiment of the present application;

[0053] Figure 15 A schematic diagram of an interface when another method for indicating auscultation position provided in an embodiment of the present application is applied;

[0054] Figure 16 A schematic structural diagram of a device for indicating auscultation position provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0056] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0057] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0058] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0059] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized.

[0060] Usually, during auscultation examination, a person with professional medical knowledge (such as a doctor, etc.) is required to use an artificial stethoscope to perform heart sounds, lung sounds or bowel sounds on the person to be tested (or the user to be auscultated). Since auscultation examination requires analysis of the heart sounds, lung sounds or bowel sounds heard, ordinary home users generally cannot use artificial stethoscopes to perform auscultation examinations on themselves or others. However, an intelligent stethoscope can perform auscultation detection on the body part to be tested (such as the chest) of the person to be tested through an auscultation sensor. And the intelligent stethoscope can send the detected auscultation data (such as heart sound signals, lung sound signals, bowel sound signals, etc.) to an electronic device with data processing function (such as a mobile phone, smart TV, computer, etc.), so that the electronic device can derive the auscultation examination results based on the auscultation data analysis. For example, when the person to be tested needs to undergo a heart sound examination, the intelligent stethoscope can be placed at the corresponding auscultation site on the upper chest part of the person to be tested, so that the intelligent stethoscope can perform auscultation detection on the corresponding auscultation site of the user to be tested.

[0061] Therefore, when using the smart stethoscope, it is necessary to indicate the corresponding auscultation site to the user so that the user can place the smart stethoscope at the corresponding auscultation site. Currently, there are two main ways to indicate the auscultation site to the user:

[0062] refer to Figure 1 As shown, an auscultation position indication diagram 100 including various auscultation sites (or auscultation areas) can be displayed on the electronic device, so that the user can find the corresponding auscultation site on the body part to be measured according to the indication diagram.

[0063] Alternatively, a stethoscope garment is provided, on which an indicator pattern corresponding to auscultation sites can be printed. When a user wears the stethoscope garment, the position of the indicator pattern on the stethoscope garment corresponding to the body part to be measured is the indicated auscultation site.

[0064] It can be seen that the above two methods of indicating the auscultation site to the user are both to indicate the user through a pre-set indication map or indication pattern. For different users, the indication map or indication pattern is set uniformly and cannot adapt to the differences in the auscultation sites of different users to provide personalized instructions for the users.

[0065] Based on this, an embodiment of the present application provides a method for indicating an auscultation position, comprising: when a user needs to perform an auscultation examination on a body part to be tested, a user image can be collected and displayed by an electronic device. The user image may include an image of the user's body part to be tested. The electronic device can identify the auscultation site on the body part to be tested based on the user image, and display a mark corresponding to the auscultation site on the user image, such as a first mark. In this way, the auscultation site for the user's body part to be tested can be indicated on the user image, thereby adapting to the differences in auscultation sites of different users and reducing the position error of the indicated auscultation site.

[0066] Figure 2 The application scenario of the method for indicating the auscultation position provided by the present application is shown. Figure 2 , the scene includes: user 201 and electronic device 202. The electronic device 202 has a camera, and the user 201 can use the camera of the electronic device 202 to capture the user image of the user 201. Figure 2 In the figure, the electronic device 202 is demonstrated by taking a mobile phone as an example.

[0067] The method for indicating the auscultation position provided in the embodiment of the present application can be applied to Figure 2 electronic devices in. For example, the electronic device may be a mobile phone, a tablet computer, a wearable device with a camera, a television, a laptop computer, a desktop computer, an augmented reality (AR) / virtual reality (VR) device, etc. The embodiment of the present application does not impose any special restrictions on the specific form of the electronic device. It should be noted that the above electronic devices can also be used in combination, for example, by collecting user images through the camera of a smart screen, and sending the user images to the mobile phone to display on the screen of the mobile phone. Alternatively, the user image is collected by the camera of the mobile phone, and the user image is sent to the VR device to display a VR image including the user image, etc.

[0068] The structure of electronic equipment is explained using a mobile phone as an example. Figure 3 , is a structural diagram of an electronic device provided in an embodiment of the present application.

[0069] like Figure 3As shown, the electronic device may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, a button 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc. Among them, the sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0070] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0071] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0072] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0073] Processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 310 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 310. If processor 310 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 310 latency, and thus improves system efficiency.

[0074] In some embodiments, the processor 310 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0075] The charging management module 340 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 340 can receive charging input from the wired charger via the USB interface 330. In some wireless charging embodiments, the charging management module 340 can receive wireless charging input via the electronic device's wireless charging coil. While charging the battery 342, the charging management module 340 can also provide power to the electronic device via the power management module 341.

[0076] The power management module 341 is used to connect the battery 342, the charging management module 340, and the processor 310. The power management module 341 receives input from the battery 342 and / or the charging management module 340 and provides power to the processor 310, the internal memory 321, the external memory, the display 394, the camera 393, and the wireless communication module 360. The power management module 341 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 341 can also be set in the processor 310. In other embodiments, the power management module 341 and the charging management module 340 can also be set in the same device.

[0077] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor.

[0078] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0079] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to electronic devices. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the same device as at least some of the modules of the processor 310.

[0080] The wireless communication module 360 ​​can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 360 ​​can be one or more devices that integrate at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310. The wireless communication module 360 ​​can also receive the signal to be sent from the processor 310, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0081] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 350, and antenna 2 is coupled to wireless communication module 360, so that the electronic device can communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0082] The electronic device implements display functionality through a GPU, display screen 394, and an application processor. A GPU is a microprocessor for image processing that connects display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs that execute program instructions to generate or modify display information.

[0083] Display screen 394 is used to display images, videos, and the like. Display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLED, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device can include one or N display screens 394, where N is a positive integer greater than one.

[0084] The electronic device can realize the shooting function through the ISP, camera 393, video codec, GPU, display 394 and application processor.

[0085] The ISP processes data fed back by camera 393. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 393.

[0086] The camera 393 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device may include 1 or N cameras 393, where N is a positive integer greater than 1.

[0087] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when an electronic device selects a frequency, the DSP performs a Fourier transform on the frequency energy.

[0088] Video codecs are used to compress or decompress digital video. Electronic devices may support one or more video codecs. This allows them to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0089] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in electronic devices, such as image recognition, face recognition, speech recognition, and text comprehension.

[0090] The internal memory 321 can be used to store computer executable program codes, which include instructions. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 321. The internal memory 321 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0091] The electronic device can implement audio functions such as music playback and recording through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the headphone jack 370D, and the application processor.

[0092] The audio module 370 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 370 can also be used to encode and decode audio signals. In some embodiments, the audio module 370 can be provided in the processor 310, or some functional modules of the audio module 370 can be provided in the processor 310.

[0093] Speaker 370A, also called a "horn," is used to convert audio electrical signals into sound signals. An electronic device can listen to music or make hands-free calls through speaker 370A.

[0094] The receiver 370B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device receives a call or voice message, the voice can be heard by placing the receiver 370B close to the human ear.

[0095] Microphone 370C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message or triggering an electronic device to perform certain events through a voice assistant, the user can speak by putting their mouth close to the microphone 370C to input the sound signal into the microphone 370C. The electronic device can be provided with at least one microphone 370C. In other embodiments, the electronic device can be provided with two microphones 370C, which can not only collect sound signals but also realize noise reduction functions. In other embodiments, the electronic device can also be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify the source of sound, realize directional recording functions, etc.

[0096] Pressure sensor 380A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 380A can be located on display screen 394. There are many types of pressure sensors 380A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 380A, the capacitance between the electrodes changes. The electronic device determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 394, the electronic device detects the touch intensity based on pressure sensor 380A. The electronic device can also calculate the touch location based on the detection signal from pressure sensor 380A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, an instruction to create a new short message is executed.

[0097] The gyroscope sensor 380B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 380B. The gyroscope sensor 380B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 380B detects the angle of the electronic device's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the electronic device through reverse motion to achieve anti-shake. The gyroscope sensor 380B can also be used for navigation and somatosensory game scenes.

[0098] Touch sensor 380K, also known as a "touch panel," can be disposed on display screen 394. The touch sensor 380K and display screen 394 form a touch screen, also known as a "touch screen." Touch sensor 380K is used to detect touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 194. In other embodiments, touch sensor 380K can also be disposed on the surface of the electronic device, at a location different from that of display screen 394.

[0099] Keys 390 include a power button, a volume button, and the like. Keys 390 may be mechanical keys or touch-sensitive keys. The electronic device may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.

[0100] Motor 391 can generate vibration prompts. Motor 391 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 394, motor 391 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0101] The SIM card interface 395 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device by inserting it into or removing it from the SIM card interface 395. The electronic device can support 1 or N SIM card interfaces 395, where N is a positive integer greater than 1. The SIM card interface 395 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 395 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 395 can also be compatible with different types of SIM cards. The SIM card interface 395 can also be compatible with external memory cards. Electronic devices interact with the network through SIM cards to implement functions such as calls and data communications. In some embodiments, the electronic device uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device and cannot be separated from the electronic device.

[0102] The methods in the following embodiments can all be implemented in an electronic device having the above hardware structure.

[0103] Figure 4 This is a flow chart of a method for indicating the position of auscultation provided in an embodiment of the present application. Figure 4 As shown, the method for indicating the auscultation position may include the following S401-S405.

[0104] S401: The electronic device collects and displays a user image.

[0105] The user image may include an image of the user's body part to be measured.

[0106] The user's body part to be tested can usually be the user's chest or upper body, or other parts that require auscultation. When the user needs to perform an auscultation examination, the user can determine the specific body part to be tested based on different auscultation tests. For example, if the user needs to perform a heart sound or bowel sound test, the front of the upper body can be used as the body part to be tested for the electronic device to collect and display. Or if the user needs to perform a lung sound test, the front and back of the upper body can be used as the body parts to be tested for the electronic device to collect and display.

[0107] For example, Figure 5 As shown, the front of the user's upper body is used as the body part to be measured, and the electronic device collects and displays the user's upper body image 501.

[0108] In some embodiments, the electronic device can capture the user's image through its built-in camera or an external camera. The user image captured and displayed by the electronic device can be a dynamic image (or video image), so that when the electronic device subsequently identifies the auscultation site based on the user image, it can adjust in real time according to changes in the user image, thereby making the auscultation site identified by the electronic device more accurate.

[0109] S402: The electronic device identifies the auscultation site of the body part to be measured based on the user image.

[0110] The electronic device may identify the auscultation site of the body part to be measured in the user image by image recognition.

[0111] For example, the electronic device may identify feature points of an image of a body part to be measured in an image of the user. For example, if the image of the body part to be measured is an image of the user's upper torso, the feature points may be the symmetrical center points of the two clavicles, the shoulders, and the lower edges of the ribs. The electronic device then determines the auscultation site of the body part to be measured based on the distribution characteristics of the auscultation sites corresponding to the body part to be measured.

[0112] The distribution characteristics of the auscultation sites may be the positional relationship between each auscultation site and the feature points identified above. For example, the distribution characteristics of the auscultation sites may be the distance between each auscultation site and the corresponding feature point, or the distance between each auscultation site.

[0113] For example, the body part to be measured is the user's upper body, the auscultation site is the heart sound auscultation site, and the feature point recognized by the electronic device is the symmetric center of the two clavicles. The electronic device can first recognize the symmetric center of the user's upper body and the clavicles based on the upper body image. Then, Figure 6 As shown, the electronic device can determine the two heart sound auscultation sites, the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602, in the user's upper body based on the vertical distance A between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602 and the symmetrical centers of the two clavicles 603, and the spacing B between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602. Similarly, the electronic device can determine other heart sound auscultation sites based on the spacing between other heart sound auscultation sites, such as the aortic valve second auscultation area 604, the tricuspid valve auscultation area 605, and the mitral valve auscultation area 606, and their approximate locations on the ribs 607. Among them, the vertical distance A between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602 and the symmetry centers of the two clavicles 603 respectively, the distance B between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602, and the distance between other heart sound auscultation sites such as the aortic valve second auscultation area 604, the tricuspid valve auscultation area 605 and the mitral valve auscultation area 606 can be obtained based on medical prior knowledge.

[0114] Typically, the electronic device can also obtain the clavicle length on the body part to be measured based on the user image, and then calculate and determine the above-mentioned distances (or spacings) for the user based on the proportional relationship between the clavicle length and the clavicle length defined in medical prior knowledge, thereby improving the matching degree between the determined auscultation site and the user's body part to be measured, and increasing the accuracy of identifying the auscultation site.

[0115] S403: The electronic device displays a first mark on the user image.

[0116] The position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured. The first mark can be used to instruct the user to place the auscultation device at the auscultation site.

[0117] In some embodiments, the first mark displayed by the electronic device may correspond to the auscultation site identified in S402, that is, all the identified auscultation sites are displayed on the user image. For example, if the image of the body part to be measured is the upper body image of the user, and the auscultation sites identified by the electronic device are five heart sound auscultation sites, then Figure 5 As shown, the electronic device can display five first marks 502 correspondingly on the user image.

[0118] For example, the first mark can be a mark pattern displayed at a corresponding position on the user image, such as a dot, a circle (such as Figure 5 ) etc. In this embodiment, as the user performs auscultation examinations on the auscultation sites corresponding to the displayed first mark in sequence, there will be auscultation sites that have not been auscultated and auscultation sites that have been auscultated in each auscultation site. Therefore, in the embodiment of the present application, the first mark displayed by the electronic device includes a mark corresponding to the auscultation site that has not been auscultated, such as a mark to be auscultated. Correspondingly, the first mark may also include a mark corresponding to the auscultation site that has been auscultated, such as a mark that has been auscultated.

[0119] The electronic device can also distinguish the mark of auscultation that has been performed from the mark of waiting for auscultation, and display the mark of auscultation that has been performed. This allows the user to determine whether the corresponding auscultation site has been auscultated. For example, the mark of auscultation that has been performed is displayed in black or gray, while the mark of waiting for auscultation is displayed in red or other colors, etc., and the mark of waiting for auscultation and the mark of auscultation that has been performed are distinguished by color difference. In other embodiments, after the auscultation site has been auscultated, the electronic device may no longer display the mark corresponding to the auscultation site (or the mark of auscultation that has been performed).

[0120] In some other embodiments, the first mark displayed by the electronic device may include only one mark. For example, the first mark corresponds to the unauscultated auscultation site (or the first mark is a mark to be auscultated). That is, the electronic device may display the identified auscultation sites in sequence until auscultation is completed for all auscultation sites.

[0121] Typically, when a user places a stethoscope on a body part to be measured, the user image may also include an image of the stethoscope. The position of the stethoscope image on the user image may move as the user moves the stethoscope over the body part to be measured. In other words, the stethoscope image is a dynamic image (or video image).

[0122] The user can select a mark to be auscultated, such as the first mark to be auscultated, and move the stethoscope so that the image of the stethoscope coincides with the first mark to be auscultated, thereby placing the stethoscope at an unaccustomed auscultation site. In this way, the user can more easily place the stethoscope based on the first mark displayed by the electronic device and the image of the stethoscope, thereby improving the accuracy of the user's placement of the stethoscope at the auscultation site.

[0123] After the electronic device displays the first mark on the user's image, the electronic device may further guide the auscultation sites corresponding to the marks to be auscultated according to preset rules, so that the user can move the auscultation device to the corresponding auscultation site according to the guidance of the electronic device. The preset rules may include prioritizing the unauscultated auscultation site closest to the auscultation device for guidance, or guiding the unauscultated auscultation sites according to a certain auscultation order, etc. If the first mark displayed by the electronic device includes only one mark, the first mark may be displayed according to the above-mentioned preset rules, that is, the electronic device only displays the first mark corresponding to the auscultation mark to which the user is to be guided for auscultation.

[0124] Therefore, when the electronic device guides the auscultation site corresponding to a mark to be auscultated, such as the first auscultation site corresponding to the first mark to be auscultated, this embodiment may further include the following S404-S405.

[0125] S404: The electronic device outputs a first prompt message.

[0126] The first prompt information can instruct the user to move the auscultation device to the auscultation site corresponding to the first mark to be auscultated.

[0127] In some embodiments, the first prompt information may be text displayed by the electronic device, or an indicator displayed on the user image, or a voice broadcast by the electronic device.

[0128] For example, Figure 7As shown, the electronic device can display an arrow 703 on the user's image, pointing from the image of the stethoscope device 701 to the first mark to be auscultated 702. The arrow 703 can be updated in real time as the user moves the stethoscope device. This arrow instructs the user to move the stethoscope device toward the first auscultation point corresponding to the first mark to be auscultated, making it more intuitive, reducing user learning costs, and improving user experience.

[0129] For another example, the electronic device may broadcast a voice instructing the user to move the auscultation device to the auscultation site corresponding to the first mark to be auscultated.

[0130] In some embodiments, the electronic device may further display a second mark corresponding to the mark to be auscultated, and indicate the auscultation order of each auscultation site through the second mark. Figure 8 As shown, the second mark 801 is a digital identifier corresponding to the auscultation order of each auscultation site. Each second mark 801 is displayed on the corresponding first mark 802.

[0131] When the electronic device displays the second mark, the voice of the electronic device for instructing the user to move the auscultation device can be combined with the second mark to express the first mark to be auscultated. For example, if the second mark corresponding to the first mark to be auscultated is number 1, then Figure 9 As shown, the voice broadcast by the electronic device can be "Please move the stethoscope device to the stethoscope position 1", etc., which is not limited here.

[0132] In some embodiments, when the electronic device has a large display screen, such as a tablet computer, laptop computer, smart TV (such as a smart screen), or desktop computer with a large screen display, the electronic device can also display auxiliary information using text to guide the user to move the stethoscope device. The content of the text can be the same as the content of the voice message.

[0133] For example, the display screen of the electronic device may include a first area and a second area. The electronic device may display the user image in the first area and the auxiliary information in the second area.

[0134] Take the smart screen as an example, Figure 10 As shown, the display screen of the smart screen is divided into a first area 1001 and a second area 1002. The first area 1001 displays a user image 1003, and the second area 1002 displays auxiliary information 1004. Among them, the second mark 1006 corresponding to the first mark to be auscultated 1005 is the number 1, and the auxiliary information 1004 includes the text "Please move the auscultation device to auscultation position 1".

[0135] In some embodiments, the auxiliary information may also include auscultation data detected by a stethoscope. For example, the stethoscope may be connected to the electronic device via a wired or wireless communication link. The stethoscope may transmit the detected auscultation data to the electronic device. For example, the stethoscope may include a stethoscope sensor, such as a heart sound sensor, a lung sound sensor, or a bowel sound sensor. The stethoscope may detect heart sounds, lung sounds, or bowel sounds at the stethoscope site using the stethoscope sensor to generate heart sound, lung sound, or bowel sound data. In some possible embodiments, the stethoscope may also include a heart rate sensor to detect the user's heart rate and generate electrocardiogram (ECG) data. The heart rate sensor may be an electrode-type heart rate sensor, an optical heart rate sensor, or the like. When a user uses the stethoscope to perform auscultation on a body part (e.g., the upper body) and simultaneously requires heart rate / ECG measurement, the user may leave their upper body uncovered so that the heart rate sensor of the stethoscope can directly contact the skin, resulting in higher detection accuracy. For example, the auxiliary information may be the stethoscope data and / or ECG data displayed as a waveform by the electronic device.

[0136] Optionally, the wireless communication protocol used when the stethoscope device and the electronic device establish a wireless connection can be a wireless fidelity (Wi-Fi) protocol, a Bluetooth protocol, a ZigBee protocol, a near field communication (NFC) protocol, various cellular network protocols, etc., without specific restrictions here.

[0137] Continuing to take the electronic device as an example, Figure 10 As shown, the smart screen can also display the heart sound waveform graph detected by the stethoscope in the second area, as well as the electrocardiogram waveform graph detected by the stethoscope.

[0138] It should be noted that the above-mentioned auscultation data, ECG data, etc. can be data sent in real time by the auscultation device, or data detected at the auscultation site after the auscultation device is placed at the auscultation site. No specific restrictions are made here.

[0139] S405: After the user moves the stethoscope device according to the first prompt information, the electronic device stores the auscultation data received from the stethoscope device when determining that the image of the stethoscope device coincides with the first mark to be auscultated.

[0140] When the image of the stethoscope device overlaps with the first mark to be auscultated, it means that the stethoscope device is placed on the auscultation site corresponding to the first mark to be auscultated. At this time, the electronic device stores the auscultation data received from the stethoscope device and can subsequently analyze the corresponding auscultation site based on the auscultation data to make a preliminary diagnosis for the auscultation site.

[0141] Figure 11 FIG. 1 is a flow chart showing another method for indicating the position of auscultation provided by an embodiment of the present application. Figure 11 As shown, the method for indicating the auscultation position may include the following S1101-S1108.

[0142] S1101. The electronic device collects and displays a user image.

[0143] S1102: The electronic device obtains the clavicle length of the body part to be measured based on the user image.

[0144] In some embodiments, the electronic device may identify the clavicle on the body part to be measured through image recognition, thereby obtaining the clavicle length.

[0145] In other embodiments, when the user moves the stethoscope device on the body part to be measured, the electronic device can also obtain the clavicle length by obtaining displacement data from the stethoscope device. The displacement data is the displacement data generated by the stethoscope device moving from one end of the clavicle to the other end. For example, the user can move the stethoscope device from one end of the clavicle to the other end. The stethoscope device can send the detected displacement data to the electronic device, so that the electronic device can obtain the clavicle length based on the displacement data. The stethoscope device can collect and obtain the data through a motion sensor, such as a six-axis motion sensor. In some possible implementations, before S1102, the electronic device can also output a second prompt information to instruct the user to move the stethoscope device from one end of the clavicle on the body part to be measured to the other end. The second prompt information can be an indicator mark corresponding to the clavicle displayed in the user image. For example, the electronic device displays an arrow on the clavicle on the user image, and the arrow extends along the extension direction of the clavicle.

[0146] S1103. The electronic device determines the auscultation site according to the clavicle length, the user image, and the auscultation position characteristics.

[0147] The implementation of this step can refer to the example of S402 and will not be described in detail here.

[0148] S1104: The electronic device determines whether there is a position that needs to be auscultated. If so, S1105 is executed: the electronic device displays a first mark on the user image. If not, the electronic device ends indicating the auscultation position.

[0149] S1106. The electronic device outputs a first prompt message.

[0150] S1107: After the user moves the stethoscope according to the first prompt, the electronic device determines whether the stethoscope reaches the stethoscope location. If so, S1108: Storing the auscultation data received from the stethoscope. If not, S1106:

[0151] In some embodiments, the electronic device may determine whether the stethoscope has reached the auscultation site by image recognition. For example, when the electronic device determines that the image of the stethoscope coincides with the first mark to be auscultated, the electronic device may determine that the stethoscope has reached the auscultation site.

[0152] In other embodiments, the electronic device may also determine whether the auscultation site has been reached by acquiring auscultation data transmitted by the auscultation device. For example, the auscultation data may include information on the strength of the auscultation signal. When the electronic device determines that the strength of the auscultation signal is greater than a detection threshold, it may determine that the auscultation device has reached the auscultation site.

[0153] Alternatively, the electronic device can also obtain the displacement data detected by the stethoscope to determine whether the distance moved by the stethoscope is equal to the distance between the initial position of the stethoscope and the auscultation site or the difference is less than a preset value. If so, it can be determined that the stethoscope has reached the auscultation site.

[0154] Typically, after storing the auscultation data received from the auscultation device, the electronic device may return to execute S1104 until auscultation is completed at all auscultation sites.

[0155] Among them, S1101, S1105, and S1106 are respectively the same as the embodiments of S401, S403, and S404, and are not described here in detail.

[0156] Figure 12 FIG. 2 shows a flow chart of another method for indicating the position of auscultation provided by an embodiment of the present application. Figure 12 As shown, the method for indicating the auscultation position may include the following S1201-S12010.

[0157] S1201: The electronic device collects and displays a user image.

[0158] S1202: The electronic device obtains the clavicle length of the body part to be measured based on the user image.

[0159] S1203. The electronic device determines the auscultation site according to the clavicle length, the user image, and the auscultation position characteristics.

[0160] S1204: The electronic device determines whether there is a position that needs to be auscultated. If so, the electronic device performs S1205: displays a first mark on the user image. If not, the electronic device ends indicating the auscultation position.

[0161] S1206: The electronic device outputs a first prompt message.

[0162] S1207. The electronic device obtains data detected by the stethoscope device.

[0163] S1208. The electronic device displays auxiliary information based on the data detected by the stethoscope device.

[0164] The data detected by the stethoscope device may include displacement data, auscultation data, etc., and the corresponding auxiliary information may include text guiding the user to move the stethoscope device, as described in the description of S404, an electrocardiogram waveform, a heart sound waveform, etc. For a specific implementation, please refer to the example of auxiliary information in S404, which will not be described in detail here.

[0165] S1209: After the user moves the stethoscope according to the first prompt, the electronic device determines whether the stethoscope reaches the stethoscope location. If so, the electronic device executes S12010: stores the auscultation data received from the stethoscope. If not, the electronic device executes S1206.

[0166] It should be noted that S1201 to S1206 and S1209, S12010 are respectively the same as the embodiments of S1101 to S1108, and are not described in detail here.

[0167] Figure 13 FIG. 2 shows a flow chart of another method for indicating the position of auscultation provided by an embodiment of the present application. Figure 13 As shown, the method for indicating the auscultation position may include the following S1301-S13011.

[0168] S1301: The electronic device collects and displays a user image.

[0169] S1302: The electronic device obtains the clavicle length of the body part to be measured based on the user image.

[0170] S1303. The electronic device determines the auscultation site based on the clavicle length, the user image, and the auscultation position characteristics.

[0171] S1304: The electronic device determines whether there is a position that needs to be auscultated. If so, S1305 is executed: the electronic device displays a first mark on the user image. If not, the electronic device ends indicating the auscultation position.

[0172] S1306: The electronic device outputs a first prompt message.

[0173] S1307. The electronic device obtains data detected by the stethoscope device.

[0174] S1308. The electronic device displays auxiliary information based on the data detected by the stethoscope.

[0175] S1309: After the user moves the stethoscope according to the first prompt, the electronic device determines whether the stethoscope has reached the stethoscope location. If so, S13010 is executed to store the stethoscope data received from the stethoscope. If not, S13011 is executed to determine whether the first prompt needs to be updated. If so, the first prompt is updated and S1306 is executed. If not, S1306 is executed.

[0176] The first mark to be auscultated indicated by the first prompt information may be the mark to be auscultated corresponding to the unauscultated auscultation site closest to the auscultation device. The electronic device may determine whether to update the first prompt information based on whether the unauscultated auscultation site closest to the auscultation device has changed. For example, when the unauscultated auscultation site closest to the auscultation device has changed to another auscultation site, the electronic device may correspondingly update the first prompt information to redirect the user to steer the auscultation device to the changed auscultation site.

[0177] It should be noted that S1301 to S13010 are respectively the same as the embodiments of S1201 to S12010, and are not described in detail here.

[0178] Figure 14 FIG. 2 shows a flow chart of another method for indicating the position of auscultation provided by an embodiment of the present application. Figure 14 As shown, the method for indicating the auscultation position may include the following S1401-S1408.

[0179] S1401: The electronic device collects and displays a user image.

[0180] S1402: The electronic device obtains the clavicle length of the body part to be measured based on the user image.

[0181] S1403. The electronic device determines each auscultation site based on the clavicle length, the user image, and the auscultation position characteristics.

[0182] Wherein, each auscultation site may be the area range where each auscultation site is located, that is, each auscultation site is located within the corresponding auscultation site range.

[0183] S1404: The electronic device displays a first mark on the user image.

[0184] S1405: The electronic device outputs a first prompt message.

[0185] S1406. The electronic device obtains data detected by the stethoscope device.

[0186] S1407: The electronic device determines whether the optimal position of the auscultation site has been reached based on the data detected by the auscultation device. If so, S1408 is executed to store the auscultation data received from the auscultation device. If not, the auscultation site is updated and S1404 is executed.

[0187] The electronic device can use data detected by the auscultation device, such as the auscultation signal strength, to determine whether the auscultation signal strength after the auscultation device reaches the auscultation site is greater than a preset threshold. If not, it can be determined that the auscultation site is not the optimal location. In this case, the electronic device can re-determine the auscultation site based on the auscultation signal strength, that is, update the auscultation site.

[0188] For example, updating the auscultation site may be redefining the area range of the corresponding auscultation site, such as narrowing the area range of the corresponding auscultation site.

[0189] For example, Figure 15 As shown in (a) in the figure, the first mark displayed by the electronic device includes only one mark, which corresponds to one of the unauscultated auscultation marks in the identified auscultation sites, and can be called the first mark to be auscultated 1501. The user moves the auscultation device to the auscultation site corresponding to the first mark to be auscultated 1501 according to the first prompt information, that is, the image 1502 of the auscultation device coincides with the first mark to be auscultated 1501. At this time, the electronic device can re-determine a better position of the auscultation site based on the auscultation data sent by the acquired auscultation device, such as narrowing the area range of the auscultation site. And as shown in FIG. Figure 15 As shown in (b) of FIG. 1 , the first mark to be auscultated 1501 (or the first mark) is redisplayed. In this way, the user can eventually move the auscultation device to a more accurate auscultation position, thereby improving the accuracy of the subsequent auscultation results.

[0190] In some embodiments, the first mark displayed by the electronic device may be a mark corresponding to an unauscultated auscultation mark in the identified auscultation sites. After S1408, the electronic device may further execute S1409 to determine whether auscultation has been completed for all auscultation sites. If so, the auscultation position indication is terminated; otherwise, the auscultation site is changed and the process returns to S1404. In other words, the first mark corresponding to the changed auscultation site is redisplayed to guide the user to the changed auscultation site.

[0191] Among them, S1401 to S1406 and S1408 are respectively the same as the embodiments of S1301 to S1303 and S1305 to S1307, and are not described in detail here.

[0192] Using the method in the aforementioned embodiment, when a user needs to examine a body part to be examined, the user can use an electronic device to capture and display a user image including the body part to be examined. The electronic device can identify the auscultation sites corresponding to the body part to be examined based on the user image, and mark and display these auscultation sites on the user image. In this way, the auscultation sites marked and displayed by the electronic device correspond to the user's body part to be examined. This method can adapt to the differences in auscultation sites among different users and reduce the positional error of the indicated auscultation sites. Furthermore, the user image captured and displayed by the electronic device can also include an image of an auscultation device. The electronic device can guide the user by outputting prompt information, allowing the user to move the auscultation device to the corresponding auscultation site according to the prompt information. The user can intuitively perceive whether the auscultation device has reached the auscultation site by checking whether the image of the auscultation device in the user image overlaps with the mark corresponding to the auscultation site. This allows the user to more accurately place the auscultation device at the auscultation site, improving the accuracy of the auscultation examination and enhancing the user experience.

[0193] Corresponding to the method in the above embodiment, the embodiment of the present application further provides a device for indicating the position of auscultation. The device can be applied to an electronic device to implement the method in the above embodiment. The functions of the device can be implemented by hardware or by executing corresponding software through hardware. The hardware or software includes one or more modules corresponding to the above functions. For example, Figure 16 A schematic diagram of a device for indicating auscultation position is shown. Figure 16 As shown, the device includes: a display module 1601, a recognition module 1602, a prompt module 1603, a processing module 1604, etc.

[0194] Among them, the display module 1601 is used to collect and display the user image, which includes the image of the user's body part to be measured; the identification module 1602 is used to identify the auscultation site of the body part to be measured based on the user image; the display module 1601 is also used to display a first mark on the user image, and the position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured, and is used to instruct the user to place the stethoscope device at the auscultation site.

[0195] In one possible implementation, when the user places the stethoscope on the body part to be measured, the user image further includes: an image of the stethoscope; and a position of the image of the stethoscope on the user image that moves as the user moves the stethoscope on the body part to be measured.

[0196] In another possible implementation, the electronic device is communicatively connected to the auscultation device; the first mark includes a first mark to be auscultated, which is a mark to be auscultated corresponding to a first auscultation site that has not been auscultated among the identified auscultation sites; a prompt module 1603 is used to output a first prompt information, which is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated; and a processing module 1604 is used to store the auscultation data received from the auscultation device when it is determined that the image of the stethoscope device coincides with the first mark to be auscultated.

[0197] In another possible implementation, the first mark further includes marks to be auscultated corresponding to other unauscultated auscultation sites among the identified auscultation sites, and the first mark to be auscultated is closest to the image of the auscultation device among the marks to be auscultated.

[0198] In another possible implementation, the first prompt information includes: an arrow pointing from the image of the stethoscope device to the first mark to be auscultated.

[0199] In another possible implementation, the display module 1601 is further configured to display a second mark corresponding to each mark to be auscultated, where the second mark is configured to indicate the order of auscultation of each auscultation site.

[0200] In another possible implementation, the first prompt information includes: a voice for instructing the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated.

[0201] In another possible implementation, the identification module 1602 is further used to re-identify the first auscultation site based on the auscultation data; the display module 1601 is further used to update and display the first mark to be auscultated based on the re-identified first auscultation site; and the prompt module 1603 is further used to re-output the first prompt information.

[0202] In another possible implementation, the identification module 1602 is specifically configured to obtain the clavicle length of the body part to be measured based on the user image; and determine the auscultation site based on the clavicle length, the user image, and the auscultation position characteristics.

[0203] In another possible implementation, the identification module 1602 is specifically used to obtain displacement data from the stethoscope when the user moves the stethoscope on the body part to be measured. The displacement data is the data collected by the stethoscope when the stethoscope moves from one end of the clavicle to the other end; and determine the user's clavicle length based on the displacement data.

[0204] In another possible implementation, the displacement data is collected by a stethoscope device through a motion sensor.

[0205] In another possible implementation, the prompt module 1603 is further configured to output a second prompt message, where the second prompt message is configured to instruct the user to move the stethoscope device from one end of the clavicle to the other end of the body part to be measured.

[0206] In another possible implementation, the display screen of the electronic device includes a first area and a second area; the display module 1601 is specifically configured to capture and display a user image in the first area; and to display auscultation data from the auscultation device in the second area.

[0207] It should be understood that the division of units or modules (hereinafter referred to as units) in the above devices is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or physically separated. Furthermore, the units in the device may be implemented entirely in the form of software called through processing elements; entirely in the form of hardware; or partially in the form of software called through processing elements, and partially in the form of hardware.

[0208] For example, each unit can be a separately established processing element, or it can be integrated into a certain chip of the device for implementation. In addition, it can also be stored in a memory in the form of a program, and called by a certain processing element of the device to execute the function of the unit. In addition, all or part of these units can be integrated together, or they can be implemented independently. The processing element described here can also be called a processor, which can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above units can be implemented by the integrated logic circuit of the hardware in the processor element or in the form of software called by the processing element.

[0209] In one example, the units in the above apparatus may be one or more integrated circuits configured to implement the above method, such as one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of at least two of these integrated circuit forms.

[0210] For another example, when the units in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a CPU or other processor that can call programs. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0211] In one implementation, the units implementing the corresponding steps of the above methods in the apparatus described above may be implemented in the form of a processing element scheduling program. For example, the apparatus may include a processing element and a storage element, with the processing element invoking a program stored in the storage element to execute the method described in the above method embodiments. The storage element may be a storage element on the same chip as the processing element, i.e., an on-chip storage element.

[0212] In another implementation, the program for executing the above method may be stored in a memory element on a different chip from the processing element, i.e., an off-chip memory element. In this case, the processing element calls or loads the program from the off-chip memory element onto the on-chip memory element to call and execute the method described in the above method embodiment.

[0213] For example, embodiments of the present application may also provide a device, such as an electronic device, which may include a processor and a memory for storing instructions executable by the processor. The processor is configured to execute the instructions, causing the electronic device to implement the method for indicating auscultation position as described in the aforementioned embodiments. The memory may be located within or outside the electronic device. The processor may include one or more.

[0214] In another implementation, the unit of the apparatus implementing each step of the above method may be configured as one or more processing elements, which may be provided on the corresponding electronic device. The processing elements may be integrated circuits, such as one or more ASICs, one or more DSPs, one or more FPGAs, or a combination of these integrated circuits. These integrated circuits may be integrated together to form a chip.

[0215] For example, embodiments of the present application further provide a chip that can be used in the aforementioned electronic device. The chip includes one or more interface circuits and one or more processors; the interface circuits and processors are interconnected via circuits; the processors receive and execute computer instructions from the electronic device's memory via the interface circuits to implement the methods described in the aforementioned method embodiments.

[0216] An embodiment of the present application also provides a computer program product, including computer instructions executed by an electronic device, such as the electronic device described above.

[0217] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0218] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0219] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0220] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0221] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, such as a program. The software product is stored in a program product, such as a computer-readable storage medium, and includes a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

[0222] For example, embodiments of the present application may further provide a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by an electronic device, the electronic device implements the method for indicating auscultation position as described in the aforementioned method embodiment.

[0223] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for indicating auscultation position, characterized in that include: The electronic device collects and displays a user image, wherein the user image includes an image of the user's body part to be measured; The electronic device identifies a plurality of auscultation sites of the body part to be measured based on the user image; The electronic device displays a first mark on the user image, and the position of the first mark on the user image corresponds to the position of the multiple auscultation sites on the body part to be measured. The first mark includes a first mark to be auscultated, and the first mark to be auscultated is a mark to be auscultated corresponding to the first auscultation site that has not been auscultated among the multiple identified auscultation sites. The first mark to be auscultated is closest to the image of the auscultation device among all the marks to be auscultated, and the first mark to be auscultated is used to instruct the user to place the auscultation device one by one at the multiple sites to be auscultated.

2. The method according to claim 1, wherein When the user places the stethoscope on the body part to be measured, the user image further includes: an image of the stethoscope; and a position of the image of the stethoscope on the user image that moves as the user moves the stethoscope on the body part to be measured.

3. The method according to claim 2, wherein The electronic device is communicatively connected to the stethoscope device; After the electronic device displays the first mark on the user image, the method further includes: The electronic device outputs first prompt information, where the first prompt information is used to instruct the user to move the auscultation device to the first auscultation position corresponding to the first mark to be auscultated; After the user moves the stethoscope device according to the first prompt information, the electronic device stores the auscultation data received from the stethoscope device when determining that the image of the stethoscope device coincides with the first mark to be auscultated.

4. The method according to claim 3, wherein The first prompt information includes: an arrow pointing from the image of the auscultation device to the first mark to be auscultated.

5. The method according to any one of claims 3 to 4, characterized in that The first prompt information includes: a voice for instructing the user to move the auscultation device to the first auscultation position corresponding to the first mark to be auscultated.

6. The method according to any one of claims 3 to 4, characterized in that When the electronic device determines that the image of the auscultation device coincides with the first mark to be auscultated, after storing the auscultation data received from the auscultation device, the method further includes: The electronic device re-identifies the first auscultation site according to the auscultation data; The electronic device updates and displays the first mark to be auscultated according to the re-identified first auscultation site, and re-outputs the first prompt information.

7. The method according to any one of claims 1 to 3, wherein: The electronic device identifies a plurality of auscultation sites of the body part to be measured based on the user image, including: The electronic device obtains the clavicle length of the body part to be measured based on the user image; The electronic device determines the multiple auscultation sites according to the clavicle length, the user image and the auscultation position characteristics.

8. The method according to claim 7, wherein When the electronic device displays the image of the stethoscope device on the user image, the electronic device obtains the clavicle length of the body part to be measured based on the user image, including: When the user moves the stethoscope device on the body part to be measured, the electronic device obtains displacement data from the stethoscope device, wherein the displacement data is data collected by the stethoscope device during the process of the stethoscope device moving from one end of the clavicle to the other end; The electronic device determines the clavicle length of the user based on the displacement data.

9. The method according to claim 8, wherein The displacement data is collected by the stethoscope device through a motion sensor.

10. The method according to claim 8, wherein Before the electronic device obtains the clavicle length of the body part to be measured based on the user image, the method further includes: The electronic device outputs second prompt information, where the second prompt information is used to instruct the user to move the stethoscope device from one end of the clavicle to the other end of the body part to be measured.

11. The method according to any one of claims 1 to 3, wherein: The display screen of the electronic device includes a first area and a second area; The electronic device collecting and displaying the user image includes: the electronic device collecting and displaying the user image in the first area; The method further includes: the electronic device displaying the auscultation data from the auscultation device in the second area.

12. An electronic device, characterized in that: include: a processor, a memory for storing instructions executable by the processor; When the processor is configured to execute the instructions, the electronic device implements the method according to any one of claims 1 to 11.

13. A computer-readable storage medium having computer program instructions stored thereon; characterized in that: When the computer program instructions are executed by an electronic device, the electronic device is enabled to implement the method according to any one of claims 1 to 11.

Images