System for generating and editing ultrasound images
The system addresses the challenge of large file sizes and transmission times in ultrasound imaging by selectively capturing and editing images based on fetal movement and gray scale analysis, enhancing user experience and reducing costs.
Patent Information
- Application Number
- JP2023579186
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-11-11
- Filing Date
- 2023-06-19
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2043-06-19
AI Technical Summary
Existing ultrasound imaging systems capture and store entire examination periods, resulting in large file sizes and prolonged transmission times, making it difficult and costly to share meaningful fetal images with patients.
A system that intelligently captures ultrasound images based on fetal movement detection and gray scale analysis, allowing for selective image capture and editing, reducing file size and transmission time by only storing significant moments.
The system efficiently reduces storage and transmission costs while enhancing user experience by providing only meaningful fetal images, improving usability and management of ultrasound data.
Smart Images

Figure 2024545381000001_ABST
Abstract
Description
[Technical field]
[0001] The following embodiment relates to a system for generating and editing ultrasound images. [Background technology]
[0002] An ultrasound diagnostic device can refer to a device that irradiates ultrasound signals from the surface of a subject's body toward a specific location inside the body and non-invasively obtains images of soft tissue cross-sections and blood flow using information from the reflected ultrasound signals (ultrasound echo signals).
[0003] Compared with other imaging diagnostic devices such as X-ray diagnostic devices, CT scanners (Computerized Tomography Scanners), Magnetic Resonance Imaging (MRI) devices, and nuclear medicine diagnostic devices, ultrasound diagnostic devices have the advantages of being small and inexpensive, capable of displaying images in real time, and highly safe as they do not involve exposure to X-rays, etc. Due to these advantages, ultrasound diagnostic devices are widely used for diagnoses of the heart, breasts, abdomen, urology, and obstetrics and gynecology.
[0004] The examiner can perform ultrasound diagnosis by holding a probe in one hand and moving the probe in contact with the surface of the subject's body while operating a control panel with the other hand. Ultrasound images obtained by such ultrasound diagnosis are displayed on a display in real time, allowing the examiner to diagnose the condition of the subject.
[0005] After taking a photograph of the fetus inside the pregnant woman's womb, the hospital will transmit the ultrasound photograph of the fetus to the pregnant woman, who can then view it and inform her family of the fetus's development. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Korean Patent No. 10-1588915 [Patent Document 2] Korean Patent No. 10-2002408 Summary of the Invention [Problem to be solved by the invention]
[0007] When capturing images of the fetus displayed on the display during an examination, there are no editing points and it is difficult to distinguish important moments, so all images captured during the examination period can be stored and transmitted to the user.
[0008] In this case, since the length of the captured video is relatively long, it takes up a relatively large amount of storage capacity, and since the file size is large when transmitting the video to a user, it takes a long time to communicate, which increases costs. A user who receives the video can view the video to understand the condition of the fetus or inform others around them, but if the video length exceeds a certain time, it may be difficult for the user to immediately understand the condition of the fetus, and the capacity may be too large to transmit to others.
[0009] Unlike a method of capturing and storing all sections from the moment the examination begins until a user inputs that the examination is ended, the system for generating and editing ultrasound images according to one embodiment starts capturing images from the moment the examiner's ultrasound probe touches the subject after the examination begins, and can detect that the examination has ended based on the gray scale and motion level of the image and stop capturing images.
[0010] A system for generating and editing ultrasound images according to one embodiment can capture images of moments when fetal movement is present or when the examiner determines that the images are important based on the grayscale and motion level of the images, and provide the images separately to the user. [Means for solving the problem]
[0011] The system for generating and editing ultrasound images of the present document may include a memory and a processor. The processor may transmit a signal to an ultrasound device requesting that imaging be started based on a probe contacting the skin of a pregnant woman, obtain an image signal from the ultrasound device, determine that the imaging screen is in a stopped state based on an amount of change in pixels of an imaging screen corresponding to the image signal received from the ultrasound device being less than a specified level and this section being maintained for more than a specified time, take a snapshot of the imaging screen at a time point when it is determined that the imaging screen is in a stopped state and store it separately in the memory, suspend imaging from the first time point based on the probe not moving from the time point when the snapshot was taken until a first time point that exceeds a specified time, resume imaging based on the probe moving again, determine that medical treatment is completed based on a gray scale value of the imaging screen exceeding a specified level, transmit a signal to the ultrasound device requesting that imaging be completed, and store images captured from the start moment of imaging to the end moment of imaging in the memory based on the end of imaging.
[0012] The system according to an embodiment may be controlled by a computer program stored on a medium in combination with hardware to perform any one of the methods described above. Effect of the Invention
[0013] In one embodiment, the system starts recording the moment the examiner's ultrasound probe touches the subject after the examination begins, and detects that the examination has ended based on the grayscale and motion level of the image and stops recording, thereby reducing the size of the recorded image stored in memory.
[0014] The system of one embodiment can reduce the size of captured video stored in memory, thereby reducing transmission time and costs, and provide a user experience that makes it easier for users to use and manage video.
[0015] The system according to one embodiment can automatically edit meaningful sections of the fetal image based on the examiner's movements and the grayscale and motion level of the captured image, and provide them to the user. [Brief description of the drawings]
[0016] [Figure 1A] 1 is a diagram illustrating a situation in which an ultrasound imaging device according to an embodiment captures an ultrasound image and obtains user authentication information from a server. [Figure 1B] 1 is a diagram illustrating a probe of an ultrasonic imaging device according to an embodiment; [Diagram 2] 1 is a block diagram illustrating a configuration of a system for generating and editing an ultrasound image according to an embodiment. [Diagram 3] 1 is a flowchart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment. [Figure 4] 1 is a flow chart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. However, various modifications may be made to the embodiments, and the scope of the patent application is not limited or restricted by such embodiments. It should be understood that all modifications, equivalents, or alternatives to the embodiments are included in the scope of the patent.
[0018] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only, and may be modified and implemented in various forms. Therefore, the embodiments are not limited to the specific disclosed forms, and the scope of the present specification includes modifications, equivalents, or alternatives within the technical spirit.
[0019] Although terms such as "first" or "second" may be used to describe various components, such terms are used only to distinguish one component from another component. For example, a first component may be named a second component, and similarly, a second component may be named a first component.
[0020] When an element is referred to as being "coupled" to another element, it should be understood that although it may be directly coupled or connected to the other element, there may be other elements between the elements.
[0021] The terms used in the examples are merely used for the purpose of explanation and should not be construed as limiting. A singular expression includes a plural expression unless the context clearly indicates otherwise. In this specification, the terms "include" or "have" are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and should be understood not to preclude the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0022] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiments belong. Terms as defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted as idealized or overly formal unless expressly defined in this application.
[0023] In addition, in the description with reference to the accompanying drawings, the same components are given the same reference numerals regardless of the reference numerals, and the duplicated description thereof will be omitted. In the description of the embodiments, if it is determined that a detailed description of related prior art may unnecessarily obscure the gist of the embodiments, the detailed description thereof will be omitted.
[0024] Embodiments may be implemented in a variety of product forms, such as personal computers, laptop computers, tablet computers, smartphones, televisions, smart home appliances, intelligent automobiles, kiosks, and wearable devices.
[0025] FIG. 1A illustrates a situation in which an ultrasound imaging device according to an embodiment captures an ultrasound image and obtains user authentication information from a server.
[0026] According to FIG. 1A, an electronic device (e.g., ultrasound imaging device) 10 in the system can receive pregnancy-related information of a patient (e.g., expectant mother, pregnant woman) from a user. The pregnancy-related information can include at least one of the patient's last menstrual period (LMP) and date of conception (DOC). The electronic device 10 can obtain an ultrasound image of a fetus by irradiating an ultrasound signal to the abdomen of the patient 30 via an ultrasound probe 50 and receiving an ultrasound echo signal reflected from the patient 30. The electronic device 10 can measure the size of a fetus's body part on the ultrasound image of the fetus. The electronic device 10 can receive member information including an identifier from the server 20. The member information can be determined differently depending on the patient 30, and can include at least one of the member's name, the name of the fetus, the number of months of pregnancy, and the examination date. The electronic device 10 can receive pregnancy information and associated body measurement data of the fetus from the server 20. The server 20 can collect fetal body size information received from multiple different devices and store big data on fetal body measurements. In one embodiment, the server 20 can provide information about the patient 30 and the patient's fetus (e.g., the degree of growth compared to other fetuses, fetal biparietal diameter (BPD), abdominal circumference (AC), head circumstance (HC), occipitofrontal diameter (OFD), and femur length (FL)) based on the big data on fetal body measurements.
[0027] According to an embodiment, the electronic device 10 can start capturing an ultrasound image when the examiner 40 touches the probe 50 to a body part of the patient 30. The electronic device 10 can obtain information of the patient 30 or information of a user using the server 20, and transmit captured images and edited images or images to a user terminal or a terminal of the patient 30. Capturing and editing of an ultrasound image will be described with reference to FIG. 3.
[0028] FIG. 1B illustrates a probe of an ultrasonic imaging device according to an embodiment.
[0029] 1B, a tip of the probe 50 may include a plurality of ultrasonic transducers 120 that generate ultrasonic waves according to an electrical signal, and a sample image acquisition unit 150. The ultrasonic transducer 120 may generate ultrasonic waves according to an applied AC power source. The ultrasonic transducer 120 may receive AC power from an external power supply device or an internal power storage device, such as a battery. The piezoelectric vibrator or thin film of the ultrasonic transducer 120 may generate ultrasonic waves by vibrating according to the supplied AC power source. The ultrasonic transducer 120 may include, for example, any one of a magnetostrictive ultrasonic transducer that uses the magnetostrictive effect of a magnetic material, a piezoelectric ultrasonic transducer that uses the piezoelectric effect of a piezoelectric material, and a capacitive micromachined ultrasonic transducer that transmits and receives ultrasonic waves using the vibration of hundreds or thousands of micromachined thin films. The ultrasonic transducers 120 may be arranged in a straight line (linear array) or in a curved line (convex array).
[0030] The sample image acquiring unit 150 may acquire one or more sample images having different brightness by photographing the subject, i.e., the skin of the pregnant woman. Here, the sample image may refer to an image including information on the skin color and skin texture of the pregnant woman. The sample image acquiring unit 150 may be embodied as a camera module in which a lens, an image sensor, an IR filter (infrared blocking filter), an actuator, and an FPCB (Flexible PCB) are assembled. In this case, the exposure time of the camera module may be controlled to acquire sample images having different brightness. In this case, the exposure time of the camera module may be controlled during ultrasound diagnosis. The sample image acquiring unit 150 may be embodied only with an image sensor. The image sensor may include, for example, a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor. The image sensor may include an external lens, a microlens, a color filter array, a pixel array, an A / D converter that converts an analog signal read from the pixel array into a digital signal, and a digital signal processing unit that processes the digital signal output from the A / D converter.
[0031] FIG. 2 is a diagram illustrating an example of a configuration of a system for generating and editing an ultrasound image according to an embodiment.
[0032] The system 201 according to an embodiment may include a processor 220 and a memory 230, and some of the components shown in the figure may be omitted or replaced. The system 201 according to an embodiment may be a server or a terminal. According to an embodiment, the processor 220 may be configured to perform calculations and data processing related to control and / or communication of each component of the system 201, and may be configured with one or more processors. The memory 230 may store information related to the above-mentioned method or a program in which the above-mentioned method is embodied. The memory 230 may be a volatile memory or a non-volatile memory. The memory 230 may store various file data, and the stored file data may be updated by the operation of the processor 220.
[0033] According to one embodiment, the processor 220 can execute a program and control the system 201. Code of the program executed by the processor 220 can be stored in the memory 230. The operation of the processor 220 can be performed by loading instructions stored in the memory 230. The system 201 can be connected to and exchange data with an external device (e.g., a personal computer or a network) via an input / output device (not shown).
[0034] According to an embodiment, the system 201 may further include a microphone. The processor 220 may use the microphone to receive the intensity of the audio output signal of the captured image, amplify the intensity of the audio output signal of the captured image based on the intensity of the audio output signal being less than (or equal to) a specified level, and further increase the degree of amplification of the intensity of the audio output signal of the captured image based on the intensity of audio noise caused by the external environment in the captured image being greater than a specified level.
[0035] According to an embodiment, the processor 220 may amplify the strength of the audio output signal so that the strength of the audio output signal of the captured image has a value between -10 dB and 10 dB based on the strength of the audio output signal being less than (or equal to or less than) a specified level (e.g., -20 dB). If the maximum volume in the ultrasound image is less than (or equal to or less than) a specified level (e.g., -20 dB), the processor 220 may amplify the sound in the ultrasound image by at least 10 dB and increase the volume to approach 0 dB. The processor 220 may amplify the sound in the ultrasound image in a general noise environment (e.g., 0 to 40 dB) in which the user uses the terminal, to assist the user in recognizing the sound. The strength of the audio output signal and the strength of the amplified signal are merely examples and are not limited thereto.
[0036] According to an embodiment, the processor 220 transmits a signal to the ultrasound device requesting that imaging be started when the probe comes into contact with the skin of the pregnant woman, receives an image signal from the ultrasound device, determines that the imaging screen is in a stopped state when an amount of change in pixels of the imaging screen corresponding to the image signal received from the ultrasound device is less than a specified level and such a period is maintained beyond a specified time, takes a snapshot of the imaging screen at a time when it is determined that the imaging screen is in a stopped state and stores it separately in the memory 230, suspends imaging from the first time point when the probe does not move until a first time point that exceeds a specified time from the time when the snapshot was taken, resumes imaging when the probe moves again, determines that treatment is in a finished state when a gray scale value of the imaging screen exceeds a specified level, transmits a signal to the ultrasound device requesting that imaging be finished, and stores images taken from the start moment of imaging to the end moment of imaging in the memory 230 when imaging is finished.
[0037] According to an embodiment, the processor 220 may determine that a user of the external device has entered the examination room based on recognizing an identifier displayed on the external device, establish a communication connection with the external device, and transmit the snapshots and the images captured from the start of capture to the end of capture stored in the memory 230 to the external device recognized via the identifier based on the end of capture. The identifier may include at least one of a QR code, radio frequency identification (RFID), near field communication (NFC), and a barcode.
[0038] When the shooting is completed, the processor 220 can automatically transmit the snapshot and the shot video to the user (eg, a pregnant woman), thereby providing convenience to the user.
[0039] According to one embodiment, there is no limitation on the calculation and data processing functions that the processor 220 can realize on the system 201. Below, a detailed description will be given of a function that starts recording the moment the examiner's ultrasound probe touches the subject after the start of the examination, and detects that the examination has ended based on the grayscale and motion level of the image and stops recording, thereby reducing the size of the captured image stored in memory.
[0040] FIG. 3 is a flow chart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment.
[0041] The operations described in Fig. 3 may be realized based on instructions that can be stored in a computer storage medium or memory (e.g., memory 230 in Fig. 2). The illustrated method may be performed by the system (e.g., system 201 in Fig. 2) previously described in Figs. 1A to 2, and the technical features as described above will be omitted below. The order of the operations in Fig. 3 may be changed, some operations may be omitted, and some operations may be performed simultaneously.
[0042] In operation 310, a processor (e.g., processor 220 of FIG. 2) can transmit a signal to the ultrasound device requesting that imaging begin based on the probe (e.g., probe 50 of FIG. 1A) contacting the skin of the pregnant woman, and can acquire a video signal from the ultrasound device.
[0043] In operation 320, the processor 220 can determine that the image capture is frozen based on the amount of change in pixels of the image capture being less than a specified level and such a period being maintained for more than a specified time.
[0044] In one embodiment, processor 220 can determine that the captured image is in a frozen state based on the amount of change in pixels of the captured image being less than approximately 5% and the period during which the amount of change in pixels of the captured image is less than a specified level (e.g., 5%) exceeding a specified time (e.g., 3 seconds).
[0045] In one embodiment, the processor 220 can classify pixel values of the captured image into lightness, chroma, and hue, calculate shading values and depth values based on the lightness, chroma, and hue of the pixels of the captured image, determine the grayscale of the captured screen based on the shading values, and determine the amount of change of the pixels of the captured image based on the shading values and depth values.
[0046] In operation 330, the processor 220 may take a snapshot of the captured image once it has been determined that the captured image is frozen.
[0047] In operation 340, the processor 220 can abort capture from the first time point based on the probe not moving from the time the snapshot was taken until the first time point that exceeds a specified time.
[0048] In one embodiment, the first time point is a state where the examiner stops moving the probe (e.g., the probe 50 in FIG. 1B) to explain a particular situation to the pregnant woman, but is not a state where the imaging is completed. The first time point may be a state where there is fetal movement or an important change in the fetus, since the examiner is explaining a particular situation to the pregnant woman. The processor 220 may capture the imaging screen at the first time point as a snapshot, store it separately in the memory 230, and transmit it to the user (e.g., the pregnant woman). The processor 220 may collect and provide the user with only relatively important moments for the fetus so that it may save time and communication costs compared to the case where the entire ultrasound image must be reviewed, and may provide convenient usability in editing the image.
[0049] In one embodiment, the processor 220 may determine that a user of the external device has entered the examination room based on recognizing an identifier displayed on the external device, and may establish a communication connection with the external device. Based on the end of shooting, the processor 220 may transmit the snapshots stored in the memory 230 and the video captured from the start of shooting to the end of shooting to the recognized external device via the identifier. The identifier may include at least one of a QR code, radio frequency identification (RFID), near field communication (NFC), and a barcode.
[0050] In one embodiment, the processor 220 may display a first parenting message corresponding to the user's entry into the examination room based on recognizing the identifier displayed on the external device, a second parenting message at the moment of starting image capture based on the probe 50 contacting the skin of the pregnant woman, a third parenting message at the time when it is determined that the image capture screen is in a stopped state, and a fourth parenting message at the time when image capture ends based on the gray scale value of the image capture screen exceeding a specified level. For example, the first parenting message may include the time and date when the pregnant woman entered the examination room. The second parenting message may include a message indicating that image capture is to begin. The third parenting message may include a message indicating that it is an important moment. The fourth parenting message may include a message indicating that image capture has ended.
[0051] In one embodiment, the processor 220 may classify at least one snapshot taken at a moment when it is determined that the shooting has stopped by shooting date, and display a timestamp indicating a point in time when the at least one snapshot is included in an image taken from a shooting start moment to a shooting end moment. The processor 220 may collect at least one snapshot to generate a separate image, add a preset message or special effect, and transmit the generated image to an external device (e.g., a user terminal).
[0052] In operation 350, the processor 220 may determine whether the medical treatment is complete based on the grey scale value of the captured image.
[0053] In one embodiment, the processor 220 can determine that the medical treatment has ended based on the grayscale value of the captured image exceeding 70%. The processor 220 can display information indicating that the medical treatment has ended and that the recording of the captured image has been completed on a display (not shown) based on the determination that the medical treatment has ended. The processor 120 can transmit information indicating that the medical treatment has ended and that the recording of the captured image has been completed to an external device (e.g., a user terminal) based on the determination that the medical treatment has ended.
[0054] In operation 360, the processor 220 can store in memory the video captured from the start of shooting to the end of shooting based on the determination that shooting has ended.
[0055] The processor 220 can transmit the snapshots stored in the memory 130 and the video captured from the start of the shooting to the end of the shooting to an external device based on the end of the shooting. When the shooting ends, the processor 220 can provide convenience to the user by automatically transmitting the snapshots and the captured video to the user (e.g., a pregnant woman).
[0056] FIG. 4 is a flow diagram illustrating a method for generating and editing an ultrasound image in a system according to an embodiment.
[0057] The operations described in Fig. 4 may be realized based on instructions that can be stored in a computer storage medium or memory (e.g., memory 230 in Fig. 2). The illustrated method may be performed by the system (e.g., system 201 in Fig. 2) previously described in Figs. 1A to 2, and the technical features as described above will be omitted below. The order of the operations in Fig. 4 may be changed, some operations may be omitted, and some operations may be performed simultaneously.
[0058] In operation 410, a processor (e.g., processor 220 of FIG. 2) may determine whether a probe (e.g., probe 50 of FIG. 1A) has contacted the skin of the pregnant woman (or patient). The processor 220 may not start capturing video if the probe 50 has not contacted the skin of the pregnant woman, and may continually sense whether the probe 50 has contacted the skin of the pregnant woman.
[0059] In operation 412, the processor 220 may begin capturing video based on the contact of the probe 50 with the skin of the pregnant woman. The processor 220 may determine the moment when the capture begins based on the movement of the probe 50, and begin capturing video to reduce the length of the video.
[0060] In operation 420, the processor 220 can determine whether the amount of change in pixels of the captured image is less than a specified level, and whether the interval in which the amount of change in pixels is less than the specified level is maintained for more than a specified time.
[0061] In one embodiment, the processor 220 may determine that the image is frozen based on the amount of change in pixels of the image being less than (or equal to) a specified level (e.g., about 5%) and the period during which the amount of change in pixels of the image is less than the specified level (e.g., about 5%) exceeds a specified time (e.g., about 3 seconds). If the image continues to be recorded even though the image is frozen, the length of the captured ultrasound image may become longer and may occupy a relatively large amount of capacity on the memory 230. In addition, the user may have difficulty checking important moments (e.g., the moment the fetus moves, or the moment a different appearance is observed) because the image is too long. The system for generating and editing ultrasound images according to the present document detects a frozen state of the image and stops recording to reduce the length of the entire image, while capturing an image of the fetus at an important moment when the examiner stops the probe and explains something to the user (e.g., pregnant woman) and providing it to the user separately.
[0062] In one embodiment, the processor 220 can classify pixel values of the captured image into lightness, chroma, and hue, calculate shading values and depth values based on the lightness, chroma, and hue of the pixels of the captured image, determine the grayscale of the captured screen based on the shading values, and determine the amount of change of the pixels of the captured image based on the shading values and depth values.
[0063] In operation 422, the processor 220 can continue imaging based on whether the amount of change in pixels on the imaging screen exceeds a certain level or the section in which the amount of change in pixels on the imaging screen is less than the certain level does not exceed a specified time. When the amount of change in pixels on the imaging screen exceeds the certain level, the processor 220 can determine that imaging should be continued while the probe 50 moves again, and resume imaging instead of interrupting the video. When the section in which the amount of change in pixels on the imaging screen is less than the certain level does not exceed a specified time (e.g., 3 seconds), the processor 220 can determine that the examiner has not stopped moving the probe 50, and can continue imaging.
[0064] In operation 425, the processor 220 may determine that the image capture screen is in a stopped state based on the amount of change in pixels of the image capture screen being less than a specified level and the section being maintained for more than a specified time. When the processor 220 determines that the image capture screen is in a stopped state, the processor 220 may reduce the length of the recorded ultrasound image (or fetal image) by interrupting recording. The processor 220 may also take a snapshot of the image capture screen at the time when the processor 220 determines that the image capture screen is in a stopped state and store it in the memory 230. The reason for switching to a stopped state during the progress of imaging is for the examiner to explain the image capture screen to the pregnant woman, and such an image capture screen may correspond to an important moment that requires explanation to the pregnant woman. The processor 220 may take a snapshot of the image capture screen at the time when the processor 220 determines that the image capture screen is in a stopped state, store it separately in the memory 230, and provide it to the pregnant woman later.
[0065] In operation 430, the processor 220 may determine whether the grayscale value exceeds a certain level. In one embodiment, the processor 220 may classify the pixel values of the captured image into lightness, chroma, and hue, calculate a shade value and a depth value based on the lightness, chroma, and hue of the pixel of the captured image, and determine the grayscale of the captured image based on the shade value.
[0066] In operation 435, the processor 220 can determine that image capture is not complete based on the grayscale value being below a certain level, and the processor 220 can subsequently begin image capture again based on the movement of the probe (e.g., probe 50 in FIG. 1A).
[0067] In operation 440, the processor 220 can determine that the image capture is completed based on the grayscale value exceeding a certain level, and can end the image capture (or recording). The processor 220 can prevent unnecessary parts from being further recorded and the length of the video from increasing after the image capture is completed and the medical treatment is completed.
[0068] In operation 450, the processor 220 can store the captured video from the start moment to the end moment in the memory 130. The processor 220 can automatically transmit the captured video to a registered user.
[0069] In one embodiment, the processor 220 may classify at least one snapshot taken at a moment when it is determined that the shooting has stopped by shooting date, and display a timestamp indicating a point in time when the at least one snapshot is included in an image taken from a shooting start moment to a shooting end moment. The processor 220 may collect at least one snapshot to generate a separate image, add a preset message or special effect, and transmit the generated image to an external device (e.g., a user terminal).
[0070] According to one embodiment, the processor 220 can determine that the image is frozen based on the amount of change in pixels of the image being less than 5% and the period during which the amount of change in pixels of the image being less than 5% exceeds 3 seconds, and can determine that treatment has ended based on the grayscale value of the image being more than 70%.
[0071] According to one embodiment, the processor 220 receives the intensity of the audio output signal of the captured image using a microphone, and amplifies the intensity of the audio output signal of the captured image based on the intensity of the audio output signal being below (or equal to) a specified level, and can further increase the degree of amplification of the intensity of the audio output signal of the captured image based on the intensity of audio noise due to the external environment in the captured image exceeding a specified level.
[0072] According to one embodiment, the processor 220 can amplify the strength of the audio output signal so that the strength of the audio output signal of the captured image has a value between -10 dB and 10 dB based on the strength of the audio output signal being less than (or equal to) -10 dB.
[0073] According to one embodiment, based on determining that imaging has ended, the processor 220 can display information on the display indicating that the medical treatment has ended and that recording of the captured image has been completed.
[0074] According to one embodiment, based on determining that the imaging has ended, the processor 220 can transmit information indicating that the medical treatment has ended and the recording of the imaging video has been completed to an external device.
[0075] The embodiments described above may be implemented with hardware components, software components, and / or a combination of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, the processing device may be described as being one in which one is used, but one skilled in the art will appreciate that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.
[0076] The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of computer readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, flash memories, and the like. Examples of program instructions include not only machine code, such as generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter, and the like. The hardware devices may be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.
[0077] The software may include a computer program, code, instructions, or a combination of one or more of these, and may configure or instruct a processing device to operate as desired, either individually or collectively. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.
[0078] As described above, although the embodiments have been described with reference to the drawings, those having ordinary skill in the art may apply various technical modifications and variations based on the above. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be replaced or substituted by other components or equivalents, and still achieve suitable results.
[0079] Accordingly, other implementations, embodiments, and equivalents of the claims are intended to be within the scope of the following claims.
Claims
1. 1. A system for generating and editing ultrasound images, comprising: Memory, a processor; The processor, Transmitting a signal to an ultrasound device to request the ultrasound device to start imaging based on the contact of the probe with the skin of the pregnant woman, and acquiring a video signal from the ultrasound device; determining that the image capture screen is in a stopped state based on the fact that a change in pixel of the image capture screen corresponding to the image signal received from the ultrasound device is less than a specified level and such a section is maintained for more than a specified time; When it is determined that the photographed screen is frozen, a snapshot is taken on the photographed screen and stored separately in the memory; interrupting the image capture from the first time point based on the probe not moving from the time point of the snapshot capture to a first time point that exceeds a specified time; resuming imaging based on the probe moving again; Based on the gray scale value of the image capturing screen exceeding a designated level, it is determined that the medical treatment has ended, and a signal is transmitted to the ultrasound device requesting that the image capturing be ended; The system stores, in the memory, the images shot from the start of shooting to the end of shooting based on the end of shooting.
2. The processor, determining that a user of the external device has entered the examination room based on recognizing an identifier displayed on the external device and establishing a communications connection with the external device; Based on the completion of the shooting, the snapshots stored in the memory and the video shot from the start of shooting to the end of shooting are transmitted to the external device recognized via the identifier; The system of claim 1 , wherein the identifier comprises at least one of a QR code, a radio frequency identification (RFID), a near field communication (NFC), and a barcode.
3. The processor, displaying a first child care message responsive to the user entering the examination room based on recognizing the identifier displayed on the external device; displaying a second childcare message at the moment when the probe comes into contact with the skin of the pregnant woman and starts photographing; displaying a third childcare message when it is determined that the photographing screen is in a stopped state; The system of claim 2 , further comprising: displaying a fourth parenting message when the photographing ends based on a grayscale value of the photographed screen exceeding a specified level.
4. The processor, determining that the captured image is in a stopped state based on the fact that the amount of change in pixels of the captured image is less than 5% and the period during which the amount of change in pixels of the captured image is less than 5% exceeds 3 seconds; The system of claim 1 , wherein the treatment is determined to be completed based on the grayscale value of the captured image exceeding 70%.
5. The processor, The pixel values of the captured image are classified into lightness, chroma, and hue. Calculating a shading value and a depth value based on the brightness, saturation and hue of pixels of the captured image; determining a gray scale of the photographed image based on the shading value; The system of claim 1 , further comprising: determining a change in pixels of the captured image based on the shadow and depth values.
6. The system further includes a microphone; The processor, Using the microphone, receive an audio output signal intensity of the captured video; amplifying a strength of the audio output signal of the captured video based on the strength of the audio output signal being less than (or equal to) a specified level; The system of claim 1 , further increasing a degree of amplification of the intensity of the audio output signal of the captured video based on the intensity of audio noise due to the external environment in the captured video exceeding a specified level.
7. The processor, The system of claim 6, further comprising: amplifying the strength of the audio output signal of the captured video to have a value between -10 dB and 10 dB based on the strength of the audio output signal being less than (or equal to) -10 dB.
8. The processor, The system according to claim 1 , further comprising: a display that displays information indicating that the medical treatment has ended and that recording of the captured video has been completed, based on the determination that the imaging has ended.
9. The processor, The system according to claim 1 , further comprising: a transmitting section configured to transmit information indicating that the medical treatment has ended and that recording of the captured image has been completed to an external device based on a determination that the imaging has ended.
10. The processor, classifying at least one snapshot taken at the moment when the photographing screen is determined to be in a frozen state by photographing date; A time stamp is displayed indicating a time when the snapshot is included in the video taken from the moment the video starts to the moment the video is stopped, Collect at least one snapshot to generate a separate image, The system of claim 1 , further comprising: adding and transmitting a pre-set message or special effect to an external device.
Citation Information
Patent Citations
Ultrasonic diagnosing apparatus
JP1992158848A
Information-processing device, ultrasonic diagnostic device, information-processing method, and information-processing program
WO2022113858A1
Ultrasound imaging reading system
KR101588915B1
Apparatus and method for generating ultrasonic image
KR102002408B1
