System for generating and editing ultrasound images

Abstract

The ultrasound image generating and editing systems of this document may include a memory and a processor. The processor can transmit a signal to the ultrasound equipment requesting that imaging begin based on the probe coming into contact with the pregnant woman's skin, and can determine whether the imaging screen is frozen based on the video signal obtained from the ultrasound equipment and the amount of change in pixels on the imaging screen. The processor can take a snapshot of the capture screen when it determines that the capture screen is frozen, and can decide to pause or resume capture based on the motion of the probe. The processor can transmit a signal to the ultrasound equipment requesting that the imaging be terminated based on the gray scale value of the imaging screen exceeding a specified level, and can store the images captured from the start of imaging to the end of imaging in memory.

Description

[Technical Field]

[0001] The following example relates to a system for generating and editing ultrasound images. [Background technology]

[0002] An ultrasound diagnostic device can refer to a device that irradiates ultrasound signals from the surface of a subject's body toward a specific location inside the body and uses information from the reflected ultrasound signals (ultrasound echo signals) to non-invasively obtain images of soft tissue cross-sections and blood flow.

[0003] Compared to other imaging diagnostic devices such as X-ray diagnostic devices, CT scanners (Computerized Tomography Scanners), Magnetic Resonance Imaging (MRI) devices, and nuclear medicine diagnostic devices, ultrasound diagnostic devices have the advantages of being small and inexpensive, capable of displaying images in real time, and highly safe as they do not involve exposure to X-rays, etc. Due to these advantages, ultrasound diagnostic devices are widely used for diagnoses of the heart, breasts, abdomen, urinary system, and obstetrics and gynecology.

[0004] The examiner can perform ultrasound diagnosis by holding a probe in one hand, moving the probe in contact with the surface of the subject's body, and operating a control panel with the other hand. Ultrasound images obtained through such ultrasound diagnosis are displayed on a display in real time, allowing the examiner to diagnose the condition of the subject.

[0005] After taking a photograph of the fetus inside the pregnant woman's womb, the hospital will transmit the ultrasound photograph of the fetus to the pregnant woman, who can then view it and inform her family of the fetus's development. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Korean Patent No. 10-1588915 [Patent Document 2] Korean Patent No. 10-2002408 Summary of the Invention [Problem to be solved by the invention]

[0007] When capturing images of the fetus displayed on the screen during an examination, there are no particular editing points and it is difficult to distinguish important moments, so all images captured during the examination period can be stored and transmitted to the user.

[0008] In this case, since the length of the captured video is relatively long, it takes up a relatively large amount of storage capacity, and when transmitting the video to a user, the file size is large, which results in a long communication time and increased costs. A user who receives the video can view it to understand the condition of the fetus or notify those around them, but if the video length exceeds a certain time, it may be difficult for the user to immediately understand the condition of the fetus, and the capacity may be too large to transmit to those around them.

[0009] Unlike a method of capturing and storing all sections from the moment the examination begins until a user inputs that the examination is finished, the system for generating and editing ultrasound images according to one embodiment starts capturing images from the moment the examiner's ultrasound probe comes into contact with the subject after the examination begins, and can detect that the examination has finished based on the gray scale and motion level of the image and stop capturing images.

[0010] A system for generating and editing ultrasound images according to one embodiment can capture images of moments when fetal movement is present or when the examiner deems the moment important based on the grayscale and motion level of the image, and provide the captured images separately to the user. [Means for solving the problem]

[0011] The system for generating and editing ultrasound images of the present document may include a memory and a processor. The processor may transmit a signal to an ultrasound device requesting that imaging be started when a probe contacts the skin of a pregnant woman, acquire a video signal from the ultrasound device, determine that the imaging screen is in a stopped state when a change in pixels of the imaging screen corresponding to the video signal received from the ultrasound device is less than a specified level and this period is maintained for more than a specified time, take a snapshot of the imaging screen at the time when it is determined that the imaging screen is in a stopped state and store the snapshot separately in the memory, suspend imaging from the first time point when the probe does not move until a first time point that exceeds a specified time from the time when the snapshot was taken, resume imaging when the probe moves again, determine that treatment is complete when a gray scale value of the imaging screen exceeds a specified level, transmit a signal to the ultrasound device requesting that imaging be stopped, and store images captured from the start time of imaging to the end time of imaging in the memory when imaging is completed.

[0012] The system according to one embodiment may be controlled by a computer program stored on a medium in combination with hardware to perform any one of the methods described above. [Effects of the Invention]

[0013] In one embodiment, the system starts recording the moment the examiner's ultrasound probe comes into contact with the subject after the examination begins, and detects that the examination has ended based on the grayscale and motion level of the image and stops recording, thereby reducing the size of the recorded image stored in memory.

[0014] The system according to one embodiment can reduce the size of the captured video stored in memory, thereby reducing transmission time and costs, and provide a user experience that makes it easier for users to use or manage the video.

[0015] The system according to one embodiment can automatically edit meaningful sections of the fetal video based on the examiner's movements and the grayscale and motion level of the captured image, and provide them to the user. [Brief explanation of the drawings]

[0016] [Figure 1A] 10A and 10B are diagrams illustrating a situation in which an ultrasound imaging device according to an embodiment captures an ultrasound image and acquires user authentication information from a server. [Figure 1B] 1 is a diagram illustrating a probe of an ultrasound imaging device according to an embodiment; [Figure 2] 1 is a block diagram illustrating a configuration of a system for generating and editing an ultrasound image according to an embodiment. [Figure 3] 1 is a flowchart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment. [Figure 4] 1 is a flowchart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. However, various modifications may be made to the embodiments, and the scope of the patent application is not limited or restricted by such embodiments. It should be understood that all modifications, equivalents, or alternatives to the embodiments are included in the scope of the patent application.

[0018] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Therefore, the embodiments are not limited to the specific disclosed forms, and the scope of this specification includes modifications, equivalents, or alternatives within the technical spirit.

[0019] Although terms such as "first" or "second" may be used to describe various components, such terms are used only to distinguish one component from another. For example, a first component may be named a second component, and similarly, a second component may be named a first component.

[0020] When a component is referred to as being "coupled" to another component, it should be understood that although the component may be directly coupled or connected to the other component, there may be other components between the components.

[0021] The terms used in the examples are used merely for the purpose of explanation and should not be construed as limiting. The singular term includes the plural term unless the context clearly indicates otherwise. In this specification, the terms "comprise" or "have" and the like are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and should be understood not to preclude the presence or possibility of addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0022] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiments pertain. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted as having an ideal or overly formal meaning unless expressly defined in this application.

[0023] In addition, in the description with reference to the accompanying drawings, the same components are given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. In describing the embodiments, if it is determined that a detailed description of related known technology may unnecessarily obscure the gist of the embodiments, the detailed description thereof will be omitted.

[0024] Embodiments may be implemented in various forms of products, such as personal computers, laptop computers, tablet computers, smartphones, televisions, smart home appliances, intelligent automobiles, kiosks, and wearable devices.

[0025] FIG. 1A illustrates a situation in which an ultrasound imaging device according to an embodiment captures an ultrasound image and obtains user authentication information from a server.

[0026] Referring to FIG. 1A , an electronic device (e.g., an ultrasound imaging device) 10 in the system can receive pregnancy-related information of a patient (e.g., an expectant mother or a pregnant woman) from a user. The pregnancy-related information can include at least one of the patient's last menstrual period (LMP) and date of conception (DOC). The electronic device 10 can emit ultrasound signals to the abdomen of the patient 30 via an ultrasound probe 50 and receive ultrasound echo signals reflected from the patient 30 to obtain an ultrasound image of the fetus. The electronic device 10 can measure the size of the fetus's body parts in the ultrasound image of the fetus. The electronic device 10 can receive membership information, including an identifier, from the server 20. The membership information can be determined differently depending on the patient 30 and can include at least one of the member's name, the name of the fetus, the number of months of pregnancy, and the examination date. The electronic device 10 can receive pregnancy information and associated physical measurement data of the fetus from the server 20. The server 20 can collect fetal body size information received from multiple different devices and store big data related to fetal body measurements. In one embodiment, the server 20 can provide information about the patient 30 and the patient's fetus (e.g., growth rate compared to other fetuses, fetal biparietal diameter (BPD), abdominal circumference (AC), head circumstance (HC), occipitofrontal diameter (OFD), and femur length (FL)) based on the big data related to fetal body measurements.

[0027] According to one embodiment, the electronic device 10 can start capturing ultrasound images when the examiner 40 touches the probe 50 to a body part of the patient 30. The electronic device 10 can obtain information about the patient 30 or user information using the server 20, and transmit captured and edited images to a user terminal or a terminal of the patient 30. Capturing and editing ultrasound images will be described with reference to FIG. 3.

[0028] FIG. 1B shows a probe of an ultrasonic imaging device according to an embodiment.

[0029] Referring to FIG. 1B, the tip of the probe 50 may include a plurality of ultrasonic transducers 120 that generate ultrasonic waves in response to electrical signals, and a sample image acquisition unit 150. The ultrasonic transducers 120 can generate ultrasonic waves when AC power is applied. The ultrasonic transducers 120 can receive AC power from an external power supply or an internal power storage device, such as a battery. The piezoelectric vibrators or thin films of the ultrasonic transducers 120 can generate ultrasonic waves by vibrating in response to the supplied AC power. The ultrasonic transducers 120 may include, for example, any one of a magnetostrictive ultrasonic transducer that uses the magnetostrictive effect of a magnetic material, a piezoelectric ultrasonic transducer that uses the piezoelectric effect of a piezoelectric material, and a capacitive micromachined ultrasonic transducer that transmits and receives ultrasonic waves using the vibration of hundreds or thousands of micromachined thin films. The ultrasonic transducers 120 may be arranged in a linear array or in a curved array.

[0030] The sample image acquisition unit 150 may acquire one or more sample images having different brightness levels by photographing the skin of a target object, i.e., a pregnant woman. Here, the sample image may refer to an image containing information about the skin color and texture of the pregnant woman. The sample image acquisition unit 150 may be embodied as a camera module assembled with a lens, an image sensor, an IR filter (infrared blocking filter), an actuator, and a flexible printed circuit board (FPCB). In this case, sample images having different brightness levels may be acquired by controlling the exposure time of the camera module. In this case, the exposure time of the camera module may be controlled during ultrasound diagnosis. The sample image acquisition unit 150 may be embodied only with an image sensor. The image sensor may include, for example, a complementary metal-oxide-semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor. The image sensor may include an external lens, a microlens, a color filter array, a pixel array, an A / D converter that converts analog signals read from the pixel array into digital signals, and a digital signal processing unit that processes the digital signals output from the A / D converter.

[0031] FIG. 2 is a diagram illustrating an example of the configuration of a system for generating and editing ultrasound images according to an embodiment.

[0032] The system 201 according to an embodiment may include a processor 220 and a memory 230, and some of the components illustrated may be omitted or replaced. The system 201 according to an embodiment may be a server or a terminal. According to an embodiment, the processor 220 is configured to perform calculations and data processing related to control and / or communication of each component of the system 201 and may be configured with one or more processors. The memory 230 may store information related to the above-described methods or programs implementing the above-described methods. The memory 230 may be a volatile memory or a non-volatile memory. The memory 230 may store various file data, and the stored file data may be updated by the operation of the processor 220.

[0033] According to one embodiment, the processor 220 can execute a program and control the system 201. The code of the program executed by the processor 220 can be stored in the memory 230. The operation of the processor 220 can be performed by loading instructions stored in the memory 230. The system 201 can be connected to and exchange data with external devices (e.g., a personal computer or a network) via an input / output device (not shown).

[0034] According to an embodiment, the system 201 may further include a microphone. The processor 220 may use the microphone to receive the intensity of the audio output signal of the captured video, amplify the intensity of the audio output signal of the captured video based on the intensity of the audio output signal being below (or equal to or less than) a specified level, and further increase the degree of amplification of the intensity of the audio output signal of the captured video based on the intensity of audio noise in the captured video due to the external environment being above the specified level.

[0035] According to one embodiment, the processor 220 may amplify the strength of the audio output signal of the captured image to have a value between -10 dB and 10 dB based on whether the strength of the audio output signal is below (or equal to or less than) a specified level (e.g., -20 dB). If the maximum volume in the ultrasound image is below (or equal to or less than) a specified level (e.g., -20 dB), the processor 220 may amplify the volume by at least 10 dB, increasing the volume to approach 0 dB. The processor 220 may amplify the sound in the ultrasound image in a typical noise environment (e.g., 0 to 40 dB) in which the user uses the terminal, to assist the user in voice recognition. The strength of the audio output signal and the strength of the amplified signal are merely examples and are not limited thereto.

[0036] According to one embodiment, the processor 220 transmits a signal to the ultrasound device requesting that imaging be started when the probe contacts the skin of the pregnant woman, receives a video signal from the ultrasound device, and determines that the imaging screen is in a stopped state when a change in pixels of the imaging screen corresponding to the video signal received from the ultrasound device is less than a specified level and this period is maintained for more than a specified time. When it is determined that the imaging screen is in a stopped state, the processor 220 takes a snapshot of the imaging screen and stores it separately in the memory 230. When the probe does not move until a first time point that exceeds a specified time from the time of taking the snapshot, the processor 220 suspends imaging from the first time point, when the probe does not move until a first time point that exceeds a specified time, the processor 220 resumes imaging when the probe moves again. When the gray scale value of the imaging screen exceeds a specified level, the processor 220 determines that treatment is complete. The processor 220 transmits a signal to the ultrasound device requesting that imaging be stopped, and when the imaging is completed, the processor 220 stores images captured from the start of imaging to the end of imaging in the memory 230.

[0037] According to an embodiment, the processor 220 may determine that a user of the external device has entered the examination room based on recognizing an identifier displayed on the external device, establish a communication connection with the external device, and, based on the completion of image capture, transmit snapshots and images captured from the start of image capture to the end of image capture stored in the memory 230 to the external device recognized via the identifier. The identifier may include at least one of a QR code, radio frequency identification (RFID), near field communication (NFC), and barcode.

[0038] When the shooting is completed, the processor 220 can automatically transmit the snapshot and the shot video to the user (for example, a pregnant woman), thereby providing convenience to the user.

[0039] According to one embodiment, there is no limitation on the calculation and data processing functions that the processor 220 can implement on the system 201. Below, a detailed description will be given of a function that starts recording the moment the examiner's ultrasound probe comes into contact with the object after the start of the examination, and detects that the examination has ended based on the grayscale and motion level of the image and stops recording, thereby reducing the size of the captured image stored in memory.

[0040] FIG. 3 is a flowchart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment.

[0041] The operations described in Fig. 3 may be implemented based on instructions that can be stored in a computer storage medium or memory (e.g., memory 230 in Fig. 2). The illustrated method may be performed by the system (e.g., system 201 in Fig. 2) previously described in Figs. 1A to 2, and the technical features described above will not be repeated below. The order of the operations in Fig. 3 may be changed, some operations may be omitted, or some operations may be performed simultaneously.

[0042] In operation 310, a processor (e.g., processor 220 of FIG. 2) can transmit a signal to the ultrasound device requesting that imaging begin based on the probe (e.g., probe 50 of FIG. 1A) contacting the skin of the pregnant woman, and can acquire a video signal from the ultrasound device.

[0043] In operation 320, processor 220 can determine that the captured image is frozen based on the amount of change in pixels of the captured image being less than a specified level and such a period being maintained for more than a specified time.

[0044] In one embodiment, processor 220 can determine that the captured image is in a static state based on the amount of change in pixels of the captured image being less than approximately 5% and the time period during which the amount of change in pixels of the captured image is less than a specified level (e.g., 5%) being greater than a specified time (e.g., 3 seconds).

[0045] In one embodiment, the processor 220 classifies the pixel values of the captured image into lightness, chroma, and hue, calculates shading values and depth values based on the lightness, chroma, and hue of the pixels of the captured image, determines the grayscale of the captured image based on the shading values, and determines the amount of change of the pixels of the captured image based on the shading values and depth values.

[0046] In operation 330, the processor 220 may take a snapshot of the captured image once it has determined that the captured image is frozen.

[0047] In operation 340, the processor 220 can abort the capture from the first time point based on the probe not moving from the time the snapshot was taken until the first time point that exceeds a specified time.

[0048] In one embodiment, the first time point may be a state in which the examiner stops moving the probe (e.g., probe 50 of FIG. 1B ) to explain a particular situation to the pregnant woman, but not a state in which imaging has ended. Since the first time point is a time when the examiner is explaining a particular situation to the pregnant woman, it may be a state in which there is fetal movement or an important change in the fetus. The processor 220 may capture the image captured at the first time point as a snapshot, store it separately in the memory 230, and transmit it to the user (e.g., the pregnant woman). The processor 220 may collect and provide the user with only relatively important moments for the fetus so that the user can review them, thereby saving time and communication costs compared to reviewing all ultrasound images, and providing convenient usability in editing images.

[0049] In one embodiment, the processor 220 may determine that a user of the external device has entered the examination room based on recognizing an identifier displayed on the external device and establish a communication connection with the external device. Based on the completion of recording, the processor 220 may transmit snapshots stored in the memory 230 and video captured from the start of recording to the end of recording to the recognized external device via the identifier. The identifier may include at least one of a QR code, radio frequency identification (RFID), near field communication (NFC), and barcode.

[0050] In one embodiment, the processor 220 may display a first childcare message corresponding to the user's entry into the examination room based on recognizing the identifier displayed on the external device, a second childcare message at the moment of starting imaging based on the probe 50 contacting the pregnant woman's skin, a third childcare message when it is determined that the imaging screen is frozen, and a fourth childcare message at the end of imaging based on the grayscale value of the imaging screen exceeding a specified level. For example, the first childcare message may include the time and date the pregnant woman entered the examination room. The second childcare message may include a message indicating that imaging is starting. The third childcare message may include a message indicating a key moment. The fourth childcare message may include a message indicating that imaging is finished.

[0051] In one embodiment, the processor 220 may classify at least one snapshot taken at the moment when it is determined that filming has stopped by the date of taking the snapshot, and may display the timestamp of the video taken from the start of filming to the end of filming, at which the at least one snapshot is included. The processor 220 may collect at least one snapshot to generate a separate video, add a preset message or special effect, and transmit the video to an external device (e.g., a user terminal).

[0052] In operation 350, the processor 220 can determine whether the medical treatment is complete based on the grey scale value of the captured image.

[0053] In one embodiment, processor 220 can determine that medical treatment has ended based on the grayscale value of the captured image exceeding 70%. Based on the determination that medical treatment has ended, processor 220 can display information indicating that medical treatment has ended and that recording of the captured image has been completed on a display (not shown). Based on the determination that medical treatment has ended, processor 120 can transmit information indicating that medical treatment has ended and that recording of the captured image has been completed to an external device (e.g., a user terminal).

[0054] In operation 360, based on the determination that the shooting has ended, the processor 220 can store the video shot from the start of shooting to the end of shooting in memory.

[0055] When the shooting is completed, the processor 220 can transmit the snapshots stored in the memory 130 and the video captured from the start of shooting to the end of shooting to an external device. When the shooting is completed, the processor 220 can provide convenience to the user by automatically transmitting the snapshots and the captured video to the user (e.g., a pregnant woman).

[0056] FIG. 4 is a flow chart illustrating a method for generating and editing an ultrasound image in a system according to an embodiment.

[0057] The operations described in Fig. 4 may be implemented based on instructions that can be stored in a computer storage medium or memory (e.g., memory 230 in Fig. 2). The illustrated method may be performed by the system (e.g., system 201 in Fig. 2) previously described in Figs. 1A to 2, and the technical features described above will not be repeated below. The order of the operations in Fig. 4 may be changed, some operations may be omitted, or some operations may be performed simultaneously.

[0058] In operation 410, a processor (e.g., processor 220 of FIG. 2) can determine whether a probe (e.g., probe 50 of FIG. 1A) has contacted the skin of the pregnant woman (or patient). If the probe 50 has not contacted the skin of the pregnant woman, the processor 220 can not start capturing video and can continuously sense whether the probe 50 has contacted the skin of the pregnant woman.

[0059] In operation 412, the processor 220 can begin capturing video based on contact of the probe 50 with the skin of the pregnant woman. The processor 220 can determine the moment of capture based on movement of the probe 50 and begin capturing video to reduce the length of the video.

[0060] In operation 420, processor 220 can determine whether the amount of change in pixels in the captured image is less than a specified level, and whether the interval in which the amount of change in pixels is less than the specified level is maintained for more than a specified time.

[0061] In one embodiment, the processor 220 may determine that the image is frozen based on the amount of pixel change in the image being less than (or equal to) a specified level (e.g., about 5%) and the duration during which the amount of pixel change in the image is less than the specified level (e.g., about 5%) exceeds a specified time (e.g., about 3 seconds). If recording continues even when the image is frozen, the length of the captured ultrasound image may increase, occupying a relatively large amount of space in the memory 230. Furthermore, the image may be too long for the user to identify important moments (e.g., the moment the fetus moves or a different appearance is observed). The system for generating and editing ultrasound images described herein detects a frozen state and pauses recording, thereby reducing the overall image length, while capturing and separately providing to the user an image of the fetus at an important moment when the examiner stops the probe and explains something to the user (e.g., the pregnant woman).

[0062] In one embodiment, the processor 220 classifies pixel values of the captured image into lightness, chroma, and hue, calculates shading values and depth values based on the lightness, chroma, and hue of the pixels of the captured image, determines the grayscale of the captured image based on the shading values, and determines the amount of change of the pixels of the captured image based on the shading values and depth values.

[0063] In operation 422, the processor 220 can continue capturing images based on whether the amount of change in pixels on the captured screen exceeds a certain level or whether the interval during which the amount of change in pixels on the captured screen is less than the certain level does not exceed a specified time. When the amount of change in pixels on the captured screen exceeds the certain level, the processor 220 can determine that the probe 50 should continue capturing images while moving again, and can resume capturing images rather than interrupting the video. When the interval during which the amount of change in pixels on the captured screen is less than the certain level does not exceed a specified time (e.g., 3 seconds), the processor 220 can determine that the examiner has not stopped moving the probe 50, and can continue capturing images.

[0064] In operation 425, the processor 220 may determine that the image capture screen is in a frozen state based on the amount of pixel change in the image capture screen being less than a specified level and the duration of such change being maintained for more than a specified time. When the processor 220 determines that the image capture screen is in a frozen state, it may pause recording to reduce the length of the recorded ultrasound image (or fetal image). Furthermore, the processor 220 may take a snapshot of the image capture screen at the time it determines that the image capture screen is in a frozen state and store it in the memory 230. The reason for switching to a frozen state during imaging is that the examiner is explaining the image capture screen to the pregnant woman, and such an image capture screen may correspond to an important moment that requires explanation to the pregnant woman. When the processor 220 determines that the image capture screen is in a frozen state, it may take a snapshot of the image capture screen, store it separately in the memory 230, and provide it to the pregnant woman later.

[0065] In operation 430, the processor 220 may determine whether the grayscale value exceeds a certain level. In one embodiment, the processor 220 may classify the pixel values of the captured image into lightness, chroma, and hue, calculate a shading value and a depth value based on the lightness, chroma, and hue of the pixel of the captured image, and determine the grayscale of the captured image based on the shading value.

[0066] In operation 435, processor 220 can determine that image capture is not complete based on the grayscale value being below a certain level, and processor 220 can subsequently begin image capture again based on movement of the probe (e.g., probe 50 in FIG. 1A).

[0067] In operation 440, the processor 220 can determine that the imaging has ended based on the grayscale value exceeding a certain level, and can end the imaging (or recording) process. After the imaging process is ended and the medical examination is completed, the processor 220 can prevent unnecessary portions from being further recorded, thereby increasing the length of the video.

[0068] In operation 450, the processor 220 can store the captured video from the start moment to the end moment in the memory 130. The processor 220 can automatically transmit the captured video to a registered user.

[0069] In one embodiment, the processor 220 may classify at least one snapshot taken at the moment when it is determined that filming has stopped by the date of taking the snapshot, and may display the timestamp of the video taken from the start of filming to the end of filming, at which the at least one snapshot is included. The processor 220 may collect at least one snapshot to generate a separate video, add a preset message or special effect, and transmit the video to an external device (e.g., a user terminal).

[0070] According to one embodiment, the processor 220 can determine that the image is frozen when the pixel change in the image is less than 5% and the time period during which the pixel change in the image is less than 5% exceeds 3 seconds, and can determine that treatment has ended when the grayscale value of the image exceeds 70%.

[0071] According to one embodiment, the processor 220 receives the intensity of the audio output signal of the captured image using a microphone, and amplifies the intensity of the audio output signal of the captured image based on the intensity of the audio output signal being below (or equal to) a specified level, and further increases the degree of amplification of the intensity of the audio output signal of the captured image based on the intensity of audio noise caused by the external environment in the captured image being above a specified level.

[0072] According to one embodiment, the processor 220 can amplify the strength of the audio output signal so that the strength of the audio output signal of the captured video has a value between -10 dB and 10 dB based on the strength of the audio output signal being less than (or equal to) -10 dB.

[0073] According to one embodiment, based on determining that imaging has ended, the processor 220 can display information on the display indicating that the medical treatment has ended and that recording of the imaging video has been completed.

[0074] According to one embodiment, based on determining that the imaging has ended, the processor 220 can transmit information to an external device indicating that the medical treatment has ended and the recording of the imaging video has been completed.

[0075] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, controller, arithmetic logic unit (ALU), digital signal processor, microcomputer, field programmable gate array (FPGA), programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a processing device may be described as being a single device; however, those skilled in the art will recognize that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

[0076] Methods according to the embodiments may be embodied in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may include, alone or in combination, program instructions, data files, data structures, and the like. The program instructions recorded on the medium may be specially designed and constructed for the embodiments, or may be well known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code, such as generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter, for example. The hardware devices may be configured to operate as one or more software modules to perform the operations of the embodiments, or vice versa.

[0077] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may instruct the processing device, either individually or collectively. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed across networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0078] Although the embodiments have been described above with reference to limited drawings, those skilled in the art may apply various technical modifications and variations based on the above. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be replaced or substituted by other components or equivalents, and still achieve suitable results.

[0079] Accordingly, other implementations, other embodiments, and equivalents of the claims are intended to fall within the scope of the following claims.

Claims

1. 1. A system for generating and editing ultrasound images, comprising: Memory and a processor; an ultrasound probe; Including, The processor: Using the ultrasound probe, detect that the probe is in contact with the skin of the pregnant woman, and based on the contact of the probe with the skin of the pregnant woman, transmit a signal to an ultrasound device requesting that imaging be started, and obtain a video signal from the ultrasound device; determining that the image capture screen is in a stopped state based on the fact that a pixel change amount calculated based on pixel values of the captured image in the image capture screen corresponding to the image signal received from the ultrasound device is less than a specified level and such a section is maintained for more than a specified time; When it is determined that the photographed screen is frozen, a snapshot is taken of the photographed screen and stored separately in the memory; based on the probe not moving from the time of taking the snapshot to a first time point that exceeds a specified time, stopping the taking of the snapshot from the first time point; Detecting that the probe is moving again based on pixel values of the captured image, and resuming image capture based on the probe being moved again; determining that medical treatment has ended based on the gray scale value of the image screen exceeding a designated level, and transmitting a signal to the ultrasound device requesting that imaging be terminated; The system stores the video captured from the moment the video was taken to the moment the video was taken, from the moment the video was taken to the moment the video was taken, in the memory, based on the fact that the video was taken.

2. The processor: determining that a user of the external device has entered the examination room based on recognizing an identifier displayed on the external device and establishing a communication connection with the external device; When the shooting is completed, the snapshots stored in the memory and the video captured from the start of shooting to the end of shooting are transmitted to the external device recognized via the identifier; The system of claim 1 , wherein the identifier comprises at least one of a radio frequency identification (RFID), a near field communication (NFC), and a barcode.

3. The processor: displaying a first childcare message corresponding to the user entering the examination room based on recognizing the identifier displayed on the external device; displaying a second childcare message at the moment when the probe comes into contact with the skin of the pregnant woman and starts photographing; displaying a third childcare message when it is determined that the photographing screen is in a stopped state; The system of claim 2 , further comprising: displaying a fourth parenting message when the photographing ends based on the grayscale value of the photographed image exceeding a specified level.

4. The processor: The pixel values of the captured image are classified into lightness, chroma, and hue. Calculating a shading value and a depth value based on the brightness, saturation, and hue of the pixels of the captured image; determining a gray scale of the photographed image based on the shading value; The system of claim 1 , further comprising: determining an amount of change for the pixel based on the shade value and the depth value.

5. the system further includes a microphone; The processor: Using the microphone, receive an audio output signal intensity of the captured video; amplifying the intensity of the audio output signal of the captured video based on the intensity of the audio output signal being less than (or equal to or less than) a specified level; The system of claim 1 , further increasing the degree of amplification of the intensity of the audio output signal of the captured video based on the intensity of audio noise caused by the external environment in the captured video exceeding a specified level.

6. The processor: The system of claim 5, wherein, based on the strength of the audio output signal being less than (or equal to or less than) -10 dB, the strength of the audio output signal of the captured video is amplified so that the strength of the audio output signal has a value between -10 dB and 10 dB.

7. The processor: The system according to claim 1 , wherein, based on the determination that the imaging has ended, information indicating that the medical treatment has ended and that the recording of the imaging video has been completed is displayed on the display.

8. The processor: The system according to claim 1 , wherein, based on the determination that the imaging has ended, information indicating that the medical treatment has ended and that recording of the imaging video has been completed is transmitted to an external device.

9. The processor: classifying at least one snapshot taken at the moment when the photographed screen is determined to be in a frozen state by photographing date; The time stamp is displayed to indicate the time at which the snapshot is included in the video taken from the moment the video starts to the moment the video is stopped. Collect at least one snapshot to generate a separate image, 10. The system of claim 1, further comprising: adding a pre-set message or special effect to transmit to an external device.

Images