Infant feeding evaluation visualization method and system, electronic equipment and storage medium

Abstract

The embodiment of the invention provides an infant feeding evaluation visualization method and system, electronic equipment and a storage medium, and belongs to the technical field of medical treatment. According to the scheme, the waveform characteristics of the facial waveform, the neck waveform and the thoracic and abdominal waveform are respectively extracted by acquiring the facial waveform representing the sucking action, the neck waveform representing the swallowing action and the thoracic and abdominal waveform representing the breathing action of the baby; synthesizing the face waveform, the neck waveform and the thoracoabdominal waveform according to the waveform characteristics of the face waveform, the neck waveform and the thoracoabdominal waveform to obtain a feeding waveform, and evaluating the face waveform, the neck waveform, the thoracoabdominal waveform and the feeding waveform through an evaluation model to obtain a feeding evaluation result. The face waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding evaluation result are displayed through the preset interface, the infant feeding behavior can be monitored and tracked, the monitoring image and the evaluation result can be output, the accuracy and comprehensiveness of feeding evaluation recognition are improved, and the professional requirement for personnel is reduced.

Description

Technical Field

[0001] The present application relates to the field of medical technology, and in particular to a method, system, electronic device and storage medium for visualizing infant feeding assessment. Background Art

[0002] Breast milk is the most suitable natural nutritious food for infants. During breastfeeding, infants mainly complete the process of sucking, swallowing and breathing in coordination. The coordinated movements of sucking, swallowing and breathing are controlled by nerves and muscles and are a complex process with dynamic changes. When the various functions of the infant's body are not fully developed, the sucking and swallowing abilities, as well as the coordination between the two and breathing, are imperfect, which will increase the occurrence of choking, aspiration and even suffocation during feeding. Therefore, the assessment of the infant's sucking, swallowing and breathing is a prerequisite for identifying feeding difficulties and providing intervention.

[0003] At present, the evaluation of infant sucking-swallowing-breathing mainly adopts imaging and scale evaluation methods, among which imaging evaluation methods mainly include swallowing angiography, fiberoptic laryngoscope swallowing function evaluation, ultrasound imaging examination and high-resolution pharyngeal pressure measurement, etc. Scale evaluation methods include premature infant oral feeding assessment scale, newborn oral movement assessment scale, oral feeding skills assessment scale, etc. However, the above methods can only evaluate each link independently, and cannot continuously evaluate the entire sucking-swallowing-breathing process, making it difficult to intuitively and accurately identify feeding difficulties. Summary of the invention

[0004] The main purpose of the embodiments of the present application is to propose a visualization method, system, electronic device and storage medium for infant feeding assessment, which aims to continuously and dynamically monitor and track infant feeding behavior, output intuitive monitoring images and assessment results, improve the accuracy and comprehensiveness of feeding assessment identification, and reduce the professional requirements for personnel.

[0005] To achieve the above-mentioned purpose, an embodiment of the present application provides a method for visualizing infant feeding assessment, the method comprising:

[0006] Obtain facial waveforms representing sucking movements, neck waveforms representing swallowing movements, and chest and abdominal waveforms representing breathing movements of infants;

[0007] Extracting waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform respectively, wherein the waveform features include frequency, peak, trough, and amplitude;

[0008] synthesizing the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform;

[0009] The facial waveform, the neck waveform, the chest and abdomen waveform, and the feeding waveform are evaluated by an evaluation model to obtain a feeding evaluation result;

[0010] The facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding assessment result are displayed through a preset interface.

[0011] In some embodiments, the step of obtaining the facial waveform representing the sucking action, the neck waveform representing the swallowing action, and the chest and abdomen waveform representing the breathing action of the infant comprises the following steps:

[0012] The first sensor arranged on the face monitors the sucking action of the baby's lower jaw moving up and down to obtain a facial waveform;

[0013] The swallowing action of the baby's thyroid cartilage moving up and down is monitored by a second sensor arranged at the neck to obtain a neck waveform;

[0014] The third sensor arranged on the chest or abdomen monitors the breathing action of the infant's chest and abdomen rising and falling movements to obtain chest and abdomen waveforms.

[0015] In some embodiments, synthesizing the facial waveform, the neck waveform, and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform to obtain a feeding waveform comprises the following steps:

[0016] Performing time-series alignment on the facial waveform, the neck waveform, and the chest and abdomen waveform;

[0017] Determining a behavior cycle of an infant according to the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform, wherein the behavior cycle includes a first stage, a second stage, and a third stage;

[0018] Dividing the facial waveform, the neck waveform, and the chest and abdomen waveform into stages according to the behavior cycle to obtain corresponding segmented waveforms;

[0019] The facial waveform, the neck waveform, and the chest and abdomen waveform are synthesized at the same stage of the same behavior cycle to obtain a behavior waveform;

[0020] The behavioral waveforms at different stages are spliced ​​together according to a preset order to obtain a feeding waveform.

[0021] In some embodiments, determining the infant's behavior cycle according to the waveform characteristics comprises the following steps:

[0022] Determine the first stage of alternating sucking and breathing of the infant according to the peaks and the troughs of the facial waveform and the peaks and the troughs of the chest and abdomen waveform;

[0023] determining a second stage of apnea during swallowing of an infant based on the amplitude of the neck waveform and the amplitude of the chest and abdomen waveform;

[0024] determining a third stage of accelerated infant breathing based on the frequency of the chest and abdomen waveform;

[0025] The first stage, the second stage and the third stage are determined as a behavior cycle of the infant.

[0026] In some embodiments, the facial waveform, the neck waveform, the chest and abdomen waveform, and the feeding waveform are evaluated by an evaluation model to obtain a feeding evaluation result, comprising the following steps:

[0027] Inputting the facial waveform into an evaluation model to obtain a sucking index;

[0028] Inputting the neck waveform into an evaluation model to obtain a swallowing index;

[0029] Inputting the chest and abdomen waveforms into an evaluation model to obtain a respiratory index;

[0030] inputting the feeding waveform into an evaluation model to obtain a coordination index;

[0031] The sucking index, the swallowing index, the breathing index and the coordination index are compared with the preset benchmark parameters in the evaluation model to obtain a feeding evaluation result.

[0032] In some embodiments, the infant feeding assessment visualization method further comprises the following steps:

[0033] A sampling statistical method is adopted to determine the reference range of the benchmark parameter based on the historical data stored in the database.

[0034] In some embodiments, the infant feeding assessment visualization method further comprises the following steps:

[0035] Recording monitoring data of the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform, and the feeding assessment result;

[0036] The monitoring data is sent to a preset terminal.

[0037] To achieve the above-mentioned purpose, another aspect of the embodiment of the present application provides a visualization system for infant feeding assessment, the system comprising:

[0038] The first module is used to obtain facial waveforms representing sucking movements, neck waveforms representing swallowing movements, and chest and abdominal waveforms representing breathing movements of infants;

[0039] A second module is used to extract waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform, respectively, wherein the waveform features include frequency, peak, trough, and amplitude;

[0040] A third module is used to synthesize the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform;

[0041] The fourth module is used to evaluate the facial waveform, the neck waveform, the chest and abdomen waveform and the feeding waveform through an evaluation model to obtain a feeding evaluation result;

[0042] The fifth module is used to display the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding assessment result through a preset interface.

[0043] To achieve the above objective, another aspect of an embodiment of the present application provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the above method when executing the computer program.

[0044] To achieve the above objective, another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program implements the above method when executed by a processor.

[0045] The embodiments of the present application include at least the following beneficial effects: The present application provides a method, system, electronic device and storage medium for visualizing infant feeding assessment, which can continuously and dynamically monitor and track infant feeding behavior by acquiring facial waveforms representing sucking actions, neck waveforms representing swallowing actions and chest and abdomen waveforms representing breathing actions of infants. The waveform features of the facial waveform, neck waveform and chest and abdomen waveform are extracted respectively, and the facial waveform, neck waveform and chest and abdomen waveform are synthesized according to the waveform features of the facial waveform, neck waveform and chest and abdomen waveform to obtain a feeding waveform, and the facial waveform, neck waveform, chest and abdomen waveform and feeding waveform are evaluated by an evaluation model to obtain a feeding evaluation result, and the facial waveform, neck waveform, chest and abdomen waveform, feeding waveform and feeding evaluation result are displayed by a preset interface, and intuitive monitoring images and evaluation results can be output, thereby improving the accuracy and comprehensiveness of feeding evaluation identification and reducing the professional requirements for personnel. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1is a flow chart of a method for visualizing infant feeding assessment provided by an embodiment of the present application;

[0047] Figure 2 is a schematic diagram of waveform data collected according to an embodiment of the present application;

[0048] Figure 3 is a schematic diagram of a feeding waveform provided in an embodiment of the present application;

[0049] Figure 4 is a schematic diagram of a preset interface provided in an embodiment of the present application;

[0050] Figure 5 is a schematic diagram of the structure of a visualization device for infant feeding assessment provided in an embodiment of the present application;

[0051] Figure 6 is a schematic diagram of a baby identification interface provided in an embodiment of the present application;

[0052] Figure 7 is a schematic diagram of a fixed sensor prompt box provided in an embodiment of the present application;

[0053] Figure 8 is a schematic diagram of a sensor check prompt box provided in an embodiment of the present application;

[0054] Fig. 9 is a schematic diagram of a measurement interface provided in an embodiment of the present application;

[0055] Fig.10 is a schematic diagram of a data saving dialog box provided in an embodiment of the present application;

[0056] Fig.11 is a schematic diagram of a history record interface provided in an embodiment of the present application;

[0057] Fig.12 is a schematic diagram of a review interface provided in an embodiment of the present application;

[0058] Fig.13 is a schematic diagram of a transmission interface provided in an embodiment of the present application;

[0059] Fig.14 is a schematic diagram of the structure of a visualization system for infant feeding assessment provided in an embodiment of the present application;

[0060] Fig.15 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0061] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in conjunction with the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the embodiments of the present application. They are only examples of devices and methods consistent with some aspects of the embodiments of the present application as detailed in the attached claims.

[0062] It is understood that the terms "first", "second", etc. used in this application can be used to describe various concepts in this article, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another concept. For example, without departing from the scope of the embodiment of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" and "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0063] The terms "at least one", "multiple", "each", "any", etc. used in this application, at least one includes one, two or more, multiple includes two or more, each refers to each of the corresponding multiple, and any refers to any one of the multiple.

[0064] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0065] Before describing the embodiments of the present application in detail, some nouns and terms involved in the embodiments of the present application are first described. The nouns and terms involved in the embodiments of the present application are subject to the following explanations.

[0066] (1) Suck-Swallow-Breathe (SSB): Suck-Swallow-Breathe is a mechanism of infant feeding behavior. Specifically, the infant generates negative pressure in the oral cavity through sucking to suck milk out of the breast. The milk is pushed to the pharynx under the action of the tongue. When enough milk accumulates in the pharynx, the swallowing action is triggered. During the swallowing process, breathing pauses for about 0.5 seconds because the nasopharyngeal passage, pharyngeal and tracheal passages are blocked.

[0067] (2) Preterm Infant Oral Feeding Readiness Assessment (PIOFRA): The PIOFRA scale consists of 5 main categories and 18 items in total, including corrected gestational age, behavioral organization (whether in a state of wakefulness, whole body posture and whole body muscle tension), oral posture (lip shape and tooth shape), oral reflexes (rooting reflex, sucking reflex, biting reflex and vomiting reflex) and non-nutritive sucking (tongue movement, tongue wrapping, jaw movement, sucking force, sucking and pausing, ability to maintain sucking / pausing, maintaining wakefulness and signs of stress). Each item is scored between 0 and 2 points, with a maximum score of 36 points.

[0068] (3) Neonatal Oral Motor Assessment Scale (NOMAS): NOMAS includes six aspects: mandibular opening and closing rate, rhythm, consistency, and tongue movement direction, range, and rate, with a total of 28 items, which are divided into three categories: normal (10 items), disordered (8 items), and impaired (10 items). The total score for normal is 20 points, and the sucking function is directly proportional to the score; the total score for disordered is 8 points, and the total score for impaired is 10 points, and the sucking function is inversely proportional to the score.

[0069] (4) Oral Feeding Skills (OFS) assessment scale: The OFS scale is a 4-level (4-quadrant) data scale that does not require special monitoring equipment and will not interfere with infant feeding. It can evaluate the improvement effect of oral feeding for different infants. The main contents include total feeding amount, feeding rate, feeding proficiency, milk intake ratio, and clinical feeding rate.

[0070] (5) Radio Frequency Identification (RFID): Radio Frequency Identification technology, also known as wireless radio frequency identification, is an automatic recognition technology that uses radio signals to identify specific targets and read and write related data, thereby achieving non-contact two-way communication.

[0071] Next, the technical background or technical evolution context on which the embodiments of the present application are based is introduced.

[0072] Due to the high incidence of infant feeding difficulties, many studies have focused on the assessment and quantification of infant sucking, swallowing, and breathing functions during breastfeeding to evaluate whether infants have feeding difficulties.

[0073] Early preliminary assessments of infants' sucking ability rely mainly on the subjective judgment of medical staff, who use gloved fingers to place inside the infant's mouth to feel the sucking pressure. However, this method lacks objectivity and quantitative standards.

[0074] As the research deepened, a series of scales were developed to more systematically observe the sucking characteristics of infants during breastfeeding. Among them, the PIOFRA scale, as a standardized assessment tool, is used in clinical practice to determine whether infants can be safely fed orally due to its simplicity and efficiency, and to provide a reference standard for the timing of interventional rehabilitation treatment. However, the scale is still limited by its strong subjectivity and the fact that it does not cover the assessment of swallowing and breathing patterns.

[0075] Similarly, NOMAS, as the most widely used assessment scale, can sensitively reflect the developmental changes in the sucking function of premature infants in clinical practice and conduct targeted assessments of oral movements and sucking-swallowing conditions. However, it also faces the problems of strong subjectivity and lack of respiratory pattern assessment.

[0076] The OFS scale does not require special equipment and can be used in clinical practice to evaluate the effects of different interventions on oral feeding in infants. However, it is also highly subjective and lacks assessment of swallowing and breathing patterns.

[0077] The above-mentioned scale has played a positive role in promoting the assessment of infant feeding ability, but it still has problems such as lack of objective numerical support, many subjective judgment components, and incomplete assessment scope. It also requires personnel to have certain medical knowledge and infant care knowledge, and master the skills and methods of assessment.

[0078] Since the sucking-swallowing-breathing mechanism is a complex dynamic process, the above method can only independently evaluate a certain link and it is difficult to continuously evaluate the entire process. Therefore, there is currently a lack of a method to intuitively evaluate the overall coordination of the SSB mechanism during infant breastfeeding.

[0079] In view of this, an embodiment of the present application provides a method, system, electronic device and storage medium for visualizing infant feeding assessment. The scheme obtains the infant's facial waveform representing the sucking action, the neck waveform representing the swallowing action and the chest and abdomen waveform representing the breathing action, respectively extracts the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform, synthesizes the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform, evaluates the facial waveform, the neck waveform, the chest and abdomen waveform and the feeding waveform through an evaluation model to obtain a feeding evaluation result, displays the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding evaluation result through a preset interface, can monitor and track the infant's feeding behavior, output monitoring images and evaluation results, improve the accuracy and comprehensiveness of feeding assessment identification, and reduce the professional requirements for personnel.

[0080] The visualization method for infant feeding assessment provided in the embodiment of the present application relates to the field of medical technology. The visualization method for infant feeding assessment provided in the embodiment of the present application can be applied to a terminal, can be applied to a server, or can be software running in a terminal or a server. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart watch, etc., but is not limited to this; the server side can be configured as an independent physical server, or can be configured as a server cluster or a distributed system composed of multiple physical servers, and can also be configured to provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and cloud servers for basic cloud computing services such as big data and artificial intelligence platforms. The server can also be a node server in a blockchain network; the software can be an application for implementing the visualization method for infant feeding assessment, etc., but is not limited to the above forms.

[0081] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0082] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with relevant laws, regulations, and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.

[0083] Figure 1 is an optional flow chart of the method for visualizing infant feeding assessment provided in an embodiment of the present application. Figure 1The method may include but is not limited to steps S101 to S105.

[0084] Step S101, obtaining the facial waveform representing the sucking action, the neck waveform representing the swallowing action, and the chest and abdomen waveform representing the breathing action of the baby.

[0085] Step S102, respectively extracting waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform, wherein the waveform features include frequency, peak, trough, and amplitude.

[0086] Step S103, synthesizing the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform.

[0087] Step S104, evaluating the facial waveform, neck waveform, chest and abdomen waveform, and feeding waveform through the evaluation model to obtain a feeding evaluation result.

[0088] Step S105, displaying the facial waveform, neck waveform, chest and abdomen waveform, feeding waveform and feeding assessment results through a preset interface.

[0089] In this embodiment, first, the facial waveform representing the sucking action, the neck waveform representing the swallowing action, and the chest and abdomen waveform representing the breathing action of the baby are obtained, such as Figure 2 As shown, Figure 2 It is a schematic diagram of the waveform data of the collected facial waveform, neck waveform, and chest and abdomen waveform.

[0090] For example, considering that imaging methods such as swallowing angiography, fiberoptic laryngoscope swallowing function assessment, and ultrasound imaging involve radiation or invasive operations, in order to reduce the discomfort of the infant and improve safety, a non-invasive monitoring method is used to fix the sensor on the infant's body to obtain the infant's facial waveform representing the sucking action, the neck waveform representing the swallowing action, and the chest and abdominal waveform representing the breathing action, so as to continuously and dynamically monitor and track the infant's feeding behavior.

[0091] Then, the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform are extracted respectively, wherein the waveform features include frequency, peak, trough, and amplitude. Specifically, the frequency, peak, trough, and amplitude of the facial waveform, the neck waveform, and the chest and abdomen waveform are extracted respectively to obtain the waveform features of each waveform.

[0092] Exemplarily, spectral analysis is performed on facial waveforms, neck waveforms, and chest and abdomen waveforms, the number of waveform repetitions in a specific period in each waveform is calculated to obtain the frequency, the peaks and troughs are determined based on the local maximum and minimum values ​​in the waveform, and the amplitude is obtained based on the difference between the peaks and troughs.

[0093] It should be noted that the waveforms corresponding to sucking, swallowing and breathing movements usually have different characteristics. For example, the facial waveform has a faster frequency and a smaller amplitude, the chest and abdomen waveform has a slower frequency and a larger amplitude, and the neck waveform has more obvious peaks and troughs.

[0094] After the waveform features are obtained, the facial waveform, the neck waveform, and the chest and abdomen waveform are synthesized according to the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform to obtain the feeding waveform. Figure 3 , the facial waveform, the neck waveform and the chest and abdomen waveform are synthesized according to their frequencies, peaks, troughs and amplitudes, and the facial waveform, the neck waveform and the chest and abdomen waveform are synthesized into a feeding waveform.

[0095] Furthermore, the facial waveform, neck waveform, chest and abdomen waveform and feeding waveform are evaluated by the evaluation model to obtain a feeding evaluation result. The evaluation model can extract evaluation indicators from the facial waveform, neck waveform, chest and abdomen waveform and feeding waveform and compare them with preset benchmark parameters to obtain a feeding evaluation result. Among them, the feeding evaluation result can include whether there is a feeding difficulty problem in the sucking, swallowing and breathing stages and whether the sucking-swallowing-breathing mechanism is coordinated.

[0096] Finally, the facial waveform, neck waveform, chest and abdomen waveform, feeding waveform and feeding assessment results are displayed through the preset interface. Specifically, the facial waveform, neck waveform, chest and abdomen waveform and feeding waveform are output in a graphical form through the preset interface. The intuitive graphical interface allows non-professionals to quickly understand the activity status of the baby during the feeding process, improves the readability of the information, and reduces the professional requirements for personnel. At the same time, the feeding assessment results are displayed through the preset interface to improve the accuracy and comprehensiveness of feeding assessment identification.

[0097] For example, refer to Figure 4 , the preset interface is composed of the operation button bar, waveform display bar and waveform indicator bar from left to right. The waveform display bar includes 4 display frames, which are used to display the facial waveform, neck waveform, chest and abdomen waveform and feeding waveform of the baby during feeding. The upper left corner of each display frame is marked with the name of the waveform, which is "Su", "Sw", "B" and "SSB", corresponding to sucking, swallowing, breathing and sucking-swallowing-breathing. The waveform indicator bar displays the indicator data of each waveform.

[0098] In some embodiments, step S101 may include but is not limited to steps S201 to S203.

[0099] Step S201, monitoring the sucking action of the baby's lower jaw moving up and down by a first sensor arranged on the face to obtain a facial waveform.

[0100] Step S202, a second sensor disposed on the neck monitors the swallowing action of the baby's thyroid cartilage moving up and down to obtain a neck waveform.

[0101] Step S203, a third sensor disposed on the chest or abdomen monitors the breathing movements of the infant's chest and abdomen to obtain chest and abdomen waveforms.

[0102] Specifically, refer to Figure 2 The first sensor is fixed on the face to capture the data of the baby's sucking action, the second sensor is fixed on the neck to capture the data of the baby's swallowing action, and the third sensor is fixed on the chest and abdomen to capture the data of the baby's breathing action. The collected data is subjected to pre-processing steps such as denoising and filtering to obtain the corresponding waveform.

[0103] In step S201 of some embodiments, a first sensor disposed on the face monitors the sucking action of the baby's lower jaw moving up and down to obtain a facial waveform. Specifically, a pressure sensor or a strain sensor is fixed on the baby's face to capture the up and down movement of the baby's lower jaw caused by the sucking action during feeding, and the up and down movement is converted into an electrical signal to obtain a facial waveform.

[0104] For example, when a baby sucks, a negative pressure environment needs to be formed in the oral cavity. To achieve this process, the baby's lower jaw moves downward to contact the breast, thereby forming a relatively sealed environment. Then, through the contraction and relaxation of the muscles, negative pressure is generated to suck the milk from the breast into the oral cavity. As the sucking action continues, the lower jaw moves upward to adjust the negative pressure state in the oral cavity. Therefore, when the sensor detects that the lower jaw moves downward, an ascending waveform is generated, and when the sensor detects that the lower jaw moves upward, a descending waveform is generated. Figure 2 As shown, each rise and fall of the facial waveform corresponds to a complete sucking action, and the frequency of the waveform directly reflects the frequency or speed of the baby's sucking.

[0105] In step S202 of some embodiments, a second sensor disposed on the neck monitors the swallowing action of the baby's thyroid cartilage moving up and down to obtain a neck waveform. Specifically, a pressure sensor or a strain sensor is fixed on the baby's neck to capture the up and down movement of the baby's thyroid cartilage due to the swallowing action during feeding, and the up and down movement is converted into an electrical signal to obtain a neck waveform.

[0106] For example, when enough milk accumulates during sucking, swallowing is triggered. Swallowing is a complex physiological process that involves the coordinated action of multiple parts of the neck, such as the oral cavity, pharynx, larynx, esophagus, and trachea. When the milk is swallowed, the thyroid cartilage, as part of the larynx, moves upward as the larynx is lifted to close the laryngeal opening and prevent milk from entering the trachea. Therefore, when the sensor detects that the thyroid cartilage moves upward, an ascending waveform is generated, and when the sensor detects that the thyroid cartilage moves downward, a descending waveform is generated. Figure 2 As shown, each rise and fall of the neck waveform corresponds to a complete swallowing action.

[0107] In step S203 of some embodiments, a third sensor disposed on the chest or abdomen monitors the breathing action of the infant's chest and abdomen to obtain a chest and abdomen waveform. Specifically, a pressure sensor or a strain sensor is fixed on the infant's chest or abdomen to capture the ups and downs of the infant's chest or abdomen caused by the breathing action during feeding, and the ups and downs of the infant's chest or abdomen caused by the breathing action are converted into electrical signals to obtain a chest and abdomen waveform.

[0108] For example, during breathing, the chest and abdomen rise and fall with the expansion and contraction of the lungs to complete inhalation and exhalation. When inhaling, the sensor detects that the chest and abdomen expand with the lungs, and a descending waveform is generated. When exhaling, the sensor detects that the chest and abdomen contract with the lungs, and an ascending waveform is generated. Figure 2 As shown, each rise and fall of the chest and abdomen waveform corresponds to a complete breathing action, and the frequency of the waveform directly reflects the frequency or speed of the baby's breathing.

[0109] The embodiment of the present application obtains corresponding waveforms by collecting the physiological movements of the infant's mandible, thyroid cartilage, chest and abdomen, and can perform multi-dimensional evaluation of the infant's physiological process of sucking-swallowing-breathing, continuously and dynamically monitor and track the infant's feeding behavior, and quantify the feeding process through waveform data so that subsequent calculations can be performed based on the data, thereby providing an objective basis for infant feeding evaluation.

[0110] In some embodiments, step S103 may include but is not limited to steps S301 to S305.

[0111] Step S301, timing alignment of the facial waveform, the neck waveform, and the chest and abdomen waveform.

[0112] Step S302, determining the behavior cycle of the infant according to the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform, wherein the behavior cycle includes a first stage, a second stage, and a third stage.

[0113] Step S303, dividing the facial waveform, the neck waveform, and the chest and abdomen waveform into stages according to the behavior cycle to obtain corresponding segmented waveforms.

[0114] Step S304, synthesizing the segmented waveforms of the facial waveform, the neck waveform, and the chest and abdomen waveform that are in the same stage of the same behavior cycle to obtain a behavior waveform.

[0115] Step S305, splicing the behavior waveforms of different stages according to a preset sequence to obtain a feeding waveform.

[0116] In this embodiment, the facial waveform, the neck waveform, and the chest and abdomen waveform are first time-aligned. Optionally, the facial waveform, the neck waveform, and the chest and abdomen waveform are time-aligned by a timestamp or a synchronization signal to ensure that the time of each waveform is synchronized in the subsequent waveform synthesis process.

[0117] Next, the infant's behavior cycle is determined based on the waveform characteristics of the facial waveform, neck waveform, and chest and abdomen waveform, referring to Figure 2 , this embodiment regards a sucking-swallowing-breathing as a behavior cycle. In a behavior cycle, sucking and breathing are alternating at first. When the baby sucks a certain amount of milk, the swallowing action is triggered, and breathing is suspended during the swallowing process. After swallowing is completed, there is still an interval before the next sucking. In order to compensate for the interruption of oxygen supply during apnea, the body will speed up the breathing rate. Therefore, this embodiment further divides the behavior cycle into the first stage (i.e., stage I), the second stage (i.e., stage II) and the third stage (i.e., stage III). Among them, the first stage is the alternation of sucking and breathing, the second stage is apnea during swallowing, and the third stage is accelerated breathing. Because each stage has unique characteristics, in order to identify the behavior cycle of the baby, the stage corresponding to the baby's current behavior can be determined based on the facial waveform, neck waveform and chest and abdomen waveform after time alignment according to the waveform characteristics in the same time period.

[0118] After determining the behavior cycle, the facial waveform, neck waveform, chest and abdomen waveform are divided into stages according to the behavior cycle to obtain the corresponding segmented waveforms. Specifically, the feeding process is segmented, and the facial waveform, neck waveform, chest and abdomen waveform are divided according to the start and end nodes of each stage in the behavior cycle, and each segmented waveform corresponds to a stage.

[0119] Then, the segmented waveforms of the facial waveform, the neck waveform, and the chest and abdomen waveform at the same stage in the same behavioral cycle are synthesized to obtain the behavioral waveform, and then the behavioral waveforms at different stages are spliced ​​according to a preset order to obtain the feeding waveform.

[0120] Specifically, the synthesis of the behavior waveform can be achieved by superimposing the segmented waveforms of the same stage to obtain the behavior waveform of the corresponding stage. Then, according to the time relationship of each stage, the behavior waveforms are sequentially spliced ​​in the order of the first stage, the second stage and the third stage to generate a continuous curve of the entire feeding process to obtain the feeding waveform.

[0121] For example, according to Figure 2 It can be seen that in the first stage, the neck waveform does not change, which means that there are only sucking and breathing movements, and the rise and fall of a waveform corresponds to a complete movement, so the segmented waveforms of the facial waveform, neck waveform, and chest and abdomen waveform in the first stage are synthesized by superposition. Figure 3 , it can be understood that the facial waveform and the chest and abdomen waveforms are superimposed according to one sucking action and one breathing action to obtain the behavioral waveform of the first stage; similarly, in the process of synthesizing the behavioral waveform of the second stage and the behavioral waveform of the third stage, since there is only a neck waveform in the second stage and only a chest and abdomen waveform in the third stage, the behavioral waveform of the second stage obtained after superposition is consistent with the neck waveform of the second stage, and the behavioral waveform of the third stage obtained after superposition is consistent with the chest and abdomen waveform of the third stage. After extracting the behavioral waveforms of the second stage and the third stage, they are spliced ​​with the behavioral waveform of the first stage in sequence. Through the above waveform synthesis method, a continuous curve of the feeding waveform is obtained, such as Figure 4 As shown in the “SSB” display box.

[0122] It should be noted that the behavioral waveforms at each stage can be smoothly connected through appropriate transitions.

[0123] In some embodiments, step S302 may include but is not limited to steps S401 to S404.

[0124] Step S401, determining the first stage of the alternation of sucking and breathing of the infant based on the peaks and troughs of the facial waveform and the peaks and troughs of the chest and abdomen waveform.

[0125] Step S402, determining the second stage of apnea during the swallowing process of the infant according to the amplitude of the neck waveform and the amplitude of the chest and abdomen waveform.

[0126] Step S403, determining the third stage of the infant's respiratory acceleration according to the frequency of the chest and abdomen waveforms.

[0127] Step S404, determining the first stage, the second stage and the third stage as the behavior cycle of the infant.

[0128] In step S401 of some embodiments, the first stage of the alternation of sucking and breathing of the infant is determined based on the peaks and troughs of the facial waveform and the peaks and troughs of the chest and abdomen waveform. Figure 2 The facial waveform and chest and abdomen waveform have obvious periodicity in a specific time period. This periodicity is mainly reflected in that the chest and abdomen waveform reaches the trough when the facial waveform reaches the peak, and the chest and abdomen waveform reaches the peak when the facial waveform reaches the trough. The peaks and troughs of the facial waveform and the chest and abdomen waveform always appear in relative order. Therefore, the starting and ending nodes of the alternating sucking and breathing stage in the feeding process can be determined based on the peaks and troughs of the facial waveform and the peaks and troughs of the chest and abdomen waveform, thereby determining the first stage.

[0129] In step S402 of some embodiments, the second stage of apnea during swallowing of the infant is determined based on the amplitude of the neck waveform and the amplitude of the chest and abdomen waveform. Figure 2 When the neck waveform shows obvious amplitude changes, it indicates that the baby is swallowing. Since the swallowing action temporarily blocks the respiratory passage, the amplitude of the chest and abdomen waveforms no longer changes. Therefore, the amplitude of the neck waveform and the chest and abdomen waveform can be used to determine the start and end nodes of the first stage of the baby's apnea during swallowing, thereby determining the second stage.

[0130] In step S403 of some embodiments, the third stage of the infant's respiratory acceleration is determined based on the frequency of the chest and abdomen waveforms. Figure 2 , before and after swallowing, the frequency of the chest and abdomen waveform changes significantly. This is because the body accelerates the respiratory rate after swallowing to compensate for the interruption of oxygen supply during respiratory arrest during swallowing. Therefore, the frequency of the chest and abdomen waveform can be used to determine the starting and ending points of the infant's respiratory acceleration stage during feeding, thereby determining the third stage.

[0131] In step S404 of some embodiments, the first stage, the second stage, and the third stage are determined as the behavior cycle of the infant. After steps S401 to S403, the feeding process is divided into a plurality of first stages, second stages, and third stages, which together constitute a complete sucking-swallowing-breathing behavior of the infant. Therefore, the first stage, the second stage, and the third stage are determined as the behavior cycle of the infant, so that the sucking-swallowing-breathing pattern can be evaluated according to the behavior cycle and the physiological changes during the feeding process can be analyzed.

[0132] In some embodiments, step S104 may include but is not limited to steps S501 to S505.

[0133] Step S501, inputting the facial waveform into the evaluation model to obtain the sucking index.

[0134] Step S502: input the neck waveform into the evaluation model to obtain a swallowing index.

[0135] Step S503, inputting the chest and abdomen waveforms into the evaluation model to obtain the breathing index.

[0136] Step S504: input the feeding waveform into the evaluation model to obtain a coordination index.

[0137] Step S505 , comparing the sucking index, swallowing index, breathing index and coordination index with the preset benchmark parameters in the evaluation model to obtain a feeding evaluation result.

[0138] In this embodiment, the facial waveform is input into the evaluation model to obtain the sucking index, the neck waveform is input into the evaluation model to obtain the swallowing index, the chest and abdomen waveform is input into the evaluation model to obtain the breathing index, and the feeding waveform is input into the evaluation model to obtain the coordination index. Among them, the sucking index includes the sucking strength and the sucking frequency, the swallowing index includes the swallowing strength and the swallowing frequency, and the breathing index includes the breathing strength and the breathing frequency.

[0139] For example, the facial waveform is analyzed by the evaluation model, and the sucking force is obtained by taking the average value of the amplitude or energy according to the amplitude or energy calculation. The neck waveform is analyzed by the evaluation model, and the swallowing force is obtained by taking the average value of the amplitude or energy calculation according to the amplitude or energy calculation. The chest and abdomen waveforms are analyzed by the evaluation model, and the breathing force is obtained by taking the average value of the amplitude or energy calculation according to the amplitude or energy calculation.

[0140] Next, the feeding waveform is subjected to signal processing and spectrum analysis through the evaluation model, the composite waveform (i.e., the feeding waveform) is decomposed through Fourier transform or fast Fourier transform, the signal is converted from the time domain to the frequency domain, the constituent components are analyzed, and the average value of the frequency of each component or the frequency of the main component is taken as the frequency value to obtain the sucking frequency, swallowing frequency, and breathing frequency.

[0141] Furthermore, based on the calculated sucking frequency, swallowing frequency and breathing frequency, the ratio of the three frequencies is determined to obtain a coordination index. As an important factor in evaluating whether the sucking-swallowing-breathing mechanism of infants is coordinated, the coordination index should maintain a relatively stable frequency ratio during normal infant feeding. When the coordination index is abnormal, it indicates that the infant's sucking-swallowing-breathing is not coordinated.

[0142] Finally, the sucking index, swallowing index, breathing index and coordination index are compared with the preset benchmark parameters in the evaluation model to obtain the feeding evaluation results. It should be noted that each indicator has a corresponding benchmark parameter. The benchmark parameter refers to the feeding data of a large number of healthy babies, and the upper and lower thresholds of the normal range are statistically obtained. If the value of an indicator exceeds the reference range of the benchmark parameter (that is, greater than the upper threshold or less than the lower threshold), it means that the baby's feeding is abnormal. Specifically, the sucking index, swallowing index, breathing index and coordination index are compared with the preset benchmark parameters in the evaluation model one by one, and all comparison results are summarized to obtain the feeding evaluation results.

[0143] Exemplarily, whether there is sucking difficulty is determined based on the sucking index and the corresponding benchmark parameters, whether there is swallowing difficulty is determined based on the swallowing index and the corresponding benchmark parameters, whether there is breathing difficulty is determined based on the breathing index and the corresponding benchmark parameters, and the overall coordination is comprehensively evaluated based on the sucking index, swallowing index, breathing index and coordination index to determine whether there is incoordination, and when incoordination is found, the incoordination link is further confirmed.

[0144] The embodiment of the present application performs waveform analysis on facial waveforms, neck waveforms, chest and abdominal waveforms, and feeding waveforms through an evaluation model, and evaluates the coordination of each link and the entire feeding process of the infant based on sucking indicators, swallowing indicators, breathing indicators, coordination indicators, and benchmark parameters. It is possible to promptly detect feeding difficulties during the feeding process and improve the accuracy and comprehensiveness of feeding assessment and identification.

[0145] In some embodiments, the infant feeding assessment visualization method may further include but is not limited to step S601.

[0146] Step S601, using a sampling statistical method, determining a reference range of a benchmark parameter based on historical data stored in a database.

[0147] In this embodiment, a sampling statistical method is used to determine the reference range of the benchmark parameters based on the historical data stored in the database. Specifically, data collection is first performed to retrieve historical data related to the benchmark parameters from the database. To ensure the integrity and accuracy of the historical data, the historical data is cleaned to remove missing or abnormal data to improve the reliability of the benchmark parameters.

[0148] Optionally, a suitable sampling method can be selected according to the total amount of data and requirements, such as random sampling, systematic sampling, etc. to extract historical data from the database. Perform statistical analysis on the extracted historical data to calculate the average value, standard deviation and other statistics of the benchmark parameters.

[0149] Based on statistics, the reference range can be determined using the mean plus or minus standard deviation method. For example, the upper and lower thresholds of the normal range are defined by the mean plus or minus one or two standard deviations to determine the reference range of the benchmark parameter.

[0150] It should be noted that the reference range of the benchmark parameter can be set not only by sampling and counting historical data, but also according to medical research results, and the embodiments of the present application do not impose specific limitations.

[0151] In some embodiments, the infant feeding assessment visualization method may further include but is not limited to steps S701 to S702.

[0152] Step S701, recording monitoring data of facial waveform, neck waveform, chest and abdomen waveform, feeding waveform and feeding assessment results.

[0153] Step S702: Send the monitoring data to a preset terminal.

[0154] In this embodiment, the monitoring data of the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding assessment result are recorded and sent to a preset terminal. Optionally, the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding assessment result are transmitted to a cloud database, and the currently collected monitoring data can be uploaded.

[0155] After the monitoring data is collected, in response to the user's instructions, the monitoring data is sent to a preset terminal for viewing. The preset terminal can be a device or system that is pre-configured to receive monitoring data from a cloud database, specifically a smartphone, tablet computer, or medical system platform that can assist doctors in remote diagnosis and treatment, so as to help multiple medical teams and parents make joint decisions.

[0156] Below, the scheme of the embodiment of the present application is introduced and explained in detail in combination with specific application examples.

[0157] In order to assist hospitals such as mother-infant rooming-in wards, breastfeeding clinics, confinement centers, and rehabilitation centers, and to evaluate and diagnose the feeding of newborns, premature infants, and infants in neurology departments, and to provide a reference for treatment, the present application embodiment provides an infant feeding assessment device. Medical staff and parents can use the device to continuously and dynamically monitor and track infant feeding behavior, discover infant feeding problems through infant sucking-swallowing-breathing graphic data and indicators, and share the data with multiple medical centers to jointly provide scientific and effective intervention measures for infants.

[0158] Reference Figure 5The device includes swallowing monitoring sensors, sucking monitoring sensors, breathing monitoring sensors, ARM processors, memory, OLED display screens and cloud platforms.

[0159] Each sensor is connected through I 2 C bus is connected to the ARM processor, where I 2 The C bus includes a serial data line (SDA) and a serial clock line (SCL), which are connected to the corresponding pins and clock pins of the ARM processor respectively. After the device is started, the ARM processor sends instructions to the three sensors that monitor sucking, swallowing, and breathing. Each sensor collects waveform data of the baby's sucking, swallowing, and breathing according to the instructions of the ARM processor, and transmits the waveform data back to the ARM processor. The ARM processor processes the waveform data collected by each sensor to ensure the accuracy of the facial waveform, neck waveform, and chest and abdomen waveform, and then merges the facial waveform, neck waveform, and chest and abdomen waveform together, and provides indicators at the same time.

[0160] The SPI output line of the ARM processor is connected to the input line corresponding to the OLED display screen. Specifically, the ARM processor sends commands and data to the OLED display screen through the SPI interface. For example, a control command is sent to set the working mode of the display screen, and image data is sent to display an image on the display screen. The ARM processor can periodically send update commands and data to the OLED display screen to update and refresh the displayed content. At the same time, the ARM processor can also receive response data from the OLED display screen.

[0161] The ARM processor is connected to the memory through a data bus to achieve data storage.

[0162] The ARM processor is connected to the cloud platform through network communication methods such as Ethernet, Wi-Fi or cellular networks (such as 4G / 5G), thereby communicating with the cloud platform through network protocols (such as TCP / IP) to achieve data sharing.

[0163] It should be noted that the device is configured with an application program that applies the visualization method for infant feeding assessment provided in the embodiment of the present application.

[0164] When the user starts the application and clicks the "Start / Stop" button, the Figure 6 The baby identification interface shown in the figure uses the RFID device to scan the QR code on the baby's wristband to identify the baby's name and hospital number. After verification, click the "Confirm" button to complete the identification.

[0165] It should be noted that the name and hospital number can also be obtained by manually entering the information through the input method.

[0166] After confirming that the identity information is correct, the application will pop up a prompt box "Please fix the sensor to the corresponding position of the baby". Figure 7 As shown. According to the prompts, users can fix the sucking monitoring sensor on the baby's face to detect the up and down movement of the lower jaw during sucking, fix the swallowing monitoring sensor on the baby's neck to capture the up and down movement of the thyroid cartilage during swallowing, and fix the breathing monitoring sensor on the baby's abdomen to detect the movement of the abdomen during breathing. After the user fixes the sensor in the corresponding position, he can click the "I have fixed the sensor, start measuring" button to measure.

[0167] It should be noted that if the sensor is not fixed correctly, a prompt box will pop up again to remind the user to make adjustments. Figure 8 After the user has adjusted the sensor, he can click the "I have adjusted the sensor, start measuring" button to start measuring.

[0168] After the sensor is fixed and the measurement phase begins, the application jumps to the measurement interface. Fig. 9 As shown, click the "Start / Stop" button to start collecting the sucking waveform (i.e., facial waveform), swallowing waveform (i.e., neck waveform) and breathing waveform (i.e., chest and abdomen waveform) of the baby during feeding, synthesize the three collected waveforms into a feeding waveform, and display all waveform graphics and corresponding evaluation indicators in the measurement interface.

[0169] It should be noted that during the feeding process, the baby may have problems in one or more links of sucking-swallowing-breathing, which will be manifested as abnormal waveforms on the waveform graph. Specifically, it is mainly reflected in the abnormal amplitude and frequency of the waveform. Common feeding problems and possible waveform abnormalities include sucking difficulties, swallowing difficulties, breathing difficulties and sucking-swallowing-breathing uncoordinated. Among them, sucking-swallowing-breathing uncoordinated can be further divided into breathing difficulties when sucking, breathing difficulties when swallowing, and breathing difficulties during the entire feeding process.

[0170] (1) Sucking difficulty: manifested as weak sucking force and lack of rhythm. When analyzed graphically, the sucking waveform may appear to have a low or high amplitude, irregular amplitude, and a single waveform may last too short or too long.

[0171] (2) Dysphagia: During graphic analysis, the swallowing waveform may show that the corresponding waveform amplitude is too low or too high, and the duration of a single waveform is too short or too long.

[0172] (3) Dyspnea: manifested as the infant's breathing becoming shallower or deeper, the frequency being too slow or too fast, and the rhythm being abnormal. When analyzed graphically, the respiratory waveform may appear to have a low or high amplitude, be irregular, and the duration of a single waveform may be too short or too long.

[0173] (4) Breathing difficulties when sucking: If breathing difficulties occur when the baby is sucking, it may indicate a problem with the coordination between sucking and breathing, which may cause the baby to have difficulty sucking. When performing graphical analysis, it may be observed that the breathing waveform is abnormal, and the sucking waveform is also abnormal.

[0174] (5) Difficulty breathing when swallowing: If the baby has difficulty breathing when swallowing, it may indicate a problem with the coordination between swallowing and breathing, which may cause difficulty swallowing or suffocation in the baby. When analyzing the graph, it can be seen that the breathing waveform is abnormal, and the swallowing waveform may also be abnormal.

[0175] (6) Breathing difficulties during the entire feeding process: If the baby has breathing difficulties during the entire feeding process, it may indicate a problem with the coordination between sucking, swallowing and breathing, which may be caused by reasons such as oral or laryngeal obstruction. It can be observed that the breathing waveform is abnormal during the entire feeding process, and sucking and swallowing may also be abnormal after being affected.

[0176] It is understandable that the application analyzes all waveforms through the evaluation model, evaluates the coordination of the baby's sucking, swallowing, and breathing according to indicators such as the number of sucking times, sucking strength, swallowing frequency, and breathing frequency, identifies whether there are waveform abnormalities during the feeding process, and obtains feeding evaluation results. When feeding difficulties are detected, the identified abnormal results will be displayed.

[0177] The "Settings" button is used to set the evaluation parameters for the baby's normal sucking, swallowing, breathing and coordination. In addition, the user can also use this button to set the display mode, such as whether the waveform display requires a grid and ruler.

[0178] The "Help" button is used to solve problems that occur during user use and provide guidance solutions.

[0179] When the sensor falls off, choking or suffocation occurs, or the waveform changes significantly during feeding, the corresponding alarm will be triggered. By clicking the "Alarm" button, a dialog box will pop up to display the specific problem. After the user handles the corresponding problem, the alarm can be lifted and the measurement can continue. In addition, the user can click this button to view the history of all alarms.

[0180] When the acquisition is finished, press the "Start / Stop" button again, and a dialog box will pop up, such as Fig.10 As shown, click "Yes" to save the data, click "No" to not save the data, and click "Cancel" to continue collecting.

[0181] If the user has saved the collection records, he can click the "History" button to jump to the history interface to view the data. Fig.11After selecting the target record, click the "Delete" button to delete the target record, and the deleted record can be viewed through the "Recycle Bin" button. The application can store the saved data in the database to track the baby's feeding behavior for a long time.

[0182] Click the "View" button to jump to the viewing interface to view the complete waveform graph recorded, such as Fig.12 After clicking any waveform, the corresponding indicators will be displayed in the waveform indicator bar. If you click the "Report Print" button, you can print the recorded waveform curve as a paper report.

[0183] If you click the "Data Transfer" button, you can jump to the transfer interface. Fig.13 As shown. Click the "Medical System" button to upload the baby's waveform record to the electronic medical record. Click the "Mobile Terminal" button to upload the waveform record to remote devices such as smartphones and tablets. After selecting the object to be transmitted, click the "Start Transmission" button to upload the data. If you need to pause during the process, press the "Stop Transmission" button. Remote data transmission through the cloud platform can assist doctors in remote diagnosis and treatment, and help multiple medical teams and parents make joint decisions.

[0184] Reference Fig.14 The embodiment of the present application also provides a system for visualizing infant feeding assessment, which can implement the above-mentioned method for visualizing infant feeding assessment. The system includes:

[0185] The first module is used to obtain the facial waveform representing the sucking action, the neck waveform representing the swallowing action, and the chest and abdomen waveform representing the breathing action of the infant.

[0186] The second module is used to extract the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform respectively, wherein the waveform features include frequency, peak, trough and amplitude.

[0187] The third module is used to synthesize the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform characteristics of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform.

[0188] The fourth module is used to evaluate the facial waveform, neck waveform, chest and abdomen waveform and feeding waveform through the evaluation model to obtain the feeding evaluation result.

[0189] The fifth module is used to display facial waveforms, neck waveforms, chest and abdomen waveforms, feeding waveforms and feeding assessment results through a preset interface.

[0190] It can be understood that the contents of the above method embodiments are all applicable to the present system embodiments, the functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0191] The embodiment of the present application also provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the above-mentioned infant feeding assessment visualization method when executing the computer program. The electronic device can be any smart terminal including a tablet computer, a smart phone, etc.

[0192] It can be understood that the contents of the above method embodiments are all applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0193] Reference Fig.15 , Fig.15 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes:

[0194] The processor 110 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, etc., and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0195] The memory 120 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 120 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 120, and the processor 110 calls and executes the infant feeding assessment visualization method of the embodiment of the present application;

[0196] Input / output interface 130, used to implement information input and output;

[0197] The communication interface 140 is used to realize the communication interaction between the device and other devices. The communication can be realized through a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.);

[0198] bus 150 , which transmits information between the various components of the device (e.g., processor 110 , memory 120 , input / output interface 130 , and communication interface 140 );

[0199] The processor 110 , the memory 120 , the input / output interface 130 , and the communication interface 140 are connected to each other in communication within the device via the bus 150 .

[0200] An embodiment of the present application further provides a computer-readable storage medium storing a computer program, which implements the above-mentioned visualization method for infant feeding assessment when executed by a processor.

[0201] It can be understood that the contents of the above method embodiments are all applicable to the present storage medium embodiments, the functions specifically implemented by the present storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0202] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0203] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0204] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0205] The system embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0206] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0207] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0208] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A method for visualizing infant feeding assessment, characterized in that: The method comprises the following steps: Obtain facial waveforms representing sucking movements, neck waveforms representing swallowing movements, and chest and abdominal waveforms representing breathing movements of infants; Extracting waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform respectively, wherein the waveform features include frequency, peak, trough, and amplitude; synthesizing the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform; The facial waveform, the neck waveform, the chest and abdomen waveform, and the feeding waveform are evaluated by an evaluation model to obtain a feeding evaluation result; The facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding assessment result are displayed through a preset interface.

2. The method according to claim 1, characterized in that The method of obtaining the facial waveform representing the sucking action, the neck waveform representing the swallowing action, and the chest and abdomen waveform representing the breathing action of the infant comprises the following steps: The first sensor arranged on the face monitors the sucking action of the baby's lower jaw moving up and down to obtain a facial waveform; The swallowing action of the baby's thyroid cartilage moving up and down is monitored by a second sensor arranged at the neck to obtain a neck waveform; The third sensor arranged on the chest or abdomen monitors the breathing action of the infant's chest and abdomen rising and falling movements to obtain chest and abdomen waveforms.

3. The method according to claim 1, characterized in that The step of synthesizing the facial waveform, the neck waveform, and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform to obtain a feeding waveform comprises the following steps: Performing time-series alignment on the facial waveform, the neck waveform, and the chest and abdomen waveform; Determining a behavior cycle of an infant according to the waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform, wherein the behavior cycle includes a first stage, a second stage, and a third stage; Dividing the facial waveform, the neck waveform, and the chest and abdomen waveform into stages according to the behavior cycle to obtain corresponding segmented waveforms; The facial waveform, the neck waveform, and the chest and abdomen waveform are synthesized at the same stage of the same behavior cycle to obtain a behavior waveform; The behavioral waveforms at different stages are spliced ​​together according to a preset order to obtain a feeding waveform.

4. The method according to claim 3, characterized in that: Determining the infant's behavior cycle according to the waveform characteristics comprises the following steps: Determine the first stage of alternating sucking and breathing of the infant according to the peaks and the troughs of the facial waveform and the peaks and the troughs of the chest and abdomen waveform; determining a second stage of apnea during swallowing of an infant based on the amplitude of the neck waveform and the amplitude of the chest and abdomen waveform; determining a third stage of accelerated infant breathing based on the frequency of the chest and abdomen waveform; The first stage, the second stage and the third stage are determined as a behavior cycle of the infant.

5. The method according to claim 4, characterized in that The step of evaluating the facial waveform, the neck waveform, the chest and abdomen waveform, and the feeding waveform by using an evaluation model to obtain a feeding evaluation result comprises the following steps: Inputting the facial waveform into an evaluation model to obtain a sucking index; Inputting the neck waveform into an evaluation model to obtain a swallowing index; Inputting the chest and abdomen waveforms into an evaluation model to obtain a respiratory index; inputting the feeding waveform into an evaluation model to obtain a coordination index; The sucking index, the swallowing index, the breathing index and the coordination index are compared with the preset benchmark parameters in the evaluation model to obtain a feeding evaluation result.

6. The method according to claim 5, characterized in that The infant feeding assessment visualization method further comprises the following steps: A sampling statistical method is adopted to determine the reference range of the benchmark parameter based on the historical data stored in the database.

7. The method according to claim 1, characterized in that The infant feeding assessment visualization method further comprises the following steps: Recording monitoring data of the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform, and the feeding assessment result; The monitoring data is sent to a preset terminal.

8. An infant feeding assessment visualization system, characterized in that: The system comprises: The first module is used to obtain facial waveforms representing sucking movements, neck waveforms representing swallowing movements, and chest and abdominal waveforms representing breathing movements of infants; A second module is used to extract waveform features of the facial waveform, the neck waveform, and the chest and abdomen waveform, respectively, wherein the waveform features include frequency, peak, trough, and amplitude; A third module is used to synthesize the facial waveform, the neck waveform and the chest and abdomen waveform according to the waveform features of the facial waveform, the neck waveform and the chest and abdomen waveform to obtain a feeding waveform; The fourth module is used to evaluate the facial waveform, the neck waveform, the chest and abdomen waveform and the feeding waveform through an evaluation model to obtain a feeding evaluation result; The fifth module is used to display the facial waveform, the neck waveform, the chest and abdomen waveform, the feeding waveform and the feeding assessment result through a preset interface.

9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images