Ai-assisted breastfeeding simulation training

Abstract

The invention is an AI-assisted breastfeeding simulation training platform. The subject matter of the invention relates to software that simulates breastfeeding training for educational purposes and to a method devised to operate this software. Accordingly, by means of a computer having at least one storage area and a set of graphical scenarios previously installed on this computer, the breastfeeding environment and steps are simulated and the process steps followed by the user to breastfeed their baby are monitored. These steps are then compared with the preloaded process steps and various feedback is provided to the user.

Description

[0001] DESCRIPTION

[0002] AI-ASSISTED BREASTFEEDING SIMULATION TRAINING

[0003] TECHNICAL FIELD

[0004] The invention relates to the health sector and to the development of software by means of artificial intelligence technology that provides an innovative and advanced solution instead of giving breastfeeding training with mannequins and models, and to the transfer of the software to a virtual reality headset so as to provide three-dimensional breastfeeding training in line with contemporary requirements. The invention is an Al-assisted breastfeeding simulation training platform. The subject-matter of the invention relates to software that simulates breastfeeding training for educational purposes and to a method that has been devised to operate this software. Accordingly, by means of a computer having at least one storage area and a set of graphical scenarios previously installed on this computer, the breastfeeding environment and steps are simulated and the process steps followed by the user to breastfeed their baby are monitored. They are further compared with the preloaded process steps and various feedback is provided to the user. It is a virtual reality system with a WebVR-based infrastructure that transfers breastfeeding training into the virtual dimension and enables breastfeeding to be experienced and taught, and is characterised in that it is a system which, by means of virtual reality software that enables navigation in a hospital environment (a specially designed space), holding the baby, giving an appropriate position and directly observing the sucking movements of the baby, and by means of VR hand controllers (remote controls) of the virtual reality headset, allows the steps in a breastfeeding scenario to be performed with simulation movements and learned. It comprises mobile platform components that enable the use of the virtual reality image via smart devices compatible with the virtual reality headset.

[0005] PRIOR ART In the relevant technical field of the subject-matter of the invention, existing applications, products of a similar nature, patent applications and patents in the same technical field, if known, and other publications are indicated below. Breastfeeding is the key to sustainable development (Republic of Turkey Ministry of Health, 2016). At the United Nations (UN) Sustainable Development Summit, the second and third goals of the Sustainable Development Goals, which are a strategic plan to increase the level of development of countries by 2030, are directly related to breastfeeding (Burton, 2018). Breastfeeding rates in the world and in our country are not at the desired level. There are many studies on breastfeeding training; however, there is no invention in which today’s technology is integrated. As a result, the existence of the problem and the inadequacy of existing solutions have made it necessary to achieve progress in the relevant technical field. It is clear that the delivery of health services will change in the coming years and will be brought into line with contemporary requirements. Artificial intelligence applications affect digital health technologies. In order for accurate information to be delivered continuously and regardless of time and place, the use of artificial intelligence technology in the health sector is inevitable. As a representative of the state of the art, the patent specification with publication number TR201700578 A2 may be cited. In the said document, a mobile application for breastfeeding counselling is described. The object of the invention is to improve the skills of expectant mothers regarding breastfeeding (providing them with the feeling of breastfeeding in real life through virtual reality) and to motivate women to breastfeed. Further objects are to increase the retention of breastfeeding education and to bring access to breastfeeding education into line with contemporary requirements.

[0006] The disadvantages of pre-invention implementations are as follows: the obligation to go to a health institution for breastfeeding training (the distance of health institutions), the fact that the training creates a workload for the staff, the lack of repeatability of the training, experiencing difficulties in accessing accurate information, training with mannequins not being in line with contemporary requirements, and not being able to provide a sense of being in the moment to the same extent as virtual reality and, consequently, not ensuring retention in teaching. There is no invention in our country that enables breastfeeding to be experienced. DESCRIPTION OF THE INVENTION

[0007] The disadvantages of pre-invention implementations are as follows: the obligation to go to a health institution for breastfeeding training (the distance of health institutions), the fact that the training creates a workload for the staff, the lack of repeatability of the training, experiencing difficulties in accessing accurate information, training with mannequins not being in line with contemporary requirements, and not being able to provide a sense of being in the moment to the same extent as virtual reality and, consequently, not ensuring retention in teaching. There is no invention in our country that enables breastfeeding to be experienced.

[0008] There is no virtual application in which breastfeeding can be directly experienced. TR201700578A2 focuses on breastfeeding problems. Instead of finding a solution to an already existing problem, one of the advantages of the present invention is teaching correct breastfeeding in order to prevent breastfeeding problems from arising. Although there is no equivalent in our country, a study conducted abroad by Tang et al. (2022) may be regarded as comparable to the present invention. In the study carried out by Tang et al. (2022), different breastfeeding scenarios were shown to individuals by means of a virtual reality headset. In the present invention, by contrast, it differs in that the specially designed environment and breastfeeding scenario can be directly experienced by means of a virtual reality headset and hand controllers and the steps of breastfeeding can be learned

[0009] In the present invention, by contrast, the difference lies in that the specially designed environment and breastfeeding scenario are directly experienced by means of a virtual reality headset and hand controllers, and the steps of breastfeeding are thereby learned.

[0010] Description of the Figures

[0011] Figure 1. Al-assisted breastfeeding simulation training module

[0012] Figure 2. Virtual reality breastfeeding simulation

[0013] Figure 3. Virtual reality mother-infant Figure 4. Virtual reality breastfeeding simulation 2

[0014] Figure 5. Virtual reality baby

[0015] Figure 6. Virtual reality breastfeeding simulation 3

[0016] List of References

[0017] 1 Virtual reality (VR) headset

[0018] 2 VR hand controller

[0019] DETAILED DESCRIPTION OF THE INVENTION

[0020] In this detailed description, the Al-assisted breastfeeding simulation training according to the invention, together with its preferred alternatives, is explained solely for the purpose of facilitating a better understanding of the subject-matter, and without creating any limiting effect.

[0021] At the beginning of the study, a breastfeeding scenario was prepared in accordance with WHO recommendations. This scenario was transferred into the virtual reality environment. The mother and infant were modelled and each step in the scenario was created one by one. In this way, the woman will be able to put on the virtual reality headset, hold the controllers (Figure 1) in her right and left hands, and herself perform these breastfeeding steps and directly experience the correct breastfeeding steps. Hardware Components The hardware of the study consists of an Oculus Quest 2 virtual reality (VR) headset (1) and hand controllers (2) with hand-tracking technology.

[0022] The designed infant avatar exhibiting sucking behaviour, the mother avatar enabling correct breastfeeding and the simulated hospital environment suitable for breastfeeding are transferred to the virtual reality headset, whereby a breastfeeding scenario is prepared by means of which mothers will be able to experience the correct breastfeeding steps. A scenario in which the invention is implemented is set out below, and this scenario does not have any limiting effect.

[0023] Breastfeeding Scenario

[0024] For the selected scenario, a suitable environment and models have been prepared. For the breastfeeding environment, a realistic patient room has been created comprising a bed on which the baby can lie, an area where the mother can wash her hands, and a space where the mother can sit comfortably and support her arm by placing a pillow underneath. In the infant avatar, facial expressions have been designed such that, during breastfeeding, it fully covers the areola, the lower lip is turned outwards, the chin touches the mother’s breast, and the cheeks are rounded and full. The designed mother avatar is a character that can be directed by the woman via the controllers. The clothing of the mother avatar has been designed to be suitable for breastfeeding. The hand movements of the mother avatar have been adjusted so that she can perform the “C-hold” used for breastfeeding. The woman will put the virtual reality (VR) headset (1 ) on her eyes and take the right and left hand controllers (2) in her hands, whereupon she will find herself within the created environment and will herself carry out the specified steps by means of the controllers in her hands. In this way, the woman will be able to learn the correct breastfeeding steps by experiencing them. The basic steps created are as follows:

[0025] 1. The mother must wash her hands,

[0026] 2. She must take her baby into her arms,

[0027] 3. She must move to a place where she can sit upright and comfortably,

[0028] 4. She must adopt the correct position that is suitable for herself for breastfeeding,

[0029] 5. The baby’s head and body must be in a straight line, the face must look towards the breast and the nose must be directly opposite the nipple, and the baby’s body must be close to the mother’s body (cradle hold),

[0030] 6. The breastfeeding position must be supported by placing a pillow under the mother’s arm and under the baby’s hips, 7. The breast must be held by supporting it from above with the thumb and from below with the four fingers. The fingers must be placed around the areola (the dark -coloured area around the nipple) (C-hold),

[0031] 8. The baby’s mouth must be stimulated by rubbing it against the nipple and the baby’s mouth must be made to open by tickling,

[0032] 9. It must be ensured that the baby obtains a full latch on the breast (grasping the breast so as to take not only the nipple but also the areola into the mouth, settling correctly towards the breast. The baby’s lower lip must be turned outwards, the chin must touch the mother’s breast, and the cheeks must be rounded and full),

[0033] 10. The baby’s head must be supported from behind,

[0034] 11. While the baby is sucking, the free hand must remain in contact with the baby,

[0035] 12. It must be observed that the baby is sucking effectively (movement should be seen in the baby’s temples and ears, and the mother should feel a tingling sensation in the nipple),

[0036] 13. The baby must be breastfed continuously for at least 5-10 minutes, and if the baby is not satisfied, after one breast has been emptied, the other breast must be offered (in the virtual reality environment this period is limited to 1 minute),

[0037] 14. Both breasts must be used for breastfeeding,

[0038] 15. When the baby stops sucking, the baby’s gas must be relieved (by taking the baby into the arms, holding the baby so that the face rests on the shoulder and gently massaging the back) and the baby must be laid down (laid on the side).

[0039] 15.1. Environments Used

[0040] In the study, the models were created using the Autodesk 3ds Max application. The project was generally implemented using the C# programming language. The planning and design of the scene, the provision and sequencing of appropriate simulation conditions, lighting, sound, and the intermediate scenes (animations) in which the necessary information is provided were carried out using the Unity software. In the final stage, the program output obtained from Unity was loaded onto the virtual reality headset.

[0041] 15.1.1. Software Architecture Programming and Modelling Languages Used: The software was developed in a modular structure by means of C# technology on the Unity game engine / editor. The 3D models used in the software were created in Blender.

[0042] 15.1.2. Modules

[0043] User and Reporting Module: This is the module in which users are added to the system with their name, surname and registration numbers, and in which information on user activities and processes is reported.

[0044] Information Module: This is the module in which users within the system are informed about the purposes of the application, the instructions, and how to use the VR device. It is the module in which, before the application starts, users are shown how to use the VR hand controllers and what functions the buttons perform.

[0045] Application Module: This is the module in which users enter the virtual environment, can interact with the objects in the environment, can walk to the room where the application will take place by means of the VR hand controllers, can hold the baby correctly, can perform the breastfeeding process and can burp the baby.

[0046] Test Module: This is the module in which the optimisation status of the implemented software in the virtual environment is tested, the correct and efficient operation of the set of rules is checked, the use of the virtual reality headset and joysticks is verified, and the efficiency of the reporting services is monitored.

[0047] 15.1.3. General Features

[0048] The software thus created provides the following:

[0049] - It is a system that enables mothers to access in the virtual environment the facilities they have under physical conditions.

[0050] - In addition to effective education and training modules, it comprises additional modules for the personal and social development of mothers. This teaching -centred structure also enhances communication between mothers.

[0051] - The system provides ease of use to the user through its speed and high performance.

[0052] - Any desired number of users can be registered in the system.

[0053] - The optimisation features have been kept at a maximum level. This invention, which focuses on improving breastfeeding skills, can at a later stage be integrated with a system in which the breastfeeding image is transferred to an artificial intelligence module in order to evaluate the mother’s breastfeeding process and which provides feedback in cases where she performs the procedure incorrectly.

[0054] Data Collection: Receiving data from sensors and external sources.

[0055] Source: Sensor A, Sensor B, external API.

[0056] Preprocessing: Cleaning and optimising the incoming data.

[0057] Process: Data filtering, data normalization.

[0058] Analysis: Analysing the data by means of artificial intelligence (Al) algorithms.

[0059] Model Used: Deep learning-based analysis.

[0060] Visualization: Presenting the results to the user.

[0061] Interface: Dynamic charts and reports.

[0062] Feedback: Processing the feedback received from the user and integrating it into the system.

[0063] Loop: Performance improvement.

Claims

CLAIMSClaim 1. The invention relates to a method for data analysis and management in an AI- assisted breastfeeding simulation training system, characterised in that it comprises: a) providing a data stream from physical devices and external sources via data collection sensors, b) cleaning and filtering the collected data, c) analysing the data by means of Al-based algorithms, d) presenting the analysis results to the user through a graphical user interface, and e) collecting user feedback in order to optimise system performance.Claim 2. Method according to claim 1, characterised in that, during the data cleaning stage, structural inconsistencies are detected and corrupted data are automatically removed.Claim 3. Method according to claim 1, characterised in that, in the visualization stage, dynamic graphical analyses are presented in real time.Claim 4. Method according to claim 1, characterised in that the data stream coming from the sensors is transmitted in encrypted form and data security is ensured.Claim 5. Method according to claim 1, characterised in that the artificial intelligence algorithms integrated into the system optimise the learning mechanism by analysing user behaviour.

Images