Development stage determination device and method, computer-readable recording medium, and terminal device
By acquiring information on the movements of the lips, corners of the mouth, tongue, and palate of infants and young children during meals, and using prescribed criteria for automated judgment, the problem of accurately determining the degree of oral function development in infants and young children in existing technologies has been solved, enabling objective and detailed determination of developmental stages and food recommendations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- LION CORP
- Filing Date
- 2021-05-12
- Publication Date
- 2026-06-16
AI Technical Summary
Existing technologies are insufficient to objectively determine the degree of oral function development in infants and young children, especially since the determination based on limited information such as the number of chewing strokes is not accurate enough.
By acquiring information on the movements of the lips, corners of the mouth, tongue, and palate of infants and young children during meals, the system automatically makes judgments based on prescribed criteria and displays the judgment results on a display device, including past judgment history and updated information.
It enables objective and accurate determination of the developmental stage of oral function in infants and young children, provides detailed developmental stage information and suggestions on suitable food types and portions, and improves the accuracy of determination and user engagement.
Smart Images

Figure CN115916046B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a developmental stage determination device, a developmental stage determination method, a program, and a terminal device.
[0002] This application claims priority based on Japanese Patent Application No. 2020-085752, filed in Japan on May 15, 2020, the contents of which are incorporated herein by reference. Background Technology
[0003] Oral functions such as eating, speaking, and breathing decline with age. This decline can lead to conditions like aspiration pneumonia, making it a crucial issue for extending healthy lifespan.
[0004] It is known that the degree of decline in oral function is largely determined by the state of oral function acquired during infancy / school years. In particular, it is important to pay attention to the preparation and administration of weaning foods in accordance with the developmental stage of oral function in infants and young children.
[0005] Therefore, caregivers and other guardians need to have a correct understanding of the degree of oral function development in infants and young children, requiring an objective method for assessment. Ideally, this assessment should be automated to ensure objective assessment of oral function development.
[0006] Previously, automatic determination of oral function was achieved through technologies such as those disclosed in Patent Document 1.
[0007] Existing technical documents
[0008] Patent documents
[0009] Patent Document 1: Japanese Patent Application Publication No. 2004-242902
[0010] The problem that the invention aims to solve
[0011] However, the technology shown in Patent Document 1 only obtains limited information such as the number of chews, which may not be able to objectively determine the degree of oral function development in infancy. Summary of the Invention
[0012] Technical means for solving problems
[0013] One embodiment of the present invention is a developmental stage determination device, comprising: an action information acquisition unit that acquires action information representing an infant's oral ingestion of food; a developmental stage determination unit that determines, based on the action information acquired by the action information acquisition unit and a predetermined determination criterion, which stage among multiple developmental stages of oral function in infancy belongs to the action; and a display control unit that displays information representing the developmental stage determined by the developmental stage determination unit on a display device.
[0014] In a developmental stage determination device according to one embodiment of the present invention, the prescribed determination criteria include reference actions of at least one part of the infant's lips, corners of the mouth, tongue, and palate, corresponding to the developmental stage.
[0015] In a developmental stage determination device according to one embodiment of the present invention, the action information includes information on the activity of at least one part of the lips, corners of the mouth, tongue, and palate during at least a portion of the period from capturing food to swallowing.
[0016] In a developmental stage determination device according to one embodiment of the present invention, the motion information includes information on the activity of at least one part of the lips, corners of the mouth, tongue, and palate during the period before food is caught.
[0017] In a developmental stage determination device according to one embodiment of the present invention, the display control unit further displays information corresponding to the developmental stage determined by the developmental stage determination unit on the display device.
[0018] In a developmental stage determination device according to one embodiment of the present invention, the display control unit graphically displays information corresponding to the developmental stage determined by the developmental stage determination unit and a history of past determination results on the display device.
[0019] In a developmental stage determination device according to one embodiment of the present invention, the display control unit displays information selected from a plurality of information corresponding to the developmental stage as updated information corresponding to the developmental stage on the display device until the developmental stage determination unit determines that the developmental stage has been updated.
[0020] A developmental stage determination device according to one embodiment of the present invention further includes an operation receiving unit that receives update operations to update information of a display object. The display control unit updates the information corresponding to the developmental stage according to the status of the update operation received by the operation receiving unit, and displays the updated information on the display device.
[0021] In a development stage determination device according to one embodiment of the present invention, the display control unit displays information that promotes the provision of the action information on the display device based on the frequency at which the action information acquisition unit provides the action information and the frequency at which the operation acceptance unit accepts the update operation.
[0022] A developmental stage determination device according to one embodiment of the present invention further comprises: a food information acquisition unit that acquires food information indicating the type of food given to an infant; and a type determination unit that determines whether the type of food indicated by the food information acquired by the food information acquisition unit is suitable as food for consumption in the developmental stage determined by the developmental stage determination unit, and the display control unit further causes the determination result of the type determination unit to be displayed on a display device.
[0023] A developmental stage determination device according to one embodiment of the present invention further includes a portion determination unit, which determines the portion of food to be given to an infant based on the motion information obtained by the motion information acquisition unit, and the display control unit further displays information based on the determination result of the portion determination unit on a display device.
[0024] One embodiment of the present invention is a developmental stage determination method, comprising: an action information acquisition step, wherein the action information acquisition step acquires action information representing an action of oral ingestion of food by an infant; a developmental stage determination step, wherein the developmental stage determination step determines, based on the action information acquired in the action information acquisition step and a predetermined determination criterion, which of a plurality of developmental stages of oral function in infancy the action represented by the action information belongs to; and
[0025] A display control step is performed to display information representing the developmental stage determined in the developmental stage determination step on a display device.
[0026] One embodiment of the present invention is a program for causing a computer to perform the following steps: an action information acquisition step, which acquires action information representing an action of oral ingestion of food by an infant; a developmental stage determination step, which determines, based on the action information acquired in the action information acquisition step and a predetermined determination criterion, which determines which of a plurality of developmental stages of oral function in infancy the action represented by the action information belongs to; and a display control step, which causes information representing the developmental stage determined in the developmental stage determination step to be displayed on a display device.
[0027] One embodiment of the present invention is a terminal device comprising: a camera unit that captures images of an infant's oral intake of food; an output unit that outputs motion information based on the images captured by the camera unit to a developmental stage determination device, the developmental stage determination device determining which of a plurality of developmental stages of oral function in infancy the motion represented by the motion information pertains to based on the motion information and a predetermined determination criterion; an acquisition unit that acquires information representing the developmental stage determined by the developmental stage determination device based on the motion information output by the output unit; and a display control unit that displays the information representing the developmental stage acquired by the acquisition unit on a display device.
[0028] Invention Effects
[0029] According to the present invention, a developmental stage determination device, a developmental stage determination method, a program, and a terminal device are provided that can objectively determine the degree of development of oral function in infancy. Attached Figure Description
[0030] Figure 1 This is a diagram illustrating an example of the functional structure of the development stage determination system in this embodiment.
[0031] Figure 2 This is a diagram showing the first example of the determination criterion information in this embodiment.
[0032] Figure 3 This is a diagram showing a second example of the determination criteria information in this embodiment.
[0033] Figure 4 This is a diagram showing a third example of the determination criteria information in this embodiment.
[0034] Figure 5 This is a diagram showing the fourth example of the determination criteria information in this embodiment.
[0035] Figure 6 This is a diagram showing the fifth example of the determination criteria information in this embodiment.
[0036] Figure 7 This diagram illustrates an example of the operation of the development stage determination system in this embodiment.
[0037] Figure 8 This is a diagram illustrating an example of information about weaning foods according to this embodiment.
[0038] Figure 9 This is a diagram illustrating an example of information regarding the method of administering weaning food according to this embodiment.
[0039] Figure 10 This is an example of the information displayed by the terminal device in this embodiment.
[0040] Figure 11 This is another example of information displayed by the terminal device in this embodiment. Detailed Implementation
[0041] Hereinafter, the development stage determination system 1 of this embodiment will be described with reference to the accompanying drawings.
[0042] Figure 1 This is a diagram illustrating an example of the functional structure of the development stage determination system 1 in this embodiment.
[0043] The developmental stage determination system 1 includes a developmental stage determination device 10 and a terminal device 20. The developmental stage determination device 10 and the terminal device 20 are connected to each other via a network 30.
[0044] The developmental stage determination device 10 is, for example, a server device. The terminal device 20 is, for example, a smartphone or tablet.
[0045] [Functional Structure of Terminal Device 20]
[0046] The terminal device 20 includes a camera unit 21, a display unit 22, and an operation detection unit 23. The camera unit 21 captures images based on the user's operations on the terminal device 20. The display unit 22 includes, for example, an LCD screen, which displays images captured by the camera unit 21 and information sent by the developmental stage determination device 10 via the network 30. The operation detection unit 23 includes, for example, a touchpad, which detects the user's operations on the terminal device 20.
[0047] The terminal device 20 sends images and other information captured by the camera unit 21 to the developmental stage determination device 10 via the network 30.
[0048] Furthermore, during the development stage determination, information such as images and text is communicated between the development stage determination device 10 and the terminal device 20 via the network 30 as described above; however, the phrase "via the network 30" will be omitted in the following description.
[0049] In one example of this embodiment, the terminal device 20 sends motion information of the photographed subject 40 (e.g., an infant) to the developmental stage determination device 10. One example of motion information is an image of the photographed subject 40's mouth while eating.
[0050] The user of terminal device 20 adjusts the position / direction of terminal device 20 so that the mouth of the infant eating is included in the camera's field of view, and then performs a shooting operation. As a result, the movement of the infant eating is included in the moving image captured by camera 21. That is, in this example, the motion information represents the action of the infant ingesting food through their mouth.
[0051] Preferably, the motion information includes the movements of the infant's lips, corners of the mouth, tongue, and palate during eating.
[0052] Moreover, preferably, the motion information includes information on the movement of at least one part of the lips, corners of the mouth, tongue, and palate during at least a portion of the period from capturing food to swallowing.
[0053] Moreover, preferably, the motion information includes information on the activity of at least one part of the lips, corners of the mouth, tongue, and jaw during the period before capturing food.
[0054] Preferably, the motion information includes more detailed information about the movements around the mouth of the infant or toddler during eating. When the motion information includes more detailed information about the movements around the mouth of the infant or toddler during eating, the accuracy of the developmental stage determination can be improved.
[0055] Furthermore, motion information only needs to include information that can determine the movements of the lips, corners of the mouth, tongue, and jaw; it does not necessarily have to be a moving image (e.g., a series of images of multiple frames taken at different times, arranged in chronological order of the shooting time). For example, motion information can also be vector information extracted from the movement of the subject within a moving image.
[0056] [Functional Structure of Developmental Stage Determination Device 10]
[0057] The developmental stage determination device 10 includes an action information acquisition unit 110, a storage unit 120, a developmental stage determination unit 130, a display control unit 140, an operation receiving unit 150, a food information acquisition unit 160, a type determination unit 170, and a quantity determination unit 180.
[0058] In addition, the motion information acquisition unit 110, storage unit 120, development stage determination unit 130, display control unit 140, and operation acceptance unit 150 will be described here, and the food information acquisition unit 160, type determination unit 170, and quantity determination unit 180 will be described later.
[0059] The motion information acquisition unit 110 acquires the motion information sent by the terminal device 20. As an example, the terminal device 20 has an output unit (not shown) that sends motion information. In this case, the motion information acquisition unit 110 acquires the motion information sent from the output unit.
[0060] The motion information includes information representing the actions of an infant or toddler ingesting food orally. That is, the motion information acquisition unit 110 acquires motion information representing the actions of an infant or toddler ingesting food orally.
[0061] The motion information acquisition unit 110 outputs the acquired motion information to the development stage determination unit 130.
[0062] Storage unit 120 storage determination criteria information 121. (Refer to...) Figures 2-6 An example of the judgment criterion information 121 will be explained.
[0063] Figures 2-6 This diagram illustrates an example of the determination criterion information 121 in this embodiment. The determination criterion information 121 is information corresponding to the criteria used to determine the developmental stage of an infant. In this example, the developmental stage of the infant is one of five stages, from stage one to stage five.
[0064] For example, the criteria for determining the developmental stage "stage one" include "frequent protrusion of the tongue, sucking when the fingers are close to the tongue (primitive reflex), sucking the fingers, licking toys, and starting to lift the head".
[0065] That is, the storage unit 120 stores the prescribed criteria for determining the developmental stage of infants and young children.
[0066] Furthermore, preferably, the determination reference information 121 includes reference movements of at least one part of the infant's lips, corners of the mouth, tongue, and palate, corresponding to the developmental stage.
[0067] Here, an example of a judgment criterion stored as judgment criterion information 121 will be explained.
[0068] (1) Throughout all developmental stages, the important parts of the benchmark movements for judgment are "tongue, lips, corners of mouth, and palate". In this case, the prescribed judgment criteria include benchmark movements of at least one of the above parts that correspond to the developmental stage.
[0069] (2) In each developmental stage, the above-mentioned parts participate in the following ways.
[0070] • All stages (stages 1 to 5): The important part in the judgment criteria is the "tongue".
[0071] • Second to fourth stages: The key areas in the judgment criteria are "lips, corners of the mouth, and jaw".
[0072] • Stage 4 only: The criteria for judgment include the use of the teeth and the movement of the cheeks.
[0073] • Phase 1 and Phase 5: The criteria for judgment include the way the "hand" is used.
[0074] • Phases 2 to 5: The criteria for judgment include the movement of the "neck and head".
[0075] Based on the above, the following scenarios may be considered.
[0076] In the first stage of developmental assessment, information about the tongue is preferably a necessary criterion. More preferably, information about the tongue is a necessary criterion in the assessment of each developmental stage.
[0077] • In the second to fourth stages, it is preferable to also add information about the "lips and palate". More preferably, it is preferable to also add information about the "corners of the mouth". Preferably, this is especially true in the fourth stage.
[0078] • In the fourth stage, preferably, additional information on "teeth and cheeks" is also added.
[0079] • In the first and fifth stages, preferably, additional information about the "hand" is also provided.
[0080] • In the second to fifth stages, and more preferably, information on the “neck and head” is added as an auxiliary measure.
[0081] (3) The specific changes in the activities of each part across each developmental stage are as follows.
[0082] • Tongue (Stages 1-5): "The tongue frequently protrudes from the tip of the mouth when food is near the mouth" → "The activity is inhibited" → "The tongue moves up and down" → "The tongue moves up, down, left and right" → "The tongue moves freely".
[0083] • Lips (stages 2-4): "The lower lip moves below the upper lip" → "The activity is suppressed, and the upper and lower lips move symmetrically from side to side" → "The upper and lower lips move asymmetrically from side to side".
[0084] • Corner of the mouth (stage 2 → stage 4): "The corner of the mouth does not move" → "It moves symmetrically on both sides at the same time" → "It moves asymmetrically on both sides".
[0085] • Jaw (stages 2-4): "Slightly move the jaw up and down" → "Move up and down" → "Move up, down, left and right".
[0086] • How teeth are used (stages four to five): "Use your front teeth to bite down and take in food" → "Use your front teeth to bite down on large foods".
[0087] • Cheeks (stages 4-5): "Puffing out cheeks while chewing" → "Puffing out cheeks rhythmically while chewing".
[0088] • Hands: "Including fingers (stage 1)", "Can grasp food with hands, can use utensils to eat by themselves (stage 5)".
[0089] • Neck and head (stages 2-5): "Head raised, neck and head move infrequently" → "Head slightly protruding from the neck towards food" → "Head protruding significantly from the neck towards food" → "Neck and head move freely and can maintain correct posture".
[0090] That is, the judgment criteria stored as judgment criteria information 121 can also be assigned additional items corresponding to the developmental stage of the judgment object, and the relative priority between each item.
[0091] Furthermore, the judgment criterion information 121 may also include information on "the tendency of the judgment criterion action to occur" and "actions with high priority in the judgment of the developmental stage". Specific examples of the above-mentioned "judgment criteria", "the tendency of the judgment criterion action to occur", and "actions with high priority in the judgment of the developmental stage" will be explained.
[0092] (1) First stage (breastfeeding period)
[0093] A. Judgment Criteria:
[0094] • Frequent protrusion of the tongue.
[0095] • Sucking on the fingers when they are close to the tongue (primitive reflex).
[0096] • Including fingers.
[0097] Licking toys.
[0098] • Start looking up.
[0099] B. Determine the tendency for the benchmark action to occur:
[0100] 1. When a spoon or other object is brought near the mouth, the tongue frequently protrudes from the tip of the mouth.
[0101] Sucking on your fingers when they are close to your tongue.
[0102] Putting fingers in mouth and licking toys.
[0103] C. Actions with high priority in determining developmental stage:
[0104] • When a spoon or other object is brought near the mouth, the tongue frequently protrudes from the tip of the mouth.
[0105] (2) Second stage (early weaning stage (gulping and swallowing period))
[0106] A. Judgment Criteria:
[0107] • The lower lip extends below the upper lip.
[0108] • The corners of the mouth hardly move.
[0109] • Move your tongue back and forth to push food deep into your throat.
[0110] • The jaw moves up and down slightly.
[0111] • Close your lips and swallow.
[0112] • Use your upper lip to take food.
[0113] • When seeing food, the mouth moves (showing interest in food).
[0114] • Open your mouth when food is brought to your mouth.
[0115] • Raise your head.
[0116] • Infrequent neck and head movements.
[0117] • The frequency of actions such as “the tongue sticking out from the tip of the mouth when something like a spoon is near the mouth” has decreased.
[0118] • Even if a spoon or other object is near its mouth, it will not push it out with its tongue.
[0119] B. Determine the tendency for the benchmark action to occur:
[0120] 1. The frequency of actions such as "the tongue sticking out from the tip of the mouth when something like a spoon is near the mouth" has decreased.
[0121] When they see food, they move their mouths (to show interest in the food).
[0122] He raised his head.
[0123] The neck and head do not move frequently.
[0124] 2. Open your mouth when food is brought to your mouth.
[0125] The tongue moves back and forth, using it to push food deep into the throat, while the corners of the mouth hardly move.
[0126] 3. Even if a spoon or other object is near the mouth, it will not push it out with its tongue.
[0127] Use your upper lip to take the food, then move your lower lip under your upper lip, and move your jaw slightly up and down.
[0128] Close your lips and swallow.
[0129] C. Actions with high priority in determining developmental stage:
[0130] • The lower lip extends below the upper lip.
[0131] • Open your mouth when food is brought to your mouth.
[0132] • Close your lips and swallow.
[0133] • The jaw moves up and down slightly.
[0134] (3) Third Stage (Mid-Weaning (Closed-Mouth Chewing Period)) A. Judgment Criteria:
[0135] • Keep your upper and lower lips tightly closed while drinking.
[0136] • The corners of the mouth extend and retract horizontally to both sides simultaneously.
[0137] • Move your tongue up and down, pressing it against your upper jaw.
[0138] • Use your jaw to move up and down to finish eating.
[0139] • Close your lips and chew for 2-3 seconds before swallowing.
[0140] • The head is turned towards the food, protruding slightly from the neck.
[0141] B. Determine the tendency for the benchmark action to occur:
[0142] 1. Close your lips and chew for 2-3 seconds before swallowing.
[0143] Move your tongue up and down, pressing it against your upper jaw.
[0144] The corners of the mouth extend and retract horizontally to both sides simultaneously.
[0145] 2. The head is slightly protruding from the neck towards the food.
[0146] The jaw moves up and down to finish eating.
[0147] Keep your upper and lower lips tightly closed while drinking.
[0148] C. Actions with high priority in determining developmental stage:
[0149] • Keep your upper and lower lips tightly closed while drinking.
[0150] • Close your lips and chew for 2-3 seconds before swallowing.
[0151] • Use your jaw to move up and down to finish eating.
[0152] (4) Fourth Stage (Post-Weaning Period (Chewing Period)) A. Judgment Criteria:
[0153] • The upper and lower lips move and twist asymmetrically.
[0154] • The corners of the mouth move asymmetrically (lifting one side only).
[0155] • Move your tongue up, down, left, and right.
[0156] • The jaw moves up, down, left, and right.
[0157] • Use your front teeth to bite and pick up food.
[0158] Chew with puffed-out cheeks.
[0159] • The head protrudes significantly from the neck, facing the food.
[0160] • Use your lips to firmly take the food in.
[0161] • Engage in activities that involve grinding hard foods with your gums.
[0162] B. Determine the tendency for the benchmark action to occur:
[0163] 1. The head protrudes significantly from the neck towards the food.
[0164] The lips firmly grasped the food.
[0165] Move your tongue up, down, left, and right, and puff out your cheeks to chew.
[0166] 2. The upper and lower lips move asymmetrically while twisting, and the corners of the mouth move asymmetrically.
[0167] The jaw moves up, down, left, and right.
[0168] 3. Use your front teeth to bite down on the ground and pick up food.
[0169] To grind hard foods with the gums.
[0170] C. Actions with high priority in determining developmental stage:
[0171] • The corners of the mouth move asymmetrically from side to side.
[0172] • The upper and lower lips twist and move asymmetrically.
[0173] Chew with puffed-out cheeks.
[0174] • Use your front teeth to bite and pick up food.
[0175] • The jaw moves up, down, left, and right.
[0176] (5) Fifth stage (weaning completion period)
[0177] A. Judgment Criteria:
[0178] The tongue moves freely.
[0179] • Able to bite or crush rhythmically with teeth and gums.
[0180] • The neck and head can move freely and maintain the correct posture.
[0181] • Able to grasp and release food with their fingers.
[0182] • Able to pick up easy-to-reach toys and bring them to their mouth.
[0183] • Able to grasp food with their hands.
[0184] • Use your front teeth to bite large foods.
[0185] • Able to bring their hand to their mouth without moving their head.
[0186] • Able to eat using utensils independently.
[0187] B. Determine the tendency for the benchmark action to occur:
[0188] 1. The tongue moves freely.
[0189] They can bite or crush rhythmically with their teeth and gums.
[0190] 2. The neck and head can move freely and maintain the correct posture.
[0191] Able to grasp and release food with fingers.
[0192] They can pick up easy-to-grab toys and bring them to their mouths.
[0193] 3. Able to eat by grasping food with their hands.
[0194] Use your front teeth to bite down on large foods.
[0195] It is possible to bring one's hand to the mouth without moving the head.
[0196] 4. Able to eat using utensils independently.
[0197] C. Actions with high priority in determining developmental stage:
[0198] • Able to grasp food with their hands.
[0199] • Able to eat using utensils independently.
[0200] • Able to bite or crush rhythmically with teeth and gums.
[0201] Back Figure 1 The developmental stage determination unit 130 determines which of the multiple developmental stages of oral function in infancy the action represented by the action information is based on one or more of the action information obtained by the action information acquisition unit 110 or the determination criterion information 121 (prescribed determination criteria).
[0202] In the determination step performed by the development stage determination unit 130, a known image processing algorithm is applied. The image algorithms mentioned here broadly include algorithms that process still images and algorithms that process moving images.
[0203] In addition, the developmental stage determination unit 130 can also determine the developmental stage by referring to the results of machine learning of the movements of the infant's lips, corners of the mouth, tongue and palate.
[0204] The developmental stage determination unit 130 outputs the developmental stage determination result to the display control unit 140.
[0205] Furthermore, the developmental stage determination unit 130 can determine the developmental stage by quantifying the infant's oral function from the actions represented by the action information, based on either the action information acquired by the action information acquisition unit 110 or the determination benchmark information. In this case, the developmental stage can also be determined by displaying the ideal value of oral function for each age along with the mean / standard deviation. Moreover, the oral function values can be graphically generated and output to the display control unit 140. In this graph, the oral function values can also display information such as the mean and standard deviation along with the history. With this configuration, the developmental process can be grasped more precisely, and users can easily gain a realistic sense of the infant's growth as the photographed subject. Furthermore, it can give users the motivation to continue using the product.
[0206] Furthermore, the developmental stage determination unit 130 can also determine the developmental stage based on still images of characteristic moments in the action of an infant or toddler ingesting food orally. In this case, the terminal device 20 may also include a feature action determination unit (not shown) that determines moments that reflect the characteristics of the developmental stage in the action of an infant or toddler ingesting food orally. When the camera unit 21 is recording the action of an infant or toddler ingesting food orally, if a moment reflecting the characteristics of a developmental stage occurs, this feature action determination unit determines that moment as a feature action. If a feature action is determined to have occurred, the feature action determination unit can cause the camera unit 21 to capture a still image, or it can prompt the display (or sound) to trigger the capture of a still image.
[0207] Furthermore, the terminal device 20 can also display explanatory information indicating the time of capturing a still image (e.g., when the spoon is near / 3 seconds after it is placed in the mouth).
[0208] By configuring it in this way, the developmental stage determination system 1 can reduce the amount of information compared to the case where the terminal device 20 sends motion images of the infant or toddler during oral feeding (i.e., long-term) to the determination device 10.
[0209] Furthermore, the terminal device 20 can also send the image captured by the camera unit 21, after removing parts of the image that are not used in the determination of the developmental stage (e.g., background images, images other than the infant's mouth), as motion information to the determination device 10. With this configuration, the amount of information in the image sent as motion information can be reduced.
[0210] The display control unit 140 outputs information based on the determination result of the developmental stage determination unit 130 to the terminal device 20. As a result, the information based on the determination result of the developmental stage determination unit 130 is displayed on the display unit 22 of the terminal device 20.
[0211] That is, the display control unit 140 displays information about the developmental stage determined by the developmental stage determination unit 130 on the terminal device 20 (i.e., the display device).
[0212] The operation receiving unit 150 receives operations performed on the terminal device 20. Specifically, when an operation on the display surface of the display unit 22 is detected, the operation detection unit 23 (e.g., touchpad) of the terminal device 20 outputs operation information corresponding to the detected operation to the development stage determination device 10. The operation receiving unit 150 receives the operation information output from the terminal device 20. The operation receiving unit 150 outputs operation information to each part of the development stage determination device 10 according to the content of the received operation. As a result, each part of the development stage determination device 10 operates in accordance with the operation performed on the terminal device 20.
[0213] [Action of Developmental Stage Determination System 1]
[0214] Next, refer to Figure 7 An example of the action of the developmental stage determination system 1 is illustrated.
[0215] Figure 7 This diagram illustrates an example of the operation of the development stage determination system 1 in this embodiment.
[0216] (Step S10) The motion information acquisition unit 110 of the developmental stage determination device 10 acquires motion information from the terminal device 20. As described above, in this example, the motion information is a video of the movement of an infant's mouth while eating.
[0217] Furthermore, in order not to reduce the accuracy of developmental stage determination, it is preferable that the user operating the terminal device 20 captures the infant's face from the nose down to the tip of the chin within the field of view of the camera unit 21. The display control unit 140 can display an instruction such as "capture from the nose down to the tip of the chin" on the display unit 22 in the terminal device 20, or it can display the outline of the face, nose, and chin on the display unit 22 and the captured image from the camera unit 21.
[0218] Furthermore, the display control unit 140 can also display an indication of the shooting time on the display unit 22.
[0219] For example, an instruction such as "Take a picture of the spoon being brought to the mouth and swallowed" can be displayed on the display unit 22.
[0220] Furthermore, it is preferable to lengthen the motion information in order not to reduce the accuracy of developmental stage determination. The display control unit 140 can also display the shooting time, the time when the camera unit 21 captures the front of the infant's face, etc. on the display unit 22.
[0221] Furthermore, the display control unit 140 can also provide attention-grabbing information (e.g., flashing light, sound) to guide the infant's face toward the camera unit 21 during filming.
[0222] Furthermore, the display control unit 140 can also display images on the display unit 22 containing information related to the infant's growth status, such as age in months / weight. In this case, the motion information acquisition unit 110 acquires the growth status-related information along with the motion information.
[0223] Furthermore, the motion information acquisition unit 110 can also store the acquired information related to the growth status as resume information in the storage unit 120.
[0224] Furthermore, the display control unit 140 can also change or add the action information to be obtained in accordance with the developmental stage of the infant.
[0225] Furthermore, the display control unit 140 can also display information indicating the shooting time and the part of the subject being photographed (i.e., shooting guidance information). When displaying shooting guidance information, the display control unit 140 can also display shooting guidance information with different content corresponding to the developmental stage of the infant.
[0226] Furthermore, for example, if the important part in the determination criterion is the "hand", the display control unit 140 can replace the display of the hand action by shooting the hand action, and instead display a prompt for the user to input the hand action (for example, displaying a question such as "Use your hand?" and displaying an answer field for this question). That is, the display control unit 140 can also display information other than the image captured by the camera unit 21 as information that should be included in the action information.
[0227] Furthermore, the display control unit 140 allows the displayed answer bar to be in the form of text input or in the form of a selection based on Yes / No, etc.
[0228] (Step S20) The development stage determination unit 130 obtains the determination criteria information 121 stored in the storage unit 120.
[0229] (Step S30) The developmental stage determination unit 130 determines which stage of oral function development the infant's eating action captured by the terminal device 20 is in.
[0230] Specifically, the developmental stage determination unit 130 uses the action information obtained in step S10 as a search key to search for the determination reference information 121 obtained in step S20. The developmental stage determination unit 130 obtains the developmental stage corresponding to the search result and the action information. The developmental stage determination unit 130 outputs the determination result of the developmental stage to the display control unit 140.
[0231] Furthermore, the developmental stage determination unit 130 can also determine the developmental stage by performing statistical calculations on multiple motion information captured at different times. With this configuration, the developmental stage determination unit 130 can improve the accuracy of developmental stage determination.
[0232] Furthermore, due to the changes in facial expressions of infants and young children, the accuracy of developmental stage determination may sometimes decrease. In such cases, if the action information includes expressions where the shape of the mouth is different from the usual expression (e.g., crying face, smiling face, etc.), the developmental stage determination unit 130 may also remove the parts of the expression where the shape of the mouth is different from the usual expression to determine the developmental stage.
[0233] Furthermore, the developmental stage determination unit 130 sometimes cannot determine the developmental stage based on the content of the action information. The developmental stage determination unit 130 can also calculate the accuracy of the developmental stage determination (for example, a 60% probability of being the third stage, etc.). In this case, the display control unit 140 can also display the calculated accuracy of the developmental stage determination on the display unit 22.
[0234] Furthermore, the developmental stage determination unit 130 can also take the baseline condition of satisfying each developmental stage as 100 and calculate the value (1 to 100, etc.) proportionally. Moreover, it can also extract the vector information of the subject's movement from the moving image and quantify it. The display control unit 140 can also graphically display the calculated value together with the previous determination results (values) as a numerical progression on the display unit 22.
[0235] Furthermore, the developmental stage determination unit 130 can also correct the determination results based on the age (months) and number of teeth of the infant or toddler being photographed 40.
[0236] Furthermore, the developmental stage determination unit 130 can also determine the developmental stage based on the history of past determination results. Past determination results can also be stored as historical information in the storage unit 120. In this case, the developmental stage determination unit 130 determines the developmental stage based on the historical information stored in the storage unit 120.
[0237] (Step S40) The display control unit 140 obtains information corresponding to the developmental stage determined in step S30. Here, an example is given of "information corresponding to the developmental stage".
[0238] [An example of information corresponding to developmental stages]
[0239] (1) Information on the form of weaning foods
[0240] The display control unit 140 obtains information about the morphology of the weaning food as information corresponding to the developmental stage. For an example of the morphology information of the weaning food, see [reference needed]. Figure 8 Please provide an explanation.
[0241] Figure 8 This diagram illustrates an example of weaning food information 122 in this embodiment. In this example, the weaning food information 122 is stored in the storage unit 120 of the developmental stage determination device 10.
[0242] Information on the developmental stage and the form of the weaning food corresponding to the developmental stage corresponds to the weaning food information 122. The display control unit 140 retrieves the weaning food information 122 by setting the developmental stage determined in step S30 as the search key, thereby obtaining information on the form of the weaning food corresponding to the developmental stage (e.g., "sticky soup-like / cheese-like" in "second stage").
[0243] (2) Information on methods of giving weaning foods
[0244] The display control unit 140 obtains information on the method of administering weaning foods as information corresponding to the developmental stage. For an example of information on the method of administering weaning foods, refer to... Figure 9 Please provide an explanation.
[0245] Figure 9 This diagram illustrates an example of the weaning food administration method information 123 according to this embodiment. In this example, the weaning food administration method information 123 is stored in the storage unit 120 of the developmental stage determination device 10.
[0246] The information on the developmental stage and the corresponding method of giving weaning food corresponds to the information on the method of giving weaning food 123. The display control unit 140 retrieves the information on the method of giving weaning food 123 by setting the developmental stage determined in step S30 as the search key, thereby obtaining the information on the method of giving weaning food corresponding to the developmental stage (for example, in "third stage", "place the spoon on the lower lip, see the baby take the food, close the mouth to chew, gulp and swallow, then hand over the next spoon").
[0247] (Step S50) Return Figure 7 The display control unit 140 outputs the information of the developmental stage determined in step S30 and the information corresponding to the developmental stage obtained in step S40 to the terminal device 20 respectively.
[0248] Figure 10 This is an example of information displayed in the terminal device 20 of this embodiment. The display unit 22 of the terminal device 20 displays a determination result image P11. This determination result image P11 is an image representing the developmental stage determined in step S30. If it is determined to be "stage three" in step S30, "stage three" (or, more commonly, "closed-mouth chewing stage") is displayed on the display unit 22 as the determination result image P11.
[0249] Furthermore, operation images B11 to B14 can also be displayed on the display unit 22.
[0250] Operation image B11 is the operation image used to display the "dining suggestion screen".
[0251] When a user of terminal device 20 operates operation image B11, terminal device 20 outputs operation information indicating that operation image B11 has been operated to developmental stage determination device 10. Operation receiving unit 150 receives the operation information output by terminal device 20 and outputs it to display control unit 140. When display control unit 140 determines that the "meal suggestion screen" of operation image B11 has been operated, it outputs the meal suggestion screen as information corresponding to the developmental stage to terminal device 20. As a result, the "meal suggestion screen" is displayed on display unit 22 of terminal device 20.
[0252] Here, the "meal suggestion screen" is, for example, an image generated based on information stored in the aforementioned weaning food delivery method information 123.
[0253] An example of the information displayed on a screen suggesting dining options includes:
[0254] 1. Feeding methods (how the spoon is held to the mouth, the infant's posture, the timing of each bite, etc.)
[0255] 2. Food form / nutrition (the form of weaning food corresponding to this period and the required amount of nutrients) 3. Suggestions for weaning food steps (in case the weaning food provided is inconsistent with the developmental stage, the correct steps are suggested. For example, "Please go back one step", "Please go forward one step", "Wait a few days before resuming weaning food"), etc.
[0256] Furthermore, the display control unit 140 can also display information on the terminal device 20 to promote oral function development (e.g., suggestions on the form of weaning food, the way it is provided, training, etc.) even if the infant or toddler in the photographed subject 40 has not progressed even if he or she has reached the prescribed age.
[0257] Operation image B12 is an operation image used to display the "weaning food recipe screen". When the user of terminal device 20 operates operation image B12, as in the case described above, display control unit 140 outputs the weaning food recipe screen to terminal device 20 as information corresponding to the developmental stage. As a result, the "weaning food recipe screen" is displayed on display unit 22 of terminal device 20.
[0258] Here, the "weaning food recipe screen" is, for example, an image generated based on the information stored in the aforementioned weaning food information 122. Furthermore, the "weaning food recipe screen" may also include, for example, moving images showing the various stages of cooking, and still images of the completed weaning food.
[0259] Operation image B13 is used to display the "Parenting Log (Advanced Calendar) Screen". When the user of terminal device 20 operates operation image B13, as described above, display control unit 140 outputs the advanced calendar screen as information corresponding to the developmental stage to terminal device 20. As a result, the "Advanced Calendar Screen" is displayed on display unit 22 of terminal device 20.
[0260] Here, the "advanced calendar screen" is, for example, a screen that displays the changes in developmental stages using date units, week units, month units, etc., and is a screen that displays advancement anniversaries and allows for easy recording of growth. Moreover, "advanced" refers to an advancement in developmental stage (for example, changing from stage one to stage two).
[0261] In one example of the information displayed on the advanced calendar screen, there is:
[0262] Confirmation of the history of transitioning from weaning foods:
[0263] • Mealtime activity footage for each date
[0264] • Menu of weaning foods that were actually eaten
[0265] • Whether or not there is an allergic reaction to each food ingredient.
[0266] Furthermore, if a developmental stage declines (downgrades, for example, from stage three to stage two) after an advancement has been determined, the user may feel uneasy. The developmental stage determination unit 130 may also be configured to prevent a downgrade even if the developmental stage is determined to be slightly lower after advancement, in the event of multiple developmental stage determinations.
[0267] Furthermore, the developmental stage determination unit 130 can also determine the developmental stage in detail. For example, when the developmental stage determination unit 130 divides the developmental stage into 100 equal parts and determines the detailed stage, the developmental stage can also be determined as "60% within the third stage", etc.
[0268] Furthermore, users may become bored when developmental stages stagnate (for example, even repeated assessments do not change the first stage). The developmental stage assessment unit 130 can also assess developmental stages by dividing them into detailed numerical values.
[0269] Operation image B14 is an operation image used to display detailed information about the developmental stage. When the user of terminal device 20 operates operation image B12, similar to the above, display control unit 140 outputs a detailed information screen of the developmental stage to terminal device 20 as information corresponding to the developmental stage. As a result, a "detailed information screen of the developmental stage" is displayed on display unit 22 of terminal device 20. Figure 11 An example of a screen displaying "detailed information about the developmental stage".
[0270] Figure 11 This is another example of information displayed on the terminal device 20 in this embodiment. The display unit 22 of the terminal device 20 displays the determination result images P21 to P25 respectively.
[0271] Image P21, representing the developmental stage determined in step S30, is compared with the reference image. Figure 10 The image is the same as the determination result image P11. When the determination is "third stage" in step S30, the "third stage" (or, the developmental stage commonly represented as "closed-mouth chewing stage") is displayed on the display unit 22 as the determination result image P21.
[0272] Image P22 is a photographic image representing a typical example of an infant or toddler at the developmental stage determined in step S30.
[0273] Image P23 is an illustration that emphasizes the activity around the mouth of an infant at the developmental stage determined in step S30.
[0274] Image P24 is an illustration that emphasizes the activity within the oral cavity of an infant at the developmental stage determined in step S30.
[0275] The determination result image P25 may also be a graphical display on the display unit 22 showing the developmental stage after the developmental stage has been numerically quantified (1 to 100, etc.) together with the past determination results (numerical values), as a progression of numerical values.
[0276] The display control unit 140 displays the various image and text information mentioned above as information corresponding to the developmental stage on the display unit 22.
[0277] As described above, the display control unit 140, in addition to displaying information about the developmental stage (e.g., "third stage", "closed-mouth chewing stage") on the display unit 22, also displays information corresponding to the developmental stage (e.g., weaning food recipes, methods of giving weaning food, training to promote the formation of good teeth, oral care methods such as brushing teeth).
[0278] That is, the display control unit 140 also displays information corresponding to the developmental stage determined by the developmental stage determination unit 130 on the terminal device 20 (display device).
[0279] [Summary of Implementation Methods]
[0280] As explained above, the developmental stage determination system 1 determines the developmental stage based on the mouth movements of infants during meals captured by the camera unit 21 and predetermined criteria, using the developmental stage determination unit 130. Therefore, the developmental stage determination system 1 allows for an objective assessment of the degree of oral function development during infancy.
[0281] Furthermore, according to Developmental Stage Determination System 1, the developmental stage of oral function is displayed along with the infant's growth as a resume, thus providing users with objective indicators regarding the types and methods of weaning foods. Therefore, users (e.g., caregivers of infants) can choose appropriate types / methods corresponding to the developmental stage of oral function. Consequently, Developmental Stage Determination System 1 can reduce the anxiety of caregivers in childcare.
[0282] [Variation Example]
[0283] Next, variations of the implementation method will be described. Furthermore, functions and operations identical to those in the above-described implementation method will be given the same reference numerals, and their descriptions will be omitted.
[0284] [Update of display information when there is no change in developmental stage (1)]
[0285] As described above, the developmental stage determination unit 130 determines the developmental stage whenever it receives action information from the terminal device 20. Updating the infant's developmental stage (e.g., advancing to the next stage) requires a certain amount of time. Therefore, even when the terminal device 20 outputs the infant's action information to the developmental stage determination unit 10, the developmental stage may sometimes remain unupdated. In such cases, if the information displayed on the terminal device 20 is not updated, the motivation to continue using the developmental stage determination system 1 may diminish.
[0286] In this modified example, the display control unit 140, regardless of whether it obtains action information from the terminal device 20, outputs information different from the previously sent information to the terminal device 20 for information corresponding to the development stage, provided that the development stage remains unchanged.
[0287] That is, during the period from when the development stage determination unit 130 determines the development stage to when the development stage is updated, the display control unit 140 displays information selected from multiple pieces of information corresponding to the development stage as updated information corresponding to the development stage on the terminal device 20 (display device).
[0288] According to the developmental stage determination system 1 configured in this way, the information displayed on the terminal device 20 can change even if the infant's developmental stage remains unchanged. Therefore, according to the developmental stage determination system 1, even if the infant's developmental stage remains unchanged, it can provide users with the motivation to continue using the developmental stage determination system 1.
[0289] [Update of display information when there is no change in developmental stage (2)]
[0290] The operation receiving unit 150 can also be configured to receive update operations performed by the user of the terminal device 20 to update information of the displayed object. In this case, the display control unit 140 updates the information corresponding to the development stage in accordance with the update operation received by the operation receiving unit 150, and displays the updated information on the terminal device 20 (display device).
[0291] According to the developmental stage determination system 1 configured in this way, the information displayed on the terminal device 20 can be changed even if the infant's developmental stage remains unchanged. Therefore, according to the developmental stage determination system 1, even if the infant's developmental stage remains unchanged, it can provide the user with the motivation to continue using the device.
[0292] [Usage reminders based on operation frequency]
[0293] When it is determined that the user has not used the developmental stage determination system 1 for a period of time, the developmental stage determination system 1 can also display a prompt to use the system (use reminder).
[0294] That is, the display control unit 140 displays the information that prompts the provision of motion information on the terminal device 20 (display device) based on the frequency at which motion information is provided to the motion information acquisition unit 110 and the frequency at which the operation acceptance unit 150 accepts update operations.
[0295] For example, when both the frequency of update operations and the frequency of providing action information are low, the display control unit 140 causes information prompting the provision of action information to be displayed on the terminal device 20 (display device). In this case, usage reminders can be provided to users who do not frequently use the developmental stage determination system 1.
[0296] Furthermore, when the frequency of update operations is high but the frequency of providing action information is low, the display control unit 140 displays the information prompting the provision of action information on the terminal device 20 (display device). In this case, it is possible to provide usage reminders to users who frequently use the information provision function of the developmental stage determination system 1 but do not frequently use the developmental stage determination function.
[0297] [Determining whether the contents of weaning foods are suitable for the child's developmental stage]
[0298] The developmental stage determination system 1 may also have the function of determining whether the weaning food given to the infant is suitable for the infant's developmental stage. In this case, the developmental stage determination device 10 includes a food information acquisition unit 160 and a type determination unit 170.
[0299] The Food Information Acquisition Department 160 acquires food information indicating the types of food given to infants and young children.
[0300] Specifically, the user uses the camera unit 21 of the terminal device 20 to capture images of weaning foods given to infants. The terminal device 20 outputs the images of the weaning foods captured by the camera unit 21 to the developmental stage determination device 10. The food information acquisition unit 160 of the developmental stage determination device 10 acquires the images of the weaning foods from the terminal device 20. The food information acquisition unit 160 uses known image matching methods to determine the type of weaning food captured in the images of the weaning foods.
[0301] In addition, the food information acquisition unit 160 can also obtain information about the types of weaning foods by taking the results of the user's text input operations, menu selection operations, etc. on the terminal device 20, and use this information as food information.
[0302] Moreover, the food information mentioned above refers to a wide range of food types, including attributes such as ingredients, cooking methods, softness, and size.
[0303] The type determination unit 170 determines whether the type of food indicated by the food information obtained by the food information acquisition unit 160 is suitable as food for the developmental stage determined by the developmental stage determination unit 130.
[0304] Specifically, the type determination unit 170 determines the type of food that should be given to the infant (the type of food suitable for the infant's developmental stage) based on the types of food predetermined in advance according to the developmental stage of the infant and the developmental stage determined by the developmental stage determination unit 130. The type determination unit 170 compares the determined types of food (i.e., the ideal types of food corresponding to the developmental stage) with the types of food indicated by the food information obtained by the food information acquisition unit 160 (i.e., the types of food actually given to the infant) to determine whether it is suitable as food to be ingested during the developmental stage determined by the developmental stage determination unit 130.
[0305] In this case, the display control unit 140 also displays the determination result of the category determination unit 170 on the terminal device 20 (display device).
[0306] Furthermore, when infants and toddlers have preferences and aversions due to the types of food they are given, their facial expressions may differ depending on whether they are given a favorite type of food or a disliked type. When these facial expressions differ, the developmental stage determination unit 130 may sometimes make incorrect determinations about the developmental stage, thus reducing the accuracy of the developmental stage determination.
[0307] The developmental stage determination unit 130 can also be configured to improve the accuracy of developmental stage determination by statistically calculating multiple action information based on the type of food determined by the type determination unit 170 (i.e., determining whether a favorite type of food is given and whether an averse type of food is given).
[0308] Furthermore, the food given to infants and young children sometimes includes types of food that are appropriate for their developmental stage. In this case, the developmental stage determination unit 130 can also be configured to improve the accuracy of developmental stage determination by using action information regarding the situation where food appropriate for the developmental stage has been given, based on the type of food determined by the type determination unit 170.
[0309] [Determining the Quantity of Weaning Foods]
[0310] The developmental stage determination system 1 can also have the function of determining the amount of weaning food given to infants and young children. In this case, the developmental stage determination device 10 includes a quantity determination unit 180.
[0311] The portion determination unit 180 determines the portion size of food to be given to the infant based on the motion information acquired by the motion information acquisition unit 110. In this case, the display control unit 140 also displays the information based on the determination result of the portion determination unit 180 on the terminal device 20 (display device).
[0312] The developmental stage determination system 1, constructed in this way, can provide information to users when there is too much or too little weaning food.
[0313] In addition, the portion determination unit 180 can also determine the portion of weaning food based on the type of food given to the infant and the history of food given to the infant in the past.
[0314] For example, the portion determination unit 180 then determines the portion of food to be given to infants and young children based on the type of food determined by the type determination unit 170.
[0315] Furthermore, for example, when the storage unit 120 stores the history of food previously given to infants and young children, the portion determination unit 180 can then determine the portion of weaning food based on the history of food stored in the storage unit 120.
[0316] Based on this developmental stage determination system 1, the system can advise users on whether the amount of weaning food is appropriate, depending on whether the food given to the infant is the first type of food given, the type of food that has been given many times and is used to, or whether the infant is in a developmental stage that has just progressed.
[0317] Furthermore, in the above embodiments, an example of the functional sharing of the development stage determination device 10 and the terminal device 20 has been described, but each device may also be configured with a different functional sharing than described above.
[0318] For example, the developmental stage determination system 1 can also be implemented as software operating in the terminal device 20 to realize all or part of the functions of the developmental stage determination device 10.
[0319] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the specific structure is not limited to these embodiments, and appropriate changes can be made without departing from the spirit of the present invention.
[0320] Furthermore, each of the aforementioned devices has a built-in computer. The processing procedures of each device are stored as programs on a computer-readable recording medium. The computer reads and executes this program to perform the aforementioned processing. Here, a computer-readable recording medium refers to a disk, optical disk, CD-ROM, DVD-ROM, semiconductor memory, etc. Alternatively, the computer program can be distributed to a computer via a communication line, and the receiving computer executes the program.
[0321] Moreover, the above program can also be a part of the program used to implement the above functions.
[0322] Alternatively, it could be a so-called differential file (differential program) that can achieve the above functions by combining with programs already stored in the computer system.
[0323] Symbol Explanation
[0324] 1…Developmental stage determination system, 10…Developmental stage determination device, 110…Motion information acquisition unit, 120…Storage unit, 130…Developmental stage determination unit, 140…Display control unit, 150…Operation receiving unit, 160…Food information acquisition unit, 170…Type determination unit, 20…Terminal device
Claims
1. A developmental stage determination device, wherein, have: The motion information acquisition unit acquires motion information, which is information about an image taken of the mouth of an infant who is being photographed, and information indicating the action of the infant taking food through the mouth. The developmental stage determination unit determines, based on the action information obtained by the action information acquisition unit and a predetermined determination criterion, which of the multiple developmental stages of oral function in infancy the action information represents. as well as A display control unit displays information indicating the developmental stage determined by the developmental stage determination unit on a display device. The prescribed criteria include baseline movements of at least one part of the infant's lips, corners of the mouth, tongue, and palate, corresponding to the developmental stage. The prescribed criteria are given additional items corresponding to the developmental stage, which include any one of the infant's hands, neck, and head.
2. The developmental stage determination device as described in claim 1, wherein, The motion information includes information on the movement of at least one part of the lips, corners of the mouth, tongue, and palate during at least a portion of the period from capturing food to swallowing.
3. The developmental stage determination device as described in claim 2, wherein, The motion information includes information on the activity of at least one part of the lips, corners of the mouth, tongue, and palate during the period before capturing food.
4. The developmental stage determination device as described in claim 1 or 2, wherein, The display control unit also displays information corresponding to the developmental stage determined by the developmental stage determination unit on the display device.
5. The developmental stage determination device as described in claim 4, wherein, The display control unit displays information corresponding to the developmental stage determined by the developmental stage determination unit, along with a history of past determination results, graphically on the display device.
6. The developmental stage determination device as described in claim 5, wherein, During the period until the development stage determination unit determines that the development stage has been updated, the display control unit displays information selected from multiple pieces of information corresponding to the development stage as updated information corresponding to the development stage on the display device.
7. The developmental stage determination device as described in claim 6, wherein, It also has an operation processing department that handles update operations to update the information of the displayed object. The display control unit updates the information corresponding to the developmental stage based on the status of the update operation received by the operation acceptance unit, and displays the updated information on the display device.
8. The developmental stage determination device as described in claim 7, wherein, The display control unit displays information that facilitates the provision of the motion information on the display device based on the frequency at which the motion information acquisition unit provides the motion information and the frequency at which the operation acceptance unit accepts the update operation.
9. The developmental stage determination device as described in claim 1 or 2, wherein, It also has: The food information acquisition department acquires food information indicating the types of food given to infants and young children; as well as The type determination unit determines whether the type of food indicated by the food information obtained by the food information acquisition unit is suitable as food for consumption during the developmental stage determined by the developmental stage determination unit. The display control unit also displays the determination result of the type determination unit on the display device.
10. The developmental stage determination device as described in claim 1 or 2, wherein, It also includes a portion determination unit, which determines the portion of food to be given to the infant based on the motion information obtained by the motion information acquisition unit. The display control unit also displays information based on the determination result of the component determination unit on the display device.
11. A method for determining developmental stage, wherein, Computers have: The motion information acquisition step acquires motion information, which is information about an image taken of the mouth of an infant who is the subject of the photograph, and is information representing the action of the infant ingesting food through the mouth. The developmental stage determination step determines which of the multiple developmental stages of oral function in infancy the action represented by the action information obtained in the action information acquisition step and the prescribed determination criteria. as well as A display control step is performed to display information indicating the developmental stage determined in the developmental stage determination step on a display device. The prescribed criteria include baseline movements of at least one part of the infant's lips, corners of the mouth, tongue, and palate, corresponding to the developmental stage. The prescribed criteria are given additional items corresponding to the developmental stage, which include any one of the infant's hands, neck, and head.
12. A computer-readable recording medium having a program recorded thereon for causing a computer to perform the following steps: The motion information acquisition step acquires motion information, which is information about an image taken of the mouth of an infant who is the subject of the photograph, and is information representing the action of the infant ingesting food through the mouth. The developmental stage determination step determines which of the multiple developmental stages of oral function in infancy the action represented by the action information obtained in the action information acquisition step and the prescribed determination criteria. as well as A display control step is performed to display information indicating the developmental stage determined in the developmental stage determination step on a display device. The prescribed criteria include baseline movements of at least one part of the infant's lips, corners of the mouth, tongue, and palate, corresponding to the developmental stage. The prescribed criteria are given additional items corresponding to the developmental stage, which include any one of the infant's hands, neck, and head.
13. A terminal device, wherein, have: The camera unit films the process of infants and young children ingesting food orally; The output unit outputs motion information based on an image of the infant's mouth captured by the camera unit to the developmental stage determination device. The developmental stage determination device determines, based on the motion information and a predetermined determination criterion, which of the multiple developmental stages of oral function in infancy the motion information represents. The acquisition unit acquires information representing the developmental stage determined by the developmental stage determination device based on the action information output by the output unit; as well as A display control unit is configured to display information representing the developmental stage acquired by the acquisition unit on a display device. The prescribed criteria include baseline movements of at least one part of the infant's lips, corners of the mouth, tongue, and palate, corresponding to the developmental stage. The prescribed criteria are given additional items corresponding to the developmental stage, which include any one of the infant's hands, neck, and head.