Data processing device, data processing method, and data processing program

Abstract

The present invention provides a data processing device, a data processing method, and a data processing program that can reduce the burden on childcare workers in childcare facilities. [Solution] The data processing device comprises an input unit 292 for acquiring user data, a processing unit 294 for performing specific processing using a data generation model that generates predetermined inference results according to the user data, and an output unit 296 for outputting the results of the specific processing to a predetermined device. The input unit 292 acquires image data showing images of children in childcare facilities as user data, the processing unit 294 performs the process of generating report information as specific processing by inputting a prompt to the data generation model instructing it to generate report information for reporting the childcare status of children in childcare facilities based on the user data, and the output unit 296 outputs information based on the generated report information to a predetermined reporting destination device.

Description

Technical Field

[0001] The technology of the present disclosure relates to a data processing device, a data processing method, and a data processing program.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, the reduction of the burden on childcare workers in childcare facilities has not been considered, and there is room for improvement in reducing such burden. [[ID=3L]]

Means for Solving the Problems

[0005] A first aspect of the technology of this disclosure is a data processing device comprising: an input unit for acquiring user data; a processing unit for performing a specific processing using a data generation model that generates a predetermined inference result corresponding to the user data; and an output unit for outputting the result of the specific processing to a predetermined device, wherein the input unit acquires image data showing an image of a person being cared for in a childcare facility as the user data; the processing unit performs the process of generating the report information as the specific processing by inputting a prompt to the data generation model instructing it to generate a report information for reporting the childcare status of the person being cared for in the childcare facility based on the user data; and the output unit outputs information based on the generated report information to a predetermined reporting destination device.

[0006] A second aspect of the technology of this disclosure is a data processing method in which a computer performs a specific processing using a data generation model that acquires user data and generates a predetermined inference result corresponding to the user data, and outputs the result of the specific processing to a predetermined device, wherein the user data is image data showing an image of a person being cared for in a childcare facility, and a prompt is input to the data generation model instructing it to generate report information for reporting the childcare status of the person being cared for in the childcare facility based on the user data, thereby performing a process to generate the report information as the specific processing, and outputting information based on the generated report information to a predetermined reporting destination device.

[0007] A third aspect of the technology of this disclosure is a data processing program that causes a computer to execute a process which involves acquiring user data, performing a specific processing using a data generation model that generates a predetermined inference result corresponding to the user data, and outputting the result of the specific processing to a predetermined device, wherein the user data is image data showing an image of a person being cared for in a childcare facility, and the specific processing is performed by inputting a prompt to the data generation model instructing it to generate report information for reporting the childcare status of the person being cared for in the childcare facility based on the user data, and outputting the information based on the generated report information to a predetermined reporting destination device. [Brief explanation of the drawing]

[0008] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the embodiment. [Figure 3] This is a schematic diagram showing an overview of a specific process according to the embodiment. [Figure 4] This is a block diagram that schematically shows the functional configuration of the specific processing unit of the data processing device according to the embodiment. [Figure 5] This flowchart schematically shows an example of the operation flow of the first specific processing by the data processing device according to the embodiment. [Figure 6] This figure shows an example of a log confirmation screen according to the embodiment. [Figure 7] This flowchart schematically shows an example of the operation flow of the second specific processing by the data processing device according to the embodiment. [Figure 8] This flowchart schematically shows an example of the operation flow of the third specific processing by the data processing device according to the embodiment. [Figure 9] This figure shows an example of an event reporting screen according to the embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, an example of an embodiment of the data processing device, data processing method, and data processing program relating to the technology of this disclosure will be described with reference to the attached drawings.

[0010] First, let's explain the terminology used in the following explanation.

[0011] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), or an APU (Accelerated Processing Unit).

[0012] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0013] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0014] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor, an antenna, and the like. The communication I / F manages communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0015] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B". That is, "A and / or B" means that it may be only A, only B, or a combination of A and B. Also, in this specification, when expressing three or more matters connected by "and / or", the same concept as "A and / or B" is applied.

[0016] FIG. 1 shows an example of the configuration of a data processing system 10 according to an embodiment. In the following, a case where a nursery school is applied as the childcare facility of the present disclosure and a nursery teacher is applied as the childcare worker of the present disclosure will be described. However, it is not limited to this form. For example, a form in which a facility for school-age child care is applied as the childcare facility of the present disclosure and a school-age child care instructor is applied as the childcare worker of the present disclosure may also be used.

[0017] As shown in FIG. 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server. An example of the smart device 14 is a smartphone. In the present embodiment, the data processing device 12 is an example of the "data processing device" according to the technology of the present disclosure. The smart device 14 according to the present embodiment is owned by the nursery school (hereinafter simply referred to as "nursery school") targeted by the data processing system 10.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of the "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. Also, the database 24 and the communication I / F 26 are connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0019] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. Also, the reception device 38, the output device 40, and the camera 42 are connected to the bus 52.

[0020] The reception device 38 includes a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by contact of an indicator (e.g., a pen or a finger, etc.) by detecting the contact of the indicator. The microphone 38B receives user input by voice by detecting the voice of the user. A control unit 46A, which will be described later, transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, a specific processing unit 290, which will be described later, acquires data indicating the user input.

[0021] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user by outputting the data in a form perceptible to the user (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0023] To avoid confusion, Figure 1 shows only one smart device 14, but in reality, smart devices 14 are installed in areas such as the rooms and playgrounds where the nursery school children are active, with cameras 42 capable of capturing images of each child's activities.

[0024] On the other hand, in this embodiment, the data processing system 10 has parent terminals 80 owned by parents (hereinafter simply referred to as "parents") who entrust their children to the nursery school as care recipients, and these terminals are connected to the network 54. To avoid confusion, only one parent terminal 80 is shown in Figure 1, but in reality, all parents who entrust their children to the nursery school as care recipients own a parent terminal 80, and all parent terminals 80 are connected to the network 54. Therefore, the data processing device 12 can exchange various types of information with all parent terminals 80.

[0025] In this embodiment, a mobile device such as a smartphone or tablet is used as the parental device 80, but the embodiment is not limited to this configuration. For example, a stationary device may be used as the parental device 80.

[0026] Furthermore, in this embodiment, the data processing system 10 is connected to the network 54 via a childcare facility terminal 82 installed in the nursery school. Therefore, the data processing device 12 can exchange various types of information with the childcare facility terminal 82.

[0027] In this embodiment, a stationary terminal is used as the childcare facility terminal 82, but the embodiment is not limited to this form. For example, a mobile terminal such as a smartphone or tablet may be used as the childcare facility terminal 82.

[0028] Furthermore, in this embodiment, the data processing system 10 is connected to the network 54 by a public institution terminal 84 owned by a public institution (hereinafter simply referred to as "public institution") that requires nursery schools to submit prescribed reports. Therefore, the data processing device 12 can also exchange various types of information with the public institution terminal 84.

[0029] In this embodiment, a stationary terminal is used as the public institution terminal 84, but it goes without saying that the embodiment is not limited to this form.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "data processing program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] Storage 32 stores three data generation models: the first data generation model 58A, the second data generation model 58B, and the third data generation model 58C. The first data generation model 58A, the second data generation model 58B, and the third data generation model 58C are used by the specific processing unit 290. In the following, when describing the first data generation model 58A, the second data generation model 58B, and the third data generation model 58C without distinguishing between them, they will be collectively referred to as "data generation model 58".

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, we will describe the processing performed by the specific processing unit 290 when the data processing device 12 performs specific processing to reduce the burden on childcare workers in childcare facilities.

[0035] Figure 3 shows a schematic diagram illustrating the outline of a specific process according to this embodiment. In the data processing system 10 of this embodiment, as shown in Figure 3, image data showing moving images obtained by the camera 42 of the smart device 14, and audio data showing time-series audio obtained by the microphone 38B of the smart device 14 are stored as log data in the storage 32 of the data processing device 12.

[0036] In this process, the data processing device 12 detects each child in the image data using a predetermined object detection technique (YOLO (You Only Look Once) in this embodiment), and registers the corresponding child's identifier (name in this embodiment) in the storage 32, associating it with the image area of ​​the detected child.

[0037] Furthermore, the identification process in this embodiment includes a first identification process that generates childcare log information indicating the childcare log 90 using image data and audio data stored in the storage 32 as log data, and accepts corrections to the childcare log indicated by the generated childcare log information.

[0038] Furthermore, the identification process in this embodiment includes a second identification process that uses image data and audio data stored in storage 32 as log data to generate public report information indicating a public report 92 to be submitted to a public institution and transmits it to the public institution.

[0039] Furthermore, the identification process in this embodiment includes a third identification process that uses image data and audio data stored in storage 32 as log data to generate parental report information indicating a parental report 94 to be reported to the parent, and transmits it to the parent.

[0040] In the data processing device 12 according to this embodiment, a first data generation model 58A is used when performing a first specific processing. Furthermore, in the data processing device 12 according to this embodiment, a second data generation model 58B is used when performing a second specific processing. Moreover, in the data processing device 12 according to this embodiment, a third data generation model 58C is used when performing a third specific processing.

[0041] As described above, in this embodiment, the first specific processing, the second specific processing, and the third specific processing are performed using data generation models 58 prepared individually for each. However, the embodiment is not limited to this configuration. For example, the first specific processing, the second specific processing, and the third specific processing may be performed using a single data generation model 58. Alternatively, two specific processing combinations in the first specific processing, the second specific processing, and the third specific processing may be performed using a common data generation model 58, and the remaining specific processing may be performed using other data generation models 58.

[0042] As shown in Figure 4, the specific processing unit 290 includes an input unit 292, a processing unit 294, and an output unit 296.

[0043] The input unit 292 acquires user data. Specifically, the input unit 292 acquires image data showing images of children (in this embodiment, children) in a childcare facility (in this embodiment, a nursery school), and audio data showing sounds around the children, as user data. More specifically, the input unit 292 acquires the above image data and audio data relating to multiple children obtained by the smart device 14.

[0044] As described above, in this embodiment, both image data and audio data are acquired by the input unit 292, but the system is not limited to this configuration. For example, the input unit 292 may acquire only one of either image data or audio data.

[0045] The processing unit 294 performs specific processing using a data generation model 58 that generates predetermined inference results according to user data. Specifically, the processing unit 294 performs the process of generating the report information as specific processing by inputting a prompt to the data generation model 58 instructing it to generate report information for reporting the childcare status of children in a childcare facility based on user data. More specifically, the processing unit 294 performs the process of generating report information for multiple children as specific processing by inputting a prompt to the data generation model 58 instructing it to generate report information for reporting the childcare status of multiple children.

[0046] The output unit 296 outputs the results of a specific process to a predetermined device. Specifically, the output unit 296 outputs information based on the generated report information to a predetermined reporting destination device. More specifically, the output unit 296 outputs information based on the generated report information to at least one (in this embodiment, all of) of the parent terminal 80, childcare facility terminal 82, and public institution terminal 84.

[0047] In this embodiment, at least one (all of them in this embodiment) of the following is applied as report information: childcare log information showing a childcare log, parent report information showing a report to the guardian of the childcare recipient, and public report information showing a report to an official reporting destination.

[0048] Then, the processing unit 294 inputs a prompt to the first data generation model 58A instructing it to generate childcare log information, thereby performing the process of generating the childcare log information as the first specific process described above. Furthermore, the processing unit 294 inputs a prompt to the second data generation model 58B instructing it to generate public report information, thereby performing the process of generating the public report information as the second specific process described above. In addition, the processing unit 294 inputs a prompt to the third data generation model 58C instructing it to generate parent report information, thereby performing the process of generating the parent report information as the third specific process described above.

[0049] Furthermore, if the report information is parental report information, the output unit 296 outputs information based on said parental report information to the parent terminal 80 using a social networking service. In this embodiment, LINE® is used as the social networking service, but the system is not limited to this configuration. For example, other services such as +Message® or WHAT'SAPP® may be used as the social networking service.

[0050] Furthermore, the processing unit 294 performs a process to estimate the emotions of the person being cared for from user data and to generate report information using the estimated emotion information as at least one (in this embodiment, all of) of the first, second, and third specific processing steps.

[0051] Furthermore, the processing unit 294 performs a third specific processing step, which involves detecting events held at the childcare facility based on user data and contacting the parents of the children being cared for.

[0052] The first data generation model 58A, the second data generation model 58B, and the third data generation model 58C are so-called generative AI (Artificial Intelligence). An example of these data generation models 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data, image data, and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0053] For example, the processing unit 294 inputs the following prompt (hereinafter referred to as the "first prompt") to the first data generation model 58A, along with the image and audio data of the most recent past predetermined period (e.g., one day) acquired by the input unit 292: "This is image and audio data showing video and audio for the most recent past day. While estimating the emotions of each child from this data, please generate childcare log information that includes predetermined information about each child. The predetermined information includes the date, weather, class, childcare status described in one line, the condition of each child, etc." The "..." in the first prompt represents the childcare status information that needs to be included in the childcare log information. As a result, the first data generation model 58A generates the childcare log information described above.

[0054] Furthermore, for example, the processing unit 294 inputs the following prompt (hereinafter referred to as the "second prompt") to the second data generation model 58B, along with the image and audio data acquired by the input unit 292 for a predetermined period (for example, the most recent past six months) that is the period covered by the public report 92: "This is image and audio data showing video for the most recent past six months. While estimating the emotions of each child from this data, please generate public report information that shows a public report containing predetermined information about each child. The predetermined information is..." The "..." in the second prompt represents information indicating the childcare situation that needs to be included in the public report information. As a result, the second data generation model 58B generates the public report information described above.

[0055] Furthermore, for example, the processing unit 294 inputs the following prompt (hereinafter referred to as the "third prompt") to the third data generation model 58C, along with the image and audio data acquired by the input unit 292 for a predetermined period (for example, the most recent past day) that is the period for which reports to be made to parents: "This is image and audio data showing video and audio for the most recent past day. Estimate the emotions of each child from this data and generate information indicating a report to parents for each child that includes predetermined information. The predetermined information is... Also, if it is estimated that some kind of event took place, generate event information including information indicating the type of event and images showing the child in question." The "..." in the third prompt represents information indicating the childcare situation that needs to be included in the parent report information. As a result, the third data generation model 58C generates the above-mentioned parent report information, and if any event took place, it also generates the above-mentioned event information.

[0056] Next, the operation of the data processing system 10 will be explained.

[0057] First, with reference to Figure 5, the flow of the first specific processing in the specific processing will be explained. Note that the flow of the first specific processing shown in Figure 5 is an example of a "data processing method" relating to the technology of this disclosure. The first specific processing according to this embodiment is executed when the childcare time at the nursery school has ended and a childcare worker (hereinafter simply referred to as "childcare worker") who is creating the childcare log for the day instructs the execution of the process via the childcare facility terminal 82. To avoid confusion, here we will explain the case where log data obtained from the smart device 14 has been accumulated for a predetermined period (one day in this embodiment) or longer.

[0058] In step S300, the input unit 292 acquires image data and audio data for the most recent past day by reading them from the log data in the storage unit 32.

[0059] In step S302, the processing unit 294 generates the first prompt described above as an example.

[0060] In step S304, the processing unit 294 inputs the generated first prompt, along with the read image data and audio data, to the first data generation model 58A, thereby generating the childcare log information described above.

[0061] In step S306, the output unit 296 uses the generated childcare log information to format the childcare log indicated by the childcare log information into a predetermined format, and outputs (transmits) it to the childcare facility terminal 82 so that a log confirmation screen for checking the childcare log can be displayed. As a result, the log confirmation screen is displayed on the display unit of the childcare facility terminal 82.

[0062] Figure 6 shows an example of the log confirmation screen according to this embodiment, which is displayed on the display unit 82A of the childcare facility terminal 82.

[0063] As shown in Figure 6, this log confirmation screen displays the date, weather, class, childcare status (written in one line), individual child's condition, timetable, etc., included in the childcare log information generated by the first data generation model 58A, in a predetermined format. Note that the "weather" and other information included in the childcare log information do not necessarily need to be estimated from the read image data; for example, the weather information for the day may be obtained from an external server providing weather information connected to network 54 and included in the childcare log information.

[0064] When the log confirmation screen shown in Figure 6 is displayed on the display unit 82A of the childcare facility terminal 82, the childcare worker checks the information displayed on the log confirmation screen and selects the edit button 82A1 if there are any changes to the content, or the register button 82A2 if there are no changes to the content.

[0065] Therefore, in step S308, the processing unit 294 determines whether the correction button 82A1 was selected by the childcare worker. If the determination is negative, it is assumed that the registration button 82A2 was selected by the childcare worker and the process proceeds to step S312. If the determination is positive, the process proceeds to step S310.

[0066] In step S310, the processing unit 294 performs a correction process to accept corrections to the information displayed on the daily log confirmation screen by the childcare worker, and then proceeds to step S312.

[0067] In step S312, the output unit 296 registers the information displayed on the log confirmation screen at this point in the storage 32 as information indicating the final childcare log, and then terminates the first identification process.

[0068] Next, with reference to Figure 7, the flow of the second specific processing in the specific processing will be described. The flow of the second specific processing shown in Figure 7 is also an example of a "data processing method" related to the technology of this disclosure. The second specific processing according to this embodiment is executed when it is time to send public report information to a public institution (in this embodiment, once every six months). In order to avoid confusion, here again we will describe the case in which log data obtained from the smart device 14 has been accumulated for a predetermined period (in this embodiment, six months) or more.

[0069] In step S400, the input unit 292 acquires image and audio data for the most recent past six months by reading them from the log data in the storage unit 32.

[0070] In step S402, the processing unit 294 generates the second prompt described above as an example.

[0071] In step S404, the processing unit 294 inputs the generated second prompt, along with the read image data and audio data, to the second data generation model 58B, thereby generating the public report information described above.

[0072] In step S406, the output unit 296 outputs the generated public report information by converting it into a predetermined format and then sending it to a public institution, after which the second identification process is terminated.

[0073] Next, with reference to Figure 8, the flow of the third specific processing in the specific processing will be explained. The flow of the third specific processing shown in Figure 8 is also an example of a "data processing method" relating to the technology of this disclosure. The third specific processing according to this embodiment is executed when a predetermined timing (in this embodiment, when childcare hours at the nursery school end) occurs. To avoid confusion, here again, we will explain the case where log data obtained from the smart device 14 has been accumulated for a predetermined period (in this embodiment, one day's worth) or longer.

[0074] In step S500, the input unit 292 acquires image and audio data for the most recent past day by reading them from the log data in the storage unit 32.

[0075] In step S502, the processing unit 294 generates the third prompt described above as an example.

[0076] In step S504, the processing unit 294 inputs the generated third prompt, along with the read image data and audio data, to the third data generation model 58C, thereby generating the aforementioned parent report information.

[0077] In step S506, the output unit 296 outputs the generated parent report information by converting it into a predetermined format (in this embodiment, the LINE® format) and then sending it to the parent terminal 80.

[0078] In step S508, the processing unit 294 determines whether the event information described above has been generated by the third data generation model 58C. If the determination is negative, the third identification process is terminated; if the determination is positive, the process proceeds to step S510.

[0079] In step S510, the output unit 296 creates information in a predetermined format (in this embodiment, the LINE® format) using the type of event indicated by the generated event information and the image of the child in question (hereinafter referred to as "event notification information"), and sends it to each parent's parent terminal 80. After this, the third identification process is terminated. Upon receiving the event notification information, the event report screen is displayed on the display unit of the parent terminal 80.

[0080] Figure 9 shows an example of the event report screen according to this embodiment, which is displayed on the display unit 84A of the parent terminal 80.

[0081] As shown in Figure 9, this event report screen displays information about the sports day practice that took place on that day, along with images of the children. Therefore, parents can understand that a sports day practice was held on that day, along with images of the practice itself.

[0082] As described above, in the data processing system 10 according to this embodiment, the input unit 292 acquires image data showing images of children in childcare facilities as user data, and the processing unit 294 inputs a prompt to the data generation model instructing it to generate report information for reporting the childcare status of children in childcare facilities based on the user data, thereby performing the process of generating report information as a specific process, and the output unit 296 outputs information based on the generated report information to a predetermined reporting destination device. As a result, it becomes unnecessary to manually create report information from scratch, and the burden on childcare workers in childcare facilities can be reduced.

[0083] Furthermore, the data processing system 10 according to this embodiment also acquires audio data indicating the sounds around the person being cared for as user data. Therefore, since audio data can be used in addition to image data to generate report information, more accurate report information can be generated compared to cases where such audio data is not used.

[0084] Furthermore, the data processing system 10 according to this embodiment applies at least one (all of them in this embodiment) of childcare log information, parent report information, and public report information as report information. Therefore, the burden on childcare providers to create this report information can be reduced.

[0085] Furthermore, in the data processing system 10 according to this embodiment, if the report information is parental report information, the information based on the parental report information is output to the device used by the parent using a social networking service. As a result, the parent can understand the contents of the parental report information using a social networking service that they are familiar with, thereby further improving convenience for the parent. Furthermore, in the data processing system 10 according to this embodiment, the childcare log information includes at least one (all of the above in this embodiment) of the following for the day: date, weather, meals, childcare summary (corresponding to "childcare status described in one line" in the first prompt in this embodiment), the condition of the child being cared for, and the timetable. Therefore, this information can be obtained from the childcare log information.

[0086] Furthermore, in the data processing system 10 according to this embodiment, a specific process is performed to estimate the emotions of the person being cared for from user data and to generate report information using the estimated emotion information. Therefore, compared to the case where report information is generated without using the emotions of the person being cared for, more accurate report information can be generated.

[0087] Furthermore, the data processing system 10 according to this embodiment further performs a specific process to detect events held at childcare facilities based on user data and to contact the parents of the children being cared for. Therefore, convenience for parents can be further improved.

[0088] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0089] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0090] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0091] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0092] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0093] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0094] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0095] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0096] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0097] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0098] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0099] In the above embodiment, we have described a case in which the data processing device of the present disclosure is applied to a data processing device 12 configured as a server, but the present invention is not limited to this form. For example, the data processing device of the present invention may be applied to a smart device 14 or a childcare facility terminal 82.

[0100] Furthermore, although the above embodiment describes a case where the log confirmation screen is displayed on the childcare facility terminal 82, the embodiment is not limited to this form. For example, the log confirmation screen may be displayed on a mobile device held by the childcare worker.

[0101] Furthermore, it goes without saying that each of the first to third prompts shown in the above embodiment is merely an example and is not limited to those illustrated.

[0102] Furthermore, it goes without saying that the timing of the execution of the first, second, and third specific processes described in the above embodiment is merely an example and is not limited to those exemplified.

[0103] Furthermore, although the above embodiment describes a case in which a smart device 14 is used as a device for acquiring the image data and audio data of the Disclosure, the invention is not limited to this form. For example, instead of the smart device 14, a robot having a camera and a microphone may be used as a device for acquiring the image data and audio data of the Disclosure.

[0104] In relation to the above, the following additional information is disclosed.

[0105] <Note 1> An input section for acquiring user data, A processing unit that performs specific processing using a data generation model that generates predetermined inference results according to the user data, The system includes an output unit that outputs the result of the specified processing to a predetermined device, The input unit acquires image data showing images of children being cared for at a childcare facility as user data. The processing unit performs the process of generating the report information as the specified process by inputting a prompt to the data generation model instructing it to generate report information for reporting the childcare status of the childcare recipients at the childcare facility, based on the user data. The output unit outputs information based on the generated report information to a predetermined reporting destination device. Data processing device. <Note 2> The input unit further acquires audio data indicating the sounds around the person being cared for as user data. The data processing device described in Appendix 1. <Note 3> The aforementioned report information includes at least one of the following: childcare log information showing a childcare log, parent report information showing a report to the parent of the childcare recipient, and public report information showing a report to an official reporting recipient. A data processing device as described in Appendix 1 or Appendix 2. <Note 4> The output unit, when the report information is the parental report information, outputs information based on the parental report information to the device used by the parent using a social networking service. The data processing device described in Appendix 3. <Note 5> Each of the aforementioned childcare log entries includes at least one of the following for that day: date, weather, meals, childcare summary, the condition of the child being cared for, and the timetable. The data processing apparatus according to claim 3 or claim 4. <Note 6> The processing unit performs the following specific processing: estimating the emotions of the person being cared for from the user data, and further using the estimated information indicating the emotions to generate the report information. A data processing device described in any one of the appendices 1 through 5. <Note 7> The processing unit further performs the process of detecting events held at the childcare facility based on the user data and contacting the guardians of the child being cared for, as the specific processing. A data processing device described in any one of the appendices 1 through 6. <Note 8> Retrieve user data, A specific processing is performed using a data generation model that generates predetermined inference results according to the user data. A data processing method for outputting the results of the specified processing to a predetermined device, As user data, image data showing images of children in childcare facilities is acquired. Based on the user data, a prompt is input to the data generation model instructing it to generate report information for reporting the childcare status of the childcare recipients at the childcare facility, thereby performing the process of generating the report information as the specified process. The information based on the generated report information is output to a predetermined recipient device. A data processing method in which a computer performs the processing. <Note 9> Retrieve user data, A specific processing is performed using a data generation model that generates predetermined inference results according to the user data. A process for outputting the result of the specified process to a predetermined device, As user data, image data showing images of children in childcare facilities is acquired. Based on the user data, a prompt is input to the data generation model instructing it to generate report information for reporting the childcare status of the childcare recipients at the childcare facility, thereby performing the process of generating the report information as the specified process. The information based on the generated report information is output to a predetermined recipient device. A data processing program that instructs a computer to perform a task. [Explanation of Symbols]

[0106] 10 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 22 Computers 24 Databases 26 Communication I / F 28 processors 30 RAM 32 storage 34 bus 36 Computer 38 Reception device 38A Touch Panel 38B Microphone 40 Output device 40A Display 40B speaker 42 cameras 44 Communication I / F 46 processors 46A Control Unit 48 RAM 50 storage 52 bus 54 Network 56 Specific Processing Program 58 Data Generation Models 58A First Data Generation Model 58B Second Data Generation Model 58C Third Data Generation Model 60 Reception Output Program 80 Parental control devices 82 Childcare facility terminals 82A Display section 84 Public Institution Terminals 84A Display section 90 Nursery Diary 92 Public Reports 94 Parent Report 290 Specific Processing Unit 292 Input section 294 Processing Unit 296 Output section< / url:>

Claims

1. An input section for acquiring user data, A processing unit that performs specific processing using a data generation model that generates predetermined inference results according to the user data, The system includes an output unit that outputs the result of the specified processing to a predetermined device, The input unit acquires image data showing images of children being cared for at a childcare facility as user data. The processing unit performs the process of generating the report information as the specified process by inputting a prompt to the data generation model instructing it to generate report information for reporting the childcare status of the childcare recipients at the childcare facility, based on the user data. The output unit outputs information based on the generated report information to a predetermined reporting destination device. Data processing device.

2. The input unit further acquires audio data indicating the sounds around the person being cared for as user data. The data processing device according to claim 1.

3. The aforementioned report information includes at least one of the following: childcare log information showing a childcare log; parent report information showing a report to the parent of the childcare recipient; and public report information showing a report to an official reporting recipient. A data processing device according to claim 1 or claim 2.

4. The output unit, when the report information is the parental report information, outputs information based on the parental report information to the device used by the parent using a social networking service. The data processing device according to claim 3.

5. Each of the aforementioned childcare log entries includes at least one of the following for that day: date, weather, meals, childcare summary, the condition of the child being cared for, and the timetable. The data processing device according to claim 3.

6. The processing unit performs the following specific processing: estimating the emotions of the person being cared for from the user data, and further using the estimated information indicating the emotions to generate the report information. A data processing device according to claim 1 or claim 2.

7. The processing unit further performs the process of detecting events held at the childcare facility based on the user data and contacting the guardians of the child being cared for, as the specific processing. A data processing device according to claim 1 or claim 2.

8. Retrieve user data, A specific processing is performed using a data generation model that generates predetermined inference results according to the user data. A data processing method for outputting the results of the specified processing to a predetermined device, As user data, image data showing images of children in childcare facilities is acquired. Based on the user data, a prompt is input to the data generation model instructing it to generate report information for reporting the childcare status of the childcare recipients at the childcare facility, thereby performing the process of generating the report information as the specified process. The information based on the generated report information is output to a predetermined recipient device. A data processing method in which a computer performs the processing.

9. Retrieve user data, A specific processing is performed using a data generation model that generates predetermined inference results according to the user data. A process for outputting the result of the specified process to a predetermined device, As user data, image data showing images of children in childcare facilities is acquired. Based on the user data, a prompt is input to the data generation model instructing it to generate report information for reporting the childcare status of the childcare recipients at the childcare facility, thereby performing the process of generating the report information as the specified process. The information based on the generated report information is output to a predetermined recipient device. A data processing program that instructs a computer to perform a task.

Images