Data processing system and data processing method

Abstract

The aim is to provide feedback based on the results of an evaluation of the actual impact that diet can have on the health of each individual user. [Solution] The data processing system comprises a terminal worn by a user and a data processing device that is communicatively connected to the terminal, wherein the data processing device includes a processor, the processor acquires an image of the user's meal taken by a camera provided on the terminal, analyzes the image to generate meal data showing the details of the meal, acquires the user's biometric data detected by a sensor provided on the terminal, integrates and analyzes the meal data and the biometric data, and outputs information corresponding to the results of the analysis.

Description

Technical Field

[0001] The technology of the present disclosure relates to a data processing system and a data processing method.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Various studies have been conducted on the relationship between diet and health. However, since height, weight, age, metabolism, etc. vary from person to person, it is quite conceivable that a diet suitable for one user may not be suitable for another user. Here, conventionally, terminals capable of acquiring a user's biological data and surrounding situation data are known. However, since there has been no mechanism for applying and analyzing these data for diet management, there has been a risk that users will continue unhealthy eating habits. Therefore, an object of the present disclosure is to provide a system and a method capable of feeding back the result of evaluating the actual impact that diet can have on each user's health.

Means for Solving the Problems

[0005] A data processing system according to a first aspect of this disclosure comprises a terminal worn by a user and a data processing device that is communicatively connected to the terminal, wherein the data processing device includes a processor, the processor acquires an image of the user's meal taken by a camera provided on the terminal, analyzes the image to generate meal data showing the details of the meal, acquires the user's biometric data detected by a sensor provided on the terminal, integrates and analyzes the meal data and the biometric data, and outputs information corresponding to the results of the analysis.

[0006] A data processing system according to a second aspect of this disclosure, in a data processing system according to a first aspect, includes a processor that acquires historical data showing the history of the user's dietary data and biometric data, predicts the user's future health risks based on the historical data, and outputs information corresponding to the predicted results.

[0007] A data processing system according to a third aspect of this disclosure, in a data processing system according to a second aspect, the processor transmits a signal to the terminal to warn the user when the health risk exceeds a predetermined standard.

[0008] A data processing system according to a fourth aspect of this disclosure, in a data processing system according to any one of the first to third aspects, the processor sends a message to the terminal indicating a meal recommended to the user in accordance with the results of the analysis.

[0009] A data processing system according to a fifth aspect of this disclosure, in a data processing system according to a fourth aspect, the processor acquires other-person data indicating the meal data and biometric data relating to other users, and determines the recommended meal based on the other-person data.

[0010] The data processing system according to the sixth aspect of this disclosure is a data processing system according to any one of the first to fifth aspects, wherein the terminal is a necklace-type terminal.

[0011] A data processing method according to a seventh aspect of this disclosure is a data processing system comprising a terminal worn by a user and a data processing device that is communicatively connected to the terminal, wherein the data processing device acquires an image of the user's meal taken by a camera provided on the terminal, analyzes the image to generate meal data showing the details of the meal, acquires the user's biometric data detected by a sensor provided on the terminal, integrates and analyzes the meal data and the biometric data, and outputs information corresponding to the results of the analysis. [Brief explanation of the drawing]

[0012] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the main functions of a data processing device and a necklace-type terminal. [Figure 3] This is a side view showing the configuration of a necklace-type terminal. [Figure 4] This is a top view showing the configuration of a necklace-type terminal. [Figure 5] The functional configuration of the control unit of the necklace-type terminal is shown in general terms. [Figure 6] The functional configuration of a specific processing unit of a data processing device is shown in general terms. [Figure 7] This diagram outlines an example of the operation flow of a specific process performed by a data processing device. [Figure 8] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 9] A conceptual example of the operation flow of a specific process by the data processing device according to the second embodiment is shown. [Modes for carrying out the invention]

[0013] Hereinafter, an example of an embodiment of a data processing apparatus, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), or an APU (Accelerated Processing Unit), etc.

[0016] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0017] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0018] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor, an antenna, and the like. The communication I / F manages communication between a plurality of computers. Examples of communication standards applicable to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B". That is, "A and / or B" means that it may be only A, only B, or a combination of A and B. Also, in this specification, when expressing three or more matters connected by "and / or", the same concept as "A and / or B" is applied.

[0020] <First Embodiment> FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0021] As shown in FIG. 1, the data processing system 10 includes a data processing device 12 and a necklace-type terminal 14. An example of the data processing device 12 is a server. In this embodiment, the data processing device 12 is an example of the "data processing device" according to the technology of the present disclosure, and the necklace-type terminal 14 is an example of the "necklace-type terminal" according to the technology of the present disclosure.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The necklace-type terminal 14 includes a computer 36, a microphone 38, a sensor 39, a speaker 40, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 38, speaker 40, and camera 42 are also connected to the bus 52.

[0024] The user 20 wearing the necklace-type terminal 14 may be, for example, a patient whose health condition is being diagnosed, or a regular user.

[0025] The microphone 38 picks up the voice emitted by the user 20, who is wearing the necklace-type terminal 14, as well as sounds around the user 20. The microphone 38 also receives instructions from the user 20 by receiving the voice emitted by the user 20. The microphone 38 captures the voice emitted by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 40 outputs audio according to the instructions from the processor 46. The speaker 40 is, for example, a directional speaker and outputs audio towards the user 20's ears.

[0026] Sensor 39 is a sensor that detects biometric data of the user 20, who is wearing the necklace-type terminal. For example, sensor 39 may be a heart rate sensor or a blood oxygen sensor.

[0027] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the necklace-type terminal 14.

[0030] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. The storage 32 stores a specific processing program 56. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58. The data generation model 58 is used by the specific processing unit 290. The storage 32 also includes a data storage unit 54.

[0032] In the necklace-type terminal 14, data acquisition processing is performed by the processor 46. The storage 50 stores the data acquisition program 60. The processor 46 reads the data acquisition program 60 from the storage 50 and executes the read data acquisition program 60 on the RAM 48. The data acquisition processing is realized by the processor 46 operating as a control unit 46A according to the data acquisition program 60 executed on the RAM 48.

[0033] As shown in Figures 3 and 4, the necklace-type terminal 14 includes multiple microphones 38, multiple sensors 39, multiple speakers 40, and multiple cameras 42. Figures 3 and 4 show an example where two microphones 38 are positioned in front of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two sensors 39 are positioned to the right and left of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two speakers 40 are positioned to the right rear and left rear of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two cameras 42 are positioned to the right front and left front of the user 20 when the user 20 wears the necklace-type terminal 14. Finally, they show an example where two sensors 39 are positioned inside the necklace-type terminal 14 so as to contact the user 20's neck when the user 20 wears the necklace-type terminal 14.

[0034] Next, we will explain the processing of the control unit 46A when the necklace-type terminal 14 performs data collection processing to collect data.

[0035] In this embodiment, the data collection process collects the user's biometric data in real time. Furthermore, it collects not only biometric data but also all surrounding environment data. This makes it possible to detect early signs of conditions such as Alzheimer's disease and dementia. It also allows for monitoring of the user's health status (e.g., heart disease).

[0036] As shown in Figure 5, the control unit 46A includes a data acquisition unit 100 and a communication unit 102.

[0037] The data acquisition unit 100 collects the outputs of the microphone 38, sensor 39, and camera 42, respectively.

[0038] The communication unit 102 transmits the outputs of the microphone 38, sensor 39, and camera 42, which are collected by the data acquisition unit 100, to the data processing unit 12.

[0039] Next, we will describe the processing of the specific processing unit 290 when the data processing device 12 performs specific processing to obtain a response corresponding to a user utterance.

[0040] In the specific processing in this embodiment, a response corresponding to the user utterance picked up by the microphone 38 of the necklace-type terminal 14 is obtained using the data generation model 58.

[0041] As shown in Figure 6, the specific processing unit 290 includes an input unit 292, a processing unit 294, and an output unit 296.

[0042] The input unit 292 stores the outputs of the microphone 38, sensor 39, and camera 42, respectively, received from the necklace-type terminal 14, in the data storage unit 54.

[0043] The input unit 292 acquires user utterances received by the necklace-type terminal 14. Specifically, it acquires user utterances picked up by the microphone 38 of the necklace-type terminal 14.

[0044] The processing unit 294 performs specific processing using the data generation model 58. Specifically, it inputs a prompt including user utterances to the data generation model 58 and obtains a generation result. At this time, the outputs of the sensor 39 and camera 42 collected by the data acquisition unit 100 may also be included in the prompt.

[0045] The output unit 296 transmits the result of the specific processing to the necklace-type terminal 14. In the necklace-type terminal 14, the control unit 46A causes the speaker 40 to output the result of the specific processing. In this way, a response corresponding to the user utterance picked up by the microphone 38 is output to the user 20 by the speaker 40. The microphone 38 further acquires the user utterance in response to the result of the specific processing. The control unit 46A transmits the audio data indicating the user utterance acquired by the microphone 38 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the user utterance.

[0046] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0047] The outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 are used, for example, to diagnose the health status of user 20. In this case, the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 may be transmitted to a terminal on the medical institution's side. Alternatively, the data processing device 12 may analyze the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 to diagnose the health status of user 20.

[0048] Next, the operation of the data processing system 10 will be explained.

[0049] First, let's explain an example of the data collection process flow.

[0050] When user 20 is wearing the necklace-type terminal 14, the data acquisition unit 100 sequentially collects the outputs of the microphone 38, sensor 39, and camera 42. The communication unit 102 sequentially transmits the outputs of the microphone 38, sensor 39, and camera 42 collected by the data acquisition unit 100 to the data processing unit 12.

[0051] Next, an example of the flow of a specific process will be explained with reference to Figure 7. Here, the input unit 292 of the data processing device 12 sequentially acquires the outputs of the microphone 38, sensor 39, and camera 42 received from the necklace-type terminal 14 and stores them in the data storage unit 54.

[0052] In step S300, the processing unit 294 determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be that the user utterance picked up by the microphone 38 contains a specific word (for example, the name of the agent installed in the necklace-type terminal 14) or a phrase (for example, "Hi! XX" (where XX is the name of the agent)).

[0053] If the trigger condition is met in step S300 (step S300; Yes), the data processing system 10 proceeds to step S301. On the other hand, if the trigger condition is not met in step S300 (step S300; No), the data processing system 10 terminates the specific processing.

[0054] In step S301, the processing unit 294 generates a prompt by adding an instruction to obtain the result of a specific process to the text representing the user utterance picked up by the microphone 38.

[0055] For example, a prompt such as "The user is speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech) can be generated. Alternatively, the outputs of sensor 39 and camera 42 can be added to the prompt to generate a prompt such as "This is biometric data representing the user's heart rate and video data representing the user's surroundings. The user is also speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech)

[0056] In step S303, the processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of a specific process based on the output of the data generation model 58.

[0057] In step S304, the output unit 296 outputs the result of the specific processing to the necklace-type terminal 14 and terminates the specific processing.

[0058] <Second Embodiment> Figure 8 shows an example of the configuration of the data processing system according to the second embodiment. Various studies have been conducted on dietary management. However, conventionally, there has been no mechanism to apply and analyze the user's biometric data and surrounding environment data for dietary management, which has led to the risk of users continuing unhealthy eating habits. In the second embodiment, in order to solve this problem, specific processing by the data processing system 10 is applied to dietary management.

[0059] The data processing system 10 according to the second embodiment comprises a data processing device 12, a necklace-type terminal 14, a nutrition database 16, a history database 17, and a community database 18. In the second embodiment, the necklace-type terminal 14 is an example of a “terminal” according to the disclosure.

[0060] The necklace-type terminal 14 is connected to the data processing device 12 via the network 54 in a communicative manner. Therefore, the data processing device 12 can collect the outputs of the microphone 38, sensor 39, and camera 42 provided on the necklace-type terminal 14. In addition, the data processing device 12 can output the results of a specific process to the speaker 40 provided on the necklace-type terminal 14.

[0061] In the second embodiment, the camera 42 provided on the necklace-type terminal 14 may be a multispectral camera. Therefore, the camera 42 observes the intensity of the light spectrum emitted by the subject (in this case, food) for each wavelength. However, it is not limited to this. The camera 42 may be other cameras such as a hyperspectral camera or an RGB camera.

[0062] Furthermore, the data processing device 12 is connected to the nutrition database 16, the history database 17, and the community database 18 via the network 54, enabling communication between them. Therefore, the data processing device 12 can access these databases to read data and write data to them.

[0063] Nutritional database 16 is a database that stores data on the nutritional components of food ingredients and dishes.

[0064] The history database 17 is a database that stores history data showing the history of a user's meal data and biometric data. The history data may be stored separately for each user. The data processing device 12 can update the history data each time by writing meal data and biometric data to the history database 17.

[0065] Community Database 18 is a database that stores dietary data and biometric data about other users. The data stored in Community Database 18 may be kept confidential in terms of personal information.

[0066] In the second embodiment, the wearer of the necklace-type terminal 14 is a user 20 who is about to eat a meal, and the meal is already prepared on the table. Therefore, the camera 42 provided on the necklace-type terminal 14 can take an image of the meal prepared on the table when the user 20 sits down.

[0067] Figure 9 shows an example of the operation flow of a specific process by the data processing device according to the second embodiment. This flow may be started automatically when it is time for a meal, or it may be started manually by the user 20 by pressing the start button or by uttering a command to start.

[0068] In step S400, the processor 28 acquires an image of the user 20's meal captured by the camera 42 installed on the necklace-type terminal 14. For example, the necklace-type terminal 14 may take a picture of the meal on the table with the camera 42 in response to the user 20 saying "Itadakimasu" (thank you for the meal). In this case, if the necklace-type terminal 14 cannot recognize the meal, it may output a voice message from the speaker 40 saying, "Cannot take a picture of the meal. Please point the camera at the meal." The processor 28 may acquire the image taken in this way from the necklace-type terminal 14 via the network 54.

[0069] In step S401, the processor 28 analyzes the image acquired in step S400 to generate meal data showing the details of the meal. For example, the processor 28 may input a prompt to the data generation model 58 instructing it to analyze the image and identify the type and quantity of dishes and ingredients, and then identify the type and quantity of dishes and ingredients from the output of the data generation model 58. Alternatively, the processor 28 may access the nutrition database 16 via the network 54 and search the nutrition database 16 using the identified dishes and ingredients as keys. As a result, the processor 28 may generate meal data including the name of the dish, ingredients used, and nutritional components (calories, protein, fat, carbohydrates, salt equivalent, calcium, or vitamins, etc.).

[0070] In step S402, the processor 28 acquires the user's biometric data detected by the sensor 39 provided on the necklace-type terminal 14. For example, the processor 28 may acquire the user's heart rate, blood glucose level, and blood oxygen saturation detected by the sensor 39 in real time from before a meal until a predetermined time has elapsed after the meal.

[0071] In step S403, the processor 28 integrates and analyzes the meal data generated in step S401 and the biometric data acquired in step S402. For example, the processor 28 may perform the analysis by inputting a prompt to the data generation model 58 instructing it to analyze, in a time series, how heart rate, blood glucose level, and blood oxygen saturation changed from before the meal to after the meal, based on the meal data and biometric data.

[0072] In this case, the processor 28 may access the history database 17 via the network 54 and obtain history data showing the history of the user 20's dietary data and biometric data. The processor 28 may then predict the user 20's future health risks based on the history data.

[0073] As an example, suppose user 20's pre-meal blood glucose level was 125 mg / dL. Suppose that user 20's historical data shows a past instance where, after consuming white rice while drinking a soft drink, their post-meal blood glucose level increased by 100 mg / dL. Now, suppose user 20's upcoming meal includes both white rice and a soft drink. In this case, processor 28 can predict that the post-meal blood glucose level will be approximately 225 mg / dL.

[0074] In step S404, the processor 28 outputs information corresponding to the results of the analysis in step S403. For example, the processor 28 may determine whether the predicted postprandial blood glucose level is 200 mg / dL or higher. If the predicted postprandial blood glucose level is 200 mg / dL or higher, the processor 28 may warn the user 20.

[0075] In this case, since the predicted postprandial blood glucose level is 225 mg / dL, which is above 200 mg / dL, the processor 28 may send a message to the necklace-type terminal 14 stating, "Your postprandial blood glucose level will rise sharply. Please be careful." In response, the necklace-type terminal 14 may output the above message as an audible message from the speaker 40. This allows the processor 28 to warn the user 20.

[0076] The above explanation uses the example of the processor 28 sending a message to the necklace-type terminal 14, but is not limited to this. The processor 28 may also send a vibration command to the necklace-type terminal 14. In response, the necklace-type terminal 14 may turn on its vibration function. This allows the processor 28 to warn the user 20.

[0077] The processor 28 may, for example, acquire historical data showing the user 20's dietary data and biometric data history, and predict the user 20's future health risks based on the historical data. The processor 28 may then output information corresponding to the prediction results, such as sending a warning signal to the necklace-type terminal 14 when the health risk exceeds a predetermined standard.

[0078] In the above explanation, the processor 28 was shown as an example of performing short-term predictions, such as postprandial blood glucose levels, but it may also perform medium- to long-term predictions. For example, if the processor 28 determines, based on historical data, that the user 20 is at high risk of developing diabetes within a few months, it may send a signal to the necklace-type terminal 14 to warn the user 20.

[0079] Furthermore, while the above explanation provided an example of the processor 28 issuing a warning to the user 20, it is not limited to this. For example, the processor 28 may send a message to the necklace-type terminal 14 stating, "Consuming white rice and a soft drink at the same time will cause a rapid increase in blood sugar levels. Please replace the soft drink with water." In response, the necklace-type terminal 14 may output the above message as an audio from the speaker 40. This allows the user 20 to replace the soft drink with water.

[0080] Furthermore, at this time, users can also share ideas for improving their diets with other users. For example, the processor 28 may access the community database 18 via the network 54 and obtain other user data, which includes dietary data and biometric data about other users.

[0081] Suppose that, upon reviewing other users' data, the processor 28 finds data indicating that switching from white rice to brown rice suppressed the rise in blood sugar levels. In this case, the processor 28 may send a message to the necklace-type terminal 14 stating, "Eating brown rice is the current health trend for suppressing the rise in blood sugar levels. We recommend switching from white rice to brown rice." In response, the necklace-type terminal 14 may output the above message as an audio from the speaker 40. As a result, the user 20 can switch from white rice to brown rice.

[0082] The processor 28 can, for example, send a message to the necklace-type terminal 14 indicating a recommended meal for the user 20, based on the analysis results. In this process, the processor 28 can also acquire other user data, including dietary data and biometric data, and determine a recommended meal based on this other user data.

[0083] As described above, the data processing system 10 according to the second embodiment includes a necklace-type terminal 14 worn by the user 20 and a data processing device 12 that is communicatively connected to the necklace-type terminal 14. The data processing device 12 acquires images of the user 20's meals taken by a camera 42 provided on the necklace-type terminal 14, analyzes the images to generate meal data showing the details of the meals, and also acquires biometric data of the user 20 detected by a sensor 39 provided on the necklace-type terminal 14. The data processing device 12 integrates and analyzes the meal data and biometric data and outputs information according to the results of the analysis. Thus, according to the data processing system 10 according to the second embodiment, it is possible to provide feedback on the results of evaluating the actual impact that meals can have on the health of each individual user.

[0084] Furthermore, according to the data processing system 10 of the second embodiment, by linking meal data and biometric data, it is possible to immediately monitor changes in the body before and after meals and evaluate in real time and in a personalized manner how the contents of the meal affect the health status.

[0085] Furthermore, according to the data processing system 10 of the second embodiment, it is possible to suggest an optimal nutritional balance for each individual user 20. For example, a user 20 who has been consistently consuming excessive salt can be advised to use alternative seasonings or to increase the intake of specific foods.

[0086] Furthermore, according to the data processing system 10 of the second embodiment, it is possible to predict potential health risks (e.g., hypertension and diabetes) that may occur if a particular eating habit continues, and to notify the user 20 in advance. Such notification may include specific dietary improvement suggestions to mitigate the risks.

[0087] Furthermore, according to the data processing system 10 of the second embodiment, a community platform is built in which users 20 can anonymously share their dietary data. This allows users 20 to exchange information and share ideas for improving their diet with other users, enabling them to maintain motivation and achieve their health goals. It also allows for the analysis of data from the entire community to discover new health trends and recommendations.

[0088] Thus, according to the data processing system 10 of the second embodiment, compared to conventional diet management, it is possible to provide more precise and personalized health management, and by adding community-based feedback and predictive analytics functions, preventive health management that goes beyond the dimension of diet management can be realized.

[0089] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0090] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing method for the specific process may be used, which includes computer 22 and multiple other computers.

[0091] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0092] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0093] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0094] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0095] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0096] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0097] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0098] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0099] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference. [Explanation of Symbols]

[0100] 10 Data Processing Systems 12 Data Processing Devices 14 Necklace-type terminal 38 Microphones 39 Sensors 40 speakers 42 cameras 46A Control Unit 100 Data Acquisition Unit 102 Communications Department 290 Specific Processing Unit 292 Input section 294 Processing Unit 296 Output section< / url:>

Claims

1. The device worn by the user, A data processing system comprising a data processing device that is communicatively connected to the aforementioned terminal, The data processing device comprises a processor, The aforementioned processor, The camera installed in the terminal captures an image of the user's meal, The aforementioned image is analyzed to generate meal data showing the details of the meal, The user's biometric data detected by the sensor installed in the terminal is acquired. The aforementioned dietary data and the aforementioned biological data are integrated and analyzed, Output information corresponding to the results of the analysis described above. Data processing system.

2. The aforementioned processor, The user acquires historical data showing the history of their meal data and biometric data. Based on the aforementioned historical data, the user's future health risks are predicted. Output information corresponding to the results of the aforementioned prediction. The data processing system according to claim 1.

3. The aforementioned processor, If the aforementioned health risk exceeds a predetermined standard, a signal is sent to the terminal to warn the user. The data processing system according to claim 2.

4. The aforementioned processor, Based on the results of the analysis, a message indicating a recommended meal for the user is sent to the terminal. The data processing system according to claim 1.

5. The aforementioned processor, Obtain other user data showing the aforementioned dietary data and biometric data relating to other users, Based on the aforementioned data from other parties, the recommended diet is determined. The data processing system according to claim 4.

6. The aforementioned terminal is a necklace-type terminal. A data processing system according to any one of claims 1 to 5.

7. The device worn by the user, A data processing system comprising a data processing device that is communicatively connected to the aforementioned terminal, The data processing device, The device acquires an image of the user's meal taken by a camera installed in the terminal, The aforementioned image is analyzed to generate meal data showing the details of the meal, To acquire the user's biometric data detected by a sensor installed in the terminal, The aforementioned dietary data and the aforementioned biological data are to be integrated and analyzed, The output of information corresponding to the results of the aforementioned analysis, Data processing method.

Images