Information processing system, information processing method, and computer program

Abstract

[Problem] To provide an information processing method, a computer program, and an information processing device that are capable of highly accurately estimating the weight of an object-to-be-measured in a non-contact manner. [SOLUTION] An information processing system according to the present disclosure comprises one or a plurality of computer processors. The information processing system comprises: a measurement device that includes an imaging device, an infrared sensor unit, and an ultrasonic sensor unit; and an information processing device that is connected to the measurement device. The one or plurality of computer processors are characterized by including: a reception unit that receives data acquired by the measurement device; and a processing unit that calculates the weight of the object-to-be-measured by processing the data received by the reception unit, wherein the processing unit calculates the volume of each portion of the object-to-be-measured on the basis of the data received by the reception unit, and calculates the weight of the object-to-be-measured on the basis of the volume of each portion, information pertaining to the configuration of each portion, and the specific gravity of an element pertaining to the configuration.

Description

Information processing system, information processing method, and computer program

[0001] The present invention relates to an information processing system, an information processing method, and a computer program.

[0002] Conventionally, when a user wants to know his or her own weight, the user generally measures his or her weight by stepping on a scale.

[0003] However, when a weight scale is shared with other users, hygiene management is required.

[0004] Furthermore, stepping on a scale not only places a physical burden on the user, but also causes psychological resistance to such an action.

[0005] Patent Document 1 discloses a technology for estimating the weight of an animal, which is difficult to measure using a weighing scale, in a non-contact manner, but there remains a problem with the accuracy of the measurement.

[0006] JP 2016-059300 A

[0007] An object of the present disclosure is to provide a technical improvement that solves or alleviates at least part of the problems of the conventional techniques described above. A more specific object of the present disclosure is to provide an information processing method, a computer program, and an information processing device that are capable of measuring the weight of an object to be measured in a non-contact manner with high accuracy.

[0008] The information processing system of the present disclosure is an information processing system comprising one or more computer processors, and the information processing system comprises a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device, and the one or more computer processors have a receiving unit that receives data acquired by the measuring device and a processing unit that calculates the weight of the object to be measured by processing the data received by the receiving unit, and is characterized in that the processing unit calculates the volume of each part of the object to be measured based on the data received by the receiving unit, and calculates the weight of the object to be measured based on the volume of each part, information regarding the configuration of each part, and the specific gravity of elements related to the configuration.

[0009] The processing unit can estimate the composition of the measurement object based on the reflection data from the measurement object acquired by the ultrasonic sensor unit and received by the receiving unit.

[0010] The processing unit can generate 3D data of the measurement object based on reflection data and / or radiation data from objects including the measurement object, which is received by the receiving unit and acquired by the infrared sensor unit.

[0011] The processing unit can generate 3D data of the measurement object based on image data including the measurement object that is received by the receiving unit and acquired by the imaging device.

[0012] The processing unit divides a solid body having an external shape corresponding to the object to be measured into multiple parts of a predetermined size based on the 3D data of the object to be measured, calculates the weight of each part based on information about the structure of each part and the specific gravity of the elements related to that structure, and obtains the weight of the object to be measured by adding up the weights of all parts.

[0013] The processing unit can further identify the measurement target by analyzing image data including the measurement target that is received by the receiving unit and acquired by the imaging device.

[0014] The processing unit can further remove background from the image data by analyzing the image data including the measurement target that is acquired by the imaging device and received by the receiving unit.

[0015] The infrared sensor unit can include an infrared camera and an infrared sensor composed of an infrared light projector, an infrared light receiver, and a reflector.

[0016] The ultrasonic sensor unit can include a master unit configured with an ultrasonic light projector and an ultrasonic light receiver, and a slave unit configured with an ultrasonic light receiver and a reflector.

[0017] The ultrasonic sensor unit has a main unit and two sub-units, and can be arranged so that the horizontal angle of the line connecting the main unit and each of the sub-units, and the elevation angle of the line connecting the main unit and each of the sub-units, are within a predetermined value.

[0018] The measuring device can be used to be placed in front of the object to be measured or above the object to be measured.

[0019] The one or more computer processors further have a memory unit that stores user information of the user who is the measurement target, and the processing unit determines whether the image data of the face of the user who is the measurement target and acquired by the imaging device, received by the receiving unit, is included in the user information stored in the memory unit, and if it is determined as a result of the determination that the image data of the user's face is included in the user information, the user can be recognized as the measurement target.

[0020] The memory unit further stores information regarding the user's actual weight, and the processing unit compares the user's weight, which is the calculated weight of the object to be measured, with the user's actual weight stored in the memory unit, and as a result of the comparison, determines whether there is a difference of a predetermined amount or more between the user's weight and the user's actual weight.

[0021] If the result of the determination is that there is a difference of a predetermined amount or more between the user's weight and the user's actual weight, the processing unit can request the measuring device to acquire data again.

[0022] The information processing method disclosed herein is an information processing method in an information processing system having one or more computer processors, and the information processing system includes a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device, and is characterized in that the one or more computer processors are caused to execute the steps of receiving data acquired by the measuring device, calculating the volume of each part of the object to be measured based on the data, and calculating the weight of the object to be measured based on the volume of each part, information related to the configuration of each part, and the specific gravity of elements related to the configuration.

[0023] The computer program of the present disclosure is a computer program executed in an information processing system having one or more computer processors, the information processing system having a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device, and causing the one or more computer processors to realize a receiving function for receiving data acquired by the measuring device and a processing function for calculating the weight of the object to be measured by processing the data received by the receiving function, characterized in that the processing function calculates the volume of each part of the object to be measured based on the data received by the receiving function, and calculates the weight of the object to be measured based on the volume of each part, information regarding the configuration of each part, and the specific gravity of elements related to the configuration.

[0024] According to the present disclosure, it is possible to provide technical improvements that solve or alleviate at least some of the problems of the conventional techniques described above. Specifically, it is possible to provide an information processing method, a computer program, and an information processing device that are capable of measuring the weight of an object to be measured non-contact with high accuracy.

[0025] FIG. 1 is a system configuration diagram showing an example of a system configuration of an information processing system according to the present disclosure. FIG. 1 is a configuration diagram showing an example of a hardware configuration of an information processing device according to the present disclosure. FIG. 1 is a configuration diagram showing an example of a functional configuration of an information processing device according to the present disclosure. FIG. 1 is a conceptual diagram showing an example of an arrangement of an information processing system according to the present disclosure. FIG. 1 is a conceptual diagram for explaining a measurement algorithm for the weight of a measurement object according to the present disclosure. FIG. 1 is a conceptual diagram showing another example of an arrangement of an information processing system according to the present disclosure. FIG. 1 is a conceptual diagram showing another example of an arrangement of an information processing system according to the present disclosure. FIG. 1 is a configuration diagram showing another example of a functional configuration of an information processing device according to the present disclosure. FIG. 1 is a system configuration diagram showing another example of a system configuration of an information processing system according to the present disclosure. FIG. 1 is a flow diagram showing an example of a user registration flow according to the present disclosure. FIG. 1 is a flow diagram showing an example of a measurement flow according to the present disclosure. FIG. 1 is a flow diagram showing an example of an information processing method according to the present disclosure. FIG. 1 is a circuit configuration diagram showing an example of a circuit configuration for realizing the functions of a computer program according to the present disclosure. FIG. 1 is a system configuration diagram showing an example of a system configuration of an information processing system according to another embodiment of the present disclosure. FIG. 1 is a conceptual diagram showing an image of a first information processing device according to the present disclosure. FIG. 1 is a configuration diagram showing an example of a functional configuration of a first information processing device according to the present disclosure. FIG. 1 is a conceptual diagram showing an image of a screen displayed on a display of a first information processing device according to the present disclosure. Fig. 1 is a system configuration diagram showing an example of the system configuration of an information processing system according to another embodiment of the present disclosure. Fig. 2 is a configuration diagram showing an example of the functional configuration of a third information processing device according to the present disclosure. Fig. 3 is a configuration diagram showing another example of the functional configuration of a first information processing device according to the present disclosure. Fig. 4 is a flow diagram showing an example of the flow of an information processing method according to another embodiment of the present disclosure. Fig. 5 is a circuit configuration diagram showing an example of a circuit configuration for realizing the functions of a computer program according to another embodiment of the present disclosure. Fig. 6 is a system configuration diagram showing an example of the system configuration of an information processing system according to another embodiment of the present disclosure.

[0026] An embodiment of an information processing system according to the present disclosure will be described with reference to the drawings.

[0027] FIG. 1 shows an example of a system configuration of an information processing system 1000 according to the present disclosure.

[0028] 1, an information processing system 1000 in the present disclosure includes an information processing device 100 and a measurement device 200. The information processing device 100 and the measurement device 200 can be directly connected to each other via wire or wirelessly.

[0029] 2, the hardware configuration of the information processing device 100 will be described. The information processing device 100 can include a processor 101, a memory 102, a storage 103, an input / output interface (input / output I / F) 104, and a communication interface (communication I / F) 105. The components are connected to each other via a bus B.

[0030] The information processing device 100 can realize the functions and methods described in this embodiment through cooperation between the processor 101, memory 102, storage 103, input / output I / F 104, and communication I / F 105.

[0031] The processor 101 executes functions and / or methods implemented by codes or instructions included in a program stored in the storage 103. The processor 101 may include, for example, a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may implement each process disclosed in each embodiment using a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large-scale integration (LSI)), etc. Furthermore, these circuits may be implemented using one or more integrated circuits, and multiple processes described in each embodiment may be implemented using a single integrated circuit. Furthermore, LSIs may also be referred to as VLSIs, super LSIs, ultra LSIs, etc. depending on the degree of integration.

[0032] The memory 102 temporarily stores programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a random access memory (RAM) and a read-only memory (ROM).

[0033] The storage 103 stores programs and includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.

[0034] The communication I / F 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various data via a network. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication is possible. The communication I / F 105 communicates with other information processing devices via the network. The communication I / F 105 transmits various data to other information processing devices in accordance with instructions from the processor 101. The communication I / F 105 also receives various data transmitted from other information processing devices and transmits it to the processor 101.

[0035] The input / output I / F 104 includes an input device for inputting various operations to the information processing device 100, and an output device for outputting processing results processed by the information processing device 100. The input / output I / F 104 may be an integrated input device and output device, or may be separate input device and output device.

[0036] The input device is realized by any one or combination of all types of devices that can accept input from a user and transmit information related to the input to the processor 101. Examples of the input device include hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (for inputting operations via images), and a microphone (for inputting operations via voice).

[0037] The output device outputs the processing results obtained by the processor 101. The output device includes, for example, a touch panel, a speaker, and the like.

[0038] Returning to FIG. 1, the measuring device 200 includes an imaging device 210 , an infrared sensor unit 220 , and an ultrasonic sensor unit 230 .

[0039] In this disclosure, the one or more computer processors provided in the information processing system 1000 are described as being provided in the information processing device 100, but this is not limited to this, and the processors may be provided in cooperation with other devices connected to the information processing device 100.

[0040] The one or more computer processors in the present disclosure include a receiving unit 110 and a processing unit 120, as shown in FIG.

[0041] The receiving unit 110 receives data acquired by the measuring device 200 .

[0042] The acquisition of data by the measuring device 200 may be triggered by the user's entry into a predetermined measurement area. For example, the user's entry into the predetermined measurement area can be determined by image analysis using the imaging device 210, which is one of the measuring devices 200. In this case, the start of measurement by the infrared sensor unit 220 and the ultrasonic sensor unit 230 may be initiated depending on the results of the image analysis.

[0043] The predetermined measurement area can be, for example, a range that can be photographed by the imaging device 210 .

[0044] Alternatively, the measurement device 200 may acquire data continuously, and the receiver 110 may acquire data when the user enters a predetermined measurement area.

[0045] The processing unit 120 processes the data received by the receiving unit 110 to calculate the weight of the measurement object.

[0046] Although the object to be measured is not particularly limited, the following examples will be described assuming that the object to be measured is a human and that the weight of the object to be measured is the body weight of the human. Note that the body weight here preferably does not include the weight of clothing worn by the human, as will be described later.

[0047] The processing unit 120 calculates the weight of each part of the measurement object based on the data received by the receiving unit 110.

[0048] As an example, the processing unit 120 divides a solid body having an outline corresponding to the object into multiple sections (slice sections) of a predetermined size based on the 3D (three-dimensional) data of the object. The weight of each section is obtained by integrating the cross-sectional area of ​​each section. Note that the predetermined size may be irregular.

[0049] Then, the processing unit 120 calculates the weight of the measurement object based on the volume of each part, information about the configuration of each part, and the specific gravity of the elements related to the configuration.

[0050] The information about the composition of each body part is, for example, information about the proportion of elements that make up each body part. Elements are what is known as the body's chemical composition. The human body is said to be mainly composed of skeletal muscle, adipose tissue, bone, and blood, while organs are mainly composed of water, fat, and protein.

[0051] The information regarding the configuration of the above-mentioned parts may be obtained by using reference data regarding the proportions of elements prepared in advance, or may be obtained by analyzing data obtained from the measurement device 200.

[0052] The weights of the elements related to the configuration are determined using previously prepared reference data on the weights of the elements.

[0053] The weight of the measurement target calculated by the processing unit 120 may be displayed on a display provided in or connected to the information processing system 1000. The display here is preferably a user terminal 400 (such as a mobile phone or a smartphone) carried by the user.

[0054] The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, it becomes possible to estimate the weight of an object to be measured in a non-contact manner with high accuracy.

[0055] In particular, the COVID-19 pandemic has made people more cautious about contact.

[0056] However, conventional measuring devices such as weighing scales use springs or pressure sensors, and users must stand directly on the measuring device to be measured, so there was a need for a technology that could measure weight in a ``non-contact'' manner.

[0057] According to the invention of the present disclosure, various data of the measurement object are measured in a non-contact manner, thereby eliminating the need for hygienic management.

[0058] Furthermore, according to the invention of the present disclosure, the physical burden on the user can be reduced because there is no need for the user to step on the measuring device.

[0059] In addition, by eliminating the need to step on the measuring device, measurements can be taken unobtrusively without interfering with daily life.

[0060] According to the invention of the present disclosure, by adopting a novel configuration in which weight is calculated using data acquired by an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, it is possible to estimate the weight of the object to be measured with higher accuracy than conventional methods.

[0061] Furthermore, the processing unit 120 can estimate the composition of the measurement target based on the transmission and / or reflection data from the measurement target acquired by the ultrasonic sensor unit 230 and received by the receiving unit 110 .

[0062] The composition estimated by such a method may be used as information regarding the configuration of the above-mentioned portion. The composition of the object to be measured by the ultrasonic sensor unit 230 can be estimated using known estimation techniques.

[0063] According to this configuration, it is possible to calculate the weight of the measurement object with higher accuracy than when the reference data is used.

[0064] In addition, the processing unit 120 can generate 3D data of the measurement object based on reflection data and / or radiation data from objects including the measurement object acquired by the infrared sensor unit 220 and received by the receiving unit 110.

[0065] Here, the infrared sensor unit 220 may include an infrared camera 221 and an infrared sensor 222 as shown in FIG.

[0066] The infrared camera 211 is an infrared thermography camera and can detect heat radiated from the measurement object U. The processing unit 120 uses this heat as radiation data.

[0067] The infrared sensor 222 is composed of an infrared light projecting unit 223, an infrared light receiving unit 224, and a reflecting unit 225. That is, the infrared sensor 222 projects infrared light from the infrared light projecting unit 223 toward the measurement object U, the light passes through the measurement object U, and the transmitted light reflected by the reflecting unit 225 is received by the infrared light receiving unit 224. The processing unit 120 uses this transmitted light as reflection data.

[0068] Note that the measurement object U here refers to a human being without clothes (a naked human being), and the target refers to a human being with clothes on. In other words, with this configuration, even if a human is wearing clothes, 3D data of only the body excluding the clothes can be generated.

[0069] As described above, the processing unit 120 divides a solid body having an external shape corresponding to the object to be measured into multiple parts of a predetermined size based on the 3D data of the object to be measured, calculates the weight of each part based on information about the structure of each part and the specific gravity of the elements related to that structure, and obtains the body weight of the object to be measured by summing the weights of all parts.

[0070] As an example, as described above, the processing unit 120 divides a solid body having an outer shape corresponding to the object to be measured into a plurality of regions of a predetermined size based on the 3D data of the object to be measured, and calculates the area of ​​the cross section of each divided region as shown in Fig. 5, and obtains the volume of each region by integrating these areas for each region.

[0071] Alternatively, the processing unit 120 can generate 3D data of the measurement object based on image data including the measurement object that is received by the receiving unit 110 and acquired by the imaging device 210 .

[0072] That is, the processing unit 120 can generate 3D data from 2D image data. Note that this configuration may be realized by automatic generation using AI, which is an external service that can be linked with the information processing system of the present invention.

[0073] Furthermore, the processing unit 120 can further identify the measurement target by analyzing image data including the measurement target that is received by the receiving unit 110 and acquired by the imaging device 210 .

[0074] The imaging device 210 may be, for example, a visible light camera.

[0075] Identification of the measurement target U is, for example, identification of attribute information such as the gender and age of the user who is the measurement target U. Such attribute information is obtained by analyzing image data of the user's face and / or body captured by the imaging device 210.

[0076] Alternatively, the measurement target is identified as a registered user. Such identification can be performed by determining whether the measurement target is a registered user based on image data of the user's face captured by the imaging device 210. If the measurement target is a registered user, the attribute information is registered in advance by input from the user.

[0077] The processing unit 120 can further remove background from the image data by analyzing the image data including the measurement target acquired by the imaging device 210 and received by the receiving unit 110 .

[0078] A known technique can be used to separate people from the background in image data.

[0079] As shown in FIG. 6 , the ultrasonic sensor unit 230 can include a main unit 231 and two slave units 232 .

[0080] The main unit 231 is composed of an ultrasonic light projecting unit 233 and an ultrasonic light receiving unit 234 .

[0081] The slave unit 232 is composed of an ultrasonic receiving unit 235 and a reflecting unit 236 .

[0082] The main unit 231 and the two sub-units 232 can be positioned so that the horizontal angle of the straight line connecting the main unit 231 and each of the sub-units 232, and the elevation angle of the straight line connecting the main unit 231 and each of the sub-units 232 are within a predetermined value.

[0083] As an example, the predetermined value is preferably 80°.

[0084] The measuring device 200 can also be used to be placed in front of the object U (FIG. 6) or above the object U (FIG. 7).

[0085] Although FIGS. 6 and 7 only show the infrared camera 221 and the main unit 231 of the ultrasonic sensor unit 230 as examples of the measuring device 200, the measuring device 200 may include the other components described above.

[0086] One or more computer processors in the present disclosure may further include a memory unit 130 as shown in FIG.

[0087] The storage unit 130 stores user information of users.

[0088] At this time, the processing unit 120 determines whether the image data of the face of the user being measured, acquired by the imaging device 210 and received by the receiving unit 110, is included in the user information stored in the memory unit 130.

[0089] If it is determined that image data of the user's face is included in the user information, the processing unit 120 recognizes the user as a measurement target U.

[0090] The measurement device 200 may be configured to perform measurements only on users who are certified as measurement subjects U.

[0091] Furthermore, for a user who is not recognized as a measurement target U, the measuring device 200 (here, the infrared sensor unit 220 and the ultrasonic sensor unit 230) can perform measurement with the permission of the user. As an example, a confirmation screen asking whether or not to perform measurement can be displayed on a display connected to the information processing system 1000 in the present disclosure. Note that the display referred to here may be provided in the information processing system 1000.

[0092] The confirmation screen may be displayed on the display of a user terminal 400 (such as a mobile phone or smartphone; details will be described later) owned by the user. At this time, information may be transmitted from the information processing device 100 to the user terminal 400 by push notification or the like.

[0093] According to this configuration, it is possible to appropriately respond when an unregistered user enters the measurement area.

[0094] The storage unit 130 may further store information relating to the actual weight of the user.

[0095] At this time, the processing unit 120 compares the calculated weight of the user as the weight of the measurement object U with the actual weight of the user stored in the storage unit 130 .

[0096] As a result of the comparison, it is determined whether there is a difference of a predetermined amount or more between the user's weight and the user's actual weight.

[0097] If the result of the determination is that there is a difference of a predetermined amount or more between the user's weight and the user's actual weight, the processing unit 120 requests the measuring device 200 to acquire data again.

[0098] Alternatively, the processing unit 120 corrects the user's weight based on the actual weight.

[0099] 10 , the information processing device 100 may be connected to a server device 300 via the Internet. In this case, the storage unit 130 may be included in the server device 300. The calculated weight of the user may also be stored in association with the user information stored in the storage unit 130.

[0100] The information processing device 100 may also be connected to a user terminal 400. The connection may be via the Internet, or by Bluetooth (registered trademark), a wireless LAN, or the like.

[0101] The information processing device 100 can transmit the calculated weight data to the user terminal 400, and the data can be stored in the user terminal 400.

[0102] Here, the flow of user registration in the information processing system according to the present disclosure will be described with reference to FIG.

[0103] First, the processing unit 120 acquires an image of a user who wishes to be registered (S11). The image of the user can be acquired by both a visible light camera and an infrared camera and then registered.

[0104] Next, the processing unit 120 registers an image of the identified user's face (S12). The registered image of the user's face can be automatically displayed on the display during or after measurement.

[0105] The processing unit 120 then acquires and registers information relating to the user's name, sex, age, weight, blood type, and height (S13). The weight registered here is managed as actual weight, which will be described later.

[0106] Finally, the processing unit 120 completes the user registration after the user confirms the registration details (S14).

[0107] Next, the flow of weight measurement in the information processing system of the present disclosure will be described with reference to FIG.

[0108] First, the processing unit 120 acquires an image of the user (S15). Based on the image, it is determined whether the user is a registered user. Furthermore, the image is used in a state where the user's body part is separated from the background part and the background is removed.

[0109] Next, the processing unit 120 acquires data from the ultrasonic sensor unit 230 and the infrared sensor unit 220 (S16, S17). Note that the order of these acquisitions is not particularly limited.

[0110] The processing unit 120 then performs image analysis and processing of the data (S18), where the image captured by the visible light camera and the image projected by the infrared camera are analyzed and noise removal processing can be performed.

[0111] Next, the processing unit 120 displays the data in a distribution diagram (S19).

[0112] Then, the processing unit 120 calculates the volume (S21).

[0113] If necessary, the processing unit 120 corrects the error in the weight (S22).

[0114] Finally, the information about the calculated weight is displayed on a display connected to the information processing device 100 (S23).

[0115] Furthermore, information about the calculated weight may be stored in the server device 300 (S24).

[0116] Next, an embodiment of an information processing method according to the present disclosure will be described with reference to the drawings.

[0117] The information processing method in the present disclosure is an information processing method in an information processing system 1000 including one or more computer processors.

[0118] The information processing system 1000 includes a measuring device 200 including an imaging device 210, an infrared sensor unit 220, and an ultrasonic sensor unit 230, and an information processing device 100 connected to the measuring device 200. Details of these devices are as described above.

[0119] The information processing method of the present disclosure then causes one or more computer processors to execute steps S110 to S130 shown in FIG.

[0120] In step S110, the data acquired by the measurement device 200 is received. Step S110 can be executed by the above-described receiving unit 110. Details of the receiving unit 110 are as described above.

[0121] In step S120, the volume of each part of the measurement target is calculated based on the received data. Step S120 can be executed by the above-mentioned processing unit 120. Details of the processing unit 120 are as described above.

[0122] In step S130, the weight of the measurement object is calculated based on the volume of each part, information about the configuration of each part, and the specific gravity of the elements related to the configuration. Step S130 can be executed by the above-mentioned processing unit 120. Details of the processing unit 120 are as described above.

[0123] The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, it becomes possible to estimate the weight of a subject in a non-contact manner with high accuracy.

[0124] In the information processing system disclosed herein, the accuracy of measurements can be improved compared to conventional methods by analyzing and applying data obtained by ultrasonic waves emitted from an ultrasonic sensor and reflected back from a reflector, data obtained by measuring the body in three dimensions using an infrared sensor, and data on gender and age obtained using a visible light camera.

[0125] The main sensor and the reflector are installed in three, two, or one locations, and the sensors perform a 3D scan of the human body to calculate the area.

[0126] It is possible to measure only the body through clothing, calculate a distribution map, and make an estimate.

[0127] Scanning method: 1) Measure distance with ultrasound. 2) Scan in 3D with an infrared sensor. 3) Measure only the body through clothing, calculate volume in 3D, and create a volume distribution map of the body's uneven surface in units of a few centimeters to calculate volume with greater precision.

[0128] ・Weight measurement calculation method The body is made up of skeletal muscle, adipose tissue, bone, blood, and other organs, which are made up of water, fat, and protein, so the volume is calculated and the specific gravity of each component is calculated using the following.

[0129] Since the body is made up of water, bone, muscle, fat, protein, etc., the volume is calculated and the specific gravity of each component is calculated using the following formula. The standard range for blood specific gravity for Japanese people is 1.052-1.060 for men and 1.049-1.056 for women. Calculations can be made using bone = approximately 2.0, muscle = 1.06, brain = 1.04, and fat = 0.94.

[0130] Body composition can be measured by the difference in transmittance between the ultrasonic sensor and the infrared sensor as they pass through the human body. It can also quantify bone, muscle mass, and fat mass.

[0131] Technical points 1. Basic information input section (age, gender, weight, blood type, height) 2. Algorithm to estimate gender and age using a visible light camera 3. Algorithm to estimate height 4. Algorithm to estimate body structure using an ultrasonic sensor 5. Algorithm to estimate area using a 3D scan 6. Algorithm to calculate weight from area 7. Algorithm to correct errors 8. Method to display weight 9. Wi-Fi (registered trademark) and Bluetooth (registered trademark) communication method 10. Method to provide service using a dedicated app

[0132] Measurement algorithm 1. Outline detection Divide the 3D measured body into irregular sizes, create a horizontal and vertical image distribution map as shown in Figure 5, and perform calculations by integrating the curved surface. 2. Estimation of each body part Separate water, bone, muscle, and fat to estimate body weight. 3. Noise removal 4. Weight estimation

[0133] ・3D scanning for measurement 1. Measures only the body, through clothing 2. Separates body parts from background. Body volume is displayed as a distribution map with irregular sizes, and the 3D measured body is displayed as a point distribution map with irregular sizes. More precise curves can be calculated 3. Recognizes gender 4. Performs personal identification and can be acquired automatically

[0134] Next, an embodiment of a computer program according to the present disclosure will be described with reference to the drawings.

[0135] The computer program in the present disclosure is a computer program executed in an information processing system 1000 having one or more computer processors.

[0136] The information processing system 1000 includes a measuring device 200 including an imaging device 210, an infrared sensor unit 220, and an ultrasonic sensor unit 230, and an information processing device 100 connected to the measuring device 200. Details of these devices are as described above.

[0137] The one or more computer processors are then caused to implement receiving and processing functions.

[0138] The receiving function receives data acquired by the measurement device.

[0139] The processing function processes the received data to calculate the weight of the object to be measured.

[0140] Specifically, the processing function calculates the volume of each part of the object to be measured based on the data received by the receiving function, and calculates the weight of the object to be measured based on the volume of each part, information regarding the composition of each part, and the specific gravity of the elements related to that composition.

[0141] The above-mentioned receiving function and processing function can be realized by a receiving circuit 111 and a processing circuit 121 shown in Fig. 14. The receiving circuit 111 and the processing circuit 121 are realized by the above-mentioned receiving unit 110 and processing unit 120, respectively. Details of each unit are as described above.

[0142] The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, it becomes possible to estimate the weight of a subject in a non-contact manner with high accuracy.

[0143] Another embodiment of the information processing system according to the present disclosure will be described below. In this embodiment, one or more processors included in the information processing device 100 may be included in a first information processing device 1100 described below.

[0144] The invention according to the embodiments described below relates to an information processing system and an information processing device that include an analysis unit as an AI platform.

[0145] Biological information such as blood pressure and body temperature is important for detecting abnormalities in health. Conventionally, the main method for obtaining such biological information has been to attach a measuring device to the body and obtain values ​​directly.

[0146] In recent years, with the spread of non-contact measuring devices and wearable devices, it has become possible to obtain biometric information more easily than ever before.

[0147] In the above-mentioned conventional technology, the biological information acquired by the measuring device is processed in an information processing device connected via the Internet.

[0148] However, the above configuration has the problem that it cannot be used with devices that cannot connect to the Internet or in places that cannot connect to the Internet. Also, due to security issues, there is a risk that measurement data of biological information, which is personal information, and the analysis results thereof may be leaked.

[0149] Therefore, the purpose of the disclosure in this embodiment is to provide a technical improvement that solves or alleviates at least part of the problems of the conventional technology described above. One of the more specific purposes of the present disclosure is to provide an information processing system, an information processing method, a computer program, and an information processing device that are capable of analyzing a user's health condition even in an environment without an Internet connection.

[0150] The information processing system of the invention in this embodiment is characterized by comprising a first information processing device having: a memory unit that stores a user's genomic information; a biometric information acquisition unit that acquires the user's biometric information; an image acquisition unit that acquires at least an image of the user's face; an environmental information acquisition unit that acquires environmental information; a display unit that displays at least a portion of the biometric information acquired by the biometric information acquisition unit and at least a portion of the environmental information acquired by the environmental information acquisition unit; a first analysis unit that analyzes the user's health condition based on the biometric information acquired by the biometric information acquisition unit and the genomic information stored in the memory unit; a judgment unit that judges whether there is an abnormality in the health condition analyzed by the first analysis unit as an AI base; and an output unit that outputs the result of the judgment by the judgment unit.

[0151] The information processing system further includes a biometric information acquisition device connected to the first information processing device, and the biometric information acquisition unit can acquire biometric information of the user acquired by the biometric information acquisition device.

[0152] The first information processing device is connected to a plurality of biometric information acquisition devices, each of which is installed in a room used by a different user in a residential facility or a shared facility, and the biometric information acquisition unit can acquire the user's biometric information acquired by the biometric information acquisition device along with the user's identification number.

[0153] The biometric information acquisition device can be installed by being embedded in the walls and / or ceilings of residential or public facilities.

[0154] The biometric information acquisition section and / or the biometric information acquisition device can acquire biometric information at a predetermined time or at predetermined time intervals.

[0155] The biometric information acquisition unit and / or the biometric information acquisition device may acquire the user's respiration, heart rate, and blood pressure in a non-contact manner.

[0156] The biometric information acquisition section and / or the biometric information acquisition device may acquire the user's brain waves in a contact or non-contact manner.

[0157] The biometric information acquisition unit and / or the biometric information acquisition device may acquire the body surface temperature of the user in a non-contact manner.

[0158] The biometric information acquisition unit and / or the biometric information acquisition device may acquire the blood glucose level of the user in a contact or non-contact manner.

[0159] The biometric information acquisition unit and / or the biometric information acquisition device may be capable of acquiring information through short-range communication with a vital measurement sensor embedded in a part of the user's body.

[0160] The environmental information acquisition unit may acquire at least one of temperature, humidity, atmospheric pressure, and oxygen concentration.

[0161] The first analysis unit can further acquire facial color information and / or facial expression information by analyzing the image of the user's face acquired by the image information acquisition unit, and analyze the user's health condition based on the facial color information and / or facial expression information, the biometric information acquired by the biometric information acquisition unit, and the genomic information stored in the memory unit.

[0162] The first information processing device may further include a user identification unit that identifies a user based on the image of the user's face acquired by the image acquisition unit.

[0163] The first information processing device may further include a communication unit that is capable of communicating with the outside only under specific conditions.

[0164] The above information processing system further includes a second information processing device that can be connected to the first information processing device via short-range wireless communication, and a third information processing device that can be connected to the second information processing device via an Internet line, and the third information processing device can have a second analysis unit that analyzes the results of the judgment obtained via the second information processing device and determines the corresponding action, and an execution unit that executes the action determined by the second analysis unit.

[0165] The information processing system may further include a fourth information processing device that can be connected to the third information processing device via an Internet line, and the action may be to notify the fourth information processing device of the results output by the output unit.

[0166] The information processing system may further include a fifth information processing device that can be connected to the third information processing device via an Internet line, and the action may be sending an operation command to the fifth information processing device.

[0167] The third information processing device may acquire health checkup data to which access has been permitted in advance, and the action may be to send lifestyle improvement information based on the health checkup data to the second information processing device.

[0168] The information processing system further includes a second information processing device that can be connected to the first information processing device via short-range wireless communication, and a sixth information processing device that can be connected to the second information processing device via short-range wireless communication, the sixth information processing device being installed on a predetermined means of transportation, the sixth information processing device acquiring biometric information of the user during movement and transmitting the acquired biometric information during movement to the second information processing device, the second information processing device transmitting the biometric information during movement to the first information processing device when it is within a distance where short-range wireless communication is possible with the first information processing device, and the first information processing device being able to pass the acquired biometric information during movement to a first analysis unit.

[0169] The information processing system further includes a second information processing device that can be connected to the first information processing device via short-range wireless communication, and a seventh information processing device that can be connected to the second information processing device via short-range wireless communication, the seventh information processing device having a predetermined transportation means, the seventh information processing device acquires biometric information of the user and transmits the acquired biometric information during movement to the second information processing device, the second information processing device transmits the biometric information during movement to the first information processing device when it is within a distance where short-range wireless communication is possible with the first information processing device, and the first information processing device can pass the acquired biometric information to a first analysis unit.

[0170] The first information processing device can use a rechargeable battery, a single-use battery, or a new energy source as power.

[0171] The information processing method in this embodiment is characterized in that it has one or more computer processors execute the following steps: a biometric information acquisition step for acquiring biometric information of a user; an image acquisition step for acquiring an image of at least the user's face; an environmental information acquisition step for acquiring environmental information; a display step for displaying at least a portion of the biometric information acquired in the biometric information acquisition step and at least a portion of the environmental information acquired in the environmental information acquisition step; a first analysis step for analyzing the user's health condition based on the biometric information acquired in the biometric information acquisition step and the user's genomic information stored in a specified memory unit; a determination step for determining whether there is any abnormality in the health condition analyzed in the first analysis step; and an output step for outputting the result of the determination in the determination step.

[0172] The computer program in this embodiment is characterized by causing one or more computer processors to realize the following: a biometric information acquisition function for acquiring a user's biometric information; an image acquisition function for acquiring at least an image of the user's face; an environmental information acquisition function for acquiring environmental information; a display function for displaying at least a portion of the biometric information acquired by the biometric information acquisition function and at least a portion of the environmental information acquired by the environmental information acquisition function; a first analysis function for analyzing the user's health condition based on the biometric information acquired by the biometric information acquisition function and the user's genomic information stored in a specified memory unit; a judgment function for determining whether there is an abnormality in the health condition analyzed by the first analysis function; and an output function for outputting the result of the judgment by the judgment function.

[0173] The information processing device in this embodiment is characterized by comprising: a memory unit that stores the user's genomic information; a biometric information acquisition unit that acquires the user's biometric information; an image acquisition unit that acquires at least an image of the user's face; an environmental information acquisition unit that acquires environmental information; a display unit that displays at least a portion of the biometric information acquired by the biometric information acquisition unit and at least a portion of the environmental information acquired by the environmental information acquisition unit; a first analysis unit as an AI platform that analyzes the user's health condition based on the biometric information acquired by the biometric information acquisition unit and the genomic information stored in the memory unit; a judgment unit that judges whether there is an abnormality in the health condition analyzed by the first analysis unit; and an output unit that outputs the result of the judgment by the judgment unit.

[0174] According to the present embodiment, it is possible to provide a technical improvement that solves or alleviates at least part of the problems of the conventional technology described above. Specifically, it is possible to provide an information processing system, an information processing method, a computer program, and an information processing device that can analyze a user's health condition based on the acquired user's biometric information and output the analysis results even without being connected to the Internet.

[0175] An information processing system according to the present embodiment will be described with reference to the drawings.

[0176] FIG. 15 shows an example of the system configuration of an information processing system 2000 according to this embodiment.

[0177] As shown in FIG. 15, the information processing system 2000 in this embodiment includes a first information processing device 2100 .

[0178] The information processing system 2000 may include a biometric information acquisition device 10 connectable to the first information processing device 2100, or the first information processing device 2100 may include the functions of the biometric information acquisition device 10. Details of the biometric information acquisition device 10 will be described later.

[0179] The hardware configuration of the first information processing apparatus 2100 can be the same as that of the information processing apparatus 100 described above.

[0180] In addition, the second information processing device 2200, third information processing device 2300, fourth information processing device 2400, fifth information processing device 2500, sixth information processing device and seventh information processing device described below can also have the same hardware configuration as the first information processing device 2100.

[0181] FIG. 16 shows an image of the external appearance of the first information processing apparatus 2100. As shown in FIG.

[0182] 16 , the first information processing device 2100 is configured with a housing 106 and a display 107 provided on the front of the housing 106. A camera 108 and a speaker 109 may also be provided on the front of the housing 106. Furthermore, the first information processing device 2100 may include various sensors, a rechargeable battery, a power cable connection portion, a SIM card insertion portion, an SD card memory insertion portion, a USB insertion portion, etc. (not shown).

[0183] The first information processing device 2100 has a memory unit 2110, a biometric information acquisition unit 2120, an image acquisition unit 2130, an environmental information acquisition unit 2140, a display unit 2150, a first analysis unit 2160, a judgment unit 2170, and an output unit 2180, as shown as an example in Figure 17.

[0184] The storage unit 2110 stores the user's genome information.

[0185] The storage unit 2110 may be the storage 103 included in the first information processing apparatus 2100 , or may be a recording medium (such as a USB memory or an SD card) that can be removed from the first information processing apparatus 2100 .

[0186] As an example, the genome information includes data indicating the user's genetic predisposition to illness or physical constitution, obtained by analyzing saliva or blood collected from the user.

[0187] The memory unit 2110 may also include basic information such as the user's address, name, and age, medical history information including a history of illnesses the user has had in the past, performance information including the user's daily respiratory rate and heart rate, abnormality history information regarding abnormalities in the user's health condition, and contact information including a list of watchers to notify the user of the user's status.

[0188] In the initial state, the actual data is registered as daily respiratory rate and heart rate values ​​included in the user's application in advance, but after the first information processing device 2100 begins to be used, the measured normal data is saved in chronological order so that changes over time can be extracted.

[0189] The biometric information acquisition unit 2120 acquires the biometric information of the user.

[0190] The user's biological information may be, for example, at least one of the user's blood pressure, pulse rate, respiration, consciousness, body temperature, blood oxygen concentration, etc. Of these, the three pieces of information, blood pressure, pulse rate, and respiration, are important parameters for analyzing the user's health condition.

[0191] The biometric information acquisition unit 2120 can acquire the biometric information from the user in a non-contact manner.

[0192] For example, the biometric information acquisition unit 2120 includes a transmitter that emits microwaves and a receiver that receives microwaves reflected by the user. The biometric information acquisition unit 2120 can detect the user's movements based on a phase difference that occurs due to the Doppler effect between the emitted microwaves and the received microwaves.

[0193] This technology can detect even involuntary biological activities such as breathing and heartbeat from the slight movements that occur on the body surface due to breathing and heartbeat. It can also estimate blood pressure fluctuations.

[0194] The biological information acquisition unit 2120 may further include a processing unit that detects changes over time in the phase difference associated with the transmission and reception of microwaves and extracts frequency components from the changes over time to determine the respiratory rate and heart rate.

[0195] The microwave is emitted from the transmitter at an emission angle of approximately 180°, and biometric information can be detected within a distance range of approximately 10 m from the transmitter.

[0196] The image acquisition unit 2130 acquires an image of at least the face of the user.

[0197] The image acquisition unit 2130 acquires an image of the location where the first information processing device 2100 is installed. The image acquisition unit 2130 acquires the image using the camera 108 described above. The image may be a still image or a video. The image acquisition unit 2130 may be the receiving unit 110 described above.

[0198] To avoid privacy issues, the image acquisition unit 2130 is locked in the control program so that it does not operate under normal circumstances, and can also be controlled so that the lock is released and image acquisition becomes possible when an abnormality of a predetermined level or higher is detected.

[0199] Also, the camera 108 may be configured to be activated when the user speaks loudly.

[0200] The environmental information acquisition unit 2140 acquires environmental information.

[0201] The environmental information acquisition unit 2140 acquires environmental information about the space in which the first information processing apparatus 2100 is installed. Here, environmental information refers to information about the living space, such as room temperature and humidity.

[0202] In one embodiment, the environmental information acquisition unit 2140 includes a temperature sensor and a humidity sensor. In other embodiments, a smoke sensor or a sensor for detecting gas leaks may be included. The temperature sensor may be a thermistor, a resistance temperature detector, or any other type. The humidity sensor may be a polymer resistor, a polymer capacitor, or any other type, but an electrical sensor that can output an electrical signal is used.

[0203] Temperature sensors and humidity sensors can continuously measure room temperature and humidity, but since this environmental information generally does not change suddenly in a short period of time, it may also be possible to configure the device to acquire environmental information intermittently at specified time intervals.

[0204] The watch may also be equipped with a radio wave receiving sensor that receives standard radio waves carrying time and calendar information, and an air pressure sensor, which can provide environmental information such as the time and weather.

[0205] The display unit 2150 displays at least a part of the biometric information acquired by the biometric information acquisition unit 2120 and at least a part of the environmental information acquired by the environmental information acquisition unit 2140. The display unit 2150 may be the display described above.

[0206] FIG. 18 shows an example of a display screen 151 displayed on the display 107 by the display unit 2150, and the screen is provided with a bioinformation display field 152 and an environmental information display field 153.

[0207] As shown in FIG. 18, the biological information display field 152 displays numerical values ​​and graphs of respiration, heart rate, and blood pressure, but is not limited to these.

[0208] The environmental information display field 153 displays the time and weather as shown in FIG. 18, but is not limited to these.

[0209] The first analysis unit 2160 analyzes the health condition of the user based on the biometric information acquired by the biometric information acquisition unit 2120 and the genome information stored in the storage unit 2110. That is, the first analysis unit 2160 is an AI-based system in which AI analyzes the health condition of the user.

[0210] The first analysis unit 2160 has learning data on factors that are highly associated with the onset of specific diseases, and analyzes whether the user's biometric information shows any pre-onset tendencies of diseases that the user is genetically likely to develop.

[0211] The determining unit 2170 determines whether or not there is an abnormality in the health condition analyzed by the first analyzing unit 2160 .

[0212] Specifically, the determination unit 2170 first determines whether or not there is a first abnormality in the health condition. The first abnormality refers to a case where the value of the biological information exceeds a predetermined threshold, regardless of the genomic information. Specifically, the first abnormality refers to a level where the value of the biological information requires immediate medical examination.

[0213] Next, the determination unit 2170 determines whether or not there is a second abnormality in the health condition. The second abnormality refers to a case where the value of the biometric information is below a predetermined threshold, but the genomic information indicates a pre-onset tendency of a disease that the user is likely to develop due to their genetic background. Specifically, the second abnormality refers to a case where the value of the biometric information is not at a level that requires an immediate medical examination, but the genomic information indicates a pre-onset tendency of a disease that the user is likely to develop due to their genetic background.

[0214] The criteria used for these determinations are assumed to be stored in advance in the storage unit 2110 .

[0215] If no abnormality is detected, the acquired biological information is determined to be the normal data and stored in the storage unit 2110. Since the capacity of the storage unit 2110 is limited, the normal data may be stored by converting spot data at regular time intervals into numerical values ​​so that the passage of time can be determined, or may be stored as averaged numerical data of section data at regular time intervals. Furthermore, data that has passed a certain time may be overwritten by the latest data, and a configuration may be adopted in which only the most recent data for a certain period of time is always stored, thereby suppressing an increase in storage capacity.

[0216] The determination unit 2170 may rank the result of the above determination according to the abnormality state. For example, in one embodiment, the result is ranked into three levels: a normal level, a level that does not require emergency but requires confirmation (second abnormality), and an emergency level that requires immediate action (first abnormality).

[0217] The output unit 2180 outputs the result of the determination made by the determination unit 2170 .

[0218] Specifically, if the judgment unit 2170 judges that there is a first abnormality in the health condition, the output unit 2180 can output a predetermined warning sound and / or warning display from the first information processing device 2100.

[0219] The predetermined warning sound is output from the speaker 109 of the first information processing apparatus 2100, and the predetermined warning display is displayed on the display 107 of the first information processing apparatus 2100.

[0220] Furthermore, when it is determined that there is a first abnormality in the health condition as a result of the determination by the determination unit 2170, the output unit 2180 may be configured to output an alarm sound and / or an alarm display from the first information processing device 2100 to another device, and further to enable an emergency call. Details will be described later.

[0221] The other devices may be information processing devices owned by the user's family, information processing devices owned by caregivers, information processing devices owned by hospitals, fire departments, police, security companies, etc. Details will be described later.

[0222] In addition, if the judgment unit 2170 judges that there is a second abnormality in the health condition, the output unit 2180 can output a predetermined notification sound or notification display from the first information processing device 2100.

[0223] The predetermined notification sound is output from the speaker 109 of the first information processing device 2100, and the predetermined notification display is displayed on the display 107 of the first information processing device 2100.

[0224] Furthermore, the output unit 2180 may display an icon corresponding to the rank determined by the determining unit 2170 on the display 107. It is preferable that the shape and color of the icon be changed so that the level of urgency can be determined at a glance. For example, by displaying a green icon for a normal level, a yellow icon for a level that does not require urgent attention but requires confirmation, and a red icon for an urgent level that requires immediate action, the user can intuitively understand the situation.

[0225] The ranking by the determining unit 2170 may be performed for each of the biological information and the environmental information, and each may be displayed as an icon on the display 107. This allows the user to easily determine what kind of abnormality has occurred.

[0226] The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. Specifically, since the first information processing device 2100 itself holds the user's genomic information and has the function of analyzing the information using AI, it is possible to analyze the user's health condition and output the analysis results even in an environment not connected to the Internet (even if it operates as a standalone device without going through a network).

[0227] Next, another embodiment of the information processing system 2000 according to the present disclosure will be described.

[0228] As shown in FIG. 19, the information processing system 2000 in the present disclosure may further include a second information processing device 2200 and a third information processing device 2300.

[0229] The second information processing apparatus 2200 is connectable to the first information processing apparatus 2100 via short-range wireless communication.

[0230] The second information processing device 2200 may be, for example, a device such as a smartphone or a tablet PC that is capable of communicating with the outside world using various communication standards. The hardware configuration of the second information processing device 2200 is as described above.

[0231] The first information processing apparatus 2100 and the second information processing apparatus 2200 can be connected using short-range wireless communication such as BLE (registered trademark).

[0232] The third information processing apparatus 2300 can be connected to the second information processing apparatus 2200 via an Internet line.

[0233] The third information processing apparatus 2300 may be, for example, a server or other device capable of communicating with the outside. The hardware configuration of the third information processing apparatus 2300 is as described above.

[0234] The second information processing apparatus 2200 and the third information processing apparatus 2300 can be connected via an Internet line.

[0235] The third information processing apparatus 2300 includes a second analysis unit 2310 and an execution unit 2320 as shown in FIG.

[0236] The second analysis unit 2310 analyzes the result of the determination obtained from the first information processing apparatus 2100 via the second information processing apparatus 2200, and determines the corresponding action to be taken.

[0237] The analysis results of the second analysis unit 2310 as the action to be taken may differ depending on whether the judgment result includes information indicating that there is a first abnormality in the health condition, information indicating that there is a second abnormality in the health condition, or information indicating that there are no abnormalities.

[0238] The execution unit 2320 executes an action based on the analysis result by the second analysis unit 2310 .

[0239] According to the above configuration, the first analysis unit 2160 analyzes information in the close space for in-house use, while the second analysis unit 2310 can execute the actions necessary to maintain or improve the user's health condition by working with other devices connected via the Internet.

[0240] Next, a specific example of an action will be described.

[0241] As shown in FIG. 19, the information processing system 2000 in the present disclosure may further include a fourth information processing device 2400.

[0242] The fourth information processing device 2400 is a device that can be connected to the third information processing device 2300 via an Internet line.

[0243] The fourth information processing device 2400 is an information processing device owned by the user's family, an information processing device owned by the user's caregiver, an information processing device owned by the user's regular hospital, a nearby fire department, police, security company, etc.

[0244] In this case, the action is to notify the fourth information processing apparatus 2400 of the result output by the output unit 2180 .

[0245] Specifically, if the health condition includes information indicating a first abnormality, the second analysis unit 2310 determines an action to be taken by the fourth information processing device 2400, such as outputting an alarm sound and / or an alarm display.

[0246] Moreover, as shown in FIG. 19, the information processing system 1000 in the present disclosure can further include a fifth information processing device 2500.

[0247] The fifth information processing apparatus 2500 can be connected to the third information processing apparatus 2300 via an Internet line.

[0248] Specifically, the fifth information processing device 2500 may be an IoT device around the user, such as an air conditioner, automatic windows, an electronic lock, a humidifier, a dehumidifier, an electric lamp, an aroma diffuser, a speaker, or a refrigerator that can be connected to the Internet.

[0249] At this time, the action is the transmission of an operation command to the fifth information processing apparatus 2500 .

[0250] An example of an operation command is turning an air conditioner on / off or adjusting the temperature.

[0251] Furthermore, the third information processing device 2300 may further control the fifth information processing device 2500 in accordance with biometric information, environmental information and / or image information obtained from the first information processing device 2100 via the second information processing device 2200.

[0252] Specifically, the second analysis unit 2310 can use AI analysis to determine facial color and facial expression to provide an optimal space, coordinate lighting colors and relaxing scents, and provide music in coordination with a speaker. Furthermore, the system can maintain comfort by operating an air conditioner in coordination with AI depending on the temperature and humidity, check the oxygen concentration in the room, and coordinate with AI to provide notifications and open and close windows with automatic ventilation motors. Furthermore, the system may have a function to notify a pre-registered email address when the temperature exceeds a certain level, a function to notify a disaster prevention center or management office, and a function to automatically unlock the door in coordination with a door lock. It may also be able to coordinate with an IoT refrigerator to provide dietary restrictions, recipes, and other information.

[0253] If the necessary device is not IoT-linked, advice may be sent to the second information processing device 2200 to suggest that it would be better to operate a nearby device.

[0254] The action can also be the transmission of lifestyle improvement information to the second information processing device 2200 .

[0255] At this time, the third information processing device 2300 can acquire medical examination data that has been permitted in advance, and lifestyle improvement information is generated in accordance with the medical examination data.

[0256] The information on improving lifestyle habits specifically includes advice on dietary habits, and can send recommended recipes and the like.

[0257] As shown in FIGS. 15 and 19, the information processing system 2000 can further include a biometric information acquisition device 10 connected to the first information processing device 2100.

[0258] The biometric information acquisition device 10 is a device in which the function of the biometric information acquisition unit 2120 is separated and provided as a separate device.

[0259] At this time, the biometric information acquisition unit 2120 acquires the biometric information of the user acquired by the biometric information acquisition device 10 .

[0260] By separating the biometric information acquisition device 10 from the first information processing device 2100, the biometric information acquisition device 10 can be used in a variety of ways, such as embedding a sensor in a wall of a building or decorating the wall, or attaching it to the back of wallpaper to automatically acquire vital information.

[0261] Such a configuration can be employed in facilities with multiple users, nursing homes, and the like.

[0262] With this configuration, body temperature, blood pressure, pulse rate, and respiration can be automatically monitored in real time, eliminating the need for frequent measurements by nurses or administrators.

[0263] If the user is residing in a nursing home, the main living space is often a single private room, and monitoring can be performed by installing the first information processing device 2100 in one location. However, if the user lives in an individual living base such as an apartment or a detached house, the living space is often divided into multiple rooms such as a living room and a bedroom, and it is necessary to acquire biometric information in each room.

[0264] Therefore, as another embodiment of the present disclosure, the information processing system 2000 can include one parent device (first information processing device 2100) and multiple child devices (biometric information acquisition devices 10).

[0265] The configuration of the parent device is the same as the configuration of the above-described first information processing device 2100. However, the biometric information acquisition unit 2120 of the first information processing device 2100 manages not only the biometric information acquired by the biometric information acquisition unit 2120 of the first information processing device 2100 itself and the environmental information acquired by the environmental information acquisition unit 2140, but also the biometric information and environmental information transmitted from the biometric information acquisition device 10, and determines the presence or absence of an abnormality according to preset abnormality determination criteria.

[0266] If there are multiple biometric information acquisition devices 10, there is a risk that it may be impossible to identify which child device the transmitted biometric information and environmental information is from, so each child device is assigned a unique ID number, and when the biometric information and environmental information are transmitted, they are transmitted in association with the unique ID number.

[0267] The biometric information acquisition device 10 includes at least a biometric information acquisition unit and a communication unit. Information is transmitted from the slave unit to the master unit using short-range wireless communication, so the slave unit can be placed anywhere within the range of the wireless signal. If a wired terminal is installed in each room of the house, the slave unit may be connected via a wired connection.

[0268] The slave unit does not include any element equivalent to an analysis unit. This is because the master unit is configured to perform analysis, which allows the slave unit to be made smaller. Furthermore, slave units installed in places where privacy is particularly required, such as toilets and bathrooms, may be configured without an image acquisition unit. In this way, slave units with different configurations may be mixed depending on the location where the slave unit is installed. The installation location and shape may also be changed to suit the installation location. For example, a slave unit installed in the bedroom of a user who spends a lot of time in bed may be installed under the bed to accurately acquire biometric information. The slave unit can also be installed by embedding it in a wall or ceiling. With these configurations, the slave unit can be installed without making the user unnecessarily aware that biometric information is being acquired, and without detracting from the aesthetic appearance of the installation location.

[0269] The biometric information acquisition unit 2120 and / or the biometric information acquisition device 10 can acquire the user's respiration, heart rate, and blood pressure in a non-contact manner.

[0270] These can be obtained in a non-contact manner by transmitting and receiving microwaves as described above.

[0271] Furthermore, the biometric information acquisition unit 2120 and / or the biometric information acquisition device 10 can acquire the user's brain waves in a contact or non-contact manner.

[0272] Brain waves can be obtained by a known brain wave sensor. Furthermore, a technology for measuring brain waves in a non-contact manner may be realized by known or future technology.

[0273] Furthermore, the biometric information acquisition unit 2120 and / or the biometric information acquisition device 10 can acquire the body surface temperature of the user in a non-contact manner.

[0274] The body surface temperature can be obtained by a known thermosensor, for example, the infrared camera described above.

[0275] Furthermore, the biometric information acquisition unit 2120 and / or the biometric information acquisition device 10 can acquire the blood glucose level of the user in a contact or non-contact manner.

[0276] The blood glucose level can be obtained using a known blood glucose sensor. Furthermore, the technology for measuring blood glucose levels without contact may be realized by known or future technology.

[0277] The biometric information acquisition unit 2120 and / or the biometric information acquisition device 10 can acquire information through short-range communication with a vital sign measurement sensor embedded in a part of the user's body.

[0278] The environmental information acquisition unit 2140 can acquire at least one of the temperature, humidity, air pressure, and oxygen concentration of the location where the first information processing device 2100 is located.

[0279] These can be acquired by a temperature sensor, a humidity sensor, an air pressure sensor, and an oxygen concentration sensor provided in the first information processing apparatus 2100 .

[0280] The values ​​obtained by the barometric pressure sensor can be used to display a weather forecast.

[0281] The environmental information acquisition unit 2140 may also acquire the time. In this case, the time can be acquired by a radio wave receiving sensor provided in the first information processing device 2100. Note that the time set in the first information processing device 2100 may be used.

[0282] These may all be displayed on the display 107, or only the set items may be displayed. This setting may be made by the user.

[0283] According to the above configuration, a comfortable space can be created to maintain or improve the health of the user.

[0284] The environmental information acquisition unit 2140 may also acquire values ​​from a fire sensor or a sound sensor. These sensors may be included in the first information processing device 2100, or may be acquired by other devices that can be connected to the first information processing device 2100.

[0285] The first analysis unit 2160 can further acquire facial color information and / or facial expression information by analyzing an image of the user's face, and analyze the user's health condition based on the facial color information and / or facial expression information, the biometric information acquired by the biometric information acquisition unit, and the genomic information stored in the memory unit.

[0286] Facial color information and facial expression information are important decision-making materials on a par with biometric information, and when combined with genome analysis data, they can enable early detection of certain diseases.

[0287] Furthermore, since the facial color information and facial expression information can be used as an index for measuring the comfort level of the environment, the fifth information processing device 500 can be operated based on such information.

[0288] For example, the optimal space (environment) can be provided by providing lighting colors in conjunction with relaxing scents, or by providing music in conjunction with speakers.

[0289] As shown in FIG. 21, the first information processing apparatus 2100 can further include a user identification unit 2190 .

[0290] The user identification unit 2190 identifies the user based on the image acquired by the image acquisition unit 2130 .

[0291] As explained above, the images acquired by the image acquisition unit 2130 are used to analyze the user's facial expression and complexion, but here they can also be used to realize a facial recognition function for identifying the user.

[0292] A known technique can be used for face authentication.

[0293] According to the above configuration, it becomes possible to realize use by multiple users.

[0294] Moreover, the first information processing apparatus 2100 in the present disclosure can further include a communication unit 195 as shown in FIG.

[0295] The communication unit 2195 enables the first information processing apparatus 2100 to communicate with an external apparatus only under specific conditions.

[0296] As an example, the specific condition refers to a case where the determining unit 2170 determines that there is a first abnormality in the health condition.

[0297] To realize the above-described communication by the communication unit 2195, the first information processing device 2100 may be provided with a wired LAN connection terminal and / or a wireless LAN card. Furthermore, the first information processing device 2100 may be provided with a SIM card insertion terminal so that communication is possible even when an Internet connection environment is not in place. Inserting a SIM card enables communication with an external device via the mobile phone's wireless communication network.

[0298] Specifically, the first information processing device 2100 can directly contact the fourth information processing device 2400 without going through the second information processing device 2200 and / or the third information processing device 2300 .

[0299] The above configuration allows for a rapid response in the event of an emergency.

[0300] Next, an embodiment of an information processing method according to the present disclosure will be described with reference to the drawings.

[0301] As shown as an example in FIG. 22, the information processing method of the present disclosure is characterized in that one or more computer processors execute a biometric information acquisition step S2120, an image acquisition step S2130, an environmental information acquisition step S2140, a display step S2150, a first analysis step S2160, a determination step S2170, and an output step S2180.

[0302] In the biometric information acquisition step S2120, biometric information of the user is acquired. This biometric information acquisition step S2120 can be executed by the above-mentioned biometric information acquisition unit 2120. Details of the biometric information acquisition unit 2120 are as described above.

[0303] In the image acquisition step S2130, an image of at least the face of the user is acquired. This image acquisition step S2130 can be executed by the above-mentioned image acquisition unit 2130. Details of the image acquisition unit 2130 are as described above.

[0304] In the environmental information acquisition step S2140, environmental information is acquired. This environmental information acquisition step S2140 can be executed by the above-mentioned environmental information acquisition unit 2140. Details of the environmental information acquisition unit 2140 are as described above.

[0305] In the display step S2150, at least a part of the biometric information acquired in the biometric information acquisition step S2120 and at least a part of the environmental information acquired in the environmental information acquisition step S2140 are displayed. The display step S2150 can be executed by the above-mentioned display unit 2150. Details of the display unit 2150 are as described above.

[0306] In the first analysis step S2160, the health condition of the user is analyzed based on the biometric information acquired in the biometric information acquisition step S2120 and the user's genomic information stored in a predetermined storage unit. This first analysis step S2160 can be executed by the above-mentioned first analysis unit 2160. Details of the first analysis unit 2160 are as described above.

[0307] In the determination step S2170, it is determined whether or not there is an abnormality in the health condition analyzed in the first analysis step S2160. This determination step S2170 can be executed by the above-mentioned determination unit 2170. Details of the determination unit 2170 are as described above.

[0308] In the output step S2180, the result of the determination in the determination step S2170 is output. This output step S2180 can be executed by the above-mentioned output unit 2180. Details of the output unit 2180 are as described above.

[0309] The above configuration provides a technical improvement that solves or alleviates at least part of the problems of the prior art described above. Specifically, since the first information processing device itself stores the user's genomic information and has a function for analyzing the information using AI, it is possible to analyze the user's health condition and output the analysis results even in an environment that is not connected to the Internet.

[0310] Next, an embodiment of a computer program according to the present disclosure will be described with reference to the drawings.

[0311] The computer program in the present disclosure is characterized by causing one or more computer processors to realize a biometric information acquisition function, an image acquisition function, an environmental information acquisition function, a display function, a first analysis function, a determination function, and an output function.

[0312] The biometric information acquisition function acquires the biometric information of the user.

[0313] The image capture function captures an image of at least the face of the user.

[0314] The environmental information acquisition function acquires environmental information.

[0315] The display function displays at least a part of the biometric information acquired by the biometric information acquisition function and at least a part of the environmental information acquired by the environmental information acquisition function.

[0316] The first analysis function analyzes the health condition of the user based on the biometric information acquired by the biometric information acquisition function and the user's genome information stored in a predetermined storage unit.

[0317] The determination function determines whether or not there is an abnormality in the health condition analyzed by the first analysis function.

[0318] The output function outputs the result of the determination made by the determination function.

[0319] The biometric information acquisition function, image acquisition function, environmental information acquisition function, display function, first analysis function, determination function, and output function can be realized by a biometric information acquisition circuit 2121, an image acquisition circuit 2131, an environmental information acquisition circuit 2141, a display circuit 2151, a first analysis circuit 2161, a determination circuit 2171, and an output circuit 2181 shown in Fig. 23. The biometric information acquisition circuit 2121, the image acquisition circuit 2131, the environmental information acquisition circuit 2141, the display circuit 2151, the first analysis circuit 2161, the determination circuit 2171, and the output circuit 2181 are realized by the biometric information acquisition unit 2120, the image acquisition unit 2130, the environmental information acquisition unit 2140, the display unit 2150, the first analysis unit 2160, the determination unit 2170, and the output unit 2180, respectively. Details of each unit are as described above.

[0320] The above configuration provides a technical improvement that solves or alleviates at least part of the problems of the prior art described above. Specifically, the first information processing device itself stores the user's genomic information and has a function for analyzing the acquired information using AI, so that it is possible to analyze the user's health condition and output the analysis results even in an environment that is not connected to the Internet.

[0321] Finally, the circumstances that led the inventors to create the present invention will be explained.

[0322] As society's aging rate rapidly increases, medical benefit costs are expected to rise from the current approximately 36 trillion yen to approximately 54 trillion yen by fiscal 2025 due to the expansion of social security spending. Medical costs per person increase with age, excluding infancy, but increase rapidly after the age of 65, and the proportion of hospitalization costs (hospitalization + meals and lifestyle care) increases after the age of 80. The current situation is that more than one-third of medical expenses (fiscal 2013) are related to lifestyle-related diseases, and a high proportion is accounted for by diseases associated with aging and mental and neurological disorders.

[0323] The spread of COVID-19 has led to restrictions on contact with others and people refraining from going out due to health concerns, creating uncertainty about the economy and employment, and work styles are changing. At the same time, people are becoming more aware of their health, including health management through remote work and caregiving due to an aging population.

[0324] Due to these changes in society's life cycle and technological advances brought about by AI, this invention was made with the aim of providing a service that improves lifestyle habits and provides a comfortable living environment through the use of a standalone device that does not go through a network, and that uses the individual's genome data to provide contactless healthcare and predicts abnormalities in the body and provides health management services.

[0325] Currently, home electronic blood pressure monitors can be broadly divided into two types: "upper arm" types that measure blood pressure on the upper arm, and "wrist" types that measure blood pressure on the wrist. The "upper arm" type can be further divided into types where you wrap a cuff around your upper arm yourself, and types where you put your arm through a cylindrical cuff that is integrated into the blood pressure monitor body.

[0326] For healthcare purposes, there are wristwatch-type devices, devices worn on the finger, and devices that connect to smartphones, etc. People with chronic blood pressure conditions such as high blood pressure and diabetes need to measure their blood pressure and have blood tests done daily or regularly.

[0327] Contact-type sensors often cannot collect data due to the stress caused by wearing them or forgetting to wear them, which can occur in natural human lifestyles. Non-contact vital sensors can collect vital data without having to wear anything on the body, and can contribute to human health without interfering with daily life.

[0328] Furthermore, by inputting genomic information, we aim to provide effective personalized services tailored to each individual. Also, it can be operated as a standalone device anywhere without going through the internet. If this can be realized, it will have the potential to be recognized as a business that can contribute to society.

[0329] Using the individual's genomic data, vital signs, complexion, facial expressions, and brain wave information, the system can be linked to AI services via a standalone AI and a dedicated app to provide the optimal living environment, detect and notify symptoms early, monitor lifestyle habits, and provide guidance for improvement.

[0330] Non-contact vital sensors include the following: ・Respiration, heart rate, blood pressure (estimated) ・Facial recognition sensor ・Identifying individuals through facial recognition ・Status estimation based on facial color and facial expression ・Thermal sensor (body surface temperature) ・Electroencephalogram measurement (connected or non-contact) ・Diabetes testing sensor

[0331] In one embodiment of the present disclosure, a server device, a data processing system, a data processing method, and a program can be provided that acquires a person's health status and notifies a dedicated display device of ways to improve lifestyle habits and the environment using a device programmed with AI that analyzes the person's genome analysis data, facial expressions, and behavioral patterns (movements), which are acquired in advance on a standalone basis even in an environment not connected to a network, a device that acquires vital information (heart rate, breathing, blood pressure, body temperature, etc.) non-contact using microwaves, a device that can measure brain waves, a device that takes body temperature using infrared rays, a device that measures oxygen concentration, and a device that displays weather forecasts and the time.

[0332] The disclosed invention detects the signs of illness in users. However, connecting to a network to predict the onset of illness poses security issues such as the risk of leaking measurement data, and it cannot be used in places without a network connection. It is not useful for improving lifestyle habits, but rather for predicting illness.

[0333] For example, AI can make comprehensive judgments to automatically control ventilation, lighting, fragrance, doors, etc., optimizing health conditions that call for improvements in lifestyle habits.

[0334] The invention disclosed herein allows a person to read genome analysis data that has been confirmed in advance through a dedicated app in conjunction with a standalone device.

[0335] If someone collapses at home, vital signs will measure their heart rate and breathing, allowing changes in their body to be identified, but malfunctions can occur depending on the accuracy of the sensors, so if the AI's behavioral patterns (movements) are not natural, the AI ​​equipped with vital data will make a comprehensive judgment and report the situation.

[0336] According to this invention, AI can judge accumulated data and proactively control a comfortable environment. For example, health conditions can be optimized by automatically controlling ventilation, lighting, fragrance, doors, etc. based on AI judgment.

[0337] In addition, the information processing system of the present disclosure can be controlled in cooperation with a smart home in a residential facility or a public facility.

[0338] In another embodiment, the information processing system of the present disclosure may further include a second information processing device that can be connected to the first information processing device via short-range wireless communication, and a sixth information processing device that can be connected to the second information processing device via short-range wireless communication.

[0339] The sixth information processing device is installed in a predetermined means of transportation, such as a bus or an airplane.

[0340] In this case, the sixth information processing device acquires biometric information of the user while moving and transmits the acquired biometric information while moving to the second information processing device, and the second information processing device transmits the biometric information while moving to the first information processing device when it is within a distance where short-range wireless communication is possible with the first information processing device, and the first information processing device passes the acquired biometric information while moving to the first analysis unit.

[0341] With this configuration, passengers or crew members traveling in a limited space on a bus, airplane, or other means of transportation can check their health status by reading the special identification number identified by the device using a special app on their smartphone.

[0342] In another embodiment, the information processing system may further include a second information processing device that can be connected to the first information processing device via short-range wireless communication, and a seventh information processing device that can be connected to the second information processing device via short-range wireless communication.

[0343] The seventh information processing device is provided with a predetermined moving means, specifically, the seventh information processing device may be a mobile robot.

[0344] In this case, the seventh information processing device acquires the user's biometric information and transmits the acquired biometric information during movement to the second information processing device, and the second information processing device transmits the biometric information during movement to the first information processing device when it is within a distance where short-range wireless communication is possible with the first information processing device, and the first information processing device passes the acquired biometric information to the first analysis unit.

[0345] With this configuration, the robot can grasp the health condition of the user while moving around in a specific location.

[0346] Notification methods may include reporting via a standalone device, connecting to an external AI via a dedicated app on the user's smartphone to notify a third party, and providing a history of the data obtained.

[0347] Furthermore, the display screen can be made more convenient by displaying weather information and the time, which are some of the first things people want to know when they wake up each day.

[0348] In addition, by linking with sensors that measure oxygen concentration and PM concentration, the surrounding environment can be made more comfortable.

[0349] The information processing system 1000 according to the present disclosure may be equipped with a rechargeable battery, a single-use battery, or a new energy source (solar power, wind power, etc.), and may be capable of performing measurements anywhere.

[0350] The information processing system 1000 according to the present disclosure may be configured to acquire vital data in a residential facility or a shared facility in conjunction with a slave device.

[0351] The information processing system 1000 of the present disclosure may be embedded in a wall or ceiling of a residential facility or other facility, and linked to each person's pre-registered ID, allowing the data of the person to be obtained in advance and the condition of the person to be confirmed and notified.

[0352] The information processing system 1000 according to the present disclosure may be provided with a function that allows a doctor to view data remotely, thereby enabling the doctor to shorten the time required for remote medical treatment using a camera.

[0353] In the information processing system 1000 according to the present disclosure, various sensors may be activated when a person is detected by a motion sensor in order to save power.

[0354] Furthermore, the biometric information acquisition unit and / or the biometric information acquisition device can acquire the biometric information at a predetermined time or at predetermined time intervals.

[0355] Next, another embodiment of the information processing system according to the present disclosure will be described. In this embodiment, the information processing device 100 may include an information processing unit, a control unit, a communication unit, a recording unit, a display unit, and an input unit, as shown in FIG.

[0356] The input unit accepts data input for registering and correcting user information. A user can register age, sex, actual weight, blood type, height, etc. via the input unit.

[0357] The control unit controls all the systems.

[0358] The information processing unit performs processes such as noise removal, surface area calculation, and volume calculation for data acquired from the sensor.

[0359] As sensors, a visible light camera, an infrared sensor, and an ultrasonic sensor can be connected.

[0360] The visible light camera is used to measure the entire body and obtain data that determines gender and age classifications.

[0361] The infrared sensor measures the entire body from the heat of the human body, even when wearing clothes, and acquires data for 3D rendering.

[0362] The ultrasonic sensor is intended to acquire data for determining the divisions of the human body structure (bones, muscles, etc.).

[0363] The reflecting portion reflects specific wavelengths of infrared rays and ultrasonic waves.

[0364] The recording section records all data.

[0365] The display unit displays a UI that allows the user to make selections.

[0366] The communication unit connects to a network, and can connect using methods such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0367] Data management is done in the cloud.

[0368] The mobile device is used to manage weight data using a dedicated app.

[0369] Furthermore, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiments. Such an information processing device can be realized by storing a program describing the processing content for realizing each function of the server device or terminal device according to the embodiments in a storage unit of the information processing device, and having the CPU of the information processing device read and execute the program.

[0370] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.

[0371] Furthermore, the methods described in the embodiments can be stored as a program executable by a computer on a recording medium such as a magnetic disk (e.g., a floppy disk, a hard disk, etc.), an optical disk (e.g., a CD-ROM, a DVD, an MO, etc.), or a semiconductor memory (e.g., a ROM, a RAM, a flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium also includes a configuration program that configures software means (including not only executable programs but also tables and data structures) within the computer for execution. The computer implementing this device loads the program stored on the recording medium and, in some cases, configures the software means using the configuration program, and executes the above-described processing by controlling the operation of this software means. Note that the term "recording medium" as used herein is not limited to a storage medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory installed within the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.

[0372] 1000 Information processing system 100 Information processing device 110 Receiving unit 120 Processing unit 200 Measuring device 210 Imaging device 220 Infrared sensor unit 230 Ultrasonic sensor unit

Claims

1. An information processing system comprising one or more computer processors, wherein the information processing system includes a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device, and the one or more computer processors include a receiving unit that receives data acquired by the measuring device, and a processing unit that calculates the weight of a measurement target by processing the data received by the receiving unit, wherein the processing unit calculates the volume of each part of the measurement target based on the data received by the receiving unit, and an information processing system that calculates the weight of the measurement target based on the volume of each part, information regarding the configuration of each part, and the specific gravity of elements related to the configuration.

2. The information processing system further comprises a determination unit that determines that the measurement target has entered a predetermined measurement area by analyzing an image captured by the imaging device, according to the information processing system of Claim 1.

3. The information processing system further comprises a face authentication unit that determines whether the measurement target is a registered user when it is determined by the determination unit that the measurement target has entered a predetermined measurement area, and a confirmation unit that confirms whether measurement can be performed on the measurement target when it is determined by the face authentication unit that the measurement target is not a registered user according to the information processing system of Claim 2.

4. The acquisition of data by the measuring device is started when it is confirmed by the confirmation unit that the measurement can be performed, according to the information processing system of Claim 3.

5. The measurement by the infrared sensor unit and the ultrasonic sensor unit is started when it is confirmed by the confirmation unit that the measurement can be performed, according to the information processing system of Claim 3.

6. When it is determined by the confirmation unit that the measurement target is not a registered user, the confirmation unit displays a confirmation screen on a display included in the information processing system or on a display of the user's information processing terminal, according to the information processing system of Claim 3.

7. The acquisition of data by the measurement device is started on the occasion when the determination unit determines that the measurement target has entered a predetermined measurement area, according to the information processing system described in claim 2.

8. The measurement by the infrared sensor unit and the ultrasonic sensor unit is started on the occasion when the determination unit determines that the measurement target has entered a predetermined measurement area, according to the information processing system described in claim 2.

9. The processing unit estimates the composition of the measurement target based on the reflected data from the measurement target acquired by the ultrasonic sensor unit received by the receiving unit, according to the information processing system described in claim 1.

10. The processing unit generates 3D data of the measurement target based on the reflected data and / or radiated data from the target including the measurement target acquired by the infrared sensor unit received by the receiving unit, according to the information processing system described in claim 1.

11. The processing unit generates 3D data of the measurement target based on the image data including the measurement target acquired by the imaging device received by the receiving unit, according to the information processing system described in claim 1.

12. The processing unit divides a solid having an outer shape corresponding to the measurement target based on the 3D data of the measurement target into a plurality of parts of a predetermined size, calculates the weight of each part based on the information regarding the composition of each part and the specific gravity of the elements related to the composition, and obtains the weight of the measurement target by summing up the weights of all the parts, according to the information processing system described in claim 10 or 11.

13. The processing unit further performs background removal from the image data by analyzing the image data including the measurement target acquired by the imaging device received by the receiving unit, according to the information processing system described in claim 1.

14. The infrared sensor unit includes an infrared camera and an infrared sensor composed of an infrared light projecting unit, an infrared light receiving unit, and a reflection unit, according to the information processing system described in claim 1.

15. The information processing system according to claim 1, wherein the ultrasonic sensor unit includes a main unit composed of an ultrasonic light projecting unit and an ultrasonic light receiving unit, and a slave unit composed of an ultrasonic light receiving unit and a reflecting unit.

16. The ultrasonic sensor unit includes the main unit and two of the slave units, and is arranged such that a horizontal angle of an angle formed by a straight line connecting each of the main unit and the slave units and a vertical angle of a straight line connecting each of the main unit and the slave units are within a predetermined value. The information processing system according to claim 15.

17. The information processing system according to claim 1, wherein the measuring device is used to be arranged at a front position of the measurement target or above the head of the measurement target.

18. The one or more computer processors further have a storage unit that stores user information of the user who is the measurement target, and the processing unit determines whether the image data of the face of the user who is the measurement target and acquired by the imaging device received by the receiving unit is included in the user information stored in the storage unit. As a result of the determination, when it is determined that the image data of the user's face is included in the user information, the information processing system according to claim 1, wherein the user is recognized as a measurement target.

19. The storage unit further stores information regarding the actual weight of the user. The processing unit compares the weight of the user, which is the calculated weight of the measurement target, with the actual weight of the user stored in the storage unit, and determines whether there is a difference of a predetermined amount or more between the weight of the user and the actual weight of the user. The information processing system according to claim 18.

20. The information processing system according to claim 18, wherein the processing unit requests the measuring device to acquire data again when there is a difference of a predetermined amount or more between the weight of the user and the actual weight of the user as a result of the determination.

21. An information processing method in an information processing system including one or more computer processors, the information processing system comprising a measurement device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measurement device, the method causing the one or more computer processors to perform steps of receiving data acquired by the measurement device, calculating a volume of each part of a measurement target based on the data, and calculating a weight of the measurement target based on the volume of each part, information on the configuration of each part, and a specific gravity of an element related to the configuration.

22. A computer program executed in an information processing system including one or more computer processors, the information processing system comprising a measurement device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measurement device, the computer program causing the one or more computer processors to realize a reception function of receiving data acquired by the measurement device and a processing function of calculating a weight of a measurement target by processing the data received by the reception function, the processing function calculating a volume of each part of the measurement target based on the data received by the reception function and calculating the weight of the measurement target based on the volume of each part, information on the configuration of each part, and a specific gravity of an element related to the configuration.