Information terminal, control method, and control program

The information terminal automates the association of measurement data with a person by using wireless communication and facial recognition, addressing the inefficiencies of existing methods and ensuring accurate data pairing.

JP2024175812AInactive Publication Date: 2024-12-19OMRON HEALTHCARE CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023093843
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-07
Publication Date
2024-12-19
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing methods for associating measurement data with a person to be measured are not user-friendly and lack accuracy in identifying the correct individual.

Method used

An information terminal equipped with a communication unit, imaging unit, and control unit that facilitates short-range wireless communication with a biological information measuring device, automatically captures images during measurement, and identifies the person based on facial recognition to associate measurement data accurately.

Benefits of technology

Enables easy and reliable association of measurement data with the correct person by eliminating the need for manual operation and ensuring accurate identification through facial recognition, enhancing user convenience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024175812000001_ABST
    Figure 2024175812000001_ABST
Patent Text Reader

Abstract

To provide an information terminal, a control method, and a control program that make it possible to easily and accurately associate and manage measurement data of a measured person.SOLUTION: An information terminal 5 according to one aspect of the present invention comprises a second wireless communication unit 54, a data storage unit 56, an imaging module 57, and a controller 58. The second wireless communication unit 54 is capable of communicating with a measurement device 1 for biological information. The data storage unit 56 is capable of storing measurement data obtained by the measurement device 1. The imaging module 57 is capable of imaging. The controller 58 identifies the measured person on the basis of an image obtained by imaging performed during the measurement by the measurement device 1, and stores, in the data storage unit 56, the measured person and the measurement data received from the measurement device 1 in association with each other.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information terminal, a control method, and a control program. [Background technology]

[0002] Conventionally, there is known a device that measures data on a subject with a measuring device, and stores the measured data in association with the subject. For example, Patent Document 1 describes a biometric information processing device that photographs the subject with a camera provided in the measuring device, identifies the subject based on the photographed image, transmits subject information in which the identified subject and the measurement data of the subject are associated with each other to a communication terminal, and stores the subject information in the communication terminal.

[0003] Patent document 2 also describes a management system that has a measurement unit consisting of an imaging device and a measuring device, and a user terminal, in which the measuring device measures a user's physical data, the imaging device captures an image of the user, and the user terminal receives the user's physical data and the user image from the imaging device.

[0004] Patent document 3 describes an information processing device that includes a device information acquisition unit that acquires information related to a biometric device, a user identification unit that identifies a user based on the information related to the biometric device acquired by the device information acquisition unit, and a data processing unit that associates the information acquired by the device information acquisition unit with the user identified by the user identification unit.

[0005] Furthermore, Patent Document 4 describes a robot in which, when a grasping means is grasped by a specified target, an acquisition unit acquires physical information relating to the physical functions of the specified target, an imaging unit acquires an image of the specified target, an identification unit recognizes the specified target based on the acquired image, and the specified target and the physical information are linked and stored. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2018-94334 A [Patent Document 2] JP 2019-76659 A [Patent Document 3] JP 2015-219726 A [Patent Document 4] JP 2019-217081 A Summary of the Invention [Problem to be solved by the invention]

[0007] There have been various proposals regarding managing measurement data of a subject in association with the subject, as shown in Patent Documents 1 to 4. However, there is a demand for further improvement in the convenience for users with regard to the method of association.

[0008] In one aspect, the present invention has been made in consideration of this situation, and its object is to provide an information terminal, a control method, and a control program that can easily and accurately match measurement data with a person being measured. [Means for solving the problem]

[0009] In order to solve the above problems, the present invention employs the following configuration.

[0010] (1) A communication unit capable of communicating with a biological information measuring device; A storage unit capable of storing measurement data obtained by the measuring device; An imaging unit capable of imaging; a control unit that identifies a person to be measured based on an image obtained by the imaging during measurement by the measurement device, and that associates the person to be measured with the measurement data received from the measurement device and stores the associated data in the storage unit; An information terminal comprising:

[0011] According to (1), the person to be measured is identified based on an image captured during measurement with the measuring device, so that the measurement data received from the measuring device can be easily and reliably associated with the correct person to be measured.

[0012] (2) An information terminal according to (1), The communication unit performs short-range wireless communication with the measurement device. Information terminal.

[0013] As in (2), short-range wireless communication is suitable for receiving measurement data of vital signs from a measurement device.

[0014] (3) An information terminal according to (1) or (2), the control unit identifies the subject from among a plurality of users registered in the information terminal based on the image. Information terminal.

[0015] According to (3), the person to be measured is identified from among pre-registered users based on the captured image, so that the user does not need to perform operations to match the measurement data with the person to be measured, and the matching can be performed easily and reliably.

[0016] (4) An information terminal according to any one of (1) to (3), The control unit identifies the subject based on the image obtained by the imaging during the measurement by the measurement device. Information terminal.

[0017] According to (4), the person to be measured is identified based on the image captured by the measuring device during measurement, so that the measurement data received from the measuring device can be easily and reliably associated with the correct person to be measured.

[0018] (5) An information terminal according to (4), a display unit that displays a content image during measurement by the measuring device; Information terminal.

[0019] According to (5), it is possible to direct the subject's gaze toward the display unit on which the content image is displayed, and an image of the subject can be appropriately captured.

[0020] (6) An information terminal according to any one of (1) to (5), The control unit causes the imaging unit to perform the imaging during measurement by the measurement device without an imaging operation from a user. Information terminal.

[0021] According to (6), it is possible to automatically capture an image of the person being measured during measurement by the measuring device, thereby identifying the person being measured.

[0022] (7) An information terminal according to any one of (1) to (6), A display unit capable of displaying an image is provided, The imaging unit is provided so as to be able to image an observer of the display unit. Information terminal.

[0023] According to (7), it is possible to capture an image of the subject facing the display unit.

[0024] (8) A method for controlling an information terminal including a communication unit capable of communicating with a measurement device for measuring biological information, a storage unit capable of storing measurement data obtained by the measurement device, and an imaging unit capable of capturing images, comprising: identifying the subject based on the image obtained by the imaging during measurement by the measuring device; storing the measurement data received from the measurement device in association with the person to be measured in the storage unit; Control methods.

[0025] According to (8), the person to be measured is identified based on an image captured during measurement with the measuring device, so that the measurement data received from the measuring device can be easily and reliably associated with the correct person to be measured.

[0026] (9) A control program for an information terminal including a communication unit capable of communicating with a measurement device for measuring biological information, a storage unit capable of storing measurement data obtained by the measurement device, and an imaging unit capable of capturing an image, A processor of the information terminal identifying the subject based on the image obtained by the imaging during measurement by the measuring device; storing the measurement data received from the measurement device in association with the person to be measured in the storage unit; A control program for executing processing.

[0027] According to (9), the person to be measured is identified based on an image captured during measurement with the measuring device, so that the measurement data received from the measuring device can be easily and reliably associated with the correct person to be measured. Effect of the Invention

[0028] According to the present invention, it is possible to provide an information terminal, a control method, and a control program that can easily and accurately associate measurement data with a person being measured. [Brief description of the drawings]

[0029] [Figure 1] 1 is a diagram showing an information management system 100 including an information terminal 5 of the present invention and a measuring device 1 that performs wireless communication with the information terminal 5. FIG. [Diagram 2] FIG. 1 is a diagram showing a thermometer 1a which is an example of the measurement device 1. [Diagram 3] FIG. 2 is a diagram showing an example in which an information terminal 5 is connected to a network. [Figure 4] 1 is a block diagram showing a configuration of a measurement device 1. FIG. [Diagram 5] 2 is a block diagram showing a configuration of an information terminal 5. FIG. [Figure 6] 13 is a diagram showing an example of a table stored in the information terminal 5. FIG. [Figure 7] 2 is a sequence diagram showing the operations of the measuring device 1 and the information terminal 5 in the information management system 100. FIG. [Figure 8] 13 is a flowchart showing an example of a process performed when an application of the information terminal 5 is started. [Figure 9] 13 is a flowchart showing a modified example of the process performed when an application of the information terminal 5 is started. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0030] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment according to one aspect of the present invention will be described with reference to the drawings.

[0031] §1 Examples of application <Information management system 100 to which the present invention is applied> FIG. 1 shows an information management system 100 including an information terminal 5 of the present invention and a measuring device 1 that performs wireless communication with the information terminal 5.

[0032] The measuring device 1 includes a biological information measuring device that measures biological information such as weight, body composition, blood pressure, pulse, heart rate, body temperature, blood glucose, or blood oxygen saturation, and an activity measuring device that measures activity such as steps, walking distance, or calories burned. The measuring device includes a measurement sensor for measuring a measurement target amount. The measurement target amount of the measurement sensor includes biological information such as weight, body fat percentage, blood pressure value, pulse rate, heart rate, body temperature, blood glucose value, or blood oxygen saturation, and activity such as steps, running distance, or calories burned, depending on the measuring device. The measuring device 1 is, for example, a non-wearable measuring device such as a weight scale, a body composition scale, a blood pressure meter, a thermometer, or a blood glucose meter, or a wearable measuring device such as a pedometer or an activity meter. A non-wearable measuring device is a measuring device that is not wearable, and is used, for example, while being installed on the ground or a stand. A wearable measuring device is a measuring device that is carried by being attached to the body of a user (a person to be measured). The measurement device 1 transmits the measured biological information and activity amount as measurement data of the user to the information terminal 5 via wireless communication.

[0033] The information terminal 5 stores the measurement data received from the measuring device 1 in a data storage unit in the information terminal 5. The information terminal 5 can also wirelessly communicate with devices other than the measuring device 1, and stores information acquired from external devices in a data storage unit in the information terminal 5. The information terminal 5 is an information processing device that analyzes various information acquired from the measuring device 1 and other external devices. The information terminal 5 is, for example, a terminal having a display such as a smartphone, a tablet terminal, a laptop computer, a desktop computer, or a wearable terminal. The information terminal 5 may be set to acquire measurement data from a specific measuring device 1. The specific measuring device 1 from which the measurement data is acquired may be registered in advance in the data storage unit of the information terminal 5.

[0034] 2 is a diagram showing a thermometer 1a, which is an example of the measurement device 1. The thermometer 1a is an example of a biological information measurement device, which measures the user's body temperature and outputs the measurement result to the user. The thermometer 1a also transmits the measurement result as the user's measurement data to the information terminal 5 via wireless communication. For example, the thermometer 1a includes a temperature sensor 21 that senses the user's body temperature, a display unit 22 that displays the measurement data (body temperature), a communication button 23 for transmitting the measurement data to the information terminal 5 via wireless communication, and a power button 24 for starting up the thermometer 1a.

[0035] Fig. 3 is a diagram showing an example in which an information terminal 5 is connected to a network. As shown in Fig. 3, the information terminal 5 may be connected to a cloud server 90 via a wide area network N such as the Internet. The information terminal 5 may transmit measurement data stored therein to the cloud server 90 via the wide area network N, and the cloud server 90 may manage the user's measurement data as a database. The information terminal 5 may also acquire measurement data managed in the cloud server 90 via the wide area network N, and use the acquired measurement data.

[0036] §2 Configuration example <Configuration of Measuring Device 1> 4 is a block diagram showing the configuration of the measuring device 1. The measuring device 1 includes a display unit 11 that displays various information, an operation unit 12 operated by the user, a measuring unit 13 that measures biological information and an activity amount, and a wireless communication unit 14 for communicating with an external device. The measuring device 1 also includes a RAM 16 that temporarily stores information, a data storage unit 17 that stores information and programs, and a controller 18 that controls the overall operation.

[0037] The display unit 11 is configured with, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 11 includes, for example, the display unit 22 described in FIG. 2. The operation unit 12 is a user interface that accepts user operations, such as buttons and a touch panel. The buttons include buttons that are physically provided on the measurement device 1 and virtual buttons displayed on the display unit 11. The buttons include, for example, the communication button 23 described in FIG. 2.

[0038] The measurement unit 13 measures biological information such as weight, body composition, blood pressure, pulse rate, heart rate, body temperature, blood glucose, blood oxygen saturation, etc., and activity levels such as number of steps, walking distance, calories burned, etc. What is measured varies depending on the measurement target of the measurement device 1.

[0039] The wireless communication unit 14 is a communication unit that performs short-distance wireless communication, for example, a circuit (module) for performing communication according to the BLE (Bluetooth Low Energy (registered trademark)) standard. The wireless communication unit 14 transmits an advertising signal for performing wireless communication to an unspecified number of external devices at a predetermined transmission cycle by broadcast communication. The wireless communication unit 14 transmits the advertising signal including, for example, the name and attribute information of the measuring device 1. The wireless communication (BLE communication) performed by the wireless communication unit 14 is, for example, communication using a 2.4 GHz frequency. The wireless communication unit 14 transmits measurement data such as biological information and activity amount measured by the measurement unit 13 to the information terminal 5 by BLE communication.

[0040] The RAM 16 is composed of a semiconductor device such as a DRAM or an SRAM, and serves as a working area for the controller 18 while temporarily storing information.

[0041] The data storage unit 17 is a recording medium that stores parameters, control programs, measurement data, etc., necessary for implementing predetermined processing. The data storage unit 17 is configured, for example, by a hard disk drive (HDD) or a semiconductor storage device (SSD).

[0042] Controller 18 realizes a predetermined process by executing a control program. In this embodiment, for example, health management application software for a measuring device is pre-installed as a control program in data storage unit 17, and controller 18 realizes a predetermined process by executing this health management application software.

[0043] For example, the controller 18 controls the wireless communication unit 14 to transmit an advertising signal for wireless communication (BLE communication). Specifically, when the measuring device 1 is started, the controller 18 controls the wireless communication unit 14 to transmit an advertising signal. For example, in the thermometer 1a shown in FIG. 2, when the power button 24 is turned on and then the communication button 23 is pressed, the controller 18 controls the wireless communication unit 14 to transmit an advertising signal.

[0044] <Configuration of information terminal 5> 5 is a block diagram showing the configuration of the information terminal 5. The information terminal 5 includes a display unit 51 that displays various information, an operation unit 52 that is operated by the user, and a first wireless communication unit 53 and a second wireless communication unit 54 for communicating with external devices. The information terminal 5 also includes a RAM 55 that temporarily stores information, a data storage unit 56 that stores information and programs, an imaging module 57 that can capture images, and a controller 58 that controls the overall operation. The controller 58 is an example of the "control unit" of the present invention.

[0045] The display unit 51 is configured with, for example, a liquid crystal display or an organic EL display. The operation unit 52 is a user interface that accepts user operations such as buttons and a touch panel. The buttons include buttons that are physically provided on the information terminal 5 and virtual buttons displayed on the display unit 51.

[0046] The first wireless communication unit 53 is a communication unit that performs cellular communication, for example, a circuit (module) for communication according to standards such as 4G, 5G, and LTE (Long Term Evolution: registered trademark). The first wireless communication unit 53 is a communication unit that performs wireless LAN communication, for example, a circuit (module) for communication according to standards such as Wi-Fi (registered trademark). The second wireless communication unit 54 is a communication unit that performs short-range wireless communication, for example, a circuit (module) for communication according to the BLE standard.

[0047] The second wireless communication unit 54 acquires measurement data of the user measured by the measuring device 1, for example, by performing BLE communication with the wireless communication unit 14 of the measuring device 1. The second wireless communication unit 54 receives an advertising signal transmitted from the wireless communication unit 14 of the measuring device 1 by scanning. The second wireless communication unit 54 recognizes the measuring device 1 from the received advertising signal, and transmits a connection request to the measuring device 1 when it wants to establish a communication connection. After transmitting an advertising signal, the measuring device 1 waits for a connection request for a predetermined time, and when it receives a connection request within the predetermined time, it stops transmitting the advertising signal and switches to one-to-one connection communication with the other party of the connection request.

[0048] The RAM 55 is composed of a semiconductor device such as a DRAM or an SRAM, and temporarily stores information and serves as a working area for the controller 58 .

[0049] The data storage unit 56 is a recording medium that stores parameters necessary for implementing predetermined processing, control programs, and measurement data acquired from the measurement device 1. The data storage unit 56 is configured, for example, by a hard disk drive (HDD) or a semiconductor storage device (SSD).

[0050] Controller 58 performs predetermined processing by executing a control program. In this embodiment, for example, health management application software for information terminals is pre-installed as a control program in data storage unit 56, and controller 58 performs predetermined processing by executing this health management application software.

[0051] For example, when health management application software for the information terminal is launched, the controller 58 controls the second wireless communication unit 54 to receive an advertising signal by scanning. When an advertising signal from the measurement device 1 is received, the controller 58 controls the second wireless communication unit 54 to transmit a connection request to the measurement device 1. When the connection request is received by the measurement device 1, communication of the measurement device 1 is switched to one-to-one connection communication with the information terminal 5, and the information terminal 5 and the measurement device 1 are in a BLE connected state.

[0052] The controller 58 also identifies the person to be measured based on an image obtained by imaging the imaging module 57 when the measuring device 1 is measuring the biological information, the amount of activity, and the like. The measurement time means, for example, during the measurement of biological information, and may include the start of the measurement and immediately after the measurement without being limited to during the measurement. Identifying the person to be measured means identifying a user who matches the person to be measured from at least one user who is registered in advance by the user in the information terminal 5 in which the health management application software is installed, and identifying a user ID (Identification) set for the identified user. The controller 58 can identify the person to be measured from a plurality of users registered in the information terminal 5 based on an image obtained by imaging. The controller 58 identifies the person to be measured by authenticating the user's face. The controller 58 associates the person to be measured identified based on the captured image with the measurement data received from the measuring device 1 and stores them in the data storage unit 56.

[0053] The controller 58 controls the display unit 51 to display a content image while the measuring device 1 is measuring biological information or the like. The content image may be, for example, an image related to the measurement, such as a provisional measurement result during the measurement, the remaining time of the measurement, or a guidance message such as "The data is being measured. Please wait a moment." If the measuring device 1 is a thermometer 1a of a type that is held under the arm, it may be a determination result of whether the thermometer 1a is properly held under the arm, or a message guiding the subject to hold the thermometer 1a properly under the arm if the thermometer 1a is not properly held under the arm, or an image that is not related to the measurement but attracts the subject's interest (for example, an animation or game for children). In addition, if the measuring device 1 is a thermometer 1a of a type that is held under the arm, the information terminal 5 is held in the hand holding the thermometer 1a during the measurement, and the controller 58 may display, as the content image, a warning image when the information terminal 5 moves by a certain amount or more, or a fun image when the information terminal 5 does not move by a certain amount or more (when the information terminal 5 is still). By displaying such content images, it is possible to increase the motivation of the person being measured to look at the information terminal 5 during measurement, to increase the motivation to perform measurement by linking the measuring device 1 and the information terminal 5, and to support appropriate measurement.

[0054] Controller 58 causes imaging module 57 to capture an image when measuring biometric information, etc., with measuring device 1, without an imaging operation from the user. An imaging operation is an explicit instruction operation for capturing an image, such as pressing an imaging button. "During measurement" means, for example, triggered by starting health management application software on information terminal 5, completing BLE connection with measuring device 1, pressing a measurement start button displayed on information terminal 5 to start measurement with measuring device 1, starting measurement of biometric information, etc. with measuring device 1, displaying a content image during measurement on display unit 51, displaying a measurement result on display unit 51, etc.

[0055] The imaging module 57 is provided so as to be able to capture an image of an observer observing the display unit 51. When the information terminal 5 is, for example, a smartphone, an image of the observer observing the display unit 51 is captured by an in-camera mounted on the liquid crystal panel side and capturing an image in the forward direction.

[0056] <Stored data of information terminal 5> Fig. 6 is a diagram showing an example of a measurement data table stored in the data storage unit 56 of the information terminal 5. As shown in Fig. 6, the measurement data tables 56a, 56b, and 56c store, for example, the measurement date and time of the measurement data and the measurement value in association with each other. For example, when the measurement device 1 is a thermometer 1a, the measurement value is body temperature [°C].

[0057] The information terminal 5 is configured to be able to store measurement data of multiple users in the data storage unit 56. In this example, the measurement data of users A, B, and C is stored in the data storage unit 56. The data storage unit 56 stores measurement data tables 56a, 56b, and 56c for storing the measurement data of users A, B, and C.

[0058] Measurement data table 56a stores the measurement data of user A. Measurement data table 56b stores the measurement data of user B. Measurement data table 56c stores the measurement data of user C. User A is the owner of information terminal 5. Users B and C are user A's children. In this example, user A's information terminal 5 stores measurement data tables 56a, 56b, and 56c which store the measurement data of user A (parent), user B (child 1), and user C (child 2).

[0059] Furthermore, images of user A, user B, and user C for face authentication are preregistered in the data storage unit 56. The images of user A, user B, and user C are registered in association with measurement data tables 56a, 56b, and 56c. The controller 58 of the information terminal 5 identifies user A, user B, or user C by face authentication based on the image captured by the imaging module 57. The controller 58 refers to the measurement data table associated with the identified user.

[0060] §3 Example of operation <Example of operation of information management system 100> Next, an example of the operation of the information management system 100 will be described with reference to Fig. 7. Fig. 7 is a sequence diagram showing the operation of the measuring device 1 and the information terminal 5 in the information management system 100.

[0061] First, power is turned on for the measurement device 1. Next, in order to launch the health management application of the information terminal 5, an icon displayed on the display unit 51, for example an icon of "health management app", is touched.

[0062] When the icon of the health management app is touched, the information terminal 5 starts the health management application (step S11). When the health management application of the information terminal 5 is launched, a connection request signal is transmitted from the information terminal 5 to the measurement device 1, and communication of the measurement device 1 is switched to one-to-one connection communication with the information terminal 5, thereby establishing a BLE connection between the information terminal 5 and the measurement device 1 (step S12).

[0063] Next, the measuring device 1 starts measuring the measurement data (step S13). The measurement of the measurement data is started, for example, by the user operating the measuring device 1 to start measurement. Specifically, if the measuring device 1 is a thermometer 1a, the user holds the thermometer 1a under his arm. Next, the measuring device 1 transmits a measurement start notification signal to the information terminal 5 to notify that the measurement of the measurement data has started (step S14).

[0064] Next, the information terminal 5 that has received the notification of the start of measurement captures an image of the user with the imaging module 57 of the information terminal 5 (step S15). For example, if the information terminal 5 is a smartphone, the image of the user is captured by the in-camera. As described above, the user touches an icon on the display unit 51 of the information terminal 5 to launch a health management application. Therefore, if the information terminal 5 is a smartphone, the user is looking at the screen of the smartphone while the measurement data is being measured after the launch of the health management application. Therefore, it is possible to capture an image of the user's face with the in-camera of the smartphone. Note that, in order to keep the state of the user looking at the smartphone screen, an image such as "Measuring data. Please wait a moment" may be displayed on the smartphone screen.

[0065] Furthermore, when the person being measured is, for example, a child and the parent is accompanying the child to measure the measurement data, the parent's smartphone may be given to the child to measure the measurement data after the health management application is launched. This allows the smartphone's front camera to capture an image of the child's face. The measured data of the child can be stored in, for example, measurement data tables 56b and 56c (see FIG. 6) of the parent's smartphone. In this case, in order to keep the child looking at the smartphone screen, for example, an animation for children may be displayed on the smartphone screen.

[0066] Next, the information terminal 5 identifies the subject from the captured image of the user (step S16). The information terminal 5, for example, refers to the face images of the users registered in the information terminal 5 and determines whether the captured user is a registered user by face authentication.

[0067] Next, when the measurement started in step S13 is completed (step S17), the measurement device 1 transmits the measured data to the information terminal 5 (step S18).

[0068] Next, information terminal 5 displays the measurement result on display unit 51 based on the measurement data received from measuring device 1 (step S19). Information terminal 5 displays the measurement result on display unit 51, regarding the measurement data received from measuring device 1 as the measurement data of the user identified in step S16.

[0069] Before the measurement result is displayed on the display unit 51, it may be confirmed whether or not there is an error in the person being measured identified from the image (step S16). For example, if the person being measured identified from the image is user B (child 1) described in FIG. 6, a confirmation pop-up such as "The person just before was child 1, right?" may be displayed on the display unit 51. If the user responds with "No (that's wrong)", for example, a list of other registered users (e.g. user A (parent), user C (child 2)) may be displayed on the display unit 51 to allow the user to select the correct person being measured.

[0070] Next, the information terminal 5 stores the measurement data in a measurement data table of the data storage unit 56 in association with the person to be measured (step S20). The information terminal 5 may transmit the users and their measurement data stored in the measurement data table to the cloud server 90.

[0071] In the above-described operation example, the measurement of the measurement data in the measurement device 1 is started based on the user's operation to start measurement on the measurement device 1, but this is not limited to this. For example, the measurement may be started when a "measurement start button" displayed on the display unit 51 in the health management application of the information terminal 5 is touched and an instruction to start measurement is sent from the information terminal 5 to the measurement device 1. In this case, the notification of the start of measurement from the measurement device 1 to the information terminal 5 in step S14 above may be omitted.

[0072] <Example of operation of information terminal 5> Next, an example of the operation of the information terminal 5 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the operation when an application is started up in the information terminal 5. This operation process starts when the health management application of the information terminal 5 is launched.

[0073] First, the information terminal 5 establishes a BLE connection with the measurement device 1 (step S31). When the information terminal 5 receives an advertising signal from the measurement device 1, it transmits a connection request to the measurement device 1. When the measurement device 1 receives the connection request, communication of the measurement device 1 is switched to one-to-one connection communication with the information terminal 5, and the information terminal 5 and the measurement device 1 are connected by BLE.

[0074] Next, the information terminal 5 determines whether or not data measurement has started in the measuring device 1 (step S32). For example, if the information terminal 5 has transmitted an instruction to start data measurement to the measuring device 1, the information terminal 5 can determine by itself whether or not data measurement has started. If the information terminal 5 has not transmitted an instruction to start data measurement to the measuring device 1, the information terminal 5 determines whether or not data measurement has started by receiving a notification of the start of measurement from the measuring device 1.

[0075] In step S32, if the measurement by the measuring device 1 has not started (step S32: No), the information terminal 5 repeats the process of step S32. In step S32, if the measurement by the measuring device 1 has started (step S32: Yes), the information terminal 5 captures an image of the user with the imaging module 57 (step S33). For example, if the information terminal 5 is a smartphone, capturing an image of the user using the front camera is the same as the process described in step S15 of FIG. 7 above.

[0076] Next, the information terminal 5 identifies the person to be measured from the image of the user acquired in step S33 (step S34). The person to be measured is identified by referencing the facial images of the users registered in the data storage unit 56 and performing face authentication to determine whether the captured user matches a registered user.

[0077] Next, the information terminal 5 determines whether or not the measurement data of the subject measured by the measurement device 1 has been received from the measurement device 1 (step S35).

[0078] If no measurement data has been received in step S35 (step S35: No), the information terminal 5 repeats the process of step S35. If measurement data has been received in step S35 (step S35: Yes), the information terminal 5 displays the measurement results of the measuring device 1 on the display unit 51 based on the received measurement data (step S36). The information terminal 5 displays the received measurement data on the display unit 51 as the measurement data of the user identified in step S34. For example, the information terminal 5 displays the measurement data with an image of the user's face, name, etc. attached.

[0079] Next, the information terminal 5 associates the measurement data received from the measurement device 1 with the subject, and stores the data in a measurement data table in the data storage unit 56 (step S37). This subject is the user identified in step S34 as matching the subject.

[0080] As described above, in a state where the information terminal 5 is connected to the measuring device 1 by BLE connection by starting the health management application, the information terminal 5 identifies the subject from among the multiple users registered in the information terminal 5 based on the image obtained by capturing an image of the observer on the display unit 51 when the measuring device 1 measures data. Then, the information terminal 5 associates the identified subject with the measurement data received from the measuring device 1 and stores them in the data storage unit 56. According to this configuration, when the measuring device 1 measures data, it is possible to capture an image of the person performing the measurement by capturing an image of the observer on the display unit 51 of the information terminal 5 that is communicating with the measuring device 1 on BLE. In addition, since the subject is identified from among the user images registered in advance based on the image of the observer on the display unit 51, the subject can be identified accurately. This makes it possible to simply and reliably associate the measurement data received from the measuring device 1 with the correct subject. In addition, even when multiple users of the measuring device 1 each have different information terminals 5, it is possible to prevent the measurement data received from the measuring device 1 from being transmitted to and stored in the information terminal 5 of a user other than the subject.

[0081] Furthermore, the information terminal 5 displays a content image on the display unit 51 of the information terminal 5 while the measuring device 1 is measuring the biological information, etc. This configuration makes it possible to direct the subject's gaze toward the display unit 51 of the information terminal 5 on which the content image is displayed while the biological information, etc. is being measured. This allows the imaging module 57 of the information terminal 5 to accurately capture an image of the subject. Therefore, the measurement data can be easily and reliably associated with the correct subject.

[0082] Furthermore, the information terminal 5 can capture an image of the person being measured, whose data is being measured, using the imaging module 57 (for example, an in-camera) when the biological information or the like is measured by the measuring device 1, even if the user does not perform an imaging operation. Therefore, an image of the person being measured can be automatically captured during measurement by the measuring device 1, and the person being measured can be identified based on the automatically captured image. Therefore, the measurement data and the person being measured can be easily and reliably associated with each other.

[0083] <Modification of the operation of the information terminal 5> Next, a modified example of the operation of the information terminal 5 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing a modified example of the operation when an application is started on the information terminal 5. This operation starts when the health management application on the information terminal 5 is launched, similar to the process in Fig. 8.

[0084] As shown in Fig. 9, in this modified example, each process from step S31 to step S36 is the same as each process from step S31 to step S36 in the operation process shown in Fig. 8. Therefore, a description of the processes in these steps will be omitted.

[0085] Next, the information terminal 5 inquires of the user as to whether or not the person being measured identified in step S34 is correct, i.e., whether or not, for example, the face image or name of the user displayed on the display unit 51 in step S36 matches the person being measured, and accepts the answer from the user (step S337a).

[0086] Next, the information terminal 5 judges whether or not a response indicating that the inquiry in step S37a is correct has been received from the user (step S37b). If a response indicating that the inquiry is correct has been received from the user (step S37b: Yes), the information terminal 5 associates the measurement data received from the measurement device 1 with the subject and stores the measurement data in the measurement data table of the data storage unit 56 (step S37c).

[0087] On the other hand, if a response indicating that the answer is correct is not received from the user in step S37b (step S37b: No), the information terminal 5 receives a selection of the correct person to be measured from the user (step S37d). For example, the information terminal 5 may display facial images of registered users on the display unit 51 and receive a selection from among them. If the person to be measured is a user who is not registered, the information terminal 5 may receive a registration operation to newly register the user. Then, after receiving a selection of the correct person to be measured from the user, the information terminal 5 stores the measurement data in the measurement data table in association with the person to be measured (step S37c).

[0088] In this manner, the information terminal 5 of the modified example is configured to inquire of the user as to whether or not the person to be measured identified by the information terminal 5 based on the captured image is the correct person to be measured, and if the person is not correct, the user can set it correctly. This makes it possible to more accurately and reliably associate the measurement data with the person to be measured.

[0089] § 4 Variations Although the embodiment of the present invention has been described above in detail, the above description is merely an example of the present invention in every respect. Various improvements and modifications can be made without departing from the scope of the present invention. For example, the following modifications are possible. In the following, the same reference numerals are used for the same components as in the above embodiment, and the description of the same points as in the above embodiment will be omitted as appropriate. The following modifications can be combined as appropriate.

[0090] In the above embodiment, the case where the information terminal 5 performs short-distance wireless communication with the measuring device 1 has been described, but the present invention is not limited to this. For example, the information terminal 5 may be connected to the measuring device 1 via a communication line and perform wired communication with the measuring device 1.

[0091] In the above embodiment, for example, when the information terminal 5 is a smartphone, the case where the image of the user is captured by the in-camera has been described, but the present invention is not limited to this. For example, the image of the user may be captured by the out-camera of the smartphone. In this case, for example, the owner of the smartphone is user A (parent), the subject of the biological information measurement is user A's child 1 (user B) or child 2 (user C), and the parent may capture the child's image by the out-camera.

[0092] §5 Program The control method of the information terminal 5 described in the above embodiment can be realized by executing a control program prepared in advance on a computer. The control program is recorded in a computer-readable storage medium and executed by being read from the storage medium. The control program may be provided in a form stored in a non-transient storage medium such as a flash memory, or may be provided via a network such as the Internet. The computer that executes the control program may be included in the information terminal 5, or may be included in an electronic device such as a smartphone, tablet terminal, or personal computer that can communicate with the information terminal 5, or may be included in a server device that can communicate with the information terminal 5 and the electronic device. [Explanation of symbols]

[0093] 1. Measuring equipment 1a Thermometer 5. Information terminal 11,22,51 Display section 12,52 Operation unit 13 Measuring part 14 Wireless Communication Section 16,55 RAM 17,56 Data storage section 18,58 Controller 21 Temperature sensing part 23 Communication button 24 Power button 53 1st Radio Communication Division 54 Second Radio Communication Division 56a~56c Measurement data table 57 Imaging module 90 Cloud Server 100 Information Management System

Claims

1. A communication unit capable of communicating with a biological information measuring device; A storage unit capable of storing measurement data obtained by the measuring device; An imaging unit capable of imaging; a control unit that identifies a subject based on an image obtained by the imaging during measurement by the measurement device, and causes the subject and the measurement data received from the measurement device to be stored in the storage unit in association with each other; An information terminal comprising:

2. 2. The information terminal according to claim 1, The communication unit performs short-range wireless communication with the measurement device. Information terminal.

3. 2. The information terminal according to claim 1, the control unit identifies the subject from among a plurality of users registered in the information terminal based on the image. Information terminal.

4. 2. The information terminal according to claim 1, The control unit identifies the subject based on the image obtained by the imaging during the measurement by the measurement device. Information terminal.

5. 5. An information terminal according to claim 4, a display unit that displays a content image during measurement by the measuring device; Information terminal.

6. 2. The information terminal according to claim 1, The control unit causes the imaging unit to perform the imaging during measurement by the measurement device without an imaging operation from a user. Information terminal.

7. 7. An information terminal according to claim 1, A display unit capable of displaying an image is provided, The imaging unit is provided so as to be able to image an observer of the display unit. Information terminal.

8. A method for controlling an information terminal including a communication unit capable of communicating with a measurement device for measuring biological information, a storage unit capable of storing measurement data obtained by the measurement device, and an imaging unit capable of capturing images, comprising: identifying the subject based on the image obtained by the imaging during measurement by the measuring device; storing the measurement data received from the measurement device in association with the person to be measured in the storage unit; Control methods.

9. A control program for an information terminal including a communication unit capable of communicating with a measurement device for measuring biological information, a storage unit capable of storing measurement data obtained by the measurement device, and an imaging unit capable of capturing an image, A processor of the information terminal identifying the subject based on the image obtained by the imaging during measurement by the measuring device; storing the measurement data received from the measurement device in association with the person to be measured in the storage unit; A control program for executing processing.

Citation Information

Patent Citations

  • Information processing unit, information process system, information processing method, and information processing program

    JP2015219726A

  • Biometric information processing device, biometric information processing method, and program

    JP2018094334A

  • Information processing device, management device, measurement unit, management system, and program

    JP2019076659A

  • Robot, robot control method, and program

    JP2019217081A