Medication support device and medication support method

Abstract

To perform medication support with a simple configuration.SOLUTION: A registration unit 111 registers a first image PC1 obtained by picking up an image of a place where a user U takes medicine by using an imaging apparatus 104. A starting unit 112 starts the imaging apparatus 104 at a specified time when the user U should take medicine. An output unit 113 outputs determination information indicating whether or not the user U has taken medicine on the basis of the first image PC1 and a second image PC2 output from the imaging apparatus 104 after being started by the starting unit 112.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a medication support device and a medication support method.

Background Art

[0002] Conventionally, technologies for medication support have been developed. For example, the drug use management system disclosed in Patent Document 1 below includes a reading unit that reads an ID from an ID tag provided corresponding to at least a drug stored in a storage unit, identification information based on the ID, information indicating the drug, information for identifying a user U who uses the drug, and information indicating the time when the drug should be used, and a storage unit that stores drug use management information in which these are associated with each other, and a determination unit that determines the usage status of the drug based on the result read by the reading unit and the drug use management information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As technologies for medication support, in addition to the method of attaching an ID tag or the like to a drug as in Patent Document 1 described above, various methods such as using a robot to dispense drugs to user U and using smart glasses have been proposed. However, all of them require the introduction of dedicated equipment, are costly, and are difficult to spread.

[0005] An object of the present invention is to perform medication support with a simple configuration.

Means for Solving the Problems

[0006] A medication assistance device according to an aspect of the present invention includes a registration unit that registers a first image obtained by imaging a location where a user takes medicine using an imaging device, an activation unit that activates the imaging device at a designated time when the user should take the medicine, and an output unit that outputs determination information indicating whether the user has taken the medicine based on a second image output from the imaging device after activation by the activation unit and the first image.

[0007] A medication assistance method according to an aspect of the present invention registers a first image obtained by imaging a location where a user takes medicine using an imaging device, activates the imaging device at a designated time when the user should take the medicine, and outputs determination information indicating whether the user has taken the medicine based on a second image output from the imaging device after activation and the first image.

Advantages of the Invention

[0008] According to an aspect of the present invention, medication assistance can be performed with a simple configuration.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0010] A. Embodiment FIG. 1 is a block diagram showing the configuration of a medication assistance device 10 according to an embodiment. The medication assistance device 10 assists a user U in correctly taking medicine. For the user U to correctly take medicine means, for example, not forgetting to take the medicine or taking the medicine repeatedly. The medication assistance device 10 is an information processing terminal such as a smartphone, a tablet terminal, or a personal computer. In this embodiment, it is assumed that the medication assistance device 10 is a smartphone. The smartphone used as the medication assistance device 10 may be a smartphone that the user U uses daily, or a smartphone that is not used daily (not necessary for the user U to carry) due to a model change or the like.

[0011] The medication assistance device 10 includes a display device 101, an input device 102, a communication device 103, an imaging device 104, a storage device 105, a processing device 106, and a bus 120 that interconnects these devices.

[0012] The display device 101 is a display device (for example, various display panels such as a liquid crystal display panel or an organic EL display panel) that displays information to the outside. The input device 102 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, or a sensor) that receives an input from the outside. Note that the display device 101 and the input device 102 may have an integrated configuration (for example, a touch panel). The communication device 103 includes an interface connectable to a network and communicates with other devices connected to the network using wireless communication or wired communication.

[0013] The imaging device 104 captures an object and outputs image data corresponding to the captured image. The imaging device 104 has, for example, an imaging optical system and an imaging element. The imaging optical system is an optical system including at least one imaging lens. The imaging element is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor.

[0014] The storage device 105 is a recording medium readable by the processing device 106. The storage device 105 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). The storage device 105 stores a program PG1. The program PG1 is a program for operating the medication support device 10.

[0015] The processing device 106 includes one or more CPUs (Central Processing Unit). The one or more CPUs are an example of one or more processors. Each of the processor and the CPU is an example of a computer.

[0016] The processing device 106 reads the program PG1 from the storage device 105. By executing the program PG1, the processing device 106 functions as a registration unit 111, a startup unit 112, and an output unit 113. In the present embodiment, the registration unit 111, the startup unit 112, and the output unit 113 are realized as functions of a medication support application installed in a smartphone.

[0017] The registration unit 111, the startup unit 112, and the output unit 113 may be configured by circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array).

[0018] The registration unit 111 registers the first image PC1 obtained by imaging the location where the user U takes medicine (hereinafter referred to as the "medicine-taking location") using the imaging device 104. The medicine-taking location is, for example, the dining table, bedroom, kitchen in the user U's home, or the desk at the user U's workplace. The registration unit 111 obtains the first image PC1, for example, by asking the user U to image the image of the medicine-taking location with the imaging device 104 at the start of using the medicine-taking support application. The registration unit 111 registers the acquired first image PC1. Registration means, for example, storing in the storage device 105 in a distinguishable form from other images by attaching a flag to the image data indicating the first image PC1.

[0019] A plurality of the first images PC1 may be registered. For example, if the medicine-taking locations after breakfast and dinner are at the dining table at home and the medicine-taking location after lunch is at the desk at work, the image of the dining table at home and the image of the desk at work may be registered as the first image PC1. Also, the first image PC1 may be a video. For example, when the medicine-taking location is the dining table at home, an image captured by moving the medicine-taking support device 10 so that the dining table and its surroundings are captured may be registered as the first image PC1.

[0020] At the start of using the medicine-taking support application, the user U may be instructed to place the holder holding the medicine-taking support device 10 at the medicine-taking location and to hold the medicine-taking support device 10 in the holder at least at the timing of taking the medicine. By holding the medicine-taking support device 10 in the pre-installed holder, the viewing angle of the image captured by the imaging device 104 can be stabilized within a certain range. Also, by holding the medicine-taking support device 10 in the holder, it becomes easier to image the entire body of the user U compared to, for example, placing the medicine-taking support device 10 on a table, etc., and the accuracy of the determination by the output unit 113 described later is improved. The user U may also be instructed to take the first image PC1 with the medicine-taking support device 10 held in the holder.

[0021] The activation unit 112 activates the imaging device 104 at the designated time when the user U should take the medicine. For example, when starting to use the medicine-taking support application, the activation unit 112 asks the user U to input the time when the user U plans to take the medicine, and stores the time as the designated time. When the user U takes medicine multiple times a day, etc., multiple designated times may be specified. Activating the imaging device 104 at the designated time may mean, for example, outputting a control signal to activate the imaging device 104 a first predetermined time (e.g., the time required to activate the imaging device 104) before the designated time so that imaging by the imaging device 104 starts at the designated time.

[0022] The imaging device 104 activated by the activation unit 112 outputs the captured image (the second image PC2 described later) to the processing device 106. After being activated by the activation unit 112, the imaging device 104 continuously captures images until its operation is stopped. The images may be a video or still images captured multiple times at predetermined intervals. Also, the activation unit 112 stops the operation of the imaging device 104 after a second predetermined time has elapsed from the designated time. The second predetermined time may be, for example, about several minutes to several tens of minutes. The designated time is not limited to a pinpoint time and may be specified as a time zone, for example, "between 7:00 am and 7:30 am". When the designated time is specified as a time zone, the activation unit 112 may activate the imaging device 104 at the start of the time zone and stop the operation of the imaging device 104 at the end of the time zone.

[0023] The output unit 113 outputs determination information indicating whether the user U has taken the medicine based on the second image PC2 output from the imaging device 104 and the first image PC1 after the activation by the activation unit 112. The determination information includes two types: first determination information indicating that the user U has taken the medicine and second determination information indicating that the user U has not taken the medicine. The output unit 113 determines whether the user U has taken the medicine based on the second image PC2 and the first image PC1, and outputs either the first determination information or the second determination information based on the determination result.

[0024] In this embodiment, when both of the following Condition 1 and Condition 2 are satisfied, the output unit 113 determines that the user U has taken the medicine and outputs first determination information. Also, when at least one of the following Condition 1 and Condition 2 is not satisfied, the output unit 113 determines that the user U has not taken the medicine and outputs second determination information.

[0025] [Condition 1] The location shown in the second image PC2 coincides with the location shown in the first image PC1. [Condition 2] The action of the user U shown in the second image PC2 is in a predetermined state (a state presumed to be taking medicine), or the user U shown in the second image PC2 holds a predetermined object (an object related to taking medicine).

[0026] Condition 1 is a condition for determining whether the position of the user U is at the medicine-taking location. The output unit 113 determines whether the location shown in the second image PC2 coincides with the location shown in the first image PC1, for example, based on the degree of coincidence between the object shown in the first image PC1 and the object shown in the second image PC2. When the location shown in the second image PC2 does not coincide with the location shown in the first image PC1, the output unit 113 outputs determination information (second determination information) indicating that the user U has not taken the medicine. This is because when the user U is not at the medicine-taking location at the specified time, it is highly likely that the user has forgotten to take the medicine or is in a situation where the medicine cannot be taken. When Condition 1 is not satisfied in the second image PC2 captured immediately after the specified time, the output unit 113 may cause an alert such as "It's time for medicine" to be displayed on the display device 101 as the second determination information.

[0027] Condition 2 is a condition for determining whether user U is actually taking medicine. The output unit 113 determines whether user U has taken medicine based on at least either the action of user U shown in the second image PC2 or the type of object held by user U shown in the second image PC2. More specifically, the output unit 113 determines whether the action of user U shown in the second image PC2 is a medicine-taking action, for example, by estimating the action using a machine learning model. The output unit 113 detects, for example, the feature points (head, eyes, mouth, neck, hands, shoulders, elbows, etc.) of the body of user U shown in the second image PC2, and estimates the posture of user U at each time point based on these distances. Then, the output unit 113 determines whether user U is performing a medicine-taking action based on the transition of the posture of user U at each time point. The medicine-taking action includes, for example, the action of putting a cup to the mouth (after containing liquid in the mouth), then removing the cup from the mouth and swallowing the liquid in the mouth, the action of taking out a tablet from a PTP (press through pack) packaging material and putting it in the mouth, or the action of opening a bag-shaped packaging material and turning it upward to contain the powder in the packaging material in the mouth, etc.

[0028] In addition, the output unit 113 determines whether user U shown in the second image PC2 holds an object related to medicine-taking, for example, by estimating the object using a machine learning model. Objects related to medicine-taking include medicine (tablets, capsules, syrups, etc.), medicine packaging materials (PTP packaging materials, bag-shaped packaging materials, bottles, etc.), or drinking containers (cups, mugs, tumblers, etc.). Note that "holding" does not necessarily mean that user U is holding it in the hand, and it may be, for example, placed in front of user U's eyes, etc.

[0029] When both the above Condition 1 and Condition 2 are satisfied, that is, when the location shown in the second image PC2 coincides with the location shown in the first image PC1, and the action of user U shown in the second image PC2 is a medicine-taking action, or when user U shown in the second image PC2 holds an object related to medicine-taking, the output unit 113 determines that user U has taken medicine.

[0030] When it is determined that the user U has taken the medicine, the output unit 113 outputs, as determination information, first determination information indicating that the user U has taken the medicine. The output mode of the first determination information is arbitrary. For example, forms such as displaying text such as "Medicine intake detected" on the display device 101 of the medicine intake support device 10, or displaying an image of a stamp being pressed on a calendar, etc. can be cited as an example.

[0031] Also, when at least one of the above conditions 1 and 2 does not hold within the third predetermined time from the specified time, the output unit 113 determines that the user U has not taken the medicine and outputs second determination information. The third predetermined time is an example of a predetermined time. The third predetermined time may be the same as, for example, the above-described second predetermined time (the time for stopping the operation of the imaging device 104).

[0032] The output mode of the second determination information is arbitrary. For example, forms such as displaying text prompting medicine intake such as "It's time for medicine" on the display device 101 of the medicine intake support device 10, or displaying an image of an illustration or photo of the medicine, etc. can be cited as an example. That is, when the user U does not take the medicine within the third predetermined time from the specified time, the output unit 113 may output information prompting the user U to take the medicine as determination information.

[0033] Hereinafter, the functions of the above-described medicine intake support device 10 will be described with reference to the drawings. FIG. 2 is a schematic diagram showing an example of an initial setting screen G1 of a medicine intake support application (denoted as "Medicine Intake Support App" in the figure). The initial setting screen G1 is displayed, for example, at the start of using the medicine intake support application. The initial setting screen G1 includes a time setting unit S1 and an image registration unit S2.

[0034] The time setting unit S1 receives the setting of the specified time when the user U should take the medicine. In the figure, for the sake of easy understanding by the user U, the specified time is denoted as the "medicine-taking time". In the example of FIG. 2, the user U designates the time using a pull-down menu. The user U may take the medicine multiple times a day. Therefore, when the time addition button B1 is pressed, a pull-down menu for setting the second and subsequent specified times (medicine-taking times) is displayed. When the OK button B2 is pressed, the setting of the specified time is completed.

[0035] The image registration unit S2 receives the registration of the first image PC1 in which the medicine-taking location is captured. In the example of FIG. 2, the image registration unit S2 includes a start button B3 for activating the imaging device 104 (camera). When the user U presses the start button B3, the imaging device 104 is activated and the imaging of the first image PC1 is started. When the imaging of a range sufficient to identify the medicine-taking location is completed, the registration unit 111 displays a message such as "Imaging is completed" and stops the operation of the imaging device 104. Also, the registration unit 111 stores the captured image in the storage device 105 as the first image PC1.

[0036] The first image PC1 is not limited to being captured by the imaging device 104 when the initial setting screen G1 is displayed. For example, an image stored in the camera roll of the storage device 105 may be designated as the first image PC1. Also, when a plurality of specified times are set, the first image PC1 may be registered for each specified time.

[0037] FIG. 3 is a schematic diagram showing an example of the first image PC1. In the first image PC1 shown in FIG. 3, objects such as a table OB1, chairs OB2, OB3, a TV OB4, a TV stand OB5, lighting OB6, and a window OB7 are captured. When capturing the first image PC1, the entire room where the medicine is taken can be included in the first image PC1 by setting the imaging range of the imaging device 104 to a wide angle or by instructing the user U to change the imaging direction.

[0038] FIG. 4 is a schematic diagram showing an example of the second image PC2. When the designated time set on the initial setting screen G1 arrives, the imaging device 104 is activated by the activation unit 112, and the imaging of the second image PC2 is started. In the second image PC2 shown in FIG. 4, a table OB1, a chair OB2, a TV OB4, a TV stand OB5, a lighting OB6, etc. are shown. Since the object shown in the first image PC1 and the object shown in the second image PC2 match, the output unit 113 determines that the location shown in the second image PC2 and the location shown in the first image PC1 match (the above condition 1 is satisfied).

[0039] In addition, the user U is shown in the second image PC2. The user U is holding a tablet N1 in his hand. Also, a cup N2 and a medicine bag N3 are placed on the table OB1. Therefore, the output unit 113 determines that the user U shown in the second image PC2 is holding an object related to taking medicine (the above condition 2 is satisfied).

[0040] FIG. 5 is a schematic diagram showing an example of the first determination information. When both condition 1 and condition 2 are satisfied as in the second image PC2 shown in FIG. 4, the output unit 113 outputs the first determination information indicating that the user U has taken the medicine. In the example of FIG. 5, as the first determination information, a message M1 saying "The first dose of medicine has been detected today. The second dose is at 19:00" is displayed. By looking at the first determination information, the user U can confirm that he has taken the medicine as scheduled. Also, the user U can confirm the scheduled time for the next dose of medicine.

[0041] FIG. 6 is a schematic diagram showing an example of the second determination information. When at least one of condition 1 or condition 2 is not satisfied, the output unit 113 outputs the second determination information indicating that the user U has not taken the medicine. In the example of FIG. 6, as the second determination information, a message M2 saying "The time for taking medicine has passed. Please check" is displayed. By looking at the second determination information, the user U can notice that he has forgotten to take the medicine.

[0042] The first determination information and the second determination information may be stored in the storage device 105 of the medication support device 10. For example, when the medication support application is launched, symbols indicating the medication status (a circle if the medication has been taken, a cross if not taken, etc.) or icons may be displayed on the calendar. In this case, the user U can retrospectively check their own medication status. For example, even if the user U forgets whether they have taken their morning medication today, they can use the medication support application to check whether the medication has been taken.

[0043] Figure 7 is a flowchart showing the operation of the processing device 106 of the medication support device 10. Steps S100 and S102 are the processes at the start of using the medication support application. The processing device 106 functions as a registration unit 111, acquires the first image PC1 captured using the imaging device 104, and registers the first image PC1 (step S100). Also, the processing device 106 receives the setting of the specified time (step S102).

[0044] The processing device 106 waits until the specified time (step S104: NO). When the specified time arrives (step S104: YES), the processing device 106 functions as an activation unit 112 and activates the imaging device 104 (step S106). The processing device 106 acquires the second image PC2 captured by the imaging device 104 (step S108).

[0045] The processing device 106 functions as an output unit 113 and determines whether the location shown in the second image PC2 is the same as the location shown in the first image PC1 (step S110, condition 1). If the location shown in the second image PC2 is not the same as the location shown in the first image PC1 (step S110: NO), the processing device 106 functions as an output unit 113 and outputs the second determination information indicating that the user U has not taken the medication (step S116). Thereafter, the processing device 106 returns the process to step S104 and repeats the subsequent processes.

[0046] When the location shown in the second image PC2 is the same as the location shown in the first image PC1 (step S110: YES), the processing device 106 functions as the output unit 113 and determines whether the user U shown in the second image PC2 is performing an operation of taking medicine (described as "medicine-taking operation" in the figure) or is holding an object related to medicine-taking (described as "medicine-taking object" in the figure) (step S112, condition 2). When the user U shown in the second image PC2 is performing an operation of taking medicine or is holding an object related to medicine-taking (step S112: YES), the processing device 106 functions as the output unit 113 and outputs first determination information indicating that the user U is taking medicine (step S118). Thereafter, the processing device 106 returns the process to step S104 and repeats the subsequent processes.

[0047] Also, in step S112, when the user U shown in the second image PC2 is not performing an operation of taking medicine and is not holding an object related to medicine-taking (step S112: NO), the processing device 106 returns the process to step S108 until the third predetermined time has elapsed since the imaging device 104 was activated (step S114: NO). When the third predetermined time has elapsed since the imaging device 104 was activated (step S114: YES), the processing device 106 functions as the output unit 113 and outputs second determination information indicating that the user U is not taking medicine (step S116). Thereafter, the processing device 106 returns the process to step S104 and repeats the subsequent processes.

[0048] As described above, the medicine-taking support device 10 according to the embodiment outputs determination information indicating whether the user U has taken medicine based on the second image PC2 output from the imaging device 104 after activation by the activation unit 112 and the pre-registered first image PC1. Therefore, compared with determining the presence or absence of the user U's medicine-taking based only on the second image PC2, the determination accuracy of the presence or absence of medicine-taking can be improved. Also, the medicine-taking support device 10 activates the imaging device 104 at a specified time when the user U should take medicine. Therefore, compared with the case where the imaging device 104 is always activated, the power consumption of the imaging device 104 can be reduced.

[0049] When the location shown in the second image PC2 does not match the location shown in the first image PC1, the medication support device 10 outputs determination information indicating that the user U has not taken the medicine. The first image PC1 is an image of the medication location. If the location shown in the second image PC2 captured at the specified time is different from the location shown in the first image PC1, it can be inferred that the user U is not acting with the intention of taking the medicine. Therefore, it is possible to quickly determine whether the user U has taken the medicine.

[0050] In addition, the medication support device 10 determines whether the user U has taken the medicine based on at least either the action of the user U shown in the second image PC2 or the type of the object held by the user U shown in the second image PC2. By identifying the action of the user U or the object held by the user U in the second image PC2, it is possible to more reliably determine whether the user U has taken the medicine.

[0051] In addition, when the location shown in the second image PC2 matches the location shown in the first image PC1, and the action of the user shown in the second image PC2 is an action of taking the medicine, or when the user U shown in the second image PC2 holds an object related to taking the medicine, it is determined that the user U has taken the medicine. Therefore, it is possible to more accurately determine whether the user U has taken the medicine.

[0052] In addition, when the user U does not take the medicine within the third predetermined time from the specified time, the medication support device 10 outputs information prompting the user U to take the medicine as the second determination information. Therefore, the user U can notice early that they have forgotten to take the medicine and take the medicine.

[0053] B: Modification Example The modification modes in the above-described embodiment are shown below. Two or more modes arbitrarily selected from the following modification modes may be appropriately combined within a non-conflicting range.

[0054] B1: First Modification Example In the above-described embodiment, the determination information was output to the medication support device 10. However, this is not the only case, and the determination information may be output to other terminals other than the medication support device 10. For example, it may be connected to a network using the communication device 103, and the determination information may be transmitted to other terminals via the network. The determination information may be transmitted as a message (including e-mail) of a message application. The other terminal may be, for example, a terminal other than the medication support device 10 managed by the user U, or a terminal held by a person related to the user U (such as a family member, caregiver, nurse, or attending physician).

[0055] According to the first modification example, the determination information is output to other terminals other than the medication support device 10. Therefore, a person related to the user U who is in a place away from the user U (medication support device 10) can grasp the medication status of the user U, improving convenience.

[0056] B2: Second Modification Example In the above-described embodiment, the imaging device 104 was provided in the medication support device 10. However, this is not the only case, and the imaging device 104 may be a device separate from the medication support device 10. For example, a small camera may be used as the imaging device 104 and installed at the medication location of the user U, and connected to the medication support device 10 (such as the user U's smartphone) using short-range wireless communication or the like.

[0057] Also, for example, the imaging device 104 may be the camera of the smartphone used by the user U, and the medication support device 10 may be a server connected to the smartphone via a network. The server has the functions of the registration unit 111, the activation unit 112, and the output unit 113. The smartphone transmits the first image PC1 and the second image PC2 to the server. The server transmits a control signal for causing the smartphone to output the determination information to the smartphone. The smartphone outputs the determination information according to the control signal. The transmission destination of the determination information is not limited to the smartphone of the user U, and may be a terminal held by the above-described related person.

[0058] According to the second modification example, since the imaging device 104 and the medication support device 10 are separate devices, the degree of freedom in device configuration can be improved. Further, for example, if a small camera is permanently installed at the medication location as the imaging device 104, the medication location can be surely imaged at the designated time, and the determination accuracy of the presence or absence of medication by the output unit 113 can be improved.

[0059] C: Others (1) In the above-described embodiments, ROM, RAM, etc. were exemplified as the storage device 105, but the storage device 105 may be a flexible disk, a magneto-optical disk (e.g., compact disk, digital versatile disk, Blu-ray (registered trademark) disk), a smart card, a flash memory device (e.g., card, stick, key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or other suitable storage media.

[0060] (2) In the above-described embodiments, the information, signals, etc. described may be represented using any of various different technologies. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0061] (3) In the above-described embodiments, the input / output information, etc. may be stored in a specific location (e.g., memory), or may be managed using a management table. The input / output information, etc. may be overwritten, updated, or appended. The output information, etc. may be deleted. The input information, etc. may be transmitted to other devices.

[0062] (4) In the above-described embodiments, the determination may be made based on a value represented by 1 bit (0 or 1), a truth value (Boolean: true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0063] (5) In the above-described embodiments, the processing procedures, sequences, flowcharts, etc. exemplified may be reordered as long as there is no contradiction. For example, for the methods described in the present disclosure, the elements of various steps are presented using an exemplary order and are not limited to the specific order presented.

[0064] (6) Each function exemplified in FIG. 1 is realized by any combination of at least one of hardware and software. Also, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using one physically or logically combined device, or may be realized using two or more physically or logically separated devices directly or indirectly (e.g., using wired, wireless, etc.) connected, and these multiple devices. The functional block may be realized by combining software with the above one device or the above multiple devices.

[0065] (7) The programs exemplified in the above-described embodiments should be broadly interpreted to mean instructions, instruction sets, codes, code segments, program codes, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, a hardware description language, or by another name.

[0066] Also, software, instructions, information, etc. may be transmitted and received via a transmission medium. For example, when software is transmitted from a website, server, or other remote source using at least one of wired technologies (coaxial cable, optical fiber cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technologies (infrared, microwave, etc.), at least one of these wired and wireless technologies is included within the definition of the transmission medium.

[0067] (8) In each of the above-described embodiments, the terms "system" and "network" are used interchangeably.

[0068] (9) The information, parameters, etc. described in the present disclosure may be represented using absolute values, relative values from a predetermined value, or another corresponding piece of information.

[0069] (10) In the above-described embodiments, the mobile device includes the case where it is a mobile station (MS: Mobile Station). The mobile station may be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user U agent, mobile client, client, or some other suitable terms. Also, in the present disclosure, terms such as "mobile station", "user U terminal", "user U equipment (UE)", "terminal", etc. may be used interchangeably.

[0070] (11) In the above-described embodiments, the terms "connected" and "coupled", or any variations thereof, mean any direct or indirect connection or coupling between two or more elements, and can include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements can be physical, logical, or a combination thereof. For example, "connected" may be read as "accessed". As used in this disclosure, two elements can be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as, by way of some non-limiting and non-exhaustive examples, electromagnetic energy having wavelengths in the radio frequency region, microwave region, and optical (both visible and invisible) region, etc.

[0071] (12) In the above-described embodiments, the description "based on" does not mean "based only on" unless otherwise specified. In other words, the description "based on" means both "based only on" and "based at least on".

[0072] (13) The terms "determining" and "deciding" as used in this disclosure may encompass a wide variety of operations. "Determining" and "deciding" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up (e.g., searching in a table, database, or another data structure), ascertaining, and considering something as having been "determined" or "decided". Also, "determining" and "deciding" may include considering something as having been "determined" or "decided" after receiving (e.g., receiving information), transmitting (e.g., transmitting information), inputting, outputting, accessing (e.g., accessing data in memory), etc. Further, "determining" and "deciding" may include considering something as having been "determined" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. That is, "determining" and "deciding" may include considering something as having been "determined" or "decided" after performing some operation. Also, "determining (deciding)" may be replaced with "assuming", "expecting", "considering", etc.

[0073] (14) In the above-described embodiments, when the terms "include", "including", and their variants are used, these terms are intended to be inclusive, similar to the term "comprising". Further, the term "or" as used in this disclosure is not intended to be an exclusive disjunction.

[0074] (15) In this disclosure, for example, when articles are added by translation, such as a, an, and the in English, this disclosure may include that the nouns following these articles are in the plural form.

[0075] (16) In the present disclosure, the term "A and B are different" may mean that "A and B are different from each other". In addition, the term may mean that "A and B are each different from C". Terms such as "separate" and "coupled" may be interpreted in the same way as "different".

[0076] (17) Each aspect / embodiment described in the present disclosure may be used alone, in combination, or switched during execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to being explicitly performed, and may be performed implicitly (for example, by not performing the notification of the predetermined information).

Description of Reference Numerals

[0077] 10... Medication support device, 101... Display device, 102... Input device, 103... Communication device, 104... Imaging device, 105... Storage device, 106... Processing device, 111... Registration unit, 112... Activation unit, 113... Output unit, U... User.

Claims

1. A registration unit that registers a first image obtained by imaging the location where the user takes medicine by using an imaging device; An activation unit that activates the imaging device at a specified time when the user should take the medicine; An output unit that outputs determination information indicating whether the user has taken the medicine based on a second image output from the imaging device after activation by the activation unit and the first image; A medicine-taking support device comprising the above.

2. When the location shown in the second image does not match the location shown in the first image, the output unit outputs determination information indicating that the user has not taken the medicine. The medicine-taking support device according to Claim 1.

3. The output unit determines whether the user has taken the medicine based on at least one of the action of the user shown in the second image and the type of object held by the user shown in the second image. The medicine-taking support device according to Claim 1.

4. When the location shown in the second image matches the location shown in the first image, and the action of the user shown in the second image is an action of taking the medicine, or when the user shown in the second image holds an object related to taking the medicine, the output unit determines that the user has taken the medicine. The medicine-taking support device according to Claim 3.

5. When the user does not take the medicine within a predetermined time from the specified time, the output unit outputs information prompting the user to take the medicine as the determination information. The medicine-taking support device according to Claim 1.

6. Register a first image obtained by imaging the location where the user takes medicine by using an imaging device. Activate the imaging device at a specified time when the medicine should be taken. Output determination information indicating whether or not the user has taken the medicine based on a second image output from the imaging device after the start-up and the first image. Medicine-taking support method.

Images