Medicine taking prompt image processing method and device

Abstract

The invention discloses a medication prompt image processing method and device, and relates to the technical field of medical health. A specific embodiment of the method comprises the following steps: acquiring usage and dosage information of a user for a medicine and an original image of the medicine carried on a medicine loading body, and identifying a single medicine graph in the original image; according to the usage and dosage information, planned taking time corresponding to each identified single medicine graph is determined; marking a corresponding single medicine graph in the original image according to the planned taking time to form a medicine taking prompt image of the medicine; and displaying the medication prompt image. According to the embodiment, the medication prompt image for accurately prompting the medicine taking time can be generated based on the usage and dosage information of the user, so that the user is helped to accurately take medicines.

Description

Technical Field

[0001] The present invention relates to the field of medical health technology, and in particular to a method and device for processing medication reminder images. Background Art

[0002] In medical scenarios, people who need to take medicines (hereinafter referred to as users) may not be sure whether they have taken the medicines, which may lead to missing medicines or taking medicines repeatedly, which may affect their health. In related technologies, some medicines will add reminders of the time to take medicines on the packaging, for example, take the first medicine on Monday, take the second medicine on Tuesday... However, since different users often have different usage and dosage of the same medicine, the existing technology cannot provide users with accurate timing for taking medicines. For example, a user's usage and dosage of the medicine in the above example is twice a day, two pills at a time, then the reminder information such as Monday and Tuesday on the medicine packaging cannot help users take medicines accurately. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a medication reminder image processing method and device, which can generate a medication reminder image that accurately prompts the timing of taking medicines based on the user's usage and dosage information, thereby helping users to take medicines accurately.

[0004] To achieve the above objective, according to one aspect of the present invention, a method for processing a medication reminder image is provided.

[0005] The medication reminder image processing method of the embodiment of the present invention includes: obtaining the user's usage and dosage information of the medicine, and the original image of the medicine carried in the medicine body, and identifying the monomer medicine graphics in the original image; determining the planned taking time corresponding to each identified monomer medicine graphic based on the usage and dosage information; marking the corresponding monomer medicine graphic in the original image with the planned taking time to form a medication reminder image of the medicine; and displaying the medication reminder image.

[0006] Optionally, identifying a single drug graphic in an original image includes: performing edge detection on the original image to obtain an edge image of the original image; including the edge of each single drug graphic in the edge image; aligning the edge image with the original image and then superimposing them to identify the single drug graphic.

[0007] Optionally, the planned taking time corresponding to each identified monomer drug graphic is determined based on the usage and dosage information, including: obtaining the user's start time for taking the drug; generating an incremental planned taking time for each monomer drug graphic based on the usage and dosage information and in accordance with a preset monomer drug graphic traversal order; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphics is determined by the usage and dosage information.

[0008] Optionally, marking a corresponding single drug graphic in the original image with the planned administration time includes: marking the planned administration time in a vicinity of the corresponding single drug graphic in the original image.

[0009] Optionally, the original image contains at least one complete medicine body and the same medicine, and the original image is obtained from a preset medicine database or collected and uploaded externally.

[0010] Optionally, the medicine is plate-packed medicine, and the medicine-packing body is a medicine-packing plate.

[0011] To achieve the above objective, according to another aspect of the present invention, a method for processing a medication reminder image is provided.

[0012] The medication reminder image processing method of the embodiment of the present invention is applied to a user terminal; the image processing method includes: receiving the user's usage and dosage information of the medicine, and the original image of the medicine carried on the medicine body; outputting the medication reminder image corresponding to the original image; wherein the medication reminder image is formed by marking the planned taking time for the single medicine graphic in the original image, and the planned taking time is determined based on the usage and dosage information.

[0013] Optionally, the planned taking time is determined according to the following steps: obtaining the user's start time for taking the drug; generating an incremental planned taking time for each monomer drug graph based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

[0014] Optionally, in the medication reminder image, the planned medication time is marked in the vicinity of the corresponding single drug graphic in the original image; and the original image contains at least one complete drug body and the same drug, the drug is a plate-packed drug, and the drug body is a drug board.

[0015] To achieve the above objective, according to another aspect of the present invention, a medication reminder image processing device is provided.

[0016] The medication reminder image processing device provided in the embodiment of the present invention may include: a recognition unit, a marking unit and a display unit.

[0017] Among them, the recognition unit can be used to obtain the user's usage and dosage information of the drug, as well as the original image of the drug carried on the drug body, and identify the individual drug graphics in the original image; the marking unit can be used to determine the planned taking time corresponding to each identified individual drug graphic based on the usage and dosage information; mark the corresponding individual drug graphics in the original image with the planned taking time to form a medication reminder image of the drug; and the display unit can be used to display the medication reminder image.

[0018] Optionally, the recognition unit can be further used to: perform edge detection on the original image to obtain an edge image of the original image; the edge image includes the edges of each monomer drug graphic; and align the edge image with the original image and then superimpose them to identify the monomer drug graphic.

[0019] Optionally, the marking unit can be further used to: obtain the user's start time for taking the drug; generate an incremental planned taking time for each monomer drug graph based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

[0020] Optionally, the marking unit may be further used to mark the planned administration time in a vicinity of the corresponding monomeric drug graphic in the original image.

[0021] Optionally, the original image contains at least one complete medicine body and the same medicine, and the original image is obtained from a preset medicine database or collected and uploaded externally.

[0022] Optionally, the medicine is plate-packed medicine, and the medicine-packing body is a medicine-packing plate.

[0023] To achieve the above objective, according to another aspect of the present invention, a medication reminder image processing device is provided.

[0024] The medication reminder image processing device provided in the embodiment of the present invention is arranged in a user terminal and may include: a receiving unit and an output unit.

[0025] Among them, the receiving unit can be used to receive the user's usage and dosage information of the drug, as well as the original image of the drug carried on the drug body; the output unit can be used to output the medication reminder image corresponding to the original image; wherein, the medication reminder image is formed by marking the planned taking time for the single drug graphic in the original image, and the planned taking time is determined based on the usage and dosage information.

[0026] To achieve the above objective, according to another aspect of the present invention, an electronic device is provided.

[0027] An electronic device of the present invention comprises: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the medication reminder image processing method provided by the present invention.

[0028] To achieve the above objective, according to yet another aspect of the present invention, a computer-readable storage medium is provided.

[0029] A computer-readable storage medium of the present invention stores a computer program, and when the program is executed by a processor, the medication reminder image processing method provided by the present invention is implemented.

[0030] To achieve the above objective, according to yet another aspect of the present invention, a computer program product is provided.

[0031] A computer program product of the present invention includes a computer program, and when the computer program is executed by a processor, the medication reminder image processing method provided by the present invention is implemented.

[0032] According to the technical solution of the present invention, the embodiments of the above invention have the following advantages or beneficial effects:

[0033] When the user needs to provide help for accurate medication, the computing device first obtains the user's usage and dosage information of the drug and the original image of the drug carried on the drug body, and identifies the single drug graphics in the original image; then determines the planned taking time corresponding to each identified single drug graphic based on the usage and dosage information, and marks the corresponding single drug graphic in the original image with the planned taking time, thereby forming a drug medication reminder image; finally, the medication reminder image that can be used as a medication reminder card is displayed to provide the accurate medication timing for the single drug. Through the above steps, the computing device generates a medication reminder image indicating the accurate taking time of each single drug according to the user's specific usage and dosage information of the drug, thereby adaptively guiding the user to accurately take the drug at each medication timing, avoiding the situation where it is impossible to determine whether the drug has been taken at present.

[0034] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0036] Figure 1 1 is a schematic diagram of the main steps of the medication reminder image processing method according to an embodiment of the present invention;

[0037] Figure 2 is a schematic diagram of specific execution steps of the medication reminder image processing method in an embodiment of the present invention;

[0038] Figure 3 is a schematic diagram of a flow chart of a first embodiment of the present invention;

[0039] Figure 4 is the original image of the medicine according to the first embodiment of the present invention;

[0040] Figure 5 yes Figure 4 An image formed by preprocessing;

[0041] Figure 6 yes Figure 5 An image formed by edge extraction;

[0042] Figure 7 is an image of a single drug graphic identified in the first embodiment of the present invention;

[0043] Figure 8 is a drug use reminder image according to the first embodiment of the present invention;

[0044] Fig. 9 It is a schematic diagram of components of a medication reminder image processing device in an embodiment of the present invention;

[0045] Fig.10 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;

[0046] Fig.11 It is a schematic diagram of the structure of an electronic device used to implement the medication reminder image processing method in an embodiment of the present invention. DETAILED DESCRIPTION

[0047] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0048] It should be pointed out that the embodiments of the present invention and the technical features therein may be combined with each other without conflict.

[0049] Figure 1 FIG. 1 is a schematic diagram of the main steps of the medication reminder image processing method in an embodiment of the present invention. Figure 1 As shown, the medication reminder image processing method of the embodiment of the present invention can be executed by a computing device. In actual applications, the application installed on the user terminal can obtain the medication reminder image as a medication reminder card by interacting with the background server. In this scenario (online scenario), the method of the embodiment of the present invention is executed by the background server as a computing device; in another scenario, the application installed on the user terminal can obtain the medication reminder image through local calculation. In this scenario (offline scenario), the method of the embodiment of the present invention is executed by the user terminal as a computing device. The specific execution steps of the method of the embodiment of the present invention are as follows:

[0050] Step S101: Obtain the user's usage and dosage information of the medicine and the original image of the medicine carried in the medicine package, and identify the single medicine graphic in the original image. The above single medicine graphic refers to the graphic of a single medicine in the original image, and the single medicine can be a piece of medicine, a pill of medicine, etc. according to the form of the medicine.

[0051] Step S102: Determine the planned taking time corresponding to each identified single drug graphic based on the usage and dosage information; mark the corresponding single drug graphic in the original image with the planned taking time to form a medication reminder image of the drug; it can be understood that the medication reminder image is marked with the planned taking time of each single drug graphic that matches the above user.

[0052] Step S103: Displaying a medication reminder image. In this step, the medication reminder image formed by image processing is displayed to the user. Since the planned medication time in the medication reminder image matches the user's usage and dosage information, the user can accurately plan medication on time according to the planned medication time of each single drug graphic in the medication reminder image. Whether the user has taken the drug or forgotten to take the drug at any medication opportunity can be determined by comparing the physical drug with the medication reminder image.

[0053] Figure 2 FIG. 1 is a schematic diagram of specific execution steps of the medication reminder image processing method according to an embodiment of the present invention. Figure 2 .

[0054] Step S201: The computing device receives a request to generate a medication reminder card. In this step, the computing device receives an externally initiated request to generate a user reminder card. In an embodiment in which the backend server serves as a computing device, a user may operate an application installed on a user terminal, such as a user operating a mobile application installed on a mobile smart terminal, and use the function of generating a medication reminder card provided by the mobile application to initiate the above request to the backend server. In an embodiment in which the user terminal serves as a computing device, a user may use the function of generating a medication reminder card provided by an application installed on the user terminal to initiate the above request to the user terminal.

[0055] Step S202: The computing device obtains the user's usage and dosage information of the drug and the original image of the drug. The usage and dosage information of the drug includes the user's frequency of taking a certain drug and the single dose. The frequency of taking refers to the number of times the drug is taken within a single medication cycle (such as a day), and the single dose refers to the weight of the drug or the number of drugs taken at a time. For example, the user's usage and dosage information of a certain drug is: twice a day (frequency of taking), one tablet at a time (single dose in quantity), or twice a day (frequency of taking), 10 mg at a time (single dose in weight). If the single dose in the usage and dosage information is in weight form, it can be converted into a quantity form according to the weight of a single tablet of the drug for subsequent processing. Exemplarily, the computing device can obtain the usage and dosage information from the prescription uploaded by the user, or read the structured usage and dosage information from the database.

[0056] The original image of the medicine refers to the original image of the medicine carried in the medicine packing body. The medicine packing body is used to carry a single medicine. Preferably, the medicine is a plate-packed medicine, and the medicine packing body can be a medicine packing board. In practical applications, the original image of the medicine can include at least one complete medicine packing body and the same medicine. The original image can be obtained by the computing device from a preset medicine database, or can be collected and uploaded by the user.

[0057] Step S203: The computing device identifies the monomeric drug graphics in the original image. In one embodiment, the computing device may perform grayscale image conversion, filtering, and edge extraction on the original image to determine the monomeric drug graphics therein; specifically, the computing device may perform edge detection on the original image to obtain an edge image of the original image, wherein the edge image contains the edges of each monomeric drug graphic; thereafter, the edge image is aligned with the original image and superimposed to obtain a monomeric drug graphic containing edge information, so as to realize the recognition of the monomeric drug graphic.

[0058] Step S204: The computing device determines the planned taking time of each monomer drug graphic. In this step, the computing device determines the planned taking time corresponding to each identified monomer drug graphic based on the user's usage and dosage information of the drug. As a preferred solution, the computing device first obtains the user's start time for taking the drug, such as "Monday morning". The planned taking time can be filled in by the user and uploaded to the computing device, or a default time can be used. For example, if the current time is Monday morning, "Monday morning" is set as the default start time. Thereafter, the computing device generates an incremental planned taking time for each monomer drug graphic based on the usage and dosage information and in accordance with the preset monomer drug graphic traversal order. Preferably, the following restrictions can be imposed on the planned taking time to ensure the rationality of the calculation of the planned taking time: the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphics is determined by the usage and dosage information.

[0059] The above monomer drug graph traversal order can be flexibly configured as needed, for example, it can be configured as: from top to bottom for drugs in different rows, and from left to right for drugs in the same row. The above increasing means that the planned taking time according to the monomer drug graph traversal order increases successively (meaning that the time becomes later) or remains unchanged. For example, the following arrangement of planned taking time belongs to the increasing situation (increasing successively): Monday morning, Monday afternoon, Tuesday morning, Tuesday afternoon; the following arrangement of planned taking time belongs to the increasing situation (including increase and unchanged): Monday morning, Monday morning, Monday afternoon, Monday afternoon; the following arrangement of planned taking time does not belong to the increasing situation (there is a decrease from the previous value): Monday morning, Monday afternoon, Monday morning, Wednesday afternoon. Monday, Tuesday, and Wednesday in the above example all belong to the same week. It can be understood that the above planned taking time can be expressed in any applicable form with any granularity of year, month, day, week, hour, minute or second.

[0060] In a specific application, the planned taking time of each monomer drug graphic can be calculated according to the frequency of taking and the single dose in the usage and dosage information, that is, each monomer drug graphic is traversed in sequence according to the traversal order of the monomer drug graphics, and the drugs with a single dose are determined to have the same planned taking time, and the time interval between different planned taking times is determined by the taking frequency. For example, if the usage and dosage information is twice a day, one tablet at a time, and the starting time is Monday morning, the planned taking time of the monomer drug graphic can be calculated in sequence as: Monday morning, Monday afternoon, Tuesday morning, Tuesday afternoon..., until all the monomer drug graphics of a drug loading body are calculated; if the usage and dosage information is twice a day, two tablets at a time, and the starting time is Monday morning, the planned taking time of the monomer drug graphic can be calculated in sequence as: Monday morning, Monday morning, Monday afternoon, Monday afternoon, Tuesday morning, Tuesday morning..., until all the monomer drug graphics of a drug loading body are calculated. If there are multiple drug loading bodies in the original image, the monomer drugs of multiple drug loading bodies can be traversed in the above monomer drug graphic traversal order, and the same calculation logic can be executed to obtain the planned taking time of the monomer drug graphic.

[0061] Step S205: The computing device marks the planned taking time on the monomer drug graphic to form a medication reminder image. In this step, the computing device marks the corresponding monomer drug graphic in the original image with the planned taking time, thereby forming a medication reminder image of the drug. In one embodiment, the computing device may mark the planned taking time in the vicinity of the corresponding monomer drug graphic in the original image for easy distinction. The vicinity can be quantitatively determined according to preset rules. For example, the area within a circle with the center point of the monomer drug graphic as the center and a preset length as the radius is determined as the vicinity of the monomer drug graphic.

[0062] Step S206: The user terminal displays a medication reminder image to guide the user to take the medicine. In this step, the user terminal displays a medication reminder image marked with the planned taking time of each monomer drug graphic to the user, and the user can compare the drug entity with the medication reminder image to take the medicine. As a preferred solution, when comparing the drug entity with the medication reminder image, the user can use the special marking pattern of the drug entity and the medication reminder image to perform image registration, that is, to maintain the consistency of posture and angle between the two images. Exemplarily, the above special marking pattern can be a fixed pattern printed on the medicine body. It can be understood that the user can also print the medication reminder image as a paper image to compare the medication.

[0063] In the technical solution of the embodiment of the present invention, the computing device generates a medication reminder image indicating the exact time to take each individual drug based on the user's specific usage and dosage information of the drug, thereby adaptively guiding the user to take the medicine accurately at each medication time, avoiding the situation where it is impossible to determine whether the medicine has been taken.

[0064] The following describes an embodiment of the present invention, in which the image processing method of the embodiment is executed by a user terminal (which can be a terminal of various forms, such as a mobile smart terminal, a personal computer, etc.); the image processing method includes: receiving the user's usage and dosage information of the drug, and the original image of the drug carried on the drug body; outputting a medication reminder image corresponding to the original image; wherein the medication reminder image is formed by marking the planned taking time for the monomer drug graphic in the original image, and the planned taking time is determined based on the usage and dosage information.

[0065] Preferably, the monomer drug graphics are determined according to the following steps: performing edge detection on the original image to obtain an edge image of the original image; the edge image includes the edges of each monomer drug graphic; and the edge image is aligned with the original image and then superimposed to identify the monomer drug graphics.

[0066] In an optional method, the planned taking time is determined according to the following steps: obtaining the user's start time for taking the drug; generating an incremental planned taking time for each monomer drug graph based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

[0067] Preferably, in the medication reminder image, the planned medication time is marked in the vicinity of the corresponding single drug graphic in the original image; and the original image contains at least one complete drug body and the same drug, the drug is a plate-packed drug, and the drug body is a drug board.

[0068] The first embodiment of the present invention is described below. Figures 3 to 8 . Figure 3 This is a flowchart of the first embodiment of the present invention. Specifically, this embodiment uses an application program combined with an image processing algorithm to identify drug images based on business input including prescription and user information and a drug database, mark the number and position of individual drugs in the image, and analyze the drugs that need to be taken at each time point. The overall solution includes 4 parts: 1. Business input; 2. Image processing; 3. Prompt information marking; 4. Result output, which are described below.

[0069] 1. Business input

[0070] This step provides a business input interface for the user to call. The input parameters are prescription information and user information, which are used to extract the medication arrangement given by the doctor. For example, the prescription information shows that the usage and dosage of drug A is: 2 times / day, 1 tablet / time. The above data can be pre-stored structured data.

[0071] 2. Image processing

[0072] The purpose of image processing is to identify the number and position of individual drugs in the drug body. Optionally, this can be achieved through computer vision software OpenCV or deep learning. The following example uses OpenCV to identify board-packed drugs. Figure 4 , the image after grayscale conversion and smoothing is shown in Figure 5 , the image after edge detection is shown in Figure 6 , the image of the single drug graphic is identified as Figure 7 .

[0073] 3. Prompt information mark

[0074] This step can calculate the planned medication time of each position based on the output result of the image recognition in the previous step, combined with the drug information, usage and dosage information, and the start time of medication, and then draw the planned medication time to the area near the corresponding single drug graphic to obtain a medication reminder image, as shown in FIG. Figure 8 . Figures 5 to 8 The horizontal and vertical axis units are both length units.

[0075] 4. Result output

[0076] This step displays the medication reminder image as a medication reminder card. The user can print out the medication reminder image to guide medication, or directly display the medication reminder image in the application of the user terminal to compare medication every time when taking medication.

[0077] In this way, this embodiment proposes a universal medication reminder card generation solution, which can provide users with personalized medication guidance capabilities and reduce the situation where users miss or repeat medications.

[0078] It should be noted that the collection, collection, update, analysis, processing, use, transmission, storage and other aspects of user personal information that may be involved in the technical solution of the present invention are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0079] For the above-mentioned method embodiments, for the convenience of description, they are expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the order of the actions described, and some steps can actually be performed in other orders or simultaneously. In addition, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily necessary to implement the present invention.

[0080] In order to better implement the above-mentioned solution of the embodiment of the present invention, relevant devices for implementing the above-mentioned solution are also provided below.

[0081] See also Fig. 9 As shown, the medication reminder image processing device 900 provided in the embodiment of the present invention may include: a recognition unit 901, a marking unit 902 and a display unit 903.

[0082] Among them, the identification unit 901 can be used to obtain the user's usage and dosage information of the drug, as well as the original image of the drug carried in the drug body, and identify the individual drug graphics in the original image; the marking unit 902 can be used to determine the planned taking time corresponding to each identified individual drug graphic based on the usage and dosage information; mark the corresponding individual drug graphics in the original image with the planned taking time to form a medication reminder image of the drug; the display unit 903 can be used to display the medication reminder image.

[0083] In an embodiment of the present invention, the recognition unit 901 can be further used to: perform edge detection on the original image to obtain an edge image of the original image; the edge image includes the edges of each monomer drug graphic; and the edge image is aligned with the original image and then superimposed to identify the monomer drug graphic.

[0084] Preferably, the marking unit 902 can be further used to: obtain the user's start time for taking the drug; generate an incremental planned taking time for each monomer drug graph based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

[0085] As a preferred solution, the marking unit 902 can be further used to mark the planned administration time in the vicinity of the corresponding monomer drug graphic in the original image.

[0086] In one embodiment, the original image includes at least one complete medicine body and the same medicine, and the original image is obtained from a preset medicine database or collected and uploaded externally.

[0087] In addition, in the embodiment of the present invention, the medicine is a plate-packed medicine, and the medicine packing body is a medicine packing plate.

[0088] The following describes a medication reminder image processing device according to another embodiment. The medication reminder image processing device according to this embodiment is arranged in a user terminal (which can be a terminal of various forms, such as a mobile smart terminal, a personal computer, etc.). The medication reminder image processing device includes: a receiving unit for receiving the user's usage and dosage information of the drug, and the original image of the drug carried on the drug body; an output unit for outputting a medication reminder image corresponding to the original image; wherein the medication reminder image is formed by marking the planned medication time for a single drug graphic in the original image, and the planned medication time is determined based on the usage and dosage information.

[0089] Preferably, the monomer drug graphics are determined according to the following steps: performing edge detection on the original image to obtain an edge image of the original image; the edge image includes the edges of each monomer drug graphic; and the edge image is aligned with the original image and then superimposed to identify the monomer drug graphics.

[0090] In an optional method, the planned taking time is determined according to the following steps: obtaining the user's start time for taking the drug; generating an incremental planned taking time for each monomer drug graph based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

[0091] Preferably, in the medication reminder image, the planned medication time is marked in the vicinity of the corresponding single drug graphic in the original image; and the original image contains at least one complete drug body and the same drug, the drug is a plate-packed drug, and the drug body is a drug board.

[0092] According to the technical solution of an embodiment of the present invention, the computing device generates a medication reminder image indicating the exact time to take each individual drug based on the user's specific usage and dosage information of the drug, thereby adaptively guiding the user to take the medicine accurately at each medication time, avoiding the situation where it is impossible to determine whether the medicine has been taken.

[0093] Fig.10An exemplary system architecture 1000 is shown to which the medication reminder image processing method or medication reminder image processing device according to the embodiment of the present invention can be applied.

[0094] like Fig.10 As shown, the system architecture 1000 may include terminal devices 1001, 1002, 1003, a network 1004 and a server 1005 (this architecture is only an example, and the components included in the specific architecture may be adjusted according to the specific application). The network 1004 is used to provide a medium for a communication link between the terminal devices 1001, 1002, 1003 and the server 1005. The network 1004 may include various connection types, such as wired, wireless communication links or optical fiber cables.

[0095] The user can use the terminal devices 1001, 1002, 1003 to interact with the server 1005 through the network 1004 to receive or send messages, etc. Various client applications, such as medical-related applications (only as an example), can be installed on the terminal devices 1001, 1002, 1003.

[0096] The terminal devices 1001 , 1002 , and 1003 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers, etc.

[0097] The server 1005 may be a server that provides various services, such as an image processing server (only an example) that provides support for medical-related applications operated by users using the terminal devices 1001, 1002, and 1003. The image processing server may process the received image processing request and feed back the processing result (such as a medication reminder image marked with the planned taking time of each single drug graphic - only an example) to the terminal devices 1001, 1002, and 1003.

[0098] It should be noted that the medication reminder image processing method provided in the embodiment of the present invention can be executed by the server 1005 , and accordingly, the medication reminder image processing device can be set in the server 1005 .

[0099] It should be understood that Fig.10 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.

[0100] The present invention also provides an electronic device. The electronic device of the embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the medication reminder image processing method provided by the present invention.

[0101] Reference below Fig.11 , which shows a schematic diagram of the structure of a computer system 1100 of an electronic device suitable for implementing an embodiment of the present invention. Fig.11 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0102] like Fig.11 As shown, the computer system 1100 includes a central processing unit (CPU) 1101, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage part 1108 into a random access memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the computer system 1100 are also stored. The CPU 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0103] The following components are connected to the I / O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a LAN card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0104] In particular, according to the embodiments disclosed in the present invention, the process described in the main step diagram above can be implemented as a computer software program. For example, the embodiments of the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the main step diagram. In the above embodiment, the computer program can be downloaded and installed from the network through the communication part 1109, and / or installed from the removable medium 1111. When the computer program is executed by the central processing unit 1101, the above functions defined in the system of the present invention are executed.

[0105] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0106] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0107] The units involved in the embodiments of the present invention may be implemented by software or hardware. The units described may also be set in a processor, for example, it may be described as: a processor includes: an identification unit, a marking unit and a display unit. The names of these units do not constitute a limitation on the units themselves in some cases, for example, the identification unit may also be described as a "unit that provides a monomer drug graphic to the marking unit".

[0108] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently and not be installed in the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the device, the steps executed by the device include: obtaining the user's usage and dosage information of the drug, and the original image of the drug carried on the drug body, and identifying the monomer drug graphics in the original image; determining the planned taking time corresponding to each identified monomer drug graphic based on the usage and dosage information; marking the corresponding monomer drug graphic in the original image with the planned taking time to form a drug medication reminder image; and displaying the medication reminder image.

[0109] The present invention also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the medication reminder image processing method provided by the present invention is implemented.

[0110] In the technical solution of the embodiment of the present invention, the computing device generates a medication reminder image indicating the exact time to take each individual drug based on the user's specific usage and dosage information of the drug, thereby adaptively guiding the user to take the medicine accurately at each medication time, avoiding the situation where it is impossible to determine whether the medicine has been taken.

[0111] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A medication reminder image processing method, characterized in that: include: Obtaining the user's usage and dosage information of the drug, as well as the original image of the drug carried on the drug pack body, and identifying the single drug graphic in the original image; Determining the planned taking time corresponding to each identified monomer drug graphic according to the usage and dosage information; Marking the corresponding single drug graphic in the original image with the planned medication time to form a medication reminder image of the drug; The medication reminder image is displayed.

2. The method according to claim 1, characterized in that The identifying of the monomeric drug graphics in the original image includes: Performing edge detection on the original image to obtain an edge image of the original image; the edge image contains the edges of each monomer drug graphic; The edge image is aligned with the original image and then superimposed to identify the monomer drug graphic.

3. The method according to claim 1, characterized in that The step of determining the planned administration time corresponding to each identified monomer drug graphic according to the usage and dosage information includes: Obtaining the start time of taking the drug by the user; Based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order, an increasing planned taking time is generated for each monomer drug graph; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

4. The method according to claim 1, characterized in that: The step of marking the corresponding monomer drug graphics in the original image with the planned administration time includes: The planned administration time is marked in the vicinity of the corresponding monomeric drug graphic in the original image.

5. The method according to claim 1, characterized in that The original image includes at least one complete medicine body and the same medicine, and the original image is obtained from a preset medicine database or collected and uploaded externally.

6. The method according to claim 1, characterized in that The medicine is a plate-packed medicine, and the medicine-packing body is a medicine-packing plate.

7. A medication reminder image processing method, characterized in that: Applied in a user terminal; the method comprises: Receiving the user's usage and dosage information of the medicine, and the original image of the medicine carried on the medicine body; Output a medication reminder image corresponding to the original image; wherein the medication reminder image is formed by marking the planned medication time for a single drug graphic in the original image, and the planned medication time is determined based on the usage and dosage information.

8. The method according to claim 7, characterized in that The planned administration time is determined according to the following steps: Obtaining the start time of taking the drug by the user; Based on the usage and dosage information and in accordance with a preset monomer drug graph traversal order, an increasing planned taking time is generated for each monomer drug graph; wherein the minimum planned taking time is equal to the start taking time, and the time interval between the planned taking times of different monomer drug graphs is determined by the usage and dosage information.

9. The method according to claim 7, characterized in that: In the medication reminder image, the planned medication time is marked in the vicinity of the corresponding single drug graphic in the original image; and the original image contains at least one complete drug body and the same drug, the drug is a plate-packed drug, and the drug body is a drug plate.

10. A medication reminder image processing device, characterized in that: include: The recognition unit is used to obtain the user's usage and dosage information of the medicine, and the original image of the medicine carried on the medicine body, and recognize the single medicine graphic in the original image; A marking unit, used to determine the planned taking time corresponding to each identified monomer drug graphic according to the usage and dosage information; Marking the corresponding single drug graphic in the original image with the planned medication time to form a medication reminder image of the drug; A display unit is used to display the medication reminder image.

11. A medication reminder image processing device, characterized in that: Set in a user terminal; the device includes: A receiving unit, used to receive the user's usage and dosage information of the medicine, and the original image of the medicine carried on the medicine body; An output unit is used to output a medication reminder image corresponding to the original image; wherein the medication reminder image is formed by marking the planned medication time for a single drug graphic in the original image, and the planned medication time is determined based on the usage and dosage information.

12. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 9.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images