Method, reading device, and reading system for capturing computer-readable codes
Patent Information
- Application Number
- JP2023532589
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2020-11-30
- Filing Date
- 2021-11-30
- Publication Date
- 2024-12-09
- Estimated Expiration
- 2041-11-30
AI Technical Summary
Current systems for tracking and documenting medical devices are prone to errors due to inconsistent encoding of information on medical products, requiring skilled personnel to scan multiple codes in a specific sequence, and often result in incomplete documentation of essential information.
A method and device for capturing multiple computer-readable codes, such as barcodes and QR codes, that automatically identifies and combines relevant information from multiple codes, providing visual feedback to users through an overlay image, ensuring complete data capture and reducing human error.
The solution ensures accurate and complete documentation of medical device information by automatically selecting the best code, combining information from multiple codes, and providing real-time feedback, thereby improving patient safety and hospital workflow efficiency.
Abstract
Description
Technical Field
[0001] The present disclosure relates to a method for capturing a plurality of computer-readable codes, preferably barcodes and / or two-dimensional codes, of a medical product or a package of a medical product for assisting a user. Further, the present disclosure relates to a reading device, a reading system, and a computer-readable storage medium according to the preamble of the independent claims. In particular, the present disclosure can be used for processing information scanned from a package (article) and identifying information contained therein, with a medical product having a plurality of computer-readable codes, preferably a plurality of barcodes. Preferably, the scanner can identify relevant information according to the intended use. One field of application is the processing and documentation of medical devices.
Background Art
[0002] Tracking and documenting patients or medical devices as medical products used in a patient's medical treatment is essential to enable tracing of the device in case of an infection or a device recall. The device can be any type of medical product. It is necessary to be able to determine which specific article (medical product) containing lot or serial number information has been used, for example implanted or used, with respect to a patient. The lot number can also be referred to as the batch number.
[0003] Currently, manual documentation is common. This includes removing a seal detachable from the device. In many cases, these seals are collected by staff in some way. For example, it is known to attach them to the surgical gown being worn during the procedure.
[0004] Subsequently, at the workplace used for documentation purposes, the seal is removed and attached to a form or document. Then, the form or document is archived or digitized.
[0005] Unfortunately, some devices do not have labels. In these cases, information such as the lot number may be printed on the item, the item packaging (medical product packaging), or the item set packaging. These items are often forgotten and subsequently not documented.
[0006] In systems currently used in hospitals, the use of medical supplies on patients can be digitally documented. Examples of such systems include hospital information systems (HIS), hospital management software or systems (HMS), laboratory information systems (LIS), policy and procedure management systems, radiology information systems (RIS), picture archiving and communication systems (PACS), and enterprise resource planning (ERP) systems. In many cases, barcode scanners are used to collect information from collected labels.
[0007] Medical devices are governed by two main standards: Global Standards 1 (GS1), such as the Global Trade Item Number (GTIN), and the Health Industry Barcode (HIBC) system. Certain devices utilize a Pharmaceutical Central Number (PZN, or "Pharmazentralnummer" in German). A database containing master data for all potentially used items must be maintained to link the appropriate item to the scanned barcode. Therefore, the information system used requires a materials management block, or an interface is needed between the information system and materials management software.
[0008] According to an exemplary study, approximately 27 percent of implant datasets scanned in hospitals were not properly maintained. Specifically, the GTIN (Graduate Data Indicator) was missing. As a result, the barcode could be scanned, but it could not be processed properly. In such cases, the user is simply shown an error message, and there is no way to restore data health other than manually entering the missing data.
[0009] This puts implants, such as knee and hip replacement implants, at a significant disadvantage because, in at least some countries, they must be documented in accordance with the law. Manual entry of implant data after scanning can lead to human error and data degradation within the system. Incorrect data can also lead to damage claims, making it extremely desirable to have a proper database for all items used.
[0010] Furthermore, some devices or lots may have multiple barcodes. Medical device manufacturers have some freedom in how they encode the relevant information of their devices. Specifically, the GS1 standard is open to different interpretations. Therefore, information presented on devices from different manufacturers lacks consistency. It is desirable that all relevant information resides in a single scannable element, preferably a data matrix code or similar code. A data matrix is a two-dimensional code, as shown in Figure 2a, and requires less area than conventional barcodes. The principle of data matrices is partially described in German Patent Application Publication No. 4107020. A data matrix with a common size of 48 rows and 48 columns can represent 348 digits or 259 alphanumeric characters. Depending on the print resolution, a 48x48 data matrix can be 10x10mm to 20x20mm in size. According to the currently used ECC200 standard, a commonly used data matrix can be up to 144x144 and can hold up to 3116 digits or 2355 alphanumeric characters.
[0011] For comparison, traditional barcodes attached to books use a 13-digit number to indicate the book's International Standard Book Number (ISBN). Figure 2b shows this barcode.
[0012] Relevant information for medical device documentation includes the GTIN, expiration date, and lot or serial number. However, in practice, medical devices often contain not only this information but also additional information that may not be relevant to documentation. Figures 2c to 2g illustrate this. In Figure 2c, the bottom of the three barcodes contains all the relevant information. In Figure 2d, the lower of the two data matrices should be scanned for all the relevant information. Users often become confused and end up performing unnecessary scans, increasing the probability of errors that lead to inaccurate data sets. In other devices, all relevant information is contained not in a single code item, but in multiple barcodes or data matrices. In this case, conventional scanning techniques result in incomplete documentation. In Figure 2e, the lower barcode contains the GTIN (i.e., the value after indicator "(01)") and expiration date data (i.e., the value after indicator "(17)"). The upper barcode, on the other hand, contains the lot number (i.e., the value after indicator "(10)").
[0013] When scanning barcodes, users must adhere to a prescribed scanning sequence to ensure that the information system properly processes the scanned data. The current procedure requires scanning the lot number first to indicate to the information system that further information follows the GTIN. When the GTIN is scanned first, the lot number is concatenated to the subsequent GTIN, resulting in a documentation error without any warning or other indication to the user. Current scanning equipment requires skilled and knowledgeable operators who are aware of these issues and can scan the codes in the correct sequence. However, the current system is highly prone to errors.
[0014] Many scanners (as capture devices) are designed to detect data matrix codes by scanning a rectangular area, rather than using a single target beam of light to highlight computer-readable codes. If multiple codes are present in this area, the scanner needs to determine which codes should be scanned and evaluated first. Experienced operators know to cover codes that should not be scanned, or should not be scanned first, to improve scanning efficiency. Specifically, users will cover codes containing GTINs and scan lot numbers first. However, the GS1 standard indicator field is not commonly recognized, and different fields can be used to indicate similar information. Regarding the GS1 standard, over 500 different so-called application identifiers are known. Figure 3 shows an excerpt of GS1 application identifiers. Also, some users consistently make the mistake of scanning long codes first or scanning codes from top to bottom. However, in reality, length and position are irrelevant to the content of the code; the user needs to find the application identifier "(10)" present in the upper code in Figure 2f and the lower code in Figure 2g.
[0015] (Related technologies) For example, U.S. Patent Application Publication 2016 / 0171258 discloses a system for detecting and processing codes for medical products. Codes are scanned and linked to a central module having a database. Product information for medical products is obtained from the code or the database. The user receives feedback if the necessary information has been read / captured, or if the user needs to scan further codes. Only one code can be scanned at a time, and it can only determine whether that one code contains the necessary information.
[0016] A barcode scanner and recognition device is known from Japanese Patent Publication No. 2016-212603. The barcode scanner scans one or more codes, and the recognition device interprets the codes. The recognition device links the code data to a database and measures how often the codes have been read. Thus, the recognition device can prevent the same code from being scanned multiple times. The recognition device can also determine whether the code is in a two-step format, in which case it can read the two codes in the appropriate order / sequence.
[0017] Therefore, it is common knowledge that, as a prior art, computer-readable codes can be scanned to determine whether or not the necessary information is present. However, existing methods cannot show the user which of multiple scanned codes is the best. Furthermore, existing methods cannot combine product information from multiple codes to obtain the necessary information.
[0018] (A brief description of this disclosure) Therefore, the purpose of this disclosure is to enable the capture of multiple computer-readable codes and to provide users with feedback on the availability of necessary product data / information within the codes and the relevance of the captured codes.
[0019] The object of this disclosure is achieved by a method for capturing one or more computer-readable codes as described in claim 1, a reading device as described in claim 8, a reading system as described in claim 14, and a computer-readable storage medium as described in claim 15.
[0020] This disclosure relates to a method for capturing, preferably scanning, multiple computer-readable codes, preferably barcodes and / or two-dimensional codes, on a medical product or the packaging of a medical product to assist a user. The method includes the steps of capturing, preferably scanning, an image of the medical product or its packaging having codes using a capture device, preferably a smartphone having a camera, and extracting / identifying at least first and second computer-readable codes in the captured image. The code data of the captured codes is interpreted / decoded by an interpreting device to obtain from the code data at least product ID / product identifier information and further product information, preferably expiration date and / or lot number.
[0021] Image capture or scanning will be understood to mean that a user or device takes a photograph of a medical product or its packaging, preferably with a camera such as a smartphone camera, or scans the product or packaging with a capture device such as a camera.
[0022] Furthermore, it should be understood that the code data for at least the first and second computer-readable codes can be, for example, a (digital) photograph of the code. If the capture device is capable of interpreting computer-readable codes, the capture device can also transmit the code data, which is the interpreted data of the code.
[0023] Product information refers to information about medical products, and should be understood to include, for example, product ID, expiration date data, and lot number. Product information may also include more information about medical products, such as, for example, the maximum transport period or maximum storage period for vaccines.
[0024] Furthermore, it should be understood that interpreting code data means retrieving information from a computer-readable code. For example, a code may be interpreted to identify it as a GS1 standard code containing a product ID. The product ID is a number or a combination of numbers and letters read from the code.
[0025] The method relating to this disclosure further includes the step of determining, based on the acquired information, whether a predetermined set of relevant information about a medical product is included in the information of the captured code and / or linked (master data) database. Furthermore, the method selects the second code as a relevant code if the acquired information for the first code is entirely included in the acquired information for the second code, or selects both the first and second codes as relevant codes if each code includes at least a portion of the information in the predetermined set of relevant information.
[0026] Please understand that the specified relevant information refers to information about medical products that needs to be scanned and digitized. The specified relevant information may differ from the type of medical product. For example, implants must be documented along with their lot number; otherwise, the required documentation requirements will not be met. The specified relevant information may be defined, for example, by legal requirements, by the user, or by other requirements, such as hospital intern requirements.
[0027] One or more computer-readable codes are selected as associated codes if they contain a predetermined set of associated information. An associated code may be a single code containing all the associated information, or it may be a set of codes containing the associated information in combination.
[0028] The method further includes transmitting, to a display device, a code marker for each code based on the result of the specifying step and the result of the selecting step, and displaying an overlay image including the captured image and the marking of the code for adding auxiliary visual information to the code to provide the user with an improved overview of the computer-readable code according to the code marker.
[0029] The code marker is additional information that is "added" to the computer-readable code. The additional information adds, for example, a description indicating whether the code is a related code, an invalid code, or a valid code that does not contain additional product information, to the code.
[0030] The overlay image is an image including the captured image having the computer-readable code and the marking of the code according to the code marker. The marking provides visual feedback about the code to the user. The marking may be, for example, a predetermined colored box around the code.
[0031] In other words, a capture device can be applied to scan one or more computer-readable codes, such as barcodes or QR codes. The capture device identifies the computer-readable codes in the captured image and transmits the code data of multiple codes to an interpreter. The interpreter interprets the code data. This allows the interpreter to extract product information from the code data. Product information is information about a medical product, such as the product identifier, lot number, and expiration date of the medical product. The interpreter determines whether the product information of the related codes contains predetermined related information. The interpreter further checks whether the missing product information is stored in the database. If one code also contains all the product information of another code, the interpreter selects that one code as the related code. If there is no single code that contains all the product information of another code, multiple codes may be related codes. A related code is any code to which new product information is added. Therefore, when multiple codes are related codes, the information contained in the codes combines to form a predetermined set of related information. The extracted product information is stored in the (master data) database. In other words, the interpretation device determines whether the product information of the captured item includes predetermined related information, or whether the predetermined related information can be obtained from the database. It is also possible to obtain the predetermined related information by combining the product information from the code data with the product information obtained from the database.
[0032] The interpreting device transmits a code marker for the relevant code to the display device. The code marker adds additional information to the code. The display device displays an overlay image to the user. The overlay image includes the captured image and one or more marked relevant codes. The marking highlights the relevant codes to the user, thereby providing the user with additional information. Different markings are applied to the relevant codes depending on the identification of the interpreting device. If the identification of the interpreting device is positive, the relevant codes may simply be marked. According to one embodiment, the color of the marking may preferably be green. Optionally, the user receives feedback that the scan is complete. On the other hand, if the identification of the interpreting device is negative, the overlay image includes a warning or message informing the user that the relevant information is incomplete. In this case as well, the relevant codes are marked / highlighted because they contain product information. However, here the relevant codes may be highlighted in red or orange.
[0033] In other words, this disclosure relates in particular to a method for collecting data about the consumption of medical supplies (medical products) in a procedure (such as surgery) from computer-readable codes, preferably barcodes, in an image containing one or more barcodes. The method includes the steps of: collecting barcode information of at least one computer-readable code, preferably a barcode, wherein each computer-readable code includes equipment identifier information (product ID), manufacturing identifier information (e.g., lot number or expiration date), and computer-readable code type information, preferably barcode type information; obtaining additional item information from a database based on the equipment identifier information (product ID), manufacturing identifier information (e.g., lot number or expiration date), and barcode type information; determining whether a predetermined set of required information (a predetermined set of related information) relating to an item exists in the computer-readable code based on the equipment identifier information, manufacturing identifier information, barcode type information, and additional item information; if the determination is yes, determining the minimum set of computer-readable codes, preferably a minimum set of barcodes, that include the predetermined set of required information relating to the item, according to predetermined rules; transmitting marking information (code markers) for displaying an image and for providing markings for barcodes included in the image (overlay image) based on the determination result; and storing the predetermined set of required information relating to the item in memory in association with the procedure.
[0034] The method relating to this disclosure has the following advantages: Simply put, the method selects the best computer-readable code from a set of multiple computer-readable codes. Preferably, the best code is highlighted to the user, and additional information is provided. Thus, the user knows exactly which of the multiple codes is the best. If there is no single code on the medical product or packaging that contains all the relevant information, the relevant information can be gathered by combining product information from multiple codes. The major problem of codes containing product identifiers being scanned before codes containing lot numbers being scanned is avoided, and lot numbers being linked to the wrong product. In this disclosure, multiple computer-readable codes can be scanned simultaneously, and they can ensure that the codes being scanned belong to the same medical product. If information is missing in the scanned code, the user receives a warning or alert. It is also possible to scan a single code. The user receives feedback on whether the single code contains all the relevant information. Furthermore, if the information system is guaranteed to have appropriate usage information in real time, reordering medical products when replenishing a predetermined number of items can be easily automated.
[0035] The advantageous aspects of this disclosure are described in the dependent claims and / or specifically below.
[0036] Preferably, the code marker may include information indicating the color and / or shape of the overlay around the barcode, and / or one or more of the text and / or symbols on or near each code. The code marker may be, for example, a box around the code. Depending on the identified result, the code marker may have different colors for different codes. For example, relevant codes may be colored green. Codes that are readable but do not contain further product information may be colored orange or yellow. Invalid codes may be colored red. Code markers with various information about the codes assist the user. Based on the code markings, the user can easily determine which codes are relevant. The user is further notified if the captured code set contains a predetermined set of relevant information, and warned if the captured code set does not contain a predetermined set of relevant information. The user can learn from the code markings which codes are relevant for future reference.
[0037] In other words, the marking information (code marker) may indicate a computer-readable code, preferably the color and / or shape of the overlay around the barcode, and / or one or more of the text, numbers, and / or symbols on or near each code. Furthermore, different markings may be used for one or more codes identified as containing a predetermined set of required information about an article, for one or more codes identified as not containing a predetermined set of required information about an article, for one or more codes identified as invalid, for one or more codes identified as valid but for which related additional article information cannot be retrieved from the database, and / or for one or more codes not used in the minimum code set.
[0038] Preferably, the method further includes the steps of adding product information to a (master data) database using an interpreting device, and determining whether the database contains predetermined required information, preferably a product ID, expiration date, and lot number. If the determination is negative, the method further includes assigning a warning or message to a code marker, and displaying to the user an overlay image of the code to which the warning or message has been assigned using a display device.
[0039] In other words, product information obtained from code data may be stored in a (master data) database. After the information is added to the database, the interpreting device determines whether the database contains the required information. Depending on the determination result, different code markers are sent to the display device. If the determination is positive, the code marker contains information about which codes are relevant. The relevant codes are highlighted in the overlay image. On the other hand, if the determination is negative, the code marker contains a warning or message. The warning or message is shown to the user in the overlay image. This informs the user that the code does not contain all the required information.
[0040] Preferably, the interpreting device stores the acquired product information in a database and determines whether the database contains the required information. If the acquired product information contains the required information or if the required information is already stored in the database, the database is completed after the product information is stored. If the interpreting device determines that the required information is not included in either the product information or the database, the user may receive a warning or message from the display device. The interpreting device may check whether the captured code contains the relevant information. If the relevant information is not included in the captured code, the interpreting device checks whether the information can be extracted from the database. If the information cannot be extracted from either the code or the database, the user receives feedback that the required information does not exist.
[0041] Preferably, the method further includes the step of assigning a green box to each of the code markers, if it is identified that one or more of the codes contain a predetermined set of relevant information about a medical product. In a further step, the display device displays to the user an overlay image in which each of the codes is surrounded by a green box. If one or more captured codes contain a predetermined set of relevant information, the codes are identified as relevant codes. One or more relevant codes are marked with a green box in the overlay image. The user can easily understand that one or more relevant codes are present and that the scan is complete.
[0042] Preferably, the method further includes the steps of assigning a hide flag to each of the codes if it is identified that one or more of the codes are invalid and do not conform to the corresponding standard of computer-readable code, and displaying an overlay image in which each of the codes is covered / hidden / faded. Irrelevant codes, or codes that are not standard codes, may be hidden in the overlay image. The user can focus on the relevant codes without being misled by the irrelevant codes. The user can learn for future reference which codes are relevant.
[0043] Preferably, the method further includes the step of linking the acquired product ID to a (master data) database by an interpreter storing the product ID in a database, or by linking the product ID in the code data of the associated code to an existing associated product ID in the database. The method further includes the step of adding further product information data to the product ID database by an interpreter, and the step of determining whether the linked product ID database contains predetermined required information, preferably an expiration date and / or lot number. After scanning the code, the medical product is linked to the (master data) database. The interpreter determines whether the information is available from the database. Information on which product information is required as a predetermined set of associated information is also available from the database. By retrieving product information from the database, a predetermined set of associated information can be completed even if the captured code does not contain all the required information.
[0044] Preferably, the method further includes the steps of assigning at least a portion of the retrieved information of at least a first and / or second code to each code marker of the code, and displaying a portion of the retrieved information next to the code in an overlay image to assist the user with further information about the medical product. The code marker may contain information about the information stored in the code. This may be information that the code contains a product identifier. The displayed overlay image may include a marker next to the code indicating that the code contains a product identifier. The product identifier, which is a number, may also be displayed next to the code. The user immediately understands the information contained in each code. The user can also learn for future reference which information is stored in a single code. Using the additional information, the user can learn the identifiers of the codes.
[0045] The purposes of this disclosure are further realized by a reader that captures multiple computer-readable codes on a medical product or the packaging of a medical product to assist the user. The reader comprises a capture device configured to capture an image of the medical product or its packaging having codes and to extract at least first and second computer-readable codes within the captured image.
[0046] Furthermore, the reader includes an interpreter. The interpreter is configured to interpret the code data and obtain at least product ID information and further product information from the code data. The interpreter is further configured to determine, based on the obtained information, whether a predetermined set of relevant information about the medical product is included in the captured code and / or in the linked (master data) database information stored in the reader's memory or the server's memory. The interpreter is further configured to select the second code as the relevant code if the information in the code data of the first code is fully included in the information in the code data of the second code, or to select both the first and second codes as relevant codes if each code contains at least a portion of the information in the predetermined set of relevant information.
[0047] The code marker for each code is transmitted to a display device based on specific results and selections. The reader further includes a display device configured to display an overlay image having the captured image and code markings to add auxiliary visual information to the code to provide the user with an improved overview of the computer-readable code, corresponding to the code marker.
[0048] The reading device comprises a capture device, an interpretation device, and a display device. The capture device is preferably a smartphone with a camera and is configured to take a picture of a medical product or scan a code. The interpretation device is configured to determine whether the necessary relevant information exists in the captured code and / or database. The interpretation device further selects the relevant codes and transmits at least one code marker for each code (one or more) to the display device. The display device displays to the user an overlay image consisting of the captured images and the code marker information embedded in the overlay image.
[0049] In other words, the present disclosure preferably provides a data evaluator (e.g., a reader) for collecting data about the consumption of medical supplies (medical products) in a procedure (such as surgery) from computer-readable codes, preferably barcodes, in an image containing one or more barcodes. The data evaluator comprises: a collection unit (capture device) configured to collect code information of at least one computer-readable code, preferably a barcode, including device identifier information (product ID), manufacturing identifier information, and code type information; an acquisition unit (interpretation device) configured to obtain additional item information from a database based on the device identifier information, manufacturing identifier information, and code type information; an identification unit (interpretation device) configured to identify whether a predetermined set of necessary information (a predetermined set of related information) about an item exists in a computer-readable code, preferably a barcode, based on the device identifier information, manufacturing identifier information, code type information, and additional item information, and if the identification is yes, to identify the minimum set of computer-readable codes, preferably a minimum set of barcodes, that include the predetermined set of necessary information about the item, according to predetermined rules; a transmission unit configured to transmit marking information (code markers) for displaying an image (overlay image) and for providing markings for computer-readable codes, preferably barcodes, contained in the image, based on the identification result; and a storage unit (database) configured to store a predetermined set of necessary information about an item in memory in association with the action.
[0050] The reader has the following advantages: It can scan multiple codes and determine whether a code contains at least a portion of a given set of related information. The reader can further identify a set of related codes containing (at least a portion of) a given set of related information (particularly in combination with residual information stored in a database) and highlight them in an overlay image. Therefore, the reader can select the best code from among multiple codes or combine multiple codes to obtain the required set of related data.
[0051] Preferably, the interpreting device is configured to identify that the first captured code conforms to the GS1 standard and that another GS1 standard barcode could also be captured. If the identification is positive, the display device displays feedback to the user to capture another computer-readable code. Some medical products have multiple GS1 standard codes. If it is known that a product has multiple codes, but only one code is present in the captured image, the user receives feedback on the display device to scan for another code. Preferably, the user is prompted to change the camera angle to capture multiple codes.
[0052] Preferably, the interpreting device has character recognition capabilities and is configured to link computer-readable codes to descriptions not defined within the computer-readable codes. Some products have computer-readable codes that do not indicate what information is stored within them. The description is rather placed next to the code and written in text. It is advantageous for the interpreting device to be able to read text. The interpreting device can link the code to the text next to it. The interpreting device can read the text, for example, using optical character recognition (OCR) or an artificial intelligence network.
[0053] Preferably, the interpreting device is configured to identify whether the captured code belongs to sterile material, and if the identification is positive, to retrieve additional information about the sterile material, preferably its expiration date, from a database. Sterile medical products or sterile materials must have an expiration date. Once the interpreting device identifies that the captured code belongs to a sterile medical product or material, it retrieves additional information, preferably its expiration date, from the captured code or a database. The interpreting device identifies whether the material has expired and provides feedback to the user via a display device.
[0054] Preferably, the interpreting device is applied to identify that not all of the information in a predetermined set of relevant information is available and that an electric medical product is installed / used, and the interpreting device shuts down the function, preferably the power, of the medical product, and the display device displays a warning to the user. If the interpreting device identifies that not all of the predetermined relevant information about the electric medical product is available, it may shut down the power to the electric medical product. Alternatively, the interpreting device may display a warning to the user via the display device.
[0055] Preferably, the interpreting device has a predetermined selectable code marker set stored in a memory unit, the code markers including information indicating the color and / or shape of the overlay around the barcode, and / or one or more of the text and / or symbols on or near each code.
[0056] This disclosure further relates to a reading system for capturing multiple computer-readable codes on a medical product or medical product packaging to assist a user. The reading system comprises at least one reading device as a client device, relating to any one of the above-described aspects of this disclosure, and a central server device for sending and receiving data to and from the reading devices, having storage with a (master) database and connected to at least one reading device. The reading system comprises one central module for data processing and a plurality of reading systems connected to the central module. The central module provides a composite database of product information. For example, if one of the plurality of capture devices is not working, another capture device can be used that provides the same functionality and has access to the same database and stored product information.
[0057] Preferably, the identification step may further include determining whether the article is related to a procedure based on equipment identifier information, manufacturing identifier information, barcode type information, and additional article information. The procedure is preferably surgery or other medical procedure.
[0058] Preferably, another marking indicating that the item is not related to the procedure may be used on one or more barcodes.
[0059] Preferably, a predetermined set of necessary information (a predetermined set of related information) relating to the article includes one or more of the following: a unique article number, a manufacturer identifier, an article number at the manufacturer, a serial number, a lot number, and / or an expiration date.
[0060] Preferably, the additional article (medical product) information includes a predetermined set of required information about the article, and further / or the predetermined set of required information about the article includes one or more of the serial number, lot number, and / or expiration date.
[0061] Preferably, the method further includes one or more of the steps of: collecting an image; detecting a barcode in the image; decoding the detected barcode based on a barcode coding table; interpreting the decoded barcode based on an interpretation table; and / or displaying the collected image along with the markings.
[0062] Preferably, the method further includes the step of prompting the user and receiving additional input from the user if at least one invalid (bar)code is identified, if a predetermined set of required information relating to the item is not present in the (bar)code, and / or if the method has properly terminated.
[0063] Preferably, the display step further includes a step of displaying interaction elements, preferably based on barcode information and / or additional item information.
[0064] Preferably, the method repeats the step of processing multiple images, preferably after a predetermined time has elapsed and / or after user confirmation.
[0065] Preferably, the marking information (code marker) may indicate the color and / or shape of the overlay around the barcode, and / or one or more of the text, numbers, and / or symbols on or near each code. Furthermore, different markings may be used for one or more codes identified as containing a predetermined set of required information about an article, for one or more codes identified as not containing a predetermined set of required information about an article, for one or more codes identified as invalid, for one or more codes identified as valid but for which related additional article information cannot be obtained from the database, and / or for one or more codes not used in the minimum code set.
[0066] Preferably, the identification unit (interpreting device) is further configured to determine whether an article is related to the procedure based on equipment identifier information, manufacturing identifier information, barcode type information, and additional article information.
[0067] Preferably, one or more barcodes may be marked with another marking indicating that the item is not related to the treatment.
[0068] Preferably, a predetermined set of required information relating to the article includes one or more of the following: unique article number, manufacturer identifier, manufacturer's article number, serial number, lot number, and / or expiration date.
[0069] Preferably, the additional article information includes a predetermined set of required information about the article. Furthermore / or, the predetermined set of required information about the article includes one or more of the serial number, lot number, and / or expiration date.
[0070] Preferably, a data evaluator is provided comprising one or more of the following: a collection unit configured to collect images; a detection unit configured to detect barcodes in the images; a decoding unit configured to decode the detected barcodes based on a barcode coding table; an interpretation unit configured to interpret the decoded barcodes based on an interpretation table; and / or a display unit configured to display the collected images together with markings.
[0071] Preferably, the data evaluator further includes an interaction unit configured to prompt the user and receive additional input from the user when at least one invalid (bar)code is identified, when a predetermined set of required information about an item is found to be absent from the (bar)code, and / or when data collection from the image has been successfully completed.
[0072] Preferably, the data evaluator further includes a display unit configured to display interaction elements, preferably based on barcode information and / or additional item information.
[0073] Preferably, the data evaluator is configured to process multiple images sequentially, preferably after a predetermined time has elapsed and / or after user confirmation, before proceeding to the next image.
[0074] Furthermore, this disclosure relates to a computer program product including a program for a processing device, the computer program product including a software code portion that performs the method according to the above-described embodiment when the program is executed on the processing device.
[0075] Preferably, the computer program product includes a computer-readable medium on which the software code portion is stored, and the program is directly loadable into the internal memory of the processing device.
[0076] The disclosure further relates to a computer-readable storage medium that, when executed by a computer, includes instructions causing the computer to perform any of the methods described above.
[0077] The description of the method for capturing computer-readable code relating to this disclosure also applies to the description of the reading device relating to this disclosure, and vice versa. [Brief explanation of the drawing]
[0078] This disclosure is described in more detail below with reference to preferred embodiments, illustrated with drawings. [Figure 1] This is a flowchart of the method disclosed herein according to one embodiment. [Figure 2a] This diagram shows examples of code on a device to facilitate understanding. [Figure 2b] This diagram shows examples of code on a device to facilitate understanding. [Figure 2c]This diagram shows examples of code on a device to facilitate understanding. [Figure 2d] This diagram shows examples of code on a device to facilitate understanding. [Figure 2e] This diagram shows examples of code on a device to facilitate understanding. [Figure 2f] This diagram shows examples of code on a device to facilitate understanding. [Figure 2g] This diagram shows examples of code on a device to facilitate understanding. [Figure 3] This is a list of GS1 standard application identifiers to facilitate understanding. [Figure 4a] This diagram shows different product coding formats to facilitate understanding. [Figure 4b] This diagram shows different product coding formats to facilitate understanding. [Figure 4c] This diagram shows different product coding formats to facilitate understanding. [Figure 4d] This diagram shows different product coding formats to facilitate understanding. [Figure 4e] This diagram shows different product coding formats to facilitate understanding. [Figure 4f] This diagram shows different product coding formats to facilitate understanding. [Figure 4g] This diagram shows different product coding formats to facilitate understanding. [Figure 4h] This diagram shows different product coding formats to facilitate understanding. [Figure 4i] This diagram shows different product coding formats to facilitate understanding. [Figure 4j] This diagram shows different product coding formats to facilitate understanding. [Figure 4k] This diagram shows different product coding formats to facilitate understanding. [Figure 4l] This diagram shows different product coding formats to facilitate understanding. [Figure 4m] This diagram shows different product coding formats to facilitate understanding. [Figure 4n] This diagram shows different product coding formats to facilitate understanding. [Figure 4o] This diagram shows different product coding formats to facilitate understanding. [Figure 4p] This diagram shows different product coding formats to facilitate understanding. [Figure 4q] This diagram shows different product coding formats to facilitate understanding. [Figure 4r] This diagram shows different product coding formats to facilitate understanding. [Figure 4s] This diagram shows different product coding formats to facilitate understanding. [Figure 4t] This diagram shows different product coding formats to facilitate understanding. [Figure 4u] This diagram shows different product coding formats to facilitate understanding. [Figure 4v] This diagram shows different product coding formats to facilitate understanding. [Figure 4w] This diagram shows different product coding formats to facilitate understanding. [Figure 4x] This diagram shows different product coding formats to facilitate understanding. [Figure 5] This is an illustrative barcode decoding table to facilitate understanding. [Figure 6] This is a schematic diagram showing a reading device according to a preferred embodiment of the present disclosure.
[0079] The drawings are schematic and are intended solely to aid in understanding the present invention. Features of the various embodiments are interchangeable.
[0080] (Detailed description of the diagram of a preferred embodiment) Examples of this disclosure will be described in detail below with reference to the attached drawings.
[0081] Figure 1 shows a flowchart of Method 1000 for capturing multiple computer-readable codes on a medical product or medical product packaging to assist a user. In this embodiment, the method is applicable to capturing barcodes and QR codes (registered trademarks). The method includes the following steps:
[0082] In the first step 1010, the method captures a medical product or its packaging having a code using a camera as a capture device 2.
[0083] In the second step 1020, the method extracts at least a first barcode or QR code and a second barcode or QR code from the captured image.
[0084] The method then proceeds to step 1030. Here, the method interprets the code data with the interpreting device 4 and obtains from the code data at least product ID information and further product information in the form of an expiration date.
[0085] In step 1040, based on the acquired information, it is determined whether the captured code and / or the information in linked database 8 contains a predetermined set of relevant information about the medical product.
[0086] Step 1050 includes selecting the second code as an associated code if the information obtained for the first code is entirely contained within the information obtained for the second code, or selecting both the first and second codes as associated codes if each code contains at least a portion of a predetermined set of associated information.
[0087] Once identification and selection are complete, the process proceeds to step 1060, which transmits the code marker for each code to the display device 6 based on the identification and selection results.
[0088] Finally, the process proceeds to step 1070, which displays an overlay image having the captured image and markings on the code to add auxiliary visual information to the code to provide the user with an improved overview of the computer-readable code, depending on the code markers.
[0089] This method allows for the addition of further information to each code and provides user assistance. The method is particularly an augmented reality method. In this method, real-world information is supplemented by digital-world information, thereby effectively adding relevant information where needed. The method can capture multiple computer-readable codes and automatically verify and interpret each code without requiring user knowledge, presenting the results of data analysis to the user in the form of additional information displayed to facilitate daily operations, particularly in hospitals. Furthermore, because the method performs selections automatically, patient safety and hospital workflow speed are improved. In particular, the method may be applied to automatically add information contained in the code, or at least a portion of it, such as an expiration date, to an overlay image (real world / digital world) to intuitively present the necessary information to the user. This reduces the user's workload, allowing them to focus on their specific task and perform it better. Moreover, since the method is performed automatically by a machine and requires no user assistance or manual input, the possibility of errors is minimized.
[0090] Primarily, the user is presented with a specific QR code or barcode that best conveys information. This allows the user to intuitively understand, for example, which barcode to focus on. Furthermore, if multiple computer-readable codes contain a minimal set of relevant information, those barcodes are precisely indicated to the user. For example, if one of seven barcodes contains expiration date information, that code is highlighted to the user. This allows the user to determine whether or not the product is still within its expiration date. Alternatively, a warning message may be displayed, with the barcode highlighted in a special color such as red, to notify the user that the product has expired. This allows the user to select the appropriate medical product. The method provides the user with an improved overview of relevant information in each applicable specific situation (front-end improvement).
[0091] On the other hand, current scanning devices can only collect images of items placed in front of the scanner and detect and decode the barcodes present. Each barcode is decoded based on its code table. In the case of barcodes, each coded character is coded using the bar and space configuration of the barcode. For example, a character in CODE39 consists of five bars and four spaces. Of these nine elements, three are thick (corresponding to the binary value 1) and six are thin (corresponding to the binary value 0). This codes 43 different uppercase letters, numbers, symbols, and spaces, and has the ability to code all 128 ASCII characters. An example of a decoding table for CODE39 is shown in Figure 5. The decoding unit processes the detected code and returns the decoded string.
[0092] The database can be used to retrieve data that includes what is needed to constitute a complete set of information. For example, the database may include the requirement of an expiration date for medical products, or, for vaccines, a transit period that must not expire. Such constraints can be added from the database. Furthermore, modified requirements can be loaded in the same way. For example, if recall information is added to the database during transit, this will mark scanned items as "expired" or "recalled," thereby preventing their use.
[0093] Optionally, the display may show the user one or more codes that will ultimately be used because one or more codes contain all the necessary information. This can be achieved, for example, by a colored or black-and-white overlay on (one or more) codes, a colored or black-and-white frame around (one or more) codes, symbols such as dots, stars, or arrows next to (one or more) codes, or any other visible markings. The remaining information may then be embellished with additional information selected from master data in a database. Examples of additional information include manufacturer information, hospital item numbers, or item descriptions.
[0094] However, equipment marking is not always done in a format where the information is contained in a single barcode or data matrix. The GS1 standard allows information to be distributed across multiple barcodes. When using conventional barcode scanners, the user must decide which code to scan first, or leave that decision to the barcode scanner. However, in these cases, as detailed above, documentation errors are likely to occur.
[0095] According to the present invention, multiple codes can be read simultaneously. If a complete set of information cannot be obtained from a single code, two or more codes can be combined as described above.
[0096] The present invention aims to make documentation and support as easy as possible for the user. Therefore, the display can work with multiple different color brushes, such as overlays. This allows the user to notice and recognize multiple different coding standards over time. Master data can be used to define how an item should be coded, what codes are assumed, and what information should be documented. A brush, in this context, refers to a colored overlay that indicates the marking of a specific area, similar to a brush used to highlight on paper.
[0097] Below, with reference to Figures 4a to 4z, several examples of medical device coding are shown in detail. Note that the same principles can be applied to devices in various fields.
[0098] As an example of a medical device, implants are described in detail below. It is common for implants to have coded information regarding GTIN / LIC+PNC, expiration date, lot, or serial number. Known coding formats for medical devices include the following: • Pharmaceutical central number (PZN, "Pharmazentralnummer" in German) (shown in Figure 4a) • EAN code (European Article Number) (EAN13 + PZN) (shown in Figure 4b) • EAN13 (shown in Figure 4c) • GS1(01) (shown in Figure 4d) • GS1(01) + GS1(17 / 10) (shown in Figures 4e and 4f) • GS1 (01 / 17 / 10) + EAN 13 (shown in Figure 4g) • GS1(* / 10) + EAN 13 (shown in Figure 4h) • GS1 (01 / 17 / 10) (shown in Figures 4i and 4j) • GS1 (01 / 17 / 21) (shown in Figure 4k) • GS1+HIBC (shown in Figure 4l) • HIBC (shown in Figures 4m and 4n) • Non-standardized codes (shown in Figures 4o and 4p) • OCR combined with barcodes (shown in Figure 4q) • OCR only (shown in Figure 4r) • Sterile products (shown in Figures 4s, 4t, and 4u) • Card number (shown in Figure 4v) • Documenting or resterilizing implants • Electronic Instructions for Use (eIFU) (shown in Figure 4w) • QR code (shown in Figure 4x) • Expiration date certificate.
[0099] In the above, OCR, or Optical Character Recognition, includes recognizing text containing multiple individual characters, and further includes recognizing symbols, specifically, for example, the designation of "lot" in Figure 4p or Figure 4q, or graphic symbols such as the hourglass symbol in Figure 4q. Therefore, this may also be called image recognition and / or may include machine learning that learns the meanings of commonly used symbols.
[0100] Figure 4a shows PZNs. In Germany, pharmaceuticals are assigned a unified pharmaceutical number (PZN). In the EU, a pharmaceutical product number (PPN) is used. PZN or PPN standards do not have priority for the documentation or reordering of implants. However, these codes must be identified and properly interpreted in order to properly track and replenish hospital supplies. PZNs should be marked in a manner distinct from (one or more) GS1 codes, i.e., by a different color, shape, and / or symbol.
[0101] Figure 4b shows the EAN13+PZN combination. Since PZN does not correspond to EAN13, both codes must be interpreted to identify the item. When creating new master data, users should be asked whether the item contains another machine-readable code. The PZN and EAN13 combination is important because it allows data to be properly transmitted to inventory management at the time of order. Once master data has been created, the item should be identified by either PZN or EAN13. PZN should be marked in a manner distinct from the (one or more) GS1 codes, i.e., by a different color, shape, and / or symbol.
[0102] Figure 4c shows EAN13. For items with EAN13, it is assumed that the expiration date and lot or serial number will be manually entered. When scanning and thereby creating new master data, the user should be asked whether the item contains another machine-readable code and whether the expiration date and lot or serial number should be documented. Generally, manual entry should be possible, but is mandatory if required by the equipment. For example, manually recording the lot number on a bandage is inappropriate for the equipment. Also, documenting an implant without a lot number does not meet the documentation requirements. This is further detailed below regarding a different GS1 coding format.
[0103] Figure 4d shows a GS1 with identifier (01). Some devices have barcodes that include a GTIN with identifier (01) and do not contain other codes. Conventional scanners can process the EAN13 immediately, but after scanning the GS1(01) code, they wait for user interaction, such as pressing a "next" button, before processing another code to be scanned. In this case, the master data may indicate that no further codes are expected for this device. Manual entry of lot information may also depend on the master data.
[0104] Figures 4e and 4f show GS1 codes with identifiers other than identifier (01). If it is known that a product has multiple GS1 codes, the user is prompted to change the camera's viewpoint to capture multiple codes.
[0105] Figure 4g shows a GS1 code and an EAN13 on the same package. If the product is found to have a complete GS1 code next to the EAN13, the user will be prompted to scan the GS1 code. In this case, the EAN13 should not be processed.
[0106] Figure 4h shows an item with an EAN13 instead of a GS1 identifier (01). If the master data defines that the product has a second code or that a lot number scan is required, the reader will not process the EAN13 and will wait until the lot number is scanned.
[0107] Figures 4i through 4k show codes that contain the necessary set of related information for a single code. Figure 4l shows an HIBC code. HIBC codes should be marked in a different color than GS1 codes. Medical products should be identified by either an HIBC code or a GS1 code. Figures 4m and 4n also show HIBC codes. From a single HIBC code, the product ID, lot number, and serial number should be obtainable.
[0108] Figures 4o through 4r show non-standardized codes. The code in Figure 4o should not be used for documentation. The reader is capable of reading text to identify what information the codes in Figures 4p and 4q contain. Figure 4r contains no computer-readable code. To process the information in Figure 4r, the reader may use optical character recognition (OCR) or document the product by taking a photograph. Figure 4v also does not belong to any standard. The information in this figure can be obtained by OCR or documented by taking a photograph.
[0109] Figures 4s to 4u show codes for sterile materials. A reader can identify that a medical product is a sterile material and, for example, obtain the expiration date of the material.
[0110] Figures 4w and 4x show codes that lead to a website or instruction containing product information. The website or instruction is opened by a reader and displayed to the user on a display device.
[0111] Figure 6 shows a schematic diagram of a reader 1 according to a preferred embodiment of the present disclosure. The reader 1 comprises a capture device 2, an interpreter 4, a display device 6, and a database 8. The capture device 2 is preferably a camera, and particularly preferably a smartphone camera. A user or device uses the capture device 2 to capture an image of a set of barcodes or to scan a set of barcodes. Barcodes are extracted from or detected within the captured image. The interpreter 4 decodes the extracted barcodes and detects what product information is stored in a single barcode. The interpreter 4 then determines whether a predetermined set of relevant information is available within the barcode or in the linked database 8. The interpreter 4 selects the relevant codes and highlights them on the display device 6.
[0112] A method for capturing multiple computer-readable codes on a medical product or medical product packaging for user assistance in a specific embodiment is described below. Capture device 2 is a camera, preferably a smartphone camera. The user scans a set of computer-readable codes with the camera. The set of computer-readable codes is, for example, a set of barcodes, as shown in Figures 2c and 2d. The camera captures an image of the computer-readable codes. Barcodes are detected in the captured image. Interpretation device 4 decodes the code data stored in the captured barcode. That is, interpretation device 4 decodes the bars in the barcode based on an interpretation table, as shown, for example, in Figure 5. Interpretation device 4 further interprets what information is stored in the barcode.
[0113] In the example in Figure 2c, the interpreter 4 can recognize that the upper barcode contains the product ID, the middle barcode contains the expiration date data and lot number, while the lower barcode contains the product ID, expiration date data, and lot number. The interpreter 4 can link the medical product to the database by its product ID and can determine whether a predetermined set of relevant information exists in the captured barcode and / or database. The interpreter 4 can obtain information on which product information is needed to obtain the complete set of relevant information. This information can be obtained from the database 8 or stored in the interpreter 4. Furthermore, product information such as sterilization date, maximum transport period, or maximum storage period may be stored in the database 8. In this case, the interpreter 4 determines that all necessary information is available in the barcode because the product ID, expiration date, and lot number are provided.
[0114] Next, the interpreting device selects one or more relevant codes. In Figure 2c, the bottom barcode is the relevant code because it contains all the necessary product information, and no other code can add information not stored in the bottom barcode. Based on the positive identification and the selection of the relevant code, the interpreting device 4 transmits code markers for all codes to the display device 6. In this case, the code marker is, for example, a green box marking the bottom code as the relevant code. The other two barcodes are highlighted with yellow or orange boxes to indicate that these barcodes are valid and compliant with the GS1 standard, but are not relevant codes. The user also receives visual feedback, for example, that all relevant information is available and the scan is complete.
[0115] Figure 2d shows another example of a barcode. Interpreter 4 detects that the upper barcode contains the product ID, which is marked with the (01) identifier according to the GS1 standard. The lower barcode contains the lot number (10) and the expiration date (17). Interpreter 4 identifies that a predetermined set of relevant information is available in the captured barcode. Thus, a positive identification is made. Since no single barcode contains all the necessary product information, Interpreter 4 selects both barcodes as relevant codes. Therefore, Interpreter 4 combines the information obtained from the two barcodes to obtain the predetermined set of relevant information. As a result, both barcodes are marked in green on the display device 6.
[0116] When the interpreting device 4 determines that a predetermined set of associated information is not present in a barcode set, the display device 6 displays a warning or message to the user indicating that the data is incomplete. The user then receives a request prompting them to scan more barcodes.
[0117] In particular, if the reading device is a mobile device equipped with a camera and a display, the user can easily interact with the reading device and use it before or during surgery.
[0118] Although some embodiments have been described in the context of apparatus, these embodiments also represent descriptions of corresponding methods, and it is obvious that the apparatus or a part of it corresponds to a method step or a feature of a method step. Similarly, embodiments described in the context of method steps also represent descriptions of a corresponding apparatus or a part of an apparatus or a part of an article or a feature of a corresponding apparatus. Some or all of the method steps may be carried out by (or using) a hardware device such as a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, such a device may perform one or more of the most important method steps. [Explanation of Symbols]
[0119] 1: Reading device 2: Capture device 4: Interpretation equipment 6: Display equipment 8: Database 100: Reading System 1000: Method 1010: Steps to capture an image 1020: Steps to extract code from an image 1030: Steps to interpret the code 1040: Step to identify a predetermined set of information 1050: Step to select a code 1060: Step to send a code marker 1070: Step to display an overlay image
Claims
1. 1. A method for capturing a plurality of computer readable codes on a medical product or packaging of the medical product to assist a user, comprising: capturing an image of the medical product or the packaging of the medical product with a capture device; extracting at least a first computer readable code and a second computer readable code in the captured image; interpreting the first computer readable code and the second computer readable code with an interpretation device and obtaining at least product identification information and further product information associated with each of the first computer readable code and the second computer readable code; determining whether a predetermined set of associated information about the medical product is included in information and / or a linked database associated with each of the first computer readable code and the second computer readable code based on the obtained information; selecting the second computer readable code as an associated code if the obtained information associated with the first computer readable code is completely contained in the obtained information associated with the second computer readable code, or selecting the first computer readable code and the second computer readable code as the associated codes if each of the information associated with the first computer readable code and the second computer readable code includes at least a portion of information of the predetermined associated information set; transmitting a code marker for each of the first computer readable code and the second computer readable code to a display device based on a result of the identifying step and a result of the selecting step; displaying an overlay image having the captured image and markings of each of the first computer readable code and the second computer readable code in response to the code markers for adding auxiliary visual information to each of the first computer readable code and the second computer readable code to provide the user with an improved overview of the first computer readable code and the second computer readable code.
2. 2. The method of claim 1 , wherein one or more of the code markers include a color and / or shape of an overlay around the barcode and / or information indicative of text and / or symbols on or near each of the first computer readable code and the second computer readable code.
3. adding, by said interpretation device, said product information to said database; determining, by said interpretation device, whether said database contains said predetermined required information; if said identification is negative, assigning a warning or message to at least one of said code markers of said first computer readable code and said second computer readable code; displaying, by the display device, the overlay image to the user, the warning or message being assigned to at least one of the first computer readable code and the second computer readable code; The method of claim 1 further comprising:
4. linking, by said interpretation device, said obtained product ID to said database by storing said product ID in said database or by linking said product ID of said association code to an existing associated product ID in said database; adding, by said interpretation device, said further product information data to said database of product IDs; determining, by said interpreting device, whether said database of linked product IDs contains said predetermined required information; The method of claim 3 further comprising:
5. Identifying each of the first computer readable code and the second computer readable code having respective associated information, the respective associated information including the predetermined set of associated information about the medical product; displaying the overlay image having a green box surrounding each of the first computer readable code and the second computer readable code having respective associated information identified as comprising the predetermined set of associated information about the medical product; The method of claim 1 further comprising:
6. A method of identifying each of the first computer-readable code and the second computer-readable code, each of which has associated therewith information that has been identified as invalid because it does not conform to a standard corresponding to the computer-readable code; displaying the overlay image with each of the first and second computer readable codes having associated therewith information that has been identified as invalid because it does not conform to a standard corresponding to the computer readable code being covered / hidden / dimmed; The method of claim 1 further comprising:
7. A method of the present invention comprising the steps of: assigning at least a portion of information associated with each of at least one of the first computer readable code and the second computer readable code to the code marker of each of the first computer readable code and the second computer readable code; displaying the portion of information next to each of the first computer readable code and the second computer readable code in the overlay image to assist the user with further information regarding the medical product; The method of claim 1 further comprising:
8. The method of claim 1 , wherein the plurality of computer readable codes are bar codes and / or two-dimensional codes.
9. The method of claim 1 , wherein the capture device is a smartphone having a camera.
10. The method of claim 1 , wherein the predetermined required information includes the product ID, expiration date, and / or lot number.
11. The method of claim 1, wherein the product information is an expiration date.
12. 1. A reading device for capturing a plurality of computer readable codes on a medical product or a package of the medical product to assist a user, comprising: a capture device configured to capture an image of the medical product or the packaging of the medical product and extract at least a first computer readable code and a second computer readable code within the captured image; An interpretation device, interpreting the first computer readable code and the second computer readable code to obtain at least product identification information and further product information associated with each of the first computer readable code and the second computer readable code; Identifying, based on the obtained information, whether a predetermined set of associated information about the medical product is included in information associated with each of the first computer readable code and the second computer readable code and / or in a linked database stored in a memory of the reading device or a memory of a server; selecting the second computer readable code as an associated code if information associated with the first computer readable code is completely contained in information associated with the second computer readable code, or selecting the first computer readable code and the second computer readable code as the associated codes if information associated with the first computer readable code and the second computer readable code each contain at least a portion of information of the predetermined associated information set; an interpretation device configured to transmit a code marker of each of the first computer readable code and the second computer readable code to a display device based on the identifying result and the selecting result; a display device configured to display an overlay image having the captured image and a marking of each of the first computer readable code and the second computer readable code in response to the code markers for adding auxiliary visual information to each of the first computer readable code and the second computer readable code to provide the user with an improved overview of the first computer readable code and the second computer readable code; A reading device comprising:
13. 13. The reading device of claim 12, wherein the interpretation device is configured to determine whether information associated with at least one of the first computer-readable code and the second computer-readable code conforms to the GS1 standard and another GS1 standard barcode may also be captured, and if the determination is positive, the display device displays feedback to the user to capture another computer-readable code.
14. 13. The reading device of claim 12, wherein the interpretation device has character recognition capabilities and is configured to link at least one of the first computer readable code and the second computer readable code to a description not defined in the first computer readable code and the second computer readable code.
15. The reading device of claim 12, wherein the interpretation device determines whether information associated with at least one of the first computer readable code and the second computer readable code belongs to a sterile material, and if the determination is positive, the interpretation device obtains additional information about the sterile material from the database.
16. 13. The reading device of claim 12, wherein the interpretation device is adapted to, upon determining that information associated with each of the first computer readable code and the second computer readable code does not include all information within the predetermined set of associated information, disable an associated powered medical product and display a warning to the user via the display device.
17. 13. The reading device of claim 12, wherein the interpretation device has a predetermined set of selectable code markers stored in the memory, the code markers including information indicative of the color and / or shape of an overlay around the barcode and / or text and / or symbols on or near each code.
18. A reading device as described in claim 15, wherein the additional information about the sterile material is an expiration date.
19. The reading device of claim 16, wherein the function of the medical product is a power source.
20. A reading device as described in claim 12, further comprising a central server device having storage with a database and connected to the at least one reading device for transmitting and receiving data to and from the at least one reading device.
21. When executed by a computer, capturing an image of the medical product or packaging of said medical product with a capture device; extracting at least a first computer readable code and a second computer readable code in the captured image; interpreting the first computer readable code and the second computer readable code with an interpretation device and obtaining at least product identification information and further product information associated with each of the first computer readable code and the second computer readable code; determining whether a predetermined set of associated information about the medical product is included in information and / or a linked database associated with each of the first computer readable code and the second computer readable code based on the obtained information; selecting the second computer readable code as an associated code if the obtained information associated with the first computer readable code is completely contained in the obtained information associated with the second computer readable code, or selecting the first computer readable code and the second computer readable code as the associated codes if each of the information associated with the first computer readable code and the second computer readable code includes at least a portion of information of the predetermined associated information set; transmitting a code marker for each of the first computer readable code and the second computer readable code to a display device based on a result of the identifying step and a result of the selecting step; and displaying an overlay image having the captured image and markings of each of the first and second computer readable codes in response to the code markers for adding auxiliary visual information to each of the first and second computer readable codes to provide a user with an improved overview of the first and second computer readable codes.
