Apparatus designed to produce and interpret results from light-transmissive diagnostic kits and operation method of the same
The electronic device and diagnostic kit reader system addresses low accuracy and multi-target detection limitations by automating signal generation and analysis, ensuring accurate and user-friendly diagnostic outcomes.
Patent Information
- Application Number
- KR1020240056528
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-04-29
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2044-04-29
AI Technical Summary
Conventional rapid immunodiagnostic kits face challenges with low accuracy, especially in detecting low concentrations of target substances and limited capability for simultaneous detection of multiple targets, requiring specialized knowledge for operation and analysis.
An electronic device and diagnostic kit reader system that generates and reads optical signals from diagnostic kits, enabling qualitative and quantitative analysis through LED illumination, camera module image conversion, and electronic device processing, allowing general users to operate via wired or wireless connection for automated analysis.
Enables accurate detection of low-concentration components and multiple targets with a single measurement, providing clear analysis results to non-specialist users through automated processing and integration with smart devices.
Smart Images

Figure 112024046576211-PAT00001_ABST
Abstract
Description
Technology Field
[0001] The present application relates to an electronic device for signal generation and reading of an optical-transmitting diagnostic kit and a method of operating the same. Background Technology
[0003] Recently, the paradigm of disease diagnosis has been shifting toward preventive medicine, which focuses on early treatment and prevention of disease spread through early diagnosis, and there is a constant demand for the development of accurate and rapid diagnostic technologies. Among various next-generation diagnostic technologies, interest in in vitro diagnostics (IVD) has increased rapidly. In vitro diagnostics refers to technologies that utilize substances derived from the human body, such as tissue, blood, saliva, urine, and cell wash fluid, to rapidly diagnose, predict, and monitor diseases outside the body.
[0004] Since the COVID-19 pandemic, existing diagnostic methods have not only struggled to provide sufficient medical services to large patient populations but also made it difficult to effectively cope with the emergence and spread of various virus variants, leading to a need for improvements in the confirmation processing speed of molecular diagnostic methods and enhancement of the sensitivity of rapid immunodiagnostics.
[0005] Diagnostic kits based on conventional rapid immunoassays are diagnostic devices that utilize antigen and antibody immunoassays, and most of them use Lateral Flow Assay (LFA) technology. This technology has the advantage of providing analysis results within a short time of about 10 minutes, offering high convenience of use, and low costs. However, it has the disadvantage of low accuracy due to low sensitivity, making it difficult to detect when the concentration of the target substance is low, and requiring general users without specialized knowledge to derive analysis results themselves. Additionally, it has the disadvantage of poor efficiency in situations requiring the simultaneous detection of multiple target substances, as it can primarily detect only one type of target substance.
[0006] The diagnostic kit reader that has been primarily used in the past is a reflective type diagnostic kit reader that irradiates light onto the kit and collects and detects the reflected light, and is primarily intended for the LFA-based diagnostic kit described above.
[0007] Furthermore, with the recent increase in the use of smart devices, there is also a growing demand for technology that diagnoses and manages diseases at the point of demand, based on the control and data management of diagnostic kit readers through integration with smart devices.
[0008] Accordingly, there is a growing need for diagnostic kits that can compensate for the aforementioned shortcomings, as well as methods to accurately analyze their results. Prior art literature
[0010] Korean Patent Publication No. 2018-0107759 The problem to be solved
[0011] One object of the present disclosure is to provide an electronic device for generating and reading signals of an optically-transmitting diagnostic kit and a method of operating the same.
[0012] The electronic device of the present invention controls a diagnostic kit reader to generate a diagnostic signal, reads it using the kit reader, and performs qualitative and quantitative analysis of a target substance to be detected based on the diagnostic signal, thereby enabling the user to clearly identify the state of the target substance, such as its concentration and type, to be analyzed. Furthermore, the invention aims to provide convenience to the user by allowing even a general user without specialized knowledge to easily operate the kit reader through an electronic device connected to the kit reader via wired or wireless means, and by enabling the final analysis results to be received after the entire process from signal generation and acquisition to analysis is performed fully automatically through the electronic device.
[0013] Another objective of the present disclosure is to accurately detect a component even when its concentration is low, and to analyze one or more targets with only a single measurement of the sample inserted into the diagnostic kit.
[0014] The problems that the present disclosure aims to solve are not limited to those described above, and problems not mentioned will be clearly understood by those skilled in the art from the present specification and the accompanying drawings. means of solving the problem
[0016] According to one embodiment of the present disclosure, a method of operation of an electronic device for signal generation and reading of a light-transmitting diagnostic kit is provided, comprising: an operation of establishing a communication connection with a diagnostic kit reader including a light source unit and a detector unit; an operation of operating at least one LED included in the light source unit to transmit light to the diagnostic kit; and an operation of operating a camera module included in the detector unit to convert the transmitted light into an electrical signal to generate image data.
[0017] The means for solving problems of the present invention are not limited to the means described above, and unmentioned means of solving problems will be clearly understood by those skilled in the art from this specification and the attached drawings. Effects of the invention
[0019] A method of operation of an electronic device according to one embodiment of the present disclosure objectively provides qualitative or quantitative analysis results of a target substance to general users without specialized knowledge, thereby enabling general users to clearly understand the state of the object to be analyzed.
[0020] A method of operation of an electronic device according to one embodiment of the present disclosure enables users to easily and conveniently control a diagnostic kit reader anywhere through a wired or wireless connection with the diagnostic kit reader, and makes it easy to receive the results through the electronic device.
[0021] A method of operation of an electronic device according to one embodiment of the present disclosure enables accurate detection of a component to be detected even when the concentration is low by using a diagnostic kit reader with high light source detection sensitivity.
[0022] The effects of the present invention are not limited to the effects described above, and unmentioned effects will be clearly understood by those skilled in the art from this specification and the accompanying drawings. Brief explanation of the drawing
[0024] FIG. 1 is a diagram showing a diagnostic kit signal generation and reading system according to one embodiment. FIG. 2 is a diagram illustrating the configuration of a diagnostic kit signal generation and reading system according to one embodiment. FIG. 3 is a diagram illustrating the operation of an electronic device generating a signal of a light-transmitting diagnostic kit and acquiring image data according to one embodiment. Figure 4 is a diagram showing an example of image data. FIG. 5 is a diagram illustrating the operation of an electronic device receiving and analyzing image data according to one embodiment. Figure 6 is a diagram showing a specific example of the operation of an electronic device analyzing image data. Figure 7 is a diagram showing another specific example of the operation of an electronic device analyzing image data. FIG. 8 is a diagram illustrating the operation of an electronic device determining a final signal reading result based on auxiliary image data according to one embodiment. FIG. 9 is a diagram illustrating the operation of an electronic device according to one embodiment, which provides a signal reading result to a user and provides information related to an analysis target to the user based on the result. Figure 10 is a diagram showing an example of a signal reading result provided to a user. Specific details for implementing the invention
[0025] The configuration and operation of a preferred embodiment of the present disclosure will be described in detail below with reference to the attached drawings.
[0026] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components.
[0027] In this document, the singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of the phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another corresponding component and do not limit the components in any other aspect (e.g., importance or order).
[0028] In this document, where it is stated that any (e.g., 1) component is "(operatively or communicatively) coupled with / to" or "connected to" another (e.g., 2) component, with or without the terms "functionally" or "communicatively," it means that said component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0029] As used in this document, the term "module" may mean a unit comprising one or more combinations of hardware, software, or firmware, for example. "Module" may be interchangeably used with terms such as unit, logic, logical block, component, or circuit, for example. "Module" may be the smallest unit of a component formed integrally or a part thereof. "Module" may be the smallest unit or a part thereof that performs one or more functions. "Module" may be implemented mechanically or electronically. For example, "Module" may include at least one of an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or programmable-logic device that performs certain operations, whether known or to be developed in the future.
[0030] An electronic device according to various embodiments of this document may include, for example, at least one of a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, a desktop personal computer, a laptop personal computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device. According to various embodiments, the wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, a contact lens, or a head-mounted device (HMD)), a fabric or clothing integrated type (e.g., electronic clothing), a body-attached type (e.g., a skin pad or a tattoo), or a bio-implantable type (e.g., an implantable circuit).
[0031] Various embodiments of this document may be implemented as software (e.g., a program) comprising one or more instructions stored in a storage medium (e.g., internal memory) or external memory that is readable by a machine (e.g., an electronic device). For example, a processor (e.g., a processor) of a machine (e.g., an electronic device) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by a machine may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.
[0032] Methods according to the various embodiments disclosed in this document may be provided as part of a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0033] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0035] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the attached drawings.
[0037] FIG. 1 is a diagram showing a diagnostic kit signal generation and reading system according to one embodiment.
[0038] A diagnostic kit signal generation and reading system according to the present disclosure can generate a signal of a diagnostic kit, read the signal, and provide the result to a user. To generate a signal of a diagnostic kit and read the signal, a diagnostic kit that injects a sample containing saliva or body fluid may be used. Additionally, the system can read the signal of the diagnostic kit based on image data. Specifically, the system can analyze pixel data based on image data and analyze the target substance detection result based thereon. Furthermore, the system can determine the diagnostic result based on the analyzed target substance detection result. Additionally, the system can train an artificial intelligence model using user information, wavelength values of a light source, a diagnostic target, multiple image data, pixel data, and signal reading results as training data. In this case, the system can train the artificial intelligence model to produce a signal reading result based on image data.
[0039] In addition, the system can provide information related to the analysis target to the user based on the signal reading result. A system according to one embodiment can select at least one piece of information related to the analysis target suitable for the signal reading result from a pre-stored database and provide it to the user.
[0041] Below, an example of the configuration of a diagnostic kit signal generation and reading system is described with reference to the attached drawings.
[0042] FIG. 2 is a diagram illustrating the configuration of a diagnostic kit signal generation and reading system according to one embodiment.
[0043] Referring to FIG. 2, a diagnostic kit signal generation and reading system may include a diagnostic kit reader (1) and an electronic device (2). However, the system may be implemented to include more devices and / or fewer devices, not limited to the examples shown and / or described.
[0044] The diagnostic kit reader (1) may be a device that generates a signal from a diagnostic kit in which a sample containing saliva or body fluid is injected, or analyzes said generated signal. Additionally, the diagnostic kit reader (1) may be connected to an electronic device (2) via a communication module. The diagnostic kit reader (1) irradiates light to transmit it into the diagnostic kit and converts said transmitted light into an electrical signal to generate image data. Here, the image data may be image data generated by transmitting light into a diagnostic kit into which a sample containing body fluid or saliva has been injected.
[0045] Additionally, the diagnostic kit reader (1) can read the signal of the diagnostic kit by analyzing image data. More specifically, the diagnostic kit reader (1) can analyze pixel data based on image data and analyze the target substance detection result based thereon. Furthermore, the diagnostic kit reader (1) can determine the diagnostic result based on the analyzed target substance detection result.
[0046] Additionally, the diagnostic kit reader (1) may provide the user with the signal reading results of the diagnostic kit. Here, the signal reading results may include, but are not limited to, the results of target substance detection or diagnosis. Additionally, the diagnostic kit reader may provide the user with information related to the subject of analysis based on the results. The diagnostic kit reader may provide the signal reading results of the diagnostic kit, information related to the subject of analysis, etc., through an interface, but is not limited to.
[0047] Additionally, the diagnostic kit reader (1) may be a device that performs the operation of the electronic device (2) described later. A detailed explanation of this will be provided later in the description of the operation.
[0048] Referring to FIG. 2, the diagnostic kit reader (1) may include a light source unit (101), a detection unit (102), a kit tray, a processor (103), a memory (104), and a communication module (105). However, the diagnostic kit reader (1) may be implemented to include more devices and / or fewer devices, not limited to the illustrated and / or described examples.
[0049] The light source unit (101) may include at least one LED. The at least one LED may be arranged based on at least one of the number of LEDs, an array, or an arrangement shape. According to one embodiment, the at least one LED may be arranged as a single LED or a plurality of LEDs. More specifically, the plurality of LEDs may be arranged as 2 to 100 LEDs. According to one embodiment, the plurality of LEDs may be arranged as an array. Here, an array refers to an arrangement in which LEDs are arranged; for example, a 2x2 array means that two LEDs are arranged in the horizontal and vertical directions, respectively. More specifically, the plurality of LEDs may be arranged as a 1x2 to 10x10 array. According to one embodiment, the at least one LED may be arranged in the shape of a circle, triangle, square, pentagon, hexagon, etc., but is not limited thereto. More specifically, the at least one LED may be arranged in a circle or a square. By diversifying the arrangement of LEDs in this way, the intensity or path of light irradiated onto the kit can be optimized, thereby allowing the signal reading result of the diagnostic kit to be determined efficiently.
[0050] The detection unit (102) may include a camera module. Here, the camera module may generate image data regarding the signal reading result of the diagnostic kit. The camera module may include an image sensor, which is a device that converts an optical image into an electrical signal and may be composed of a chip with multiple photodiodes integrated therein. For example, the image sensor may include a CCD (Charge Coupled Device), CMOS (Complementary Metal Oxide Semiconductor), etc., but is not limited thereto.
[0051] The kit tray may be a space for placing the kit to be diagnosed and may be necessary for inserting and removing the diagnostic kit. The kit tray may protrude outward from the slot or be inserted inward into the slot. The slot may be formed on the front or side of the diagnostic kit reader (1). The protrusion and insertion may be moved manually by the user or moved automatically or semi-automatically by adding a specific device.
[0052] A processor (103) included in the diagnostic kit reader (1) according to the present disclosure may provide a plurality of functions for generating and reading signals of the diagnostic kit. Since the processor (103) of the diagnostic kit reader may be implemented identically or similarly to the processor (201) of the electronic device described later, a more detailed description is omitted. Since the memory (104) included in the diagnostic kit reader (1) may be implemented identically or similarly to the memory (202) of the electronic device described later, a more detailed description is omitted. In addition, a communication module (105) included in the diagnostic kit reader (1) according to the present disclosure may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the diagnostic kit reader and the electronic device described later (e.g., user electronic device) or an external electronic device, and the performance of communication through the established communication channel. Since the communication module (105) included in the diagnostic kit reader (1) may be implemented identically or similarly to the communication module (203) of the electronic device described later, a more detailed description is omitted.
[0053] The electronic device (2) may be an electronic device used by users who wish to read the signal of a diagnostic kit through a diagnostic kit reader. For example, the electronic device (2) may include, but is not limited to, a PC, a laptop, a smartphone, and a wearable device such as a head-mounted display (HMD) device, and may further include a type of electronic device capable of receiving user input and displaying a graphic user interface (GUI) for operating the diagnostic kit reader or providing information related to signal reading results and analysis targets.
[0054] The electronic device (2) can establish a communication connection with the diagnostic kit reader (1) through a communication module and can operate the diagnostic kit reader (1) through communication to cause the diagnostic kit reader to generate image data. Additionally, the electronic device (2) according to one embodiment can operate the diagnostic kit reader (1) through communication to cause the diagnostic kit reader to read the signal of the diagnostic kit based on the image data.
[0055] The electronic device (2) can receive image data generated from the diagnostic kit reader (1) and can read the signal of the diagnostic kit by analyzing the received image data. In a more specific embodiment, the electronic device (2) can analyze pixel data based on the image data and analyze the target substance detection result based thereon. Furthermore, the electronic device (2) can determine the diagnostic result based on the analyzed target substance detection result.
[0056] Additionally, the electronic device (2) may provide the user with the signal reading results of the diagnostic kit. Here, the signal reading results may include, but are not limited to, the results of target substance detection or diagnostic results. Here, the signal reading results may be results read by the operation of the electronic device (2) or the operation of the diagnostic kit reader (1). Additionally, the electronic device (2) may provide the user with information related to the analysis target based on the results. The electronic device may provide the signal reading results of the diagnostic kit, information related to the analysis target, etc., through an interface, but is not limited thereto.
[0057] Referring to FIG. 2, the electronic device (2) may include a processor (201), memory (202), and a communication module (203). However, the electronic device may be implemented to include fewer or more configurations, not limited to the examples shown and / or described. In this case, the electronic device may include a server device, but is not limited thereto.
[0058] The processor (201) may include at least one processor implemented such that at least some parts provide different functions. For example, it may execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of an electronic device connected to the processor (201) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (201) may store instructions or data received from other components in memory (202) (e.g., volatile memory), process the instructions or data stored in the volatile memory, and store the resulting data in non-volatile memory. According to one embodiment, the processor (201) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with it. For example, if the electronic device includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a designated function. An auxiliary processor may be implemented separately from the main processor or as part thereof. The auxiliary processor may control at least some of the functions or states associated with at least one component of the electronic device (e.g., communication module (203)) on behalf of the main processor while the main processor is in an inactive (e.g., sleep) state, or together with the main processor while the main processor is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., communication module (203)).According to one embodiment, an auxiliary processor (e.g., a neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device itself where the artificial intelligence model is executed, or through a separate server. The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. The artificial intelligence model may include, additionally or substantially, a software structure in addition to the hardware structure. Meanwhile, the operation of the electronic device (or computing device) described below can be understood as the operation of the processor (201).
[0059] A processor (201) included in an electronic device (2) according to the present disclosure may provide a plurality of functions for generating and reading signals of a diagnostic kit. Specifically, the processor (201) may perform functions such as operating an LED included in a light source unit (101) of a diagnostic kit reader to transmit light to the diagnostic kit, operating a camera module included in a detection unit (102) of a diagnostic kit reader to convert the transmitted light into an electrical signal to generate image data, analyzing the image data to read the signal of the diagnostic kit, and providing information related to the signal reading result and the object of analysis, but is not limited thereto. For example, the processor (201) may include an LED operating unit (201a), a camera module operating unit (201b), an analysis unit (201c), an information providing unit (201d), but is not limited thereto.
[0060] In this disclosure, the processor is distinguished into a plurality of units (e.g., "~parts") based on its function; however, this is for the convenience of explanation and does not mean that each unit is necessarily implemented in separate hardware. That is, the plurality of units included in the processor may be implemented in separate hardware, but they may also be implemented in a single hardware.
[0061] The LED operating unit (201a) can transmit light to the diagnostic kit by operating at least one LED included in the light source unit (101) of the diagnostic kit reader. Detailed information on the method of transmitting light to the diagnostic kit using the LED operating unit (201a) is described in FIG. 3.
[0062] The camera module operating unit (201b) can generate image data by converting transmitted light into an electrical signal through the operation of the camera module included in the detection unit (102) of the diagnostic kit reader. Detailed information on the method of generating image data using the camera module operating unit (201b) is described in FIG. 3.
[0063] The analysis unit (201c) can read the signal of the diagnostic kit based on image data. More specifically, the analysis unit (201c) can analyze the target substance detection result by analyzing pixel data based on the generated image. Furthermore, the analysis unit (201c) can determine the diagnostic result based on the target substance detection result. According to one embodiment, the analysis unit (201c) can read the signal of the diagnostic kit using at least one artificial intelligence model. Detailed information on the method of reading the signal of the diagnostic kit using the analysis unit (201c) is described in FIGS. 4 to 9.
[0064] The information providing unit (201d) can provide the user with the signal reading results of the diagnostic kit, information related to the analysis target, etc. According to one embodiment, the information providing unit (201d) can provide information related to the analysis target based on the signal reading results using a pre-stored database. Detailed information on the method of providing the user with the signal reading results of the diagnostic kit, information related to the analysis target, etc. using the information providing unit (201d) is described in FIG. 10.
[0065] The memory (202) may store various data output by at least one component of the electronic device (e.g., processor (201)). The data may include, for example, software (e.g., a program) and input or output data for related instructions. The memory (202) may include volatile memory or non-volatile memory. The memory (202) may be implemented to store an operating system, middleware or an application, and / or the aforementioned artificial intelligence model.
[0066] Additionally, the memory (202) included in the electronic device (2) according to the present disclosure may include at least one database constructed for a specific purpose. Specifically, the electronic device may include at least one database (DB) constructed to read signals from a diagnostic kit and provide information related to a suitable analysis target. For example, the memory (202) may include, but is not limited to, an image data DB that stores generated image data or a health DB that stores information related to an analysis target.
[0067] Additionally, the electronic device (2) may be implemented to store at least one database described above using memory (202), but is not limited thereto, and may be implemented to receive data previously stored in an external device.
[0068] The communication module (203) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device and an external electronic device (e.g., a diagnostic kit reader), and the performance of communication through the established communication channel. The communication module (203) may include one or more communication processors (e.g., a communication chip) that operate independently of the processor (201) (e.g., a program processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (203) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., a LAN (local area network) communication module, a cable communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (e.g., mobile device, wearable device, or server device) through a first network (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, hotspot, Zigbee, NFC (near field communication), RFID (radio frequency identification), or IrDA (infrared data association)) or a second network (e.g., a legacy cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).The wireless communication module can identify or authenticate an electronic device within a communication network, such as a first network or a second network, by using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in a subscriber identification module. The wireless communication module can support 5G networks following 4G networks and next-generation communication technologies, such as new radio access technology (NR access technology). NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module can support high-frequency bands (e.g., mmWave band) to achieve high data transmission rates, for example. The wireless communication module may support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beamforming, or large-scale antenna. According to one embodiment, the wireless communication module may support a peak data rate for realizing eMBB (e.g., 20 Gbps or higher), loss coverage for realizing mMTC (e.g., 164 dB or lower), or U-plane latency for realizing URLLC (e.g., downlink (DL) and uplink (UL) each of 0.5 ms or lower, or round trip 1 ms or lower).
[0069] Meanwhile, not limited to the examples illustrated and / or described in FIG. 2, the operation described below may be implemented in an on-device form in the electronic device (2), and the server may be implemented so that the diagnostic kit result reading service can be performed on the server, and the operation of the electronic device (2) described below may be implemented on the server.
[0071] Hereinafter, examples of the operation of the electronic device (2) according to various embodiments are described. The operation of the electronic device (2) described below may be understood as the operation of a server implemented in a server.
[0072] FIG. 3 is a diagram illustrating the operation of an electronic device generating a signal and acquiring image data of a light-transmitting diagnostic kit according to one embodiment. However, the operations may be performed regardless of the order of the illustrated and / or described operations, and more operations may be performed and / or fewer operations may be performed.
[0073] More specifically, in the operation of generating a signal of a diagnostic kit, an electronic device (2) according to one embodiment can establish a communication connection with a diagnostic kit reader (1) (S100), operate at least one LED included in a light source unit (101) to transmit light to the diagnostic kit (S200), and operate a camera module included in a detection unit (102) to convert the transmitted light into an electrical signal to generate image data (S300).
[0074] Referring to FIG. 3, the electronic device can establish a communication connection with the diagnostic kit reader (1) according to operation S100. According to one embodiment, the operation may be performed through a communication module (203) included in the electronic device. According to one embodiment, the communication module (203) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., a LAN (local area network) communication module, a cable communication module, or a power line communication module). Accordingly, in operation S100, the electronic device may be established with the diagnostic kit reader via a wireless communication connection or a wired communication connection.
[0075] Additionally, according to operation S200, the electronic device may operate at least one LED included in the light source unit (101) to transmit light to the diagnostic kit. According to one embodiment, in operation S200, the electronic device may control at least one of the blinking, brightness, and wavelength of the LED based on a first control condition. At this time, the first control condition may include at least one of a target substance, a label substance, a kit shape, a number of diagnostic areas, and a location of the diagnostic area. In the present disclosure, "label substance" may refer to a substance that is coupled to a target substance to detect the target substance and is implemented to enable visual detection of the target substance within a diagnostic kit reader. Also in the present disclosure, "kit shape" may refer to the shape of the diagnostic kit and may include, but is not limited to, a strip shape, a disk shape, etc. Also in the present disclosure, "diagnostic area" may be an area implemented to detect the target substance in the diagnostic kit and may include a sensor for detecting the target substance.
[0076] For example, the electronic device can control the blinking of LEDs by considering the number of diagnostic areas and the location of the diagnostic areas. Accordingly, the electronic device can uniformly transmit light to multiple diagnostic areas. Here, controlling the blinking of LEDs may be done by turning some LEDs on and turning some LEDs off. As another example, the electronic device can control the brightness of LEDs by considering the shape of the kit. Accordingly, the electronic device can transmit light of a brightness suitable for detection to the diagnostic kit. As yet another example, the electronic device can control the wavelength of LEDs by considering the label material. Here, when gold nanoparticles are used as the label material, since gold nanoparticles are visually expressed as red, the wavelength of the LED can be controlled to a range of 500 nm to 600 nm, which represents green, the complementary color of said red.
[0077] In this way, by controlling the LED while considering various control conditions, the brightness or wavelength of the light irradiated onto the kit can be optimized, allowing for efficient reading of the signal results from the diagnostic kit.
[0078] Additionally, the electronic device may, in accordance with operation S300, operate a camera module included in the detection unit (102) to convert the transmitted light into an electrical signal and generate image data. Here, the image data may be data required to read the signal of the diagnostic kit in an operation to be described later. According to one embodiment, in operation S300, the electronic device may generate one or more image data.
[0079] FIG. 4 is a diagram illustrating an example of image data generated by the above operation S300. Image data according to one embodiment may be generated such that a shape such as a spot appears in the diagnostic area depending on the presence or absence of a target substance in a sample contained in a diagnostic kit, but is not limited thereto. In the case where there are multiple diagnostic areas of the diagnostic kit, image data according to one embodiment may be generated such that the shape of the spot appears arranged in a circular, linear, triangular, square, pentagonal, hexagonal shape, etc., based on the arrangement of the multiple diagnostic areas, but is not limited thereto. In this case, image data may be generated so that signals from multiple diagnostic kits can be read simultaneously.
[0080] According to one embodiment, in operation S300, the electronic device (2) may control at least one of the position, function, ISO sensitivity, shutter speed, shooting angle, and shooting operation of the camera module based on a second control condition. Here, the function may include, but is not limited to, a function for adjusting brightness, sharpness, contrast, white balance, etc. At this time, the second control condition may include at least one of the conditions of the shooting area, target material, label material, kit type, number of diagnostic areas, and location of the diagnostic area. Here, the conditions of the shooting area may include, but are not limited to, the brightness, contrast, sharpness, color, etc. of the area to be photographed. For example, the electronic device may control the ISO sensitivity to be high to generate bright image data when the shooting area is dark. As another example, the electronic device may control the macro function of the camera module to increase sharpness. Here, when photographing multiple diagnostic areas, the sharpness of each diagnostic area may be increased uniformly. As another example, the electronic device may adjust the white balance by considering the color of the shooting area. As another example, the electronic device can proceed with shooting with the camera module if all of the second control conditions satisfy a predetermined range.
[0081] In this way, by controlling the camera module considering various control conditions, image data can be generated in an environment desired by the user or pre-set, and this generates image data in a state optimized for analysis, thereby enabling efficient reading of signals from the diagnostic kit.
[0082] Additionally, the electronic device (2) according to one embodiment can control the operation of the kit tray. Here, the operation of the kit tray may be an operation regarding the protrusion or retraction of the kit tray. For example, the electronic device can control the kit tray to protrude or retract based on input from a user regarding the protrusion or retraction. As another example, the electronic device can control the kit tray to protrude or retract by detecting whether a diagnostic kit is placed in the kit tray.
[0083] FIG. 5 is a diagram illustrating the operation of an electronic device (2) receiving image data and analyzing the image data to read a signal of a diagnostic kit according to one embodiment. However, the operations may be performed regardless of the order of the operations shown and / or described, and more operations may be performed and / or fewer operations may be performed.
[0084] Referring to FIG. 5, the electronic device (2) can receive generated image data through a communication module in operation S400. Additionally, the electronic device (2) can analyze the received image data in operation S500 to read the signal of the diagnostic kit. In this way, by receiving and analyzing the generated image data in the electronic device, components such as an analysis module can be excluded from the essential components of the diagnostic kit reader, thereby drastically reducing the weight, size, and cost of the diagnostic kit reader. Furthermore, users can easily receive analysis results by utilizing electronic devices connected to the kit reader via wired or wireless means, thereby providing convenience to the users.
[0085] FIG. 6 is a diagram illustrating a specific example of an operation (S500) in which an electronic device (2) according to one embodiment analyzes image data to read a signal of a diagnostic kit. However, the operations may be performed regardless of the order of the illustrated and / or described operations, and more operations may be performed and / or fewer operations may be performed.
[0086] Referring to FIG. 6, an electronic device (2) according to one embodiment can analyze pixel data based on image data in operation S510 (S510). More specifically, the electronic device can analyze pixel data of a diagnostic area within the image data. In the present disclosure, "diagnostic area" may be an area implemented to detect a target substance in a diagnostic kit and may include a sensor that detects the target substance. Also in the present disclosure, "pixel data" may be used as a term meaning information regarding a pixel of a camera sensor, and said pixel data may include information regarding the brightness or color of the pixel.
[0087] More specifically, information regarding the brightness of the pixel can be expressed as a value within the range of 0 to 225. Here, it is understood that the higher the brightness of a plurality of pixels, the higher the light transmittance, and the lower the brightness of a plurality of pixels, the lower the light transmittance. This is because when the light transmittance is high, the light passing through the diagnostic kit and reaching the camera module increases, making it brighter, and when the light transmittance is low, the light passing through the diagnostic kit and reaching the camera module decreases, making it darker.
[0088] More specifically, information regarding the color of the pixel may include R, G, and B channel values. Here, the R, G, or B channel values may each be expressed within a range of 0 to 225, and the larger the value of a specific channel, the darker the color corresponding to that specific channel may appear. Here, the R channel may appear as red, the G channel as green, and the B channel as blue. For example, if the color information of the pixel data is (255, 0, 0), the R channel value is 255, the G and B channel values are 0, and the color appears as red corresponding to the R channel. As another example, if the color information of the pixel data is (0, 0, 0), the color appears as black. The color can be determined by calculating the average of the RGB values. Here, if the color of multiple pixels within the diagnostic area appears as a single color, it is understood that the light transmittance is high, and if the color of multiple pixels within the diagnostic area appears as two or more colors, it is understood that the light transmittance is low. This is because, in image data, shapes such as spots in the diagnostic area may appear in different colors depending on whether a target substance is present in the sample contained in the diagnostic kit. This is because when a target substance is present, the light irradiated by the light source is absorbed by the sensor in the diagnostic area (i.e., the transmittance of light is reduced), and the specific color of the light is not expressed. When a target substance is present, to give a more specific example, the RGB channel values in the sensor in the diagnostic area may approach 0 (i.e., the color information becomes (0, 0, 0)), appearing black.
[0089] Referring to FIG. 6, an electronic device (2) according to one embodiment can analyze a target substance detection result based on the analyzed pixel data (S520). Here, the target substance detection result may be the result of qualitative or quantitative analysis of the substance to be detected. In the case of qualitative analysis, the electronic device may analyze the target substance detection result as positive or negative.
[0090] More specifically, the electronic device (2) can analyze the results of target substance detection based on analyzed pixel data and a preset standard. In the case of qualitative analysis, for example, if the brightness value of the analyzed pixel data is below a preset standard, it can be determined that the sample contains the target substance. For example, if the brightness value of the analyzed pixel data is above a preset standard, it can be determined that the sample does not contain the target substance. As another example, if the number of colors of the analyzed pixel data within the diagnostic area is above a preset standard, it can be determined that the sample contains the target substance. Specifically, this determination can be made when there are two or more colors of the pixel data. As another example, if the number of colors of the analyzed pixel data is below a preset standard, it can be determined that the sample does not contain the target substance. Specifically, this determination can be made when there is only one color of the pixel data. In the case of quantitative analysis, for example, the results regarding the concentration of the target substance can be analyzed based on the quantitative value of the analyzed pixel data and a preset standard.
[0091] Additionally, referring to FIG. 6, the electronic device (2) can determine a diagnosis result in operation S530 based on the analyzed target substance detection result and a preset standard. Here, the "preset standard" serves as a standard for determining the diagnosis result and may be set based on the target substance, label substance, detection method, relevant regulations, etc., but is not limited thereto. Also, in the present disclosure, "diagnosis result" may be used as a term meaning a result based on the detected target substance, and the result may appear as negative or positive. For example, the diagnosis result may be a result for a specific disease corresponding to the target substance. As another example, the diagnosis result may be a result for a specific chemical substance corresponding to the target substance. The electronic device (2) according to one embodiment may determine the diagnosis result for a specific disease as positive if the target substance detection result is greater than or equal to the preset standard, and may determine the diagnosis result for a specific disease as negative if the analyzed target substance detection result is less than or equal to the preset standard.
[0093] FIG. 7 is a diagram illustrating another specific example of an operation in which an electronic device (2) according to one embodiment analyzes image data to read a signal of a diagnostic kit. However, the operations may be performed regardless of the order of the operations shown and / or described, and more operations may be performed and / or fewer operations may be performed.
[0094] Referring to FIG. 7, the electronic device (2) can identify the location of a diagnostic area based on image data in operation S540. In the present disclosure, the "diagnostic area" may be an area implemented to detect a target substance in a diagnostic kit, and if the diagnostic kit has multiple diagnostic areas, the image data may include images of one or more diagnostic areas. Additionally, the electronic device (2) can determine a diagnostic target corresponding to the identified location (S550). Here, the "diagnostic target" may be a target substance, a specific disease corresponding to the target substance, or a specific chemical substance corresponding to the target substance, but is not limited thereto. If the diagnostic kit has multiple diagnostic areas, identifying the locations of the multiple diagnostic areas and determining the diagnostic targets corresponding thereto in this way enables clear distinction of information regarding each diagnostic area.
[0095] An electronic device (2) according to one embodiment can correct image data in operation S500. Here, the correction can be performed based on at least one of brightness, clarity, color, and noise of the image data. By adding such a correction operation, analysis can be performed based on clearer image data, thereby obtaining an accurate diagnostic result.
[0096] Meanwhile, not limited to the examples described, the electronic device (2) can generate an artificial intelligence model by using user information, wavelength values of a light source, a diagnostic target, multiple image data, pixel data, and signal reading results (target substance detection results and diagnostic results) as learning data and performing learning according to a preset learning method, and can determine the aforementioned signal reading results, i.e., target substance detection results or diagnostic results, using the artificial intelligence model.
[0098] FIG. 8 is a diagram illustrating an operation in which an electronic device determines a final signal reading result based on auxiliary image data according to one embodiment. However, the operations may be performed regardless of the order of the illustrated and / or described operations, and more operations may be performed and / or fewer operations may be performed.
[0099] Referring to FIG. 8, the electronic device (2) can generate a first auxiliary image data and a second auxiliary image data in operation S1101. Here, auxiliary image data may refer to image data additionally generated through the camera module of the detection unit (102). By utilizing one or more auxiliary image data, a more accurate signal reading result of the diagnostic kit can be provided. According to one embodiment, the electronic device can generate the nth (where n is a natural number greater than or equal to 3) auxiliary image data. Since operation S1101 can be performed as described above in operation S300, a detailed description is omitted. Additionally, the electronic device (2) can generate image data based on the first auxiliary image data and the second auxiliary image data in operation S1102. According to one embodiment, the electronic device can generate image data by additionally utilizing the nth (where n is a natural number greater than or equal to 3) auxiliary image data. Additionally, in operation S1103, the electronic device (2) can determine a final signal reading result based on a first signal reading result analyzed based on the first auxiliary image data, a second signal reading result analyzed based on the second auxiliary image data, and a third signal reading result analyzed based on the image data. Here, the operation of analyzing the first signal reading result and the second signal reading result can be performed as described in S500 above. In this way, by using one or more signal reading results, the signal of the diagnostic kit can be read more accurately.
[0101] FIG. 9 is a diagram illustrating the operation of an electronic device (2) according to one embodiment providing a signal reading result of a diagnostic kit to a user and providing information related to an analysis target to the user based on the result. However, the operations may be performed regardless of the order of the illustrated and / or described operations, and more operations may be performed and / or fewer operations may be performed.
[0102] Referring to FIG. 9, the electronic device (2) can obtain user information in operation S600. In the present disclosure, "user information" may be used as a term meaning various information that can identify a user. For example, user information may include, but is not limited to, information regarding personal identification ID, gender, age, disease history, region, time, etc. Here, "personal identification ID" may be used as a term meaning an ID used to identify individual users, which enables the electronic device to classify and store target substance detection results or diagnostic results by personal identification ID, or to provide them to the user corresponding to the ID. Accordingly, the user can not only read the results once but also manage the status of the analysis target over the long term by storing and receiving multiple results. Additionally, "region" or "time" may be used as a term meaning the region or time at which the diagnostic kit results are to be read.
[0103] According to one embodiment, the electronic device (2) can acquire user information based on user input through an input / output interface. According to one embodiment, the electronic device can acquire user information through linkage with information registered in another application or another electronic device (e.g., a wearable device). Here, in the case of disease history, as one embodiment, the electronic device can acquire information regarding disease history through linkage with electronic medical record data stored in a database. For example, the electronic medical record data stored in the database may include, but is not limited to, Electronic Medical Record (EMR) data or Electronic Health Record (HER) data.
[0104] Referring to FIG. 9, an electronic device (2) according to one embodiment may provide a signal reading result of a diagnostic kit to a user in operation S700. Here, the signal reading result may include a target substance detection result or a diagnostic result. In addition, the signal reading result may be a result read by the operation of the electronic device (2) or the operation of the diagnostic kit reader (1). The electronic device (2) may provide the result through an interface, but is not limited thereto. According to one embodiment, the electronic device (2) may provide a plurality of signal reading results simultaneously. Accordingly, the user receives a plurality of target substance detection results or diagnostic results simultaneously in a single inspection, thereby having the effect of managing the state of the object to be analyzed efficiently and conveniently. According to one embodiment, the electronic device (2) may provide a comparison result in which a plurality of signal reading results according to a plurality of time points are compared at a plurality of time points. Accordingly, the user can compare a plurality of target substance detection results or diagnostic results at a time point, which has the effect of allowing the user to manage the state of the object to be analyzed over a long period, rather than merely reading the signal once.
[0105] According to one embodiment, the electronic device (2) can build signal reading results in a database. More specifically, the electronic device can build target substance detection results or diagnostic results in a database.
[0106] Figure 10 is a diagram showing an example of a signal reading result provided to a user.
[0107] Referring to FIG. 10, an electronic device (2) according to one embodiment can simultaneously provide diagnostic results regarding whether there is an infection with RSV, COVID-19, influenza A, and influenza B.
[0108] Referring again to FIG. 9, an electronic device (2) according to one embodiment may provide information related to an analysis target to a user based on a signal reading result in operation S800. Here, "information related to an analysis target" is used as a term meaning various information related to a target substance to be detected, a disease corresponding to the target substance, or a chemical substance corresponding to the target substance. For example, information related to an analysis target includes, but is not limited to, information on therapeutic drugs, lifestyle information, and target substance information. According to one embodiment, information related to an analysis target may be information related to a diagnostic result determined to be positive.
[0109] According to one embodiment, the electronic device can provide information related to the analysis target to the user based on signal reading results and user information. By additionally considering user information, there is an effect of providing information related to the analysis target that is more suitable to the user.
[0110] An electronic device (2) according to one embodiment can, in operation S800, select and provide to the user at least one analysis target-related information corresponding to a signal reading result from a pre-stored database.
[0111] According to one embodiment, the diagnostic kit reader (1) may perform at least one of the operations of the aforementioned electronic device (2) in the same or similar manner. For example, when the diagnostic kit reader (1) performs S200 and S300 among the operations of generating a signal of the diagnostic kit, the signal of the kit may be generated internally within the diagnostic kit reader without control by the electronic device (2). As another example, when the diagnostic kit reader (1) performs the operation (S500) of reading the signal of the diagnostic kit, the signal of the kit may be read internally within the diagnostic kit reader. In this case, the operation (S700 or S800) of providing the signal reading result or information related to the object to be analyzed may be performed in the diagnostic kit reader (1) or in the electronic device (2).
Claims
Claim 1 A method of operation of an electronic device for generating and reading a signal of a light-transmitting diagnostic kit comprises: an operation (S100) of establishing a communication connection with a diagnostic kit reader (1) including a light source unit (101) and a detection unit (102); an operation (S200) of operating at least one LED included in the light source unit (101) to transmit light to a diagnostic kit including a plurality of diagnostic areas; an operation (S300) of operating a camera module included in the detection unit (102) to convert the transmitted light into an electrical signal to generate image data; an operation (S400) of receiving the generated image data through a communication module; an operation (S500) of reading a signal based on the image data; and an operation (S700) of simultaneously providing the signal reading result to a user for each of the plurality of diagnostic targets. The operation of reading the signal (S500) includes: an operation of identifying the location of the plurality of diagnostic areas based on the image data; and an operation of determining a diagnostic target regarding whether there is infection with different diseases corresponding to the location of each of the identified plurality of diagnostic areas. and an operation of analyzing pixel data for each of the plurality of diagnostic regions; wherein the operation of analyzing pixel data for each of the plurality of diagnostic regions comprises, for each of the plurality of diagnostic regions, an operation of generating first auxiliary image data and second auxiliary image data; an operation of generating image data based on the first auxiliary image data and the second auxiliary image data; and an operation of determining a final signal reading result for the corresponding diagnostic region based on a first signal reading result analyzed based on the first auxiliary image data, a second signal reading result analyzed based on the second auxiliary image data, and a third signal reading result analyzed based on the image data.A method of operation comprising determining that a sample corresponding to a diagnostic area contains a target substance when the brightness value of pixel data corresponding to each of the plurality of diagnostic areas is below a preset standard. Claim 2 In claim 1, the operation (S100) of establishing the communication connection is a method of operation in which the wired communication connection or wireless communication connection is established. Claim 3 A method of operation according to claim 1, wherein the light-transmitting operation (S200) includes an operation of controlling at least one of the blinking, brightness, and wavelength of the LED based on a first control condition, and the first control condition includes at least one of a target material, a label material, a kit type, a number of diagnostic areas, and a location of diagnostic areas. Claim 4 In claim 1, the operation (S300) of generating the image data includes an operation of controlling at least one of the position, function, ISO sensitivity, shutter speed, shooting angle, and shooting operation of the camera module based on a second control condition, wherein the second control condition includes at least one of the conditions of a shooting area, a target substance, a label substance, a kit type, the number of diagnostic areas, and the location of the diagnostic area, and the conditions of the shooting area include at least one of the conditions of brightness, contrast, sharpness, and color. Claim 5 delete Claim 6 delete Claim 7 A method of operation according to claim 1, wherein the operation of analyzing the image data (S500) further includes the operation of correcting the image data, and the correction is performed based on at least one of brightness, sharpness, color, and noise of the image data. Claim 8 A method of operation according to claim 1, wherein the operation of reading the signal (S500) is performed through an artificial intelligence model, and the artificial intelligence model is learned based on the wavelength value of the light source, the diagnostic target, a plurality of image data, pixel data, the result of detecting the target substance and the diagnostic result. Claim 9 delete Claim 10 delete Claim 11 In claim 7, the method of operation further comprises an operation (S800) of providing information related to an analysis target to a user based on the signal reading result, wherein the information related to an analysis target includes at least one of therapeutic drug information, lifestyle information, and target substance information.
Citation Information
Patent Citations
Detection device and control method thereof
KR1020200046271A
Apparatus and method for generating infection status information based on image information
KR1020240038534A
Fluorescence reader system measuring by time control using image sensor
KR1020200141275A
Apparatus and method for determining health condition using urine diagnostic strip based on artificial intelligence
KR1020220115710A
Bio-Marker Dectector With Combined Functions
KR1020230149416A
