Processing device, inspection device for optical inspection and corresponding method - Patents.com

The integrated processing device and inspection apparatus facilitate automated and standardized optical quality inspection of specimens, enhancing efficiency and consistency in quality control through centralized data management and user-assisted inspection.

JP7802817B2Active Publication Date: 2026-01-20LEICA MICROSYSTEMS SUZHOU TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023553665
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-01
Publication Date
2026-01-20
Estimated Expiration
2041-03-01

AI Technical Summary

Technical Problem

Existing optical inspection methods for specimens, such as medical components, lack efficiency and standardization, with manual recording of inspection results and limited integration of digital tools for quality assurance.

Method used

A processing device and inspection apparatus with integrated optical inspection means, user interface, and processing unit that provides automated instructions, data storage, and image analysis for standardized quality inspection, using a camera, microscope, and user input devices to facilitate efficient and centralized reporting.

Benefits of technology

Enables standardized, efficient, and automated optical quality inspection of specimens, ensuring consistent quality control through integrated data management and user-assisted inspection processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007802817000001
    Figure 0007802817000001
  • Figure 0007802817000002
    Figure 0007802817000002
  • Figure 0007802817000003
    Figure 0007802817000003
Patent Text Reader

Abstract

An inspection system and corresponding method are provided, the inspection system comprising a processing device (130) for use in an inspection device (100) for optical inspection of a specimen (160), the processing device (130) being coupled to a camera (116) of the optical inspection means (110), coupled to a user interface means (120) including a display means (122), configured to receive input data from the user interface means (120) and / or the camera (116) and provide output data to the user interface means (120), and coupled to a storage means (180) and accessing the storage means (180) for storing and retrieving data, the processing device (130) displaying instructions (190) stored in the storage means (180) to display the user interface means (120) and / or the camera (116), and ... the processing device (130) is configured to provide instructions (192) for an optical quality inspection of a specimen (160) to be performed by a user (150) via the user interface means (120) and to supply the instructions (192) as output data to the user interface means (120), the instructions (192) including predetermined instructions for the user (150) regarding which type of optical quality inspection to perform on which specimen (160); and the processing device (130) is configured to receive quality report data (196) from the optical quality inspection and / or image data of images acquired by the camera (116) as input data via the user interface means (120) and to store the quality report data (196) and / or the image data in the storage means (180).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention essentially relates to a processing device for use in an inspection apparatus for the optical inspection of specimens, an inspection apparatus, a method for performing an optical quality inspection of a specimen, a method for setting up the inspection apparatus and a method for operating the processing device. [Background technology]

[0002] Optical inspection of objects or samples is required in various technical fields. For example, in medical technology, components such as stents must be inspected for certain quality requirements before final use. Such quality inspection can be performed visually or by using magnifying equipment such as a microscope. Any inspection results, such as pass or fail, can be recorded manually or, for example, on a simple digital sheet. Summary of the Invention [Means for solving the problem]

[0003] According to the invention, a processing device, an inspection device, a method for performing an optical quality inspection, a method for setting up an inspection device, a method for operating a processing device and corresponding computer programs are proposed having the features of the independent claims. Advantageous further developments form the subject matter of the respective dependent claims and the following description.

[0004] The present invention relates to an inspection apparatus for optical inspection (particularly optical quality inspection) of samples, a processing device for use with or in the apparatus, as well as a method for performing optical quality inspection of samples, a method for setting up the inspection apparatus, and a method for operating the processing device. In particular, the samples here may include medical components or parts, such as stents, medical screws, etc. However, of course, various types of samples may be inspected. The inspection apparatus here comprises optical inspection means (or optical inspection apparatus), user interface means or a user interface device, and a processing device. The optical inspection means includes a camera (i.e., image acquisition means) and preferably also a microscope usable by a user for detailed inspection and magnification of the sample. The user interface means comprises display means such as a monitor (display) and preferably also user input means or a user input device such as a keyboard and / or a computer mouse. The user interface means may also comprise a touch display, which in this case forms a combination of the display means and the user input means.

[0005] The camera may be combined with the microscope and may further be combined with the user interface means or at least part thereof. For example, the camera may be attached to the microscope in order to allow (live) imaging of the sample via the microscope. Furthermore, the display means may also be integrated into the microscope such that what is visualized on the display means is coupled to the optical path of the microscope (i.e. in this case the display means which is part of the user interface means is also part of the optical inspection means).

[0006] The processing unit is a computing unit communicatively coupled to the user interface means (including the display means) and further to the camera. This allows it to receive input data from the user interface means and the camera, and to provide output data to the user interface means, particularly the display means. In this way, the processing unit can control operations. It should be noted that the processing unit may include individual communication interfaces for connecting each corresponding component, but multiple components may also be connected to a common interface of the processing unit. For example, separate USB interfaces may be provided for the camera, keyboard, and computer mouse (although the keyboard and computer mouse may also be connected to a common USB interface). An HDMI interface may be provided for the display.

[0007] Preferably, a storage means is provided for storing data such as instructions for a user performing the optical quality inspection. Data acquired during such optical quality inspection (quality report data) can also be stored in the storage means. Such a storage means can be connected to or communicatively coupled to the processing device, for example, via an interface. Generally, various types of storage means can be used, such as folder-based data storage and / or a database server.

[0008] Thus, the processing device is communicatively coupled (connected) to the camera of the optical inspection means, communicatively coupled to the user interface means including the display means, configured to receive input data from the user interface means and / or the camera and to provide output data to the user interface means, and communicatively coupled to the storage means and configured to access the storage means for storing and retrieving data.

[0009] To enable an optical inspection of the sample and ensure its sufficient quality, specific instructions for the user can be provided, including in particular a kind of workflow with various steps of the inspection to be performed on the sample. To achieve this, the invention proposes storing instruction data on or in the storage means, including such instructions for the optical quality inspection of the sample to be performed by the user. The processing device then accesses these instruction data and provides instructions for the optical quality inspection of the sample to be performed via the user interface means, which in turn provide the instructions as output data to the user interface means. These instructions include predetermined instructions for the user regarding which type of optical quality inspection to perform on which sample. As mentioned above, there can be different steps in the workflow with different instructions. For details of these instructions, please refer to the figures and the corresponding description.

[0010] The user performing the optical quality inspection of the specimen must then (in particular according to instructions) acquire various data about the specimen, such as measurements, defects, etc., and may also need to acquire images of the specimen, in particular using a camera of the optical inspection means. The user must therefore formulate a kind of quality report. Data referring to such a quality report, also referred to below as quality report data, is in this case created by the user using the user interface means and sent to the processing device for storage in the storage means. Thus, the processing device receives the quality report data from the optical quality inspection via the user interface. The processing device can also receive image data of images acquired by the camera as input data. The processing device then stores the quality report data and / or the image data in the storage means.

[0011] This allows a user to carry out an optical quality inspection of a specimen in strict accordance with predetermined instructions, e.g. stored in a central storage means, the definition of which will be explained in more detail below. Furthermore, all quality reports or quality report data are stored in the same location, allowing central access to all quality reports. In particular, several of these inspection devices (or corresponding processing devices) can be connected to the same storage means, so that all processing devices are supplied with the same instructions and all quality reports can be stored in the same location.

[0012] Preferably, the instructions further include at least one predetermined overlay to be displayed by the display means, whereby the overlay is virtually overlaid on the sample currently being observed by the optical inspection means and / or via the display means (e.g. directly, by coupling the overlay into the optical path via the eyepieces of the microscope, or indirectly as an overlay presented on the monitor together with a live image of the sample captured by a camera and presented on the monitor), the overlay to be used by the user to perform a specific optical quality inspection on the sample. Such an overlay may include, for example, a shape that the sample must have or an area that should have the shape of the sample inside. In particular, the camera is controlled by the processing device to acquire a live image of the sample currently being observed, and the display means is controlled to display the live image and the overlay, such that the overlay is virtually overlaid on the live image.

[0013] Preferably, the overlay is aligned with a live image of the currently observed sample. This allows, inter alia, to determine quality characteristics based on the difference between the corresponding geometrical scale of the overlay and the live image of the sample. In this case, the quality report can, inter alia, include a pass or fail record determined based on the quality characteristics. The use of such an overlay allows for fast and efficient optical quality inspection of the sample, since the user or operator performing the inspection is assisted by the (automatic) display requirements (scale ratio, shape, etc.) that the sample must fulfill. The alignment of the overlay and the sample can be performed by the user (e.g., by positioning the sample relative to the overlay), but such alignment can also be performed automatically using a processing device. This can, for example, include image analysis of the live image of the sample, including detection of the edges of the sample in the live image, and corresponding orientation of the overlay.

[0014] As mentioned above, the present invention also relates to a method for setting up such an inspection device. As mentioned above, in addition to coupling or connecting the processing device to the corresponding components and means and configuring them accordingly, setting up here also includes creating instruction data containing instructions for optical quality inspections of samples to be performed by a user and storing this instruction data in storage means. Creating here includes defining instructions for the user regarding which types of quality inspections to perform on which samples, what quality reports to generate, and what images to acquire from the samples.

[0015] Preferably, the instruction data and the instructions contained in this instruction data are not defined by the user or operator performing the optical quality inspection, but by another person, such as a (quality) controller, who is aware of all data that is requisitely obtained from a particular sample or particular sample type during such a quality inspection. Furthermore, quality reports for multiple samples can be retrieved from the storage means and inspected and / or approved, for example by a (quality) controller, who can then generate a batch report. A further overview of such an optical quality inspection procedure is shown in the figures.

[0016] It should further be noted that each of the processing devices can be configured to perform some or all of the tasks provided by the integrated processing means of a camera (a kind of smart or intelligent camera) as disclosed in WO 2020 / 182088, a document describing a digital microscope camera and a microscope equipped with such a camera allowing imaging of a sample. In contrast to such a smart camera, the processing device proposed in the present invention is a device provided separately from the camera and can therefore be used in combination with different cameras according to the needs of the user or customer.

[0017] Further advantages and embodiments of the invention will become apparent from the description and accompanying drawings.

[0018] It should be noted that the features mentioned above and those further described below can be used not only in the respective combinations shown but also in other combinations or alone, without departing from the scope of the invention. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a schematic diagram showing an inspection device according to the present invention in a preferred embodiment; [Figure 2] FIG. 2 is a detailed view showing a processing device that is a part of the inspection device of FIG. [Figure 3]1 shows a schematic flow schema illustrating the method according to the invention in a preferred embodiment; [Figure 4] 1A-1D show diagrammatically the steps in optical quality inspection according to the present invention in a preferred embodiment; [Figure 5] 3A-3C show diagrammatically the steps in an optical quality inspection according to the invention in another preferred embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0020] FIG. 1 shows a schematic diagram of an inspection apparatus 100 according to a preferred embodiment of the present invention. The inspection apparatus 100 comprises an optical inspection means 110, a user interface means 120, and a processing unit 130. The optical inspection means 110 includes a microscope 112 having an objective lens 112 and an eyepiece 114, and a camera 116. For example, the camera 116 is coupled to the microscope 112 separately from the eyepiece 114, thereby allowing a user or operator 150 to observe or optically inspect a sample 160 through the eyepiece 114 while simultaneously capturing live images of the sample 160 via the camera 116. The camera 116 is communicatively coupled to a processing unit 130. The processing unit 130 can be attached to the microscope via a mounting bracket, if desired.

[0021] The user interface means 120 includes a display means 122 in the form of a monitor or display, and input means including a keyboard 124 and a computer mouse 126. Each of these components, i.e., the display means 122, the keyboard 124, and the computer mouse 126, is connected (communicatively coupled) to a processing unit 130. This allows a user to view or optically inspect a sample via the display means. Alternatively, a separate eyepiece may be omitted.

[0022] Further, storage means 180 is connected to processing unit 130, for example, via Ethernet or the Internet. The storage means may provide folder-based data storage for storing instruction data 190, quality report data 196, and images as previously described and described in more detail below. Of course, other or additional storage means, such as a server running a database, may also be used and connected to processing unit 130. For example, instructions 192 and quality reports 194 may be displayed on display means 122.

[0023] FIG. 2 shows a detailed view of the processing device 130 of FIG. 1, particularly a rear view. The processing device 130 includes a processor (CPU) 231 and multiple (communication) interfaces or ports. For example, the interfaces include an Ethernet interface 232, four USB interfaces 233 (which may be of different types, e.g., USB 3.0 and / or USB 2.0), and an HDMI interface 234. A power socket 235 is also provided. The Ethernet interface 232 can be used to connect the processing device 130 to a network, and the USB interfaces 233 can be used to connect the processing device 130 to the camera 116, keyboard 124, and computer mouse 126. The HDMI interface 234 can be used to connect the processing device 130 to the display means 122. A WIFI dongle 236 is also shown, which can be connected to one of the USB interfaces 233 to provide another network connection. If necessary, other components, such as a barcode scanner and / or a foot switch (which can be considered as user interface means), can also be connected. Another (mobile) storage device can also be connected. It should be noted that these interfaces and their use for connections are provided for illustrative purposes only.

[0024] Via a network, the processing device 130 can be connected to storage means (see also above) and / or to other processing devices of other inspection devices.

[0025] 3 illustrates an optical quality inspection procedure proposed as a method in the present invention, including setup of an inspection device, with a particular focus on instructions and quality reporting. Steps 300-320 relate to setting up the inspection device, i.e., the device used to inspect the specimen. These steps include communicatively coupling a processing device to a user interface means and a camera (step 300), communicatively coupling the processing device to a storage means (step 305), configuring the processing device to access the storage means for storing and retrieving data (step 310), configuring the processing device to provide instructions to a user upon request (step 315), and configuring the processing device to store quality report data and image data upon request while providing instructions (step 320).

[0026] These steps are essentially preparatory steps that are performed before the start of the quality inspection. Note that the order of the steps does not necessarily have to be the order shown and described. As mentioned above, instruction data including instructions must be created and stored in storage means before the inspection. This creation can be performed in the following procedure, which will be described in conjunction with steps 330 to 360.

[0027] In step 330, instructions are created to be performed for a particular sample or sample type, such as a particular stent, where the instructions may be or include the type of workflow or sequence of steps that a user or operator must perform during optical quality inspection of the sample, such as defined by an administrator managing the overall procedure.

[0028] In step 335, the instruction is submitted, for example, by an administrator, typically a quality controller in charge of quality control. In step 340, the quality controller checks the instruction, for example, regarding quality-related aspects. If the instruction meets the requirements, the quality controller approves the instruction. If not, the instruction can be revised, i.e., step 330 is executed again. The approved instruction is stored in the storage means in the form of instruction data or included in the instruction data. It should be noted that the instruction can be stored in the storage means in step 330 and the quality controller can also access the instruction data to check and / or approve it in step 340. For example, only approved instructions are enabled for access by the user. An inspection device can be used to create and / or check and / or approve the instruction. It should be noted that a separate computer connected to the storage means (e.g., via a network) can also be used.

[0029] In step 345, an optical quality inspection according to the previously defined instructions is performed by the user or operator using the inspection device on one or more samples. In this step, the instructions are provided to the user via the display means as described above. Further details on what the instructions may look like are provided below. In step 350, the user submits a quality inspection report, which is then stored in the storage means in the form of quality report data. It should be noted that various schemes are possible for creating such a quality report or data. For example, after each inspection step according to the workflow, the user can submit the results of the corresponding inspection step via the user interface and mark this report as complete after the workflow for a particular sample is completed. This means that the quality report data is repeatedly updated during the workflow. Steps 345 and 350 are repeated for each sample inspected.

[0030] It should be noted that separate quality reports may be generated and stored in the storage means using multiple testing devices for multiple users, and that if all users test the same type of sample, each user may have access to the same instruction data. Of course, different instructions or workflows (e.g., with different names) may be provided for different samples.

[0031] The quality reports may be reviewed and approved, for example, by an administrator, in step 355. Further, from multiple quality reports, an administrator may create a batch report in step 360.

[0032] It should be noted that different software applications (apps) may be provided on the processing device, such as a manager app for administrators (and quality controllers) to define different workflows, review quality reports, etc., and an operator app for users to perform optical quality inspections (with respect to steps 345 and 350 above). User accounts may also be configured so that only users with accounts can perform optical quality inspections. Different user accounts may also be granted different qualifications or access to only certain instructions for particular samples.

[0033] Figure 4 shows, in a preferred embodiment, the steps in an optical quality inspection according to the present invention. Overall, Figure 4 shows the content of the display or monitor of the inspection device described above during the optical quality inspection of a sample. In this example, the sample is a stent, of which a (live) image 400 (camera view) is presented on the display. As mentioned above, the camera of the inspection device can be used to acquire such a live image.

[0034] On the right side of the display, a menu bar is displayed containing specific instructional text and / or (software) buttons 410-415. These text / buttons may include a button to exit the workflow and return to the workflow selection screen ("Back"); a list of test results that opens a detailed view of the test results; camera settings; user settings; the number of steps; a button to move to the next workflow step ("Next"); a button to return to the previous workflow step ("Previous"); and a detailed description of the tasks within the current workflow step. Note that reference numerals 410-415 and corresponding boxes are used for illustrative purposes only and do not relate to the actual content, value, or placement of such text / buttons.

[0035] Additionally, a camera button 420 is displayed within the camera view. Clicking on this button 420 can reveal other options or camera options, such as marking defects in the camera image, performing a length measurement, performing an angle measurement, performing a radius measurement, or adding a record to the image. Depending on the type of action or option, the user can set several markers within the image / view using the computer mouse, and the corresponding measurement will be performed automatically. As an example, performing a length (or diameter) measurement is indicated in FIG. 4 by a dashed line 430 and corresponding markers (denoted by crosses at each end of the dashed line). After the measurement is completed, the user can save the measurements and generate quality report data (which is part of an overall quality report that includes other measurements, etc.).

[0036] Another function could be to take an image of the current view of the sample, including the measurement markers and measurement lines shown in Figure 4, for example, so that the exact measurements can be inspected later. Also, defects on the sample can be recorded, for example, by taking an image and adding a textual record. Furthermore, the camera settings can be adjusted, if necessary, using the respective buttons.

[0037] Such measurements using a camera and live images typically require calibration of the camera or its settings. This can be done as an initial step in the workflow or at any time needed. Such calibration may require photographing a known measure, such as a measuring tape, as a sample, performing a length measurement of such known measure as described above, and setting this length in the calibration menu.

[0038] Figure 5 shows a schematic representation of the steps in optical quality inspection according to the present invention in another preferred embodiment. Generally, Figure 5 shows the contents of a display or monitor of an inspection device similar to that of Figure 4, along with a live image 500 of a sample. Note that the sample in this example is not a stent, but a threaded screw.

[0039] On the right side of the display, a menu bar is displayed containing certain instructional text and / or (software) buttons 510-515. The text / buttons here may be similar to the text / buttons shown in Figure 4 and designated by reference numerals 410-415. Also, button 520 may correspond to button 420 in Figure 4, or to a save button used to save measurements etc. after clicking the camera button (see above, i.e., the three boxes showing the different options or camera options mentioned above).

[0040] In this case, an overlay 530 is overlaid on the currently observed sample (and each of its live images). This overlay can be created during the creation of the overall instructions or workflow, as described above. In this example, the overlay 530 is a kind of net or grid, with two parallel lines at the top and bottom, and several other parallel lines oriented slightly to the right from top to bottom. This overlay can be aligned with the live image 500 by the user or automatically.

[0041] In this example, the top and bottom lines indicate the shape that the outer edge of the sample can or should have. Any additional margins can also be included. The nearly vertical lines indicate the direction or progression that the sample threads must or should have. Depending on the difference between the overlay and the actual scale or geometry of the sample, the sample can be marked as pass or fail in the quality report.

[0042] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0043] While some aspects have been described in the context of an apparatus, it will be apparent that these aspects also represent a description of a corresponding method, where a block or apparatus corresponds to a step or feature of a step, and similarly, aspects described in the context of a step also represent a description of a corresponding block or item or feature of a corresponding apparatus.

[0044] Some embodiments relate to a microscope including a system such as that described in connection with one or more of FIGS. 1-5. Alternatively, the microscope may be part of or connected to a system such as that described in connection with one or more of FIGS. 1-5. FIG. 1 shows a schematic diagram of a system 100 configured to perform the methods described herein. The system 100 includes a microscope 112 and a computer system 130. The microscope 112 is configured to capture images and is connected to the computer system 130. The computer system 130 is configured to perform at least a portion of the methods described herein. The computer system 130 may be configured to execute a machine learning algorithm. The computer system 130 and the microscope 112 may be separate entities or may be integrated within a common housing. The computer system 130 may be part of a central processing system of the microscope 112 and / or part of a subsidiary component of the microscope 112, such as a sensor, actor, camera, or lighting unit of the microscope 112.

[0045] Computer system 130 may be a local computing device (e.g., a personal computer, laptop, tablet computer, or mobile phone) with one or more processors and one or more storage devices, or may be a distributed computing system (e.g., a cloud computing system with one or more processors and one or more storage devices distributed across various locations, such as local clients and / or one or more remote server farms and / or data centers). Computer system 130 may include any circuit or combination of circuits. In one embodiment, computer system 130 may include one or more processors, which may be of any type. As used herein, processor may contemplate any type of computing circuit, such as, but not limited to, a microprocessor of a microscope or microscope component (e.g., a camera), a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA), or any other type of processor or processing circuit. Other types of circuitry that may be included in computer system 130 may be custom circuitry, application specific integrated circuits (ASICs), etc., such as one or more circuits (e.g., communications circuits) used in wireless devices such as cell phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. Computer system 130 may also include one or more storage devices, which may include one or more memory elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard drives and / or one or more drives that handle removable media, such as compact discs (CDs), flash memory cards, digital video discs (DVDs), etc.Computer system 130 may also include a display device, one or more speakers and a controller which may include a keyboard and / or mouse, trackball, touch screen, voice recognition device, or any other device that allows a user of the system to input information to and receive information from computer system 130.

[0046] Some or all of the steps may be performed by (or using) a hardware apparatus, such as, for example, a processor, microprocessor, programmable computer, or electronic circuitry. In some embodiments, any one or more of the critical steps may be performed by such an apparatus.

[0047] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. This implementation may be performed by a non-transitory storage medium, such as a digital storage medium, for example, a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM, an EPROM, an EEPROM, or a FLASH memory, on which electronically readable control signals are stored, which cooperate (or can cooperate) with a programmable computer system to implement the respective methods. Therefore, the digital storage medium may be computer-readable.

[0048] Some embodiments of the present invention include a data carrier having electronically readable control signals that can cooperate with a programmable computer system to perform any of the methods described herein.

[0049] Generally, embodiments of the present invention may be implemented as a computer program product comprising program code that is operative to perform any of the methods when the computer program product is run on a computer, and that may be stored, for example, on a machine-readable carrier.

[0050] Further embodiments comprise the computer program for performing any of the methods described herein, stored on a machine readable carrier.

[0051] In other words, an embodiment of the present invention is, therefore, a computer program having a program code for performing any of the methods described herein when the computer program runs on a computer.

[0052] Therefore, another embodiment of the invention is a recording medium (or data carrier or computer readable medium) containing a computer program stored thereon for performing any of the methods described herein when executed by a processor. The data carrier, digital recording medium or recording medium is typically tangible and / or non-transitory. Another embodiment of the invention is an apparatus as described herein, comprising a processor and a recording medium.

[0053] A further embodiment of the present invention is, therefore, a data stream or a sequence of signals representing the computer program for performing any of the methods described herein, the data stream or sequence of signals being for example adapted to be transmitted via a data communication connection, for example the Internet.

[0054] Another embodiment comprises a processing means, for example a computer, or a programmable logic device configured to or adapted to perform any of the methods described herein.

[0055] Another embodiment comprises a computer having installed thereon the computer program for performing any of the methods described herein.

[0056] Another embodiment of the present invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for implementing any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may include, for example, a file server for transferring the computer program to the receiver.

[0057] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functionality of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor to perform any of the methods described herein. In general, the methods are advantageously performed by any hardware apparatus.

Claims

1. A processing device (130) for use in an inspection device (100) for optical inspection of a specimen (160), said processing device (130) comprising: communicatively coupled to the camera (116) of the optical inspection means (110); communicatively coupled to a user interface means (120) including a display means (122); receiving input data from said user interface means (120) and / or said camera (116); - Providing output data to said user interface means (120); Communicatively coupled to a storage means (180) and accessing said storage means (180) for storing and retrieving data; It is structured as follows: the processing device (130) is further configured to provide instructions (192) for an optical quality inspection of the specimen (160) to be performed by a user (150) via the user interface means (120) by accessing instruction data (190) stored in the storage means (180), and to provide the instructions (192) as output data to the user interface means (120); the instructions (192) include predetermined instructions for the user (150) regarding which type of optical quality inspection to perform on which sample (160); the processing device (130) is further configured to receive, via the user interface means (120), quality report data (196) from an optical quality inspection and / or image data of an image acquired by the camera (116) as input data, and to store the quality report data (196) and / or the image data in the storage means (180); the instructions (192) further include at least one predetermined overlay (530) displayed by the display means (122), whereby the overlay (530) is virtually overlaid on the sample (160) currently being observed by the optical inspection means (110) and / or via the display means (122); The processing device (130) controlling said camera (116) to acquire a live image (500, 600) of the sample currently being observed; determining quality characteristics for pass or fail based on differences between corresponding geometric measures of the overlay (530) and the live image (500) of the specimen; controlling the display means (122) to display the live image (500) and the overlay (530) such that the overlay (530) is virtually overlaid on the live image (500); further configured as follows: A processing device (130).

2. An inspection device (100) for optical inspection of a specimen (160), said inspection device (100) comprising: an optical inspection means (110) including a camera (116); a user interface means (120) including a display means (122); and a processing device (130) according to claim 1 communicatively coupled to the user interface means (120) and the camera (116). Inspection device (100).

3. 10. A method for allowing a user to perform an optical quality inspection of a specimen (160) using the inspection device (100) of claim 2, the method comprising: observing a sample (160) using said optical inspection means (110); having a user perform an optical quality inspection of the sample (160) according to instructions (192) displayed on the display means (122); having the user generate a quality report (194) regarding the optical quality inspections performed; storing said quality report (194) in said storage means (180) and / or capturing images using said camera and storing said images in said storage means (180); A method comprising:

4. The method comprises: observing the sample (160) using the camera (116) and the display means (122); aligning an overlay (530) displayed on said display means (122) with said sample being observed; determining quality characteristics for pass or fail based on differences between corresponding geometric measures of the overlay (530) and the sample or a live image (500) of the sample; further comprising: The method of claim 3.

5. 1. A method of setting up an inspection apparatus (100) for optical inspection of a specimen (160) by providing optical inspection means (110) including a camera (116), user interface means (120) including display means (122), a processing unit (130) and storage means (180), the method comprising: communicatively coupling (300) said processing unit (130) to said user interface means (120) and said camera (116); communicatively coupling (305) said processing unit (130) to said storage means (180); configuring (310) said processing unit (130) to access said storage means (180) for storing and retrieving data; - creating (330) instruction data (190) including instructions (192) for an optical quality inspection of a sample (160) to be performed by a user (150) and storing said instruction data (190) in said storage means (180), said step (330) of creating said instruction data (190) including defining instructions (192) for said user (150) regarding what type of quality inspection to perform on which sample (160), what quality report to generate and what images to acquire from said sample (160); configuring (315) the processing device (130) to provide the instructions (192) to a user (150) upon request; configuring (320) said processing device (130) to store quality report data (196) and image data as required during the provision of said instructions (192); Including, The step of creating the instruction data includes: further comprising defining at least one overlay (530) to be displayed by said display means (122) such that said overlay (530) is virtually overlaid on the sample (160) currently being inspected by said optical inspection means (110) and / or observed via said display means (122); The method comprises: controlling said camera (116) to acquire a live image (500, 600) of the sample currently being observed; determining quality characteristics for pass or fail based on differences between corresponding geometric measures of the overlay (530) and a live image (500) of the specimen; controlling the display means (122) to display the live image (500) and the overlay (530) such that the overlay (530) is virtually overlaid on the live image (500); further comprising: method.

6. said optical inspection means (110) further comprising a microscope (112); and / or The user interface means (120) further includes a touch display as the display means (122) and / or input means (124, 126) provided separately from the display means (122). The method of claim 5.

7. said storage means (180) comprising a folder-based data storage and / or database server; 7. The method according to claim 5 or 6.

8. The method according to any one of claims 5 to 7, wherein a processing device (130) according to claim 1 is used as the processing device.

9. 10. The method of operating a processing device (130) of claim 1, comprising: communicatively coupled to the camera (116) of the optical inspection means (110); communicatively coupled to a user interface means (120) including a display means (122); receiving input data from said user interface means (120) and / or said camera (116); - Providing output data to said user interface means (120); Communicatively coupled to a storage means (180) and accessing said storage means (180) for storing and retrieving data; It is structured as follows: The method comprises: providing instructions (192) for optical quality inspection of specimens (160) to be performed by a user (150) via the user interface means (120) by accessing instruction data (190) stored in the storage means (180) by the processing device (130), and providing the instructions (192) as output data to the user interface means (120), the instructions (192) including predetermined instructions for the user (150) regarding which type of quality inspection to perform on which specimen (160); receiving, by the processing device (130) as input data, quality report data (196) from the optical quality inspection via the user interface means (120) and / or image data of images acquired by the camera (116), and storing the quality report data (196) and / or the image data in the storage means (180); A method comprising:

10. the instructions further comprise at least one predetermined overlay (530) displayed by the display means (122), whereby the overlay (530) is virtually overlaid on the specimen (160) currently being observed by the optical inspection means (110) and / or via the display means (122), and the overlay (530) is used by the user (150) to perform a specific quality check on the specimen (160); The method comprises: controlling the camera (116) by the processing unit (130) to acquire a live image of the sample (160) currently being observed; controlling the display means (122) to display the live image (500) and the overlay (530) such that the overlay (530) is virtually overlaid on the live image (500); further comprising:

10. The method of claim 9.

11. A computer program comprising a program code for performing the method of claim 9 or 10 when the computer program is run on a processing device (130) according to claim 1.

Citation Information

Patent Citations

  • Method and device for identifying abnormal cells in to-be-detected sample and storage medium

    CN111524132A

  • Digital microscope and method for recognizing an image template

    DE102014106233A1

  • Semiconductor test equipment and semiconductor inspection method

    JP2007115991A

  • Inspection device and method

    JP2007232387A

  • Three-dimensional image inspection device, three-dimensional image inspection method, three-dimensional image inspection program, and computer readable recording medium

    JP2017032340A