Apparatus for optical imaging systems, optical imaging systems, methods, and computer programs

Abstract

The example relates to an apparatus for an optical imaging system, an optical imaging system, a method, and a computer program. The example provides an apparatus for an optical imaging system comprising one or more processors and one or more storage devices. The apparatus is configured to receive a first trigger signal indicating a user's desire to perform a measurement. The measurement requires a first geometric element and a second geometric element. Furthermore, the apparatus is configured to receive a second trigger signal indicating the first geometric element and the second geometric element. Furthermore, the apparatus is configured to determine measurement parameters based on the first and second trigger signals and to control the measurement based on the measurement parameters.

Description

Technical Field

[0001] The present example relates to an optical imaging system, such as an optical imaging system used in an industrial environment for monitoring and controlling a manufacturing process or the quality of a workpiece, and also relates to an optical imaging system, method, and computer program.

[0002] Background Optical imaging systems are often used in industrial and manufacturing environments for the purpose of monitoring and controlling the quality of a process or workpiece. Optical imaging systems may feature digital imaging systems, video capabilities, and precision measurement tools, which enable a user to quickly and accurately inspect samples and workpieces, such as products, during or after a manufacturing process. In addition, they often have an automated analysis system that can provide real-time feedback to a production line, further streamlining quality process control. The software component of a measurement set is typically established using dedicated software designed to cooperate with a microscope. However, the software component may not be sufficient to provide the user with intuitive and easy options for setting up measurements. Therefore, there may be a need for an improved concept that provides an intuitive and easy workflow for setting up measurements, for example, measurements for process control.

[0003] Summary This need is addressed by the subject matter of the independent claims.

[0004] The concept proposed in this disclosure is based on the insight that the user experience can be improved by providing a single workflow for setting up measurements. This single workflow may be a flexible approach for generating geometric elements and / or defining / performing measurements of those geometric elements. A single workflow can improve the user experience, for example, by eliminating redundant user interactions. This could potentially reduce the number of choices a user must make when setting up measurements.

[0005] This example provides an apparatus for an optical imaging system, comprising one or more processors and one or more storage devices. The apparatus is configured to receive a first trigger signal indicating a user's desire to perform a measurement. The first trigger signal may be received from an input device. The measurement requires a first geometric element and a second geometric element. Furthermore, the apparatus is configured to receive a second trigger signal indicating the first and second geometric elements. The second trigger signal may be received from an input device. Furthermore, the apparatus is configured to determine measurement parameters based on the first and second trigger signals and to control the measurement based on the measurement parameters. The first trigger signal may be generated based on the user's selection of an icon. The icon to be selected may be displayed on a display device used to display an image of a sample. The second trigger signal may be generated based on the user's selection and / or creation of a geometric element. The measurement includes at least a first geometric element and a second geometric element. Both the first and second geometric elements are required to perform the measurement. For example, the distance between a first geometric element and a second geometric element is to be measured. The measurement parameter determined based on the first and second trigger signals may represent the parameter of the measurement, for example, the distance between the first and second geometric elements to be measured. The device can control the measurement by generating a control signal and transmitting the control signal to a processing circuit responsible for performing the measurement. Upon receiving a second trigger signal indicating the first and second geometric elements that may be associated with a desired measurement, the device can receive information about each geometric element required for the (desired) measurement. This may allow the measurement parameter to be determined in an easy manner based on the first and second trigger signals. In this way, the number of choices that the user must make can be reduced. Thus, the user experience can be improved.

[0006] In one example, the second trigger signal may indicate trigger data that shows the user's selection of an existing geometric element. The device may be further configured to compare the selected existing geometric element with a first and / or second geometric element. If the selected existing geometric element matches the first or second geometric element, the device may be further configured to associate the selected existing geometric element with the first or second geometric element. The existing geometric element may be a geometric element displayed on a display device. For example, the existing geometric element may already be defined. Therefore, the existing geometric element can be assigned to a measurement without creating a new geometric element. The trigger data may include data about the user's selection of an existing geometric element. For example, the trigger data may include data about the user's intention to use an existing geometric element for a measurement. By comparing the selected existing geometric element, the device can determine whether the existing geometric element is available for measurement. If the selected existing geometric element is available for measurement, the device can associate the selected existing geometric element with the first or second geometric element. This may allow the user to select a geometric element for measurement. In this way, the unnecessary creation of geometric elements can be avoided.

[0007] For example, the device may be further configured to discard trigger data if the selected existing geometric element does not match the first or second geometric element. For instance, the device may not use the trigger data at all. This can ensure that only data relevant to the measurement is processed by the device.

[0008] In one example, the second trigger signal may indicate user data indicating a user request to generate a geometric element. The device may be further configured to compare the user request to generate a geometric element with a first geometric element and / or a second geometric element. If the user request to generate a geometric element matches either the first or second geometric element, the device may be further configured to generate either the first or second geometric element based on the user data. By comparing the user request to generate a geometric element, the device can determine whether the user request is usable for measurement. If the user request to generate a geometric element is usable for measurement, the device can generate the geometric element according to the user request. The generated geometric element may be either the first or second geometric element. This may allow the user to generate geometric elements for measurement in an easy manner.

[0009] In one example, user data may further indicate the location of the geometric elements to be generated. In this way, the user can define the geometric elements according to their actual needs.

[0010] For example, if a user's request to generate a geometric element does not match a first or second geometric element, the device may be further configured to discard the user data. For instance, the device may not need to use the user data at all. This can ensure that only data relevant to the measurement is processed by the device.

[0011] In one example, the device may be further configured to determine the order in which to compare a user's request to generate selected existing geometric elements or geometric elements with a first and a second geometric element. The order may be determined based on a first trigger signal. For example, the first trigger signal may indicate the order in which the first geometric element must be defined before the second geometric element. This may enable a simpler workflow. For example, the association of selected existing geometric elements can be performed in order. In this way, the number of selections that the user must make can be reduced.

[0012] In one example, the first trigger signal may indicate the desired measurement process. In this way, the measurement process can be started after all necessary geometric elements have been selected / created. This can potentially reduce the number of selections the user must make.

[0013] In one example, the device may be configured to receive a third trigger signal and further generate measurement parameters based on the third trigger signal. The third trigger signal may be received from an input device. The third trigger signal may indicate a user's selection of a measurement process. In this way, the user can define a measurement process, for example, by selecting a measurement process from multiple measurement processes. This may enable the provision of a simple workflow for setting up measurements.

[0014] In one example, the device may be further configured to acquire measurement results and transmit a measurement signal indicating the measurement results. In this way, the user can be informed of the measurement results.

[0015] Embodiments provide a method for an apparatus for an optical imaging system. The method includes receiving a first trigger signal indicating a user's desire to perform a measurement, the measurement requiring a first geometric element and a second geometric element. The method further includes receiving a second trigger signal indicating the first geometric element and the second geometric element. The method further includes determining measurement parameters based on the first and second trigger signals and controlling the measurement based on the measurement parameters.

[0016] Various examples of this disclosure relate to corresponding computer programs having program code for performing the above-described methods when the computer program is executed on a processor. [Brief explanation of the drawing]

[0017] Some examples of apparatus and / or methods are described below, for illustrative purposes only, with reference to the attached drawings. [Figure 1] This is a schematic diagram showing an example of equipment for an optical imaging system. [Figure 2a] This figure shows different examples of workflows for setting up measurements. [Figure 2b] This figure shows different examples of workflows for setting up measurements. [Figure 2c] This figure shows different examples of workflows for setting up measurements. [Figure 2d] This figure shows different examples of workflows for setting up measurements. [Figure 3] This is a schematic diagram illustrating the system. [Figure 4] An example of the method is shown in the flowchart.

[0018] Detailed explanation Various examples are described in more detail below, with reference to the attached diagrams illustrating several examples. In the diagrams, the thickness of lines, layers, and / or areas may be exaggerated for clarity.

[0019] Figure 1 shows a schematic diagram of an example of a device 130 for an optical imaging system 100. The device 130 is responsible for the task of controlling various aspects of the microscope of the optical imaging system 100, which may be an optical imaging system 100 for process control in an industrial environment, and various aspects of the optical imaging system 100 as a whole, as well as / or the task of processing various types of sensor data from the optical imaging system 100. As a result, the device 130 can be implemented as a computer system that works in conjunction with various components of the optical imaging system 100, such as the sensor 122.

[0020] As shown in Figure 1, the apparatus 130 comprises one or more processors 134 and one or more storage devices 136. Optionally, the apparatus 130 further comprises one or more interfaces 132. One or more processors 134 are coupled with one or more storage devices 136 and the optional one or more interfaces 132. Generally, the functions of the apparatus 130 may be provided by one or more processors 134 (for example, for determining measurement parameters) cooperating with one or more interfaces 132 (for exchanging data, for example, with an input device to receive a first trigger signal, with a display device 330 to transmit measurement signals) and / or one or more storage devices 136 (for storing and / or retrieving data).

[0021] Device 130 is configured to receive a first trigger signal indicative of a user's desire of the optical imaging system 100 to perform a measurement. The first trigger signal can be received from an input device. Alternatively, the first trigger signal may be received from a storage device. The input device may be a keyboard and / or a controller, which may include a mouse, a trackball, a touch screen, a voice recognition device, or any other device that enables a system user to input information. For example, the input device may be associated with a display device. The display device can be used to display the sample 110. For example, the sample 110 can be displayed through a microscope (not shown) of the optical imaging system 100. An image of the sample can be acquired by the sensor 122. The sample 110 can be a sample to be tested. For example, the sample 110 can be a workpiece in an industrial manufacturing process. For example, the optical imaging system 100 can be configured for process control of the sample 110. The optical imaging system 100 can be designed for use in a laboratory environment. The optical imaging system 100 can be used to inspect a sample 110 such as a product during a manufacturing process to ensure that it meets the required specifications and standards.

[0022] The optical imaging system 100 may be equipped with functions such as digital imaging (e.g., sensor 122), video capabilities (e.g., display device 330), and precision measurement tools, which enable users such as technicians to identify defects, monitor changes in the manufacturing process, and / or make adjustments as needed to ensure product quality. In addition, many process control microscopes have automated systems that can quickly analyze images and provide feedback to the production line, further streamlining the quality process control. However, there may be a need to adjust the measurements for process control, for example, to compensate for systematic errors caused by changes in the manufacturing process or to set up measurements for new workpieces.

[0023] The first trigger signal can be generated based on the user's selection of an icon. The icon can be a graphic symbol representing a specific action or function. The icon can be used alone or in combination with text to initiate an action. For example, the first trigger signal can be generated by the user selecting only one icon (e.g., refer to icon 280 in FIG. 2). Thus, the device 130 can receive information regarding a plurality of geometric elements required for measurement by only one selection that the user has to make. In this way, the number of selections that the user has to make can be reduced.

[0024] Furthermore, since the device 130 receives information regarding a plurality of geometric elements together with the first trigger signal, information regarding actual geometric elements, such as shape, dimensions, may be required. Thus, the device 130 is further configured to receive a second trigger signal indicating a first geometric element and a second geometric element. The second trigger signal can be received from an input device or a storage device. The second trigger signal can be received after the first trigger signal. For example, the second trigger signal can define the first geometric element and the second geometric element required for measurement.

[0025] The second trigger signal may include a plurality of sub-second trigger signals. The first sub-second trigger signal may indicate the first geometric element, and the second sub-second trigger signal may indicate the second geometric element. The first sub-second trigger signal can be received before the second sub-second trigger signal. Alternatively, the second trigger signal may be only a single signal indicating the first geometric element and the second geometric element.

[0026] Therefore, the second trigger signal may define the geometric elements required for the measurement indicated by the first trigger signal. Thus, the apparatus 130 is further configured to determine the measurement parameters. The measurement parameters are determined based on the first and second trigger signals. The measurement parameters may be specific variables that are measured and optionally monitored to ensure that the process is operating within desired limits. The measurement parameters may typically be key indicators of process performance and are used to detect when the process deviates from its normal operating range. By monitoring the measurement parameters of the process, it is possible to identify when the process is operating outside the desired range and take corrective action to bring it back into compliance. The measurement parameters may be associated with the first and / or second geometric elements. For example, a measurement involving the first and second geometric elements can be performed using only a single measurement parameter (e.g., only a single measurement process may be available). Therefore, further data may not be required to determine the measurement parameters. Alternatively, measurements involving the first and second geometric elements can be performed using multiple measurement parameters (for example, multiple measurement processes may be available). In this case, the user can select a measurement process. The device 130 may receive data indicating the selected measurement process and may determine the measurement parameters based on the selected measurement process.

[0027] For example, the measurement may be an optical inspection such as surface inspection, texture analysis, defect detection, or dimensional measurement. The measurement parameters may be part of the measurement. The measurement may involve measuring parameters such as the length, width, height, diameter, radius, roughness, texture, and structure of the sample 110.

[0028] Dimensional measurement refers to the process of determining the size and dimensions of a structure. For example, dimensional measurement may be used during the manufacturing process to inspect and verify the size and dimensions of a workpiece, such as sample 110. This is done to ensure that the workpiece meets the required specifications and standards, and to detect any deviations or defects that may affect the quality or performance of the workpiece. Dimensional measurement can be performed on a wide range of materials and workpieces, including metal parts, plastic parts, and electronic devices. Measurement parameters may be part of dimensional measurement. For example, the selection of the measurement process may define the distance between a first geometric element and a second geometric element to be measured, for example, from edge to edge or from center to center.

[0029] Furthermore, the device 130 is configured to control the measurement. The measurement is controlled based on measurement parameters. The device 130 can generate control signals. The device 130 can transmit control signals to another processor, for example, the processor of the optical imaging system 100, in order to perform the measurement. Thus, the device 130 can trigger the measurement. Alternatively, the device 130, for example, one or more processors 134, may perform the measurement.

[0030] The device 130 provides a flexible approach to generating geometric elements within a single workflow, and / or measuring the parameters of those geometric elements. For example, a single workflow can be initiated by the user selecting only a single icon. A first trigger signal and a second trigger signal can be used to facilitate a workflow for the user to perform measurements, such as defining the creation and measurement processes for geometric elements. Instead of first selecting separate icons to define the geometric elements and then selecting the corresponding measurement icons to define the measurement process, the device 130 can enable an intuitive and easy measurement setup.

[0031] For example, the user can select an existing geometric element. Additionally or alternatively, the user can generate a new geometric element. Based on a second trigger signal, the device 130 can determine whether an existing geometric element should be used or whether a new geometric element should be generated. Therefore, the user does not need to choose between using an existing geometric element and creating a new one. This can potentially reduce the number of choices the user has to make.

[0032] For example, the device 130 can recognize, during a selection, for instance, when the user clicks, whether an existing geometric element has been selected or whether a geometric element should be generated. Therefore, the device 130 can adjust the measurement accordingly. For example, if no geometric element exists during the first selection, the device 130 can associate the first selection with the user's intention to generate a geometric element. Thus, the device 130 can generate a region of interest based on the user's first and second selections. Furthermore, the device 130 can generate a geometric element, for example, a first geometric element, within the region of interest. Alternatively, if an existing geometric element exists during the first selection, the device 130 may determine whether the user intended to select the existing geometric element. For example, the device 130 can associate the existing geometric element with the first geometric element. In this case, the device 130 can associate the second selection with the user's intention to select or generate a second geometric element. In this way, the number of selections the user must make can be reduced.

[0033] The proposed concept is centered around two main components: a microscope equipped with optical components and capable of housing a display device 330 used for observing a sample 110, and a device 130 used to control an optical imaging system 100, process sensor data from the microscope, for example, a sensor 122, and control measurements.

[0034] Generally, an optical microscope system 100 includes a microscope suitable for examining objects that are too small to be examined with the human eye (alone). For example, the microscope may provide optical magnification of a sample such as the sample 110 shown in Figure 1. Thus, the structure of the sample 110, for example, a structure formed by a manufacturing process, can be magnified and measured with improved precision. In modern microscopes, optical magnification is often provided by a camera or imaging sensor, for example, the microscope's optical imaging sensor 122. The microscope may further include one or more optical magnification components used to magnify the image of the sample 110, such as an objective lens.

[0035] Various different types of optical imaging systems exist. For example, optical imaging system 100 may be used for process control. Optical imaging system 100 may comprise an optical system, a camera or detector, and a monitor such as a display device 330. The optical system may typically comprise optical components such as lenses, mirrors, or other optical components that work together to produce a high-resolution image of the sample 110, e.g., a live view. The camera or detector, e.g., sensor 122, can be used to acquire a live view, e.g., a live view of the sample 110, and convert it into a digital signal that can be displayed on the display device 330 and / or analyzed using software, e.g., software implemented by the apparatus 130. The display device 330 may be used to display the live view acquired by sensor 122 and any additional information such as measurement data or analysis methods, or to provide the user with a graphical user interface that triggers user selections to generate a first trigger signal and / or a second trigger signal. For example, the display device 330 may be used to display a number of icons to be selected by the user.

[0036] In one example, the second trigger signal may indicate trigger data indicating a user's selection of an existing geometric element. The device 130 may be further configured to compare the selected existing geometric element with a first and / or second geometric element. If the selected existing geometric element matches the first or second geometric element, the device 130 may be further configured to associate the selected existing geometric element with the first or second geometric element. For example, the existing geometric element may be a geometric element displayed on a display device, e.g., display device 330. The trigger data may also enable the device 130 to associate the existing geometric element with a measurement. In this way, the unnecessary creation of geometric elements can be avoided, which can reduce the number of selections the user must make. For example, the user may select an existing geometric element by, for example, clicking on it. Data regarding the click on the existing geometric element may be part of the trigger data. Thus, the device 130 may receive information about the click on the existing geometric element via the trigger data. The device 130 can assign existing geometric elements to the first or second geometric elements for measurement based on trigger data (and a first trigger signal defining the first and second geometric elements).

[0037] For example, if a first geometric element is not defined for measurement (and a selected existing geometric element matches the required first geometric element), the device 130 may associate the trigger data with the first geometric element. Thus, the device 130 can map the selected existing geometric element to the first geometric element. Alternatively, if a first geometric element is already defined for measurement (and a selected existing geometric element matches the required second geometric element), the device 130 may associate the trigger data with the second geometric element. Thus, the device 130 can map the selected existing geometric element to the second geometric element. In this way, the device 130 can provide the user with a single workflow. Furthermore, it can reduce the number of selections the user must make.

[0038] In one example, if the selected existing geometric element does not match the first or second geometric element, the device 130 may be further configured to discard the trigger data. In this way, the device 130 can determine whether the trigger data is to be used for measurement. For example, the user may select an existing geometric element that does not belong to the measurement. Therefore, the device 130 can discard the trigger data and wait for other trigger data.

[0039] In one example, the second trigger signal indicates user data indicating the user's request to generate a geometric element. The device 130 may be further configured to compare the user's request to generate a geometric element with a first geometric element and / or a second geometric element. If the user's request to generate a geometric element matches either the first or second geometric element, the device 130 may be further configured to generate either the first or second geometric element based on the user data. In this way, the device 130 can generate geometric elements in an easy manner.

[0040] For example, user data may indicate two user choices. The first choice may be made by the user before the second choice. The first choice may be, for example, a selection of a position on the sample 110 in a live image displayed on the display device 330. The second choice may be, for example, a selection of another position on the sample 110 in a live image displayed on the display device 330. Thus, the apparatus 130 may determine the user's intention to generate geometric elements based on the first and second choices. The apparatus may generate a region of interest for generating geometric elements. The region of interest may be generated based on the first and second choices. Geometric elements may be generated within the region of interest. Thus, the apparatus 130 may provide the user with a single workflow for easily defining measurements, such as geometric elements.

[0041] For example, if a first geometric element has already been defined or generated, the device 130 may associate user data with a second geometric element. Thus, the user data can be used to define or generate a second geometric element. The user data may indicate that the first geometric element and / or the second geometric element are to be defined (e.g., selected from existing geometric elements) and / or generated.

[0042] In one example, user data may further indicate the location of the geometric elements to be generated. For instance, as described above, user data may be used by the device 130 to generate a region of interest. Therefore, since the geometric elements can be generated within the region of interest, user data can indicate the location of the geometric elements. In this way, the user can select the location or region of the geometric elements to be generated.

[0043] For example, if a user's request to generate a geometric element does not match a first or second geometric element, the device 130 may be further configured to discard the user data. In this way, the device 130 can determine whether the user data is to be used for measurement. For example, in a live view of sample 110, the user may select an area from which no geometric elements can be generated. Therefore, the device 130 can discard the user data and wait for other user data.

[0044] For example, the device 130 may be further configured to determine the order in which a user's request to generate a selected existing geometric element or geometric element is compared with a first geometric element and a second geometric element. The order may be determined based on a first trigger signal. For example, the first trigger signal may indicate the required order of the first and second geometric elements. For example, to provide a single workflow, the device 130 may need to define the order in which the first and second geometric elements are defined and / or generated. For example, the device 130 may assign the user's selection to the first or second geometric element based on the order. For example, the first geometric element may need to be defined or generated before the second geometric element can be defined or generated. This may make it possible to ensure that the user's selection is associated with or assigned to the correct geometric element. In this way, the number of selections that the user must make can be reduced.

[0045] The order can be assigned to icons that the user can select. For example, icons may represent different geometric elements. The arrangement of geometric elements may indicate the order. In this way, icons can inform the user of the order in which geometric elements must be defined or created. Data regarding the user's selection of icons may be part of a first trigger signal. In this way, the device 130 can receive the information necessary to determine the order in which to assign selected existing geometric elements or user requests to each geometric element. Furthermore, icons can inform the user of a sequence of a single workflow provided by the device 130.

[0046] In one example, the first trigger signal may indicate a desired measurement process. For instance, the first trigger signal may indicate only one possible measurement process. Thus, the device 130 can control the measurement after receiving a second trigger signal. The second trigger signal may be used by the device 130 to determine the first geometric element in a second geometric element for measurement. This may allow the device 130 to easily control the measurement.

[0047] Alternatively, the user may select from multiple measurement processes. In one example, the device 130 may be further configured to receive a third trigger signal from an input device or storage device and to generate measurement parameters based on the third trigger signal. The third trigger signal may indicate the user's selection of a measurement process. The measurement process may define actual measurements, such as surface inspection, texture analysis, defect detection, or optical inspection such as dimensional measurement. Additionally or alternatively, the measurement process may define the measurement of parameters, such as the distance between a first geometric element and a second geometric element, the dimensions of the first geometric element, or the shape of the first geometric element. The measurement process may also be called a measurement feature. Thus, the third trigger signal may indicate the user's selection of specific parameters for measurement, such as a measurement feature. For example, the user may select parameters for measurement after defining and / or generating geometric elements. Data regarding the user's selection of parameters for measurement may be part of the third trigger signal.

[0048] In one example, the device 130 may be further configured to acquire measurement results for a measurement and transmit a measurement signal indicating the measurement results. For example, the measurement signal may be transmitted to a display device or a storage device such as a frame buffer. In this way, the user can be informed of the measurement results.

[0049] As shown in Figure 1, one or more optional interfaces 132 are coupled to each of the one or more processors 134 in the apparatus 130. In the example, one or more processors 134 may be implemented using any processing means, such as one or more processing units, one or more processing devices, processors, computers, or programmable hardware components that can operate with appropriately adapted software. Similarly, the functions of the one or more processors 134 described may be implemented in software, which is then executed by one or more programmable hardware components. Such hardware components may include general-purpose processors, digital signal processors (DSPs), microcontrollers, and the like. One or more processors 134 can control one or more interfaces 132, and as a result, any data transfers that occur through one or more interfaces 132, and / or any interactions that one or more interfaces 132 may be involved in, can be controlled by one or more processors 134.

[0050] In one embodiment, the apparatus 130 may include memory, for example, one or more storage devices 136, and at least one or more processors 134 operably coupled to the memory and configured to perform the methods described below.

[0051] In the example, one or more interfaces 132 may correspond to any means for acquiring, receiving, transmitting, or providing analog or digital signals or information, such as any connectors, contacts, pins, registers, input ports, output ports, conductors, lanes, etc., that enable the provision or acquisition of signals or information. One or more interfaces 132 may be wireless or wired and may be configured to communicate with further internal or external components, such as transmitting or receiving signals, information.

[0052] The device 130 may be a computer, processor, control unit, (field)programmable logic array ((F)PLA), (field)programmable gate array ((F)PGA), graphics processor unit (GPU), application-specific integrated circuit (ASIC), integrated circuit (IC), or system-on-a-chip (SoC) system. The device 130 may be part of the optical imaging system 100. Alternatively, the device 130 may be outside the optical imaging system 100 and may be part of, for example, a display device 330.

[0053] Further details and embodiments will be mentioned in relation to the examples described below. The example shown in Figure 1 may have one or more additional optional features corresponding to one or more embodiments mentioned in relation to the proposed concept, or to one or more examples described below (e.g., Figures 2 to 4).

[0054] Figures 2a to 2d show different examples of workflows for setting up measurements. Figure 2a shows a prior art workflow. Figure 2a shows two different icons 210 and 212 for generating geometric elements and one icon 214 for generating or defining measurement features. For example, icon 210 is for generating lines, icon 212 is for generating circles, and icon 214 is for defining measurements between lines and circles.

[0055] The workflow shown in Figure 2a requires the user to select icon 210 to generate a line. To define the region of interest for line fitting to generate the line, the user must further select two points on the sample, for example, two points in the live view of the sample, at 220. After generating the line, the user selects icon 212 to generate a circle. To define the region of interest for circle fitting to generate the circle, the user must further select two points in the live view, at 230. After generating the circle, the user selects icon 214 to define the measurement features. The measurement features can be adjusted to circle measurements. To define the line and circle measurements, the user must further select the line at 240, the circle at 250, and the desired measurement features, for example, location measurements, at 260. Thus, the number of selections the user must make is at least 10. For example, the user must click 10 different icons and / or locations in the live view / icon panel to perform the measurements. For example, the cursor used by the user to make the selections must move between the live view and the icon panel 3 times. Therefore, the user experience may be degraded by the number of selections required and / or by switching between, for example, a live view for defining areas of interest and, for example, an icon panel for selecting geometric elements to be generated.

[0056] In contrast, the device shown in Figure 1 can be used to reduce the number of selections that the user must make. As seen in Figures 2b to 2d, the number of selections the user makes can be reduced based on a first trigger signal, a second trigger signal, and an optional third trigger signal.

[0057] Icon 280 can be designed so that the order of defining / generating geometric elements is from left to right (see arrow 278 indicating the creation order of geometric elements shown in icon 280). For example, icon 280 may indicate that the user must first define or generate the first geometric element 282, such as a line. After defining or generating the first geometric element 282, the user must then define or generate the second geometric element 284. In this way, the user can be informed of the workflow supported or provided by the device.

[0058] The device may offer an "on-the-fly" workflow. An on-the-fly workflow may allow for the direct definition of the generation of required geometric elements and the selection of measurement features in a single workflow. This may reduce the number of selections the user must make. For example, as shown in Figure 2b, the number of clicks is reduced to six. Furthermore, the cursor moves only once between the live image and the icon panel. This may improve the user experience. As seen in Figure 2b, the user may need to select icon 280 to begin setting up the measurement. During the measurement setup, the user may define measurement features and geometric elements on the fly. In 290, the user may select a region of interest for line fitting to generate a first geometric element, e.g., a line. In 292, the user may select a region of interest for circle fitting to generate a second geometric element, e.g., a circle. Data regarding the user's selections in 292 and 294 may be part of the user data described above. In 294, the user may select measurement features. Therefore, an on-the-fly workflow may require only six selections from the user to set up the measurement. Thus, the user can perform the measurement by making only six clicks.

[0059] Figures 2c and 2d illustrate an alternative, or mixed approach, in which one geometric element already exists. Therefore, the device can distinguish between the user's request to select an existing geometric element and the user's request to generate a new geometric element. For example, as seen in Figures 2c and 2d, the device may adopt a workflow depending on the user's selection (received by a second trigger signal).

[0060] Figure 2c shows a workflow where a second geometric element already exists. The user can start the workflow by selecting icon 280, which may be the same icon shown in Figure 2b. In 290', the user can select a region of interest for line fitting to generate the first geometric element, such as a line. The data for selection 290' may be part of the user data described above. In 292', the user can select an existing geometric element as the second geometric element for measurement. The data for selection 292' may be part of the trigger data described above. Thus, the device can associate the existing geometric element with the second geometric element for measurement. In 294', the user can select a measurement feature. Thus, an on-the-fly workflow may require only five selections from the user to set up the measurement.

[0061] Figure 2d shows a workflow where the first geometric element already exists. The user can start the workflow by selecting icon 280, which may be the same icon shown in Figure 2b or Figure 2c. At 290'', the user can select an existing geometric element as the first geometric element for measurement. The data for selection 290'' may be part of the trigger data described above. Thus, the device can associate the existing geometric element with the first geometric element for measurement. At 292'', the user can select a region of interest for circle fitting to generate a second geometric element, such as a circle. The data for selection 292'' may be part of the user data described above. At 294'', the user can select a measurement feature. Thus, an on-the-fly workflow may require only five selections from the user to set up the measurement.

[0062] Further details and embodiments are referred to in relation to the examples described above and / or below. The example shown in Figure 2 may have one or more optional additional features corresponding to the proposed concept or one or more embodiments referred to in relation to one or more examples described above (e.g., Figure 1) and / or below (e.g., Figures 3-4).

[0063] Some embodiments relate to an optical imaging system comprising the apparatus described in relation to Figure 1. Alternatively, the optical imaging system may be part of or connected to the apparatus described in relation to Figure 1.

[0064] Figure 3 shows a schematic diagram of system 300, for example, an optical imaging system 300. The optical imaging system 300 may comprise the apparatus described with reference to Figure 1 and a display device 330. The display device 330 may be part of a computer system 320. For example, a microscope 310 may comprise the apparatus or be communicatively coupled to the apparatus. Alternatively, the computer system 320 may comprise the apparatus. The microscope 310 can be communicatively coupled to the display device 330. Thus, the apparatus can transmit display signals from the microscope 310 to the display device 330 or to a storage device such as a frame buffer.

[0065] Figure 3 shows a schematic diagram of a system 300 configured to carry out the methods described herein, for example, the methods described with reference to Figures 2 and 4. The system 300 includes a microscope 310 and a computer system 320. The microscope may be equipped with the apparatus described above, for example, with reference to Figure 1. The microscope 310 is configured to acquire images and is connected to the computer system 320. The computer system 320 is configured to carry out at least a portion of the methods described herein. The computer system 320 may be configured to run machine learning algorithms. The computer system 320 and the microscope 310 may be separate entities, but they may also be integrated into one common housing. The computer system 320 may be part of the central processing system of the microscope 310, and / or the computer system 320 may be part of the dependent components of the microscope 310, such as sensors, actors, cameras, or illumination units of the microscope 310.

[0066] The computer system 320 may be a local computer device (e.g., a personal computer, laptop, tablet computer, or mobile phone) comprising one or more processors and one or more storage devices, or it may be a distributed computer system (e.g., a cloud computing system comprising one or more processors and one or more storage devices distributed to various locations such as local clients and / or one or more remote server farms and / or data centers). The computer system 320 may include any circuit or combination of circuits. In one embodiment, the computer system 320 may include one or more processors, which can be of any kind. As used herein, the processor may be intended to be any kind of computing circuit, such as a microprocessor for a microscope or microscopic component (e.g., a camera), a microcontroller, a composite instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multicore processor, a field-programmable gate array (FPGA), or any other kind of processor or processing circuit. Other types of circuits that may be included in the computer system 320 may be custom circuits, application-specific integrated circuits (ASICs), etc., such as one or more circuits (communication circuits, etc.) used in wireless devices such as mobile phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. The computer system 320 may also include one or more storage devices that may include one or more memory elements suitable for a particular application, such as main memory in the form of random access memory (RAM), one or more hard drives and / or one or more drives that handle removable media such as compact discs (CDs), flash memory cards, digital video discs (DVDs), etc.The computer system 320 may include a display device, one or more speakers and a controller which may include a keyboard and / or mouse, trackball, touchscreen, voice recognition device, or any other device which enables a user of the system to input information into and receive information from the computer system 320.

[0067] Further details and embodiments are referenced in relation to the examples described above and / or below. The example shown in Figure 3 may have one or more embodiments referenced in relation to the proposed concept, or one or more optional additional features corresponding to the examples described above (e.g., Figures 1-2) and / or below (e.g., Figure 4).

[0068] Figure 4 shows a flowchart of an example of Method 400. Method 400 for an optical imaging system includes receiving a first trigger signal 410 indicating a user's desire to perform a measurement on the optical imaging system. The measurement requires a first geometric element and a second geometric element. Furthermore, Method 400 includes receiving a second trigger signal 420 indicating the first geometric element and the second geometric element. The first trigger signal may be received from an input device and / or a storage device. The second trigger signal may be received from an input device and / or a storage device. Furthermore, Method 400 includes determining measurement parameters based on the first and second trigger signals 430 and controlling the measurement based on the measurement parameters 440. Method 400 may be performed by the apparatus described with reference to Figure 1.

[0069] Further details and embodiments are mentioned in connection with the examples described above. The example shown in Figure 4 may have one or more embodiments mentioned in connection with the proposed concept, or one or more optional additional features corresponding to one or more of the examples described above (e.g., Figures 1 to 3).

[0070] Some or all of the method steps may be performed by a hardware device (or by using a hardware device), such as a processor, microprocessor, programmable computer, or electronic circuit. In some embodiments, one or more of the most critical steps may be performed by such a device.

[0071] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. This implementation is feasible using a non-transient recording medium, which is a digital recording medium, etc., that stores electronically readable control signals and cooperates (or can cooperate) with a programmable computer system to carry out each method. Examples include floppy disks, DVDs, Blu-rays, CDs, ROMs, PROMs and EPROMs, EEPROMs, or FLASH memory. Thus, the digital recording medium may be computer-readable.

[0072] Some embodiments of the present invention include a data carrier having electronically readable control signals that can cooperate with a programmable computer system so as to carry out any of the methods described herein.

[0073] Generally, embodiments of the present invention can be implemented as a computer program product comprising program code, which operates to perform one of the methods when the computer program product is executed on a computer. This program code may be stored, for example, on a machine-readable carrier.

[0074] Another embodiment includes a computer program stored in a machine-readable carrier for carrying out any of the methods described herein.

[0075] Therefore, in other words, embodiments of the present invention are computer programs having program code for carrying out any of the methods described herein when the computer program is executed on a computer.

[0076] Accordingly, another embodiment of the present invention is a recording medium (or data carrier or computer-readable medium) containing a stored computer program for carrying out any of the methods described herein when executed by a processor. The data carrier, digital recording medium, or recording medium is typically tangible and / or non-transient. Another embodiment of the present invention is an apparatus, such as those described herein, comprising a processor and a recording medium.

[0077] Therefore, another embodiment of the present invention is a data stream or signal sequence representing a computer program for carrying out any of the methods described herein. The data stream or signal sequence may be configured to be transmitted, for example, over a data communication connection, such as the Internet.

[0078] Another embodiment includes processing means, for example, a computer or programmable logic device configured or adapted to carry out any of the methods described herein.

[0079] Another embodiment includes a computer having an installed computer program for carrying out any of the methods described herein.

[0080] Another embodiment of the present invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for carrying out any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may include, for example, a file server for transferring the computer program to the receiver.

[0081] In some embodiments, a programmable logic device (e.g., a field-programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, the field-programmable gate array may cooperate with a microprocessor to carry out any of the methods described herein. Generally, the methods are advantageously carried out by any hardware device.

[0082] When several embodiments are described in relation to a device or system, these embodiments should also be understood as descriptions of the corresponding methods, and vice versa. For example, a block, device, or functional embodiment of a device or system may correspond to a feature of the corresponding method, such as a method step. Accordingly, embodiments described in relation to a method should also be understood as descriptions of the corresponding block, corresponding element, characteristic, or functional feature of the corresponding device or system.

[0083] The following claims are incorporated into the detailed description herein, and each claim may stand on its own as a separate example. While a dependent claim in a claim refers to a specific combination with one or more other claims, it should also be noted that other examples may also include combinations of a dependent claim with the subject matter of any other dependent or independent claim. Unless it is stated that a particular combination is not intended in an individual case, such combinations are expressly proposed herein. Furthermore, features of a claim should also be included in any other independent claim, even if the claim is not directly defined as dependent on any other independent claim.

[0084] Aspects and features described in relation to a particular example of a prior example may be combined with one or more further examples to replace identical or similar features in further examples, or to introduce additional features in further examples. [Explanation of symbols]

[0085] 100 Optical Imaging Systems 110 samples 122 sensors 130 Equipment 132 Interfaces 134 processors 136 Storage Devices 210,212,214 icons 220,230 Selection of Area of ​​Interest 240,250 Geometry Element Selection 260 Selection of Measurement Features 278 Geometry element creation order 280 icons 282 First Geometric Element 284 Second Geometric Element 290,290',292,292'' Selection of Area of ​​Interest 290'',292' Selection of Geometry Elements 294,294',294'' Selection of measurement features 300 Systems 310 Microscope 320 Computer Systems 330 Display Devices 400 ways 410 Reception of the first trigger signal 420 Reception of the second trigger signal 430 Determination of measurement parameters 440 Measurement Control

Claims

1. An apparatus (130) for an optical imaging system comprising one or more processors (134) and one or more storage devices (136), wherein the apparatus (130) Upon receiving a first trigger signal indicating a user request for the optical imaging system to perform a measurement requiring a first geometric element and a second geometric element, A second trigger signal indicating the first geometric element and the second geometric element is received. Based on the first trigger signal and the second trigger signal, the measurement parameters are determined. A device (130) configured to control the measurement based on the measurement parameters.

2. The second trigger signal indicates trigger data indicating the user's selection of an existing geometric element, and the device (130) further: The selected existing geometric element is compared with at least one of the first geometric element or the second geometric element. The apparatus (130) according to claim 1, wherein if the selected existing geometric element matches the first geometric element or the second geometric element, the selected existing geometric element is configured to associate with the first geometric element or the second geometric element.

3. The apparatus (130) according to claim 2, further configured to discard the trigger data if the selected existing geometric element does not match the first geometric element or the second geometric element.

4. The second trigger signal indicates user data that represents the user's request to generate a geometric element, and the device (130) further, The user's request to generate a geometric element is compared with at least one of the first geometric element or the second geometric element. The apparatus (130) according to any one of claims 1 to 3, configured to generate the first geometric element or the second geometric element based on the user data if the user's request to generate a geometric element matches the first geometric element or the second geometric element.

5. The apparatus (130) according to claim 4, further indicating the position of the geometric elements to be generated, based on the user data.

6. The apparatus (130) according to claim 4 or 5, further configured to discard the user data if the user's request to generate a geometric element does not coincide with the first geometric element or the second geometric element.

7. The apparatus (130) according to any one of claims 2 to 6, further configured to determine, based on the first trigger signal, an order for comparing the selected existing geometric element or the user's request to generate geometric elements with the first geometric element and the second geometric element.

8. The apparatus (130) according to any one of claims 1 to 7, wherein the first trigger signal indicates a desired measurement process.

9. The aforementioned device (130) further, Upon receiving a third trigger signal indicating the user's selection of a measurement process, The apparatus (130) according to any one of claims 1 to 8, further configured to generate the measurement parameters based on the third trigger signal.

10. The aforementioned device (130) further, Obtain the measurement results for the aforementioned measurement, The apparatus (130) according to any one of claims 1 to 9, configured to transmit a measurement signal indicating the measurement result.

11. An optical system (100) comprising the apparatus (130) according to any one of claims 1 to 10.

12. A method (400) for an apparatus for an optical imaging system, Receiving a first trigger signal (410) indicating a user request of the optical imaging system to perform a measurement requiring a first geometric element and a second geometric element, Receiving a second trigger signal indicating the first geometric element and the second geometric element (420), Based on the first trigger signal and the second trigger signal, the measurement parameters are determined (430), A method (400) comprising controlling the measurement based on the measurement parameters (440).

13. A computer program having program code for carrying out the method according to claim 12 when the program is executed on a processor.

Images