System and method for optimizing imaging settings for machine vision operations
By detecting the start trigger, the additional component requirements and installation complex problems of multiple imaging settings capture in the prior art are solved, and the rapid image setting adjustment and efficient image capture of the machine vision system are realized.
Patent Information
- Application Number
- CN202110871030.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-07-31
- Filing Date
- 2021-07-30
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-07-30
AI Technical Summary
Existing machine vision systems require multiple expensive additional components when capturing multiple imaging settings, resulting in complex installation, delayed and space occupancy, and conventional systems require frequent adjustments to imaging settings for high-fidelity image analysis.
By detecting the starting trigger, the processor automatically adjusts the imaging settings of the imaging device, including parameters such as aperture size, exposure length, ISO value, focal value and lighting control, to achieve fast and effective real-time image setting adjustment.
Reduces the need for expensive additional components, shortens installation time, improves image capture and processing efficiency, and optimizes the efficiency and effectiveness of machine vision operations.
Smart Images

Figure CN114091497B_ABST
Abstract
Description
Background Art
[0001] Since machine vision systems were introduced into industrial settings, developers have sought to reduce their corresponding costs and space requirements. These systems are able to perform machine vision jobs to provide high-fidelity image analysis at the expense of capturing images under finely tuned imaging settings (e.g., exposure length). However, these machine vision jobs also typically require the machine vision system to cycle through multiple imaging settings to capture multiple images with, for example, different depths of field. Therefore, multiple cameras and additional external lights are required in many conventional situations to ensure that the machine vision system can capture appropriate images for each imaging setting in the imaging setting to provide the intended image analysis.
[0002] Unfortunately, each additional piece of equipment can be very expensive, can further complicate installation, and can delay a machine vision job. For example, a typical exterior light can cost a few hundred to a few thousand dollars, while a typical camera and reader combination can cost a few thousand to tens of thousands of dollars. Each additional component also needs to be integrated into the machine vision system, which can easily cost twice the purchase price. In addition, each additional component purchased and installed in a machine vision system can take up valuable physical space, creating unnecessary or dangerous congestion in an industrial setting. Furthermore, the conventional system's imaging settings often require adjustments to the additional component while the conventional system is performing the job, resulting in significant delays in the conventional system completing the job.
[0003] Therefore, there is a need for systems and methods for optimizing image settings for machine vision jobs that allow for fast and efficient real-time image settings adjustments to a machine vision system during a machine vision job. Summary of the invention
[0004] In an embodiment, the present invention is a method for optimizing one or more imaging settings for a machine vision operation. The method includes detecting a start trigger by one or more processors, the start trigger initiating the machine vision operation. The method further includes capturing a first image of a target object by an imaging device according to a first configuration of the one or more imaging settings in response to detecting the start trigger. The method further includes automatically adjusting the one or more imaging settings to a second configuration by the one or more processors in response to capturing the first image of the target object, the second configuration including at least one imaging setting different from the first configuration. The method further includes capturing a second image of the target object by the imaging device according to the second configuration of the one or more imaging settings.
[0005] In variations of this embodiment, the one or more imaging settings include one or more of (i) aperture size, (ii) exposure length, (iii) ISO value, (iv) focal length value, (v) gain value, or (vi) illumination control.
[0006] In another variation on this embodiment, the start trigger includes the target object entering the field of view (FOV) of the imaging device.
[0007] In yet another variation of this embodiment, the imaging device is a single camera.
[0008] In yet another variation of this embodiment, the machine vision job includes one or more machine vision tools, and the one or more machine vision tools are configured to perform one or more machine vision techniques on the first image and the second image. In a further variation of this embodiment, the method further includes: performing the one or more machine vision techniques on the first image and the second image according to the one or more machine vision tools included in the machine vision job by the one or more processors; and generating a result signal representing a pass indication or a fail indication of the machine vision job by the one or more processors. In a further variation of this embodiment, the one or more machine vision tools include at least one of (i) a barcode scanning tool, (ii) a pattern matching tool, (iii) an edge detection tool, (iv) a semantic segmentation tool, (v) an object detection tool, or (vi) an object tracking tool.
[0009] In yet another variation of this embodiment, the machine vision operation includes a predetermined number of configurations of the one or more imaging settings. In a further variation of this embodiment, the method further includes: (a) designating the second image as a current image; (b) in response to capturing the current image of the target object, automatically adjusting the one or more imaging settings to a subsequent configuration, the subsequent configuration including at least one imaging setting that is different from each previous configuration of the one or more imaging settings; (c) capturing a subsequent image of the target object by the imaging device according to the subsequent configuration of the one or more imaging settings; (d) designating the subsequent image as the current image; and (e) iteratively performing steps (b)-(e) until each of the predetermined number of configurations of the one or more imaging settings has been utilized to capture at least one image of the target object.
[0010] In another embodiment, the present invention is a computer system for optimizing one or more imaging settings for a machine vision job. The system may include an imaging device configured to capture a first image of a target object according to a first configuration of one or more imaging settings, and to capture a second image of the target object according to a second configuration of the one or more imaging settings. The system may further include one or more processors; and a non-transitory computer-readable memory coupled to the imaging device and the one or more processors. The memory stores instructions thereon, which, when executed by the one or more processors, cause the one or more processors to: detect a start trigger that initiates a machine vision job, and in response to capturing the first image of the target object, automatically adjust the one or more imaging settings to the second configuration, the second configuration including at least one imaging setting that is different from the first configuration.
[0011] In variations of this embodiment, the one or more imaging settings include one or more of (i) aperture size, (ii) exposure length, (iii) ISO value, (iv) focal length value, (v) gain value, or (vi) illumination control.
[0012] In a variation on this embodiment, the start trigger includes the target object entering a field of view (FOV) of the imaging device.
[0013] In another variation of this embodiment, the machine vision job includes one or more machine vision tools, and the one or more machine vision tools are configured to perform one or more machine vision techniques on the first image and the second image. Further in this variation, when the instructions are executed by the one or more processors, the one or more processors are further caused to: perform the one or more machine vision techniques on the first image and the second image according to the one or more machine vision tools included in the machine vision job; and generate a result signal indicating a pass indication or a fail indication of the machine vision job.
[0014] In yet another variation of this embodiment, the machine vision operation includes a predetermined number of configurations of the one or more imaging settings. Further in this variation, when the instructions are executed by the one or more processors, the one or more processors are further caused to: (a) designate the second image as a current image; (b) in response to capturing the current image of the target object, automatically adjust the one or more imaging settings to a subsequent configuration, the subsequent configuration including at least one imaging setting different from each previous configuration; (c) capture a subsequent image of the target object by the imaging device according to the subsequent configuration of the one or more imaging settings; (d) designate the subsequent image as the current image; and (e) iteratively perform steps (b)-(e) until each of the predetermined number of configurations of the one or more imaging settings has been utilized to capture at least one image of the target object.
[0015] In yet another embodiment, the present invention is a tangible machine-readable medium for optimizing one or more imaging settings for a machine vision operation. When executed, the instructions cause at least: detecting a start trigger that initiates a machine vision operation; in response to detecting the start trigger, capturing a first image by an imaging device according to a first configuration of the one or more imaging settings; in response to capturing the first image of the target object, automatically adjusting the one or more imaging settings to the second configuration, the second configuration including at least one imaging setting different from the first configuration; and capturing a second image of the target object by the imaging device according to the second configuration of the one or more imaging settings.
[0016] In a variation of this embodiment, the machine vision job includes one or more machine vision tools, and the one or more machine vision tools are configured to perform one or more machine vision techniques on the first image and the second image. Further in this variation, when the instructions are executed, the machine is further caused to: perform the one or more machine vision techniques on the first image and the second image according to the one or more machine vision tools included in the machine vision job; and generate a result signal indicating a pass indication or a fail indication of the machine vision job.
[0017] In another variation of this embodiment, the machine vision operation includes a predetermined number of configurations of the one or more imaging settings, and wherein when the instructions are executed, the machine is further caused to at least: (a) designate the second image as a current image; (b) in response to capturing the current image of the target object, automatically adjust the one or more imaging settings to a subsequent configuration, the subsequent configuration including at least one imaging setting that is different from each previous configuration; (c) capture a subsequent image of the target object by the imaging device according to the subsequent configuration of the one or more imaging settings; (d) designate the subsequent image as the current image; and (e) iteratively perform steps (b)-(e) until each of the predetermined number of configurations of the one or more imaging settings has been utilized to capture at least one image of the target object. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The accompanying drawings, in which the same reference numerals represent the same or functionally similar elements throughout the different views, together with the following detailed description, are incorporated herein and form a part of the specification and are used to further illustrate embodiments of the concepts including the claimed invention and to explain the various principles and advantages of those embodiments.
[0019] Figure 1 is an example system for optimizing one or more imaging settings for machine vision tasks according to embodiments described herein.
[0020] Figure 2 According to the embodiments described herein Figure 1 A stereoscopic view of the imaging device.
[0021] Figure 3 Depicted is an example application interface for optimizing one or more imaging settings for machine vision jobs according to embodiments described herein.
[0022] Figure 4A Depicted are additional application interfaces for optimizing one or more imaging settings for machine vision jobs according to embodiments described herein.
[0023] Figure 4B Yet another application interface for optimizing one or more imaging settings for machine vision tasks according to embodiments described herein is depicted.
[0024] Figure 5 is a flow chart representing a method for optimizing one or more imaging settings for machine vision tasks according to embodiments described herein.
[0025] Figure 6Execution of an example machine vision job including multiple imaging setups is depicted, wherein the example machine vision job implements the example methods and / or operations described herein.
[0026] Those skilled in the art will appreciate that the elements in the drawings are shown for simplicity and clarity and are not necessarily drawn to scale. For example, the sizes of some of the elements in the drawings may be exaggerated relative to other elements to help improve understanding of the embodiments of the present invention.
[0027] Device and method construction have been represented in the drawings by conventional symbols where appropriate, showing only those specific details relevant to an understanding of the embodiments of the invention so as not to obscure the disclosure with details that would be apparent to one of ordinary skill in the art having the benefit of the description herein. DETAILED DESCRIPTION
[0028] Owners / operators of machine vision systems have long been plagued by the inability to use a variety of imaging setups to achieve high-fidelity image analysis without purchasing and installing additional system components. Cameras, readers, external lights, and other components are very expensive to purchase and install, and often require the user / operator to individually change component settings between image captures to ensure that each image is suitable for a specific machine vision technique (e.g., bar code scanning, edge detection, etc.). It is therefore an object of the present disclosure to eliminate these and other problems of conventional machine vision systems by enabling the creation and execution of machine vision jobs that include a set of imaging setups that are applied sequentially by a machine vision camera. As described herein, embodiments of the present disclosure can reduce the need for expensive additional components, speed up installation and integration time for machine vision systems, and ensure that the system maximizes image capture and processing efficiency.
[0029] Figure 1 An example intelligent imaging system 100 is shown, configured to analyze pixel data of an image of a target object to optimize one or more imaging settings for a machine vision task, in accordance with various embodiments disclosed herein. Figure 1In an example embodiment of the present invention, the intelligent imaging system 100 includes a user computing device 102 and an imaging device 104, which is communicatively coupled to the user computing device 102 via a network 106. In general, the user computing device 102 and the imaging device 104 are capable of executing instructions to, for example, implement the operations of the example methods described herein, as represented by the flowcharts of the figures accompanying this specification. The user computing device 102 is generally configured to enable a user / operator to create a machine vision job for execution on the imaging device 104. When created, the user / operator can then transmit / upload the machine vision job to the imaging device 104 via the network 106, where the machine vision job is then interpreted and executed. The user computing device 102 may include one or more operator workstations, and may include one or more processors 108, one or more memories 110, a networking interface 112, an input / output (I / O) interface 114, and an intelligent imaging application 116.
[0030] The imaging device 104 is connected to the user computing device 102 via the network 106 and is configured to interpret and execute the machine vision job received from the user computing device 102. Typically, the imaging device 104 can obtain a job file containing one or more job scripts from the user computing device 102 via the network 106, which job scripts can define the machine vision job and can configure the imaging device 104 to capture and / or analyze images according to the machine vision job. For example, the imaging device 104 may include a flash memory for determining, storing or otherwise processing imaging data / database and / or post-imaging data. The imaging device 104 can then receive, identify and / or otherwise interpret a trigger so that the imaging device 104 captures an image of the target object according to the configuration established via the one or more job scripts. Once captured and / or analyzed, the imaging device 104 can transmit the image and any associated data to the user computing device 102 via the network 106 for further analysis and / or storage. In various embodiments, the imaging device 104 may be a “smart” camera and / or may be configured to automatically perform sufficient functionality of the imaging device 104 to acquire, interpret, and execute job scripts defining machine vision jobs, such as any one or more job scripts contained in one or more job files acquired from, for example, a user computing device 102.
[0031] In summary, the job file may be a JSON representation / data format of one or more job scripts that may be transferred from the user computing device 102 to the imaging device 104. The job file may further be loaded / read by a C++ runtime engine or other suitable runtime engine executed on the imaging device 104. In addition, the imaging device 104 may run a server (not shown) that is configured to listen for and receive job files from the user computing device 102 via the network 106. Additionally or alternatively, the server configured to listen for and receive job files may be implemented as one or more cloud-based servers, such as a cloud-based computing platform. For example, the server may be any one or more cloud-based platforms, such as MICROSOFT AZURE, AMAZON AWS, etc.
[0032] In any event, the imaging device 104 may include one or more processors 118, one or more memories 120, a networking interface 122, an I / O interface 124, and an imaging component 126. The imaging component 126 may include a digital camera and / or a digital video camera for capturing or shooting digital images and / or frames. Each digital image may include pixel data, which may be analyzed by one or more tools, each of which is configured to perform image analysis tasks, as described herein. For example, the digital camera and / or the digital video camera of the imaging component 126 may be configured to shoot, capture, or otherwise generate digital images, and such images may be stored in a memory (e.g., one or more memories 110, 120) of a corresponding device (e.g., user computing device 102, imaging device 104) in at least some embodiments.
[0033] For example, the imaging component 126 may include a photo-realistic camera (not shown) for capturing, sensing, or scanning 2D image data. The photo-realistic camera may be an RGB (red, green, blue) based camera for capturing 2D images with RGB based pixel data. In various embodiments, the imaging component may additionally include a three-dimensional (3D) camera (not shown) for capturing, sensing, or scanning 3D image data. The 3D camera may include an infrared (IR) projector and an associated IR camera for capturing, sensing, or scanning 3D image data / data set. In some embodiments, the photo-realistic camera of the imaging component 126 may capture a 2D image and associated 2D image data at the same or similar time point as the 3D camera of the imaging component 126, so that the imaging device 104 may have both a set of 3D image data and a set of 2D image data available for a specific surface, object, area, or scene at the same time in the same or similar instance. In various embodiments, the imaging component 126 may include a 3D camera and a photo-realistic camera as a single imaging device, which is configured to capture 3D depth image data while capturing 2D image data. Thus, the captured 2D image and corresponding 2D image data may be depth aligned with the 3D image and 3D image data.
[0034] In an embodiment, the imaging component 126 may be configured to capture an image of a surface or region of a predefined search space or an image of a target object within the predefined search space. For example, each tool included in the job script may also include a region of interest (ROI) corresponding to a specified region or target object imaged by the imaging component 126. The composite region defined by the ROI for all tools included in a particular job script may thus define a predefined search space that the imaging component 126 may capture in order to facilitate the execution of the job script. However, the predefined search space may be specified by the user to include a field of view (FOV) having more or less features than the composite region defined by the ROI of all tools included in the particular job script. It should be noted that the imaging component 126 may capture 2D and / or 3D image data / data sets of various regions, so that additional regions other than the predefined search space are contemplated herein. In addition, in various embodiments, the imaging component 126 may be configured to capture other image data sets other than 2D / 3D image data, such as grayscale image data or amplitude image data, each of which may be aligned with the 2D / 3D image data depth.
[0035] The imaging device 104 can also process 2D image data / datasets and / or 3D image data sets for use by other devices (e.g., user computing device 102, external server). For example, one or more processors 118 can process image data or data sets captured, scanned or sensed by the imaging component 126. The processing of image data can generate post-imaging data, which can include metadata, simplified data, normalized data, result data, status data or alarm data determined from the original scanned or sensed image data. The image data and / or post-imaging data can be sent to the user computing device 102 executing the intelligent imaging application 116 for viewing, manipulation and / or otherwise interacting. In other embodiments, the image data and / or post-imaging data can be sent to a server for storage or further manipulation. As described herein, the user computing device 102, the imaging device 104 and / or an external server or other centralized processing unit and / or memory can store such data, and can also send the image data and / or post-imaging data to other applications implemented on a user device (such as a mobile device, a tablet computer, a handheld device, or a desktop device).
[0036] Each of the one or more memories 110, 120 may include one or more forms of volatile and / or non-volatile, fixed and / or removable memory (such as read-only memory (ROM), electronically programmable read-only memory (EPROM), random access memory (RAM), erasable electronically programmable read-only memory (EEPROM) and / or other hard drives, flash memory, MicroSD cards, etc.). Generally, a computer program or computer-based product, application or code (e.g., the intelligent imaging application 116 or other computing instructions described herein) may be stored on a computer-usable storage medium or a tangible, non-transitory computer-readable medium (e.g., a standard random access memory (RAM), a compact disk, a universal serial bus (USB) drive, etc.) having such computer-readable program code or computer instructions contained therein, wherein the computer-readable program code or computer instructions may be installed on or otherwise adapted to be executed by one or more processors 108, 118 (e.g., working in conjunction with a corresponding operating system in one or more memories 110, 120) to facilitate, implement or perform machine-readable instructions, methods, processes, elements or limitations as illustrated, depicted or described with respect to the various flow charts, diagrams, charts, drawings and / or other disclosures herein. In this regard, the program code can be implemented in any desired programming language, and can be implemented as machine code, assembly code, byte code, interpretable source code, etc. (e.g., via Galag, Python, C, C++, C#, Objective-C, Java, Scala, ActionScript, JavaScript, HTML, CSS, XML, etc.).
[0037] The one or more memories 110, 120 may store an operating system (OS) (e.g., Microsoft Windows, Linux, Unix, etc.) that can facilitate the functions, applications, methods, or other software discussed herein. The one or more memories 110 may also store an intelligent imaging application 116, which may be configured to enable machine vision job construction, as further described herein. Additionally or alternatively, the intelligent imaging application 116 may also be stored in the one or more memories 120 of the imaging device 104, and / or in an external database (not shown) that may be accessed via the network 106 or otherwise communicatively coupled to the user computing device 102. The one or more memories 110, 120 may also store machine-readable instructions, including any of one or more applications, one or more software components, and / or one or more application programming interfaces (APIs), which may be implemented to facilitate or perform the features, functions, or other disclosures described herein, such as any methods, processes, elements, or limitations, as illustrated, depicted, or described with respect to the various flow charts, diagrams, charts, drawings, and / or other disclosures herein. For example, some of the applications, software components, or APIs may be, include, or be part of a machine vision-based imaging application, such as the smart imaging application 116, each of which may be configured to facilitate their various functions discussed herein. It should be understood that one or more other applications executed by one or more processors 108, 118 may be contemplated.
[0038] The one or more processors 108, 118 may be connected to the one or more memories 110, 120 via a computer bus responsible for communicating electronic data, packets of data, or otherwise communicating electronic signals to and from the one or more processors 108, 118 and the one or more memories 110, 120 in order to implement or execute machine-readable instructions, methods, processes, elements, or limitations as illustrated, depicted, or described with respect to the various flow charts, diagrams, charts, drawings, and / or other disclosures herein.
[0039] The one or more processors 108, 118 may interface with the one or more memories 110, 120 via a computer bus to execute an operating system (OS). The one or more processors 108, 118 may also interface with the one or more memories 110, 120 via a computer bus to create, read, update, delete, or otherwise access or interact with data stored in the one or more memories 110, 120 and / or an external database (e.g., a relational database such as an Oracle, DB2, MySQL, or NoSQL-based database such as MongoDB). The data stored in the one or more memories 110, 120 and / or the external database may include all or part of any of the data or information described herein, including, for example, machine vision job images (e.g., images captured by the imaging device 104 in response to execution of a job script) and / or other suitable information.
[0040] The network interfaces 112, 122 may be configured to communicate (e.g., send and receive) data to one or more networks or local terminals, such as the network 106, via one or more external / network ports. In some embodiments, the network interfaces 112, 122 may include client-server platform technology, such as ASP.NET, Java J2EE, Ruby on Rails, Node.js, web services, or online APIs, which are responsive to receiving and responding to electronic requests. The network interfaces 112, 122 may implement client-server platform technology that may interact with one or more memories 110, 120 (including application(s), component(s), API(s), data, etc. stored therein) via a computer bus to implement or execute machine-readable instructions, methods, processes, elements, or limitations, as illustrated, depicted, or described with respect to the various flow charts, diagrams, charts, drawings, and / or other disclosures herein.
[0041] According to some embodiments, the network interfaces 112, 122 may include or interact with one or more transceivers (e.g., WWAN, WLAN, and / or WPAN transceivers) operating in accordance with IEEE standards, 3GPP standards, or other standards, and may be used to receive and transmit data via an external / network port connected to the network 106. In some embodiments, the network 106 may include a private network or a local area network (LAN). Additionally or alternatively, the network 106 may include a public network, such as the Internet. In some embodiments, the network 106 may include a router, a wireless switch, or other such wireless connection points that communicate with the user computing device 102 and the imaging device 104 (via the network interface 122) via wireless communications (via the network interface 112) based on any one or more of a variety of wireless standards, including, by way of non-limiting example, IEEE 802.11a / b / c / g (WIFI), Bluetooth standards, and the like.
[0042] The I / O interfaces 114, 124 may include or implement an operator interface configured to present information to an administrator or operator and / or receive input from an administrator or operator. The operator interface may provide a display screen (e.g., via the user computing device 102 and / or the imaging device 104) that a user / operator may use to visualize any images, graphics, text, data, features, pixels, and / or other suitable visualizations or information. For example, the user computing device 102 and / or the imaging device 104 may at least partially include, implement, access, present, or otherwise expose a graphical user interface (GUI) for displaying images, graphics, text, data, features, pixels, and / or other suitable visualizations or information on a display screen. The I / O interfaces 114, 124 may also include I / O components (e.g., ports, capacitive or resistive touch sensitive input panels, keys, buttons, lights, LEDs, any number of keyboards, mice, USB drives, optical drives, screens, touch screens, etc.) that may be directly / indirectly accessible via or attached to the user computing device 102 and / or imaging device 104. According to some embodiments, an administrator or user / operator may access the user computing device 102 and / or imaging device 104 to construct jobs, view images or other information, make changes, enter responses and / or selections, and / or perform other functions.
[0043] As described above, in some embodiments, the user computing device 102 may be part of a "cloud" network to perform the functions discussed herein or may otherwise communicate with other hardware or software components within the cloud to send, retrieve, or otherwise analyze the data or information described herein.
[0044] Figure 2 According to the embodiments described herein Figure 1 2. The imaging device 104 includes a housing 202, an imaging aperture 204, a user interface label 206, a dome switch / button 208, one or more light emitting diodes (LEDs) 210, and mounting point(s) 212. As previously mentioned, the imaging device 104 can obtain job files from a user computing device (e.g., the user computing device 102), after which the imaging device 104 interprets and executes the job files. The instructions included in the job files may include device configuration settings (also referred to herein as "imaging settings") that are operable to adjust the configuration of the imaging device 104 prior to capturing an image of a target object.
[0045] For example, the device configuration settings may include instructions to adjust one or more settings related to the imaging aperture 204. As an example, assume that at least a portion of the intent analysis corresponding to the machine vision job requires the imaging device 104 to maximize the brightness of any captured image. To accommodate this requirement, the job file may include a device configuration setting to increase the aperture size of the imaging aperture 204. The imaging device 104 may interpret these instructions (e.g., via one or more processors 118) and increase the aperture size of the imaging aperture 204 accordingly. Thus, the imaging device 104 may be configured to automatically adjust its own configuration to best suit a particular machine vision job. Additionally, the imaging device 104 may include or may be otherwise adapted to include, for example, but not limited to, one or more bandpass filters, one or more polarizers, one or more DPM diffusers, one or more C-mount lenses, and / or one or more C-mount liquid lenses above the imaging aperture 204 or otherwise affecting the received illumination through the imaging aperture 204.
[0046] The user interface label 206 may include a dome switch / button 208 and one or more LEDs 210, and may thereby enable various interactive and / or indication features. Generally, the user interface label 206 may enable a user to trigger and / or adjust to the imaging device 104 (e.g., via the dome switch / button 208), and may be able to identify when one or more functions, errors, and / or other actions have been performed or occurred relative to the imaging device 104 (e.g., via the one or more LEDs 210). For example, the trigger function of the dome switch / button (e.g., the dome / switch button 208) may enable a user to use the imaging device 104 to capture an image and / or display a trigger configuration screen of a user application (e.g., the smart imaging application 116). The trigger configuration screen may allow a user to configure one or more triggers for the imaging device 104, which may be stored in a memory (e.g., one or more memories 110, 120) for use in later developed machine vision jobs, as discussed herein.
[0047] As another example, the adjustment functionality of the dome switch / button (e.g., dome / switch button 208) can enable a user to automatically and / or manually adjust the configuration of the imaging device 104 according to a preferred / predetermined configuration and / or display an imaging configuration screen for a user application (e.g., smart imaging application 116). The imaging configuration screen can allow a user to configure one or more configurations for the imaging device 104, which can be stored in a memory (e.g., one or more memories 110, 120) for use in later developed machine vision jobs, as discussed herein.
[0048] To further illustrate this example, and as discussed further herein, a user may utilize an imaging configuration screen (or more generally, the intelligent imaging application 116) to establish two or more configurations of imaging settings for an imaging device 104. The user may then save the two or more configurations of imaging settings as part of a machine vision job and then send them to the imaging device 104 in a job file containing one or more job scripts. The one or more job scripts may then instruct an imaging device 104 processor (e.g., one or more processors 118) to automatically and sequentially adjust the imaging settings of the imaging device according to one or more of the two or more configurations of imaging settings after each successive image capture.
[0049] The mounting point(s) 212 may enable a user to connect and / or removably attach the imaging device 104 to a mounting device (e.g., an imaging tripod, a camera mount, etc.), a structural surface (e.g., a warehouse wall, a warehouse ceiling, a structural support beam, etc.), other accessories, and / or any other suitable attachment device, structure, or surface. For example, the imaging device 104 may be optimally placed on a mounting device in a distribution center, manufacturing plant, warehouse, and / or other facility for imaging to monitor the quality / consistency of products, packages, and / or other items as they pass through the FOV of the imaging device 104. Additionally, the mounting point(s) 212 may enable a user to connect the imaging device 104 to a variety of accessories, including, but not limited to, one or more external lighting devices, one or more mounting devices / brackets, and the like.
[0050] In addition, the imaging device 104 may include a number of hardware components contained within the housing 202 that enable connection to a computer network (e.g., the network 106). For example, the imaging device 104 may include a network interface (e.g., the network interface 122) that enables the imaging device 104 to connect to the network, such as a Gigabit Ethernet connection and / or a dual Gigabit Ethernet connection. Furthermore, the imaging device 104 may include a transceiver and / or other communication components as part of the network interface to communicate with other devices (e.g., the user computing device 102) via, for example, Ethernet / IP, PROFINET, Modbus TCP, CC-Link, USB 3.0, RS-232, and / or any other suitable communication protocol or combination thereof.
[0051] Figure 3 An example application interface 300 for optimizing one or more imaging settings for a machine vision job is depicted in accordance with embodiments described herein. In general, the example application interface 300 may represent an interface of an intelligent imaging application (e.g., the intelligent imaging application 116) that a user may access via a user computing device (e.g., the user computing device 102). Specifically, when a user selects to view the devices tab 302, the example application interface 300 may present to the user a list of all available devices (e.g., the imaging devices 104) that the user may connect to and / or construct a machine vision job. From here, the user may view a device selection list 304, which may display each connected device that the user may access and may further include information such as, but not limited to, a device name, a device model, an IP address corresponding to the device, a device serial number, a device manufacturing date, a device firmware status, a device online status, and / or any other suitable indication.
[0052] The user may then select a device indicated by the selected device indicator 306 from the device selection list 304 in order to configure and / or otherwise view certain settings of the device. The selected device indicator 306 may display the device name and the device online status, and may additionally or alternatively include any other information related to the device. After selecting the device indicated in the selected device indicator 306, the intelligent imaging application 116 may additionally display a selected device configuration list 308 within the example application interface 300. The selected device configuration list 308 may include various information about the selected device, such as, but not limited to, a selected device general overview (e.g., firmware update, library update, etc.), a selected device license overview (e.g., DHCP timeout, IP address fallback, etc.), a selected device communication overview (e.g., available connection types, current connection type, etc.), a selected device status overview (e.g., lens type, lighting type, etc.), and / or any other suitable information or combination thereof.
[0053] In addition, the selected device configuration list 308 may include instructions to execute, store, and / or otherwise associate an indication of a machine vision job with the selected device. For example, the selected device configuration list 308 may indicate that the selected device is configured to operate according to a first machine vision job uploaded to the selected device at a first time (e.g., "uploaded at 10:00 am on 10 / 10 / 18"). The selected device configuration list 308 may additionally indicate that the first machine vision job includes a first configuration of one or more image settings corresponding to the selected device and a second configuration of one or more image settings corresponding to the selected device. Each of the one or more image settings included in the first and second configurations may be additionally displayed in the selected device configuration list 308.
[0054] The example application interface 300 may also include an add device function 310 to allow a user to add additional devices, such as additional devices not found in the device selection list 304. If a user acquires a new device, such as an imaging device (e.g., imaging device 104), the user may click, swipe, and / or otherwise interact with the add device function 310 to add the new device to the device selection list 304. Additionally, once the new device is added, the user may interact with the set device function 312A / B to configure and / or otherwise view settings corresponding to the new device. Thus, the user may interact with the set device function 312A / B at any time after adding the device to the device selection list 304 to adjust, view, or otherwise manage device settings.
[0055] Additionally or alternatively, when the user interacts with the set device function 312A / B, the smart imaging application 116 can generate / present a new interface that allows the user to configure a machine vision job for the selected device (e.g., as indicated by the selected device indicator 306). The user can additionally cause the smart imaging application 116 to generate / present a new interface by interacting with the job creation tab 314. In this manner, the user can transition out of the example application interface 300 to configure a machine vision job corresponding to the selected device by interacting with the set device function 312A / B or the job creation tab 314.
[0056] Figure 4A Depicted are additional application interfaces for optimizing one or more imaging settings for a machine vision job according to embodiments described herein. For example, after interacting with a job creation tab (e.g., job creation tab 314) and / or setting device functions (e.g., setting device functions 312A / B), an intelligent imaging application (e.g., intelligent imaging application 116) can transition a user to a job construction application interface 400. In general, a user can utilize the job construction application interface 400 to organize and configure machine vision tools into a specific sequence that defines a corresponding machine vision job. A user can additionally utilize the job construction application interface 400 to upload a corresponding machine vision job to an imaging device (e.g., imaging device 104) for interpretation and execution.
[0057] To construct a machine vision job, a user may select a tool configured to perform a machine vision function. The user may select a tool by clicking, sliding, dragging, and / or otherwise interacting with the (multiple) available tool list 402. Each tool may be included in a drop-down list (as shown) of the (multiple) available tool list 402, or may be clearly visible to the user on the (multiple) available tool list 402. In any event, the user may select the desired tool and move the desired tool to the job flow builder section 404 to begin constructing the machine vision job. In the job flow builder section 404, the user may organize each selected tool into an optimal / priority order based on the requirements of the machine vision job. In addition, the user may configure each tool to more accurately meet the requirements of the machine vision job. For example, the user may configure a barcode scanning tool selected from the available tool list 402 to scan a larger / smaller area of the (multiple) images captured by the selected device (e.g., imaging device 104).
[0058] The user may also select a representative image from a film strip 406 to complete the configuration of the selected tool. The film strips 406 may include live images from the selected device, or they may be stored images (e.g., in one or more memories 110, 120) representing ideal image captures of a machine vision job. Additionally or alternatively, the intelligent imaging application 116 may automatically populate the film strip 406 based on the selected tool in the job flow builder portion 404. Once selected, the representative image may appear in a larger portion above the film strip 406, enabling the user to place a tool ROI 408 on the representative image. The tool ROI 408 indicates an area of the representative image that the tool represented by the tool ROI 408 may analyze using machine vision technology. For example, if the tool ROI 408 represents the ROI of a barcode scanning tool, the barcode scanning tool will scan a barcode within the area of the representative image indicated by the tool ROI 408.
[0059] If the user cannot decide on an appropriate tool for the machine vision job, the user may click, swipe, and / or otherwise interact with the job construction application interface 400, and the smart imaging application 116 may generate / present a tool information area 410. The smart imaging application 116 may provide the user with common tool suggestions, tool type suggestions, descriptions of each tool included in the tool information area 410, and / or any other suitable information in combination thereof. For example, the smart imaging application 116 may provide the user with an option in the tool information area 410 to search for a particular tool by typing, speaking, and / or otherwise indicating the name, function, or other representative characteristics of the tool.
[0060] When the user has selected and / or ordered one or more tools, and has thus created a machine vision job, the job deployment switch 412 allows the user to upload the machine vision job to the selected device (e.g., the imaging device 104). The intelligent imaging application 116 can register the user interaction with the job deployment switch 412 and convert the machine vision job into a job file, which is then transmitted (e.g., via the network 106) to the selected device. The machine vision job can also be stored in a memory (e.g., one or more memories 110, 120). The user can additionally switch the uploaded machine vision job to active / inactive use by interacting with the job deployment switch 412. Thereafter, the user can adjust the configuration / settings associated with the machine vision job by accessing the machine vision job and interacting with one or more tools in the (multiple) available tool list 402 and / or the job builder flow section 404, the image in the job slide 406, the image in the tool ROI 408, and / or through the options in the tool information area 410.
[0061] In various embodiments, the job construction application interface 400 allows a user to construct multiple machine vision jobs to be executed sequentially for a selected device (e.g., imaging device 104). For example, the job construction application interface 400 may allow a user to construct a first machine vision job that includes a first set of tools that adjust the configuration of the selected device to a first configuration. The first configuration may include one or more imaging settings of the selected device, such as, but not limited to, aperture size, exposure length, ISO value, and / or any other suitable value or combination thereof. The job construction application interface 400 may allow a user to construct a second machine vision job that includes a second set of tools that adjust the configuration of the selected device to a second configuration. The second set of tools may be the same or different from the first set of tools, and the second configuration may be the same or different from the first configuration. In any event, the intelligent imaging application 116 may transmit the two machine vision jobs to the selected device, and the two machine vision jobs may be stored in a memory (e.g., one or more memories 110, 120). Thereafter, the selected device may automatically perform the first machine vision job and the second machine vision job in sequence, for example, may capture at least one image according to the first configuration, automatically adjust to the second configuration, and capture at least one image according to the second configuration.
[0062] However, a user may wish to configure the specific functionality of each tool included in the job builder flow portion 404. Therefore, reference Figure 4B , the user can interact with the tools in the job builder flow portion 404 or other areas of the job construction application interface 400, and the intelligent imaging application 116 can generate / present a tool configuration application interface 420. The tool configuration application interface 420 can enable the user to customize the specific functions of each tool included in the machine vision job via user-selectable options present in the tool configuration area 422. For example, the tool configuration area 422 may include tool configuration options such as, but not limited to, tool model area type, tool name, tool fixture, tool image type, tool acceptance threshold, tool rotation threshold, tool timeout, and / or any other suitable tool configuration options. For illustration, the user can configure the tool rotation threshold corresponding to the tool ROI 408 based on the relative minimum rotation of the cap of the target object 424 characterized in the image. In this way, the intelligent imaging application 116 allows the user to fully customize the selection, order, and individual configuration of each tool included in the machine vision job.
[0063] In addition, in various embodiments, one or more tools included in the job builder flow portion 404 can be AI-based tools trained using at least one artificial intelligence (AI) algorithm. For example, training a barcode locating tool may involve image analysis of hundreds, thousands, or millions of training images having pixel data of an object with a barcode to configure the weights of the barcode locating tool and its underlying algorithm (e.g., a machine learning or artificial intelligence algorithm) for predicting and / or classifying barcode locations in future images. In this example, one or more processors of a computing platform (e.g., a user computing device 102) can receive multiple training images of an object with a barcode via a computer network (e.g., network 106). The computing platform can also train the barcode locating tool using the pixel data of the multiple training images.
[0064] In various embodiments, supervised or unsupervised machine learning programs or algorithms can be used to train AI tools (e.g., AI barcode locating tools). The machine learning program or algorithm can use a neural network, which can be a convolutional neural network, a deep learning neural network, or a combined learning module or program learned in two or more features or feature data sets (e.g., pixel data) in a specific region of interest. The machine learning program or algorithm can also include natural language processing, semantic analysis, automatic reasoning, regression analysis, support vector machine (SVM) analysis, decision tree analysis, random forest analysis, K-nearest neighbor analysis, naive Bayes analysis, clustering, reinforcement learning, and / or other machine learning algorithms and / or techniques. In some embodiments, algorithms based on artificial intelligence and / or machine learning can be included as libraries or packages executed on a computing platform (e.g., user computing device 102). For example, the library can include a library based on TENSORFLOW, a PYTORCH library, and / or a SCIKIT-LEARN Python library.
[0065] Machine learning may involve recognizing patterns in existing data (such as training a tool on pixel data of an image that includes one or more target objects with a barcode) to facilitate prediction or identification of subsequent data (such as using the tool on new pixel data of a new target object to determine whether the new target object includes a barcode and / or the location of the barcode on the new target object).
[0066] Machine learning model(s) (such as the AI barcode locating tool described for some embodiments) can be created and trained based on example data (e.g., "training data" and associated pixel data) inputs or data (which may be referred to as "features" and "labels") to make effective and reliable predictions for new inputs (such as test-level or production-level data or inputs). In supervised machine learning, a machine learning program operating on a server, computing device, or other processor(s) can be provided with example inputs (e.g., "features") and their associated or observed outputs (e.g., "labels") so that the machine learning program or algorithm can determine or discover rules, relationships, patterns, or other machine learning "models" that map such inputs (e.g., "features") to outputs (e.g., labels), for example, by determining and / or assigning weights or other metrics to various feature categories of the model. Such rules, relationships, or other models can then be provided to subsequent inputs so that the tool executing on the server, computing device, or other processor(s) predicts the expected output based on the discovered rules, relationships, or models.
[0067] In unsupervised machine learning, a server, computing device, or other processor(s) may need to find its own structure in unlabeled example inputs, wherein multiple generations of tools are trained, for example, by performing multiple training iterations by the server, computing device, or other processor(s) until a satisfactory tool is obtained, for example, a tool that provides sufficient prediction accuracy when generating given test-level or production-level data or inputs. The disclosure herein may use one or both of such supervised or unsupervised machine learning techniques.
[0068] Typically, pixel data includes a point or square of data within an image, wherein each point or square represents a single pixel within the image. Each pixel can be a specific location within the image. In addition, each pixel can have a specific color (or lack a specific color). Pixel color can be determined by a color format and associated channel data associated with a given pixel. For example, a popular color format includes a red-green-blue (RGB) format with red, green, and blue channels. That is, in an RGB format, the data of a pixel is represented by three digital RGB components (red, green, blue) that can be referred to as channel data to manipulate the color of a pixel region in an image. In some implementations, for each pixel, the three RGB components can be represented as three 8-bit numbers. Three 8-bit bytes (one byte for each RGB) are used to generate 24-bit color. Each 8-bit RGB component can have 256 possible values ranging from 0 to 255 (i.e., in a base 2 binary system, an 8-bit byte can contain one of 256 values ranging from 0 to 255). The channel data (R, G, and B) can be assigned a value between 0 and 255 and is used to set the color of a pixel. For example, the three values (250, 165, 0) represent (red=250, green=165, blue=0) can represent an orange pixel. As a further example, (red=255, green=255, blue=0) represents red and green, each fully saturated (8-bit brightness is 255), with no blue (zero), and the resulting color is yellow. As a further example, black has RGB values of (red=0, green=0, blue=0), and white has RGB values of (red=255, green=255, blue=255). Gray has the property of having equal or similar RGB values. So (red=220, green=220, blue=220) is a light gray (close to white), while (red=40, green=40, blue=40) is a dark gray (close to black).
[0069] Thus, the synthesis of the three RGB values creates the final color for a given pixel. For a 24-bit RGB color image using 3 bytes, there can be 256 shades of red, 256 shades of green, and 256 shades of blue. This provides 256x256x256, or 16.7 million possible combinations or colors, for a 24-bit RGB color image. Thus, the RGB data value of a pixel shows how much of each of the three colors of red, green, and blue the pixel is made up of. These three colors and intensity levels are combined at the image pixel (i.e., at the pixel location on the display screen) to illuminate the display screen at that location with that color. However, it should be understood that other bit sizes with fewer or more bits (e.g., 10 bits) can be used to produce fewer or more overall colors and ranges.
[0070] As a whole, the various pixels positioned together in a grid pattern form a digital image (e.g., pixel data 202ap, 202bp, and / or 202cp). A single digital image may consist of thousands or millions of pixels. Images may be captured, generated, stored, and / or transmitted in a variety of formats, such as JPEG, TIFF, PNG, and GIF. These formats use pixels to store images.
[0071] Image analysis can include training a machine learning-based tool (e.g., an AI barcode locating tool) on pixel data of an image, the image including one or more target objects with a barcode. Additionally or alternatively, image analysis can include using a machine learning-based tool as previously trained to determine whether each of the one or more target objects includes a barcode and / or the position of the barcode on each of the one or more target objects based on pixel data (e.g., including their RGB values) of one or more images including the one or more target objects. The weights of the tool can be trained via analysis of various RGB values of barcode pixels of a given image. For example, dark or low RGB values (e.g., pixels with values R=25, G=28, B=31) can indicate a typical black area of a barcode. Brighter RGB values (e.g., pixels with R=210, G=234, B=241) can indicate a typical white area of a barcode (e.g., the space between black barcode bars or black squares of a QR code).
[0072] When a series of pixels in the analysis area transitions from dark or low RGB values to bright RGB values (or vice versa) in a consistent order, this can indicate the presence of a barcode represented by the series of pixels. For example, an image can have a front surface of a target object, wherein the front surface includes a barcode near the bottom of the image. The AI barcode positioning tool can analyze one or more areas of the image until the AI barcode positioning tool analyzes the corresponding area of pixels including the barcode representing the target object. The AI barcode positioning tool can identify that the pixel indicates a barcode because the pixel can have a sequence of very dark RGB value pixels that contrast with very bright RGB value pixels. In this way, pixel data of thousands or millions of training images (e.g., detailing one or more features of the target object, such as the barcode of each target object) can be used for training or using a machine learning tool (e.g., an AI barcode positioning tool) to determine the presence / position of a barcode and / or any other suitable machine vision technology described herein.
[0073] Figure 51 is a flow chart showing a method 500 for optimizing one or more imaging settings for machine vision tasks according to embodiments described herein. The method 500 describes various methods for optimizing one or more imaging settings for machine vision tasks and is described below in conjunction with Figure 6 Embodiments of method 500 are discussed. In general, method 500 for optimizing one or more imaging settings for a machine vision task includes detecting a start trigger to capture a first image, capturing a first image of a target object according to a first configuration of the one or more imaging settings, automatically adjusting the one or more imaging settings to a second configuration, and capturing a second image of the target object according to the second configuration of the one or more imaging settings. Capturing the first image, automatically adjusting the imaging settings, and capturing the second image may be referred to separately. Figure 6 Let's discuss.
[0074] It should be understood that when referring to Figure 5 and Figure 6 When described, the imaging device 104 and / or imaging assembly 126 may include a single camera configured to perform the various actions and functions described herein. However, in various embodiments, the imaging device 104 may include multiple cameras.
[0075] In addition, for simplicity, refer to Figure 5 and Figure 6 Each imaging setup configuration discussed is described in terms of one or more groups of machine vision tools. For example, a first image may be captured in accordance with a first configuration and a second image may be captured in accordance with a second configuration, respectively, based on one or more machine vision tools, which are used to analyze the first image and the second image. It should be understood that each imaging setup configuration (e.g., a first configuration, a second configuration, etc.) may also be determined based on a distance from the imaging device 104 to the target object and / or any other suitable metric. For example, a first image may be captured in accordance with a first configuration determined based on a first distance from the imaging device 104 to the target object, respectively, and a second image may be captured in accordance with a second configuration determined based on a second distance from the imaging device 104 to the target object. In this example and other examples utilizing different metrics and / or more or fewer imaging setup configurations, each machine vision tool included in the machine vision job may analyze each image capture.
[0076] The method 500 may include detecting a start trigger that initiates a machine vision operation (block 502). In general, a start trigger may describe a catalyst that causes the imaging device 104 to capture an image of a target object according to a set of imaging settings. For example, the start trigger may be any action, threshold satisfaction, timing completion, and / or other occurrence that causes the imaging device 104 to capture an image of the target object. In various embodiments, the start trigger may include a target object entering a field of view (FOV) of the imaging device 104. In such embodiments, the imaging device 104 may include a proximity sensor or other suitable device configured to identify the presence of a target object at a location, generate a start trigger in response to identifying the presence of the target object, and transmit the start trigger to the imaging device 104 to cause the imaging device 104 to capture an image of the target object. Block 502 may be performed by, for example, the imaging device 104 and / or the user computing device 102.
[0077] In addition, the machine vision job may generally include at least one machine vision tool that is configured to perform at least one machine vision technique on the captured image. For illustration, the machine vision tool may include, but is not limited to: (i) a barcode scanning tool, (ii) a pattern matching tool, (iii) an edge detection tool, (iv) a semantic segmentation tool, (v) an object detection tool, and / or (vi) an object tracking tool. As an example, the machine vision job may include a barcode scanning tool that is configured to perform a barcode scanning technique on an image captured by the imaging device 104. In various embodiments, the machine vision job may include one or more machine vision tools that are configured to perform one or more machine vision techniques on a first image and a second image, as discussed herein. In addition, it should be understood that each machine vision tool referenced and / or otherwise included herein may include multiple reference names / nomenclatures, and all such machine vision tools are contemplated for use in embodiments of the present disclosure.
[0078] The method 500 may further include capturing a first image of the target object according to a first configuration of one or more imaging settings (box 504). The imaging device 104 may capture the first image of the target object in response to detecting / receiving a start trigger. Typically, the first configuration of the one or more imaging settings may correspond to an optimal imaging setting for a first machine vision tool or a first group of machine vision tools executed as part of a machine vision job. For example, assume that the first machine vision tool included in the machine vision job is a barcode scanning tool, and further assume that the barcode scanning tool can optimally perform barcode scanning technology on images captured with high contrast. The first configuration of the one or more imaging settings may include a high contrast setting and / or a combination of imaging settings configured to produce a high contrast image. Box 504 may be performed by, for example, the imaging device 104.
[0079] As another example, assume that the first group of machine vision tools included in the machine vision job is a barcode scanning tool, an edge detection tool, and a pattern matching tool. In addition, assume that the barcode scanning tool can best perform barcode scanning techniques on images captured with high contrast, the edge detection tool can best perform edge detection techniques on images captured with medium contrast, and the pattern matching tool can best perform pattern matching techniques on images captured with high gain. The first configuration of one or more imaging settings may include a medium contrast setting, a high contrast setting, a high gain setting, and / or a combination of imaging settings, which is configured to produce a combination of optimal settings for each machine vision tool (e.g., one or more "average" optimal imaging settings). For illustration, each of the barcode scanning tool, the edge detection tool, and the pattern matching tool may have one or more different optimal image settings. However, when the imaging device 104 captures the first image using one or more "average" optimal imaging settings, each tool can quickly and efficiently perform its respective machine vision techniques on the first image. In this way, multiple machine vision tools can perform their respective machine vision techniques on a single image captured using the imaging settings based on the optimal imaging settings of one, some, or all of the multiple machine vision tools.
[0080] In various embodiments, the one or more imaging settings may include one or more of (i) aperture size, (ii) exposure length, (iii) ISO value, (iv) focal length value, (v) gain value, and / or (vi) illumination control.
[0081] It should be appreciated that the imaging device 104 or other suitable imaging system may automatically reconfigure one or more imaging settings to be consistent with the first configuration as a real-time response to detecting / receiving the start trigger and before capturing the first image. Figure 6, the imaging device 104 can detect / receive a start trigger to capture a first image of a target object 602. The target object 602 can include three target areas 602a, 602b, and 602c, each of which includes a feature of interest (e.g., a barcode, a pattern, an edge, etc.). The imaging device 104 can also include a machine vision job in a memory that is configured to be executed when the start trigger is detected / received, and / or the imaging device 104 can download (e.g., from a user computing device 102) from a remote storage device (e.g., via the network 106) the machine vision job that is configured to be executed when the start trigger is detected / received. The machine vision job can include one or more machine vision tools, and each tool can include a unique set of imaging settings corresponding to the corresponding tool. For example, as previously mentioned, a barcode scanning tool may require a high contrast image, and when included in the machine vision job, a high contrast imaging setting can be included accordingly.
[0082] In any event, the imaging device 104 may detect / receive a start trigger causing the imaging device 104 to capture a first image. Assume that the first image corresponds to a first target area 602a of the target object 602, and that the first target area 602a includes a corresponding pattern. Further, assume that the machine vision job includes a pattern matching tool configured to identify and analyze the corresponding pattern in the first target area 602a, and that the instructions included in the job file corresponding to the pattern matching tool include a unique set of imaging settings (in this example, a "first configuration") intended to optimize image capture for pattern matching analysis. Further, assume that the job file includes instructions indicating a first distance 604a from the imaging device 104 to the first target area 602a. Prior to capturing the first image, the imaging device 104 may interpret and / or otherwise receive instructions included in the job file corresponding to the pattern matching tool and the first distance 604a, and as a result, the imaging device 104 may adjust one or more imaging settings to match the first configuration identified in the job file instructions. Thereafter, the imaging device 104 may capture the first image according to the first configuration.
[0083] Additionally or alternatively, the imaging device 104 may include a rangefinder and / or other distance measuring equipment to determine the first distance 604a, the second distance 604b, the third distance 604c, and / or any other suitable distance before capturing the first image. For example, assume that the job file in the aforementioned example does not include instructions indicating the first distance 604a. In addition, assume that the first configuration specifies that the imaging device 104 should use the medium gain setting to capture the first image, but does not specify other imaging settings (e.g., aperture size, focal length value, etc.) to obtain a suitable image of the first target area 602a using the medium gain setting at the first distance 604a. In this example, the rangefinder can determine the first distance 604a and transmit the first distance 604a to one or more processors 118 of the imaging device 104. The one or more processors 118 can analyze the first distance based on known imaging relationships (e.g., increasing aperture size results in shallower depth of field) to determine the specific imaging settings for capturing the first image (and / or any subsequent images) based on the first configuration (e.g., medium gain setting). Thus, the imaging device 104 may adjust, for example, a gain setting, an aperture size, a focal length value, and / or any other suitable imaging setting to achieve a set of imaging settings according to the first configuration. It should be appreciated that the imaging device 104 may also automatically determine suitable imaging settings to achieve a set of imaging settings according to the first configuration, the second configuration, the third configuration, and / or any other configuration in the absence of a range finder and / or other distance measurement equipment.
[0084] The method 500 may further include automatically adjusting one or more imaging settings to a second configuration, the second configuration including at least one imaging setting different from the first configuration (box 506). In general, the second configuration may correspond to one or more machine vision tools that are not included in the first configuration. For example, a first machine vision tool included in the machine vision operation may include a barcode scanning tool that may require a high contrast and medium / low brightness image for optimal barcode scanning analysis. Therefore, the first configuration may include a high contrast setting and a medium / low brightness setting, so that the imaging device 104 captures a first image of the first target area 604a with high contrast and medium / low brightness. However, a second machine vision tool included in the machine vision operation may include an edge detection tool that may require a medium contrast and medium / high brightness image for optimal edge detection analysis. Therefore, the second configuration may include a medium contrast setting and a medium / high brightness setting, so that the imaging device 104 adjusts the contrast and brightness settings before capturing the second image. Of course, the imaging settings included in the first configuration and the second configuration may include any suitable imaging settings. Box 506 may be performed by, for example, the imaging device 104.
[0085] In various embodiments, the imaging device may be configured to automatically adjust imaging settings of an imaging assembly (e.g., imaging assembly 126) and any additional components included as part of the imaging device. For example, the imaging device may obtain a first configuration as part of a job file that includes a small aperture size and a medium lighting setting. The imaging device may automatically adjust the aperture size of the imaging device to a small setting, and may additionally automatically adjust the lighting settings of external and / or internal lighting devices to a medium setting. Of course, in these embodiments, the imaging device may be configured to adjust imaging settings associated with any number and / or type of additional components that are internally / externally included as part of the imaging device.
[0086] The method 500 may further include capturing a second image of the target object according to a second configuration of the one or more imaging settings (block 508). For example, as part of the job file, assume that a first group of the one or more machine vision tools includes a first configuration such that the imaging device 104 captures a first image of the target object (e.g., the target object 602) according to the first configuration. An imaging device (e.g., the imaging device 104) may obtain the first configuration and adjust the imaging settings of the imaging device accordingly. As part of the job file, further assume that a second group of the one or more machine vision tools includes a second configuration having at least one imaging setting different from the first configuration. The imaging device may capture the first image and thereafter automatically adjust the imaging settings of the imaging device according to the second configuration before capturing the second image. The imaging device may then capture the second image according to the imaging settings corresponding to the second configuration. Block 508 may be performed by, for example, the imaging device 104.
[0087] For illustration and reference Figure 6, assume that the imaging device 104 receives a job file, the job file includes a first set of machine vision tools and a second set of machine vision tools and corresponding first and second configurations, the first and second configurations being configured to capture images of a first target area 602a and a second target area 602b, respectively. In addition, assume that the first configuration includes a small aperture size setting and a medium brightness setting, and the second configuration includes a medium aperture size setting and a high brightness setting. In this example, the imaging device can obtain a start trigger and automatically adjust the imaging settings of the imaging device to a small aperture size and medium brightness to capture a first image of the first target area 602a. Of course, it should be understood that the imaging device can alternatively automatically adjust the imaging settings of the imaging device according to the first configuration before obtaining the start trigger. In any event, in response to the first image capture, the imaging device can automatically adjust the imaging settings of the imaging device to a medium aperture size and a high brightness setting. Therefore, the imaging device can capture a second image of the second target area 602b using the medium aperture size and high brightness settings. In this way, the imaging device 104 can capture a first image of the first target area 602a according to a first configuration of the imaging settings in response to a single start trigger, and the device 104 can capture a second image of the second target area 602b according to a second configuration of the imaging settings in response to a single start trigger.
[0088] The method 500 may further include designating the second image as the current image (optional block 510) and determining whether all image setting configurations have been applied (optional block 512). That is, the job file including the first set of machine vision tools and the second set of machine vision tools may include any suitable number of sets of machine vision tools and / or any suitable number of individual machine vision tools that require a designated configuration of imaging settings. Therefore, the imaging device may designate each most recently captured image as the current image in response to the start trigger, and determine whether all imaging setting configurations have been applied so that all corresponding images have been captured. If the imaging device determines that all imaging setting configurations have not been applied (the "no" branch of the optional block 512), the imaging device may continue to perform the (multiple) actions included in the optional block 514. Alternatively, if the imaging device determines that all imaging setting configurations have been applied (the "yes" branch of the optional block 512), the imaging device may continue to perform the (multiple) actions included in the optional block 520. Optional blocks 510 and 512 may be performed by, for example, the imaging device 104.
[0089] For example, refer to Figure 6, assuming that a job file transmitted to an imaging device (e.g., imaging device 104) includes three different sets of machine vision tools, each set including a corresponding imaging setting configuration. In response to detecting, receiving, and / or otherwise sensing a start trigger, the imaging device may automatically adjust the imaging settings according to the first corresponding configuration and capture a first image of the first target area 602a, and then automatically adjust the imaging settings according to the second corresponding configuration and capture a second image of the second target area 602b. The imaging device may then designate the second image as the current image and determine that the third corresponding imaging setting configuration has not yet been applied. Therefore, the imaging device may determine that all imaging setting configurations have not yet been applied (the "No" branch of optional box 512), and continue to optional box 514.
[0090] In addition, in various embodiments, a machine vision job may include (e.g., as part of a job file) a predetermined number of configurations of one or more imaging settings. As previously mentioned, a machine vision job may include one or more machine vision tools, each of which includes a corresponding configuration of one or more imaging settings. Additionally or alternatively, a machine vision job may include multiple groups of machine vision tools, wherein each group may include a combined / aggregated configuration and / or multiple configurations of one or more imaging settings, as discussed herein. Furthermore, in these embodiments, each configuration of one or more imaging settings included in a machine vision job may include the same machine vision tool; however, the machine vision tool settings (e.g., user-selectable options present in the tool configuration area 422) may be customized for a specified configuration. As an example, if a machine vision job includes three configurations of one or more imaging settings to capture first, second, and third images of first, second, and third target areas 602a-c, respectively, the settings of each machine vision tool included in the first, second, and third target areas 602a-c are to maximize the respective processing potential of each configuration (e.g., the potential of a barcode scanning tool to scan a barcode, the potential of a pattern matching tool to match a pattern, etc.).
[0091] The method 500 may further include automatically adjusting one or more image settings to a subsequent configuration (optional block 514). In general, each subsequent configuration may include at least one imaging setting that is different from each previous configuration of the one or more imaging settings. For example, assume that the corresponding configuration of the one or more imaging settings includes a high contrast setting, a small aperture size setting, and a short exposure time setting. In this example, every other corresponding configuration may include up to two settings of the high contrast setting, the small aperture size setting, and the short exposure time setting included in the corresponding configuration. Referring to the previous example, the imaging device may automatically adjust the imaging settings of the imaging device from the second corresponding imaging setting configuration to the third corresponding imaging setting configuration. Optional block 514 may be performed by, for example, the imaging device 104.
[0092] The method 500 may further include capturing a subsequent image of the target object according to a subsequent configuration of one or more imaging settings (optional box 516). Continuing with the previous example, the imaging device may capture a third image of the third target area 602c according to the third corresponding imaging setting configuration. The method 500 may further include designating the subsequent image as the current image (optional box 518), and returning to the optional box 512. In the previous example, the imaging device may designate the third image as the current image, and again determine whether all imaging setting configurations have been applied. As an example, if the machine vision job includes (e.g., via a job file) a fourth corresponding imaging setting configuration, the imaging device may automatically adjust one or more imaging settings according to the fourth corresponding imaging setting configuration and capture a fourth image. In some embodiments, the imaging device may iteratively perform each action associated with the optional box 512 to the optional box 518 until the imaging device determines that all imaging setting configurations have been applied (the "yes" branch of the optional box 512). Optional boxes 516 and 518 may be performed by, for example, the imaging device 104.
[0093] When the imaging device determines that all imaging setting configurations have been applied (the "yes" branch of optional box 512), the imaging device may perform one or more machine vision techniques on the captured image (optional box 520). As previously discussed, the machine vision job may include one or more machine vision tools, each of which is configured to perform one or more machine vision techniques on the captured image. For example, the machine vision job may include a barcode scanning tool, a pattern matching tool, an edge detection tool, and / or any other suitable machine vision tool or combination thereof. Thus, the imaging device may (as part of the machine vision job) apply a barcode scanning tool to the first image to scan the first image of the barcode. Similarly, the imaging device may apply a pattern matching tool and an edge detection tool to the first image to identify one or more patterns and one or more edges, respectively. The imaging device may also apply these and / or other machine vision tools to each of the captured images (e.g., the second, third, fourth, and / or all subsequent images). Optional box 520 may be performed by, for example, the imaging device 104.
[0094] In various embodiments, when one or more of the machine vision tools are AI machine vision tools, each of the captured images can be collected or aggregated at an imaging device and can be analyzed by an AI machine vision tool (e.g., an AI tool such as a machine learning imaging tool as described herein) and / or used to train the AI machine vision tool. Each of these images can include pixel data (e.g., RGB data) that identifies feature data of a target object and corresponds to each of the imaging setting configurations included in the machine vision job.
[0095] The method 500 may further include generating a result signal for the machine vision job (optional block 522). Typically, the machine vision job may return a result signal to indicate to the user / operator whether the captured image meets a threshold and / or otherwise obtains a satisfactory analysis from each machine vision tool included in the machine vision job. If a single machine vision tool does not return and / or otherwise perform a satisfactory analysis when analyzing the corresponding captured image, the machine vision job may fail for the corresponding captured image. In contrast, if all machine vision tools included in the machine vision job for a specific configuration of one or more imaging settings return and / or otherwise perform a satisfactory analysis on the corresponding captured image, the machine vision job may pass the corresponding captured image. As a result, the imaging device may return a result signal to the user / operator to indicate a pass indication or a fail indication of the machine vision job. Optional block 522 may be performed by, for example, the imaging device 104.
[0096] For example, refer to Figure 6 , assume that the imaging device 104 captures a first image of a first target area 602a of a target object 602. Assume that the machine vision tools analyzing the first image are configured to search for a first bar code, a first pattern, a first edge, and a first set of alphanumeric characters. Further, assume that each of the machine vision tools performs a satisfactory analysis such that the machine vision tools analyzing the first image successfully identify each of the first bar code, the first pattern, the first edge, and the first set of alphanumeric characters. As a result, the imaging device may output a pass indication for display to the user / operator indicating that each of the machine vision tools successfully performed a satisfactory analysis.
[0097] As another example, assume that the imaging device 104 captures a second image of a second target area 602b of the target object 602. Assume that the machine vision tools analyzing the second image are configured to search for a second bar code, a second pattern, a second edge, and a second set of alphanumeric characters. Further, assume that some of the machine vision tools perform a satisfactory analysis such that the machine vision tools analyzing the second image successfully identify each of the second bar code, the second pattern, and the second edge. However, assume that at least one machine vision tool does not perform a satisfactory analysis such that the at least one machine vision tool does not successfully identify the second set of alphanumeric characters. As a result, the imaging device may output a fault indication for display to the user / operator indicating that at least one machine vision tool failed to successfully perform a satisfactory analysis with respect to the second image.
[0098] In the above examples, the pass / fail indication may include any suitable information and may be present in any suitable format. Generally, the pass / fail indication may include any alphanumeric characters, symbols, icons, colors, highlights, pictures, and / or other graphical representations, and / or any other suitable indications or combinations thereof. For example, the failure indication of the previous example may include text indicating that at least one machine vision tool failed to identify the second set of alphanumeric characters. As another example, the pass indication of the previous example may include a green light or other symbol indicating a machine vision tool (e.g., a graphic hand in a "thumbs up" configuration) that positively identifies each of the first barcode, the first pattern, the first edge, and the first set of alphanumeric characters. Additionally or alternatively, a pass / fail indication for each corresponding captured image and / or portion thereof may be used and / or overlaid on a graphical representation of the corresponding captured image.
[0099] Additionally, it should be understood that each action described in method 500 may be performed in any order, number of times, or any other combination (or combinations) of one or more imaging settings suitable for optimizing machine vision operations. For example, some or all of the blocks of method 500 may be performed once, multiple times, or not at all.
[0100] Other considerations
[0101] The above description relates to the block diagram of the accompanying drawings. The alternative implementation of the example represented by the block diagram includes one or more additional or alternative elements, processes and / or devices. Additionally or alternatively, one or more of the example boxes in the figure can be combined, divided, rearranged or omitted. The components represented by the blocks of the figure are implemented by hardware, software, firmware and / or any combination of hardware, software and / or firmware. In some examples, at least one of the components represented by the blocks is implemented by a logic circuit. As used herein, the term "logic circuit" is explicitly defined as a physical device including at least one hardware component, which is configured (for example, via an operation according to a predetermined configuration and / or via the execution of a stored machine-readable instruction) to control one or more machines and / or perform the operation of one or more machines. Examples of logic circuits include one or more processors, one or more coprocessors, one or more microprocessors, one or more controllers, one or more digital signal processors (DSPs), one or more application-specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more microcontroller units (MCUs), one or more hardware accelerators, one or more dedicated computer chips, and one or more system-on-chip (SoC) devices. Some example logic circuits, such as ASICs or FPGAs, are specially configured hardware for performing operations (e.g., one or more of the operations represented by the flowcharts described herein). Some example logic circuits are hardware that executes machine-readable instructions to perform operations (e.g., one or more operations represented by the flowcharts of the present disclosure, if any). Some example logic circuits include a combination of specially configured hardware and hardware that executes machine-readable instructions. The above description relates to various operations described herein and flowcharts that may be attached to this document to illustrate the flow of those operations. Any such flowchart represents an example method disclosed herein. In some examples, the method represented by the flowchart implements the device represented by the block diagram. Alternative implementations of the example methods disclosed herein may include additional or alternative operations. In addition, the operations of the alternative implementations of the methods disclosed herein may be combined, divided, rearranged, or omitted. In some examples, the operations described herein represented by the flowcharts are implemented by machine-readable instructions (e.g., software and / or firmware) stored on a medium (e.g., a tangible machine-readable medium) for execution by one or more logic circuits (e.g., (multiple) processors). In some examples, the operations described herein are implemented by one or more configurations of one or more specially designed logic circuits (e.g., ASIC(s)). In some examples, the operations described herein are implemented by a combination of specially designed logic circuit(s) and machine-readable instructions stored on a medium (e.g., a tangible machine-readable medium) for execution by the logic circuit(s).
[0102] As used herein, each of the terms "tangible machine-readable medium," "non-transitory machine-readable medium," and "machine-readable storage device" are expressly defined as a storage medium (e.g., a disk such as a hard drive, a digital versatile disk, an optical disk, a flash memory, a read-only memory, a random access memory, etc.) on which machine-readable instructions (e.g., program code in the form of software and / or firmware) are stored for any suitable period of time (e.g., permanently, for an extended period of time (e.g., while a program associated with the machine-readable instructions is being executed), and / or for a short period of time (e.g., while the machine-readable instructions are cached and / or in the process of being buffered). Further, as used herein, each of the terms "tangible machine-readable medium," "non-transitory machine-readable medium," and "machine-readable storage device" are expressly defined to exclude propagating signals. That is, as used in any claim of this patent, any of the terms "tangible machine-readable medium," "non-transitory machine-readable medium," and "machine-readable storage device" are not to be construed as being implemented by a propagating signal.
[0103] In the above description, specific embodiments have been described. However, it is understood by those skilled in the art that various modifications and changes may be made without departing from the scope of the invention as set forth in the following claims. Therefore, the description and the accompanying drawings are to be regarded as illustrative rather than restrictive, and all such modifications are intended to be included within the scope of the present teachings. Additionally, the described embodiments / examples / implementations should not be interpreted as mutually exclusive, but rather as potentially combinable, if such combinations are permitted in any way. In other words, any feature disclosed in any of the foregoing embodiments / examples / implementations may be included in any of the other foregoing embodiments / examples / implementations.
[0104] These benefits, advantages, solutions to problems, and any (multiple) elements that may make any benefit, advantage, or solution occur or become more prominent are not to be construed as critical, required, or essential features or elements of any or all claims. The claimed invention is defined solely by the appended claims, including any amendments made during the pendency of this application and all equivalents of those claims as issued.
[0105] In addition, in this document, relational terms such as first and second, top and bottom, etc. can be used alone to distinguish one entity or action from another entity or action, without necessarily requiring or implying any actual such relationship or order between these entities or actions. The terms "include", "comprises", "has", "has", "includes", "contains", "covers", "covers" or any other variation thereof are intended to cover non-exclusive inclusions, so that a process, method, article or device that includes, has, contains, covers a list of elements includes not only those elements but also other elements that are not explicitly listed or inherent to such processes, methods, articles or devices. Elements that begin with "includes one", "has one", "includes one", "covers one", in the absence of more constraints, do not exclude the presence of other identical elements in the process, method, article or device that includes, has, contains, covers the element. The terms "one" and "an" are defined as one or more, unless otherwise expressly stated herein. The terms "substantially," "approximately," "approximately," "about" or any other version of these terms are defined as close as understood by one of ordinary skill in the art, and in one non-limiting embodiment, within 10%, within 5%, within 1% in another embodiment, and within 0.5% in another embodiment. The term "coupled," as used herein, is defined as connected, although not necessarily directly and not necessarily mechanically. A device or structure that is "configured" in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
[0106] The abstract of the present disclosure is provided to allow the reader to quickly ascertain the nature of the present technical disclosure. This abstract is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the above-mentioned detailed description, it can be seen that various features are grouped together in various embodiments for the purpose of integrating the present disclosure. This method of disclosure should not be interpreted as reflecting the intention that the claimed embodiments require more features than those explicitly stated in the claims. On the contrary, as reflected in the following claims, the subject matter of the invention may lie in less than all the features of a single disclosed embodiment. Therefore, the following claims are thus incorporated into the detailed description, wherein each claim represents itself as a subject matter claimed separately.
Claims
1. A method for optimizing one or more imaging settings for a machine vision task, the method comprising: detecting, by one or more processors, a start trigger that initiates the machine vision operation; In response to detecting the start trigger, capturing, by an imaging device, a first image of the target object according to a first configuration of the one or more imaging settings; in response to capturing a first image of the target object, automatically adjusting, by the one or more processors, the one or more imaging settings to a second configuration, the second configuration comprising at least one imaging setting different from the first configuration; capturing, by the imaging device, a second image of the target object according to the second configuration of the one or more imaging settings; (a) designating the second image as the current image; (b) in response to capturing the current image of the target object, automatically adjusting the one or more imaging settings to a subsequent configuration, the subsequent configuration comprising at least one imaging setting that is different from each previous configuration of the one or more imaging settings; (c) capturing, by the imaging device, subsequent images of the target object according to the subsequent configuration of the one or more imaging settings.
2. The method according to claim 1, characterized in that The one or more imaging settings include one or more of (i) aperture size, (ii) exposure length, (iii) ISO value, (iv) focal length value, (v) gain value, or (vi) illumination control.
3. The method according to claim 1, characterized in that The start trigger includes the target object entering the field of view (FOV) of the imaging device.
4. The method according to claim 1, characterized in that The imaging device comprises a single camera.
5. The method according to claim 1, characterized in that The machine vision job includes one or more machine vision tools configured to perform one or more machine vision techniques on the first image and the second image.
6. The method of claim 5, further comprising: performing, by the one or more processors, the one or more machine vision techniques on the first image and the second image in accordance with the one or more machine vision tools included in the machine vision job; as well as A result signal representing a pass indication or a fail indication of the machine vision task is generated by the one or more processors.
7. The method according to claim 5, characterized in that The one or more machine vision tools include at least one of (i) a barcode scanning tool, (ii) a pattern matching tool, (iii) an edge detection tool, (iv) a semantic segmentation tool, (v) an object detection tool, or (vi) an object tracking tool.
8. The method according to claim 1, characterized in that The machine vision job includes a predetermined number of configurations of the one or more imaging settings.
9. The method of claim 8, further comprising: (d) designating the subsequent image as the current image; as well as (e) iteratively performing steps (b)-(e) until each of the predetermined number of configurations of the one or more imaging setups has been utilized to capture at least one image of the target object.
10. A computer system for optimizing one or more image settings for a machine vision task, the system comprising: An imaging device, the imaging device being configured to: capturing a first image of a target object according to a first configuration of the one or more imaging settings, and capturing a second image of the target object according to a second configuration of the one or more imaging settings; one or more processors; as well as a non-transitory computer-readable memory coupled to the imaging device and the one or more processors, the memory having stored thereon instructions that, when executed by the one or more processors, cause the one or more processors to: detecting a start trigger that initiates a machine vision operation, and In response to capturing the first image of the target object, automatically adjusting the one or more imaging settings to a second configuration, the second configuration comprising at least one imaging setting different from the first configuration (a) designating the second image as the current image; (b) in response to capturing the current image of the target object, automatically adjusting the one or more imaging settings to a subsequent configuration, the subsequent configuration comprising at least one imaging setting that is different from each previous configuration of the one or more imaging settings; (c) capturing, by the imaging device, subsequent images of the target object according to the subsequent configuration of the one or more imaging settings.
11. The computer system of claim 10, wherein: The one or more imaging settings include one or more of (i) aperture size, (ii) exposure length, (iii) ISO value, (iv) focal length value, (v) gain value, or (vi) illumination control.
12. The computer system of claim 10, wherein: The start trigger includes the target object entering the field of view (FOV) of the imaging device.
13. The computer system of claim 10, wherein: The machine vision job includes one or more machine vision tools configured to perform one or more machine vision techniques on the first image and the second image.
14. The computer system of claim 13, wherein: When the instructions are executed by the one or more processors, the one or more processors are further caused to: performing the one or more machine vision techniques on the first image and the second image in accordance with the one or more machine vision tools included in the machine vision job; as well as A result signal is generated indicating a pass indication or a fail indication of the machine vision operation.
15. The computer system of claim 10, wherein: The machine vision job includes a predetermined number of configurations of the one or more imaging settings.
16. The computer system of claim 15, wherein: When the instructions are executed by the one or more processors, the one or more processors are further caused to: (d) designating the subsequent image as the current image; and (e) iteratively performing steps (b)-(e) until each of the predetermined number of configurations of the one or more imaging setups has been utilized to capture at least one image of the target object.
17. A tangible machine-readable medium comprising instructions for optimizing one or more imaging settings for a machine vision task, which when executed cause a machine to at least: detecting a start trigger, the start trigger initiating a machine vision operation; In response to detecting the start trigger, capturing, by an imaging device, a first image according to a first configuration of the one or more imaging settings; In response to capturing the first image of the target object, automatically adjusting the one or more imaging settings to a second configuration, the second configuration comprising at least one imaging setting different from the first configuration; and capturing, by the imaging device, a second image of the target object according to the second configuration of the one or more imaging settings (a) designating the second image as the current image; (b) in response to capturing the current image of the target object, automatically adjusting the one or more imaging settings to a subsequent configuration, the subsequent configuration comprising at least one imaging setting that is different from each previous configuration of the one or more imaging settings; (c) capturing, by the imaging device, subsequent images of the target object according to the subsequent configuration of the one or more imaging settings.
18. The tangible machine-readable medium of claim 17, wherein: The machine vision job includes one or more machine vision tools configured to perform one or more machine vision techniques on the first image and the second image.
19. The tangible machine-readable medium of claim 18, wherein: When the instructions are executed, the machine is further caused to at least: performing the one or more machine vision techniques on the first image and the second image in accordance with the one or more machine vision tools included in the machine vision job; as well as A result signal is generated indicating a pass indication or a fail indication of the machine vision operation.
20. The tangible machine-readable medium of claim 17, wherein: The machine vision job includes a predetermined number of configurations of the one or more imaging settings, and wherein the instructions, when executed, further cause the machine to at least: (d) designating the subsequent image as the current image; and (e) iteratively performing steps (b)-(e) until each of the predetermined number of configurations of the one or more imaging setups has been utilized to capture at least one image of the target object.
Citation Information
Patent Citations
Points from focus operations using multiple light settings in a machine vision system
CN104137147A
Multi-level image focus using a tunable lens in a machine vision inspection system
CN106482634A
System and method for fast approximate focus
US20100158343A1
Imaging systems with broadband image pixels for generating monochrome and color images
US20150146037A1
Balancing exposure and gain at an electronic device based on device motion and scene distance
US20170118400A1
