Illumination control for imaging systems with multiple image sensors

Abstract

To provide illumination control for imaging systems with multiple image sensors.SOLUTION: The invention provides a multi-sensor imaging system generally relating to illumination synchronization in a multi-imager environment. A process comprises: operating a near-field illumination source associated with a near-field image sensor, based on a first illumination pulse train; determining an exposure period of a far-field image sensor; and modifying one or more characteristics of the first illumination pulse train to accommodate the exposure period of the far-field image sensor.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] FIELD Embodiments of the present disclosure relate generally to imaging systems having multiple image sensors, and more particularly to illumination control for image sensors in imaging systems. [Background technology]

[0002] Imaging devices and systems have found applications in areas that are becoming more complex and sophisticated than simple photography. There is a constant demand for improving the imaging capabilities of these devices and systems to support new capabilities. In currently available imaging systems, factors such as smaller form factors have led to increased interference between components of the imaging system. In such systems, it remains a challenge to operate the components in a synchronized manner to prevent any adverse effects on each other's performance. Summary of the Invention

[0003] In general, the embodiments of the present disclosure provided herein are configured for lighting control and synchronization in a multi-imager environment. Other implementations of one or more alternative illuminator assemblies and / or alternative illumination imaging systems and devices will be, or will become, apparent to one of ordinary skill in the art upon review of the following drawings and detailed description. All such additional implementations are intended to be included herein within the scope of this disclosure and protected by the following claims.

[0004] According to some exemplary embodiments, an imaging system is provided herein. In the exemplary embodiments, the imaging system includes a first illumination source associated with a first image sensor, the first illumination source configured to operate based on a first illumination pulse train. The imaging system also includes a second image sensor and a controller communicatively coupled to each of the first illumination source, the first image sensor, and the second image sensor. In some exemplary embodiments, the controller is configured to determine a first exposure period of the second image sensor and modify one or more characteristics of the first illumination pulse train to accommodate the first exposure period of the second image sensor.

[0005] Additionally or alternatively, in some embodiments of the imaging system, the controller is further configured to insert at least one additional illumination pulse into the first illumination pulse train to modify one or more characteristics of the first illumination pulse train, such that one of the start time period or the end time period of the illumination period of the at least one additional illumination pulse is aligned with one of the start time period or the end time period of the first exposure period of the second image sensor.

[0006] Additionally or alternatively, in some embodiments of the imaging system, the controller is further configured to insert at least one additional illumination pulse within the first illumination pulse train to modify one or more characteristics of the first illumination pulse train such that illumination of the first image sensor corresponding to the at least one additional illumination pulse overlaps in time with an autofocus period of the second image sensor.

[0007] Additionally or alternatively, in some embodiments of the imaging system, to modify one or more characteristics of the first illumination pulse train, the controller is further configured to increase a timing delay between a pair of temporally subsequent illumination pulses of the first illumination pulse train such that one of the start time period or the end time period of the first exposure period is aligned with a respective one of the start time period or the end time period of the increased timing delay. are.

[0008] Additionally or alternatively, in some embodiments of the imaging system, the first image sensor is exposed during at least a second exposure period, hi some exemplary embodiments, the exposure of the first image sensor during the second exposure period begins coincident with the start time period of the first illumination pulse of the first illumination pulse train, and the end time period of the second exposure period extends beyond the end time period of the first illumination pulse of the first illumination pulse train.

[0009] Additionally or alternatively, in some embodiments of the imaging system, the controller is further configured to acquire image frames captured by exposing the second image sensor during the first exposure period. In some exemplary embodiments, the controller is further configured to determine a brightness of the image frames and activate a second illumination source associated with the second image sensor based on the determined brightness of the image frames, wherein the second illumination source is configured to operate based on a second illumination pulse train.

[0010] Additionally or alternatively, in some embodiments of the imaging system, exposure of the first image sensor begins simultaneously with activation of the first illumination source.

[0011] Additionally or alternatively, in some embodiments of the imaging system, the second image sensor remains deactivated during a first illumination period of a first illumination pulse of the first illumination pulse train. Additionally or alternatively, in some embodiments, the second image sensor is exposed during a portion of a second illumination period of a second illumination pulse of the first illumination pulse train.

[0012] In exemplary embodiments, an imaging method is provided. The method may be implemented using any one of a myriad of implementations, such as via the hardware, software, and / or firmware of a multi-sensor imaging engine and / or multi-sensor imager described herein. In some exemplary implementations of the method, the exemplary method includes operating a first illumination source associated with a first image sensor based on a first illumination pulse train. The exemplary method further includes determining a first exposure period of a second image sensor and modifying one or more characteristics of the first illumination pulse train to accommodate the first exposure period of the second image sensor.

[0013] Additionally or alternatively, in some embodiments of the method, modifying one or more characteristics of the first illumination pulse train includes inserting at least one additional illumination pulse into the first illumination pulse train such that one of the start time period or the end time period of the illumination period of the at least one additional illumination pulse is aligned with one of the start time period or the end time period of the first exposure period of the second image sensor.

[0014] Additionally or alternatively, in some embodiments of the method, modifying one or more characteristics of the first illumination pulse train includes inserting at least one additional illumination pulse within the first illumination pulse train such that illumination of the first image sensor corresponding to the at least one additional illumination pulse overlaps in time with an autofocus period of the second image sensor.

[0015] Additionally or alternatively, in some embodiments of the method, modifying one or more characteristics of the first illumination pulse train includes increasing a timing delay between a pair of temporally subsequent illumination pulses of the first illumination pulse train such that one of the start time period or the end time period of the first exposure period is aligned with a respective one of the start time period or the end time period of the increased timing delay.

[0016] Additionally or alternatively, in some embodiments of the method, the method further includes causing exposure of the first image sensor during at least a second exposure period. In some exemplary embodiments, the exposure of the first image sensor during the second exposure period begins simultaneously with a start time period of a first illumination pulse of the first illumination pulse train. In some exemplary embodiments, an end time period of the second exposure period extends beyond an end time period of the first illumination pulse of the first illumination pulse train.

[0017] Additionally or alternatively, in some embodiments of the method, the method further includes obtaining an image frame captured by exposing a second image sensor during the first exposure period. An example method further includes determining a brightness of the image frame and activating a second illumination source associated with the second image sensor based on the determined brightness of the image frame, the second illumination source being configured to operate based on a second illumination pulse train.

[0018] In exemplary embodiments, an apparatus is provided. In the exemplary embodiments, the imaging system includes a memory configured to store executable instructions and one or more processors. In some exemplary embodiments, the one or more processors are configured to execute the executable instructions to control operation of a first illumination source associated with a first image sensor based on a first illumination pulse train. In some exemplary embodiments, the one or more processors are further configured to determine a first exposure period of a second image sensor and modify one or more characteristics of the first illumination pulse train to accommodate the first exposure period of the second image sensor.

[0019] Additionally or alternatively, in some embodiments of the apparatus, the one or more processors are further configured to insert at least one additional illumination pulse within the first illumination pulse train to modify one or more characteristics of the first illumination pulse train, such that one of the start time period or the end time period of the illumination period of the at least one additional illumination pulse is aligned with one of the start time period or the end time period of the first exposure period of the second image sensor.

[0020] Additionally or alternatively, in some embodiments of the apparatus, the one or more processors are further configured to insert at least one additional illumination pulse within the first illumination pulse train to modify one or more characteristics of the first illumination pulse train, such that illumination of the first image sensor corresponding to the at least one additional illumination pulse overlaps in time with an autofocus period of the second image sensor.

[0021] Additionally or alternatively, in some embodiments of the apparatus, to modify one or more characteristics of the first illumination pulse train, the one or more processors are further configured to increase a timing delay between a pair of temporally subsequent illumination pulses of the first illumination pulse train such that one of the start time periods or the end time periods of the first exposure period is aligned with a respective one of the start time periods or the end time periods of the increased timing delay.

[0022] Additionally or alternatively, in some embodiments of the apparatus, the one or more processors are further configured to obtain image frames captured by exposing the second image sensor during the first exposure period. In some exemplary embodiments of the apparatus, the one or more processors are further configured to determine a brightness of the image frames and activate a second illumination source associated with the second image sensor based on the determined brightness of the image frames, wherein the second illumination source is configured to operate based on a second illumination pulse train. [Brief explanation of the drawings]

[0023] Having thus described embodiments of the present disclosure in general terms, reference is now made to the accompanying drawings, which are not necessarily drawn to scale.

[0024] [Figure 1A] 1 shows a block diagram of an exemplary multi-sensor imaging system, in accordance with an exemplary embodiment of the present disclosure.

[0025] [Figure 1B] 1 shows a block diagram of an exemplary multi-sensor imaging engine, in accordance with an exemplary embodiment of the present disclosure.

[0026] [Figure 2] 1 shows a block diagram of an exemplary multi-sensor imaging device in accordance with various embodiments of the present disclosure.

[0027] [Figure 3] 1 illustrates a visualization of a field of view associated with an exemplary multi-sensor imaging device, according to an exemplary embodiment of the present disclosure.

[0028] [Figure 4] 1 illustrates a visualization of a first illumination generated by an exemplary multi-sensor imaging system, according to an exemplary embodiment of the present disclosure.

[0029] [Figure 5] 10 illustrates a visualization of a second illumination generated by an exemplary multi-sensor imaging system, according to an exemplary embodiment of the present disclosure.

[0030] [Figure 6] 1 illustrates timing diagrams associated with operational functions of an exemplary multi-sensor imaging system, in accordance with exemplary embodiments of the present disclosure.

[0031] [Figure 7] 1 shows a flowchart illustrating an example operation of a process for lighting control in a multi-imager environment, according to an example embodiment of the present disclosure.

[0032] [Figure 8] 1 shows a flowchart illustrating exemplary operations of a process for modifying one or more characteristics of a first illumination pulse train to accommodate a first exposure period of a second image sensor of an exemplary multi-sensor imaging system, according to an exemplary embodiment of the present disclosure.

[0033] [Figure 9] 10 shows a flowchart illustrating exemplary operations of another process for modifying one or more characteristics of a first illumination pulse train to accommodate a first exposure period of a second image sensor of an exemplary multi-sensor imaging system, in accordance with an exemplary embodiment of the present disclosure.

[0034] [Figure 10] 10 shows a flowchart illustrating exemplary operations of another process for modifying one or more characteristics of a first illumination pulse train to accommodate a first exposure period of a second image sensor of an exemplary multi-sensor imaging system, in accordance with an exemplary embodiment of the present disclosure.

[0035] [Figure 11] 1 illustrates a timing diagram associated with operational functions of an exemplary multi-sensor imaging system for flicker reduction, in accordance with an exemplary embodiment of the present disclosure.

[0036] [Figure 12A] 1 illustrates an exemplary workflow of a symbol decoding process according to an exemplary embodiment of the present disclosure. [Figure 12B] 1 illustrates an exemplary workflow of a symbol decoding process according to an exemplary embodiment of the present disclosure. [Figure 12C] 1 illustrates an exemplary workflow of a symbol decoding process according to an exemplary embodiment of the present disclosure.

[0037] [Figure 13] 1 illustrates an exemplary workflow of a flicker reduction process according to an exemplary embodiment of the present disclosure.

[0038] [Figure 14] 1 illustrates an exemplary workflow of a flicker reduction process for extended far-field exposure of an imaging device, according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0039] Various embodiments of the present disclosure will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all, embodiments of the present disclosure are shown. Indeed, embodiments of the present disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like numbers refer to like elements throughout.

[0040] Imaging devices, such as tag readers, are used in a variety of scenarios, each requiring a specific set of imaging requirements to be met so that tag reader-associated operations, such as symbol decoding, can be performed sequentially. Additionally, specific safety requirements related to the tag reader's operator, for example, must be met to ensure compliance with regulations. Tag readers typically require surface-mounted symbols to be scanned from a close range in order to successfully decode them. However, in some environments, such as warehouses, it is not possible to scan and sequentially decode parcel and shipment-mounted symbols by reaching each shipment from a close range. Therefore, extended-range tag readers are provided, which do not require an operator to reach each shipment individually from a close range. Such extended-range tag readers can scan multiple symbols from a single operator position due to the extended-range reader's far-field scanning capabilities. Such tag readers include multiple image sensors and associated optics to provide these capabilities.

[0041] The illumination requirements of sensors can vary widely. For example, one or more image sensors in a sign reader may require illumination even during data readout, while other sensors may not. Thus, keeping the light source of one image sensor active for a longer period of time may interfere with the exposure period of another sensor where illumination is not desired. Such interference can result in images that are defective in terms of one or more imaging characteristics, thereby adversely affecting the resulting image processing task. The problem is particularly prevalent in small imaging devices where sensors, illumination sources, and other optics and components are closely spaced. Furthermore, in the context of a multi-imager environment (e.g., including multiple imagers and / or multiple light sources), naive implementations for capturing images by alternating between imagers and / or light sources exacerbate the flicker effect and, therefore, the negative impacts associated therewith.

[0042] In many scenarios where the image sensors are of different types, it is difficult to synchronize the illumination of the sensors for successful operation. For example, if a sign reader includes a rolling shutter sensor for far-field imaging and a global shutter sensor for near-field imaging, the extended illumination time of the rolling shutter during data readout makes it difficult to ensure optimal illumination conditions for the global shutter sensor. This can result in undesirable effects such as snapping in images captured by the global shutter sensor. Furthermore, the extended illumination time can also result in heat generation that affects the thermal management system within the barcode scanner. Furthermore, in outdoor environments, illumination may not always be necessary for far-field imaging because sufficient ambient light is available. Therefore, the aimer of the imaging system may not be able to distinguish from the background, thereby requiring a rapid focus to adjust the focus position of the image sensor.

[0043] Additionally, controlling the illumination of such devices can be useful to provide a pleasing visual appearance to the operator. For example, if the illumination pulses are within a certain frequency range (e.g., below a certain threshold frequency), the operator may experience headaches and / or seizures from viewing the illumination exposure. Therefore, in the context of a multi-imager having multiple illumination sources, each illumination source should be configured to prevent such negative health effects and undesirable visual appearance. Regardless, if illumination sources are cycled and / or otherwise switched frequently, the operator may experience a "flickering" effect that may be undesirable or equally harmful.

[0044] Some embodiments described herein relate to a dual illumination framework for a multi-sensor imaging system including multiple illumination sources and multiple image sensors. Some embodiments described herein utilize a first illumination source and a first image sensor for capturing an image during one or more illumination pulses of an illumination pulse train associated with the first illumination source. Some embodiments further utilize a second image sensor to capture an image, and the exposure period of the second image sensor is contemplated to be modified with respect to the first illumination pulse train so that the illumination of the first illumination source does not introduce any undesirable effects into the image captured by the second image sensor. Furthermore, the illumination of the second image sensor is timed in a manner that does not affect the image captured by the first image sensor.

[0045] In some embodiments, one or more events may be triggered that indicate a condition requiring activation of the second illumination source. In this regard, the second illumination source may generate second illumination for illuminating a second field of view associated with the second image sensor. In one such exemplary context, activation of the second illumination source may be triggered after determining that an object is not detectable in images captured in the first field of view using the first illumination source and / or in the second field of view using ambient light illumination, and therefore that the object is likely further away from the imaging device. Activation of the second illumination source may be triggered in response to detecting one or more events and / or conditions, such as in response to processing one or more previously captured images to determine that a threshold number of images have been captured and that there are no detectable objects in images captured in very low lighting conditions (e.g., below a certain white value threshold).

[0046] In such a situation, changing to a different illumination source allows a second image sensor to be triggered during the illumination pulse of the newly activated second illumination source, improving the effective read range of the device. In embodiments with three or more illumination sources, the same considerations may continue to cycle through the three or more illumination sources, e.g., narrowing the field of view illuminated by each illumination source and expanding the effective range with each cycle. Alternatively, one or more illumination sources may be skipped, e.g., the cycle proceeds immediately from the widest illumination source to the narrowest illumination source without utilizing one or more intermediate illumination sources.

[0047] Such embodiments provide effective synchronization of illumination sources with flicker reduction and / or flicker elimination while enabling effective and efficient capture of images for processing. Operation of such embodiments increases the likelihood that an image will be captured within a desired operating timeframe that contains sufficient data for successful processing while capturing images in a manner that is likely to successfully complete an image processing task, such as sign or symbol scanning. Implementations of various exemplary embodiments described herein maintain or improve operational efficiency of an imaging device while addressing challenges arising from the use of multiple sensors and multiple illumination sources.

[0048] In some embodiments, some of the above operations may be modified or further amplified. Furthermore, in some embodiments, additional optional operations may be included. Modifications, amplifications, or additions to the above operations may be performed in any order and in any combination.

[0049] Many modifications and other embodiments of the disclosure described herein will come to mind to one skilled in the art to which this disclosure pertains having the benefit of the teachings presented in the foregoing description and the associated drawings. It is therefore to be understood that the embodiments are not limited to the particular embodiments disclosed, and that modifications and other embodiments are intended to be included within the scope of the appended claims. Furthermore, while the foregoing description and the associated drawings describe exemplary embodiments in the context of particular example combinations of elements and / or functions, it is to be understood that different combinations of elements and / or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and / or functions than those explicitly described above are also contemplated as being recited within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation. definition

[0050] The term "illumination" refers to one or more light rays generated by an illumination source within a defined field of view. In at least one exemplary context, the illumination includes one or more illumination pulses generated by a corresponding illumination source. In some embodiments, the illumination is generated based on a "defined pulse frequency," which refers to the rate at which illumination pulses are generated by the illumination source. Additionally or alternatively, in some embodiments, the illumination is generated based on a "defined pulse phase," which refers to the activation period during which the illumination source is generating the corresponding illumination.

[0051] Thus, multiple illumination pulses having a defined pulse frequency may collectively constitute an "illumination pulse train." Each illumination pulse may extend in the time domain for a duration referred to as an "illumination period." An illumination period may therefore refer to the duration of time during which the amplitude of the illumination pulse remains non-zero. That is, the illumination period of an illumination pulse refers to the period during which the illumination source remains activated corresponding to the illumination pulse.

[0052] In at least one example context, an illumination pulse is associated with an "illumination pulse start time," which refers to electronically managed data representing the time at which the corresponding illumination source begins generating an illumination pulse. Additionally or alternatively, in at least one such context, an illumination pulse is associated with an "illumination pulse end time," which refers to electronically managed data representing the time at which the corresponding illumination source stops generating an illumination pulse.

[0053] The term "illumination period start time period" refers to a time period of a threshold duration starting from an illumination pulse start time, where the threshold duration may have a configurable value. In at least one example context, the threshold duration may be zero, and thus the terms illumination period start time period and illumination pulse start time may refer to the same instance in time. Each illumination pulse may have an individual start time period.

[0054] The term "illumination period end time period" refers to a time period of a threshold duration that ends at an illumination pulse end time, where the threshold duration may have a configurable value. In at least one example context, the threshold duration may be zero, and thus the terms illumination period end time period and illumination pulse end time may refer to the same instance in time. Each illumination pulse may have an individual end time period.

[0055] The term "illumination source" (also referred to as "illuminator source" or "illuminator") refers to one or more light-generating hardware, devices, and / or components configured to generate illumination within a desired field of view. Non-limiting examples of illumination sources include one or more light emitting diodes (LEDs), lasers, etc.

[0056] The term "near-field illumination source" refers to an illumination source configured to generate illumination for illuminating a near-field associated with a near-field image sensor. In at least one example context, a near-field illumination source is configured to generate illumination over a wider field of view as compared to a far-field illumination source.

[0057] The term "far-field illumination source" refers to an illumination source configured to generate illumination for illuminating a field of view associated with a far-field imager. In at least one example context, a far-field illumination source is configured to generate illumination over a narrower field of view compared to a near-field illumination source.

[0058] The term "near-field illumination" refers to the specific illumination generated by a near-field illumination source. In some embodiments, the near-field illumination is associated with illumination of the near field captured by a near-field image sensor. The term "near-field illumination pulse" refers to an illumination pulse of the near-field illumination associated with the near-field sensor.

[0059] The term "far-field illumination" refers to the specific illumination generated by a far-field illumination source. In some embodiments, the far-field illumination is associated with illumination in the far field captured by a far-field image sensor. The term "far-field illumination pulse" refers to an illumination pulse of the far-field illumination.

[0060] The term "imager" refers to one or more components configured to capture an image representing a particular field of view. In at least one exemplary context, the imager includes at least one optical component (e.g., a lens and / or associated housing) that defines the particular field of view. Additionally or alternatively, in at least one exemplary context, the imager includes an image sensor configured to output an image based on light engaging the image sensor, such as via the optical component.

[0061] The term "image sensor" refers to one or more components configured to generate an image represented by a data object based on light incident on the image sensor. In some such example contexts, the image sensor converts light waves interacting with the image sensor into signals representing the image output by the sensor.

[0062] The term "near-field image sensor" refers to an image sensor configured to capture an image of a near field. In at least one context, the near-field image sensor comprises at least one near-field optical component that defines a near field and an electronic sensor. In at least one exemplary context, the near-field image sensor may include a global shutter. In some exemplary situations, the near-field image sensor may include a rolling shutter. The term "near-field image" refers to electronic data generated by the near-field image sensor that embodies a captured representation of the near field.

[0063] The term "far-field image sensor" refers to an image sensor configured to capture an image of a far field. In at least one context, the far-field image sensor comprises at least one far-field optical component that defines a far field and an electronic sensor. In at least one exemplary context, the far-field image sensor may include a rolling shutter. In some exemplary situations, the far-field image sensor may include a global shutter. The term "far-field image" refers to electronic data generated by the far-field image sensor that embodies a captured representation of the far field.

[0064] The term "exposure period" refers to the time during which the image sensor is configured to be exposed to incoming light. In at least one exemplary embodiment, the image sensor of the imager is configured to utilize a variable exposure time that can be set to a specific exposure time value.

[0065] The term "exposure period start time period" refers to a time period of a threshold duration that begins from the start of an exposure period. The threshold duration may have a configurable value. In one example, the threshold duration may be zero, and thus the terms exposure period start time period and exposure period start may refer to the same instance in time.

[0066] The term "exposure period end time period" refers to a time period of a threshold duration that ends at the end of the exposure period, where the threshold duration may have a configurable value. In one example, the threshold duration may be zero, and thus the terms exposure period end time period and end of exposure period may refer to the same instance in time.

[0067] FIG. 1A illustrates a block diagram of an exemplary multi-sensor imaging system 10 (hereinafter also referred to as imaging system 10) according to an exemplary embodiment of the present disclosure. Multi-sensor imaging system 10 includes an imaging engine 100 communicatively coupled to a controller 20, a communications interface 40, an initiating component 60, and one or more peripheral components 80. In some exemplary embodiments, imaging system 10 may include fewer or more components than those illustrated in FIG. 1A. Imaging system 10 is configured to capture one or more images of a target within one or more fields of view using one or more illumination sources. Imaging system 10 processes the one or more images to perform one or more image processing tasks, such as reading signs. Accordingly, in some exemplary embodiments of the present disclosure, imaging system 10 may be partially or fully embodied as a sign or symbol reader or a handheld device capable of reading signs and similar symbols. One exemplary embodiment of imaging system 10 is illustrated in FIG. 2, the details of which are described in subsequent portions of this disclosure.

[0068] The controller 20 may be configured to perform one or more control operations associated with the imaging system 10. For example, the controller 20 may control the imaging engine 100 to cause image capture of targets within the field of view of the imaging engine 100. Additionally, the controller 20 may process the captured images to perform one or more image processing tasks. The controller 20 may be embodied as a central processing unit (CPU) that includes one or more processors and memory. In some exemplary implementations, the controller 20 may be configured to perform one or more image processing tasks. In embodiments, controller 20 may be implemented using one or more microcontroller units (MCUs), such as one or more of a variety of hardware processing means, such as a coprocessor, a microprocessor, a digital signal processor (DSP), a processing element with or without an associated DSP, or various other processing circuits, including integrated circuits, such as, for example, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a hardware accelerator, a dedicated computer chip, etc. In some embodiments, the processor of controller 20 may include one or more processing cores configured to operate independently. A multi-core processor may enable multiprocessing within a single physical package. Additionally or alternatively, the processor may include one or more processors configured in tandem via a bus to enable independent execution of instructions, pipelines, and / or multiple threads.

[0069] Memory may be non-transitory, e.g., it may include one or more volatile and / or non-volatile memories. For example, memory may store data (e.g., bits) that may be retrieved by a machine (e.g., a computing device such as a processor). The memory may be an electronic storage device (e.g., a computer-readable storage medium) including a gate configured to store information, data, content, applications, instructions, etc. to enable the device to perform various functions in accordance with exemplary embodiments of the present invention. For example, the memory may be configured to buffer data for processing by the processor. Additionally or alternatively, the memory may be configured to store instructions for execution by the processor.

[0070] In some embodiments, the processor (and / or a co-processor or any other processing circuitry that assists or is otherwise associated with the processor) may communicate with memory via a bus for passing information between components of the imaging system 10. The processor may be configured to execute instructions stored in memory or otherwise accessible to the processor. Additionally or alternatively, the processor may be configured to perform hard-coded functions. Thus, whether configured by hardware or software methods, or a combination thereof, a processor may represent an entity (e.g., physically embodied in circuitry) that is capable of performing operations according to embodiments of the present invention while configured accordingly. Thus, for example, if the processor is embodied as an ASIC, FPGA, etc., the processor may be specifically configured in hardware to perform the operations described herein. Alternatively, as another example, if the processor is embodied as an execution body of software instructions, the instructions may specifically configure the processor to perform the algorithms and / or operations described herein when executed. The processor may include, among other things, a clock, an arithmetic logic unit (ALU), and logic gates configured to support the operation of the controller 20. That's fine.

[0071] The communications interface 40 may include input and output interfaces for supporting communication with the imaging system 10. The communications interface 40 may be embodied by any means, such as devices or circuitry embodied in either hardware or a combination of hardware and software, configured to receive and / or transmit data from and / or to communication devices in communication with the imaging system 10. In this regard, the communications interface 40 may include, for example, an antenna (or antennas) and supporting hardware and / or software for enabling communication with a wireless communications network. Additionally or alternatively, the communications interface 40 may include circuitry for interacting with the antenna to cause transmission of signals via the antenna or for processing reception of signals received via the antenna. In some environments, the communications interface 40 may alternatively or additionally support wired communications. Thus, for example, the communications interface 40 may support a variety of communications protocols, including cable, digital subscriber line (DSL), universal serial bus (USB), and the like. , USB), or other mechanisms.

[0072] Initiating component 60 may include hardware, software, firmware, and / or combinations thereof configured to indicate initiation (and / or termination) of a desired function by a user. For example, initiating component 60 may send an initiation signal to controller 20 to initiate operation of imaging engine 100, e.g., to initiate illumination via one or more illumination sources and / or to initiate capture via an image sensor, one or more images. Additionally or alternatively, initiating component 60 may send a stop signal to controller 20 to terminate the corresponding function, e.g., to stop scanning via an image sensor. In some embodiments, initiating component 60 is initiated by one or more buttons, triggers, and / or other physical components provided in or on the body of the chassis. For example, in at least one exemplary context, initiating component 60 is embodied by one or more “trigger” components that, when engaged by an operator (e.g., when the operator pulls a trigger), send a signal to controller 20 to initiate a corresponding function. In some such embodiments, the initiating component may send a stop signal to controller 20 to stop such function when the component is disengaged by the operator (e.g., when the operator releases the trigger). Alternatively or additionally, in at least some embodiments, initiating component 60 is embodied without a component for direct engagement by an operator. For example, when imaging system 10 is embodied as an imaging device, initiating component 60 may be embodied by hardware and / or software, or a combination thereof, to detect when the imaging device is raised and / or positioned in and / or lowered from a predefined “scan” position to trigger a stop. Alternatively or additionally, initiating component 60 may be embodied as a user interface element of imaging system 10. In such an embodiment, initiating component 60 embodied as a user interface element may be configured to receive input from a user on a user interface and then send a corresponding command to controller 20 .

[0073] The one or more peripheral components 80 include other structural and functional elements of the imaging system 10, such as, for example, a display device, a user interface, a housing, a chassis, a power supply, etc. One or more of the peripheral components 80 may be controlled by the controller and may operate according to instructions or control provided by the controller 20.

[0074] 1B illustrates an exemplary multi-sensor imaging engine (hereinafter also referred to as an “imaging engine”) in accordance with an exemplary embodiment of the present disclosure. Specifically, as shown, the exemplary multi-sensor imaging engine is embodied by multi-sensor imaging engine 100. Multi-sensor imaging engine 100 includes multiple image sensors, specifically, near-field image sensors and far-field image sensors configured to capture image data objects within a near field associated with the near-field image sensor and a far field associated with the far-field image sensor, respectively. In at least one exemplary context, multi-sensor imaging engine 100 is configured to capture images for the purpose of sign reading at different ranges, such as a near range using the near-field image sensor and a far range using the far-field image sensor.

[0075] As shown, multi-sensor imaging engine 100 includes near-field image capture optics 104A. Near-field capture optics 104A may be embodied by one or more lenses and / or other optical components configured to allow light to interact across a corresponding image sensor, specifically near-field image sensor 102A. In this regard, near-field image capture optics 104A may define a particular field of view that may be captured by near-field image sensor 102A. In some embodiments, near-field image capture optics 104A define a near field of view associated with a first focus range, such that objects located at and / or within a determinable offset from the first focus range may be clear in images captured by near-field image sensor 102A.

[0076] As further shown, multi-sensor imaging engine 100 includes far-field image capture optics 104B. Far-field image capture optics 104B may be embodied by one or more lenses and / or other optical components configured to allow light to interact across a corresponding image sensor, specifically far-field image sensor 102B. In this regard, far-field image capture optics 104B may define a second field of view that may be captured by far-field image sensor 102B. In some embodiments, far-field image capture optics 104B defines a far field that is associated with a second focal range, such that objects located at and / or within a determinable offset from the second focal length are captured by far-field image sensor 102B. 102B. In some such embodiments, the near field is wider than the far field, such that the captured data represents more of the environment within the field of view of multi-sensor imaging engine 100. The far field is narrower than the near field and is focused to a greater extent, allowing for clearer capture of objects located at a greater range than can be clearly captured in the near field. The physical layout of the illumination source and image sensor can be varied for different applications.

[0077] In some exemplary embodiments, the near-field image sensor 102A may include a global shutter to provide enhanced motion tolerance. The near-field image sensor 102A may use a large field of view (FOV), which allows for Applications include, but are not limited to, optical character recognition (OCR), image reproduction, This enables applications such as image processing, machine learning, and the like. In some embodiments, the far-field image sensor 102B may include a rolling shutter. The far-field image sensor 102B uses a small FOV to improve sampling of the far field. Additionally, each of the near-field image sensor 102A and the far-field image sensor 102B may have an associated focus mechanism. The focus mechanism may include a focus scheme that controls movement of one or more focus lenses along the optical axis of the image sensor (102A or 102B). To this end, in some embodiments, the focus scheme may include one or more motors, e.g., stepper motors. The focus scheme may provide multiple distinct focus positions within each field of view, and the motors may move the focus optics of a particular image sensor to each of the distinct focus positions to exhibit the focus mechanism. For example, in some exemplary embodiments, to change the focus of the far-field image sensor 102B, a corresponding motor may move the associated focus optics of the far-field image sensor 102B to three distinct focus positions in the far field. The operation of each of the focus mechanisms may be controlled by a processing component such as controller 20 or processor 202 of FIG. 1A.

[0078] In some embodiments, for example, as shown, each image sensor (or a subset thereof) is associated with one or more components for generating illumination configured to illuminate the field of view defined by the image sensor. For example, as shown, multi-sensor imaging engine 100 further includes near-field illumination source 106A and corresponding near-field projection optics 108A. Near-field illumination source 106A may generate illumination pulses that constitute a near-field illumination pulse train. That is, activation of near-field illumination source 106A occurs for a period of time, and then near-field illumination source 106A remains deactivated for a set period of time before the next activation. Near-field illumination source 106A is configured to generate light along the optical axis of near-field projection optics 108A. This light is refracted through near-field projection optics 108A to generate near-field illumination, which may be generated in a desired pattern based on the configuration and design of near-field projection optics 108A. In this regard, the illumination generated by light exiting near-field projection optics 108A may illuminate a particular field, such as a near field captureable by near-field image sensor 102A. It should be understood that in some embodiments, near-field illumination source 106A and / or near-field projection optics 108A may be designed such that the near-field illumination specifically illuminates a near field and may affect the functionality of far-field image sensor 102B without adversely affecting the functionality of near-field image sensor 102A. For example, due at least in part to the proximity between components, reflected light may interact with far-field image sensor 102B and adversely affect the image created via far-field image sensor 102B. In some exemplary embodiments, near-field illumination source 106A may generate near-field illumination based on one or more illumination pulses that comprise a near-field illumination pulse train.

[0079] Similarly, multi-sensor imaging engine 100 further includes far-field illumination source 106B and corresponding far-field projection optics 108B. Far-field illumination source 106B generates far-field illumination pulses that constitute a far-field illumination pulse train. Far-field illumination source 106B is configured to generate light in the direction of far-field projection optics 108B. This light is then projected through far-field projection optics 108B. 8B to produce far-field illumination, which may be produced in a desired pattern based on the configuration and design of far-field projection optics 108B. In this regard, the far-field illumination may illuminate a particular field of view, such as the far field captureable by far-field image sensor 102B. It should be understood that far-field illumination source 106B and / or far-field projection optics 108B may be designed such that the far-field illumination specifically illuminates the far field without producing sufficient reflections that adversely affect the operation of near-field image sensor 102A and / or far-field image sensor 102B.

[0080] Additionally or alternatively, optionally, in some embodiments, the multi-sensor imaging engine 100 further comprises an aimer illumination source 110. The aimer illumination source 110 is configured to generate light in the direction of the aimer projection optics 112. For example, the aimer illumination source comprises one or more laser diodes and / or high-intensity LEDs configured to generate sufficiently powerful and / or concentrated light. The light is refracted through the aimer projection optics 112 to generate aimer illumination, which may be generated in a desired pattern based on the configuration and design of the aimer projection optics 112. For example, for purposes of barcode scanning, in one exemplary context, the aimer pattern may be generated as a laser line pattern.

[0081] Multi-sensor imaging engine 100 further comprises a protective window 114. Protective window 114 comprises one or more optical components configured to allow generated light to exit engine 100 and incident light to be received to interact with corresponding image sensors 102A and 102B via image capture optics 104A and 104B. In some contexts, protective window 114 reflects at least a portion of illumination projected by far-field projection optics 108B and / or near-field projection optics 108A, which may interact with image sensors 102A and / or 102B via light leakage or via corresponding image capture optics 104A and / or 104B. For example, at least a portion of the near-field illumination may be reflected toward far-field image sensor 102B and, if triggered when an illumination pulse occurs, adversely affect the operation of far-field image sensor 102B. In at least one example context, the far-field illumination source 106B generates light that is focused and / or otherwise sufficiently designed so that the far-field illumination generated by the far-field projection optics 108B is not reflected sufficiently to adversely affect the near-field image sensor 102A.

[0082] It should be understood that in other embodiments, the multi-sensor imaging engine may include any number of image capture optics, image sensors, illumination sources, and / or any combination thereof. In this regard, imaging engine 100 may be expanded to capture any number of fields of view, each of which may be associated with a corresponding illuminator designed specifically to illuminate the corresponding field of view. One or more illumination sources may adversely affect the operation of another illuminator. In such a situation, when one such illumination source is active, the adversely affected image sensor may be activated between illumination pulses of the illumination source described herein. Such operation may be implemented for any combination of illumination sources and image sensors.

[0083] In some embodiments, multi-sensor imaging engine 100 includes one or more processing components (e.g., a processor and / or other processing circuitry) for controlling the activation of one or more components of multi-sensor imaging engine 100. For example, in at least one exemplary embodiment, multi-sensor imaging engine 100 includes a processor configured to time illumination pulses of near-field illumination source 106A and / or far-field illumination source 106B and / or control exposure of near-field image sensor 102B and / or far-field image sensor 102A. In some such situations, the processor is embodied by any one of a myriad of processing circuit implementations, such as, for example, an FPGA, an ASIC, a microprocessor, a CPU, etc. In at least some embodiments, the processor may be in communication with one or more memory devices having computer-coded instructions that, when executed by the processor, enable such functionality. In some embodiments, the processor may be configured to control one or more sub-processors. It should be understood that the processor may include a processor, a remote processor (e.g., a "cloud" processor), etc., and / or may be in communication with one or more additional processors for performing such functions. For example, in at least one embodiment, the processor may be in communication with and / or operate with another processor within the imaging device, such as processor 202 as depicted and described with respect to FIG. 2.

[0084] FIG. 2 illustrates an exemplary multi-sensor imaging device in accordance with an exemplary embodiment of the present disclosure. Specifically, FIG. 2 illustrates exemplary multi-sensor imaging device 200. As shown, multi-sensor imaging device 200 includes a device chassis 210 for housing various components of the device. In this regard, it should be understood that device chassis may be embodied in any of a myriad of chassis designs using any of a myriad of materials and / or the like suitable for positioning the various components of multi-sensor imaging device 200 for operation. In at least one exemplary context, device chassis 210 may be embodied as a handheld device chassis, a wearable chassis, or the like.

[0085] Multi-sensor imager 200 includes multi-sensor imaging engine 100, as described above with respect to FIG. 1B. Multi-sensor imager 200 further includes processor 202. Processor 202 (and / or any other co-processors and / or processing circuitry supporting and / or otherwise associated with processor 202) may provide processing functionality for multi-sensor imager 200. In this regard, processor 202 may be embodied in any one of a myriad of ways, as discussed with respect to controller 20 of FIG. 1A.

[0086] In some exemplary embodiments, processor 202 is configured to provide functionality for operating one or more components of multi-sensor imaging device 200. For example, processor 202 may be configured to activate far-field illumination source 106B, near-field illumination source 106A, and / or aimer illumination source 110. Additionally or alternatively, in some embodiments, processor 202 is configured to activate near-field image sensor 102A and / or far-field image sensor 102B to expose the corresponding image sensor and / or read captured data to generate an image based on the data captured during the exposure. Additionally or alternatively, in some embodiments, processor 202 is configured to process the captured image, for example, based on one or more image processing tasks. In one such exemplary context, processor 202 is configured to attempt to detect and decode visual indicia, such as 1D and / or 2D barcodes, from the captured image. In this regard, processor 202 may be configured to utilize visual indicia analysis algorithms and / or visual indicia decoding algorithms to provide such functionality.

[0087] Additionally or alternatively, optionally, in some embodiments, multi-sensor imaging device 200 further includes initiating component 206. Initiating component 206 may be embodied in a myriad of ways, as discussed with respect to initiating component 60 of FIG. 1A.

[0088] Additionally or alternatively, optionally, in some embodiments, imaging device 200 further includes display 208. Display 208 may be embodied by an LCD, LED, and / or other screen device configured for data provided by one or more components of device 200. For example, in some embodiments, display 208 is configured to render a user interface including text, images, control elements, and / or other data provided by processor 202 for rendering. In some embodiments, for example, display 208 is an LCD and / or LED monitor integrated with the surface of device chassis 210 and visible to an operator. The display 208 may be embodied by an initiating component 206 to, for example, provide information decoded from a barcode and / or associated with such information decoded from the barcode. In one or more embodiments, the display 208 may be configured to receive a user engagement and / or may send one or more corresponding signals to the processor 202 to trigger a function based on the user engagement. In some such embodiments, the display 208 provides a user interface function that embodies the initiating component 206 to, for example, allow an operator to initiate and / or terminate a scan function via interaction with the user interface.

[0089] Additionally or alternatively, optionally, in some embodiments, the dual image capture device 200 further includes a memory 204. The memory 204 may provide storage functionality, for example, for storing data processed by the multi-sensor image capture device 200 and / or instructions for providing the functionality described herein. In some embodiments, the processor 202 may communicate with the memory 204 via a bus to pass information between device components and / or to retrieve instructions for execution. The memory 204 may be embodied in a myriad of ways, as discussed with reference to the controller 20 of FIG. 1A . The memory 204 may be configured to store information, data, content, applications, instructions, etc., to enable the image capture device 200 to perform various functions according to exemplary embodiments. In some embodiments, the memory 204 includes computer-coded instructions for execution by the processor 202, for example, to perform functions described herein and / or in conjunction with hard-coded functions executed via the processor 202. For example, if processor 202 is embodied as an execution body of software instructions, the instructions, when executed, may specifically configure processor 202 to perform the algorithms and / or operations described herein. Non-limiting, exemplary implementations of multi-sensor imaging engine 100 and multi-sensor imager 200 are described in patent application Ser. No. 16 / 684,124, filed Nov. 14, 2019, entitled "INTEGRATED ILLUMINATION-AIMER IMAGING APPARATUSES," the contents of which are incorporated herein by reference in their entirety. It should be understood that one or more of such components may be configurable to provide illumination synchronization, as described herein.

[0090] In some exemplary embodiments of the present disclosure, the processor 202 and the memory 204 may together be embodied as an imaging controller or an illumination controller, and thus may be fixedly or removably coupled to the imaging device 200, or may be partially or completely external to the imaging device 200. In some embodiments, the imaging controller may be embodied as an integrated circuit operably coupled to the imaging device 200.

[0091] Figure 3 shows a visualization of the fields of view that can be captured by an exemplary multi-sensor imager. For example, as shown in Figure 3, Figure 3 shows near field 302 and far field 304 that can be captured by multi-sensor imager 200. As shown, near field 302 is wider than the far field, such that more of the environment can be captured within near field 302 than far field 304.

[0092] Further, as shown, the far field 304 extends further than the near field 302. In this regard, the narrow nature of the far field 304 may enable capture of a more detailed representation of a particular portion of an environment as compared to the near field 302. In some embodiments, the near field 302 and the far field 304 may be captured by corresponding near-field image sensors and corresponding far-field image sensors of the multi-sensor imager 200. The near field 302 may be associated with a near focus range at a particular distance from the corresponding image sensor in the multi-sensor imager 200. Additionally or alternatively, the far field 304 may be associated with a far focus range at another distance from the corresponding image sensor in the multi-sensor imager 200. In this regard, the near field focus range may be associated with a far-field image range at a different distance from the corresponding image sensor in the multi-sensor imager 200. Additionally, when captured via the image sensor, objects from the multi-sensor imaging device 200 may be closer than the far-field focal range so as to be in better focus and allow for an extended range compared to a near-field image sensor.

[0093] Multi-sensor imager 200 may be configured to provide illumination specifically to illuminate each of fields of view 302 and 304. In this regard, the illumination source may be specifically designed to match the field of view of the corresponding image sensor such that the illumination adequately illuminates the corresponding field of view without overfill or underfill. Utilizing a separate illumination source to generate illumination and capture in a non-corresponding image sensor during illumination may result in overfill (e.g., when capturing using a far-field image sensor during a near-field illumination pulse) and / or underfill (e.g., when capturing using a near-field image sensor during a far-field illumination pulse), which may affect the quality of the data in the captured image due to too much illumination and / or, as described, not enough illumination. For example, FIG. 4 illustrates a visualization of near-field illumination generated by a multi-sensor imager, such as multi-sensor imager 200, in accordance with an exemplary embodiment of the present disclosure. In this regard, near-field illumination 402 may be generated to substantially or entirely illuminate near field 302. Near-field illumination 402 may be generated according to an illumination pattern that sufficiently illuminates the entire near field 302 for capture.

[0094] FIG. 5 illustrates a visualization of far-field illumination generated by an exemplary multi-sensor imaging device, such as multi-sensor imaging device 200, in accordance with an exemplary embodiment of the present disclosure. In this regard, far-field illumination 404 may be generated to substantially or entirely illuminate far-field 304. Far-field illumination 504 may be generated according to an illumination pattern that sufficiently illuminates the entire far-field 304 for capture by a corresponding far-field image sensor. Far-field illumination 504 may also illuminate only a certain percentage of near-field 302, such as a central percentage (e.g., 25%, 50%, etc.) of near-field 302. In this regard, activation of far-field illumination can be problematic for capturing sufficient images of certain visual landmarks, such as those that extend beyond the boundaries of far-field 304, at certain distances. Therefore, utilizing an appropriate illuminator for each image sensor while minimizing flicker and minimizing operation time is desirable to increase the likelihood and efficiency of successful detection and decoding of visual landmarks.

[0095] FIG. 6 illustrates a timing diagram 600 associated with operational functions of an exemplary multi-sensor imaging system, according to an exemplary embodiment. The timing diagram 600 illustrates the timing of activation and deactivation of various components (e.g., near-field illumination source, near-field image sensor, far-field illumination source, far-field image sensor, focusing mechanism) of the multi-sensor imaging device 200. Several individual processes associated with the imaging system 10 / imaging device 200 are illustrated using pulses in the timing diagram 600 of FIG. 6. The vertical extension of a pulse in the timing diagram does not necessarily specify the amplitude of the pulse. According to some exemplary embodiments, each pulse in the timing diagram 600 may be defined by a length of activation time of the associated component / process, followed by a length of inactivation time of the associated component / process. Each pulse may have a corresponding period, which may be defined as the duration during which the amplitude of the pulse remains non-zero. The period of the pulse may be terminated by a start time instance (pulse start time) and an end time instance (pulse end time). As used herein, the term start time period of a pulse may refer to a time period of a threshold duration starting from a pulse start time, where the threshold duration may have a configurable value. In one example, the threshold duration may be zero, and thus the start time period of the period and the pulse start time may refer to the same instance in time. Similarly, the term end time period of a pulse refers to a time period of a threshold duration ending at a pulse end time, where the threshold duration may have a configurable value. In at least one example context, the threshold duration may be zero, and thus the end time period of the period and the pulse end time may refer to the same instance in time. In some example embodiments, the respective threshold durations are The temperature may be configurable according to one or more performance parameters of the controller 20 and / or the imaging engine 100.

[0096] As shown in timing diagram 600, some pulses associated with particular operations of particular components of imaging system 10 / imager 200 may be aligned in time, partially or completely overlapping, or non-overlapping with one or more other pulses associated with one or more operations of other components of imaging system 10 / imager 200. As one example, the start of near-field illumination pulse 602A is aligned in time with the start of pulse 604 associated with exposing the near-field image sensor (also referred to as near-field exposure pulse 604). As another example, near-field illumination pulse 602A may not overlap with pulse 606 associated with reading out the near-field image sensor (also referred to as near-field readout pulse 606). As another example, pulse 614A associated with exposing the far-field image sensor (also referred to as far-field exposure pulse 614A) overlaps with near-field readout pulse 606.

[0097] Executable instructions corresponding to the operations illustrated in timing diagram 600 may be utilized by an imaging system / imaging device to perform seamless execution of one or more imaging or image processing tasks. For example, activation of each image sensor may include two steps to capture a corresponding image: exposing the image sensor and reading out from the image sensor. In this regard, it should be understood that, for example, processor 202 may be configured to enable activation of various components based on the timing diagram. According to some exemplary embodiments, image sensors (102A, 102B) may be operated in a manner such that the exposure period of far-field image sensor 102B is aligned with or accommodated by the illumination pulse train of near-field illumination source 106A. Such modification of the illumination pulse train of near-field illumination source 106A to accommodate the exposure period of far-field image sensor 102B may be achieved by various methods, some examples of which are discussed with reference to FIGS. 8-10.

[0098] As shown, timing diagram 600 includes a near-field illumination pulse train 602 used by near-field illumination source 106A to generate near-field illumination. Near-field illumination pulse train 602 includes multiple illumination pulses, such as illumination pulses 602A, 602B, 602C, 602D, and 602E. Note that in its unmodified form, the near-field illumination pulses may include only illumination pulses similar to illumination pulse 602A generated at a particular fixed frequency. Additional illumination pulses similar to illumination pulses 602B-602E may be added by controller 20 or processor 202 to accommodate exposure period 614 of far-field image sensor 102B in near-field illumination pulse train 602 to mitigate illumination issues associated with multi-sensor imaging device 200 / system 10. In this regard, each near-field illumination pulse may be defined by a length of activation time (e.g., near-field illumination source 106A on time) followed by a length of deactivation time (e.g., near-field illumination source 106A off time). In an exemplary context, the multi-sensor imager 200 may be configured to periodically generate near-field illumination pulses 602A with an on-time of 1.5 milliseconds (“ms”) followed by an off-time of 14.5 ms. In this regard, each illumination pulse 602A may begin, last for 1.5 ms, and then end before another illumination pulse 602A begins after the lapse of 14.5 ms. To avoid occlusion, only one illumination pulse 602A is shown in the near-field illumination pulse train 602. However, in accordance with exemplary embodiments described herein, the unmodified form of the near-field illumination pulse train 602 may be contemplated to include multiple such illumination pulses 602A. The near-field illumination source 106A may generate additional illumination pulses 602B-602E in a similar manner as described above with the same or different on-times and off-times. Each of the illumination pulses 602A-602E may extend in the time domain for a duration referred to as an illumination period. In the above exemplary embodiment, for example, each illumination pulse 602A may have an illumination duration equal to 1.5 milliseconds. The light period may begin at a first time instance and end at a second time instance, where the first time instance may correspond to an illumination pulse start time of the illumination pulse and the second time instance may correspond to an illumination pulse end time of the illumination pulse.

[0099] In some exemplary embodiments, the near-field image sensor 102A and the far-field image sensor 102B may each be activated while near-field illumination is being generated. As shown, the near-field image sensor exposure pulse 604 may be perfectly or substantially aligned with the near-field illumination pulse 602A of the near-field illumination pulse train 602. That is, exposure of the near-field image sensor during the exposure period 604 may begin simultaneously with the start time period of the near-field illumination pulse 602A of the near-field illumination pulse train 602. In some exemplary embodiments, the end time period of the exposure period 604 may extend beyond the end time period of the near-field illumination pulse 602A of the near-field illumination pulse train 602. For example, as shown, the near-field image sensor exposure begins with the rising edge of the exposure pulse 604, which is aligned with the rising edge of the first near-field illumination pulse 602A. The exposure of the near-field image sensor 102A ends at a time instance beyond the falling edge of the first near-field illumination pulse 602A. In this regard, the near-field image sensor 102A is exposed during the entire (or nearly the entire) first near-field illumination pulse 602A, maximizing the likelihood of capturing sufficient data to enable successful completion of an imaging task such as barcode scanning.

[0100] It should be understood that in some embodiments, the illumination pulse can occur at any time during the exposure of the image sensor, provided that the image sensor is desired to be exposed during the illumination pulse. For example, in a situation where the near-field image sensor 102A is exposed during a near-field illumination pulse, the exposure can begin before the illumination pulse, or the illumination pulse can occur later during the exposure. As one such example, in a context where the near-field image sensor 102A is associated with an exposure time value of 4.5 ms and each near-field illumination pulse lasts 1.5 ms, the exposure of the near-field image sensor 102A can begin any time between the start of the illumination pulse and 3 ms before the illumination pulse start time, such that the entire illumination pulse occurs during the exposure. It should be understood that the specific timing can be different for any combination of differently configured image sensors and / or illumination sources.

[0101] As shown, near field image sensor 102A may then be read out at pulse 606 to generate and / or process a corresponding image (e.g., a first near field image) at pulse 608. Concurrent with the start of readout from near field image sensor 102A at pulse 606, exposure of far field sensor 102B may begin at pulse 614. Thereafter, with the end of exposure of far field sensor 102B at pulse 614, readout from the far field sensor may begin at pulse 616 to generate and / or process a corresponding image (e.g., a first far field image) at pulse 618.

[0102] It should be noted that in some exemplary embodiments, the start time period of the exposure period of pulse 614 may be perfectly or substantially aligned with the start time period of the readout period of pulse 606. Furthermore, the end time period of the exposure period of pulse 614 may be perfectly or substantially aligned with the start time period of the readout period of pulse 616.

[0103] The timing of the illumination pulses and the corresponding exposure, readout, and / or processing may be determined in any one of a myriad of ways. For example, in at least one exemplary embodiment, the timing for the activation of the illumination pulses and / or image sensor exposure may be pre-determined and / or hard-coded for execution by one or more associated processors. Additionally or alternatively, in some embodiments, the timing offset to the next illumination pulse may be determined by the pulse frequency of the generated illumination and / or the start time of the illumination pulse ( For example, the exposure of one or more image sensors may be appropriately timed based on a known and / or determinable current time, illumination pulse frequency, determined offset, and / or exposure time value of the image sensor to be exposed. For example, based on such data, the exposure of the image sensor may be triggered so that the image sensor remains exposed for the entire illumination pulse in some situations and / or remains fully or partially exposed between illumination pulses in other situations.

[0104] Each illumination source is utilized to illuminate a desired field of view for capture by a corresponding image sensor, increasing the likelihood of successful completion of an imaging task, such as barcode scanning.

[0105] FIG. 7 shows a flowchart illustrating an example operation of a process 700 for illumination control in a multi-imager environment according to an exemplary embodiment of the present disclosure. FIG. 7 is described in conjunction with the timing diagram 600 shown in FIG. 6. The process 700 may be implemented by the imaging system 10 or imaging device 200 described with reference to FIGS. 1A and 2. The process 700 includes, at 702, operating, by the controller 20 / processor 202, a first illumination source based on a first illumination pulse train. The first illumination source may correspond to a light source associated with a near-field sensor. As an example, the first illumination source may be the near-field illumination source 106A described with reference to FIGS. 1B-2. The first illumination source may illuminate a near-field of a near-field image sensor according to the first illumination pulse train. The first illumination pulse train may correspond to the near-field illumination pulse train 602 shown in the timing diagram of FIG. 6. In some exemplary embodiments, the first illumination pulse train may have a constant pulse frequency of approximately 60-90 Hz to produce short, bright pulses of illumination. In some sensitive applications, the pulse frequency may be set to a constant value above 90 Hz.

[0106] Process 700 further includes, at 704, determining, by controller 20 / processor 202, a first exposure period of the second image sensor. In some exemplary embodiments, the second image sensor may be far-field image sensor 102B, and thus the first exposure period may correspond to the exposure period of far-field sensor 102B. Illumination and exposure of the second image sensor may be controlled or triggered by a control or processing medium, such as controller 20 or processor 202. Thus, the first exposure period of the second image sensor may be pre-determined and / or hard-coded for execution by one or more associated processors. In some exemplary embodiments, the exposure period may be dynamically calculated based on one or more imaging parameters associated with the second image sensor.

[0107] Process 700 further includes, at 706, modifying, by the controller 20 / processor 202, one or more characteristics of the first illumination pulse train to accommodate the first exposure period of the second image sensor. By modifying one or more characteristics of the first illumination pulse train, such as the pulse frequency, process 700 provides an effective measure for inhibiting “illumination leakage” from the far-field image sensor to the near-field image sensor, and vice versa. Modifying one or more characteristics of the first illumination pulse train may be performed for the purpose of reducing illumination interference among the image sensors of the imaging system. Thus, one or more characteristics of the first illumination pulse train may be modified in a myriad of ways. In some exemplary embodiments, one or more additional illumination pulses may be added or inserted into the first illumination pulse train to avoid illumination interference with the exposure of the second image sensor, a detailed description of which is provided with reference to processes 706A and 706B of FIGS. 8 and 9, respectively. Additionally or alternatively, in some exemplary embodiments, the timing delay between a pair of temporally subsequent illumination pulses of the first illumination pulse train is increased to avoid illumination interference with the exposure of the second image sensor. 10, a detailed description of which is provided with reference to process 706C.

[0108] Process 700 includes, at 708, operating, by the controller 20 / processor 202, a first illumination source associated with the first image sensor based on the modified first illumination pulse train. Accordingly, the controller 20 / processor 202 controls subsequent activation of the near-field illumination source based on the modified near-field illumination pulse train. Thus, the exposure of the near-field image sensor is aligned with the illumination pulses of the modified near-field illumination pulse train to perform image capture by the near-field image sensor. Because the modified near-field illumination pulse train is generated taking into account the exposure period of the far-field image sensor, the possibility of illumination leakage between the two sensors is reduced, or in some cases eliminated. Process 700 thus provides an efficiency measure for operating a multi-sensor imaging system / apparatus. Accordingly, an apparatus performing or utilizing process 700 provides improved imaging and / or subsequent image processing tasks.

[0109] 8 shows a flowchart illustrating an example operation of a process 706A for modifying one or more characteristics of a first illumination pulse train to accommodate a first exposure period of a second image sensor of an example multi-sensor imaging system, in accordance with at least one example embodiment of the present disclosure. In some example embodiments, the process 706A may be triggered in scenarios where illumination synchronization along with flicker control or elimination is required.

[0110] Process 706A includes, at 802, determining, by the controller 20 / processor 202, a start time period and an end time period of a first exposure period of a second image sensor. As previously described, the second image sensor may be the far-field image sensor 102B. Accordingly, the controller 20 / processor 202 may determine the boundaries of the exposure period of the far-field image sensor. Further, as discussed with reference to step 704 of FIG. 7, the first exposure period of the second image sensor may be pre-determined and / or hard-coded for execution by one or more associated processors. In some exemplary embodiments, the exposure period may be dynamically calculated based on one or more imaging parameters associated with the second image sensor. The controller 20 / processor 202 may obtain data regarding the exposure period of the far-field image sensor from any of the sources described above and determine the start time period and the end time period of the exposure period.

[0111] At step 804, process 706A includes generating, by the controller 20 / processor 202, at least one additional illumination pulse of the first illumination pulse train of the first image sensor. The at least one additional illumination pulse may be generated for insertion into the first illumination pulse train. Accordingly, at 806, process 706A further includes, by the controller 20 / processor 202, inserting the at least one additional illumination pulse into the first illumination pulse train such that the start and / or end time periods of the illumination period of the at least one additional illumination pulse are aligned with the start and / or end time periods of the first exposure period of the second image sensor. That is, the at least one additional illumination pulse may be added or inserted into one or more “non-care regions” of the pulses corresponding to the exposure period of the second image sensor. A “non-care region” may correspond to a portion of the exposure period in which the object or a portion thereof is not captured. As discussed, the second image sensor may be a far-field image sensor, and in a typical scenario, the initial and terminal windows associated with pulses corresponding to the exposure period of the far-field image sensor may not be associated with capturing an object, since the object is typically captured within the center window of the exposure period of the far-field image sensor. Thus, in the examples illustrated herein, the initial and terminal windows of the exposure period may correspond to non-care regions. However, additionally or alternatively, any other portion of the exposure period may be included within the scope of the present disclosure. It is contemplated that the area may also be defined as a non-care area within the area.

[0112] As shown in FIG. 6, one or more additional illumination pulses 602B and 602E (shown by dotted lines) are generated and inserted into the near-field illumination pulse train 602 so that the start time period of the illumination period of illumination pulse 602B is aligned with the start time period of the far-field image sensor exposure period 614A, and the start time period of the illumination period of illumination pulse 602E is aligned with the start time period of the far-field image sensor exposure period 614B.

[0113] 9 shows a flowchart 706B illustrating exemplary operations of another process for modifying one or more characteristics of a first illumination pulse train to accommodate a first exposure period of a second image sensor of an exemplary multi-sensor imaging system, in accordance with at least one exemplary embodiment of the present disclosure. In some exemplary embodiments, process 706B may be triggered in scenarios where illumination synchronization is required along with flicker elimination.

[0114] Process 706B includes, at 902, determining, by the controller 20 / processor 202, an autofocus period for the second image sensor. During operation of the second image sensor for imaging in the far field, it is necessary for the image sensor to move to one of several focus positions. The shift from an initial position of the image sensor (and / or associated optics) to one of the focus positions occurs during the autofocus period. The autofocus period may be predefined and stored in the memory of the imaging engine, or may be dynamically calculated based on one or more imaging parameters. In either case, the controller 20 / processor 202 may obtain the autofocus period or calculate it in other ways.

[0115] At step 904, process 706B includes generating, by the controller 20 / processor 202, at least one additional illumination pulse for the first illumination pulse train of the first image sensor. The at least one additional illumination pulse may be generated for insertion into the first illumination pulse train. Accordingly, process 706B further includes, at 906, inserting, by the controller 20 / processor 202, the at least one additional illumination pulse into the first illumination pulse train such that illumination of the first image sensor corresponding to the at least one additional illumination pulse overlaps in time with an autofocus period of the second image sensor. That is, the at least one additional illumination pulse may be added or inserted into the first illumination pulse train at a position aligned with a period of motor movement of the second image sensor.

[0116] As shown in FIG. 6, one or more additional illumination pulses 602D (shown by thick dotted lines) are generated and inserted into the near-field illumination pulse train 602 so that the illumination period of the illumination pulses 602D overlaps with the autofocus motor movement pulse 610.

[0117] FIG. 10 illustrates a flowchart illustrating an example of the operation of another process 706C for modifying one or more characteristics of a first illumination pulse train to accommodate a first exposure period of a second image sensor of an exemplary multi-sensor imaging system, in accordance with at least one exemplary embodiment of the present disclosure. Process 706C includes, at 1002, determining, by controller 20 / processor 202, a start time period and an end time period of the first exposure period of the second image sensor. As previously discussed, the second image sensor may be far-field image sensor 102B. Accordingly, controller 20 / processor 202 may determine the boundaries (start time period and end time period) of the exposure period of the far-field image sensor. Furthermore, as discussed with reference to step 704 of FIG. 7, the first exposure period of the second image sensor may be pre-determined and / or hard-coded for execution by one or more associated processors. In some exemplary embodiments, the exposure period may be dynamically calculated based on one or more imaging parameters associated with the second image sensor. Controller 2 O / Processor 202 may obtain data regarding the exposure period of the far-field image sensor from any of the sources mentioned above and determine the start and end time periods of the exposure period.

[0118] Process 706C further includes, at 1004, determining, by the controller 20 / processor 202, a pair of temporally subsequent illumination pulses of the first illumination pulse train that are in closest temporal proximity to the first exposure period of the second image sensor. The controller 20 / processor 302 may determine a start time instance and an end time instance of the exposure period of the far-field image sensor. The controller 20 / processor 302 may map the determined start time instance and end time instance of the exposure period to the near-field illumination pulse train to determine a pair of temporally subsequent illumination pulses in the near-field illumination pulse train that are in closest temporal proximity to the determined start time instance and end time instance of the exposure period, respectively, on the time axis.

[0119] Process 706C further includes, at 1006, increasing, by the controller 20 / processor 202, the timing delay between a qualifying pair of temporally subsequent illumination pulses of the first illumination pulse train so that one of the start or end time periods of the first exposure period is aligned with a respective one of the start or end time periods of the increased timing delay. As shown in example timing diagram 1100 of FIG. 11, illumination pulse pair 1104, 1106 and illumination pulse pair 1108, 1110 of the near-field illumination pulse train may be selected as a qualifying pair of temporally subsequent illumination pulses that are closest to the start and end time instances of exposure period 1112. Accordingly, the controller 20 / processor 302 may increase the timing delay between the illumination pulses (1102-1110) so that the start and / or end time periods of exposure period 1112 are aligned with a respective one of the falling edge of illumination pulse 1104 and the rising edge of illumination pulse 1106, respectively. The falling edge of illumination pulse 1104 may be within a threshold delay of the start time period of exposure period 1112, and the rising edge of illumination pulse 1106 may be within another threshold delay of the end time period of exposure period 1112. Similar modifications to the other pulses in the exposure period may be made to align with the corresponding pair of illumination pulses. The duration between the rising edge of illumination pulse 1104 and the falling edge of illumination pulse 1106 defines the increased timing delay. Thus, as shown in the modified near-field illumination pulse train of FIG. 11 , the start and end time periods of the far-field image sensor exposure period 1112 are aligned with the start or end time periods of the increased timing delays, respectively.

[0120] 12A and 12B illustrate an exemplary workflow of a symbol decoding process performed by an exemplary multi-sensor imaging system in accordance with at least one exemplary embodiment of the present disclosure. In some exemplary embodiments, imaging system 10 and / or imaging device 200 may include or be part of an exemplary symbol reading device, such as a sign reader. Processes 1200A, 1200B, and 1200C, as illustrated in FIGS. 12A, 12B, and 12C, provide a symbol decoding method that includes various aspects of method 700. A symbol reader having multiple image sensors can mitigate problems resulting from flicker and illumination leakage when implementing processes 1200A, 1200B, and 1200C, and thus provide error-free or reduced-error capture of an image of a symbol. This results in faster and more efficient decoding of the symbol. Further advantages of the workflow will become apparent through the following disclosure of the workflow.

[0121] Some or all of the steps of processes 1200A, 1200B, and 1200C may be performed by suitable data processing and control means. For example, in some exemplary embodiments, processes 1200A, 1200B, and 1200C may be performed by symbol reader. In some exemplary embodiments, the symbol reader controller may be embodied in a manner similar to that described with reference to controller 20 of imaging system 10.

[0122] Process 1200A is triggered upon receiving input from a user on initiating component 206 of imaging device 200. In response, process 1200A begins at 1202 by turning on an aimer as an indicator. As described with reference to FIG. 2, aimer illumination source 110 and aimer projection optics 112 may together generate an aimer as a desired pattern. Next, at 1204, process 1200A includes turning on near-field illumination. Near-field illumination may be generated in various ways, for example, as discussed previously in this disclosure. In some exemplary embodiments, near-field illumination is generated according to a near-field illumination pulse train having a fixed pulse frequency. Individual near-field illumination pulses may be of short duration, such as 1.5 ms.

[0123] Exposure of the near-field image sensor begins at 1206 substantially simultaneously with activation of the near-field illumination source. In some exemplary embodiments, the near-field image sensor may include a global shutter and have a large field of view. In some exemplary situations, the near-field image sensor may include a rolling shutter. Thereafter, at 1208, process 1200A may include transferring data from the near-field image sensor to capture a first near-field image. That is, charge may be read out to construct an image frame captured by the near-field image sensor.

[0124] Concurrent with step 1208, process 1200A includes initiating exposure of the far-field image sensor in the far field at 1210. In some exemplary embodiments, the far-field image sensor may include a rolling shutter and may have a narrow field of view compared to the near-field image sensor. After the far-field image sensor exposure period has elapsed, data transfer from the far-field image sensor may begin at 1212 to capture a first far-field image.

[0125] Upon capturing the first near-field image, process 1200A includes processing the first near-field image and beginning a first decoding run at 1214. The first near-field image is processed to obtain a distance estimate of the target symbol within the image. Toward this end, any suitable image processing-based distance estimation technique may be utilized (e.g., without limitation, using a parallax-based technique or a disparity in the sharpness of the images from the near-field image sensor and the far-field image sensor). For example, as a binary test, the decoding result of the first decoding run may determine whether the target symbol was successfully captured in the first near-field image. The distance estimation result may be used to determine whether the first far-field image is used to decode the symbol instead of the first near-field image. In an exemplary scenario in which the target symbol is located beyond the maximum imaging range of the near-field image sensor, the captured first near-field image frame may not show the target symbol with an acceptable level of brightness, luminance, contrast, etc. Therefore, near-field imaging may not be an appropriate means for decoding the symbol. In such cases, a far-field image sensor may be relied upon to attempt successful decoding.

[0126] At 1216, process 1200A includes determining whether the symbol was successfully decoded in the first decoding run. If the symbol was successfully decoded from the first near-field image, no processing of the first far-field image is required, and step control proceeds to step 1246 of FIG. 1200C, where the decoded symbol may be output by the symbol decoder. However, if the symbol was not successfully decoded by the symbol decoder at 1214, process 1200A includes moving the imaging engine, thereby moving the far-field image sensor, to a corresponding focus position at 1218. Moving to the corresponding focus position determines a particular focus position from the set of focuses based on the distance estimated at step 1214. The focus positions of the image sensor may be individually defined as discrete steps traversed by the focus motor of the imaging engine. Following the movement of the imaging engine at 1218, control of the steps proceeds to two parallel flows shown in process 1200B of FIG.

[0127] Process 1200B includes a first flow including steps 1220-1232 directed to processing and imaging using a far-field image sensor, and a second flow including steps 1234-1242 directed to imaging using a near-field image sensor. In some exemplary embodiments, the second flow including steps 1234-1242 may be skipped in one or more iterations of processes 1200A, 1200B, and 1200C.

[0128] Process 1200B includes processing a far-field image (in this case, the first far-field image) at 1220 to begin a second decoding run. The first far-field image may be processed to decode the target symbol while other parameters of the image are acquired through processing. The other parameters may be the brightness of the first far-field image, etc. These parameters may be used to determine one or more sensor parameters of the far-field image sensor to be adjusted. It is then determined at 1222 whether the symbol is successfully decoded in the second decoding run. If the check at 1222 is positive (yes), control of the step proceeds to step 1246 of FIG. 1200C, where the decoded symbol may be output by the symbol decoder. However, if the symbol is not successfully decoded by the symbol decoder at 1222, control proceeds to step 1224, where it is determined whether illumination in the far field is required. Such a determination may be made, for example, by any suitable image processing technique on the first far-field image. If it is determined that far-field illumination is required, the far-field illumination source may be turned on at 1226, and control may proceed to step 1228. However, if far-field illumination is not required, control may proceed directly to step 1228. At 1228, exposure of the far-field sensor begins, with or without illumination in the far field, as the case may be. Transfer of data from the far-field image sensor may then be completed at 1230 to obtain a second far-field image. The second far-field image may be processed at 1232, and a third decoding run is attempted. Control then proceeds to step 1244 of process 1200C shown in FIG. 7C.

[0129] In a parallel second flow of process 1200B, upon determining that the symbol cannot be successfully decoded by the symbol decoder, the near-field illumination pulses are modified at 1234 to accommodate one or more exposure periods of the far-field image sensor. Modification of the near-field illumination pulses may be achieved by modifying the near-field illumination pulse train in a myriad of ways, as discussed with reference to FIGS. 8-10 . Near-field illumination may then be initiated at 1236 according to the modified near-field illumination pulses, and the near-field image sensor may be exposed at 1238 in the near field. Illumination and exposure of the near-field image sensor after the illumination pulse modification may be achieved in a manner similar to that described in steps 1204 and 1206, respectively. At 1240, process 1200B includes initiating near-field image sensor data transfer to capture a second near-field image. At 1242, the second near-field image may be processed, and a fourth decoding run may be attempted by the symbol decoder. Control then passes to step 1244 of process 1200C shown in Figure 7C.

[0130] At 1244, it is determined whether a symbol is decoded in either one of the third decoding runs at 1232 or the fourth decoding run 1242. If the symbol decoder is able to successfully decode the target symbol from either the second far field image or the second near field image, control proceeds to 1246, where the decoded symbol is output by the symbol decoder. However, if at 1244 it is determined that the symbol is not successfully decoded by the symbol decoder, control proceeds to 1248, where any focus positions not yet visited are decoded. It is then determined whether any focus positions remain for the far-field image sensor for which far-field imaging has not yet been performed in any of the iterations. That is, process 1200C includes determining whether there are any focus positions for which far-field imaging has not yet been performed (i.e., all focus positions have been visited). If there are no such focus positions remaining for which far-field imaging has not yet been performed (i.e., all focus positions have been visited), it is concluded that the target symbol is outside the imaging range of the symbol decoder or that the target symbol is not in the imaged field of view. Thus, at 1250, an error message may be output indicating that the target symbol is not decodable by the symbol decoder. However, if it is determined at 1248 that one or more focus positions remain that have not yet been visited, control proceeds to 1252, where the imaging engine is moved to a corresponding position in the far field that has not yet been visited. The movement of the imaging engine may be performed in a manner similar to that described with reference to step 1218 of FIG. 12B. The movement to focus positions may be scheduled in ascending order (i.e., moving from closer to farther of the individual focus positions of the far-field image sensor). Control then returns to the two parallel flows of process 1200B at steps 1220 and 1234.

[0131] 12A-12C may be utilized to perform symbol decoding with suitable hardware, thereby significantly increasing the likelihood of successfully decoding target symbols from near-field and / or far-field images due to the improved focus selection control provided by modifying the near-field illumination pulses. Such improvements in the decoding process result in improved overall functionality of the symbol decoder device itself.

[0132] While the exemplary workflow illustrated in FIGS. 12A-12C has been described with an end application in mind as symbol decoding, it is contemplated within the scope of the present disclosure that other end application tasks utilizing dual or multiple image sensors (and thereby multiple illumination sources) may also be modified to benefit from the improved lighting control and synchronization framework provided herein. That is, the scope of the present disclosure should not be limited to symbol decoders alone, and suitable modifications may be made to extend the lighting control framework to similar end use cases, such as multi-camera-based mobile phones. In some exemplary contexts, the multi-image sensor device may be embodied as a smartphone having at least two cameras. The cameras may have the same or separate illumination sources associated with each of them. At least one camera in the smartphone may be considered a primary camera associated with image capture in bright, well-lit, and low-lit scenarios. The image quality of such cameras may be measured in megapixels (megapixels, The image quality may be directly related to the image quality (MP) of the smartphone, and in some exemplary embodiments, the primary camera may have 12, 24, 48, or 64 MP. One or more other cameras in the smartphone may be considered secondary cameras associated with one or more image enhancement features. For example, the smartphone may have a telephoto lens supporting an ultra-zoom option. In some exemplary embodiments, the telephoto lens may support a zoom factor ranging from 2x to 10x. In some more advanced embodiments, the smartphone may have an ultra-wide-angle lens to enhance the smartphone's field of view. Additionally or optionally, in some exemplary embodiments, the smartphone may include a depth sensor for measuring the depth of background objects relative to the primary object in the field of view. One or more cameras in a smartphone may have different lighting requirements to support the smartphone's universal imaging capabilities. For example, the primary camera may require an illumination flash for imaging in low-lit scenarios, while the smartphone's monochrome lens may demonstrate a spike in brightness during imaging in the same pulse. Thus, the resulting image may be impaired in terms of one or more imaging parameters.

[0133] The exemplary embodiments described herein are directed to the illumination of multiple cameras in a smartphone. The present invention helps alleviate the aforementioned problems by providing an effective solution aimed at synchronizing the exposures of one or more cameras. In particular, as shown in Figures 6-12C, the exposure of one or more cameras may be designed or adjusted to overlap or be outside the exposure of one or more other cameras, regardless of the requirements. The exemplary embodiments also provide an adaptive process for illumination synchronization, so that the proposed solution applies to a wide variety of imaging scenarios and situations.

[0134] In some exemplary embodiments, in a multi-imager environment, such as a multi-image sensor device, cycling between illumination sources (e.g., near-field and far-field illumination sources) during symbol reading / decoding can introduce a flickering effect to an operator of the multi-image sensor device. Therefore, the illumination control framework may also include one or more frameworks for flicker reduction. Figure 13 illustrates an exemplary workflow of a generalized flicker reduction process 1300 performed by an exemplary multi-sensor imaging system, in accordance with at least one exemplary embodiment of the present disclosure.

[0135] At 1302, process 1300 includes operating a first illumination source associated with the near-field sensor based on a first illumination pulse train. The first illumination source may be near-field illumination source 106A discussed with reference to FIG. 2. Thus, the first source illumination source may be operated according to a near-field illumination pulse train, such as near-field illumination pulse train 602 of FIG. 6 or the near-field illumination pulse train of FIG. 11. The first near-field illumination source may be configured to generate pulsed illumination in the near field of the imaging engine. Each individual pulse may be of short duration, such as 1.5 ms, and may be periodic or aperiodic with the other illumination pulses in the pulse train.

[0136] At 1304, process 1300 includes causing exposure of the near-field sensor during a first exposure period. The start time period of the first exposure period may be substantially or perfectly aligned with the start time period of the illumination period of the first illumination source. That is, exposure of the near-field image sensor may begin substantially simultaneously with activation of the first illumination source, as shown in timing diagram 1100 of FIG. 11. Exposure of the near-field image sensor may continue for a period that ends beyond the end of the illumination period of the first illumination source (i.e., beyond the activation period of the first illumination source).

[0137] At 1306, process 1300 includes causing exposure of the far-field sensor during a second exposure period that does not overlap with any illumination period of the first illumination source. For example, the far-field image sensor of imaging device 200 / imaging system 10 may be exposed during the second exposure period. The start and end time periods of the second exposure period of the far-field image sensor may be scheduled so as not to overlap with the illumination period of any illumination pulse in the near-field illumination pulse train. That is, exposure of the far-field image sensor may occur during a time period in which the first illumination source is turned off.

[0138] In this way, modifying the near-field illumination pulse train to accommodate the far-field exposure period ensures that illumination from the far-field illumination does not occur in the exposure of the near-field image sensor, and vice versa. Because the far-field image sensor is exposed only during periods when the near-field illumination source is off, there is no interference from the near-field illumination source in the exposure of the far-field image sensor. Such an arrangement also ensures that the illumination (near-field illumination and far-field illumination) is generated substantially sequentially (i.e., with no or very little time gap between near-field illumination activation and far-field illumination activation for consecutive pulses). Therefore, an operator cannot perceive noticeable flicker caused by dimming and brightening the illumination source.

[0139] In some exemplary embodiments, the target to be acquired is located at a significant distance from the imaging engine. The target may be located far away from the target. Therefore, target acquisition may be achieved using the far-field image sensor. Furthermore, such scenarios may extend to the far-field image sensor's farthest focus (shortest focus), requiring the longest exposure of the far-field image sensor, for example, if the far-field image sensor includes a rolling shutter. In such scenarios, keeping the far-field illumination source activated for extended periods of time may introduce several issues with the operation of the imaging engine, such as excessive heat caused by extended activation of the far-field illumination source. Therefore, in such scenarios, a framework may be desired that reduces the activation time of the far-field illumination source while ensuring that far-field imaging is not impaired. FIG. 14 illustrates an exemplary workflow of a flicker reduction process 1400, particularly for extended far-field exposures, performed by an exemplary multi-sensor imaging system, in accordance with at least one exemplary embodiment of the present disclosure.

[0140] Process 1400 includes operating a first illumination source associated with a near field sensor based on a first illumination pulse train, at 1402. Step 1402 may be performed in a manner similar to step 1302.

[0141] Process 1400 includes causing exposure of a near field sensor during a first exposure period, the start time period of the first exposure period being aligned with the start time period of an illumination period of a first illumination source, at 1402. Step 1402 may be performed in a manner similar to step 1304.

[0142] Process 1400 further includes, at 1406, causing exposure of the far-field sensor during a second exposure period, the second exposure period overlapping with at least one illumination period of the first illumination source. For example, the far-field image sensor of imaging device 200 / imaging system 10 may be exposed during the second exposure period. In some exemplary embodiments, the start or end time period of the second exposure period of the far-field image sensor may be scheduled such that the start or end time period of the second exposure period of the far-field image sensor is fully or substantially aligned with the start or end time period of an illumination period of the near-field illumination pulse train. For example, as shown in FIG. 6, the start time period of far-field exposure pulse 614A is aligned with illumination pulse 602B of near-field illumination pulse train 602.

[0143] In an exemplary context where the target to be captured is in the central region of the field of view of the far-field image sensor, to extend the exposure time of the far-field image sensor, the exposure can be modified to expose at most a small number of the top columns and bottom rows of the rolling shutter-based far-field image sensor while the near-field illumination source is activated. This minimizes reflections and light leakage / illumination spill into the outer top and bottom regions of the far-field image, and in this context ensures that a minimum-sized region in the central region of the far-field sensor's field of view does not receive illumination from the near-field illumination source, which would interfere with automatic gain control operation and general decoding. Therefore, the resulting captured image does not contain any adverse effects that may have been introduced by illumination spill from the near-field illumination source.

[0144] It is contemplated within the scope of the present disclosure that if the target to be captured is in an area other than the central area of the field of view of the far-field image sensor, the minimum size area may be configurable by an operator / administrator of the imaging engine, i.e., the minimum size area may be defined according to the location of the target to be captured in the field of view of the far-field image sensor.

[0145] In this manner, the exemplary embodiment of the flicker reduction process of FIG. 14 provides an effective reduction in flicker perceptible to an operator by ensuring overlap between the exposure period of the far-field image sensor and the illumination period of the near-field illumination source.

[0146] It will be understood that each block of the flowcharts shown above in Figures 7, 8, 9, 10, 12A, 12B, 12C, 13, and 14, and combinations of blocks within the flowcharts, can be implemented by various means, such as hardware, firmware, a processor, circuitry, and / or other communication devices associated with the execution of software including one or more computer program instructions. For example, one or more of the procedures described above may be embodied by computer program instructions. In this regard, computer program instructions embodying the procedures described above may be stored by a memory device of an apparatus employing embodiments of the present invention and executed by a processor within an imaging device / system. As will be understood, any such computer program instructions may be loaded onto a computer or other programmable apparatus (e.g., hardware) to generate a machine, with the resulting computer or other programmable apparatus implementing the functions specified in the flowchart blocks. These computer program instructions, which may direct a computer or other programmable apparatus to function in a particular manner, may also be stored in a computer-readable memory, with the instructions stored in the computer-readable memory generating a product whose execution implements the functions specified in the flowchart blocks. Computer program instructions may also be loaded into a computer or other programmable device to cause a sequence of operations to be performed on the computer or other programmable device to create a computer-implemented process, such that the instructions executing on the computer or other programmable device provide operations for implementing the functions specified in the flowchart blocks.

[0147] Thus, the blocks of the flowcharts represent combinations of means for performing the specified functions and combinations of operations for performing the specified functions to perform the specified functions / operations. It will also be understood that one or more blocks of the flowcharts, and combinations of blocks within the flowcharts, may be implemented by a dedicated hardware-based computer system that performs the specified functions, or a combination of dedicated hardware and computer instructions.

[0148] Although an exemplary processing system has been described above, implementations of the subject matter and functional operations described herein can be implemented in other types of digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed herein and their structural equivalents, or in combinations of one or more of them.

[0149] Embodiments of the subject matter and operations described herein can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed herein and their structural equivalents, or in a combination of one or more of them. Embodiments of the subject matter described herein can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a computer storage medium, for execution by or to control the operation of an information / data processing apparatus. Alternatively or additionally, the program instructions can be encoded on an artificially generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information / data for transmission to a suitable receiver apparatus for execution by the information / data processing apparatus. The computer storage medium can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them. Furthermore, while a computer storage medium is not a propagated signal, a computer storage medium can be a source or destination of computer program instructions encoded in an artificially generated propagated signal. A computer storage medium may also include one or more separate physical components or media (e.g., multiple CDs, disks, or other storage device).

[0150] The operations described herein may be implemented as operations performed by an information / data processing apparatus on information / data stored on one or more computer-readable storage devices or received from other sources.

[0151] The term "data processing apparatus" encompasses all kinds of apparatuses, devices, and machines for processing data, including, for example, a programmable processor, a computer, a system on a chip, or two or more of the foregoing or a combination of the foregoing. An apparatus may include special-purpose logic circuitry, such as an FPGA (field-programmable gate array) or an ASIC (application-specific integrated circuit). In addition to hardware, an apparatus may also include code that creates an execution environment for the computer program in question, such as code comprising processor firmware, a protocol stack, a repository management system, an operating system, a cross-platform runtime environment, a virtual machine, or one or more combinations thereof. The apparatus and execution environment may implement various computing model infrastructures, such as web services, distributed computing, and grid computing infrastructures.

[0152] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or information / data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple cooperating files (e.g., files storing one or more modules, subprograms, or portions of code).

[0153] The processes and logic flows described herein can be implemented by one or more programmable processors that execute one or more computer programs to perform actions by operating on input information / data and generating output. Processors suitable for executing computer programs include, for example, both general-purpose and special-purpose microprocessors, as well as any one or more processors of any type of digital computer. Generally, a processor receives instructions and information / data from a read-only memory or a random-access memory, or both. The essential elements of a computer are a processor for performing actions in accordance with the instructions and one or more memory devices for storing instructions and data. Generally, a computer also includes one or more mass storage devices, such as magnetic, magneto-optical, or optical disks, for storing data, or is operably coupled to receive information / data from, transmit information / data to, or both. However, a computer need not necessarily have such devices. Suitable devices for storing computer program instructions and information / data include all forms of non-volatile memory, media, and memory devices, including exemplary semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices, magnetic disks, e.g., internal hard disks or removable disks, magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and memory can be supplemented by, or incorporated in, special purpose logic circuitry.

[0154] To provide for interaction with a user, embodiments of the subject matter described herein can be implemented on a computer that has a display device, e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information / data to the user, as well as a keyboard and pointing device, e.g., a mouse or trackball, by which the user can provide input to the computer. Other types of devices can also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback, and input from the user can be received in any form, including acoustic, speech, or tactile input. Additionally, a computer can interact with a user by sending and receiving documents to a device used by the user, e.g., by sending a web page to a web browser on the user's client device in response to a request received from the web browser.

[0155] While this specification contains many specific implementation details, these should not be construed as limiting the scope of any disclosure or what may be claimed, but rather as descriptions of features specific to particular embodiments of a particular disclosure. Certain features described herein in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments separately or in any suitable subcombination. Furthermore, even if features are described above as acting in a particular combination and initially claimed as such, one or more features from a claimed combination may, in some cases, be deleted from the combination, and the claimed combination may be directed to a subcombination or variations of the subcombination.

[0156] Similarly, although operations are shown in a particular order in the figures, this should not be understood as requiring such operations to be performed in the particular order or sequence shown, or to perform all of the operations shown, to achieve desirable results. In certain situations, multitasking and parallel processing may be advantageous. Furthermore, the separation of various system components in the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the program components and systems described may generally be integrated into a single software product or packaged into multiple software products.

[0157] Thus, specific embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.

Claims

1. 1. An imaging system, comprising: a first illumination source associated with the first image sensor, the first illumination source configured to operate based on a first illumination pulse train; a second image sensor; and a controller communicatively coupled to the first illumination source, the first image sensor, and the second image sensor, the controller: determining a first exposure period of the second image sensor; modifying one or more characteristics of the first illumination pulse train to accommodate the first exposure period of the second image sensor.

2. 2. The imaging system of claim 1, wherein the controller is further configured to insert at least one additional illumination pulse into the first illumination pulse train to modify the one or more characteristics of the first illumination pulse train such that one of a start time period or an end time period of an illumination period of the at least one additional illumination pulse is aligned with a respective one of a start time period or an end time period of the first exposure period of the second image sensor.

3. 2. The imaging system of claim 1, wherein the controller is further configured to insert at least one additional illumination pulse into the first illumination pulse train to modify the one or more characteristics of the first illumination pulse train such that illumination of the first image sensor corresponding to the at least one additional illumination pulse overlaps in time with an autofocus period of the second image sensor.

Images