Electronic devices with optical identification sensor

IN595721BActive Publication Date: 2026-07-16APPLE INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
IN202214045411
Authority / Receiving Office
IN · IN
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-09-08
Filing Date
2022-08-09
Publication Date
2026-07-16
Estimated Expiration
2042-08-09

AI Technical Summary

Technical Problem

Designing light-based sensors for electronic devices to accurately identify external items attached to them, such as removable straps or cases, is challenging due to the need for precise color-coded tag recognition at close distances and potential occlusion or damage sensitivity.

Method used

An optical identification sensor with a light source, an array of photodetectors, and a field-of-view restriction filter, which includes multiple emitters of different wavelengths and a diffusing layer, allows for accurate reading of color-coded tags by establishing a narrow field of view and combining images to determine unique identifiers.

Benefits of technology

Enables reliable identification of external items with color-coded tags at short distances, improving occlusion and damage insensitivity, and reducing sensor height and cost compared to conventional camera-based systems.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

ABSTRACT ELECTRONIC DEVICES WITH OPTICAL IDENTIFICATION SENSOR An electronic device may be attached to an external item. The electronic device may include an optical identification sensor configured to sense a color5 encoded tag in the external item when the item is attached to the device. The optical identification sensor may include a board layer, a protective filter layer, wall structures for supporting the protective filter layer on the board layer, a linear array of photodetectors disposed between the board layer and the protective filter layer, a field-of-view restriction filter interposed between the photodetectors and 10 the protective filter layer, and a light source having multiple emitters for illuminating the color-encoded tag. The emitters may be activated sequentially to produce multiple images that are combined to reconstruct an accurate reading of the color-encoded tag, which can then be used to identify the type of external item currently attached to the electronic device.
Need to check novelty before this filing date? Find Prior Art

Description

Field

[0001] This relates generally to electronic devices, and, more particularly, toelectronic devices with sensors.Background

[0002] Electronic devices often include components that have sensors. Forexample, earbuds, cellular telephones, wristwatches, and other portable devicessometimes have light-based components.

[0003] A user may decide to mate these electronic devices to one or more items.In one scenario, a removable strap can be attached to a wristwatch. In anotherscenario, a removable case can be attached to a cellular telephone. It can bechallenging to design light-based sensors that can properly identify the type ofsuch items when they are attached to an electronic device.Summary

[0004] An electronic device may be attached to or mated with an external item.The external item may be provided with a passive identification tag such as acolor-coded tag having a linear array of color blocks. The electronic device mayhave a housing, a display in the housing, and an optical identification sensor forsensing the color-coded tag within the external item to determine a uniqueidentifier for that item.

[0005] In accordance with some embodiments, the optical identification sensorcan include a light source configured to emit light that illuminates the externalitem, an array of photodetectors configured to receive the light reflecting backfrom the external item through a portion of the housing, and a field-of-viewrestriction filter configured to establish a field of view for each photodetector inthe array of photodetectors as the photodetectors receive the light reflecting backfrom the external object through the field-of-view restriction filter. The field-of-view restriction filter can be an opaque layer having multiple through holes. Eachof the through holes can have a diameter and a height that is greater than thediameter. The field of view of the field-of-view restriction filter can have a field-of-view angle that is less than 10°. The optical identification sensor can include apresence sensor configured to detect when the external item is attached to theelectronic device. The optical identification sensor and the external object can beseparated by a distance that is less than 5 millimeters when the external object isattached to the electronic device. The light source can include a first emitterconfigured to emit light in a first range of wavelengths, a second emitterconfigured to emit light in a second range of wavelengths different than the firstrange of wavelengths, and a third emitter configured to emit light in a third rangeof wavelengths different than the first and second ranges of wavelengths. Theoptical identification sensor can further include a light diffusing layer disposedover the first, second, and third emitters.

[0006] In accordance with some embodiments, the optical identification sensorcan include: a light source configured to emit light, through a portion of thehousing, for illuminating the color-coded tag in the external item; a field-of-viewrestriction filter; and a linear array of photodetectors configured to receive thelight reflecting back from the color-coded tag in the external item through theportion of the housing and through the field-of-view restriction filter. The lightsource can include multiple emitters of different wavelengths. The electronicdevice can include control circuitry configured to sequentially activate theemitters to acquire corresponding images using the photodetectors. The opticalidentification sensor can further include a light scattering layer over the emitters.The control circuitry can further be configured to combine the images to detectedges of each of the color blocks, identify a location for each of the color blocks,determine a dominant color for each of the color blocks, and output a uniqueidentifier for the external item based on the dominant color of each of the colorblocks.

[0007] In accordance with some embodiments, the optical identification sensorcan be a lensless optical identification assembly having a light source configuredto emit light that illuminates the external item mated with the electronic device, anangular filter having openings, and an array of photodetectors configured toreceive the light reflecting back from the external item through the openings ofthe angular filter but without passing through a lens. The light source can includemultiple emitters that are sequentially activated to acquire corresponding imagesusing the array of photodetectors. The lensless optical identification assembly canfurther include a diffusive light pipe over the emitters.Brief Description of the Drawings

[0008] FIG. 1 is a schematic diagram of an illustrative electronic device and anexternal item that can be removably attached to the electronic device inaccordance with some embodiments.

[0009] FIG. 2 is a side view of an illustrative wristwatch and a removable strapin accordance with some embodiments.

[0010] FIG. 3 is a side view of an illustrative electronic device and a removablecase in accordance with some embodiments.

[0011] FIG. 4 is a cross-sectional side view of an illustrative electronic devicehaving an optical identification sensor configured to identify an external item witha color-coded tag in accordance with some embodiments.

[0012] FIG. 5 is an exploded perspective view of an illustrative opticalidentification sensor in accordance with some embodiments.

[0013] FIG. 6 is a cross-sectional side view showing an illustrative opticalidentification sensor having a light source configured to illuminate a color-codedtag in an external item in accordance with some embodiments.

[0014] FIG. 7 is a cross-sectional side view showing an illustrative opticalidentification sensor having a light source configured to illuminate, using a lightdiffuser, a color-coded tag in an external item in accordance with someembodiments.

[0015] FIG. 8 is a cross-sectional side view showing more details of anillustrative optical identification sensor in accordance with some embodiments.

[0016] FIG. 9 is a cross-sectional side view illustrating how a field-of-viewrestriction filter establishes a field of view for an underlying photodetector inaccordance with some embodiments.

[0017] FIG. 10 is a top (plan) view of an illustrative field-of-view restrictionfilter in accordance with some embodiments.

[0018] FIG. 11 is a flow chart of illustrative steps for operating an opticalidentification sensor in an electronic device to identify an external item inaccordance with some embodiments.Detailed Description

[0019] Electronic devices may be provided with light-based components. Thelight-based components may include, for example, light-based (optical) sensors.An optical sensor may have a light source with separately addressable lightemitting elements and may have an array of photodetectors for sensing light fromthe light source reflecting back from an external item that has been mated with anelectronic device. The optical sensor is a lensless sensor having a narrow field-of-view filter for creating a 1:1 scale image of a color-coded tag in the external itemon the array of photodetectors. Unlike typical camera (lens) based sensors, anoptical sensor configured in this way can be used to accurately read the colorcoded tag in the external item at shorter distances and can be made thinner withless cost.

[0020] A schematic diagram of an illustrative electronic device having a displayis shown in FIG. 1. Device 10 may be a cellular telephone, tablet computer,laptop computer, wristwatch device or other wearable device, a television, astand-alone computer display or other monitor, a computer display with anembedded computer (e.g., a desktop computer), a system embedded in a vehicle,kiosk, or other embedded electronic device, a media player, or other electronicequipment. Configurations in which device 10 is a wristwatch, cellular telephone,or other portable electronic device may sometimes be described herein as anexample. This is illustrative. Device 10 may, in general, be any suitableelectronic device with a display.

[0021] Device 10 may include control circuitry 20. Control circuitry 20 mayinclude storage and processing circuitry for supporting the operation of device 10.The storage and processing circuitry may include storage such as nonvolatilememory (e.g., flash memory or other electrically-programmable-read-onlymemory configured to form a solid state drive), volatile memory (e.g., static ordynamic random-access-memory), etc. Processing circuitry in control circuitry 20may be used to gather input from sensors and other input devices and may be usedto control output devices. The processing circuitry may be based on one or moremicroprocessors, microcontrollers, digital signal processors, baseband processorsand other wireless communications circuits, power management units, audiochips, application specific integrated circuits, etc. During operation, controlcircuitry 20 may use a display and other output devices in providing a user withvisual output and other output.

[0022] To support communications between device 10 and external equipment,control circuitry 20 may communicate using communications circuitry 22.Circuitry 22 may include antennas, radio-frequency transceiver circuitry (wirelesstransceiver circuitry), and other wireless communications circuitry and / or wiredcommunications circuitry. Circuitry 22, which may sometimes be referred to ascontrol circuitry and / or control and communications circuitry, may supportbidirectional wireless communications between device 10 and external equipmentover a wireless link (e.g., circuitry 22 may include radio-frequency transceivercircuitry such as wireless local area network transceiver circuitry configured tosupport communications over a wireless local area network link, near-fieldcommunications transceiver circuitry configured to support communications overa near-field communications link, cellular telephone transceiver circuitryconfigured to support communications over a cellular telephone link, ortransceiver circuitry configured to support communications over any othersuitable wired or wireless communications link). Wireless communications may,for example, be supported over a Bluetooth link, a WiFi link, a wireless linkoperating at a frequency between 10 GHz and 400 GHz, a 60 GHz link, or othermillimeter wave link, a cellular telephone link, or other wireless communicationslink. Device 10 may, if desired, include power circuits for transmitting and / orreceiving wired and / or wireless power and may include batteries or other energystorage devices. For example, device 10 may include a coil and rectifier toreceive wireless power that is provided to circuitry in device 10.

[0023] Device 10 may include input-output devices such as devices 24.Inputoutput devices 24 may be used in gathering user input, in gathering informationon the environment surrounding the user, and / or in providing a user with output.Devices 24 may include one or more displays such as display 14. Display 14 maybe an organic light-emitting diode display, a liquid crystal display, anelectrophoretic display, an electrowetting display, a plasma display, amicroelectromechanical systems display, a display having a pixel array formedfrom crystalline semiconductor light-emitting diode dies (sometimes referred to asmicroLEDs), and / or other display. Configurations in which display 14 is anorganic light-emitting diode display or microLED display are sometimesdescribed herein as an example.

[0024] Display 14 may have an array of pixels configured to display images fora user. The pixels may be formed on display panels formed from rigid and / orflexible display panel substrates. One or more additional substrates, which maysometimes be referred to as interconnect substrates, may include interconnects(signal paths) for distributing power and other signals to the display panel(s). Inan illustrative configuration, one or more display panels may be mounted to aflexible interconnect substrate so that display panel contacts mate withcorresponding interconnect substrate contacts, thereby electrically connecting theinterconnects of the display panel(s) to the interconnects of the interconnectsubstrate. The flexibility of the interconnect substrate allows the interconnectsubstrate to conform to curved display surfaces.

[0025] Sensors 16 in input-output devices 24 may include force sensors (e.g.,strain gauges, capacitive force sensors, resistive force sensors, etc.), audio sensorssuch as microphones, touch and / or proximity sensors such as capacitive sensors(e.g., a two-dimensional capacitive touch sensor integrated into display 14, a twodimensional capacitive touch sensor overlapping display 14, and / or a touch sensorthat forms a button, trackpad, or other input device not associated with a display),and other sensors. If desired, sensors 16 may include optical sensors such asoptical sensors that emit and detect light, ultrasonic sensors, optical touch sensors,optical proximity sensors, and / or other touch sensors and / or proximity sensors,monochromatic and color ambient light sensors, image sensors, fingerprintsensors, temperature sensors, sensors for measuring three-dimensional noncontact gestures ("air gestures"), pressure sensors, sensors for detecting position,orientation, and / or motion (e.g., accelerometers, magnetic sensors such ascompass sensors, gyroscopes, and / or inertial measurement units that contain someor all of these sensors), health sensors, radio-frequency sensors, depth sensors(e.g., structured light sensors and / or depth sensors based on stereo imagingdevices that capture three-dimensional images), optical sensors such as selfmixing sensors and light detection and ranging (lidar) sensors that gather time-of-flight measurements, humidity sensors, moisture sensors, gaze tracking sensors,and / or other sensors.

[0026] In some arrangements, device 10 may use sensors 16 and / or other inputoutput devices to gather user input. For example, buttons may be used to gatherbutton press input, touch sensors overlapping displays can be used for gatheringuser touch screen input, touch pads may be used in gathering touch input,microphones may be used for gathering audio input, accelerometers may be usedin monitoring when a finger contacts an input surface and may therefore be usedto gather finger press input, etc.

[0027] If desired, electronic device 10 may include additional components (see,e.g., other devices 18 in input-output devices 24). The additional componentsmay include haptic output devices, audio output devices such as speakers, lightemitting diodes for status indicators, light sources such as light-emitting diodesthat illuminate portions of a housing and / or display structure, other optical outputdevices, and / or other circuitry for gathering input and / or providing output.Device 10 may also include a battery or other energy storage device, connectorports for supporting wired communication with ancillary equipment and forreceiving wired power, and other circuitry.

[0028] As shown in FIG. 1, electronic device 10 may be brought into contact ormated with an external item such as item 30. In certain embodiments, it may bedesirable for electronic device 10 to identify a type of item 30 that has beenattached to device 10. Item 30 may include an identification tag such as tag 30that can be detected using one or more sensors 16 within device 10. Identificationtag 30 may be a code tag such as a color-coded (color-encoded) tag or otherpassive identification tag. In contrast to conventional monochrome (black-and-white only) barcodes, the use of a color tag 30 encodes information in differentwavelengths and enables reading the encoded information using discretewavelength illumination. Reading an identification tag in this way can provideimproved occlusion insensitivity (e.g., for when a portion of tag 30 is blocked bydust or other interfering particles) and improved damage insensitivity (e.g., forwhen a portion of tag 30 has been scratched off, has some manufacturing defect,or has otherwise been damaged).

[0029] In one embodiment, electronic device 10 may include an optical sensor16 configured to sense color-coded tag 32 when external item 30 has been broughtinto close proximity with device 10. In the mated state, optical sensor 16 ofelectronic device 10 and tag 32 of external item 30 may be separated by a distanceD. Distance D may be equal to 1 mm, 2 mm, 3 mm, 0.5-3 mm, less than 0.5 mm,less than 1 mm, less than 2 mm, less than 3 mm, less than 4 mm, less than 5 mm,1-10 mm, etc. Optical sensor 16 has to be capable of sensing tag 30 at such shortdistances.

[0030] FIG. 2 illustrates one suitable embodiment where electronic device 10 isa wristwatch configured to be worn on a wrist of a user. As shown in FIG. 2,wristwatch 10 may be removably coupled to a band such as band (external item)30. Band 30, which may sometimes be referred to as a strap, wrist strap, watchstrap, wrist band, or watch band, may be used to secure the wristwatch device 10to the wrist of a user. Wristwatch 10 may include an optical sensor 16 configuredto identify band 30 by sensing identification tag 32 when band 30 is brought intoclose proximity with wristwatch 10. By sensing identification tag 32, wristwatch10 can determine a unique identifier indicative of the type of wrist band, the colorof the wrist band, the material of the wrist band, etc. Optical sensor 16 of thistype is therefore sometimes referred to as an optical identification sensor.

[0031] FIG. 3 illustrates another suitable embodiment in which electronic device10 is a cellular telephone. As shown in FIG. 3, cellular telephone 10 may beremovably inserted into a case such as case (external item) 30. Case 30, whichmay have a recess R configured to receive device 10, can be used to provideprotection and / or can be used to charge device 10 (e.g., in the scenario which case30 is a battery case). Cellular telephone 10 may include an optical sensor 16configured to identify case 30 by sensing identification tag 32 when case 30 isbrought into close proximity with cellular telephone 10. By sensing identificationtag 32, cellular telephone 10 can determine a unique identifier indicative of thetype of case, the color of the color, the material of the case, etc. Optical sensor 16of this type is therefore sometimes referred to as an optical identification sensor.

[0032] The examples of FIG. 2 and 3 in which electronic device 10 is awristwatch or a cellular telephone and in which external item 30 is a wrist band ora case is merely illustrative. In general, electronic device 10 can be any portableelectronic device or computer and item 30 can be any external item or accessorythat can be mated to or removably attached to device 10.

[0033] FIG. 4 is a cross-sectional side view showing item 30 that has beenbrought into close proximity with electronic device 10. As shown in FIG. 4, item30 has a housing (enclosure) 40 and identification tag 32 disposed within house40. Identification (ID) tag 32 may be a code tag such as a color-coded (color10encoded) tag or other passive identification marker or badge. Illustrativeconfigurations in which tag 32 is a color-encoded tag are sometimes describedherein as an example.

[0034] Color-coded tag 32 may include an array of color blocks such as blocks32B printed on a substrate such as a reflective or diffused substrate. The substratecan be a sheet of polymer (as an example). Each color block 32B may includeone or more pigments responsive to different wavelengths ink printed onto the tagsubstrate. For example, the pigments can be color pigments that reflectwavelengths in the visible spectrum (e.g., from about 400 nm to 700 nm) orinfrared pigments that reflect wavelengths in the near infrared spectrum (e.g.,around 740-1100 nm).

[0035] In the example of FIG. 4, tag 32 may include some combination of colorblocks 32B such as red (R) blocks, blue (B) blocks, green (G) blocks, red-blue(RB) blocks, red-green (RG) blocks, and / or blue-green (BG) blocks. Eachpermutation of these six colors represents a unique color identifier code. Anexemplary tag 32 having 10 color blocks (as shown in FIG. 4) can encode up toaround 60 million (i.e., 6^10) unique identifier codes. This is merely illustrative.In another example where tag 32 has nine color blocks each of which can be oneof six possible colors (e.g., R, G, B, RB, RG, or BG), such tag can encode up toaround 10 million (i.e., 6^9) unique identifier codes. In general, tag 32 shouldinclude a sufficient number of color blocks with pigments to encode at least ahundred thousand codes, at least a million codes, at least ten million codes, etc.

[0036] If desired, some color blocks may be white blocks (i.e., blocks thatreflect all visible wavelengths) or black blocks (i.e., blocks that reflect none of thevisible wavelengths). The codes can optionally include error correction featuressuch as checksum information, cyclic redundancy checking (CRC) information,and error correcting code (ECC) information at the expense of address space. Tag32 configured in this way can be manufactured with relatively low cost whileencoding a high density code that is insensitive to occlusion, scratch, andmisalignment. In another suitable embodiment, tag 32 may include somecombination of color blocks 32B such as cyan (C) blocks, magenta (M) blocks,yellow (Y) blocks, cyan-magenta (CM) blocks, cyan-yellow (CY) blocks, and / ormagenta-yellow (MY) blocks.

[0037] Color-coded tag 32 may be disposed behind a portion of housing 40 suchas behind a protective color layer 42. Protective cover layer 42 may be tintedblack or with other opaque color and may be otherwise patterned to cosmeticallyobfuscate tag 32 so tag 32 is hidden from the user's view. Protective cover layer42 may be formed from glass, sapphire, polymers, and / or other transmissive layerthat is sufficiently transparent to the wavelengths associated with the pigmentsprinted on tag 32.

[0038] Referring still to FIG. 4, device 10 may include a housing (enclosure) 12and an optical identification sensor 16 disposed within housing 12. Opticalidentification sensor 16 may be configured to sense color-coded tag 32 when item30 is brought into close proximity with device 10. For example, when item 30 ismated with or attached to device 10, optical identification sensor 16 and tag 32may only be separated by less than 1 mm, less than 2 mm, less than 3 mm, lessthan 4 mm, less than 5 mm, 1-4 mm, 1-10mm, etc. Optical identification sensor16 may be disposed behind a portion of housing 12 such as behind an aperturewindow 50. Aperture window 50 may be tinted black or with other opaque colorand may be otherwise patterned to cosmetically obfuscate any underlyingcomponent (e.g., so that optical identification sensor 16 is hidden from the user'sview). Window layer 50 may be formed from glass, sapphire, polymers, and / orother transmissive layer that is at least partially or sufficiently transparent to thewavelengths of interest (i.e., wavelengths associated with the pigments printed oncolor tag 32). Window 50 may have a transmissivity of at least 1%, at least 10%,at least 20%, at least 30%, at least 40%, at least 50%, 50-90%, or up to 99% forthe wavelengths of interest.

[0039] Optical identification sensor 16 may include a carrier layer such asprinted circuit board 52, a linear (one dimensional) array of photodetectors 58 onlayer 52, a field-of-view (FoV) restriction filter such as FoV restriction filter 60disposed over photodetector array 58, an additional filter layer such as filter layer56 disposed over FoV restriction filter 60, and walls 54 supporting filter 56 andenclosing components 58 and 60 within sensor 16. Sensor 16 assembled in thisway is sometimes referred to as an optical identification module or opticalidentification assembly. Filter layer 56 may be a glass, polymer, or othertransparent layer that serves as a protective layer for the optical sensor module. Ifdesired, filter layer 56 can be configured to selectively filter out wavelengthsoutside the range(s) of interest.

[0040] Optical identification sensor 16 may include additional components (notshown in the cross-sectional side view of FIG. 4). FIG. 5 shows an explodedperspective view of at least some of the internal components within sensor 16. Asshown in FIG. 5, sensor 16 includes FoV restriction filter 60 disposed overphotodetector array 58 (as described above in connection with FIG. 4) and mayfurther include a light source such as light source 66 and a separate item presencesensor such as sensor 68. Light source 66 need not and should not be covered byFoV restriction filter 60.

[0041] Sensor 68 may have an emitter that emits short infrared or color pulsesand an associated detector to measure a corresponding amount of reflected light toidentify when item 30 is mated with device 10. Sensor 68 may generate pulses ata frequency of 0.01 Hz to hundreds of kilohertz to determine the presence of item30 or the presence of color-coded tag 32. Presence sensor 68 operated in this waymay sometimes be referred to as a proximity sensor. The use of a separatededicated item presence sensor 68 is merely illustrative. If desired, light source66 can also be used as the requisite emitter while array 58 can serve as thedetector to determine whether item 30 has been mated with device 10. This canhelp obviate the need for a separate proximity sensor 68 within opticalidentification sensor 16.

[0042] In one suitable embodiment, light source 66 can include one or morebroadband white light-emitting diodes or lasers (e.g., a vertical-cavity surface-emitting laser or VCSEL). This is merely illustrative. In other suitableembodiments, light source 66 may include color light-emitting diodes (LEDs) orlasers (e.g., VCSELs). Illustrative device configurations in which opticalidentification sensor 16 is provided with color light-emitting elements aresometimes described herein as an example.

[0043] FIG. 6 shows one example in which optical identification sensor 16includes multiple individually addressable color LEDs (or lasers) configured toemit light for illuminating color tag 32. The wavelengths of these color LEDsshould be selected based on the color blocks in tag 32. In the example of FIG. 6,tag 32 includes color blocks formed using green, red, and blue pigments. In suchscenarios, light source 66 should include a green (G) emitter 70-1 that emits greenlight, a red (R) emitter 70-2 that emits red light, and a blue (B) emitter 70-3 thatemits blue light. The emitters 70 may be mounted on a support layer such assupport layer 72. Each emitter 70 should have a sufficiently wide enoughemission coverage to properly illuminate every color block in tag 32 (as shown byemission coverage 73). If desired, the intensity of each emitter 70 can bemodulated with one or more unique modulation frequency in order to improveambient light rejection and / or to reduce interference from other electromagneticsources.

[0044] These color emitters can be activated in sequence (i.e., one after another)to acquire three corresponding images using the array of photodetectors. Forexample, blue emitter 70-3 can be turned on during a first period to acquire a first1D image based on reflection from the blue emitted light, green emitter 70-1 canbe turned on during a second period following the first period to acquire a second1D image based on reflection from the green emitted light, and red emitter 70-2can be turned on during a third period following the second period to acquire athird 1D image based on reflection from the red emitted light. Additionalprocessing circuitry within device 10 (e.g., control circuitry 20 of FIG. 1) mayreconstruct an accurate image of color tag 32 based on the three sequentiallyacquired images.

[0045] The example of FIG. 6 in which the color emitters each have a wideangle of coverage is merely illustrative. FIG. 7 illustrates another suitableembodiment in which light source 66 is provided with a light diffusing orscattering layer such as light diffusing layer 74. Light diffusing (or scattering)layer 74 can be a diffusive light pipe (as an example). Light diffusing layer 74 isinterposed between filter 56 and emitters 70. Light diffusing layer 74 is capableof producing a broad emission coverage (as shown by emission coverage 75)without requiring the individual emitters 70 to have a wide emission output.

[0046] Similar with the example of FIG. 6, the color emitters of FIG. 7 can beactivated in sequence to acquire three corresponding images using the array ofphotodetectors. For example, green emitter 70-1 can be turned on during a firstperiod to acquire a first 1D image based on reflection from the green emittedlight, blue emitter 70-3 can be turned on during a second period following the firstperiod to acquire a second 1D image based on reflection from the blue emittedlight, and red emitter 70-2 can be turned on during a third period following thesecond period to acquire a third 1D image based on reflection from the redemitted light. Additional processing circuitry within device 10 (e.g., controlcircuitry 20 of FIG. 1) may reconstruct an accurate image of color tag 32 based onthe three sequentially acquired images.

[0047] The examples described above in connection with FIGS. 6 and 7 inwhich light source 66 has individually addressable color emitters of differentwavelengths is merely illustrative. In other suitable embodiments, color filterscan be added on top of the array of photodetectors to obviate the need for emittersof different colors (wavelengths).

[0048] Referring back to FIG. 4, field-of-view (FoV) restriction filter 60 may beused to establish or limit the field of view of each photodetector within array 58by selectively passing through light rays that are substantially parallel to thesurface normal of housing 12 (e.g., the emitted light rays reflecting back from tag32, as shown by arrows 62 that are parallel or almost parallel to the Z axis).Reflecting light rays such as light rays 64 that are not substantially parallel to thehousing surface normal (e.g., non-parallel light rays with an angle of divergenceof greater than 1°, 2°, 3°, 5°, 10°, 2-20°, or other suitable threshold degree) will berejected or filtered out by field-of-view restriction filter 60.

[0049] FIG. 8 shows a more detailed view of FoV restriction filter 60 relative tocolor tag 32 and photodetector array 58 (e.g., a linear array of individualphotodetectors 59). As shown in FIG. 8, each color block 32B within tag 32 maybe overlapped by more than five photodetectors 59 in the array when item 30 ismated with device 10. If desired, each color block 32B within tag 32 may beoverlapped by more than ten photodetectors 59. Array 58 may include a lineararray of 1-by-n photodetectors 59, where n can be at least 20, at least 50, at least100, at least 200, hundreds, or even thousands of photodetectors 59. Thephotodetectors 59 in array 58 can be photodiodes formed using thecomplementary metal-oxide-semiconductor (CMOS) process, charge-coupleddevices (CCDs), or other types of semiconductor photosensitive elements.

[0050] Optical identification sensor 16 need not include any color filters or lensover photodiodes 59. Photodetector array 58 is therefore sometimes referred to asa monochrome sensor array. Optical identification sensor 16 is thereforesometimes referred to as a lensless sensor. A lensless and color-filter-less opticalidentification sensor of this type exhibits a reduced height and footprint comparedto conventional camera / imaging sensors having color filters and lenses formedover a two-dimensional array of photodiodes. Such type of optical sensorassembly is therefore more compact and is a more cost-effective solution formobile devices.

[0051] Field-of-view restriction filter 60 is disposed over photodetector array58. FoV restriction filter 60 may be a layer with an array of holes (through holes,slots, louvers, or openings) 61 that allow light to travel through to the underlyingphotodetectors 59. In one suitable arrangement, the array of holes 61 in filter 60may be more dense than the array of photodetectors (i.e., each photodetector 59can be overlapped by more than one of the holes 61). In another one suitablearrangement, the array of holes 61 in filter 60 may be less dense than the array ofphotodetectors (i.e., each hole 61 can be overlapped by more than onephotodetector 59). In yet another suitable arrangement, each hole 61 in filter 60can correspond to exactly one respective photodetector 59 in the array.

[0052] FIG. 9 shows an example in which at least one hole 61 of the FoVrestriction filter 60 is positioned over a photodetector 59 in array 58. As shown inFIG. 9, each hole 61 may have a height h and a diameter d, where height h isgreater than diameter d. For example, hole height h can be at least two times holediameter d, at least three times hole diameter d, at least four times hole diameter d,at least five times hole diameter d, two to ten times hole diameter d, or more thanten times diameter d.

[0053] Having a relatively tall and narrow hole 61 located over photodetector 59enables filter 60 to establish a narrow field of view as shown by field-of-viewangle θ between arrows 76. Filter 60 may be configured to restrict the field-ofview angle θ to be less than 2°, less than 3°, less than 4°, less than 5°, less than 2-10°, less than 15°, less than 20°, etc. Light rays such as light ray 78 beyond theestablished field of view will be filtered, absorbed, or otherwise rejected by filter60. Filter 60 configured and operated in this way is sometimes referred to as alight control film, a narrow field-of-view restriction filter, an angular filter, or anangle-of-view filter. The example of FIG. 9 in which one hole 61 is positionedover photodiode 59 is merely illustrative. The density of holes 61 in FoVrestriction filter 60 can be selected to produce the desired field of view for eachphotodetector 59.

[0054] FIG. 10 is a top (plan) view of illustrative field-of-view restriction filter60 in accordance with some embodiments. As shown in FIG. 10, FoV restrictionfilter 60 may be constructed from a black plate, black polymer sheet, or otheropaque layer (film) that has been perforated with holes (through holes) 61. Eachof the holes 61 can be a narrow cylindrical hole, a lozenge shaped hole, an ovalhole, an elliptical hole, an elongated oval hole with curved and straight walls (asshown in FIG. 10), or can have other suitable shapes. If desired, these holesthrough which parallel light rays are allowed to pass through to the underlyingphotodetector can be constructed using louvers or microlouvers. Each hole 61 cancorrespond to one or more underlying photodetectors. Alternatively, two or moreholes 61 can correspond to the same underlying photodetector. The example ofFIG. 10 in which filter 60 has two rows of holes 61 is merely illustrative. Ifdesired, FoV restriction filter 60 can have only one row of holes 61 or more thantwo rows of holes 61.

[0055] Without FoV restriction filter 60, diffused reflections from a nearby colortag would ordinarily form a blurry, unrecoverable image on the array ofphotodetectors. With FoV restriction filter 60 in place, however, a 1:1 scaleimage of the color-coded tag can be acquired using the array of photodetectors toenable reading of discrete color blocks. This allows device 10 accurately read thecolor tag in the attached item and to determine a unique identifier for that item.The control circuitry within device 10 can then look up the unique identifier in alookup table in firmware or other database to precisely identify the type ofexternal item that has been attached, mated, or otherwise coupled to device 10.

[0056] FIG. 11 is a flow chart of illustrative steps for operating opticalidentification sensor 16 of the type described in connection with FIGS. 1-10 inaccordance with some embodiments. During the operations of block 80, opticalidentification sensor 16 can be used to detect the presence of external item 30.For example, sensor 16 may use a dedicated presence sensor (e.g., proximitysensor 68 of FIG. 5) to determine whether item 30 has been attached to device 10.If no item has been detected, then sensor 16 will stay idle. In response todetecting that an item has been brought into close proximity with device 10 (e.g.,when the external item has been mated with or attached to device 10), thepresence sensor will trigger light source 66 to begin illuminating the tag in theexternal item.

[0057] Light source 66 may include emitters of different colors (wavelengths)that can be sequentially turned on to illuminate the color-coded tag in the externalitem. During the operations of block 82, a first emitter in light source 66 (e.g., ared emitter element) may be activated while the photodetector array acquires afirst image by sensing the corresponding light rays reflecting back from the tag.During the operations of block 84, a second emitter in light source 66 (e.g., agreen emitter element) may be activated while the photodetector array acquires asecond image by sensing the corresponding light rays reflecting back from the tag.During the operations of block 86, a third emitter in light source 66 (e.g., a blueemitter element) may be activated while the photodetector array acquires a thirdimage by sensing the corresponding light rays reflecting back from the tag.Sequentially activating emitters of different colors obviates the need for colorfilters to be formed on the array of photodetectors.

[0058] During the operations of block 88, processing circuitry (e.g., processingcircuitry in sensor 16 or in control circuitry 20 of device 10) can be used toperform signal conditional on the acquired images. For example, the processingcircuitry can perform calibration, color correction, gain correction, or other signaladjustments to the acquired images.

[0059] During the operations of block 90, the processing circuitry can sum(combine) the three images to detect edges of each color block (e.g., to locate thecenter and boundaries of each color block). During the operations of block 92,the processing circuitry can identify individual color (code) block locations fromthe edges detected during step 90. During the operations of block 94, theprocessing circuitry can then determine the dominant color for each color blocklocation (e.g., to determine whether the dominant color of each code block is red,green, blue, red-green, red-blue, or green-blue). If desired, code blocks without adominant color may be flagged for erasures (e.g., black code blocks and / or whitecode blocks may be omitted from consideration for the final identifiercomputation).

[0060] During the operations of block 96, the processing circuitry can performerror checking. To support error checking function, the code tag should includeerror correction features such as checksum information, cyclic redundancychecking (CRC) information, and / or error correcting code (ECC) information atthe expense of address space. If no error has been found, then the processingcircuitry may output a corresponding unique identifier that precisely identifies theexternal item (see step 98). If an error has been found, then the processingcircuitry may output an error message to the user, correct the error, or take othersuitable action (see step 100).

[0061] The operations of FIG. 11 are merely illustrative. At least some of thedescribed operations may be modified or omitted; some of the describedoperations may be performed in parallel; additional processes may be added orinserted between the described operations; the order of certain operations may bereversed or altered; the timing of the described operations may be adjusted so thatthey occur at slightly different times, or the described operations may bedistributed in a system.

[0062] In accordance with an embodiment, an electronic device is provided thatincludes a housing, a display in the housing and an optical identification sensorthat includes a light source configured to emit light that illuminates an externalobject, an array of photodetectors configured to receive the light reflecting backfrom the external object through a portion of the housing and a field-of-viewrestriction filter configured to establish a field of view for each photodetector inthe array of photodetectors as the photodetectors receive the light reflecting backfrom the external object through the field-of-view restriction filter.

[0063] In accordance with another embodiment, the field-of-view restriction filterincludes an opaque layer having a plurality of through holes.

[0064] In accordance with another embodiment, each through hole in the pluralityof through holes has a diameter and a height that is greater than the diameter.

[0065] In accordance with another embodiment, the field-of-view restriction filteris configured to allow light within the field of view to pass through to thephotodetectors and to reject light outside the field of view.

[0066] In accordance with another embodiment, the field of view of the field-of-view restriction filter has a field-of-view angle that is less than 10°.

[0067] In accordance with another embodiment, the optical identification sensorfurther includes an additional filter layer over the field-of-view restriction filter.

[0068] In accordance with another embodiment, the optical identification sensorincludes a presence sensor configured to detect when the external object isattached to the electronic device.

[0069] In accordance with another embodiment, the optical identification sensorand the external object are separated by a distance that is less than 5 millimeterswhen the external object is attached to the electronic device.

[0070] In accordance with another embodiment, the light source includes a firstemitter configured to emit light in a first range of wavelengths, a second emitterconfigured to emit light in a second range of wavelengths different than the firstrange of wavelengths and a third emitter configured to emit light in a third rangeof wavelengths different than the first and second ranges of wavelengths.

[0071] In accordance with another embodiment, the optical identification sensorincludes a light diffusing layer disposed over the first, second, and third emitters.

[0072] In accordance with another embodiment, the light emitted from the first,second, and third emitters reach the external object without passing through thefield-of-view restriction filter.

[0073] In accordance with another embodiment, the array of photodetectorsincludes a linear array of photodetectors devoid of color filters.

[0074] In accordance with another embodiment, the photodetectors receive thelight reflecting back from the external object through the field-of-view restrictionfilter without passing through a lens.

[0075] In accordance with an embodiment, an electronic device operable with anexternal item having a color-coded tag, is provided that includes a housing, adisplay in the housing and an optical identification sensor having a light sourceconfigured to emit light, through a portion of the housing, for illuminating thecolor-coded tag in the external item, a field-of-view restriction filter and a lineararray of photodetectors configured to receive the light reflecting back from thecolor-coded tag in the external item through the portion of the housing andthrough the field-of-view restriction filter.

[0076] In accordance with another embodiment, the light source includes aplurality of emitters of different wavelengths, includes control circuitryconfigured to sequentially activate the plurality of emitters to acquirecorresponding images using the photodetectors.

[0077] In accordance with another embodiment, the optical identification sensorincludes a light scattering layer over the plurality of emitters.

[0078] In accordance with another embodiment, the color-coded tag includes aplurality of color blocks and the control circuitry is further configured to combinethe images to detect edges of each of the color blocks, identify a location for eachof the color blocks, determine a dominant color for each of the color blocks andoutput a unique identifier for the external item based on the dominant color ofeach of the color blocks.

[0079] In accordance with another embodiment, the field-of-view restriction filterincludes an opaque layer having a plurality of holes that establish a field of viewfor each photodetector in the linear array of photodetectors.

[0080] In accordance with an embodiment, an electronic device is provided thatincludes a housing, a display in the housing and a lensless optical identificationassembly that includes a light source configured to emit light that illuminates anexternal item mated with the electronic device, an angular filter having a pluralityof openings and an array of photodetectors configured to receive the lightreflecting back from the external item through the openings of the angular filterbut without passing through a lens.

[0081] In accordance with another embodiment, the light source includes aplurality of emitters that are sequentially activated to acquire correspondingimages using the array of photodetectors, the lensless optical identificationassembly includes a diffusive light pipe over the plurality of emitters.

[0082] The foregoing is merely illustrative and various modifications can bemade to the described embodiments. The foregoing embodiments may beimplemented individually or in any combination.Table of Reference Numerals10 Electronic device 14 Display16 Sensor(s) 18 Other20 Control circuitry 22 Communications circuitry24 Input-output devices 30 Item32 Identification tag 12, 40 HousingR Recess 42 Protective cover layer32B Color block 54 Walls56 Filter later 58 Photodetector array60 Field-of-view restriction filter 62, 64, 78 Light rays66 Light source 68 Presence sensor50 Aperture window 52 Printed circuit board70 Emitter 72 Support layer73, 75 Light coverage 74 Light diffusing layer59 Photodetectors 61 Holes76 Arrows θ Field-of-view angled Diameter h Height80, 82, 84, 86,88, 90, 92, 94,96, 98, 100 Blocks

Claims

1. An electronic device comprising: a housing; a display in the housing; and an optical identification sensor that comprises: a light source configured to emit light that illuminates an external object; an array of photodetectors configured to receive the light reflecting back from the external object through a portion of the housing; and a field-of-view restriction filter configured to establish a field of view for each photodetector in the array of photodetectors as the photodetectors receive the light reflecting back from the external object through the field-of-view restriction filter.

2. The electronic device of claim 1, wherein the field-of-view restriction filter comprises an opaque layer having a plurality of through holes.

3. The electronic device of claim 2, wherein each through hole in the plurality of through holes has a diameter and a height that is greater than the diameter.

4. The electronic device of claim 1, wherein the field-of-view restriction filter is configured to allow light within the field of view to pass through to the photodetectors and to reject light outside the field of view.

5. The electronic device of claim 4, wherein the field of view of the field-of-view restriction filter has a field-of-view angle that is less than 10°.

6. The electronic device of claim 1, wherein the optical identification sensor further comprises an additional filter layer over the field-of view restriction filter.

7. The electronic device of claim 1, wherein the optical identification sensor further comprises a presence sensor configured to detect when the external object is attached to the electronic device.

8. The electronic device of claim 7, wherein the optical identification sensor and the external object are separated by a distance that is less than 5 millimeters when the external object is attached to the electronic device.

9. The electronic device of claim 1, wherein the light source comprises: a first emitter configured to emit light in a first range of wavelengths; a second emitter configured to emit light in a second range of wavelengths different than the first range of wavelengths; and a third emitter configured to emit light in a third range of wavelengths different than the first and second ranges of wavelengths.

10. The electronic device of claim 9, wherein the optical identification sensor further comprises a light diffusing layer disposed over the first, second, and third emitters.

11. The electronic device of claim 9, wherein the light emitted from the first, second, and third emitters reach the external object without passing through the field-of-view restriction filter.

12. The electronic device of claim 1, wherein the array of photodetectors comprises a linear array of photodetectors devoid of color filters.

13. The electronic device of claim 1, wherein the photodetectors receive the light reflecting back from the external object through the field-of-view restriction filter without passing through a lens.

14. An electronic device operable with an external item having a color-coded tag, comprising: a housing; a display in the housing; and an optical identification sensor having: a light source configured to emit light, through a portion of the housing, for illuminating the color-coded tag in the external item; a field-of-view restriction filter; and a linear array of photodetectors configured to receive the light reflecting back from the color-coded tag in the external item through the portion of the housing and through the field-of-view restriction filter.

15. The electronic device of claim 14, wherein the light source comprises a plurality of emitters of different wavelengths, further comprising: control circuitry configured to sequentially activate the plurality of emitters to acquire corresponding images using the photodetectors.

16. The electronic device of claim 15, wherein the optical identification sensor further comprises a light scattering layer over the plurality of emitters.

17. The electronic device of claim 15, wherein the color-coded tag comprises a plurality of color blocks and wherein the control circuitry is further configured to: combine the images to detect edges of each of the color blocks; identify a location for each of the color blocks; determine a dominant color for each of the color blocks; and output a unique identifier for the external item based on the dominant color of each of the color blocks.

18. The electronic device of claim 14, wherein the field-of-view restriction filter comprises an opaque layer having a plurality of holes that establish a field of view for each photodetector in the linear array of photodetectors.

19. An electronic device comprising: a housing; a display in the housing; and a lensless optical identification assembly that comprises: a light source configured to emit light that illuminates an external item mated with the electronic device; an angular filter having a plurality of openings; and an array of photodetectors configured to receive the light reflecting back from the external item through the openings of the angular filter but without passing through a lens.

20. The electronic device of claim 19, wherein the light source comprises a plurality of emitters that are sequentially activated to acquire corresponding images using the array of photodetectors, the lensless optical identification assembly further comprising: a diffusive light pipe over the plurality of emitters.