Detection of target-related images based on color space conversion technology and the use of ultraviolet light

By employing color space conversion to identify common and uncommon colors in target environments and incorporating ultraviolet and infrared layers, the method enhances edge detection and security in matrix barcodes, addressing inefficiencies in existing image processing technologies.

JP7579314B2Active Publication Date: 2024-11-07CAPITAL ONE SERVICES LLC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2022182602
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-03-18
Filing Date
2022-11-15
Publication Date
2024-11-07
Estimated Expiration
2040-03-16

AI Technical Summary

Technical Problem

Existing image processing technologies struggle with optimal edge detection in various color spaces, leading to inefficiencies and inaccuracies in identifying boundaries within images, particularly in environments with complex color distributions.

Method used

The use of color space conversion techniques to optimize matrix detection by identifying the most common and least common colors in a target environment, creating a matrix barcode with ultraviolet and infrared layers that enhance edge detection and security, utilizing a combination of non-black and non-white colors and multiple color channels.

Benefits of technology

This approach improves edge detection accuracy and security by aligning color channels with environmental colors, allowing for higher information capacity and secure verification processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007579314000001
    Figure 0007579314000001
  • Figure 0007579314000002
    Figure 0007579314000002
  • Figure 0007579314000003
    Figure 0007579314000003
Patent Text Reader

Abstract

The present invention provides an apparatus, method and article of manufacture for improving image detection and security, including matrix-based image formation and detection. [Solution] The method processes image data, generates one or more color spaces associated with the data, performs a color space transformation based on the generated color spaces, generates an image based on the color space transformation, including but not limited to, a matrix barcode, and applies one or both of an ultraviolet layer and an infrared layer to the image generated from the color space transformation, e.g., a matrix barcode.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] Related Applications This application is a continuation of U.S. patent application Ser. No. 16 / 357,211, entitled "Detection of Target-Related Images Based on the Use of Color Space Conversion Techniques and Ultraviolet Light," filed Mar. 18, 2019. The contents of the aforementioned application are incorporated herein by reference in their entirety. [Background technology]

[0002] Since time immemorial, certain materials (e.g., paint, ink, etc.) have been used to memorize scenes and / or objects in semi-permanent to permanent media. Such memorization involves photographic efforts to create pictures. Computer technology has allowed the digitization and detection of these pictures into images, introducing image processing as a technical field. Edge detection constitutes at least one aspect of image processing and is often applied.

[0003] It is with respect to these and other considerations that current improvements are needed. Summary of the Invention

[0004] The following presents a simplified summary in order to provide a basic understanding of some novel embodiments described herein. This summary is not an extensive overview, and it is not intended to identify key / critical elements or to delineate the scope. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.

[0005] One aspect of the disclosure includes an apparatus for creating a matrix optimized for detection in a particular environment, the apparatus including a memory for storing instructions and a processing circuit coupled to the memory operable to execute instructions that, when executed, cause the processing circuit to: receive a representative dataset including at least one of i) one or more images of a target and ii) one or more videos of the target, the target including at least one of i) an environment, ii) a live entity, and iii) an object; process the representative dataset to create a histogram of the target; identify a plurality of most common colors associated with the target based on the histogram; determine a plurality of associated colors based on the histogram, the plurality of associated colors including at least one of i) a color not present associated with the target and ii) a least common color associated with the target; and create a matrix using the plurality of associated colors, the matrix associated with the target.

[0006] Another aspect of the present disclosure includes a method for detecting a matrix optimized for detection in a particular environment, the method including detecting a matrix displayed on a display via a physical medium and associated with the environment, the matrix including a plurality of non-black and non-white colors, each of the plurality of non-black and non-white colors being at least one of i) a color not present in association with the environment, and ii) a least common color associated with the environment.

[0007] Yet another aspect of the present disclosure includes an article of manufacture displaying a matrix barcode optimized for detection in a particular environment. An article of manufacture comprising a matrix barcode displayed via a physical medium and associated with an environment, the matrix barcode including a plurality of non-black and non-white colors, the matrix barcode storing computer data. butThe embedded computer data includes a product represented by a plurality of pixels associated with non-black and non-white colors, the plurality of pixels being associated with at least three color channels forming a matrix barcode.

[0008] Yet another aspect of the present disclosure includes an apparatus for creating a matrix optimized for detection in a particular environment, the matrix being a portion of a layered image including an ultraviolet light layer. The apparatus includes: receiving a representative dataset including at least one of i) one or more images and ii) one or more videos of a target, the target including at least one of i) an environment, ii) a live entity, and iii) an object; processing the representative dataset to create a histogram of the target; identifying a plurality of most common colors associated with the target based on the histogram; determining a plurality of associated colors based on the histogram, the plurality of associated colors including at least one of i) a color not present in association with the target, and ii) a least common color associated with the target; and creating a matrix using the plurality of associated colors and the at least one ultraviolet light layer, the matrix being associated with the target.

[0009] Yet another aspect of the present disclosure includes a method for detecting a matrix optimized for detection in a particular environment, the matrix being a portion of an image that includes at least one ultraviolet light layer, the method includes detecting a matrix barcode displayed on a display via a physical medium and associated with the environment, the matrix barcode including a plurality of non-black and non-white colors and at least one ultraviolet light layer, the at least one ultraviolet light layer reflecting ultraviolet light, and the matrix barcode including four or more bits of information.

[0010] Yet other aspects of the present disclosure include a product displaying a matrix barcode optimized for detection in a particular environment, the matrix barcode being part of an image having an ultraviolet light layer. The product includes a matrix barcode displayed via a surface adapted to at least one of project, absorb, reflect, or irradiate ultraviolet light, the matrix barcode including a combination of four or more constituent matrix barcodes each associated with a distinct color channel, the matrix barcode including an ultraviolet light color channel associated with at least one layer of at least one of the four constituent matrix barcodes.

[0011] Yet another aspect of the present disclosure includes an apparatus for creating a matrix optimized for detection in a particular environment, the matrix being a portion of a layered image including an infrared layer, the apparatus includes: receiving a representative dataset including at least one of i) one or more images and ii) one or more videos of a target, the target including at least one of i) an environment, ii) a live entity, and iii) an object; processing the representative dataset to create a histogram of the target; identifying a plurality of most common colors associated with the target based on the histogram; determining a plurality of associated colors based on the histogram, the plurality of associated colors including at least one of i) a color not present in association with the target, and ii) a least common color associated with the target; and creating a matrix using the plurality of associated colors and the at least one infrared layer, the matrix being associated with the target.

[0012] Yet another aspect of the present disclosure includes a method for detecting a matrix optimized for detection in a particular environment, the matrix being a portion of an image that includes at least one infrared layer, the method includes detecting a matrix barcode displayed on a display via a physical medium and associated with the environment, the matrix barcode including a plurality of non-black and non-white colors and at least one infrared layer, the at least one infrared layer reflecting infrared light, and the matrix barcode including four or more bits of information.

[0013] Yet other aspects of the present disclosure include a product displaying a matrix barcode optimized for detection in a particular environment, the matrix barcode being part of an image having an infrared layer, the product including a matrix barcode displayed via a surface adapted to at least one of project, absorb, reflect, or illuminate with infrared light, the matrix barcode including a combination of four or more constituent matrix barcodes each associated with a distinct color channel, the matrix barcode including an infrared color channel associated with at least one layer of at least one of the four constituent matrix barcodes.

[0014] Yet another aspect of the present disclosure includes an apparatus for creating a matrix barcode including both ultraviolet and infrared layers, the apparatus including a memory for storing instructions and a processing circuit coupled to the memory operable to execute instructions that, when executed, cause the processing circuit to create a matrix barcode using at least one infrared layer and at least one ultraviolet layer.

[0015] Yet another aspect of the present disclosure includes an apparatus for creating a matrix optimized for detection in a particular environment, the matrix being part of a layered image including an infrared layer and an ultraviolet layer. The apparatus includes a memory for storing instructions and a processing circuit coupled to the memory operable to execute instructions that, when executed, cause the processing circuit to: create a matrix barcode using one or more color layers, at least one infrared layer and at least one ultraviolet layer; receive a representative dataset including i) one or more images and ii) at least one of one or more videos of a target, the target including at least one of i) an environment, ii) a live entity, and iii) an object; process the representative dataset to create a histogram of the target; identify a plurality of most common colors associated with the target based on the histogram; and determine a plurality of associated colors based on the histogram, the plurality of associated colors including at least one of i) a color not present for the target, and ii) a least common color associated with the target, the plurality of associated colors being included in each of the one or more color layers.

[0016] Yet another aspect of the present disclosure includes a method for detecting a matrix barcode optimized for detection in a particular environment, the matrix barcode including both an ultraviolet layer and an infrared layer, the method including detecting a matrix barcode displayed on a display via a physical medium and associated with an environment, the matrix barcode including a plurality of non-black and non-white colors, at least one infrared layer, and at least one ultraviolet layer, the at least one ultraviolet layer reflecting ultraviolet light and the at least one infrared layer reflecting ultraviolet light.

[0017] Yet another aspect of the present disclosure includes an article of manufacture for displaying a matrix barcode having both ultraviolet and infrared layers, the article of manufacture comprising a matrix barcode displayed via a surface adapted to at least one of project, absorb, reflect, or emit both infrared and ultraviolet light, the matrix barcode including at least one infrared layer and at least one ultraviolet layer.

[0018] Yet other aspects of the present disclosure include an article for displaying a matrix barcode having both ultraviolet and infrared layers, and one or more colored layers optimized for detection in a particular environment. The article includes a matrix barcode displayed via a suitable surface that reflects both infrared and ultraviolet light, the matrix barcode including at least one infrared layer, at least one ultraviolet layer, and a plurality of non-black and non-white colors, the plurality of non-black and non-white colors being associated with at least three non-white and non-black color channels.

[0019] To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings. These aspects are indicative of various ways in which the principles disclosed herein may be practiced, all aspects and equivalents of which are intended to be within the scope of the claimed subject matter. Other advantages and novel features may become apparent from the following detailed description when considered in conjunction with the drawings. [Brief description of the drawings]

[0020] [Figure 1] 1 illustrates an embodiment of a system for improving edge detection in an image in accordance with at least one embodiment of the present disclosure. [Figure 2A] 2 illustrates an embodiment of a clustering process for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 2B] 2 illustrates an embodiment of a color space conversion technique for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Diagram 3] 2 illustrates an embodiment of a centralized system for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 4] 2 illustrates an embodiment of an operating environment for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 5A] 2 illustrates an embodiment of a first logic flow for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 5B] 2 illustrates an embodiment of a second logic flow for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 5C] 10 illustrates a third logic flow embodiment for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 5D] 10 illustrates a fourth logic flow embodiment for the system of FIG. 1 in accordance with at least one embodiment of the present disclosure. [Figure 6A] 1 illustrates the formation of a scannable image in accordance with at least one embodiment of the present disclosure. [Figure 6B] 1 illustrates the formation of a scannable image in accordance with at least one embodiment of the present disclosure. [Figure 6C] 1 illustrates the formation of a scannable image in accordance with at least one embodiment of the present disclosure. [Figure 7] 1 illustrates a computing device for generating and scanning a scannable image in accordance with at least one embodiment of the present disclosure. [Figure 8] 2 illustrates an embodiment of a graphical user interface (GUI) for the system of FIG. 1. [Figure 9] 1 illustrates an embodiment of a computing architecture. [Figure 10] 1 illustrates an embodiment of a communications architecture. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Various embodiments are directed to improving image processing by identifying which color space model is most appropriate to use for detection in a particular environment, such as, for example, converting between color spaces to improve detection in a particular environment or in relation to a particular target. In various embodiments, converting between color spaces provides a matrix that is placed on an object or displayed by an electronic device, the matrix being optimized for detection in the environment by performing one or more color space interactions in generating the matrix. In one or more embodiments, the matrix is ​​a matrix barcode, and in one or more embodiments, the matrix barcode is a fiducial marker.

[0022] In various embodiments, the color space transformation encodes information about the matrix barcode that allows for proper scanning of the object associated with the matrix barcode while preventing tampering and mis-verification. For example, the color channels containing the information are tied to the transformation, and without the scanning device having access to the information associated with the transformation, the scan cannot verify the object associated with the object and / or access the information associated with it.

[0023] In various embodiments, color space conversion provides for increasing the amount of information that can be stored in a matrix, e.g., a matrix barcode, since the color channels associated with the converted (derived) color space can be increased as needed and without restriction (if the scanning device is appropriately configured to detect when the matrix is ​​scanned).

[0024] In various embodiments, an ultraviolet and / or infrared layer may be used in conjunction with the matrix to further increase the information associated with the matrix, add a layer of security, and / or optimally utilize the inks associated with printing the matrix.

[0025] Thus, various embodiments of the present disclosure provide at least one of the following advantages: i) enhance detection of images, e.g., matrices, on objects in the environment (since the color of the matrix is ​​selected and optimized with the color of the environment in mind); ii) provide safer verification; iii) store more information in the matrix since there is no front-loading limitation on the number of color channels that can be used, allowing the amount of information to be further increased and making verification scans safer by adding infrared or ultraviolet capabilities.

[0026] In various embodiments, the color space conversion improves edge detection. In image processing, edge detection is a known technical field, and techniques for edge detection provide different results for different color space models. It is not uncommon for one color space model to provide better results in edge detection than another, since acquiring image data according to a color space model provides a higher chance of successful edge detection than other color space models.

[0027] Color space models are configured to represent color data, but most models differ in their representation of that color data. For example, the CIELAB or LAB color space model represents color as three values, L for luminance / lightness, and alpha (A) and beta (B) for each of the green-red and blue-yellow color components. The LAB color space model is typically used when converting from a red-green-blue (RGB) color space model to a cyan-magenta-yellow-black (CMYK). For some images, representing their color data in the LAB color space model provides better edge detection results than other color space models, including the RGB model. As a result, the embodiments can improve the affordability, scalability, modularity, extensibility, or interoperability of operators, devices, or networks that utilize image detection as a means of verifying transactions by providing a more effective and accurate way of scanning images associated with verification (thus minimizing redundant consumption of computer resources).

[0028]

[0023] The detailed descriptions which follow may be presented in terms of program procedures executed on a computer or network of computers, generally with reference to the notation and nomenclature used herein. These procedural descriptions and representations are used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art.

[0029] Procedures are described herein and are generally conceived to be self-consistent sequences of operations leading to a desired result. These operations are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical, magnetic, or optical signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It is sometimes convenient, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities.

[0030] Further, the manipulations performed are often referred to in terms such as adding or comparing, which are commonly associated with mental operations performed by a human operator. No such capability of a human operator is necessary, or desirable in most cases, in any of the operations described herein that form part of one or more embodiments. Rather, the operations are machine operations. Useful machines for performing the operations of the various embodiments include general purpose digital computers or similar devices.

[0031] Various embodiments also relate to apparatus or systems for performing these operations. This apparatus may be specially constructed for the required purposes, or may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. The procedures presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose machines may be used with programs written in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the required method steps. The required structure for these various machines will be apparent from the description given.

[0032] Reference is now made to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding thereof. It will be apparent, however, that the novel embodiments may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form to facilitate description thereof. The intention is to cover all modifications, equivalents, and alternatives consistent with the claimed subject matter.

[0033] 1 illustrates a block diagram of system 100. Although system 100 illustrated in FIG. 1 has a limited number of elements in a particular topology, it can be understood that system 100 may include more or fewer elements in alternative topologies as desired for a given implementation. System 100 may implement some or all of the structure and / or operations of system 100 within a single computing entity, such as entirely within a single device.

[0034] The system 100 may comprise an apparatus 120. The apparatus 120 may generally be configured using various components to process an input 110 and generate an output 130, of which (some) output 130 is displayed on a display device or printed on a suitable material surface. The apparatus 120 may comprise a processor 140 (e.g., processing circuitry) and computer memory 150. The processing circuitry 140 may be any type of logic circuitry, and the computer memory 150 may be a configuration of one or more memory units.

[0035] The device 120 further includes logic 160 stored in the computer memory 150 and executed on the processing circuitry 140. The logic 160 operates to cause the processing circuitry 140 to process the image data of the image dataset 170 into patched image data, the image data being structured according to a color space model. The color space model described herein refers to any suitable color space model, such as Red-Green-Blue (RGB), Cyan-Magenta-Yellow-Black (CMYK), Luminance-Alpha-Beta (LAB), etc. For example, the alpha and beta channels of the LAB color space model refer to the green-red and blue-yellow color components, respectively. The green-red component may represent the variance between red and green, with green in the negative direction and red in the positive direction along the axis, and the blue-yellow component may represent the variance between blue and yellow, with blue in the negative direction and yellow in the positive direction along the axis. In various embodiments, an edge may be defined (mathematically) as each pixel location where the alpha channel has a value of zero (0) or close to zero.

[0036] In various embodiments, the patched image data includes a plurality of patches, each patch comprising color data (e.g., pixel data in which each pixel is represented as a tuple of red-green-blue (RGB) color intensities). As described herein, one color space model (e.g., RGB) may correspond to a greater likelihood of success at edge detection than other color space models. Some images provide optimal or near-optimal edge detection results when placed in RGB, while other images provide optimal or near-optimal edge detection results when placed in LAB or XYZ color spaces, and vice versa.

[0037] In various embodiments, logic 160 is further operable to cause processing circuitry 140 to apply color space conversion mechanism 180 to the image data to generate image data transformed according to another color space model. Logic 160 is then operable to cause processing circuitry 140 to apply edge detection technique 190 to the transformed image data. Edge detection technique 190 is an image processing technique that refers to any one of several algorithms for identifying edges or boundaries of objects in an image. In general, edge detection technique 190 provides information (e.g., pixel data) that indicates the location of edges in the image data of image dataset 170. Some implementations of edge detection technique 190 operate by detecting brightness discontinuities, and for those implementations, having the image data in LAB color space, or XYZ color space over RGB, provides more accurate edge detection results. Some implementations of edge detection technique 190 provide accurate edge detection results when the image data is modeled according to HCL (hue-saturation-luminance) instead of RGB.

[0038] In various embodiments, logic 160 is further operable to cause processing circuit 140 to identify an image group corresponding to the patched image data. Image dataset 170 further includes image group model data correlating the image with a color space model that is most likely to provide a suitable edge detection result. In various embodiments, the image group model data indicates a color space model to use in transforming a given image prior to edge detection to achieve a near-optimal edge detection result. Logic 160 is further configured to cause processing circuit 140 to select a color space conversion mechanism 180 based on the image group. Color space conversion mechanism 180 is operable to convert image data to transformed image data according to another color space model, the other color space model having a higher probability than the color space model at edge detection of the image group. It is understood that the other color space model can be any color space model, including one having a different number of channels than the color space model.

[0039] In various embodiments, logic 160 may be further operable to cause processing circuitry 140 to determine an optimal color space for detection associated with a particular object, entity, or environment, where the color space or histogram representation of the particular object, entity, or environment may be part of image dataset 170. Logic 160 may be further operable to cause processing circuitry 140 to determine the optimal color space based on one or more color space conversion operations, where the color space conversion operations may provide a mechanism for encoding information in any suitable medium, including, but not limited to, a matrix, such as a matrix barcode, fiducial marker, other suitable barcode, or other suitable image. Logic 160 may be further operable to cause processing circuitry 140 to generate a matrix, e.g., a matrix barcode, fiducial marker, or other scheme, for detection associated with a particular object, entity, or environment based on the color space determination. Logic 160 may further be operable to cause processing circuitry 140 to provide a scheme for adding at least one ultraviolet and infrared layer to an image, such as a matrix or matrix barcode, useful for detection related to a particular object, entity, or environment, where the ultraviolet and / or infrared layers may add additional data bearing capabilities and / or security to the detectable image.

[0040] One or more color space models described herein, as stated or implied elsewhere herein, refer to any appropriate color space model, such as color spaces employing tristimulus systems or schemes, Red-Green-Blue (RGB), Luminance-Alpha-Beta (LAB), XYZ color space, and / or the like, and / or variations thereof. Similarly, although various embodiments may refer to a particular transformation from one particular color space to another, transformations between other color spaces are contemplated and consistent with the teachings of this disclosure.

[0041] In various embodiments, as described herein, one color space model (e.g., RGB or XYZ) may correspond to a higher probability of success in edge detection relative to an object, entity, or environment having a particular color distribution, for detection of a displayed or printed image, e.g., a barcode, than another color space model. Furthermore, certain colors and color channels associated with a color space may provide superior edge detection relative to an object, entity, or environment. Some images provide optimal or near-optimal edge detection results when placed in RGB, while other images provide optimal or near-optimal edge detection results when placed in XYZ or LAB, and vice versa. As an example, an image depicting a red balloon on a green field appears very differently in RGB than in LAB. Thus, with respect to edge detection, LAB provides a higher probability than RGB in successfully identifying and locating the edge (e.g., boundary) of a red balloon or matrix, e.g., a barcode or fiducial marker, colored red in a green environment.

[0042] In various embodiments, a color channel is a distribution of colors where the first color and the second color have the highest prevalence of the first and second colors, respectively, and the boundary can be a transition between these colors, such that the first color is at a minimum in the color channel and the second color is at a maximum. This boundary can be at least one pixel where the color changes from the first color to the second color or vice versa. If the first color is set to zero (0) and the second color is set to two hundred and fifty-five (255), then mathematically, this boundary can be located at a pixel that jumps between the minimum and maximum values. For example, there can be a sharp division (i.e., a thin boundary) where at least two adjacent pixels immediately transition between 0 and 255. In various embodiments, the color channels, e.g., "R", "G", and "B", define a color space (e.g., a first color space based on a tristimulus system), such as RGB, and in various embodiments, a custom color channel can be created using a (second) tristimulus value system that is defined in association with the XYZ color space (and / or a conversion to the XYZ color space). In various embodiments, the color channels may be greater than three.

[0043] In various embodiments, as discussed herein, one or more color channel ranges are selected such that a maximum color value of one or more color channels corresponds to a unique, most common, and / or highest color value of a target object, entity, and / or environment associated with the scan, and a minimum color value of a color channel corresponds to the most unique, most common, and / or highest color value of a scannable image, e.g., a matrix, a matrix barcode, and / or a fiducial marker. Furthermore, the most common and / or highest color value of a scannable image is also the least common (lowest color value) and / or absent from a target object, entity, and / or environment associated with the scan, or vice versa (e.g., with respect to maximum or minimum values).

[0044] In various embodiments, as described herein, certain objects, entities, or environments may have color distributions and associated colors and color channels that make the color space more complex and diverse, including colors that are not perceptible by the human eye and are more attractive for detection, in addition to increasing the capacity for storing and encrypting information. Thus, in various embodiments, logic 160 is further operable to cause processing circuitry 140 to identify an image group corresponding to the patched image data. Image dataset 170 further includes image group model data that correlates the image with a color space conversion model that is most likely to provide a suitable edge detection result. In some embodiments, the image group model data indicates a color space conversion model to use in converting a given image prior to edge detection to achieve a near-optimal edge detection result. Logic 160 is further configured to cause processing circuitry 140 to select color space conversion mechanism 180 based on the image group. Color space conversion mechanism 180 is operable to convert image data to converted image data according to other color space models, the other color space models having a higher probability than the color space model in edge detection of the image group.

[0045] In various embodiments, system 100 may include one or more of camera or video device 195 and / or scanning device 197, both of which may be any suitable device for obtaining, capturing, editing, and / or scanning images, including but not limited to video or camera photos, of objects, entities, and / or environments. Logic 160 may be configured to capture or scan images of particular objects, entities, or environments using device 195 and / or device 197, and the captured images may become part of image dataset 170 and may be used to determine an appropriate color space, perform color space conversion, and / or scan the images determined from the color space conversion, as may be consistent with the teachings provided herein.

[0046] In various embodiments, system 100 may include a printing device 199 (e.g., a printer) or application therefor, where image portions of image dataset 170 and / or images generated by one or more components of system 100 may be printed by printing device 199 by applying color space conversion techniques or mechanisms, such as a scannable matrix, matrix barcode, or fiducial marker, and / or printing device 199 may provide a scheme for other devices to print or generate images associated with the scannable matrix, matrix barcode, or fiducial marker.

[0047] Figure 2A illustrates an embodiment of a clustering process 200A of system 100. Clustering process 200A operates on an image dataset (e.g., image dataset 170 of Figure 1) that stores color data for images.

[0048] In some embodiments of the clustering process 200A, the color data 202 of the image undergoes a patching operation in which the image is processed into multiple patches 204 of patched image data 206. Each patch 204 of the patched image data 206 includes color data according to a color space model, such as pixel data having an RGB tuple. The clustering process 200A further processes the patched image data 206 via a transformation operation 208 by applying a color space transformation mechanism to the color data of the patched image 206 to transform the patched image data into transformed image data of a transformed image 210. The color data of the patched image 206 is organized according to a color space model, and new color data for the transformed image 210 is generated according to another color space model.

[0049] In some embodiments, the clustering process 200A performs a mini color space transformation on at least one patch of the patched image 206, possibly leaving one or more patches without transformation. Via a transformation operation 208, the mini color space transformation modifies color data in the at least one patch to transform the patched image data into transformed image data of the transformed image 210. The clustering process 200A may perform stitching between patches to make the patched image 206 uniform, as opposed to creating artificial edges.

[0050] 2B illustrates an example of a color space conversion scheme 200B according to various embodiments of the present disclosure. A histogram 218 representation of a particular object, entity, or environment 215 is provided (where the numbers 100, 90, 80, and 70 are intended to represent simplified versions of color distribution values ​​of one or more colors representing the particular object, entity, or environment 215). The histogram 218 may be generated by having one or more components of the system 100 perform a scan of the particular object, entity, or environment 215 and generate a histogram 218 of the most common colors, least common colors, or non-existent colors of the object, entity, or environment 215. In one or more embodiments, the histogram 218 may be four or more colors of the most common colors of the object, entity, or environment. Because various embodiments of the present disclosure expressly contemplate the use of colors imperceptible to the human eye, there is no limit to the number of colors that can be used with respect to histogram 218, and any image, matrix, matrix barcode, fiducial marker, etc. generated from the color space transformations discussed herein, or from a color space, including but not limited to, may have more than four colors and four color channels, where the four colors and / or four color channels are distinct and different from one another.

[0051] In various embodiments, one or more components of the system 100 may determine the most common colors associated with an object, entity, or environment 215, and the resulting histogram 218 may be based on that determination. The histogram 218 may be used to map the most common colors to a distribution 222 associated with an appropriate color space 224, including, but not limited to, an RGB color space 224. In various embodiments, the colors in the histogram 218 are mapped according to the tristimulus values ​​of the RGB color space, e.g., "R", "G", and "B". Any suitable mathematical transformation, e.g., linear algebra, etc., may be used to map the transformation to the RGB color space, e.g., to convert the mapped RGB color space to other color spaces.

[0052] In various embodiments, once the distribution 222 has been mapped according to the RGB color space 224, one or more components of the system 100 may convert the RGB distribution 222 to a new color space 226 having a distribution 228 according to the new color space 226. Any suitable color space conversion may be used, including conversion to the XYZ color space. The conversion may be according to any suitable mathematical conversions and equations governing the XYZ color space, including suitable tristimulus value conversions between RGB and XYZ. In various embodiments, "Y" represents luminance values ​​in the XYZ space, and at least one (or both) of "X" and "Z" represent chrominance values ​​and associated distributions in a color space, e.g., 226 plotted according to the XYZ color space.

[0053] In various embodiments, the luminance channel "Y" is filtered to result in a color space 228' and distribution 226', which may help determine only the actual saturation associated with the entity, object, or environment 215 without considering luminance (this is useful since it allows for colors that are not perceptible to at least the human eye). In various embodiments, four (or more) lines may be defined by points (a1, b1), (a2, b2), (a3, b3), and (a4, b4), selected to be the greatest distance apart with respect to the distribution 226'. In various embodiments, points a1, a2, a3, and a4 may be selected to correspond to the most common colors associated with the entity, object, or environment 215, and b1, b2, b3, and b4 may represent the opposite of these colors, and by extension, the least common or non-existent colors associated with the entity, object, or environment b1, b2, b3, b4. These lines may define vectors for a new color space transformation in XYZ or other appropriate color space 245 and may form the basis of new XYZ tristimulus values. An image such as a matrix or matrix barcode may be created using the colors associated with the new color space 250 and a distribution of colors 245 defined by the color channel vectors (i,-i), (j,-j), (k,-k), the additional color channel, and all other color channels associated with it (omitted from the display due to limitations of three-dimensional space). In various embodiments, the colors may correspond to less common or non-existent colors relative to where a potential scan may occur (or what is being scanned), e.g., a matrix barcode on an entity or object and / or an environment with colors that have the greatest difference relative thereto, thus enhancing edge detection.

[0054] Alternatively, although not explicitly shown, one may determine the maximum distance from the most common to the least common color, e.g., from a1 to b1, a2 to b2, etc., and then draw lines from b1, b2, b3, and b4 in parallel or opposite directions tangent to the vectors or directions associated with a1, a2, a3, and a4. The color channel vectors (i,-i), (j,-j), (k,-k), additional color channels, and all other color channels (omitted from the display due to limitations of the three-dimensional space) associated with color space 250 may be completely colorless and / or mildly common in relation to the entity, object, or environment 215, which may further enhance edge detection.

[0055] In various embodiments, when performing a color space conversion between 228' and 250, in addition to performing an algebraic or other appropriate conversion associated with the XYZ color space, the color channel vectors, e.g., (i,-i), (j,-j), (k,-k), may be made orthogonal to one another by performing any appropriate mathematical and / or directional operations on the vectors and / or by selecting appropriate points on the color space 226' and distribution 228' when performing the conversion. In various embodiments, a second maximum difference between one or more points may be taken in space 250 in addition to the directional operation that centers the distribution 245 along the axis of the newly defined color channel vectors, e.g., (i,-i), (j,-j), (k,-k), such that the color channel vectors are orthogonal and have a maximum distance from one another. In various embodiments, performing at least one of an orthogonality operation, a maximum determination, and / or an orientation operation may further enhance edge detection of an image generated for scanning, such as a matrix barcode, in relation to the scanned entity, object, or environment 215.

[0056] In various embodiments, the various color channels described above, including each vector, e.g., (-i,i), define a first color that is the minimum in the color channel, and a second color that is the maximum. This boundary may be at least one pixel where the color changes from the first color to the second color, or vice versa. If the first color is set to zero (0) and the second color is set to two hundred fifty-five (255), then mathematically, this boundary may be located at a pixel that jumps between the minimum and maximum values. For example, there may be a sharp division (i.e., a thin boundary) where at least two adjacent pixels immediately transition between 0 and 255. In various embodiments, the boundary may be a transition between these colors, as described above, when one or more color channel ranges are selected such that the maximum color value of one or more color channels corresponds to the unique, most common, and / or highest color value of the target object, entity, and / or environment associated with the scan, and the minimum color value of the color channel corresponds to the most unique, most common, and / or highest color value of the scannable image, e.g., matrix, matrix barcode, and / or fiducial marker. Additionally, the most common and / or highest color values ​​in a scannable image may also be the least common (lowest color values) and / or absent in a target object, entity, and / or environment associated with the scan, or vice versa (e.g., in terms of maximum or minimum values).

[0057] The length of a color channel may be adjusted accordingly based on the capabilities of the various components, e.g., the scanning and image acquisition capabilities of the camera or video device 195, the scanning device 197, and / or the recognition component 422-4 (described below with respect to FIG. 4), where the length increases the number of distinct colors between the minimum and maximum points of the color channel.

[0058] In various embodiments, the conversion from the RGB color space to the XYZ color space and / or the conversion from the initially transformed (differential) XYZ space to another XYZ color space may be controlled by a tristimulus equation (Equation 1) that defines the transformed color space and the distribution of the color space, where the value of x+y=z may be normalized to 1. x=X / (X+Y+Z), y=Y / (X+Y+Z), z=Z / (X+Y+Z). formula 1

[0059] In various embodiments, the values ​​of "X", "Y", and "Z" depend on the input colors from the RGB color space (or from the color space to convert in the case of the second transformation). As noted above, the tristimulus values ​​are three-fold definition, but the transformation may include more than two color channels, including color channels that define colors that are not perceptible to the human eye. In various embodiments, the transformation governed by Equation 1 may form a key for a scanning device to scan an image defined by the transformation, such as a matrix, e.g., a matrix barcode or fiducial marker. In various embodiments, this means that in addition to providing a means for increasing the number of color channels and colors of a scanned image, this also means increasing the bits of information that can be encoded therein, and other advantages of various embodiments are that it provides a way to securely encode information, for example, without knowing the formula or formulas governing the color space, and without knowing the input values ​​(based on the first color space associated with the entity, object, or environment 215), and without knowing the input values ​​(based on the first color space associated with the entity, object, or environment 215), a successful scan cannot occur. Thus, in various embodiments, logic 160 of system 100 may cause processor 140 (or an application programmed to perform the operations of 100) to provide a key governed by Equation 1 to scanning device 197 in order to scan an image encoded according to one or more color space transformations associated with Equation 1.

[0060] In various embodiments, logic 160 of system 100 may cause processor 140 to provide a scheme for adding one or both of an ultraviolet layer and / or an infrared layer to an image, such as a matrix, e.g., a matrix barcode or fiducial marker. The image includes multiple non-black or non-white colors governed by any suitable color space. In various embodiments, the scheme may include both an ultraviolet layer and an infrared layer, and the ultraviolet layer may form the first layer of the image to take advantage of its properties. In various embodiments, the non-black and non-white colors of the scannable image may be determined by one or more color space conversion techniques as outlined herein. In various embodiments, non-black and non-white colors refer to colors that are not black or white. In various embodiments, non-black and non-white colors refer to colors that are not black, white, or based on a grayscale distribution.

[0061] 3 illustrates a block diagram of a distributed system 300. A distributed system 300 may distribute portions of the structure and / or operations of system 100 across multiple computing entities. Examples of distributed systems 300 include, but are not limited to, client-server architectures, three-tier architectures, N-tier architectures, tightly coupled or clustered architectures, peer-to-peer architectures, master-slave architectures, shared database architectures, and other types of distributed systems. The embodiments are not limited in this context.

[0062] The distributed system 300 may include a client device 310 and a server device 320. In general, the client device 310 and / or the server device 320 may be the same as or similar to the apparatus 120, as described with reference to FIG. 1. For example, the client device 310 and the server device 320 may each include a processing component 330 that is the same as or similar to the processing circuit 140, as described with reference to FIG. 1. In other examples, the devices 310, 320 may communicate over a communication medium 312 using a communication signal 314 via a communication component 340.

[0063] The server device 320, via a communication component 340, may communicate with other devices over a communication medium 312 using communication signals 314. The other devices may be internal or external to the device 320, as desired for a given implementation.

[0064] The client device 310 may comprise or use one or more client programs that operate to perform various methodologies according to the described embodiments. In one embodiment, for example, the client device 310 may implement the system 100 including the logic 160 of FIG. 1, and in various embodiments, the client device 310 may perform one or more operations to form an image based on one or more color space transformations as outlined above and herein.

[0065] The server device 320 may comprise or use one or more server programs that operate to execute various methodologies according to the described embodiments. In one embodiment, for example, the server device 320 may perform the clustering process 200A of FIG. 2A and generate the image group model data 350 by performing one or more color space conversion operations of scheme 200B, and / or generate the image group model data 350. The image group model data 350 may include a matrix, e.g., a printing scheme or color distribution of an image scanned in the environment 215 of an entity, object, or matrix barcode or fiducial marker.

[0066] The devices 310, 320 may comprise any electronic device capable of receiving, processing, and transmitting information of the system 100. Examples of electronic devices include, but are not limited to, an ultra-mobile device, a mobile device, a personal digital assistant (PDA), a mobile computing device, a smartphone, a telephone, a digital telephone, a mobile phone, an e-book reader, a handset, a one-way pager, a two-way pager, a messaging device, a computer, a personal computer (PC), a desktop computer, a laptop computer, a notebook computer, a netbook computer, a handheld computer, a tablet computer, a server, a server array or server farm, a web server, a network server, an Internet server, a workstation, a minicomputer, a mainframe computer, a supercomputer, a network appliance, a web appliance, a distributed computing system, a multiprocessor system, a processor-based system, a consumer electronics device, a programmable consumer electronics device, a gaming device, a television, a digital television, a set-top box, a wireless access point, a base station, a subscriber station, a mobile subscriber center, a radio network controller, a router, a hub, a gateway, a bridge, a switch, a machine, or a combination thereof. The embodiments are not limited in this context.

[0067] The devices 310, 320 may execute instructions, processing operations, or logic of the system 100 using a processing component 330. The processing component 330 may comprise various hardware elements, software elements, or a combination of both. Examples of hardware elements may include devices, logic devices, components, processors, microprocessors, circuits, processing circuits, circuit elements (e.g., transistors, resistors, capacitors, inductors, etc.), integrated circuits, application specific integrated circuits (ASICs), programmable logic devices (PLDs), digital signal processors (DSPs), field programmable gate arrays (FPGAs), application specific standard products (ASSPs), system on a chip (SOCs), complex programmable logic devices (CPLDs), memory units, logic gates, registers, semiconductor devices, chips, microchips, chipsets, and the like. Examples of software elements may include software components, programs, applications, computer programs, application programs, system programs, software development programs, machine programs, operating system software, middleware, firmware, software modules, routines, subroutines, functions, methods, procedures, software interfaces, application program interfaces (APIs), instruction sets, computing code, computer code, code segments, computer code segments, words, values, symbols, or any combination thereof. The decision whether an embodiment is implemented using hardware and / or software elements may vary according to any number of factors, such as desired computation speeds, power levels, thermal tolerances, processing cycle budgets, input data rates, output data rates, memory resources, data bus speeds and other design or performance constraints required for a particular implementation.

[0068] The devices 310, 320 may use a communication component 340 to perform communication operations or logic of the system 100. The communication component 340 may implement any well-known communication technology and protocol, such as technology suitable for use with a packet-switched network (e.g., a public network such as the Internet, a private network such as an enterprise intranet, etc.), a circuit-switched network (e.g., the Public Switched Telephone Network), or a combination of packet-switched and circuit-switched networks (with appropriate gateways and translators). The communication component 340 may include various types of standard communication elements, such as one or more communication interfaces, network interfaces, network interface cards (NICs), radios, wireless transmitters / receivers (transceivers), wired and / or wireless communication media, physical connectors, etc. By way of example and not limitation, the communication medium 312 includes wired communication media and wireless communication media. Examples of wired communication media may include wires, cables, metal leads, printed circuit boards (PCBs), backplanes, switch fabrics, semiconductor materials, twisted pair wires, coaxial cables, optical fibers, propagated signals, etc. Examples of wireless communication media may include acoustic, radio frequency (RF) spectrum, infrared and other wireless media.

[0069] Figure 4 illustrates an embodiment of an operating environment 400 of the system 100. As shown in Figure 4, the operating environment 400 includes an application 420, such as an enterprise software application, for processing input 410 and generating output 430.

[0070] The application 420 comprises one or more components 422-a, where a represents any integer. In one embodiment, the application 420 may comprise an interface component 422-1, a clustering component 422-2, a transformation mechanism library 422-3, and a recognition component 422-4. The interface component 422-1 may be generally configured to manage the user interface of the application 420, for example, by generating graphical data for presentation as a graphical user interface (GUI). The interface component 422-1 may generate GUIs for depicting various elements such as dialog boxes, HTML forms with rich text, and the like.

[0071] The clustering component 422-2 may generally be arranged to organize images into image groups or clusters. Some embodiments of the clustering component 422-2 perform one or more color space conversion operations of the clustering process 200A of FIG. 2A and / or the scheme 200B of FIG. 2B to generate the image group model data 350 of FIG. 3. In various embodiments, the clustering component 422-2 identifies for each image group a particular color space conversion, as outlined herein or otherwise appropriate, that has a higher likelihood of success in edge detection for that group than the current color space conversion. In various embodiments, the clustering component 422-2 may perform the clustering process described above for various edge detection techniques, resulting in a set of image groups where each set of image groups corresponds to a particular technique. Edge detection techniques vary in how they identify boundaries in an image, some techniques detect color differences, while others measure other attributes. Some techniques differ in how they measure color differences. Certain steps in one technique can be modified to create multiple techniques.

[0072] The color space conversion library 422-3 may include multiple color space conversion mechanisms and may generally be arranged to provide a color space conversion mechanism for applying to an image, converting that image to a transformed image according to a color space model that is different from the original color space model of the image. As described herein, a color space model refers to a technique for modeling the color data of an image, such as RGB or LAB, or RGB to XYZ, or RGB to XYZ to other XYZ. Generally, and as outlined in one or more embodiments herein, a color space conversion mechanism performs mathematical operations to map data points in the original / current color space model of an image to corresponding data points according to a different color space model. This may include converting values ​​of data points in one domain to corresponding values ​​of corresponding data points. As an example, a color space transformation may transform an RGB pixel having a tuple of RGB values ​​into a LAB pixel having a tuple of LAB values, an RGB pixel having a tuple of RGB values ​​into an XYZ pixel having a tuple of XYZ values, and / or an RGB pixel having a tuple of RGB values ​​into an XYZ pixel having a tuple of XYZ values, and again into other XYZ pixels having other tuples of XYZ values. The pixels associated with the final transformation may define a color distribution of a scannable image, such as a matrix or matrix barcode used for scanning associated with an entity, object, or environment.

[0073] The recognition component 422-4, such as a suitable scanner, printer and / or camera or application therefor, may generally be configured to perform edge detection techniques as part of a recognition operation on the transformed image. One example of a well-known recognition operation is optical character recognition (OCR). The application 420 invokes the recognition component 422-4 to perform various tasks including scanning a matrix, e.g., a matrix barcode or fiducial marker, to verify the authenticity of the item and / or to obtain encoded information associated with the barcode. The recognition component 422-4 may be configured to include a key, e.g., a mathematical formula or formulas with specified inputs that define a color space transformation, to scan the associated color reflected by the barcode. The color is based on one or more color space transformation techniques outlined herein. The key defines the final transformation that defines the color channels and color space associated with the colors of the scannable image. Each color channel defined by the key represents at least one bit of encoded data.

[0074] In various embodiments, the recognition component 422-4 may print or provide a schema for printing an image, e.g., a barcode and / or a fiducial marker, that includes one or more non-black and non-white colors and one or both of an ultraviolet layer and an infrared layer. The color channels associated with each of the non-black and non-white colors may each constitute at least one bit of data, and each of the infrared and ultraviolet layers may each constitute one bit of data. In various embodiments, each of the non-black and non-white colors is generated by a color space conversion mechanism or technique and is scannable by a key associated with the conversion mechanism. In various embodiments, the number of color channels may be adjusted to be four or more color channels, as the recognition component 422-4 may be adjusted to scan any number of colors, including colors that are not perceptible to the human eye.

[0075] In various embodiments, the non-black and non-white color channels may be used in combination with one or both of an infrared layer or an ultraviolet layer on a scannable image such as a matrix, matrix barcode and / or fiducial marker, with each of the color channels, ultraviolet layer, and / or infrared layer representing a bit of data and a different method of encoding data into the image, such that six or more bits of data may be encoded into the image. In various embodiments, the ultraviolet layer may be printed or displayed first in association with the infrared layer and various layers associated with the non-black and non-white color channels to take advantage of the properties of the ultraviolet layer.

[0076] In various embodiments, an image including all or one of the layers associated with the non-black and non-white color channel layers, the ultraviolet layer, and the infrared layer may be scanned by the recognition component 422-4 for verification. The recognition component 422-4 may include or receive a key based on an equation associated with the color space conversion, for example, Equation 1. The color space conversion reveals the associated color channel with the associated color that contains the information, in addition to one or more verification bits that indicate whether the presence or absence of the ultraviolet and / or infrared layers indicates encoded information. Thus, the key and / or verification bits provide a way to decode the information.

[0077] In various embodiments, the application 420 is configured to provide an output 430 once a scan of an image, e.g., a barcode, including the key and / or verification bits, is verified locally. In various embodiments, the recognition component 422-4 may require an additional verification step of contacting a host system including one or more of the functionality of the system 100 to verify, e.g., by one or more comparison steps, that the key and / or verification bits used by the recognition component 422-4 are accurate. If the key is accurate and the scan is verified by the recognition component 422-4, the output 430 of the application 420 is one or more of access, transfer, or receipt of information, including currency, personal, and / or financial information, to another entity.

[0078] In various embodiments, scanning an image, e.g., a matrix, a matrix barcode, and / or a fiducial marker, may be performed to protect a user from financial misappropriation. The recognition component 422-4 may perform text or image recognition operations to determine whether the image, e.g., a barcode, is valid, and according to some embodiments, may associate the validity of the scan with verifying or accessing information, including any sensitive information, such as a password or a social security number (SSN). The application 420 may invoke the recognition component 422-4 to scan an image, e.g., a barcode, prior to publishing social network content, such that identification of sensitive information within the content may prevent said publication, potentially preventing the image from being properly scanned, e.g., if the component scanning the image does not have a key associated with the color space information and / or a key to properly decode according to bits indicating that the ultraviolet and / or infrared layers contain information. In various other embodiments, the scanning of an image, e.g., a barcode, may provide for the initiation of a financial transaction, e.g., any suitable electronic transfer of funds.

[0079] Included herein are a series of flow charts depicting example methodologies for implementing novel aspects of the disclosed architecture. For ease of explanation, one or more methodologies illustrated herein, e.g., in the form of a flow chart or flow diagram, are shown and described as a series of acts, however, it should be understood that the methodologies are not limited by the order of acts, as some acts may occur in different orders and / or concurrently with other acts according to the present disclosure. For example, one skilled in the art may understand and appreciate that a methodology can alternatively be represented as a series of interrelated states or events, such as a state diagram. Moreover, not all acts illustrated in a methodology are required for a new implementation.

[0080] 5A illustrates one embodiment of a logic flow 500A. The logic flow 500A may represent some or all of the operations performed by one or more embodiments described herein.

[0081] In the illustrated embodiment shown in FIG. 5A, logic flow 500A receives (502) a representative dataset of a target, such as an entity, object, or environment. For example, logic flow 500 may receive a representative dataset including at least one of i) one or more images of the target, and ii) one or more videos of the target, where the target includes at least one of i) the environment, ii) a live entity, and iii) an object using any suitable camera or scanning device. The representative dataset is included in image group model data 350 or is obtained directly by scanning the target using any suitable device, e.g., camera or video device 195 and / or scanning device 197. In various embodiments, the target may be an environment that includes a scannable image therein.

[0082] Logic flow 500A may process the representative data set into an appropriate representation of the color scheme, such as a histogram (504). For example, logic flow 500 may examine image group model data 350, which includes captured data of a scanned environment. Once logic flow 500 identifies the scanned data of the environment, the logic flow may process the data into a histogram in a particular color space, for example, the RGB color space.

[0083] Logic flow 500A may utilize a histogram to identify the most common colors of the environment (506). In various embodiments, the logic flow identifies the most common colors for applying a color space conversion mechanism to substantially maximize edge detection of scannable images such as matrices, matrix barcodes, fiducial markers, and the like.

[0084] The logic flow 500A may determine a number of associated colors based on a histogram 508. For example, the histogram may be used to map to a first color space in which least common and / or absent colors are determined relative to the most common colors of the target, and the least common and / or absent colors form the basis of one or more color channels in a second color space.

[0085] In various embodiments, the associated plurality of colors may represent a range of colors between the most common and least common and / or absent colors of the target, including the only color not present in association with the target and / or the least common color in association with the target. In various embodiments, to determine based on the number of associated colors, the logic flow may select and apply a color space conversion mechanism to the image data associated with the histogram. As described herein, the image data may include color data configured according to a color space model, e.g., a histogram may be used to create a color space representation of the target data. In some embodiments, the logic flow 500 applies the color space conversion mechanism 180 of FIG. 1 by converting the image data to transformed image data comprising color data according to another color space model that is different from the color space associated with the histogram. For example, the logic flow may create a histogram of the image data associated with the target and then use the histogram to create a first color space representation of the target, e.g., an RGB color space representation. Thereafter, as described below, the logic flow may perform one or more additional color space conversion techniques to another color space, such as the XYZ color space or any other suitable color space utilizing a tristimulus system.

[0086] In various embodiments, logic flow 500A can manipulate color data of the original image data to perform a color space transformation to enable efficient edge detection of the transformed image data. As described below, logic flow 500A can modify the color space model to quickly identify boundaries, such as when two colors are close together. Logic flow 500A examines each data point in the image, and for each location, logic flow 500A identifies a color. In various embodiments, the color space transformation can determine at least one set of color coordinates corresponding to a plurality of related colors in the (second) other color space based on at least one set of color coordinates for each of the most common colors according to the other (or second) color space. The at least one set of coordinates of the most common colors is either or both perpendicular / orthogonal and maximum distance to the at least one set of coordinates of the related colors with respect to the other color space. In various embodiments, the second color space can be considered a derived color space of the first color space.

[0087] In various embodiments, this ensures that the colors used in the scannable image may maximize edge detection, since the maximum distance between the target's general color channels and colors in the environment and other color channels and colors (associated color channels and colors) ensures that the associated color channels and colors are not present in the target and / or are not the most common in the target. Furthermore, if the associated colors and color channels are selected to be perpendicular or orthogonal to the target's color channels and colors (and to each other), this may further enhance edge detection.

[0088] In one example utilizing one or more of the techniques outlined above, logic flow 500A proceeds to identify two or more colors by their prevalence in the target and compose them into one channel. For example, consider a first color and a second color with first and second highest prevalence, respectively. Now, the first color will be at a minimum in the color channel and the second color will be at a maximum, such that the boundary can be the transition between these colors. This boundary can be at least one pixel where the color changes from the first color to the second color or vice versa. If the first color is set to zero (0) and the second color is set to two hundred and fifty-five (255), then mathematically this boundary can be located at the pixel that jumped between the minimum and maximum values. For example, there can be a sharp division (i.e., a thin boundary) where at least two adjacent pixels immediately transition between 0 and 255.

[0089] As alluded to above, these color channels may correspond to a first color space, e.g., RGB, which may be based on a first set of tristimulus values, and the first color space may have color coordinates to represent the target colors, e.g., the most common colors of the target. Next, logic flow 500A may identify one or more colors that are unused or rarely used (i.e., least common or nonexistent) and establish those colors in the other channels to be opposite the common colors identified above. The new color channel (or color channels) forms the basis of a new color space, e.g., a new set of tristimulus values ​​in the XYZ color space, and the first color space is transformed to a second color space.

[0090] Logic flow 500A may then perform one or more additional operations, such as configuring the color channels of the new color space to be perpendicular or orthogonal to each other in the new color space model, performing an additional conversion to a third color space including an intermediate operation to filter features not related to chromaticity, such as luminance or lightness channels, and / or performing an orientation operation in the second (or third) color space (to maximize the distance between the color channels, thereby enhancing edge detection) before making the color channels perpendicular or orthogonal to each other.

[0091] Logic flow 500A may utilize the associated colors of block 508 to create one or more scannable images, such as a matrix, a matrix barcode, a fiducial marker, or any other image suitable for scanning (510). In various embodiments, the associated colors may be the colors of each color channel associated with the final color space conversion described above, e.g., multiple color channels and associated colors that may be represented in an XYZ color space, and may be uncommon in the target and / or completely absent in the target. In various embodiments, the least common and / or absent colors may be positioned orthogonal to each other to further enhance edge detection. In various embodiments, the scannable image may be a matrix barcode formed to reflect the colors of each of the least common and / or absent and / or orthogonal color channels with respect to the environment including the target, e.g., the matrix barcode.

[0092] In various embodiments, the matrix barcode has embedded information based on color space transformation. For example, each pixel associated with the matrix barcode is associated with a color channel of a final color space, such as an XYZ color space with color channels representing the least common or non-existent colors of the environment. Each color channel represents a bit of data, and the number of color channels can be three or more, four or more, etc. (as there are no limitations imposed by human perception). And by extension, the number of encoded bits can be three or more, four or more, etc.

[0093] In various embodiments in which four or more colors are used, each of the four or more colors is a distinct color relative to one another, and based on the color space techniques discussed herein and above, the four or more colors are derived from a plurality of coordinates corresponding to each of at least four different colors along a transformed (derived) color space. The transformed (derived) color space includes a plurality of coordinate sets representing at least four common colors of a target, e.g., an environment. Each of the four or more colors corresponds to a distinct set of coordinates in the transformed (derived) color space.

[0094] In various embodiments, each of the four or more different colors is selected based on having a maximum opposite coordinate relationship with respect to at least one of a plurality of sets of coordinates representing at least four common colors in the target, e.g., environment.

[0095] There are several applicable edge detection techniques, and the edge detection technique 190 may be appropriate for one color space model of the transformed image data, while another edge detection technique may be appropriate for the original color space model, and the embodiment is not limited to this example.

[0096] 5B illustrates one embodiment of a logic flow 500B. The logic flow 500B may represent some or all of the operations performed by one or more embodiments described herein.

[0097] In the illustrated embodiment shown in FIG. 5B, the logic flow may detect a matrix including one or more non-black and non-white colors, each of which is i) at least one of the colors not present in association with the environment, and / or ii) at least one least common color associated with the environment 515. In various embodiments, the matrix is ​​a barcode constructed with one or more color space conversion techniques as outlined herein, for example, the matrix barcode is derived from an RGB color space and a derived color space of the RGB color space (a color space converted (derived) from the RGB color space, such as the XYZ color space). In various embodiments, the derived color space is the XYZ color space with a filtered luminance channel.

[0098] In various embodiments, the barcode may be scanned using any suitable component, e.g., scanning device 197, having a suitable key, e.g., tristimulus equations associated with a conversion to an XYZ color space, that reveals color channels associated with colors associated with scannable portions of the matrix barcode, which in various embodiments include information encoded in the matrix barcode. In various embodiments, the barcode may include four or more distinct colors, each associated with at least four distinct color channels, each color being different from each other and different from the most common color of the environment. In various embodiments, the colors and color channels of the barcode may be calculated according to a coordinate relationship between the most common and least common and / or non-existent colors in a derived color space, including a maximum distance between the most common and least common and / or non-existent colors. Additional or different color space conversion techniques may be used, as discussed herein, and this is merely one example consistent with the present disclosure.

[0099] In various embodiments, the barcode may be printed and / or embedded in a physical medium, e.g., a physical surface or material, in the least common and / or non-existent color using any suitable component, e.g., printing device 199, and the barcode may be scanned along the surface of the physical surface. In other embodiments, any suitable computing device, including a computer, laptop, or tablet (shown in FIG. 7 provided below), may be configured to generate a scannable barcode that reflects the least common or non-existent color such that the barcode may be scanned along the surface of a computer display.

[0100] The logic flow 500B may transmit 520 the results of the scan to any suitable computing device discussed herein, including an indication as to whether the barcode was successfully scanned and whether any encoded information associated therewith was obtained.

[0101] 5C illustrates one embodiment of a logic flow 500C. The logic flow may represent some or all of the operations performed by one or more embodiments described herein.

[0102] In the illustrated embodiment shown in FIG. 5C, logic flow 500C performs one or more of the operations of flow 500C, which in one embodiment performs operations 502, 504, 506, and 508.

[0103] Logic flow 500C may utilize the associated colors to generate a scannable image such as a matrix, matrix barcode, fiducial marker, or any other suitable image for scanning 530, where the scannable image may include one or both of an ultraviolet layer and an infrared layer in addition to including non-black and non-white colors (such as the least common and / or non-existent colors associated with the target, e.g., environment, etc.). In various embodiments, the matrix, matrix barcode, fiducial marker, or any other suitable image may be printed and / or embedded into a physical surface using any suitable component, e.g., printing device 199, with the least common and / or non-existent colors and the infrared and / or ultraviolet layer, and the barcode may be scanned along the surface of the physical surface. In other embodiments, any suitable computing device, including a computer, laptop, or tablet (illustrated in FIG. 7 provided below), may be configured to generate a scannable barcode that reflects the least common or non-existent colors, the ultraviolet layer, and / or the infrared layer. The matrix, matrix barcode, fiducial marker, or any other suitable image may be scanned along the surface of a computer display.

[0104] In various embodiments, the ultraviolet layer may be printed along the physical surface first and / or may form a top layer generated on a computer screen to maximize the benefits associated with ultraviolet light. In various embodiments, the color of the scannable image does not need to be a color that is related to the environment and / or is not based on color space conversion techniques, but can be any color including standard black and white, using a scannable image that includes both infrared and ultraviolet layers for detection.

[0105] 5D illustrates one embodiment of a logic flow 500D. The logic flow 500D may represent some or all of the operations performed by one or more embodiments described herein.

[0106] In the illustrated embodiment shown in Figure 5D, the logic flow may detect a scannable image, e.g., a matrix, that includes one or more non-black and non-white colors, each of which is at least one of i) a color that is not present in association with the environment, and / or ii) a least common color associated with the environment, in addition to one or both of an ultraviolet and / or infrared layer 540. In various embodiments, the matrix is ​​a barcode constructed with one or more color space conversion techniques outlined herein, e.g., as described with respect to Figure 5B, with the addition of an ultraviolet and / or infrared layer.

[0107] In various embodiments, a scannable image, e.g., a barcode, may be scanned with any suitable component, e.g., scanning device 197, having a suitable key, e.g., a tristimulus equation associated with a conversion to an XYZ color space, which in various embodiments reveals color channels having associated colors associated with the scannable portions of the matrix barcode, including the information encoded in the matrix barcode. In addition to the key, any suitable component, e.g., scanning device 197, may also have a verification bit indicating whether an ultraviolet layer and / or an infrared layer is associated with the information, and if so, performs a scan and / or decodes the information based on the verification bit. In various embodiments, the barcode may include four or more distinct colors, each associated with at least four distinct color channels, each color being different from each other and different from the most common colors of the environment in addition to having one or both of an ultraviolet layer and / or an infrared layer, such that the scan may be a scan of six or more bits of information.

[0108] In various embodiments, the barcode may be printed and / or embedded into the physical surface in the least common and / or non-existent color using any suitable component, e.g., printing device 199, and the barcode may be scanned along the surface of the physical surface. In other embodiments, any suitable computing device, including a computer, laptop, or tablet (illustrated in FIG. 7 provided below), may be configured to generate a scannable barcode reflecting the least common or non-existent color, and the barcode may be scanned along the surface of a computer display. In various embodiments, the print of the scannable image, e.g., the barcode, may have an ultraviolet layer as the top layer, and any associated scan may consider the ultraviolet layer first. Similarly, in various embodiments, if the scannable image is generated by a computing device and displayed by a computer display, the first layer displayed by the computing device may be the ultraviolet layer.

[0109] Logic flow 500D may transmit 550 the results of the scan to any suitable computing device as discussed herein, including an indication of whether the barcode was successfully scanned, plus any associated encoded information obtained.

[0110] 6A illustrates one technique 600A for forming a scannable image in accordance with at least one embodiment of the present disclosure. Scannable image layers 605a, 610a, and 615a each represent a layer of a scannable image, such as a barcode, associated with one or more colors. Any suitable component disclosed herein may perform one or more color space conversion techniques on each scannable image layer 605a, 610a, 615a to generate layers 620a, 625a, and 630a, which may be combined into a single scannable image, e.g., barcode 635a. In various embodiments, scannable layers 620a, 625a, and 630a may each be associated with a color channel that represents one or more colors that are not present and / or uncommon with respect to a target that may be associated with scannable image 635a. In various embodiments, the one or more color channels associated with the colors of 620a, 625a, and 630a may be orthogonal or perpendicular to one another with respect to the color space in which they are represented. Scannable image 635a may be printed on a target physical surface using any suitable device and / or generated by any suitable computing device for display on a computer display.

[0111] Although the embodiment of FIG. 6A illustrates performing a conversion technique with respect to a color scheme associated with existing scannable image layers 605a, 610a, and / or 615a, scannable image 635a may be generated from scratch without conversion from an existing image; for example, a target may be scanned and its associated color space determined therefrom, and final scannable image 635a may be generated by performing one or more color space conversions on the color space as disclosed herein or in other suitable manner.

[0112] 6B illustrates one technique 600B for forming a scannable image according to at least one embodiment of the present disclosure. Scannable image layers 605b, 610b, and 615b each represent a layer of a scannable image, such as a barcode, associated with one or more colors. Any suitable component disclosed herein may perform one or more color space conversion techniques on each scannable image layer 605b, 610b, 615b to generate layers 620b, 625b, and 630b, and layers 620b, 625b, and 630b may be combined into a single scannable image 635b, e.g., barcode 635b. In various embodiments, scannable layers 620b, 625b, and 630b each may be associated with a color channel that represents one or more colors that are not present and / or uncommon with respect to a target that may be associated with scannable image 635b. In various embodiments, one or more color channels associated with the colors of 620b, 625b, and 630b may be orthogonal or perpendicular to one another with respect to the color space representing those colors. In various embodiments, at least one layer, e.g., 630b, may be made with ultraviolet or infrared ink or produced using ultraviolet or infrared light and may include additional channels of information, e.g., an ultraviolet or infrared layer of information, that may absorb, reflect, project, and / or emit ultraviolet or infrared light. In various embodiments, the ultraviolet or infrared layer 630b may be the first layer of the image 635b. In various embodiments, the ultraviolet or infrared layer 630b may include color channel layers representing various colors, including colors that are uncommon and / or absent from the target associated with the scannable image 635b, and in various embodiments, only the ultraviolet channel may be associated with the ultraviolet layer 630b.

[0113] In various embodiments, the scannable image 635b may be printed on the physical surface of the target using any suitable device and / or may be generated by any suitable computing device for display on a computer display.

[0114] In various embodiments, the scannable image 635b is a fiducial marker that takes advantage of the inherent orientation features of ultraviolet and / or infrared light when scanned by a suitable device that can detect one or both of ultraviolet and / or infrared light. In various embodiments, when a suitable device, e.g., the scanning device 197, scans the fiducial marker 635b that reflects ultraviolet and / or infrared light, it is easy to ascertain the spatial relationship of an object associated with the fiducial marker 635b, e.g., an object having the fiducial marker labeled thereon and / or a computer display generating the fiducial marker 635b, relative to other objects in the scanning device 197 and the environment that contains the device, due to the inherent properties associated with the reflection and detection of ultraviolet and / or infrared light.

[0115] 6C illustrates one technique 600C for forming a scannable image in accordance with at least one embodiment of the present disclosure. Scannable image layers 605c, 610c, 615c, and 620c each represent a layer of a scannable image, such as a barcode, associated with one or more colors. Any suitable component disclosed herein may perform one or more color space conversion techniques on each scannable image layer 605c, 610c, 615c, and 620c to generate layers 625c, 630c, 635c, and 640c, which may be combined into a single scannable image, such as, for example, barcode 645c. In various embodiments, scannable layers 625c, 630c, 635c, and 640c may each be associated with a color channel that represents one or more colors that are not present and / or uncommon with respect to a target that may be associated with the scannable image. In various embodiments, the one or more color channels associated with the colors of 625c, 630c, 635c, and 640c may be orthogonal or perpendicular to one another with respect to the color space representing those colors.

[0116] In various embodiments, at least one layer, e.g., 635c, may be made of infrared ink or may be generated using infrared light to include an additional channel of information, e.g., an ultraviolet layer of information, that may absorb, reflect, project, and / or emit infrared light, and in various embodiments, infrared layer 630c may be the first layer of image 635c. In various embodiments, infrared layer 630c may include color channel layers representing various colors, including colors that are uncommon and / or absent in the target associated with scannable image 645c, and in various embodiments, only infrared channels may be associated with infrared layer 630d. In various embodiments, at least one layer, e.g., 640c, may be made of ultraviolet ink or may be generated using ultraviolet light to include an additional channel of information, e.g., an ultraviolet layer of information, that may absorb, reflect, project, and / or emit ultraviolet light, and in various embodiments, ultraviolet layer 640c may be the first layer of image 645c. In various embodiments, the ultraviolet layer 640c may include a color channel layer representing various colors including uncommon and / or non-existent colors from the target to be associated with the scannable image 645c, and in various embodiments, only the ultraviolet channel may be associated with the ultraviolet layer 640c.

[0117] In various embodiments, the scannable image 645c is a fiducial marker that utilizes the inherent orientation features of ultraviolet and / or infrared light when scanned by a suitable device that can detect one or both of ultraviolet and / or infrared light. In various embodiments, when a suitable device, e.g., scanning device 197, scans fiducial marker 645c that reflects both ultraviolet and infrared light, the spatial relationship of the object associated with fiducial marker 645c, e.g., the object on which the fiducial marker is labeled and / or the computer display that produces fiducial marker 645c, in relation to other objects in the scanning device 197 and the environment that contains the device, is easy to see or detect because of the inherent properties associated with reflecting and detecting ultraviolet and / or infrared light. In various embodiments where fiducial marker 645c utilizes both ultraviolet and infrared light, the presence of both acts as a fail-safe in case the functionality of scanning device 197 is compromised and / or an initial scan fails to detect one or the other.

[0118] In various embodiments, the scannable image 645c may include both an infrared layer 635c and an ultraviolet layer 640c, with the printing or generation of layer 645c being the first layer to utilize the properties associated with ultraviolet light. At least one embodiment provided above indicates that one or both of layers 635c and 640c may include color channel information, e.g., scannable colors having a relationship to the target, but in various embodiments, layers 635c and 640c may be strictly associated with infrared and / or ultraviolet information, respectively. Furthermore, in various embodiments, the colors of layers 620c, 625c, and 630c need not be layers having a relationship to the target, and in various embodiments, said layers may be composed of black and white colors and / or other colors not related to the target and / or not based on color space conversion techniques.

[0119] FIG. 7 illustrates a computer or tablet system 700 for generating and scanning a scannable image 740. The tablet system includes a tablet 702 for generating a scannable image 740, e.g., a barcode, the tablet 702 includes applications 705A-E, application N, and application 420, one embodiment of which is described in more detail above with respect to FIG. 4. The tablet 702 may include one or more user interface devices 720 that a user may use to interface with the tablet 702. The tablet 702 may generate a scannable image 740 that includes one or both of an ultraviolet layer and an infrared layer. The tablet 702 may be configured to ensure that the top layer is an ultraviolet layer to take advantage of the unique properties of ultraviolet light. The image may further include one or more color layers, including white and black layers. The image may further include one or more non-black and non-white color layers that are associated with colors associated with the environment in which the tablet is placed. For example, the tablet may be configured to have a camera with an application. It may scan an environment and generate a scannable image 740 having colors associated with the environment. In various embodiments, the colors associated with the environment may be determined by one or more color space transformations based on one or more color space transformation techniques as discussed herein, including colors that are least common and / or not present in the environment including tablet 702.

[0120] The system 700 may further include a camera or scanning device c750 that may scan the scannable image 740, and in various embodiments the camera or scanning device c750 may include the application 420 (as described above), and / or a color space key and / or infrared validation bits and / or ultraviolet validation bits as disclosed herein, to perform a valid scan of the scannable image 740 and / or to obtain any encoded information associated therewith.

[0121] 8 illustrates an embodiment of a graphical user interface (GUI) 800 for an application of system 100. In some embodiments, user interface 800 is configured for application 420 of FIG.

[0122] As shown in FIG. 8, the GUI 800 includes several components such as a toolbar 802 and GUI elements. The toolbar 802 includes, as an example tool, a recognize text tool 804 that, when invoked, scans an image 806, for example, a barcode generated from one or more color space techniques and / or including one or both of an ultraviolet layer and / or an infrared layer as outlined herein. The scan may use a key and / or verification bit to ensure a valid scan is made, and a proper scan may act as a security measure to access and / or identify sensitive information 808. As described herein, a proper color space conversion mechanism provides the most accurate edge detection results since the underlying color space model has a higher probability of edge detection than other applicable color space models and the barcode may be generated with this in mind.

[0123] 9 illustrates an embodiment of an exemplary computing architecture 900 suitable for implementing various embodiments as described above. In one embodiment, the computing architecture 900 may include or be implemented as part of an electronic device. Examples of electronic devices may include, among others, those described with reference to FIG. 3. The embodiments are not limited in this context.

[0124] The terms "system" and "component" as used in this application are intended to refer to any computer-related entity, either hardware, a combination of hardware and software, software, or software in execution, examples of which are provided by the exemplary computing architecture 900. For example, a component may be, but is not limited to, a process running on a processor, a processor, a hard disk drive, multiple storage drives (of optical and / or magnetic storage media), an object, an executable, a thread of execution, a program, and / or a computer. As an example, both an application running on a server and the server may be a component. One or more components may reside within a process and / or thread of execution, and a component may be localized on one computer and / or distributed among two or more computers. Furthermore, components may be communicatively coupled to one another by various types of communication media to coordinate operations. Coordination may include unidirectional or bidirectional exchange of information. For example, components may communicate information in the form of signals communicated over the communication media. The information may be embodied as signals assigned to various signal lines. In such an assignment, each message is a signal. However, further embodiments may use data messages as an alternative. Such data messages may be transmitted over a variety of connections, examples of which include parallel interfaces, serial interfaces, and bus interfaces.

[0125] Computing architecture 900 may include various common computing elements, such as one or more processors, multi-core processors, co-processors, memory units, chipsets, controllers, peripherals, interfaces, oscillators, timing devices, video cards, audio cards, multimedia input / output (I / O) components, power supplies, etc. However, embodiments are not limited to implementation with computing architecture 900.

[0126] As shown in FIG. 9, the computing architecture 900 includes a processing unit 904, a system memory 906, and a system bus 908. The processing unit 904 may be any of a variety of commercially available processors, including, but not limited to, AMD® Athlon®, Duron® and Opteron® processors, ARM® application, embedded and secure processors, IBM® and Motorola® DragonBall® and PowerPC® processors, IBM and Sony® Cell processors, Intel® Celeron®, Core®, Core(2)Duo®, Itanium®, Pentium®, Xeon®, and XScale® processors and similar processors. Dual microprocessors, multi-core processors, and other multi-processor architectures may also be used as the processing unit 904.

[0127] The system bus 908 provides an interface to system components including, but not limited to, the processing unit 904 from the system memory 906. The system bus 908 may be any of several types of bus structures that may further interconnect to a memory bus (with or without a memory controller), a peripheral bus, and a local bus using any of a variety of commercially available bus architectures. Interface adapters may connect to the system bus 908 through a slot architecture. Examples of slot architectures include, but are not limited to, Accelerated Graphics Port (AGP), CardBus, (Enhanced) Industry Standard Architecture ((E)ISA), MicroChannel Architecture (MCA), NuBus, Peripheral Component Interconnect (Enhanced) (PCI(X)), PCI Express, Personal Computer Memory Card International Association (PCMCIA), and the like.

[0128] The computing architecture 900 may comprise or be embodied in a variety of articles of manufacture. The articles of manufacture may comprise a computer-readable storage medium for storing logic. Examples of computer-readable storage media may include any tangible medium capable of storing electronic data, including volatile or non-volatile memory, removable or non-removable memory, erasable or non-erasable memory, writable or re-writable memory, and the like. Examples of logic may include executable computer program instructions implemented using any suitable type of code, such as source code, compiled code, interpreted code, executable code, static code, dynamic code, object-oriented code, visual code, and the like. The embodiments may also be implemented at least in part as instructions contained in or on a non-transitory computer-readable medium, which may be read and executed by one or more processors to enable performance of the operations described herein.

[0129] The system memory 906 may include various types of computer readable storage media in the form of one or more high speed memory units such as read only memory (ROM), random access memory (RAM), dynamic RAM (DRAM), double data rate DRAM (DDRAM), synchronous DRAM (SDRAM), static RAM (SRAM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, polymer memory such as ferroelectric polymer memory, ovonic memory, phase change or ferroelectric memory, silicon oxide nitride oxide silicon (SONOS) memory, magnetic or optical cards, arrays of devices such as redundant array of independent disks (RAID) drives, solid state memory devices (e.g., USB memory, solid state drive (SSD)), and other types of storage media suitable for storing information. In the illustrated embodiment shown in FIG. 9, the system memory 906 may include a non-volatile memory 910 and / or a volatile memory 912. The non-volatile memory 910 may store a basic input / output system (BIOS).

[0130] The computer 902 may include various types of computer-readable storage media in the form of one or more low-speed memory units, including an internal (or external) hard disk drive (HDD) 914, a magnetic floppy disk drive (FDD) 916 that reads from or writes to a removable magnetic disk 918, and an optical disk drive 920 that reads from or writes to a removable optical disk 922 (e.g., a CD-ROM or DVD). The HDD 914, FDD 916, and optical disk drive 920 may be connected to the system bus 908 by a HDD interface 924, a FDD interface 926, and an optical drive interface 928, respectively. The HDD interface 924 for an external drive implementation may include at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.

[0131] The drives and associated computer-readable media provide volatile and / or nonvolatile storage of data, data structures, computer-executable instructions, etc. For example, a number of program modules may be stored on the drives and memory units 910, 912, including an operating system 930, one or more application programs 932, other program modules 934, and program data 936. In one embodiment, the one or more application programs 932, other program modules 934, and program data 936 may include, for example, various applications and / or components of system 100.

[0132] A user may enter commands and information into the computer 902 through one or more wired / wireless input devices, for example, a keyboard 938 and a pointing device such as a mouse 940. Other input devices may include a microphone, infrared (IR) remote control, radio frequency (RF) remote control, game pad, stylus pen, card reader, dongle, fingerprint reader, grab, graphic tablet, joystick, keyboard, retina reader, touch screen (e.g., capacitive, resistive, etc.), track ball, track pad, sensor, stylus, etc. These and other input devices are often connected to the processing unit 904 through an input device interface 942 coupled to the system bus 908, but may be connected by other interfaces, such as a parallel port, an IEEE 1394 serial port, a game port, a USB port, an IR interface, etc.

[0133] A monitor 944 or other type of display device is also connected to the system bus 908 via an interface, such as a video adapter 946. The monitor 944 can be internal or external to the computer 902. In addition to the monitor 944, computers typically include other peripheral output devices, such as speakers, printers, etc.

[0134] The computer 902 may operate in a networked environment using logical connections via wired and / or wireless communications to one or more remote computers, such as a remote computer 948. The remote computer 948 may be a workstation, a server computer, a router, a personal computer, a portable computer, a microprocessor-based entertainment device, a peer device, or other common network node, and typically includes many or all of the elements described relative to the computer 902, although for purposes of brevity, only a memory / storage device 950 is shown. The logical connections shown include wired / wireless connections to a local area network (LAN) 952 and / or larger networks, e.g., a wide area network (WAN) 954. Such LAN and WAN networking environments are commonplace in offices and businesses, facilitating enterprise-wide computer networks, such as intranets. All of these may connect to a global communications network, e.g., the Internet.

[0135] When used in a LAN networking environment, the computer 902 is connected to the LAN 952 through a wired and / or wireless communication network interface or adapter 956. The adapter 956 may facilitate wired and / or wireless communication to the LAN 952, which may include a wireless access point disposed thereon for communicating with the wireless functionality of the adapter 956.

[0136] When used in a WAN networking environment, the computer 902 may include a modem 958 or have other means for establishing communications over the WAN 954, such as connected to a communications server on the WAN 954 or via the Internet. The modem 958 may be internal or external, a wired and / or wireless device, and connects to the system bus 908 via the input device interface 942. In a networked environment, program modules depicted relative to the computer 902, or portions thereof, may be stored in the remote memory / storage device 950. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

[0137] The computer 902 is operable to communicate with wired and wireless devices or entities using the IEEE 802 family of standards, such as wireless devices operatively arranged for wireless communication (e.g., IEEE 802.11 wireless modulation technology). This includes at least Wi-Fi (or Wireless Fidelity), WiMax, Bluetooth wireless technologies, and the like. Thus, communication can be a predefined structure, as with traditional networks, or simply ad-hoc communication between at least two devices. Wi-Fi networks provide secure, reliable, and fast wireless connectivity using radio technologies called IEEE 802.11x (a, b, g, n, etc.). Wi-Fi networks can be used to connect computers to each other, to the Internet, and to wired networks (using IEEE 802.3 related media and functions).

[0138] 10 illustrates a block diagram of an exemplary communications architecture 1000 suitable for implementing various embodiments as described above. Communications architecture 1000 includes various common communications elements such as transmitters, receivers, transceivers, radios, network interfaces, baseband processors, antennas, amplifiers, filters, power supplies, etc. However, embodiments are not limited to implementation with communications architecture 1000.

[0139] 10, communications architecture 1000 includes one or more client(s) 1002 and server(s) 1004. Client(s) 1002 may implement client device 310. Server(s) 1004 may implement server device 950. Client(s) 1002 and server(s) 1004 are operatively connected to one or more respective client data store(s) 1008 and server data store(s) 1010 that may be employed to store information local to the respective client(s) 1002 and server(s) 1004, such as cookie(s) and / or associated contextual information.

[0140] The clients 1002 and the servers 1004 may communicate information with each other using a communications framework 1006. The communications framework 1006 may implement any well-known communications technology and protocol. The communications framework 1006 may be implemented as a packet-switched network (e.g., a public network such as the Internet, a private network such as a corporate intranet, etc.), a circuit-switched network (e.g., the public switched telephone network), or a combination of packet-switched and circuit-switched networks (with appropriate gateways and translators).

[0141] The communications framework 1006 may implement various network interfaces configured to accept, communicate, and connect to communications networks. A network interface may be considered a specialized form of input / output interface. A network interface may employ a connection protocol including, but not limited to, direct connection, Ethernet (e.g., thick, thin, twisted pair 10 / 100 / 1000 base-T, etc.), token ring, wireless network interface, cellular network interface, IEEE 802.11ax network interface, IEEE 802.16 network interface, IEEE 802.20 network interface, etc. Additionally, multiple network interfaces may be used to interface with various communications network types. For example, multiple network interfaces may be used to enable communications over broadcast, multicast, and unicast networks. If processing requirements call for greater speed and capacity, a distributed network controller architecture may similarly be used to pool, load balance, and otherwise increase the communications bandwidth required by the clients 1002 and the servers 1004. The communications network may be any one and combination of wired and / or wireless networks, including, but not limited to, direct interconnects, secure custom connections, private networks (e.g., enterprise intranets), public networks (e.g., the Internet), personal area networks (PANs), local area networks (LANs), metropolitan area networks (MANs), operational missions as nodes on the Internet (OMNIs), wide area networks (WANs), radio networks, cellular networks, and other communications networks.

[0142] Some embodiments may be described using the terms "in one embodiment" or "embodiments" along with their derivatives. These terms mean that a particular feature, structure, or characteristic described in connection with an embodiment is included in at least one embodiment. The appearances of the phrase "in one embodiment" in various places in this specification do not necessarily all refer to the same embodiment. Additionally, some embodiments may be described using the terms "coupled" and "connected" along with their derivatives. These terms are not necessarily intended as synonyms for each other. For example, some embodiments may be described using the terms "connected" and / or "coupled" to indicate that two or more elements are in direct physical or electrical contact with each other. However, the term "coupled" may mean that two or more elements are not in direct contact with each other but still cooperate or interact with each other.

[0143] It is emphasized that the Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it cannot be used to interpret or limit the scope or meaning of the claims. Moreover, in the foregoing detailed description, it will be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure should not be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in fewer than all features of a single disclosed embodiment. Accordingly, the following claims are hereby incorporated into the detailed description, with each claim standing on its own as a separate embodiment. In the appended claims, the terms "including" and "wherein" are used as the plain English equivalents of the respective terms "comprising" and "wherein." Furthermore, the terms "first," "second," "third," etc. are used merely as labels and are not intended to impose numerical requirements on the objects.

[0144] What has been described above includes examples of the disclosed architecture. Of course, it is not possible to describe every conceivable combination of components and / or methodologies, but one of ordinary skill in the art may recognize that many more combinations and permutations are possible. Accordingly, the novel architecture is intended to embrace all such alterations, modifications, and variations that fall within the spirit and scope of the appended claims.

Claims

1. a processor accessing a histogram of the environment generated based on one or more images of the environment; determining, based on the histogram, the most common colors associated with the environment by mapping the most common colors according to a red-green-blue (RGB) color space, the RGB color space being converted to another color space; determining at least one set of color coordinates for each of the most common colors according to the other color space; determining, based on at least one set of color coordinates for each of the most common colors according to the other color space, at least one set of color coordinates corresponding to a plurality of related colors according to the other color space; determining, based on the histogram, color coordinates corresponding to the associated colors, the associated colors based on the processor; generating a matrix barcode using the associated plurality of colors and ultraviolet light layers; A computer-implemented method comprising:

2. The computer-implemented method of claim 1 , wherein the associated plurality of colors includes at least one of a color that is not present in association with the environment or a least common color associated with the environment.

3. The method comprises: generating the histogram of the environment based on the one or more images of the environment; The computer-implemented method of claim 1 , further comprising:

4. 2. The computer-implemented method of claim 1, wherein the other color space including a luminance channel is generated based on a transformation of the RGB color space, and the luminance channel is removed from the other color space.

5. The computer-implemented method of claim 4 , wherein removing the luminance channel generates a set of color coordinates according to the other color space.

6. 2. The computer-implemented method of claim 1, wherein the matrix barcode has embedded computer data represented by a plurality of pixels that are partially associated with the ultraviolet light layer and each of the associated plurality of colors.

7. 10. The computer-implemented method of claim 1, wherein the matrix barcode is a fiducial marker for communicating spatial information, the communicated spatial information being derived at least in part from the ultraviolet light layer.

8. A non-transitory computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to: accessing a histogram of the environment generated based on one or more images of the environment; determining the most common colors associated with the environment based on the histogram by mapping the most common colors according to a Red-Green-Blue (RGB) color space, where the RGB color space is converted to another color space; determining at least one set of color coordinates for each of the most common colors according to the other color space; and determining at least one set of color coordinates corresponding to a plurality of related colors according to the other color space based on at least one set of color coordinates for each of the plurality of most common colors according to the other color space; determining the associated colors based on color coordinates corresponding to the associated colors based on the histogram; and generating a matrix barcode using said associated plurality of colors and ultraviolet light layers; A non-transitory computer-readable storage medium for causing the computer to execute

9. 9. The non-transitory computer-readable storage medium of claim 8, wherein the associated plurality of colors includes at least one of a color that is not present in association with the environment or a least common color associated with the environment.

10. The instructions cause a computer to: The non-transitory computer-readable storage medium of claim 8 , further configured to generate the histogram of the environment based on the one or more images of the environment.

11. 9. The non-transitory computer-readable storage medium of claim 8, wherein the other color space including a luminance channel is generated based on a transformation of the RGB color space, and the luminance channel is removed from the other color space.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the removal of the luminance channel produces a set of color coordinates according to the other color space.

13. 9. The non-transitory computer readable storage medium of claim 8, wherein the matrix barcode has embedded therein computer data, the computer data being represented by a plurality of pixels associated in part with the ultraviolet light layer and each of the associated plurality of colors.

14. 10. The non-transitory computer-readable storage medium of claim 8, wherein the matrix barcode is a fiducial marker for communicating spatial information, the communicated spatial information being derived at least in part from the ultraviolet light layer.

15. 1. A computing device comprising: A processor; and a memory storing instructions that, when executed by the processor, cause the processor to: accessing a histogram of the environment generated based on one or more images of the environment; determining the most common colors associated with the environment based on the histogram by mapping the most common colors according to a Red-Green-Blue (RGB) color space, where the RGB color space is converted to another color space; determining at least one set of color coordinates for each of the most common colors according to the other color space; and determining at least one set of color coordinates corresponding to a plurality of related colors according to the other color space based on at least one set of color coordinates for each of the plurality of most common colors according to the other color space; determining the plurality of associated colors based on color coordinates corresponding to the plurality of associated colors based on the histogram; generating a matrix barcode using said associated plurality of colors and ultraviolet light layers; A computing device that executes the following:

16. 16. The computing device of claim 15, wherein the associated plurality of colors comprises at least one of a color that is not present in association with the environment or a least common color associated with the environment.

17. The instructions cause the apparatus to: The computing device of claim 15 , further configured to generate the histogram of the environment based on the one or more images of the environment.

18. 16. The computing device of claim 15, wherein the other color space including a luminance channel is generated based on a transformation of the RGB color space, and the luminance channel is removed from the other color space.

19. The computing device of claim 18 , wherein the removal of the luminance channel produces a set of color coordinates according to the other color space.

20. 16. The computing device of claim 15, wherein the matrix barcode is a fiducial marker for communicating spatial information, the communicated spatial information being derived at least in part from the ultraviolet layer.

Citation Information

Patent Citations

  • Image processor and image processing program

    JP2008065803A

  • Image processor and image processing program

    JP2008301187A

  • Image recognition method and apparatus utilizing edge detection based on magnitudes of color vectors expressing color attributes of respective pixels of color image

    US20040081355A1