Robotic shoe cleaning system for improved retail participation

Abstract

A method of retail engagement includes receiving, in a retail mechanism, a wear article from a user, wherein the wear article includes dirt or debris on an outer surface of the article. The method then includes automatically cleaning the wear article to at least partially remove dirt or debris from the outer surface. Cleaning includes contacting the shoe with the rotating brush, and at least one of the wear article or the rotating brush is automatically manipulated to cause contact. Finally, the outer surface of the article may be decorated with one or more decorations, where the one or more decorations are selected by a user.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 405,280, filed on September 9, 2022, which is incorporated by reference in its entirety and encompasses all contents disclosed therein. Technical Field

[0003] The present disclosure generally relates to an interactive robotic system for increasing retail engagement through an automated shoe cleaning process. In addition, aspects of the present disclosure relate to distributing cryptographically protected digital collectibles through the cleaning process. Background Art

[0004] In recent years, consumer product companies have experienced a decline in foot traffic / customer counts at physical retail locations with the advent of online shopping. In the wake of the SARS-CoV-2 pandemic, health and safety concerns have further accelerated and driven this shift to online shopping. Despite a decrease in ongoing health and safety concerns stemming from the pandemic, the convenience of online shopping and / or curbside pickup remains popular and in-store customer counts have been slow to return to previous levels. As a result, physical retail organizations need to offer unique in-store experiences that provide value to consumers while enticing customers back to physical stores.

[0005] Various aspects of the present disclosure discuss the use of digital collectibles and / or non-fungible tokens (NFTs). Typically, an NFT is a unique (i.e., non-fungible) electronically stored digital record that can be sold or traded between different market participants. In many cases, an NFT can be used as a digital certificate of authenticity or proof of ownership in a corresponding digital or physical item (e.g., a "digital collectible"). Records including NFTs are typically stored in / on an immutable digital ledger (such as a blockchain-type ledger), which can be distributed among many different nodes or ledger maintenance participants. Such blockchain ledgers will typically use some cryptographic means to encode at least a portion of the recorded content, while also referencing previous blocks (in the blockchain) to provide continuity. Where appropriate within the present disclosure, any reference to NFTs should be interpreted inclusively to include any virtual commodity, virtual collectible, digital collectible, or similar item, regardless of whether the digital item is recorded to a public blockchain, a private blockchain, or a distributed or centralized database.

[0006] NFTs typically include resident data called metadata stored directly on the blockchain. Due to the cost complexity of pushing large amounts of data through the transaction verification process, metadata may typically include pointers or references to off-chain data / digital files (e.g., photos, graphics, videos, and / or audio) that would be too expensive to store on the chain. When the NFT is displayed, such as on a user's social media account or in a user's digital wallet, an associated software program can check the metadata and then digitally retrieve the associated photos from the referenced file repository for display. These photos or models are typically viewed as "digital collectibles" where their authenticity or ownership is verified through a blockchain registry (i.e., a cryptographically protected digital image or model). BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a schematic diagram of a system for cleaning and / or repairing an article of footwear.

[0008] Figure 2 Such as can be with Figure 1 Schematic diagram of the imaging station used in conjunction with the system.

[0009] Figure 3A is a schematic diagram of a dry brush station having a first brush / bristle type that can be used with Figure 1 system.

[0010] Figure 3B is a schematic diagram of a dry brush station having a second brush / bristle type that can be used with Figure 1 system.

[0011] Figure 4 Such as can be with Figure 1 Schematic diagram of a drying station used in conjunction with the system.

[0012] Figure 5 is a schematic flow chart of a method of retail engagement via an automated shoe cleaning process.

[0013] Figure 6 is a schematic flow chart of a user interface that guides the placement and selection of one or more visual adornments on a virtual and corresponding physical shoe.

[0014] Figure 7 is a schematic flow chart of a method for distributing digital collectibles following cleaning and / or decoration of an article of footwear.

[0015] FIG. 8 is a schematic diagram of an encrypted digital collectible imported into a virtual environment.

[0016] Fig. 9is a schematic perspective view of a system for cleaning and / or repairing and / or decorating an article of footwear.

[0017] Fig.10 is a schematic side view of a robotic applicator for applying decoration to an article of footwear.

[0018] Fig.11 Schematic diagram of an NFT token gating system for cleaning footwear.

[0019] Fig.12 is a schematic perspective view of a robotic cleaning tool utilizing shoelace material as bristles. DETAILED DESCRIPTION

[0020] The present disclosure generally relates to a system for increasing retail engagement by automating the cleaning, refurbishment and / or decoration of articles of footwear. These systems / methods are believed to provide an interactive experience for in-person consumers, which attracts consumers to physical retail establishments while also increasing the dwell time that consumers spend in a particular area or store. Thus, the present technology may be beneficial to both consumers and establishments.

[0021] As will be discussed herein, the present system and method uses a combination of imaging and robotics to analyze and clean / refurbish a worn pair of shoes provided by a consumer. More specifically, upon receiving a worn pair of shoes from a customer / user, the present system can scan the shoes to determine the physical construction of the shoes and identify if there is any dirt, debris, stains or damage on the shoes. The system then uses various cleaning / repairing methods to refurbish the shoes and ideally extend the life of the shoes. It is estimated that increasing the service life / lifespan of a pair of shoes by six months can reduce the carbon footprint of a pair of shoes by up to 66%.

[0022] In addition to cleaning and refurbishing a worn pair of shoes, the system also provides the ability to decorate the pair of shoes with one or more auxiliary objects, decorative pieces, or decals, which can be selected by the user through a provided user interface. Such decorations can include, for example, gemstones, rhinestones, spikes, patches, decals, and / or other appliques that can be fused to the shoes after the cleaning process. In doing so, the user can customize the look and feel of the shoes according to their own style preferences. In some embodiments, these applied decorations can provide commemorative functions, such as by commemorating a user's visit to a famous store location (e.g., a flagship store) or by commemorating a famous time-related event / happening. For example, on the day of the opening ceremony of the Olympic Games, specific patches or decals corresponding to those games can be provided.

[0023] In further configurations of the present technology, the applied decorations may include one or more digital identifiers that can associate a user with the digital collectible. As part of the renovation process, the digital collectible may be gifted or sold to the user via a provided digital code. Such a digital collectible may include, for example, a cryptographically protected digital image or model that is uniquely recorded on a distributed blockchain ledger. In some configurations, the digital image or model may resemble a cleaned shoe, or may have an appearance / appearance similar to a commemorative patch / decal applied to a physical shoe (e.g., which may then be applied as a decoration to a different digital collectible). In yet other configurations, the digital collectible may be an accessory or item that may be used within a virtual world, or may be a performance modifier that may change how a digital item behaves within a virtual environment / virtual world.

[0024] With reference to the accompanying drawings, Figure 1 A system 10 for cleaning and / or repairing an article of footwear 12 (i.e., generally referred to herein as a "shoe 12") is schematically illustrated. In the illustrated configuration, the system 10 is primarily constructed around a multi-degree-of-freedom robotic arm 14 that carries a shoe last 16 at a distal portion 18. As used in the footwear industry, the shoe last 16 is a fixture that generally resembles a size model of a foot / ankle and can receive and support the shoe 12 during a number of subsequent processes. In some embodiments, the shoe last 16 held by the robotic arm 14 can be a discrete tool that the robot can select based on the nature and size of the shoe 12 provided by the consumer. More specifically, after any initialization by the user, the robotic arm 14 can select an appropriately sized shoe last 16 from a collection of different sized shoe lasts before starting the cleaning process. Alternatively, in some configurations, the shoe last 16 can be a dynamically resizable fixture that is operable to change size to receive and support shoes of different sizes and physical configurations. This dynamic resizing may occur, for example, using one or more mechanical expansion sections that may be moved using screws, gears, linkages, hydraulics, or pneumatics to achieve the desired pressure contact against the interior surface of the shoe 12 .

[0025] During operation, the robotic arm 14 may circulate or convey the shoe 12 through various stations 19 (also / alternatively such as Fig. 9 Each station 19 or process is designed to perform a different process on the shoe 12. Each station may include different specialized equipment that can be used when performing a specified process. Figure 1As shown, examples of different functional stations include, for example, an imaging station 20, a dry brush station 22, a wet brush station 24, a drying station 26, a repair station 28, and / or a decorating / decal station 30. Various aspects of the process may further rely on input or decisions provided by a user 32 via a user input terminal 34 in digital communication with a main process controller 36. The user input terminal 34 may also be used to provide the user 32 with a real-time narrative of the ongoing process.

[0026] Figure 2 An embodiment of an imaging station 20 is illustrated systematically. In general, the imaging station can be used to identify the physical structure and condition of the shoe 12 so that subsequent processes can be more uniquely adapted to the specific shoe 12 and its needs. More specifically, knowledge of the physical structure (size, material, construction) can be used to more accurately position different cleaning tools relative to the shoe 12, and can even change the nature of the cleaning process depending on the material being cleaned. Similarly, knowledge of the condition of the shoe 12 (e.g., the presence of dirt, debris, stains, rips, tears, excessive wear, etc.) can also help select appropriate cleaning processes and the duration of these processes to achieve satisfactory results. The imaging station 20 may include one or more visible spectrum cameras 40, infrared spectrum cameras, ultrasonic emitters / detectors, photogrammetry systems, and / or LiDAR sensors 42 to capture spatial and visible information (generally "imaging sources") of the shoe 12. These imaging sources can be fed to a designated imaging processor or GPU 44, which includes software / firmware operable to convert scanned / collected image data into a suitable 3D annotation model 46.

[0027] In one configuration, the imaging station 20 may rely on input from the user 32 or rely on optical image recognition techniques to estimate the entire physical structure of the shoe 12 (i.e., based on a catalog of known shoe constructions and / or machine learning techniques). In other embodiments, the system 10 may utilize an imaging sensor that relies on more direct measurements, such as by using a LiDAR-type scanning process to perform dimensional modeling / scanning of the physical shoe 12, rather than relying entirely on optical / visible spectrum sensing. As is well known, such a process builds a shell model of a physical object by acquiring multiple three-dimensional data points on the surface of the object (via laser-based sensing) and then encapsulating / skinning these data points with a continuous surface / shell. Once the physical construction and size of the shoe are understood, the imaging station 20 may use optical detection methods to more appropriately skin the model and / or identify the presence of dirt, debris, stains, damage, or excessive wear on the shoe. In some embodiments, optically identified materials and / or cleanable contaminants can be identified within the model, such as via associated metadata, layers, etc.

[0028] Reference again Figure 1Once the shoe 12 has been adequately modeled via the imaging station 20, the robotic arm 14 can transfer the shoe 12 to an optional dry brushing station 22 to begin the cleaning process. The dry brushing process may be particularly useful if the imaging station 20 detects that the sole is excessively dirty or the upper is dusty and may require mechanical cleaning. FIG. 3A to FIG. 3B As generally illustrated, the dry brush station 22 can utilize one or more rotating / spinning bristle type brushes 50a, 50b to mechanically remove and clean dirt or debris from the shoe. In one configuration, the dry brush station 22 can include a variety of different brush types and / or stiffnesses, and can be configured to select an appropriate brush based on the properties of the material to be cleaned (i.e., as determined via the imaging station 20). For example, in one configuration, the stiffness of the bristles 52 can be selected based on the durability of the material they will engage. In this way, when brushing a more rugged outsole 54, a stiffer brush / bristle (e.g., Figure 3A 50a), while when brushing the knitted material of the upper 56, a softer brush / bristle may be required (e.g., Figure 3B The knitted material of the upper 56 may be damaged by the harder brushes, such as the brush 50b in FIG.

[0029] Reference again Figure 1 After the dry brushing station 22, if stains or embedded dirt or contaminants still remain, the robotic arm 14 can transfer the shoe 12 to the wet brushing station 24. The wet brushing station 24 can utilize a process similar to dry brushing, but it can be combined with the use of water, solvents, detergents, or other foaming or non-foaming cleaning agents to more deeply penetrate the material and release embedded dirt / debris / discoloration. In one configuration, the nature of the cleaning agent can be selected based on the material being cleaned and / or the estimated stain composition and extent. Very similar to FIG. 3A to FIG. 3B In some configurations, the wet brush may utilize one or more rotating / spinning bristle type brushes to apply the cleaning solution and work it into the material, as in the dry brush process shown in . In other embodiments, the wet "brush" station may not actually use a bristle type brush, but may use a different type of "brush", such as one or more wet cloths, sponges, or melamine foam type cleaning tools. In addition, the wet brush station 24 may also be configured to select an appropriate brush (from a plurality of available brushes) based on the nature of the stain, the nature of the cleaning agent, and the material to be cleaned (i.e., as determined via the imaging station 20). Although the wet brush station 24 may utilize a liquid bath, partially submerged brushes, and / or sprayers in the initial application / cleaning, after the cleaning solution is applied, the wet brush station 24 may also include one or more wiping cloths or absorbent brushes to advance the cleaning process and / or remove liquid / soil residue or excess soap bubbles (i.e., the wet brush station 24 may include a wipe-off process).

[0030] like Figure 1As further shown in FIG. 1 , after the wet brushing station 24, the robotic arm 14 may transfer the shoe 12 to a drying station 26, which may attempt to eliminate any residual / residual moisture from the washing process. Figure 4 , the drying station 26 may utilize one or more blowers 60, suction devices, directed airflow, heated airflow, dehumidification systems, and / or infrared energy sources 62 to mechanically remove and / or evaporate any liquids retained by the various materials of the shoe 12. In some embodiments, one or more baffles 64, air deflectors, etc. may be used to specifically direct airflow across and / or through the shoe 12.

[0031] Once the shoe 12 is dry, the robotic arm 14 can transfer it back to the imaging station 20 for further analysis and to determine whether any of the cleaning steps should be repeated. Additionally, the imaging station 20 can make a final assessment of structural damage that cannot be repaired by cleaning. After this assessment, if applicable, the robotic arm 14 can transfer the shoe to the repair station 28, whereby different fillers, adhesives, dyes, etc. can be selectively applied to the shoe to repair or reverse damage caused by natural wear.

[0032] Although the foregoing discussion identifies the various stations as discrete and implies that they are physically separate, this is not necessarily the case. For example, in some embodiments, the system may include two robotic arms. The first arm 14 is the arm that carries the shoe last 16 and the shoe 12, while the second robotic arm is configured to select a different end effector to perform the function of each described "station". In other words, the second arm may start by picking up and utilizing the imaging assembly, and then may pick up a dry brush end effector consisting of one or more rotating brushes, and so on. In still other embodiments, each station may be physically separate and have its own automated control process, while the shoe 12 and supporting shoe last 16 are stationary / fixed on a carriage / gantry / cart that can transport the target shoe from one station to another. In other embodiments, one or more of these stations may be modified or omitted based on the condition of the shoe sensed by the imaging station 20.

[0033] Figure 5A flow chart illustrating a method 70 of retail participation via an automated shoe cleaning process (similar to the shoe cleaning process discussed above) is generally provided. As shown, the method can begin at 72, where the system 10 receives a shoe 12 from a user 32 onto an appropriately sized shoe last 16. Generally, "appropriately sized" is intended to refer to a shoe last that contacts at least a majority of the inner surface of the upper of the shoe in a manner that can adequately support the material throughout the subsequent cleaning process. In one configuration, this can involve selecting an appropriately sized shoe last from a collection of different shoe lasts based on the size or configuration of the shoe received. In another configuration, the shoe last can be a fixture of varying sizes that can be adjusted in one or more dimensions to fill the interior volume of the shoe.

[0034] Once the shoe 12 has been received on the last at 72, the shoe 12 may be imaged at 74. In such a process, one or more imaging devices may scan the shoe 12 to structurally model the shoe and visually identify the material construction and the presence of dirt, debris, stains, or damage on the shoe 12. Using the output from the imaging process, if any dirt or debris is present, the system may then attempt to mechanically remove such dirt or debris via a dry brushing process at 76. Dry brushing may involve mechanically contacting the exterior surface of the shoe with one or more mechanical elements, such as a rotating bristle brush, to remove any caked-on dirt / debris.

[0035] After the dry brushing process (76), the system may then attempt to wash any remaining dirt, debris, or stains from the material through a wet brushing process at 78. This may involve a similar brushing mechanism as the dry brushing process (e.g., a brush with different bristle stiffnesses depending on the material rotation and / or rotation), although may include the use of water, detergents, solvents, or other cleaning products to penetrate deeper into the material.

[0036] After any required wet brushing at 78, the shoe may undergo a drying process (at 80) to clean any remaining / residual liquid from the wet brushing process. Once dry, in some embodiments, the shoe may be re-imaged (at 82) to determine if further cleaning is required (at 84). This determination may be performed by a processor with suitable image recognition software. In one configuration, this determination may be performed by comparing a later scan in time to a previous scan to identify the degree of cleaning in the previous step, as well as to estimate the remaining amount of residual debris or contaminants.

[0037] If the processor determines that further cleaning would be beneficial (at 84), one or more of the dry brushing process or the wet brushing process may be repeated. If further cleaning is not deemed beneficial, the method 70 may proceed to an optional damage repair process. Repairing damage may include, for example, automatically filling in missing polymer material (e.g., pits in the foam, missing outsole material, etc.), gluing torn portions of foam together, rebuilding parts that require more extensive rebuilding or replacement, or dyeing / bleaching any permanently discolored portions of the shoe.

[0038] To provide an appealing visual experience for the user, each of the above steps may be performed using a visually appealing process, such as by using one or more multi-DOF robotic arms, rotating brushes, dynamic tool / end effector changes, etc. Additionally, during the execution of various processes, the connected user display terminal 34 may provide synchronized infographics describing what is happening.

[0039] After the cleaning process, the user may be provided with the option of decorating their shoes with one or more decorative pieces, decals or patches (in Figure 5 The process may generally include the user first customizing the interactive digital model through the user interface terminal 34 (at 86a), and then the system replicating the digital decoration on the physical shoe through one or more robotic processes (at 86b). Figure 6 This is further illustrated in the schematic diagram provided in .

[0040] like Figure 6 As shown generally, a customized interactive digital model (e.g. Figure 5 The step 86a) in can begin with the system presenting an interactive digital model 90 of their shoes 12 to the user through a user interface terminal 34 (e.g., a tablet, a connected smartphone, a computer terminal, or a self-service terminal, etc.). Through the terminal 34, the processor 36 can provide the user with the ability to rotate the model 90 and the ability to select the placement (at 92) and properties / graphics (at 94) of the selected decorations. In one configuration, a plurality of different decorations 96 can be presented to the user for selection / application. In some configurations, the digital model 90 can be a realistic model obtained by the above-mentioned imaging process. In some embodiments, the processor 36 can constrain and / or limit the selection of available decorations to a narrower subset of decorations based on predefined style guidelines or other physical constraints. For example, in one configuration, the processor 36 can limit the selection according to the color version or wear mode (e.g., due to concerns about safety and durability, the user can be restricted from placing rhinestones directly on the outsole that contacts the ground). In other embodiments, processor 36 may suggest placing a decal or patch on the shoe to sew / repair existing structural damage, such as thinned material, abrasions, and / or rips or tears in the upper surface.

[0041] Once the user 32 has decorated the interactive model via the user interface terminal 34, they may submit the model to the processor 36 (at 98), whereby the processor 36 may then instruct one or more robotic systems / robotic arms to decorate the physical shoe 12 in a manner similar to the digital shoe (at 100). More specifically, the robotic arm 14 may transport the shoe 12 to a decoration station where a second robotic arm 102 or applicator 104 may remove the shoe 12 from a corresponding reel (typically at Fig. 9 The decoration is picked up from a shoe 12 (shown at 105) and then applied to the shoe 12 at a designated location. In one configuration, the decoration may include an adhesive backing that can independently adhere to the material of the shoe upon contact (e.g., a tape adhesive or a pressure sensitive adhesive), or can adhere / fuse to the material upon application of thermal or UV energy (i.e., where the energy can initiate a chemical bonding / curing process, or can thermally weld the decoration to the material). Fig.10 One embodiment of an applicator 104 or press-type device that can apply pressure and / or energy to secure an ornament to a shoe 12 is illustrated. In some embodiments, the applicator 104 can be configured to apply the ornament to the shoe and can be slightly shaken in a side-to-side motion to cause the ornament to adhere to and / or release from the applicator. In some embodiments, the applicator 104 can be selected from a collection of applicators to more closely match the contour of the shoe, as can be detected via an imaging modality such as photogrammetry (or any of the other imaging sources described above). In other embodiments, if a compatible adapter is to be used to apply the ornament, the complexity can be greatly reduced (possibly at the expense of visual enjoyment and overall retail engagement).

[0042] In some configurations, the decoration may include an embedded digital identifier or unlocking code that may provide the user with a secondary benefit from the cleaning / decorating process beyond simply receiving a clean or decorated shoe. For example, in some configurations, the digital identifier may be a discount code that may be redeemed for other goods / services from the store. Alternatively, the one-time code may top up the user's account with virtual coins or points that the user may apply or redeem for one or more digital trophies, levels, collectibles, and / or experiences within the virtual marketplace. In some configurations, such points / credits may indicate a user's level of physical retail engagement, brand loyalty, and / or may reward the user for actively seeking to extend the life of their shoes, which has a net positive impact on the environment.

[0043] The embedded digital identifier can have various forms, depending on the nature of the decoration or application. For example, in one embodiment, the digital identifier can be encoded in a visible image on a decal or patch. This can take the form of a QR code, a barcode, a unique digital camouflage pattern, a color selection at a predefined point within the image, etc. In another embodiment, the digital identifier can be encoded in an NFC tag integrated or embedded in the patch. In either case, it is preferred that the user can extract the code using available means (such as hardware or software functions integrated into their smartphones). In the case where the code is embodied in a visible image, the user can rely on the camera function within his mobile phone to capture the image, after which the provided software decoder can analyze the image and decode the image into an alphanumeric digital identifier or code. Similarly, because NFC communication circuitry is incorporated into most smartphone devices, the provided software will be able to communicate with the NFC tag in the patch for receiving the digital identifier.

[0044] In one configuration, a digital identifier embedded within a decorative item may enable a user to mint, receive, or otherwise own or possess a cryptographically protected digital collectible. Figure 7 A method 110 of distributing a digital collectible after cleaning and / or decorating an article of footwear is generally illustrated. As generally illustrated, the method 110 begins with a user submitting their physical article of footwear to a cleaning / decorating process such as described above at 112. During the process, a robotic system may apply and fuse a decorative item such as a decal or patch to the submitted article at 114. The decal or patch may include an embedded digital identifier that may be selectively decoded via a software application running on a user's smartphone device or other portable computing device at 106.

[0045] Once the digital identifier is decoded, the user may submit the code to a digital application running on an Internet-connected server / device. Once the Internet-connected device receives the digital identifier from the user (at 116), the Internet-connected device may present to the user (via the user's connected computing device) one or more available digital collectibles that may be redeemed for the digital identifier (at 118). Such collectibles may include, for example, Proof of Presence Protocol (POAP) NFTs, digital collectible images or models of the user's shoes, commemorative items, or other digital tokens or virtual currencies. The received digital currency may be of the kind that may be accumulated or exchanged at a later date for other digital items, physical items, or merchandise discounts.

[0046] In one configuration, commemorative items that may be provided to a user may include, for example, a virtual medal, trophy, or certificate identifying the user's participation in a cleaning process or the user's presence at a particular retail location. Alternatively, these commemorative items may include souvenirs related to third-party events or occurrences that occurred at a temporally associated time (e.g., to commemorate, for example, the opening ceremony of the Olympic Games). In some configurations, the received digital collectible may be part of a series or a broader collection of collectibles. In such embodiments, the received digital collectible may be selected from a broader collection or series in a sequential manner, according to one or more time windows, randomly, according to a probabilistic method, according to the presence and / or digital attributes of other digital collectibles in the user's digital wallet, according to the physical location of the cleaning and / or decoration, or by other similar methods. In some embodiments, if the user is to acquire all of the constituent digital collectibles in a series, one or more additional opportunities, experiences, or digital collectibles may be provided to the user.

[0047] If the digital collectible provided is an image or model of the user's shoes, the user may be presented with the options of obtaining the collectible in pristine / new condition (which may be understood based on recognized brands / models / years / color schemes determined during the cleaning process), in a worn condition prior to cleaning (i.e., constructed directly from or otherwise derived from pre-cleaning imaging), or in a worn but cleaned condition of the shoes (i.e., which may be constructed directly from or otherwise derived from post-cleaning imaging).

[0048] Once the user selects the desired item (i.e., the Internet-connected device receives an indication of the selected item at 120), in one configuration, the Internet-connected device may then initiate a transfer of the item to an account associated with or otherwise belonging to the user at 122. In one embodiment, such a transfer may include transferring a cryptographically protected record of the item to an associated digital wallet address of the user via a record on a distributed blockchain ledger.

[0049] In some embodiments, the digital image or model of the user's shoe may be imported into a video game, virtual environment, or virtual world, where the digital image or model of the user's shoe may then be worn or otherwise used by an avatar controlled by the user, such as shown in FIG8. More specifically, FIG8 schematically illustrates a processor 36 that facilitates or directs the creation and / or recording of an NFT 140 including a digital image or model 142 (i.e., a digital collectible 142) on a corresponding distributed blockchain ledger 144. Once recorded or minted to the blockchain, the digital collectible (or the 3D image file / model referenced by the NFT 140) may be downloaded and / or imported into a virtual environment 146, where the game program may allow an avatar 148 to wear or otherwise use the shoe / collectible 142. It will be appreciated that the virtual environment 146 may be a video game or other software application that may be run in an Internet / cloud hosting space where a user may participate remotely, or on a console-type device where the graphics file for the shoe will be downloaded to the user's console for local gaming. In further embodiments, the digital image or model 142 may be suitable for representation in the real world via an augmented reality viewer.

[0050] In one embodiment, the above-described retail-engaged cleaning process / method can be provided as a service to brand-loyal consumers as a reward for their participation or activity within the brand community. For example, in one configuration, the cleaning process can be provided free of charge to any user with an existing user account with the brand. To achieve this, in some configurations, various aspects of the process (such as setup, inputting a brand or model of shoes, or initiating the process) can be performed on the user's smartphone 190 (such as Fig.11 The smart phone 190 can communicate directly or indirectly with the cleaning system via a wireless communication network 192 (e.g., a wide area network (WAN) including any suitable infrastructure or computing device). Such a network 192 can be any available type of network, including a combination of public distributed computing networks (e.g., the Internet) and secure private networks (e.g., local area networks, wide area networks, virtual private networks). It can also include wireless transmission systems and wired transmission systems (e.g., satellites, cellular networks, terrestrial networks, etc.).

[0051] In another embodiment, such as Fig.11As schematically illustrated in , one or more aspects of the cleaning process may be available as an NFT gating process that may require a user to own a particular NFT 140 within a digital wallet or user account on a distributed blockchain ledger 144 or other similar public or private blockchain or database. In this way, ownership of an NFT 140 may be equivalent to a membership pass that, based on the rarity tier of the NFT or other associated badge 204, may allow a predefined number of cleanings within a given time period. In some embodiments, the badges 204 may be recorded directly in the metadata of the NFT 140, and they may not be subject to any restrictions or modifiable. For example, in one configuration, the NFT 140 may initially be minted with all the access badges it will have, and these access rights may persist for the duration of the NFT's existence. In other embodiments, after use, the NFT itself may be "destroyed" or sent to a destruction wallet, or the badge itself may be marked as used in the metadata. In other embodiments, the badge 204 may be a sub-asset NFT referenced by the NFT 140 in the metadata. After use, the sub-asset NFT badge can be destroyed individually without affecting the higher-level NFT 140. This nested or layered approach to NFT use is described in U.S. Patent No. 11,475,449, which is incorporated by reference in its entirety and covers all of the contents disclosed therein.

[0052] like Fig.11 As further illustrated, isolated portions of the cleaning process, such as the innovative scrubbing / wiping device 206, can be used as a standalone token-gated cleaning system 208. For example, Fig.11 The diagram in the figure and Fig.12 As further illustrated in detail in FIG. 1 , in one configuration, the scrubbing / wiping device 206 may include one or more rotating brushes 210 made from virgin or recycled shoelaces 212. If the process is used in a wet environment, the device 206 may also include a beater bar that uses the contact between the shoelaces and the bar to wring out any liquid and restore the absorbency of the shoelace material.

[0053] Although the present disclosure is made with specific reference to articles of footwear, such examples should be considered illustrative of a more general system for retail engagement and / or distribution of digital collectibles through a product ornamentation / decoration process. It is specifically contemplated that the process may be similarly used with other retail-based consumer products (such as articles of clothing, such as hats, short-sleeved t-shirts, long-sleeved t-shirts, sweatshirts, pants, or jackets; accessories, such as bags or backpacks; sporting equipment, such as golf clubs, personal protective equipment / pads, mountain bikes, etc.). In each case, the article may be secured with a suitable fixture (i.e., where a shoe last may be suitable for an article of footwear, a sweatshirt may be more suitably supported by a small table or mannequin). In addition, depending on the nature of the article, not all parts of the cleaning process are strictly required or even available. In some embodiments, the process may be specifically limited to the decoration process, and cleaning may be omitted entirely. However, particularly in the footwear industry, the cleaning process may be particularly applicable to certain cleated footwear or hiking boots, which may be prone to hitting grass or other dirt / debris between the cleats / stays.

[0054] As mentioned above, the present technology presents an interactive and visually stimulating way of interacting with customers in a physical retail environment. As used herein, the concept of a retail environment or institution is intended to refer to any physical space, in which one or more goods or services are provided to potential customers in exchange for some form of currency. In many cases, a retail establishment can take the form of an entity, a brand-specific store, yet it can also include parts of a kiosk, a booth, or a consumer crowd where an activity site may exist. It should be noted that although it is best to maximize the participation of customers, to perform the cleaning and / or decoration process completely in a retail establishment, it is not strictly required to do so. In other words, unless otherwise stated, one or more steps in the cleaning and / or decoration process can be performed outside the field of vision of a retail establishment or a consumer / user, while still meeting the goal of increasing the consumer's retail participation level.

[0055] Aspects of the present disclosure may be implemented, for example, by a computer executable program of instructions (such as a program module), which is generally referred to as a software application or application program executed by any of the controllers or controller variants described herein. In a non-limiting example, the software may include routines, programs, objects, components, and data structures that perform specific tasks or implement specific data types. The software may form an interface to allow the computer to react according to an input source. The software may also collaborate with other code segments to initiate various tasks in response to data received together with the source of the received data. The software may be stored on any of a variety of non-transitory memory devices that digitally communicate with the controller. Non-transitory memory may include, for example, but not limited to, a disk-based hard drive and / or a solid-state drive including one or more types of flash memory.

[0056] In addition, various aspects of the present disclosure can be practiced with various computer systems and computer network configurations (including multiprocessor systems, microprocessor-based or programmable consumer electronic devices, minicomputers, mainframe computers, etc.). In addition, various aspects of the present disclosure can be practiced in a distributed computing environment, in which tasks are performed by resident devices and remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in both local computer storage media and remote computer storage media including memory storage devices. Therefore, various aspects of the present disclosure can be implemented in conjunction with various hardware, software, or combinations thereof in a computer system or other processing system.

[0057] As noted in this disclosure, the present system may utilize a public blockchain infrastructure or a private blockchain infrastructure, a distributed ledger, an append-only database, and the like. In one instance, the cryptographically protected digital assets currently described may initially be stored / secured to a private blockchain that resides on an infrastructure maintained by a single entity or a consortium of entities. While the assets of any one entity may be maintained by that entity, each entity may agree on a common form or data construct for the infrastructure. Such a model may provide for sharing of network and infrastructure costs / resources while allowing each entity to maintain its own asset independence. For further public trust, assets created on the private or semi-private blockchain may be transferred to a public chain at the discretion of the user (possibly subject to one or more transfer conditions).

[0058] Any of the methods described herein may include machine-readable instructions for execution by: (a) a processor, (b) a controller, and / or (c) any other suitable processing device. Any algorithm, software, control logic, protocol, or method disclosed herein may be embodied as software stored on a tangible medium (such as, for example, a flash memory, a hard drive, or other memory device). The entire algorithm, control logic, protocol, or method and / or portions thereof may alternatively be executed by a device other than a controller and / or embodied in firmware or dedicated hardware in a usable manner (e.g., implemented by an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable logic device (FPLD), discrete logic, etc.). In addition, although specific algorithms are described with reference to the flowcharts depicted herein, many other methods for implementing the example machine-readable instructions may be used alternatively.

[0059] Various aspects of the present disclosure have been described in detail with reference to the illustrated embodiments; however, those skilled in the art will recognize that many modifications may be made thereto without departing from the scope of the present disclosure. The present disclosure is not limited to the precise configurations and compositions disclosed herein; and any and all modifications, changes and variations apparent in the foregoing description are within the scope of the present disclosure as defined by the appended claims. Furthermore, the concepts of the present disclosure expressly include any and all combinations and sub-combinations of the foregoing elements and features.

[0060] Further aspects and embodiments of the present disclosure are provided in the following list of clauses, which should be read in light of the above disclosure:

[0061] Clause 1. A method of retail engagement, comprising: receiving a wear article from a user in a retail establishment, the wear article comprising dirt or debris on an outer surface of the article; imaging the wear article to determine a structure of the wear article and a location of the dirt or debris on the outer surface of the article; automatically brushing the article with a first brush at the determined location to remove at least a portion of the dirt or debris, wherein the first brush is a dry brush; automatically brushing the article with a second brush at the determined location to further remove the dirt or debris, wherein the second brush is a wet brush comprising liquid water, a detergent and / or a solvent; and drying the article to remove any of the liquid water, the detergent and / or the solvent that remains after brushing with the second brush.

[0062] Item 2. The method according to Item 1 further includes selecting the first brush from a plurality of first brushes, each of the plurality of first brushes having a different bristle type and / or stiffness, wherein the selected first brush has a bristle type and / or stiffness selected based on the structure of the wear article determined at the location of the dirt or the debris.

[0063] Clause 3. The method of clause 1, wherein determining the structure comprises determining a physical structure and determining a material type of the wear article.

[0064] Clause 4. The method of clause 3, wherein imaging comprises imaging the wear article using a LiDAR system to determine the physical structure, and imaging the wear article using a vision camera to determine the material type and the location of the dirt or the debris.

[0065] Clause 5. The method of clause 1, wherein the wear article is an article of footwear having an upper and a sole structure, and wherein receiving the wear article from the user comprises receiving the article of footwear on a last such that the last extends between the upper and the sole structure.

[0066] Clause 6. The method of Clause 5, further comprising using a multi-degree-of-freedom robotic arm to transfer the wear article and the last from the first brush to the second brush and from the second brush to a drying station.

[0067] Clause 7. The method of Clause 1 further comprising: decorating the outer surface of the article with one or more decorations after removing the dirt or the debris, the one or more decorations being selected by the user.

[0068] Clause 8. The method according to Clause 7 further includes: presenting a digital image or model of the wearable article to the user via a user interface device; receiving an indication of a placement position of the one or more decorations on the digital image or model from the user via the user interface device; receiving a selection of a selected decoration from a selection of available decorations from the user via the user interface device; and wherein decorating the article with the one or more decorations includes automatically placing the selected decoration at a position on the wearable article corresponding to the placement position on the digital image or model.

[0069] Clause 9. The method of Clause 8, further comprising presenting a digital collection comprising the digital image or model of the wear article to the user via the user interface device.

[0070] Clause 10. A method according to Clause 8, wherein the selected decoration includes a digital identifier; the method further includes: receiving the digital identifier from the user; after receiving the digital identifier from the user, transferring the digital collectible to the user's account or digital wallet or instructing the transfer of the digital collectible to the user's account or digital wallet.

[0071] Clause 11. The method of clause 10, wherein the digital collectible comprises the digital image or model of the wear article.

[0072] Clause 12. The method of clause 10, wherein the digital collectible comprises a digital image or model of the selected decorative item.

[0073] Clause 13. A method according to Clause 10, wherein after receiving the digital identifier from the user, the method includes: presenting a plurality of available digital collectibles to the user; receiving a selection of a desired digital collectible from the plurality of available digital collectibles from the user; and wherein transferring the digital collectible to the account or digital wallet of the user or instructing the transfer of the digital collectible to the account or digital wallet of the user includes transferring the desired digital collectible to the account or digital wallet of the user or instructing the transfer of the desired digital collectible to the account or digital wallet of the user.

[0074] Clause 14. The method of clause 10, wherein the digital collectible is cryptographically secured to a digital blockchain ledger as a non-fungible token.

[0075] Clause 15. A robotic system for cleaning worn footwear in a retail environment, the worn footwear including dirt or debris on an outer surface of the article, the system comprising: a multi-degree-of-freedom robotic arm having a distal portion having a last mounted thereon, wherein the last is operable to receive and support the worn footwear; an imaging station configured to capture a plurality of images of the worn footwear on the last; a processor configured to receive the images and generate a digital dimensional model of the worn footwear, the digital dimensional model including an identification of the location of the dirt or debris; a dry brush station comprising at least one rotatable bristle brush, wherein the processor The processor is also configured to control the robotic arm to bring the location of the dirt or debris on the footwear into contact with the rotatable bristle brush; a wet brush station, the wet brush station comprising at least one rotatable wet brush, the wet brush being wetted with liquid water, detergent and / or solvent; wherein after dry brushing, the processor is configured to control the robotic arm to bring the location of the dirt or debris on the footwear into contact with the rotatable wet brush; a drying station, the drying station comprising at least one blower, the at least one blower being operable to discharge a directional airflow, wherein after wet brushing, the processor is configured to control the robotic arm to bring the footwear into the directional airflow to remove or evaporate any remaining liquid water, detergent or solvent.

[0076] Clause 16. The system of Clause 15, further comprising a decorating station comprising a robotic applicator operable to apply one or more physical decorations to a lateral surface of the article of footwear.

[0077] Clause 17. A system according to clause 16, wherein the processor is further configured to: present the digital dimensional model of the worn footwear article to a user via a user interface device; receive an indication of a placement location of the one or more decorations on the dimensional model from the user via the user interface device; receive a selection of a selected decoration from a selection of available decorations from the user via the user interface device; and control the robotic arm and the robotic applicator to apply the selected decoration to a location on the footwear article corresponding to the placement location on the dimensional model.

[0078] Clause 18. The system of Clause 17, wherein the processor is further configured to present a digital collection including the size model of the article of footwear to the user via the user interface device.

[0079] Clause 19. A system according to Clause 17, wherein the selected decoration includes a digital identifier; and wherein the processor is further configured to: receive the digital identifier from the user; after receiving the digital identifier from the user, transfer the digital collectible to the user's account or digital wallet or instruct the digital collectible to be transferred to the user's account or digital wallet.

[0080] Clause 20. The system of clause 19, wherein the digital collectible comprises a digital image or model of the dimensional model or the selected adornment of the article of footwear.

[0081] Clause 21. A system according to clause 19, wherein after receiving the digital identifier from the user, the processor is configured to: present a plurality of available digital collectibles to the user; receive from the user a selection of a desired digital collectible from the plurality of available digital collectibles; and wherein the transferred digital collectible is the digital collectible desired by the user.

[0082] Clause 22. A method of retail engagement, comprising: receiving a wear article from a user in a retail establishment, the wear article comprising dirt or debris on an outer surface of the article; automatically cleaning the wear article to at least partially remove the dirt or debris on the outer surface, wherein cleaning comprises contacting the shoe with a rotating brush, and wherein at least one of the wear article or the rotating brush is automatically manipulated to cause contact; and automatically decorating the outer surface of the article with one or more ornaments, the one or more ornaments being selected by the user.

[0083] Clause 23. A method according to Clause 22, wherein the selected decoration includes a digital identifier; the method further includes: receiving the digital identifier from the user; after receiving the digital identifier from the user, transferring the digital collectible to the user's account or digital wallet or instructing the transfer of the digital collectible to the user's account or digital wallet.

[0084] Clause 24. The method of clause 23, wherein the digital collectible comprises a digital image or model of the wear article.

[0085] Item 25. The method according to Item 24 further includes imaging the wear article to generate the digital image or model, wherein the imaging includes: imaging the wear article using a LiDAR system to determine the physical structure of the article; and imaging the wear article using a visual camera to determine the visual appearance of the article.

[0086] Clause 26. The method of clause 23, wherein the digital collectible comprises a digital image or model of the selected decorative item.

[0087] Clause 27. A method according to Clause 23, wherein after receiving the digital identifier from the user, the method includes: presenting a plurality of available digital collectibles to the user; receiving a selection of a desired digital collectible from the plurality of available digital collectibles from the user; and wherein transferring the digital collectible to the account or digital wallet of the user or instructing the transfer of the digital collectible to the account or digital wallet of the user includes transferring the desired digital collectible to the account or digital wallet of the user or instructing the transfer of the desired digital collectible to the account or digital wallet of the user.

[0088] Clause 28. The method of clause 23, wherein the digital collectible is cryptographically secured to a digital blockchain ledger as a non-fungible token.

[0089] Item 29. The method according to Item 22 further includes: imaging the wear article to generate a digital image or model of the wear article; presenting the digital image or model of the worn footwear article to a user via a user interface device; receiving an indication of a placement position of the one or more decorations on the size model from the user via the user interface device; receiving a selection of a selected decoration from a selection of available decorations from the user via the user interface device; and controlling a robotic applicator to apply the selected decoration to a location on the article corresponding to the placement location on the digital image or model.

[0090] Item 30. A method according to Item 29, wherein imaging includes: imaging the wear article using a LiDAR system to determine the physical structure of the article; imaging the wear article using a visual camera to determine the visual appearance of the article; and merging the physical structure with the visual appearance to generate the digital image or model.

[0091] Clause 31. The method of Clause 22, wherein the article is an article of footwear.

[0092] Clause 32. The method of Clause 22, wherein the article is an article of clothing.

[0093] Clause 33. The method of Clause 22, further comprising fusing the decorative article to the article by applying thermal energy or ultraviolet light.

[0094] Clause 34. A method for distributing cryptographically protected digital collectibles, the method comprising: receiving a wearable article from a user at a retail establishment; automatically decorating an outer surface of the article with one or more ornaments, the one or more ornaments being selected by the user and including a digital identifier; wherein the selected ornament includes a digital identifier; after decorating, receiving the digital identifier from the user; after receiving the digital identifier from the user, transferring the cryptographically protected digital collectible to an account or digital wallet of the user or instructing the transfer of the cryptographically protected digital collectible to the account or digital wallet of the user.

[0095] Item 35. The method according to Item 34 further includes: imaging the wear article to generate a digital image or model of the wear article; presenting the digital image or model of the worn footwear article to a user via a user interface device; receiving an indication of a placement position of the one or more decorations on the size model from the user via the user interface device; receiving a selection of a selected decoration from a selection of available decorations from the user via the user interface device; and controlling a robotic applicator to apply the selected decoration to a location on the article corresponding to the placement location on the digital image or model.

[0096] Item 36. A method according to Item 35, wherein imaging includes: imaging the wear article using a LiDAR system to determine the physical structure of the article; imaging the wear article using a visual camera to determine the visual appearance of the article; and merging the physical structure with the visual appearance to generate the digital image or model.

[0097] Clause 37. The method of clause 34, wherein the cryptographically protected digital collectible comprises the digital image or model of the wear article.

[0098] Clause 38. The method of clause 34, wherein the digital collectible comprises a digital image or model of the selected ornament.

[0099] Clause 39. A method according to clause 34, wherein after receiving the digital identifier from the user, the method includes: presenting a plurality of available cryptographically protected digital collectibles to the user; receiving a selection from the user of a desired cryptographically protected digital collectible from the plurality of available cryptographically protected digital collectibles; and wherein transferring the digital collectible to the account or digital wallet of the user or instructing the transfer of the digital collectible to the account or digital wallet of the user includes transferring the desired digital collectible to the account or digital wallet of the user or instructing the transfer of the desired digital collectible to the account or digital wallet of the user.

[0100] Clause 40. The method of Clause 34, wherein the article is an article of footwear.

[0101] Clause 41. The method of Clause 34, wherein the article is an article of clothing.

[0102] Clause 42. The method of Clause 34, further comprising fusing the decorative article to the article by applying thermal energy or ultraviolet light.

Claims

1. A method of retail engagement, comprising: receiving a wear article from a user in a retail establishment, the wear article comprising dirt or debris on an exterior surface of the article; automatically cleaning the wear article to at least partially remove the dirt or debris on the outer surface, wherein cleaning comprises contacting the shoe with a rotating brush, and wherein at least one of the wear article or the rotating brush is automatically manipulated to cause contact; as well as The outer surface of the article is automatically decorated with one or more decorations, the one or more decorations being selected by the user.

2. The method of claim 1, wherein the selected decoration comprises a digital identifier; The method further comprises: receiving the digital identifier from the user; After receiving the digital identifier from the user, the digital collectible is transferred to an account or digital wallet of the user or instructed to be transferred to the account or digital wallet of the user.

3. The method of claim 2, wherein the digital collectible comprises a digital image or model of the wear article.

4. The method of claim 3, further comprising imaging the wear article to generate the digital image or model, wherein imaging comprises: imaging the wear article using a LiDAR system to determine the physical structure of the article; as well as The wear article is imaged using a vision camera to determine the visual appearance of the article.

5. The method of claim 2, wherein the digital collectible comprises a digital image or model of the selected decorative item.

6. The method of claim 2, wherein after receiving the digital identifier from the user, the method comprises: presenting a plurality of available digital collectibles to the user; receiving, from the user, a selection of a desired digital collectible from among the plurality of available digital collectibles; and Wherein transferring the digital collectible to the account or digital wallet of the user or instructing the transfer of the digital collectible to the account or digital wallet of the user includes transferring the desired digital collectible to the account or digital wallet of the user or instructing the transfer of the desired digital collectible to the account or digital wallet of the user.

7. The method of claim 2, wherein the digital collectible is cryptographically secured to a digital blockchain ledger as a non-fungible token.

8. The method according to claim 1, further comprising: imaging the wear article to generate a digital image or model of the wear article; presenting the digital image or model of the wear article to a user via a user interface device; receiving, via the user interface device, from the user an indication of a location for placement of the one or more decorations on the digital image or model; receiving, via the user interface device, a selection of a selected ornament from a selection of available ornaments from the user; as well as A robotic applicator is controlled to apply the selected decoration to the article at a location corresponding to the placement location on the digital image or model.

9. The method of claim 8, wherein imaging comprises: imaging the wear article using a LiDAR system to determine the physical structure of the article; imaging the wear article using a vision camera to determine the visual appearance of the article; as well as The physical structure is merged with the visual appearance to generate the digital image or model.

10. The method of claim 1, wherein the article is an article of footwear.

11. The method of claim 1 , wherein the article is an article of clothing.

12. The method of claim 1, further comprising fusing the decorative element to the article by applying thermal energy or ultraviolet light.

13. A method for distributing cryptographically protected digital collectibles, the method comprising: receiving the wear article from a user in a retail establishment; automatically decorating an outer surface of the article with one or more decorations, the one or more decorations being selected by the user and comprising a digital identifier; Among the decorations chosen are digital identifiers; receiving the digital identifier from the user after decorating; After receiving the digital identifier from the user, the cryptographically protected digital collectible is transferred to the account or digital wallet of the user or the transfer of the cryptographically protected digital collectible is instructed.

14. The method according to claim 13, further comprising: imaging the wear article to generate a digital image or model of the wear article; presenting the digital image or model of the wear article to a user via a user interface device; receiving, via the user interface device, from the user an indication of a location for placement of the one or more decorations on the digital image or model; receiving, via the user interface device, a selection of a selected ornament from a selection of available ornaments from the user; as well as A robotic applicator is controlled to apply the selected decoration to the article at a location corresponding to the placement location on the digital image or model.

15. The method of claim 14, wherein imaging comprises: imaging the wear article using a LiDAR system to determine the physical structure of the article; imaging the wear article using a vision camera to determine the visual appearance of the article; as well as The physical structure is merged with the visual appearance to generate the digital image or model.

16. The method of claim 13, wherein the cryptographically protected digital collectible comprises the digital image or model of the wear article.

17. The method of claim 13, wherein the digital collectible comprises a digital image or model of the selected decorative item.

18. The method of claim 13, wherein after receiving the digital identifier from the user, the method comprises: presenting a plurality of available cryptographically protected digital collectibles to the user; receiving, from the user, a selection of a desired cryptographically protected digital collectible from among the plurality of available cryptographically protected digital collectibles; and Wherein transferring the digital collectible to the account or digital wallet of the user or instructing the transfer of the digital collectible to the account or digital wallet of the user includes transferring the desired digital collectible to the account or digital wallet of the user or instructing the transfer of the desired digital collectible to the account or digital wallet of the user.

19. The method of claim 13, wherein the article is an article of footwear.

20. The method of claim 13, wherein the article is an article of clothing.

21. The method of claim 13, further comprising fusing the decorative element to the article by applying thermal energy or ultraviolet light.

Images