Smart electronic shoes and logic for navigation assistance through automatic tactile, auditory and visual feedback

Abstract

Intelligent electronic shoes and clothing with controller automation features, methods for manufacturing / operating such footwear and clothing, and control systems for executing the automation features of such footwear and clothing are proposed. A method for operating an intelligent electronic shoe (IES) includes receiving a user's location data from a GPS satellite service, for example, via a controller through a wireless communication device. The controller also receives location data of a target object or location, such as a virtual shoe hidden at a virtual point, for example, from a back-end server-level computer or other remote computing node. The controller retrieves or predicts path planning data, which includes a derived route for traversing from the user's location to the target location within a geographic area. The controller then sends a command signal to a navigation alert system mounted on the shoe structure of the IES to output visual, auditory and / or tactile prompts to guide the user along the derived route.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of and priority to U.S. Patent Application No. 16 / 874,944, filed on May 15, 2020. Technical Field

[0003] The present disclosure relates generally to wearable electronic devices. More specifically, aspects of the present disclosure relate to systems, methods, and devices for implementing automated features for smart electronic shoes and clothing. Background Art

[0004] Articles of footwear, such as shoes, boots, slippers, sandals, etc., are generally composed of two main elements: an upper that secures the footwear to the user's foot; and a sole structure that provides underlying support for the foot. The upper can be made of a variety of materials, including textiles, foams, polymers, natural and synthetic leathers, etc., which can be stitched, welded, or adhesively bonded together to form an outer shell or harness for securely containing the foot. For sandals and slippers, the upper can have an open-toe or open-heel construction, or can generally be limited to a series of straps that extend over the instep and, in some designs, can surround the ankle. In contrast, boot and shoe designs incorporate a complete upper with a closed toe or heel construction to enclose the user's foot. An ankle opening through the rear quarter of the upper provides access to the interior of the footwear, facilitating entry or removal of the foot from the upper. Laces or straps can be used to secure the foot within the upper.

[0005] The sole structure is typically attached to the lower portion of the upper, between the user's foot and the ground. In many articles of footwear, including boots and athletic shoes, the sole structure is a layered construction that typically incorporates an insole for enhanced comfort, a midsole for shock reduction, and an outsole for surface contact. The insole, which may be partially or fully located within the upper, is a thin, compressible member that provides a contact surface for the underside "plantar area" of the user's foot. In contrast, the midsole is mounted beneath the insole, forming the middle layer of the sole structure. In addition to attenuating ground reaction forces, the midsole can also help control foot movement and impart stability. The outsole is secured to the bottom side of the midsole, which forms the ground-contacting portion of the footwear. The outsole is typically made of a durable and wear-resistant material, including a tread pattern for improved traction. Summary of the invention

[0006] Presented herein are intelligent electronic shoes with accompanying control logic for implementing automated footwear functions, methods of making such shoes and methods of using such shoes, and control systems for providing automated features of intelligent electronic shoes. By way of example, an Internet of Adaptive Apparel and Footwear (IoAAF) system is presented that wirelessly communicates with an intelligent electronic shoe (IES) to provide communication between the IES and: (1) wireless-enabled devices (footwear to device (F2D)); (2) third-party IES (footwear to footwear (F2F)); (3) motor vehicles (footwear to vehicle (F2V)); (4) intelligent transportation or other infrastructure systems (footwear to infrastructure (F2I)); and / or (5) grids, networks, pedestrians, etc. (footwear to everything (F2X)). In a representative embodiment, the IES is equipped with a detection tag, such as a radio frequency (RF) transponder, which receives an incoming alert signal. The alert signal may be broadcast by an emitter-detector module mounted on a fixed structure (e.g., a building, lamp post, or traffic signal pole, etc.) or a mobile structure (e.g., a person, a bicycle, a Society of Automotive Engineers (SAE) Level 3, 4, or 5 autonomous vehicle, etc.).

[0007] The ES detection tag may reply to an incoming alert signal having RF power having a first frequency by forwarding the incoming signal as a transparent output signal having RF power having a second frequency. The transponder may be equipped with a frequency filter that limits the incoming signal to a signal having a first frequency, a frequency converter that converts the incoming signal to a transparent output signal, and an amplifier that enhances the output signal based on the incoming signal. Using a vehicle-mounted or structure-mounted RF transmitter-detector module to scan the incoming or surrounding area for a response signal output by an IES transponder may help avoid pedestrian collisions by providing an early warning prior to field of view recognition.

[0008] By placing detection tags on the IES and automating the communication between the IES detection tags and complementary emitter-detectors mounted on vehicles, streetlight poles, nearby buildings, etc., the networked IoAAF system allows connected parties to "see ahead" of impending collisions by eliminating the need for direct line-of-sight sensing and provides impending "awareness" before the IES is in close proximity to the vehicle. In practice, the IoAAF system architecture helps eliminate false alarms caused by the inability of standard sensor hardware to effectively monitor pedestrians hidden behind blind corners or other visual obstructions. Collision avoidance can be further improved by automatically providing auditory, visual, and / or tactile warnings to pedestrians via the IES, or by modulating the timing of crosswalk signals to change pedestrian flow. In addition to being able to identify pedestrian safety, the disclosed IoAAF system can also be used: in manufacturing facilities, for example, to prevent injuries to assembly line workers by robots; in storage facilities, for example, to avoid collisions between workers and forklifts or automated guided vehicles (AGVs); or at road construction sites, for example, to protect construction workers from passing vehicles. User movements—start, stop, left, right, speed up, slow down, etc.—can be controlled through selective actuation of audio, visual, and haptic feedback devices within the IES.

[0009] For F2V and F2I applications, the IoAAF system can automatically communicate with smart footwear / clothing to perform pedestrian collision threat assessment based on a large amount of available data. For example, the F2I system can perform pedestrian collision threat assessment before the line of sight between the moving object and the IES user by aggregating, fusing and analyzing the following data: IES-generated user dynamics data (e.g., position, speed, trajectory, acceleration / deceleration, etc.); user behavior data (e.g., historical behavior at a specific corner of an intersection, historical behavior at intersections in general, historical behavior under current surrounding conditions, etc.); environmental data (e.g., intersections with red lights vs. green lights, residential vs. urban environments, adverse weather conditions vs. optimal driving conditions); crowdsourced data (dynamics and behavior of other pedestrians wearing smart footwear / clothing in the vicinity of the IES user). Interoperable component communications are typically wireless and bidirectional, with data being passed back and forth to infrastructure components via an ad hoc network (e.g., using dedicated short-range communications (DSRC)). Traffic management monitoring systems can use IES, infrastructure, and vehicle data to set variable speed limits and adjust the phase and timing of traffic signals.

[0010] To enable wireless communication between the IES and the remote electronic device, the IES can support a communication session established by a user's smartphone, handheld computing device, or other portable electronic device with wireless communication capabilities. Alternatively, the IES can operate as a standalone device with a resident wireless communication device encapsulated within the shoe structure. Other peripheral hardware may include a resident controller, a shortwave antenna, a rechargeable battery, a resident memory, a SIM card, etc., all of which are housed within the shoe structure. The IES can be equipped with a human-machine interface (HMI) that allows a user to interact with the footwear and / or the IoAAF system. For example, one or more electroactive polymer (EAP) sensors can be woven into or formed into a patch mounted on the shoe structure and can be operated to receive user input that allows the user to control the operational aspects of the IES. Similarly, any accompanying operations for executing automatic footwear features can be performed locally by the IES controller, or can be performed in a distributed computing manner for execution by a smartphone, a handheld computing device, an IoAAF system, or any combination thereof.

[0011] As yet another option, execution of any one or more of the footwear features described herein may initially require secure authentication of the user via an IES controller and / or an IoAAF system server computer. For example, a distributed sensor array within the shoe structure communicates with the IES controller to perform biometric verification, such as confirming user weight (e.g., via pressure sensors), shoe size (e.g., via electro-adaptive responsive lacing (EARL)), footprint (e.g., via an optical fingerprint sensor), gait profile, or other suitable methods. As an extension of this concept, any of the above-described sensing devices can be used as a binary (ON / OFF) switch to confirm that the IES is actually on the user's foot when attempting to execute an automated feature. Failure to authenticate, verify, or confirm the presence of a user may result in the IES being inoperable and / or sending an electronic notification to the registered owner or the IoAAF system that unauthorized use has been detected.

[0012] Providing wireless data exchange to facilitate execution of automated features may require registering the IES with the IoAAF system. For example, a user may record an IES serial number using the IoAAF system, which will then issue a verification key to a personal account (e.g., a "digital safe" running on the user's smartphone, tablet, PC, or laptop) to provide additional authentication. Registration may be completed manually by the user, for example, or digitally, for example, via a barcode or near field communication (NFC) tag on the shoe. A unique virtual shoe may be assigned to the IES and stored in the digital safe. Each virtual shoe may be powered by blockchain security technologies designed to help ensure uniqueness and authenticity, such as cryptographic hash functions, trusted timestamps, associated transaction data, and the like. Additional information regarding encrypted digital assets for footwear items may be found, for example, in U.S. Patent No. 10,505,726B1 to Christopher Andon et al., which is incorporated herein by reference in its entirety.

[0013] Although described with reference to articles of footwear as representative applications of the novel concepts presented herein, it is contemplated that many of the disclosed options and features may be applied to other wearable garments, including clothing, headwear, eyewear, wristbands, ties, legwear, etc. It is also contemplated that the disclosed features are implemented as part of an augmented reality (AR) or virtual reality (VR) device or system operable to overlay data, notifications, and other visual indicators to perform any of the techniques and options presented above and below.

[0014] Other aspects of the present disclosure relate to methods for making any disclosed system and device and methods for using any disclosed system and device. In an example, a method for automating the collaborative operation between an intelligent transportation management (ITM) system and one or more intelligent electronic shoes is proposed. Each IES is provided with an upper and a sole structure, the upper is attached to the user's foot, and the sole structure is attached to the upper and supports the user's foot thereon. The representative method includes, in any order and in any combination of any of the features and options disclosed above or below: sending a prompt signal to a detection tag attached to the IES sole structure and / or the upper via an emitter-detector module communicatively connected to a traffic system controller of the ITM system; receiving a response signal generated by the detection tag in response to receiving the prompt signal via the emitter-detector module; determining the user's current location based on the response signal via the traffic system controller; identifying a traffic light near the user's location and communicatively connected to the traffic system controller; determining the current (first) operating state of the traffic light; and sending a command signal to the traffic light by the traffic system controller to switch from the current (first) operating state to a different (second) operating state.

[0015] Aspects of the present disclosure relate to networked control systems and accompanying logic for performing automated features of electronic shoes and clothing. For example, a system for automating the collaborative operation between an intelligent transportation management system and intelligent electronic shoes is proposed. The system includes an emitter-detector module, which is mounted on a fixed traffic signal pole or similar structure and broadcasts a prompt signal. The system also includes a detection tag, which is mounted on the sole structure and / or upper of the IES and is operable to receive the prompt signal of the emitter-detector module and to reactively send a response signal back to the emitter-detector module. The traffic system controller is communicatively connected to the emitter-detector module and is operable to execute instructions stored in a memory to perform various operations. The system controller is programmed to: determine the real-time location of the user based on the response signal output by the IES detection tag; determine the current (first) operating state (e.g., green signal phase) of a traffic light near the user's location and communicatively connected to the traffic system controller; send a phase change command signal to the traffic light to switch from the current (first) operating state to a different (second) operating state (e.g., red signal phase).

[0016] For any of the disclosed systems, methods, and apparatus, an IES may be equipped with a footwear controller and one or more dynamic sensors, all of which are mounted to the sole structure and / or upper. The dynamic sensors generate and output sensor data indicative of the speed and / or heading of the IES. The sensor data is transmitted via the IES footwear controller to a traffic system controller, which uses the received data to determine whether to transmit a command signal to a traffic signal to change the operating state of the signal. For example, the traffic system controller may use the dynamic sensor data to determine an expected intrusion time that the IES may violate a traffic lane specified by a traffic signal. The traffic system controller then determines an estimated phase change time as the difference between the current time and a preprogrammed phase change time when the traffic signal is scheduled to switch from a first operating state to a second operating state. Once calculated, the traffic system controller determines whether the expected intrusion time is less than the estimated phase change time; if so, the traffic system controller automatically sends a phase change command signal to the traffic signal. The traffic system controller may also determine: (1) if the speed of the IES is substantially equal to zero, and (2) if the direction of travel of the IES is in a direction away from the traffic lane specified by the traffic signal. If either (1) or (2) returns a positive determination, the traffic system controller is programmed not to send a phase change command signal to the traffic signal.

[0017] For any of the disclosed systems, methods, and apparatus, a traffic system controller may determine the current position, speed, and / or trajectory of a motor vehicle in a traffic lane defined by a traffic signal. The traffic system controller will simultaneously determine whether the user's current position is within a predetermined proximity of the vehicle's current position. In this case, in response to determining that the user's position is within the proximity of the vehicle's position, a phase change command signal is sent to the traffic signal. As a further option, the traffic system controller may send a pedestrian collision warning signal to the footwear controller in response to the user's current position being within a predetermined proximity to the vehicle's current position. The footwear controller may respond to receipt of the pedestrian collision warning signal by sending one or more command signals to a resident alert system that is attached to the sole structure / upper and is operable to generate a predetermined visual, audible, and / or tactile alert that the user may perceive.

[0018] For any disclosed system, method and apparatus, the detection tag may include an RF transponder installed on an IES sole structure and / or an upper. In this case, the prompt signal has a first RF power of a first frequency, and the response signal has a second RF power of a second frequency different from the first frequency. The prompt signal includes an embedded data set; the response signal resends the embedded data set back to the transmitter-detector module. The RF transponder may be equipped with an RF antenna and a frequency filter connected to the RF antenna. The frequency filter may be operable to reject any RF signal having an RF power with a frequency different from the first frequency.

[0019] For any disclosed system, method and apparatus, the resident footwear controller may send real-time user location and dynamic data to the traffic system controller. The traffic system controller, in turn, fuses the real-time user location data and the user dynamic data to determine a pedestrian collision threat value. The pedestrian collision threat value predicts the intrusion of the user relative to the current position and predicted route of the motor vehicle. The footwear controller may also aggregate and transmit behavioral data representing the historical behavior of the user while wearing the IES. In this case, the pedestrian collision threat value is also based on the fusion of the user location and dynamic data with the behavioral data. Alternatively, the traffic system controller may collect crowd-sourced data indicating the behavior of multiple individuals near the user. In this case, the pedestrian collision threat value is also based on the fusion of behavioral data, user location data and / or user dynamic data with crowd-sourced data. The traffic system controller may also merge and transmit environmental data indicating characteristics of the user's surrounding environment. The pedestrian collision threat value is also based on the fusion of behavioral data, user location data, user dynamic data and / or crowd-sourced data with environmental data.

[0020] For any of the disclosed systems, methods, and apparatus, a traffic system controller may send a pedestrian collision warning signal to a footwear controller. Upon receiving the warning signal, the footwear controller may automatically respond by sending an activation command signal to a resident tactile transducer, causing the tactile transducer to generate a predetermined tactile alert designed to warn a user of an impending collision with a motor vehicle. Optionally or alternatively, the footwear controller may automatically respond to receiving the pedestrian collision warning signal by outputting an activation command signal to a resident audio system, causing an associated audio component to generate a predetermined audible alert designed to warn a user of an impending collision. As yet another option, the resident footwear controller may automatically respond to receiving the pedestrian collision warning signal by sending an activation command signal to a resident lighting system, causing an associated lighting element to generate a predetermined visual alert designed to warn a user of an impending collision with a motor vehicle.

[0021] Also presented herein are smart electronic shoes and clothing with auxiliary control logic and resident navigation alert systems for providing user navigation assistance through automatic tactile, auditory and / or visual feedback. It is foreseeable that the disclosed IES and IES control systems can be used as input and / or output devices for location-based and navigation-based games, tours, travel, entertainment, marketing, etc. In a non-limiting example, a pair of automatic lace tensioning motors encapsulated on or within the shoe structure of a pair of IES are operated individually and collaboratively as tactile force feedback devices to provide navigation instructions to the user. A representative application is to provide step-by-step instructions to the user through tactile, auditory and / or visual feedback devices resident "in the shoe" to help them navigate from the current "start" location or a specified starting point to the desired "end" location or a selected series of stop points.

[0022] Another representative application of IES-based navigation assistance includes directions to physical or virtual objects or checkpoints, which can be perceived separately in VR or AR (e.g., via SNKRS Stash TM or CryptokickS TM feature access content). For example, a user may be prompted to “hunt” for a pair of virtual CryptoKicks “hidden” in a physical store by using a photographic “snapshot” or augmented reality feature on a wireless-enabled handheld computing device. TM. After determining the user's real-time location, a set of instructions are derived for circling the store to locate the target virtual object. These instructions are converted into a corresponding sequence of tactile cues, each tactile cue being adapted to correspond to a specific action (e.g., forward, backward, left, right, start, stop, etc.). The tactile cues are then delivered to the user through sequential activation and modulation of the shoelace motors. Additional information regarding targeted searches for tangible and virtual objects using geocaching can be found, for example, in U.S. Patent Application Publication No. 2019 / 0080342A1 to Christopher Andon et al., which is incorporated herein by reference in its entirety for all purposes.

[0023] Various aspects of the present disclosure relate to intelligent footwear and apparel for providing user navigation assistance through automatic tactile, auditory and / or visual feedback. In one example, an intelligent electronic shoe for assisting a user in navigating to a target object and / or target location is presented. The IES includes a shoe structure, such as an upper mounted to a sole structure, for attachment to and support of a user's foot thereon. A navigation alert system mounted on or in the IES shoe structure is selectively operable to generate visual, auditory and / or tactile output in response to an electronic command signal. The IES is also equipped with a wireless communication device that is operable to wirelessly communicate with a remote computing node, such as providing data exchange with a back-end or middleware server-type computer through a piggyback session with a handheld smart phone or a wireless-enabled tablet computer.

[0024] Continuing with the discussion of the above example, a resident or remote controller is communicatively connected to the navigation alert system and the wireless communication device. The controller is programmed to receive, retrieve, calculate, estimate, etc. (collectively referred to as "determine") the user's location data and simultaneously receive the location data of the target object / location from the remote computing node. Using this information, the controller determines path planning data, including a derived route for traversing from the user's location to the target location within a specified geographic area. Once the path planning data is acquired, the controller sends a command signal to the navigation alert system to output visual, auditory and / or tactile prompts designed to guide the user along the derived route.

[0025] Other aspects of the present disclosure are directed to methods for making smart footwear and apparel to provide user navigation assistance and methods of using smart footwear and apparel. In one example, a method for operating an IES to assist a user in navigating to a target object or location in a geographic area is presented. The representative method includes, in any order and in any combination with the features and options disclosed above or below: receiving location data indicating a user location of a user via a controller through a wireless communication device; receiving location data indicating a target location of a target object or location from a remote computing node via a wireless communication device via a controller; determining path planning data via a controller, which includes a derived route for traversing from the user location to the target location within the geographic area; and sending a command signal to a navigation alert system mounted on a shoe structure via a controller to output visual, auditory and / or tactile prompts that guide the user along the derived route.

[0026] For any disclosed system, method, and apparatus, the path planning data may include a sequence of navigation instructions for walking motion from a user location to a target location. In this case, each command signal corresponds to a calibrated navigation alert system prompt indicating a corresponding navigation instruction. The controller may also track the real-time movement of the user along the derived route and determine whether each new user position in a series of new user positions along the route corresponds to one of the navigation instructions in the path planning data. In this case, each command signal is sent in response to determining that one of the new user positions corresponds to a corresponding navigation instruction associated with the command signal. Each navigation instruction includes one or more of the following: forward, backward, turn left, turn right, accelerate, decelerate, go up, go down, start, stop, turn around, etc.

[0027] For any of the disclosed systems, methods, and devices, the controller may also send a start command signal to a navigation alert system to output a visual, auditory, and / or tactile prompt designed to notify the user to begin traveling along the derived route. Similarly, the controller may also send a completion command signal to the navigation alert system to output a visual, auditory, and / or tactile prompt designed to notify the user that they have arrived at the target location. For at least some applications, the target object / location is a virtual object located at a virtual location. The target location may be depicted by a virtual geo-fence; the controller may respond to a user violating the geo-fence by sending a completion command signal to the alert system to output a feedback prompt notifying the user that they have arrived at the target object / location.

[0028] For any of the disclosed systems, methods, and devices, the navigation alert system includes a tactile transducer mounted on a sole structure and operable to generate a tactile prompt in response to a command signal to assist the user in navigating. In some system architectures, the tactile transducer is a shoelace motor mounted on or inside a shoe structure and operable to selectively convert the shoelaces or straps of an IES between a tensioned and an untensioned state. The IES may include a left shoe and a right shoe attached to and supporting the user's left and right feet, respectively. In this case, the tactile transducer includes a discrete shoelace motor mounted on the shoe structure of the left shoe and the right shoe. The command signal generated by the controller activates the two shoelace motors individually and in coordination, thereby generating a tactile prompt for guiding the user along the lead-out route. As another option, the command signal adjusts the motor speed and / or applied tension of the two shoelace motors, thereby generating a tactile prompt for guiding the user along the lead-out route.

[0029] The above summary of the invention does not represent every embodiment or every aspect of the present disclosure. On the contrary, the above summary of the invention only provides examples of some novel concepts set forth herein. When combined with the accompanying drawings and the appended claims, the above-mentioned features and advantages of the present disclosure and other features and attendant advantages will become apparent from the following description of the illustrated examples and representative modes for implementing the present disclosure. In addition, the present disclosure explicitly includes any and all combinations and sub-combinations of the elements and features presented above and below. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 is a lateral side view of a representative intelligent electronic shoe with controller automated footwear features in accordance with aspects of the present disclosure.

[0031] Figure 2 yes Figure 1 A partial schematic bottom view of a representative smart electronic shoe.

[0032] Figure 3 During wireless data exchange to perform one or more automated footwear features, a user wearing the Figure 1 and Figure 2 A partial schematic perspective view of a representative user of a pair of smart electronic shoes.

[0033] Figure 4 During wireless data exchange with a representative intelligent transportation management system to perform one or more automated footwear features and one or more automated transportation system features, each of the wearers Figure 1 and Figure 2 A top-down perspective view of multiple representative users of a pair of IES.

[0034] Figure 5is a flow chart illustrating a representative automatic footwear characterization protocol that may correspond to memory stored instructions executed by resident or remote control logic circuitry, a programmable controller, or other computer-based device or network of devices in accordance with aspects of the disclosed concepts.

[0035] Figure 6 is the use according to various aspects of the present disclosure Figure 1 and 2 A pair of IESs are used to automatically present the perspective of a representative user interacting with the security system of a representative building.

[0036] Figure 7 According to the use of various aspects of the present disclosure Figure 1 and Figure 2 Illustration of a floor plan of a representative user using a pair of IES to automatically interact with one or more subsystems of a home automation system.

[0037] Figure 8 is a partially schematic perspective illustration of a representative electronic navigation assistance system including a representative wireless-enabled handheld computing device in communication with an IES equipped with a navigation alert system in accordance with aspects of the present disclosure.

[0038] Figures 9A-9D yes Figure 8 A partial schematic diagram of a representative electronic navigation assistance system showing a representative handheld computing device in communication with an IES to execute a user navigation assistance application to help a user locate a representative target object and / or location.

[0039] Fig.10 is a flow chart illustrating a representative IES navigation algorithm for assisting a user around a predetermined path in accordance with various aspects of the present disclosure, which may correspond to instructions stored in a memory executed by a resident or remote system controller, control logic circuit, programmable electronic control unit, or other integrated circuit (IC) device or network of IC devices.

[0040] The present disclosure is suitable for various modifications and alternative forms, and some representative embodiments have been shown in the drawings by way of example and will be described in detail herein. However, it should be understood that the novel aspects of the present disclosure are not limited to the specific forms shown in the drawings listed above. Instead, the present disclosure will cover all modifications, equivalents, combinations, sub-combinations, permutations, groupings and substitutions that fall within the scope of the present disclosure covered by the appended claims. DETAILED DESCRIPTION

[0041] The present disclosure is susceptible to implementation in many different forms. Representative embodiments of the present disclosure are shown in the drawings and will be described in detail herein, with the understanding that these illustrated examples are provided as exemplary illustrations of the disclosed principles rather than limitations on the broad aspects of the present disclosure. In this regard, elements and limitations described in the abstract, technical field, background technology, summary of the invention, and detailed description sections but not explicitly set forth in the claims should not be incorporated into the claims individually or collectively by implication, inference, or otherwise.

[0042] For purposes of this detailed description, unless otherwise stated: the singular includes the plural and vice versa; the words "and" and "or" shall be both conjunctions and antonyms; the words "any" and "all" shall mean "any and all"; and, "including," "comprising," and "having" shall each mean "including but not limited to." In addition, approximate words such as "approximately," "almost," "substantially," and "substantially" may be used herein in the sense of "at, approximately, in the vicinity of," or "within 0-5% of," or "within acceptable manufacturing tolerances," or any logical combination thereof. Finally, directional adjectives and adverbs, such as before, after, medially, laterally, proximal, distally, vertical, horizontally, front, rear, left, right, and the like, may be used, for example, with respect to an article of footwear worn on a user's foot and operatively oriented with the ground engaging portion of the sole structure lying on a flat surface.

[0043] Referring now to the drawings, wherein like reference numerals refer to like features throughout the several views, Figure 1 A representative article of footwear is shown, generally indicated at 10, and depicted herein as an athletic shoe or "sneaker" for purposes of discussion. The illustrated footwear 10 (also referred to herein as "smart electronic shoes" or "IES" for simplicity) is merely an exemplary application with which the novel aspects and features of the present disclosure can be practiced. Similarly, implementations of the present concept for wearable electronic devices worn on human feet should also be understood as representative applications of the concepts disclosed herein. It will be understood that the various aspects and features of the present disclosure can be integrated into other footwear designs and can be incorporated into any logically related type of wearable electronic device worn on any part of the body. As used herein, the terms "shoes" and "footwear," including their arrangements, can be used interchangeably and synonymously to refer to any relevant type of clothing worn on the feet. Finally, the features shown in the drawings are not necessarily drawn to scale and are provided for guidance purposes only. Therefore, the specific and relative dimensions shown in the drawings should not be interpreted as limiting.

[0044] Representative footwear 10 in Figure 1 and Figure 2The footwear 10 is generally described as a two-part construction consisting primarily of a foot-receiving upper 12 mounted on top of an underlying sole structure 14. For ease of reference, the footwear 10 may be divided into three anatomical regions: a forefoot region R FF , mid-foot area R MF and rear foot (heel) area R HF ,like Figure 2 The footwear 10 can also be divided into lateral sections S along a vertical plane. LA (the distal half of the shoe 10 farthest from the sagittal plane of the human body) and the medial section S ME (The proximal half of the shoe 10 closest to the sagittal plane of the human body). According to the generally accepted anatomical classification, the forefoot region R FF Located at the front of the footwear 10 and generally corresponding to the phalanges (toes), metatarsals and any interconnecting joints thereof. FF and R HF The mid-foot area R is inserted between MF , which generally corresponds to the cuneiform, navicular, and cuboid bones (i.e., the arch area of ​​the foot). In contrast, the heel area R HF Located at the rear of the footwear 10 and generally corresponding to the talus and calcaneus. The lateral and medial segments S of the footwear 10 LA and S ME Extends through all three anatomical regions R FF , R MF , R HF , and each corresponds to a respective lateral side of footwear 10. Although Figure 1 and 2 Only a single shoe 10 is shown for the user's left foot, but a mirror-image substantially identical counterpart may be provided for the user's right foot, such as Figure 3 It will be appreciated that the shape, size, material composition and manufacturing method of the shoe 10 may be varied, individually or collectively, to accommodate virtually any conventional or non-conventional application.

[0045] refer to Figure 1, upper 12 is depicted as having a closed toe and heel configuration, which is generally defined by three interconnected portions: a toe box 12A that covers and protects the toes; an upper 12B that extends behind the toe box and around lace eyelets 16 and tongue 18; and a rear portion 12C that is behind the upper 12B and includes the rear and sides of the upper 12 that covers the heel. The upper 12 portion of the footwear 10 can be made of any of a variety of materials or combinations thereof, such as textiles, foams, polymers, natural and synthetic leathers, etc., which are stitched, adhesively bonded, or welded together to form an interior void for comfortably accommodating the foot. The individual material elements of the upper 12 can be selected and positioned relative to the footwear 10 to impart durability, breathability, wear resistance, flexibility, and comfort, for example. An ankle opening 15 in the rear portion 12C of the upper 12 provides access to the interior of the shoe 10. A lace 20, straps, buckles or other mechanisms may be used to change the circumference of the upper 12 to more securely hold the foot inside the shoe 10 and to facilitate entry and removal of the foot from the upper 12. The lace 20 may be passed through a series of holes in the upper 12;

[0046] The sole structure 14 is securely secured to the upper 12 so that the sole structure 14 is securely secured to the upper 12 and to the support surface (e.g., Figure 3 In effect, the sole structure 14 acts as an intermediate support platform that separates the user's foot from the ground. In addition to attenuating ground reaction forces and providing cushioning for the foot, Figure 1 and 2 The sole structure 14 of the present invention can also provide traction, give stability and help limit various foot movements, such as unintentional foot inversion and eversion. According to the illustrated example, the sole structure 14 is manufactured as a sandwich structure with an insole 22 of the uppermost layer, an intermediate midsole 24 and an outer sole 26 of the lowermost layer. The insole 22 shown is partially located in the internal space of the footwear 10, firmly fixed to the lower part of the upper 12, so that the insole 22 is located near the plantar surface of the foot. Below the insole 22 is the midsole 24, which combines one or more materials or embedded elements that enhance the comfort, performance and / or ground reaction force attenuation characteristics of the footwear 10. These elements and materials can include polymer foam materials (such as polyurethane or ethyl vinyl acetate (EVA)), filling materials, regulators, inflatable air bags, plates, support elements or motion control members, alone or in any combination. The outer sole 26 that may not exist in some configurations of the footwear 10 is fixed to the lower surface of the midsole 24. Outsole 26 can be formed by rubber material, and this rubber material provides the durable and wear-resistant surface for engaging with ground.In addition, outsole 26 also can have texture, to enhance the traction (i.e. friction) performance between footwear 10 and the supporting surface below.

[0047] Figure 3 is a partial schematic diagram of an exemplary IES data network and communication system, generally designated 30, for providing wireless data exchange to perform one or more automatic footwear features for a pair of intelligent electronic shoes 10 worn by a user or customer 11. Although a single user 11 is shown communicating with a single motor vehicle 32 via the IES system 30, it is contemplated that any number of users may communicate with any number of motor vehicles or other remote computing nodes suitable for wirelessly exchanging information and data. Figure 3 One or both of the IES 10 are communicatively coupled to a remote host system 34 or a cloud computing system 36 via a wireless communication network 38. Wireless data exchange between the IES 10 and the IES system 30 may be performed directly, such as in a configuration where the IES 10 is provided as a standalone device, or may be performed indirectly, such as by pairing and mounting the IES 10 to a smartphone 40, a smart watch 42, a wireless local area network (WiFi) node, or other suitable device. In this regard, the IES 10 may be, for example, via a short-range wireless communication device (e.g., Unit or near field communication (NFC) transceiver), dedicated short-range communication (e.g., DSRC) components, radio antennas, etc. communicate directly with the motor vehicle 32. Only selected components of the IES 10 and IES system 30 are shown and described in detail herein. However, the systems and devices discussed herein may include many additional and alternative features and other available hardware and well-known peripheral components, for example, to perform the various methods and functions disclosed herein.

[0048] Continue to refer Figure 3, the host system 34 can be implemented as a high-speed server computing device or a mainframe computer capable of handling batch data processing, resource planning, and transaction processing. For example, the host system 34 can operate as a host in a client-server interface to perform any necessary data exchange and communication with one or more "third-party" servers to complete a specific transaction. On the other hand, the cloud computing system 36 can be used as a middleware for IoT (Internet of Things), WoT (Internet of Things), Internet of Adaptive Clothing and Footwear (IoAAF) and / or M2M (Machine to Machine) services, connecting various heterogeneous electronic devices with a service-oriented architecture (SOA) through a data network. As an example, the cloud computing system 36 can be implemented as a middleware node to provide different functions for dynamically loading heterogeneous devices, multiplexing data from each of these devices, and routing data through reconfigurable processing logic for processing and transmission to one or more destination applications. The network 38 can be any available type of network, including a combination of public distributed computing networks (e.g., the Internet) and secure private networks (e.g., local area networks, wide area networks, virtual private networks). It may also include wireless and wired transmission systems (e.g., satellite, cellular network, terrestrial network, etc.). In at least some aspects, most (if not all) data transaction functions performed by IES10 may be performed over a wireless network such as a wireless local area network (WLAN) or a cellular data network to ensure freedom of movement for user 11 and IES10.

[0049] The footwear 10 is equipped with various embedded electronic hardware to function as a hands-free, rechargeable, and smart wearable electronic device. The various electronic components of the IES 10 are controlled by one or more electronic controller devices, such as a resident footwear controller 44 ( Figure 2). The footwear controller 44 may include any one or more of the following: a logic circuit, a dedicated control module, an electronic control unit, a processor, an application specific integrated circuit or any suitable integrated circuit device, whether resident or remote or a combination of both. For example, the footwear controller 44 may include a plurality of microprocessors, including a master processor, a slave processor and / or an auxiliary or parallel processor. As used herein, the controller 44 may include any combination of hardware, software and / or firmware disposed inside and / or outside the shoe structure of the IES10, configured to communicate with the IES10 and a bus, computer, processor, device, service and / or network and / or control data transmission between them. The footwear controller 44 may generally be used to execute any one or all of the various computer program products, software, applications, algorithms, methods and / or other processes disclosed herein. During use or operation of the controller 44, routines may be executed in real time, continuously, systematically, sporadically and / or at regular intervals, such as every 100 microseconds, 3.125, 6.25, 12.5, 25 and 100 milliseconds, etc.

[0050] The footwear controller 44 may include, or may communicate with, a resident or remote storage device, such as a resident footwear memory 46 enclosed within the sole structure 14 of the footwear 10. The resident footwear memory 46 may include semiconductor memory, including volatile memory (e.g., random access memory (RAM) or multiple RAMs) and non-volatile memory (e.g., read-only memory (ROM) or EEPROM), disk storage media, optical storage media, flash memory, etc. Remote communication functionality with remote networked devices may be provided by one or more or all of a cellular network chipset / component, a satellite service chipset / component, or a wireless modem or chipsets / components, all of which are provided in Figure 2 It is expressed as 48 in Chinese. A transceiver, radio frequency identification (RFID) tag, NFC device, DSRC component, or radio antenna provides a close range wireless connection, all of which are indicated at 50. A resident power source, such as a lithium-ion battery 52 with plug-in or cable-free (inductive or resonant) rechargeable capability, may be embedded within the upper 12 or sole structure 14 of the footwear 10. Wireless communication may be further facilitated by implementing a BLUETOOTH Low Energy (BLE), Category (CAT) M1, and / or CAT-NB1 wireless interface. The various communication devices described above may be configured to exchange data between devices as part of a system or periodic beacon message broadcast in a footwear-to-vehicle (F2V) data exchange and / or a footwear-to-everything (F2X) data exchange (e.g., footwear-to-infrastructure (F2I), footwear-to-pedestrian (F2P), or footwear-to-footwear (F2F)).

[0051] The position and movement of the IES 10 and thus the user 11 can be tracked by a position tracking device 54, which can be located in the sole structure 14 or the upper 12 or a combination thereof. The position data can be determined by a satellite-based global positioning system (GPS) or other suitable navigation system. In one example, the GPS system can monitor the position of a person, motor vehicle or other target object on the earth using a cooperative group of orbiting GPS satellites, which communicate with a suitable GPS transceiver to generate a series of data points with time stamps in real time. In addition to providing data related to the absolute latitude and absolute longitude position coordinates of the GPS receiver carried by the target object, the data provided by the GPS system can also be modified and used to provide information about the following: the time elapsed during the execution of a specified operation, the distance moved, the altitude or height of a specific location, the altitude change within a specified time window, the direction of movement, the speed of movement, etc. The resident footwear controller 44 can use the converged set of the aforementioned GPS data to estimate the predicted route of the user 11. The GPS system data can be used alone or together to supplement and optionally calibrate the speed and distance data based on the accelerometer or other pedometers. To this end, information collected by the GPS satellite system may be used to generate correction factors and / or calibration parameters for use by the IES 10 to help ensure accurate sensor data and, therefore, optimal system operation.

[0052] Even without a GPS receiver, the IES10 can determine location and motion information by working with a cellular system via a process called "trilateration." The towers and base stations of a cellular system communicate radio signals and are arranged into a cellular network. A cellular device such as the IES10 may be equipped with a low-power transmitter for communicating with the nearest tower, base station, router, or access point. When a user uses the IES10 (e.g., moving from one cell to another), the base station monitors the strength of the transmitter signal. As the IES10 moves toward the edge of a cell, the transmitter signal strength of the current reflection tower decreases. At the same time, the base station in the approaching cell detects an increase in signal strength. When the user enters a new cell, the reflection tower transfers the signal from one to another. The resident footwear controller 44 can determine the location of the IES10 based on the measurements of the transmitter signal, such as the approach angle to (multiple) cellular reflection towers, the time it takes for each signal to propagate to multiple reflection towers, and the respective strength of each signal when it reaches the corresponding reflection tower. In accordance with other aspects of the present concepts, one or more motion sensing devices can be integrated into the shoe structure to determine the dynamic motion (e.g., translation, rotation, velocity, acceleration, etc.) of the IES10 about or along one or more axes relative to an established benchmark or reference (e.g., position, spatial orientation, reaction, force, velocity, acceleration, electrical contact, etc.).

[0053] Common Reference Figure 1 and Figure 2 , the article of footwear 10 may be equipped with a resident lighting system 56 having one or more lighting devices controlled by the footwear controller 44 to selectively illuminate the shoe structure and surrounding areas. The lighting system 56 may employ different types of lighting devices, including light emitting diodes (LEDs), electroluminescent panels (ELPs), compact fluorescent lamps (CFLs), high intensity discharge lamps, flexible and non-flexible organic LED displays, flat panel liquid crystal displays (LCDs), and other available types of lighting elements. Any number of lighting devices may be arranged on any portion of the shoe 10; as shown, a first lighting device 58 is encapsulated in a midfoot region R of the footwear 10. MF The first lighting device 58 is adjacent to the window 60 ( Figure 1 ) is positioned such that the window 60 seals against a frame aperture extending through the peripheral wall of the sole structure 14 on the outside of the shoe 10. The lighting device 58 can be operated in an illuminated or "on" state, a non-illuminated or "off" state, a range of lighting intensities (e.g., low, medium and high light output), various colors and / or various lighting modes. With this arrangement, the first lighting device 58 selectively illuminates a portion of the upper 12, a portion of the sole 14, and a ground surface adjacent to the IES 10. S1 part of.

[0054] Reference now Figure 5 Flowchart of a method for automating a wearable electronic device (e.g., Figure 1 and 2 IES 10) and Intelligent Transport Management (ITM) systems (which are Figure 3 An improved method or control strategy for collaborative operation between an IES data network and a communication system 30 is depicted as a whole at 100. Figure 5 Some or all of the operations shown in and described in further detail below may represent algorithms corresponding to processor executable instructions, which may be stored, for example, in main memory, secondary memory, or remote memory, and executed, for example, by a resident or remote controller, central processing unit (CPU), control logic circuit, or other module or device to perform any or all of the functions described above or below associated with the disclosed concepts. It should be appreciated that the order of execution of the operational blocks shown may be changed, additional blocks may be added, and some of the blocks described may be modified, combined, or eliminated.

[0055] The method 100 begins at block 101 with processor executable instructions for a programmable controller or control module or similar suitable processor, such as Figure 2The resident footwear controller 44 is used to call the control function for controlling the wearable electronic device (e.g. Figure 1 The initialization procedure of the protocol for the operation of the IES 10). During the use of the intelligent electronic shoe 10, the routine can be called and executed in real time, continuously, systematically, sporadically and / or at regular intervals, etc. Figure 3 The architecture of the IES Data Network and Communication Systems 30, as Figure 5 In a representative embodiment of the method described in , the initialization process at block 101 can be automatically initiated each time the user 11 approaches a road or road intersection 13, each time the user 11 approaches a vehicle 32 or is approached by a vehicle 32, or each time the user 11 is within detectable proximity of a mobile emitter-detector module 70 (e.g., mounted to a vehicle 32) or a fixed emitter-detector module 72 (e.g., mounted on a crosswalk signal pole 74). Using a portable electronic device such as a smart phone 40, smart watch 42, the user 11 can launch a dedicated mobile application or a web-based applet that collaborates with an intelligent transportation system (e.g., represented by a remote host system 34) through an IoAAF middleware node (e.g., represented by a cloud computing system 36) to monitor the user 11, for example, as part of a pedestrian collision avoidance process. Figure 3 The example in FIG. 3 depicts a single pedestrian (female runner) avoiding injury from an incident with a single automobile (SAE Level 3, 4, or 5 autonomous vehicle) at an urban road intersection. However, it is contemplated that the IES system 30 monitors and protects any number and type of users from any number and type of vehicles or objects operating in any logically related environment.

[0056] To enhance security, the interaction between the IES 10 and the IES system 30 may be enabled by an authentication process at predefined process block 103. Authentication may be performed by a primary or secondary source to confirm the correct activation of the wearable electronic device and / or the valid identity of the device user. After manually entering user identification information (e.g., a password, PIN code, credit card number, personal information, biometric data, predefined key sequence, etc.), the user may be allowed to access a personal account, such as on a user's Connect software application and operates on a smartphone 40 registered through an IoAAF middleware node. Thus, transactions can be effected through, for example, a combination of a personal identification input (e.g., mother's maiden name, social security number, etc.) with a secret PIN number (e.g., a six-digit or eight-digit code), or a combination of a password (e.g., created by the user 11) and a corresponding PIN number (e.g., issued by the host system 34), or a combination of a credit card input with a secret PIN number. Additionally or alternatively, a barcode, RFID tag, or NFC tag can be printed on or attached to the IES 10 shoe structure and configured to transmit a secure authentication code to the IES system 30. Other established authentication and security technologies, including blockchain cryptographic technologies, can be used to prevent unauthorized access to user accounts, for example, to minimize the impact of unapproved access to user accounts, or to prevent unauthorized access to personal information or funds through user accounts.

[0057] As an alternative or supplemental option to manually entering identification information at predefined process block 103, safety verification of user 11 may be automatically performed by a resident footwear controller 44. By way of non-limiting example, a pressure sensor 62, which may be in the nature of a binary contact-type sensor switch, may be attached to the footwear 10 (e.g., embedded within the midsole 24 of the sole structure 14). The pressure sensor 62 detects a calibrated minimum load on the insole 22, thereby determining the presence of a foot in the upper 12. Any future automated features of the IES 10 may first require that the controller 44 confirm the presence of a foot in the upper 12 via a prompt signal to the binary pressure sensor 62, thereby using the footwear 10 to initiate an automated operation, prior to transmitting a command signal. Although in the Figure 2 Only a single sensor is shown, but it is contemplated that the IES10 may be equipped with a distributed array of sensors, including pressure, temperature, humidity, and / or shoe dynamics sensors, packaged at discrete locations throughout the write structure. Similarly, foot presence sensing (FPS) may be determined by a variety of available sensing technologies (including capacitive, electromagnetic, etc.). Additional information regarding foot presence sensing may be found, for example, in U.S. patent application publications US2017 / 0265584A1 and 2017 / 0265594A1 to Steven H. Walker et al., both of which are incorporated herein by reference in their respective entireties and for all purposes.

[0058] In addition to being used as a binary (ON / OFF) switch, the pressure sensor 62 can also adopt a multi-mode sensor configuration (e.g., a polyurethane dielectric capacitive biofeedback sensor) that detects any of a variety of biometric parameters, such as the amount of applied pressure generated by the foot in the upper 12, and outputs one or more signals indicative thereof. These sensor signals can be transmitted from the pressure sensor 62 to the resident footwear controller 44, which then aggregates, filters, and processes the received data to calculate a current user weight value. The current user weight at the personal computer currently using the IES 10 is compared with a previously verified, memory-stored user weight (e.g., a registered user of an existing personal account has been authenticated). In this way, the footwear controller 44 can determine whether the current user weight is equal to or within a predetermined threshold range of the authenticated user weight. Once the current user is authenticated as an authenticated user, the resident footwear controller 44 is able to send command signals to one or more subsystems within the footwear 10 to automate its features.

[0059] As part of the predefined process block 103, automatic security authentication of the user may be achieved through other available techniques, including cross-referencing the features of the current user's foot with previously verified features of the authenticated user's foot. Figure 2 IES 10 in FIG. 1 is a representative IES 10 in which a motorized lacing system is assembled, which uses a lace motor (M) 64 mounted on the footwear 10 and which can be selectively actuated to move the shoelace 20 back and forth between an untensioned (loose) state and one or more tensioned (tightened) states. The lace motor 64 can be a bidirectional DC worm gear motor, which is housed in the sole structure 14 and controlled by a resident footwear controller 44. Activation of the lace motor 64 can be initiated by a manual activation switch built into the shoe structure, or can be activated by a soft key on an app on the user's smartphone 40 or smart watch 42. Control commands may include, but are not limited to, incremental tightening, incremental loosening, opening / full loosening, storing "preferred" tension, and restoring / recovering tension. Additional information about motorized lace tensioning systems can be found, for example, in U.S. Pat. No. 9,365,387 B2, which is incorporated herein by reference in its entirety for all purposes.

[0060] For example, in response to a sensor signal from the pressure sensor 62 indicating that the foot has been placed within the upper 12, the motor control of the lace motor 64 can be automated via the resident footwear controller 44. During use of the IES 10, the lace tension can be actively adjusted by the controller 44 through the controlled operation of the lace motor 64, for example, to better hold the foot in response to dynamic user movements. In at least some embodiments, an H-bridge mechanism is employed to measure the motor current; the measured current is provided as an input to the footwear controller 44. The resident footwear memory 46 stores a lookup table having a list of calibration currents, each of which is known to correspond to a certain lace tensioning position. By checking the measured motor current against the calibration current recorded in the lookup table, the footwear controller 44 can determine the current tensioning position of the lace 20. The foregoing functionality, as well as any other logically related options or features disclosed herein, can be applied to alternative types of wearable garments, including clothing, headwear, eyewear, wristbands, ties, legwear, underwear, and the like. Additionally, the shoelace motor 64 may be adapted to automate the tensioning and loosening of straps, latches, cables, and other commercially available mechanisms for securing a shoe.

[0061] Similar to the pressure sensor 62 discussed above, the lace motor 64 can double as a binary (ON / OFF) switch that effectively enables and disables the automated functions of the IES 10. That is, the resident footwear controller 44 can communicate with the lace motor 64 to determine whether the shoelace 20 is in a tensioned state or an untensioned state before executing the automated features. If the latter, all automated features can be disabled by the resident footwear controller 44 to prevent accidental activation of automated functions when the IES 10 is not in use. Conversely, upon determining that the lace motor 64 is placing the shoelace 20 in a tensioned state, the footwear controller 44 is allowed to send automated command signals.

[0062] During operation of the shoelace motor 64, the shoelace 20 can be placed in any of a plurality of discrete, tensioned positions to accommodate feet with different girths or users with different tension preferences. A shoelace sensor that can be built into the motor 64 or encapsulated in the sole structure 14 or the upper 12 can be used to detect the current tension position of the shoelace 20 of a given user. Alternatively, real-time tracking of the position of the output shaft (e.g., worm gear) of the bidirectional electric shoelace motor 64 or the position of a specified portion of the shoelace 20 (e.g., a shoelace spool that cooperates with the motor's turbine) can be used to determine the shoelace position. When the shoelace 20 is tensioned, the resident footwear controller 44 communicates with the shoelace motor 64 and / or the shoelace sensor to identify the current tension position of the shoelace 20 for the current user. The current tension position can then be compared with a previously verified shoelace tension position stored in a memory (e.g., authenticated to a registered user of an existing personal account). Through this comparison, the footwear controller 44 can determine whether the current tension position is equal to or within a predetermined threshold range of the verified tension position. After authenticating the current user as a verified user, command signals may be transmitted via resident footwear controller 44 to one or more subsystems within footwear 10 to automate its features. If the current user cannot be authenticated or verified, footwear controller 44 may be disabled, rendering the IES inoperable.

[0063] Upon completion of the authentication process set forth in predefined process block 103, Figure 5 The method 100 is performed by processor executable instructions to the input / output block 105 to retrieve sufficient data to track the movement of one or more target objects moving in the specified environment monitored by the IES system 30. Figure 3 In the example shown, the IES 10, the remote host system 34, and / or the cloud computing system 36 may receive, directly or through coordinated operation with a smartphone 40 or smartwatch 42, location data indicating the current location and speed (velocity and direction) of the user 11 and the current location and speed (velocity and direction) of the motor vehicle 32. User movement may also be tracked through a dedicated mobile app or route planning app running on the user's smartphone 40. The location and movement of the IES 10, and therefore the user 11, may also be determined, for example, through a satellite-based GPS navigation system transceiver built into the upper 12 or sole structure 14. In addition to tracking user dynamics, a backend intermediary server, such as the cloud computing system 36 acting as a middleware node, tracks the location and movement of the vehicle 32 in real time, for example, through an onboard transmission device or through an app on the driver's personal computing device.

[0064] Another technique for determining a user's location and attendant movement is to employ a detection tag 78 that is carried by the user 11 and that communicates with an emitter-detector module 70, 72 mounted on a nearby structure or nearby moving object. Figure 1 and Figure 3 In the representative implementation shown, detection tag 78 is implemented as a passive or active radio frequency (RF) transponder mounted on an exterior surface of sole structure 14 . Figure 1 The RF transponder 78 includes an omnidirectional (I-type) RF antenna coil 80, which is made of conductive material and is shaped to receive and transmit signals in the form of electromagnetic radiation waves. An RF frequency filter 82, which can be a lumped Butterworth filter, is electrically connected to the RF antenna 80 and is designed for bandpass operability to allow only those signals with RF power of a calibrated (first) frequency or within a calibrated (first) frequency range to pass. As another option, the frequency filter 82 can provide a bandstop function that attenuates and rejects all signals with RF power with an undesirable frequency or within any one or more undesirable frequency bands (i.e., outside the calibrated (first) frequency range). An optional dielectric cover 84 is placed on the RF antenna 80, the filter 82, and the accompanying detection tag electronic device to protect the components and improve the performance as an RF transponder. Signal exchange can be routed through a system data packet interface (SPI) and a general-purpose input / output (GPIO). Frequency and phase adjustable signal outputs can be provided by phase locked loop (PLL) or direct digital synthesis (DDS) synthesizers, harmonic mixers, and local oscillators based on PLL or DDS synthesizers.

[0065] When user 11 approaches Figure 3 At the road intersection 13, detection tag 78 ( Figure 1 ) receives a sweeping frequency prompt signal S transmitted at regular intervals by a mobile emitter-detector module 70 (which may be packaged near the front end of the vehicle 32) or a fixed emitter-detector module 72 (which may be hung from a pedestrian crossing signal pole 74, a building wall or a similar suitable fixed structure) P For applications where the detection tag 78 consists of a passive RF transponder, the emitter-detector modules 70, 72 may broadcast the alert signal S in a repetitive or substantially continuous manner. P In contrast, for an active RF transponder embodiment, an incoming alert signal S may be transmitted in response to a call back signal broadcast by the detection tag 78 in a repetitive or substantially continuous manner. P . Prompt signal S P is an electromagnetic field wave having a predetermined (first) RF power level with a standardized (first) downlink frequency. PContains an embedded data set with encoded unique information (e.g., transmitter ID, interrogation code, timestamp, etc.). The data can be superimposed on a swept frequency carrier in a narrowband system to help reduce bandwidth overhead that may be incurred by certain embodiments. Note that the reverse situation is also possible, where the detection tag 78 broadcasts and the module 70 receives and retransmits the prompt signal S P .

[0066] Upon receiving the prompt signal S P When the detection tag 78 processes the signal S P The signal S P As the output response signal S R is retransmitted back to the emitter-detector modules 70, 72. The response signal S R is an electromagnetic field wave having a distinguishable (second) RF power with a complementary (second) uplink frequency different from the first frequency. The detection tag 78 may be equipped with an RF frequency converter to modulate the incoming alert signal S P (e.g., by frequency doubling the incoming signal), and based on the incoming cue signal S P , when the signal S R Before being transmitted to the emitter-detector modules 70, 72, the response signal S R To help ensure that the emitter-detector modules 70, 72 recognize the detection tag 78, the response signal S R The prompt signal S P At least a portion of the embedded data is returned to the emitter-detector modules 70, 72 in a mechanically mimicking manner. To minimize onboard power usage, the detection tag 78 can operate in two modes: an idle mode and an active mode. When idle, the detection tag 78 is generally dormant and therefore does not draw power from the resident power source 52 or an off-board power source. In contrast, when the detection tag 78 is in an active state, it temporarily draws power from the resident power source 52 or is activated by an incoming prompt signal S P Thus, the detection tag 78 does not transmit a transparent output signal unless and until an incoming signal having RF power of a predetermined frequency is received.

[0067] As part of performing a pedestrian collision threat assessment, Figure 1-3 The smart electronic shoe 10 can use alternative means to exchange data with the IES system 30 and the motor vehicle 32. Instead of using an RF transponder, the detection tag 78 can be made of one or more electroactive polymer (EAP) sensors, each sensor having a discrete dielectric EAP element mounted on the sole structure 14 or the upper 12. According to this example, the incoming prompt signal S PThe EAP sensor is an electric field that generates a current with sufficient voltage to cause a physical state change (e.g., arcing or expansion) in the implanted dielectric EAP element. Through normal use of the IES 10, the user 11 will unknowingly reverse the physical state change of the EAP sensor, for example, by flattening or compressing the dielectric EAP element with their foot. In doing so, the EAP sensor will generate a current that causes the IES 10 to output a response signal S R It is also envisioned that the IES 10 may communicate directly with the vehicle 32 , for example, via a device-to-device wireless ad hoc network (WANET), rather than redirecting all data through the IES system 30 or other pre-existing wireless access points.

[0068] Reference again Figure 5 The method 100 continues to processing block 107 with processor executable instructions for sending or receiving a preliminary pedestrian collision warning signal in response to the response signal S indicating that the user is approaching and may enter the roadway in a manner that may cause a motor vehicle accident. R For basic applications, whenever a user 11 and a motor vehicle 32 approach an intersection 13 simultaneously, a pedestrian collision warning signal can be automatically broadcast by the IES system 30, regardless of the auxiliary variables. As shown in the figure, for example, Figure 4 In the example of FIG. 1 , the wireless transmitter node 86 of the IES system 30 may broadcast a preliminary pedestrian collision warning signal to a first user 11A wearing the IES 10 who is approaching a road intersection 13A and is predicted to cross the road intersection 13A at the same time as a moving vehicle 32A that is about to cross the intersection 13A. Even if buildings visually block each other, a second user 11B wearing the IES 10 and approaching the intersection 13A may receive a preliminary warning signal to notify the user 11B to be extra careful of the oncoming vehicle 32A. A pair of IES 10 may be registered for a user 11C who is visually, physically, or mentally impaired; the preliminary pedestrian collision warning signal may also be sent to a third user 11C due to the increased likelihood that the individual will unknowingly wander into the intersection 13A when the vehicle 32A is passing. The warning signal may be sent to multiple users 11A, 11B, 11C and any potential threatening vehicle 32A so that each party can take remedial measures to prevent an unexpected collision between a pedestrian and a car.

[0069] For more complex multi-modal applications, the IES system 30 receives data from a variety of sensing devices that use, for example, light detection, radar, laser, ultrasonic, optical, infrared, damped mass, smart materials, or other technologies suitable for object detection and tracking. According to the illustrated example, the IES system 30 can be equipped with or can receive signals from: one or more digital cameras, one or more range sensors, one or more speed sensors, one or more dynamic sensors, and any necessary hardware and software for processing raw sensor data filtering, classification, fusion, and analysis. Each sensor produces an electrical signal that indicates a characteristic or condition of the target object, typically as an estimate with a corresponding standard deviation. Although the operating characteristics of these sensors are generally complementary, some sensors are more reliable than others in estimating certain parameters. Most sensors have different operating ranges and coverage, and some are able to detect different parameters within their operating range. In addition, the performance of many sensor technologies may be affected by different environmental conditions. Therefore, sensors are generally uneven, and their operational overlap provides opportunities for sensing fusion.

[0070] A dedicated control module or appropriately programmed processor will aggregate and pre-process the sensor-based data sets, fuse the aggregated data, analyze the fused data in conjunction with relevant crowd-sourced data and behavioral data for each target object being evaluated, and estimate whether the target object is statistically likely to enter the predicted path of the motor vehicle. For example, at input / output block 109, the resident footwear controller 44 collects and sends the following data to the IES system 30: (1) location data having one or more parameters indicating the real-time location of the IES 10 and, therefore, the user 11 (e.g., latitude, longitude, altitude, geospatial data, etc.), (2) dynamic data having one or more parameters indicating the real-time movement of the IES 10 and, therefore, the user 11 (e.g., relative or absolute speed, acceleration / deceleration, trajectory, etc.), and (3) behavioral data indicating the historical behavior of the user 11 while wearing the IES 10. Such historical data may include past trends of a given user when at a particular intersection or in a particular geographic location, past trends of a given user in urban or rural environments overall, past trends of a given user under various weather conditions, past trends of a given user in particular dynamic scenarios, etc. It is contemplated that the IES controller 44 may collect and transmit other types of data, including predicted path data indicating an estimated path for the user 11 based on available current and historical information. Any such data may be collected and stored locally on the IES 10, via the IES system 30, via the vehicle 32, via nearby devices and systems, or any combination thereof.

[0071] At predefined process block 111, Figure 5The method 100 is continued by processor executable instructions for a resident or remote controller to apply a sensor fusion module to the converged raw sensor data to determine the motion of a target object in the monitored environment, such as the likelihood of a pedestrian intruding relative to the expected route and position of the vehicle. The IES system 30, for example, conditions the data received from the resident footwear controller 44 so as to correlate the received sensor data to ensure overlap with a single, common "reference" time frame, coordinate system, standard measurement value set, etc. Once the received sensor data is sufficiently conditioned to ensure alignment across relevant metrics, the IES system 30 can execute a data association protocol that will classify each corresponding portion of the sensor data and then associate the relevant portions of the sensor data based on any complementary classifications. The IES system 30 can then perform a sensor fusion process of the conditioned and classified data as well as the path planning data of the target object and the subject vehicle. Sensor fusion can be typically represented as a computational framework for the aggregation, analysis, and merging of data originating from heterogeneous or homogeneous sources (e.g., the multiple different sensor types discussed above). For the application shown, sensor fusion may be embodied as a dedicated software device that intelligently combines data from multiple sensors and corrects for the imperfections of the individual sensors to compute complete, accurate, and understandable information.

[0072] After completing the sensor fusion, the IES system 30 calculates a pedestrian collision threat value. The collision threat value can predict the behavior of the monitored target object in a manner that is likely to cause a harmful event. According to the example shown, the pedestrian collision threat value can predict the intrusion mode of the user 11, that is, the mode at least partially hinders the predicted route of the target vehicle 32, and the predicted route is related to the current (real-time) position of the target vehicle. The pedestrian collision threat value can be based on the fusion of user position data, user dynamic data and user behavior data. Optionally, the pedestrian collision threat value can also fuse behavior, user position and user dynamic data with crowd-sourced data and environmental data. Environmental data can be composed of information indicating the user's surrounding environment, such as current weather conditions, current vehicle traffic conditions, current pedestrian traffic conditions, etc. By comparison, crowd-sourced data can be composed of information indicating the location, movement and / or behavior of multiple individuals close to the user. The remote computing node receiving the aforementioned data may include a remote host system 34, a cloud computing system 36, a resident footwear controller of a motor vehicle 32, a resident vehicle controller 76 of a motor vehicle, or a distributed computing combination thereof. Alternatively, the footwear controller 44 may transmit any or all of the foregoing data via the wireless communication devices 48, 50 to a central control unit of the intelligent transportation management system.

[0073] Figure 5Method 100 proceeds to decision block 113 to determine: (1) whether the pedestrian collision threat value PCT1 generated at processing block 111 is greater than a calibrated threshold CV T (2) Whether the current (first) operating state OS1 of the approaching traffic control light is equal to one or more conflicting signals SP C Based on the first query, the threshold CV for calibration can be determined by empirical testing that provides sufficient quantitative data to establish a statistically significant minimum confidence percentage (e.g., 80%) T , below which the calculated collision threat value is inconclusive or it is probabilistically inferred that a collision event will not occur. T Available techniques may include random Gaussian processes, finite mixture model (FMM) estimation protocols or other normal or continuous probability distribution techniques.

[0074] For the latter of the two queries made at decision block 113, the conflicting signal is C Includes any signal phasing in which the right of way is provided to traffic in a manner that does not allow safe crossing at a given road segment. Traffic signal phasing may be implemented in a traffic system controller using signal indications, signal heads, and accompanying control logic that controls and coordinates timing, sequencing, and duration. Signal phasing settings may be changed as needed, for example, to accommodate changes in traffic demand, patterns, etc., and in a manner that produces safe and efficient operation for prevailing conditions.

[0075] Reference again Figure 3 , for example, shows a user 11 traveling at a speed and trajectory that is estimated to place them within the roadway of the intersection 13 at approximately the same time as vehicles 32 expected to pass through the same intersection 13. Upon detection of the user 11 by the IES system 30 using the emitter-detector modules 70, 72, the back-end server computer of the remote host system 34 will identify a traffic light or group of traffic lights (e.g., intersection 13A) that is located at a roadway segment (e.g., intersection 13A) proximate to the user's location and that is operable to regulate traffic flow (e.g., cars traveling eastbound and pedestrians traveling northbound). Figure 4Once identified, the remote host system 34 determines the real-time operational state of the traffic light, which may include a go state (continuous green light or walk (WALK) signal), a warning / yield state (continuous yellow light or flashing walk signal), a can't go or stop state (continuous red light or don't walk signal), or a transition state between any of the above states (green to yellow, yellow to red, etc.). One or more of these operational states can be characterized as conflict signal phase SPC. By way of non-limiting example, the go state, warning / yield state, and warning transition state can all be designated as conflict signal phase SPC. C .

[0076] If any of the evaluations made at decision block 113 returns a negative result (block 113=No), the method 100 may loop back to terminal block 101 and run in a continuous loop; alternatively, the method 100 may proceed to terminal block 117 and terminate temporarily. Conversely, upon determining that the pedestrian collision threat value PCT1 is actually greater than the calibrated threshold CV T And the current operating state OS1 of the traffic control signal light corresponds to any conflicting signal phase SP C When (block 113=yes), method 100 proceeds to processing block 115, where one or more remedial actions are taken to avoid a collision between the user and the vehicle. By way of example and not limitation, the wireless transmitter node 86 may send a notification that a pedestrian collision is imminent to the vehicle controller 76; the vehicle controller 76 may immediately respond by issuing one or more brake command signals to the vehicle braking system to perform a braking maneuver, for example, to bring it to a complete stop or to reduce the speed to a calculated value that readily allows an evasive maneuver. Additionally or alternatively, the vehicle 32 may perform other autonomous vehicle functions, such as controlling vehicle steering, controlling operation of the vehicle transmission, controlling engine throttle, and other autonomous driving functions. Visual and / or audible warnings may be sent to the driver using a vehicle center console infotainment system, a digital instrument panel display, or a personal portable electronic device.

[0077] Processing block 115 may also include processor executable instructions for automating pedestrian and vehicle traffic flow changes through traffic signal phase modulation. Figure 4The IES system 30 (represented by the traffic signal control cabinet 92) transmits a command signal to the vehicle traffic control light 88 to switch from a first operating state (e.g., green light) to a second operating state (e.g., yellow light or red light) in an attempt to stop the motor vehicle 32 before the motor vehicle 32 enters the intersection 13, thereby preventing a collision with the user 11. As described above, the traffic signal modification can be based on user dynamic data (e.g., speed and direction of travel) suggesting that the user 11 will enter the monitored road segment 13 and vehicle dynamic data (e.g., speed and predicted path) suggesting that the vehicle 32 will enter the same monitored road segment 13. In this regard, the IES system 30 can receive and analyze the IES dynamic sensor data to identify the IES 10 and, therefore, the estimated expected intrusion time of the user 11 in violation of the traffic lane specified by the vehicle traffic control light 88.

[0078] The IES system 30 may also determine an estimated phase change time, which is calculated as the difference between the current (real time) time and the preprogrammed phase change time when the traffic signal is scheduled to switch from the first current operating state to the alternate operating state. In response to determining that the expected intrusion time is less than the estimated phase change time—the user 11 is expected to enter the intersection 13 before the vehicle traffic control light 88 is preprogrammed to change from green to red—the traffic signal control cabinet 92 automatically transmits a phase change command signal to the traffic control light 88. Alternatively, if the expected intrusion time does not place the user 11 within the intersection 13 before the signal phase changes, there is no need for the traffic signal control cabinet 92 to intervene and preemptively issue a phase change command signal. This is also the case for situations where the user dynamics data indicates that the user 11 has stopped or will stop before entering the intersection 13, or indicates that the user 11 is in a supplemental or alternative travel direction that will not place him in the intersection 13. Again, the traffic signal control cabinet 92 does not need to intervene and preemptively issue a phase change command signal. After completing the remedial action performed at process block 115 , method 100 proceeds to end block 117 and temporarily terminates.

[0079] In addition to facilitating the automation of one or more vehicle operations designed to mitigate or prevent a vehicle-pedestrian collision, method 100 may also simultaneously facilitate the automation of one or more IES features designed to mitigate or prevent a vehicle-pedestrian collision at process block 115. For example, a first command signal may be sent to a first IES subsystem to execute a first automated feature AF1 of the smart electronic shoe. Figure 3In the example shown, the resident footwear controller 44 receives the pedestrian collision threat value output at block 111, determines at block 113 that the threat value is greater than a threshold, and responsively takes preventive action at block 115. The resident footwear controller 44 responds to the determination automatically (i.e., without any user input or external system prompt) by sending a command signal to the resident lighting system 56 to activate the lighting device 58 to produce a predetermined light output. The selected color and / or pattern is detectable by the user 11 and, optionally, the driver of the vehicle 32, and is sufficiently conspicuous to warn of an impending collision. As a non-limiting example, the resident lighting system 56 may output a flashing bright red light pattern; the use of this particular color and pattern may be limited to warning the user of a potential hazard. The light output of the IES 10 may be coordinated with the light output of the headlights of the motor vehicle 32 to further assist in notifying the user 11 of a predicted vehicle collision.

[0080] It is foreseeable that as Figure 5 As part of the method 100 shown, any disclosed connected wearable electronic device may automate additional or alternative features. In response to a positive determination at decision block 113, the footwear controller 44 may automatically send a second command signal to the second subsystem to execute a second automated feature AF2 of the wearable electronic device. As a non-limiting example, Figure 2 The IES 10 is equipped with a tactile transducer 66 housed within the sole structure 14 to be in operable communication with the insole 22. To alert the IES 10 of the pedestrian collision threat estimate, the resident footwear controller 44 issues a command signal to the tactile transducer 66 to generate a tactile cue (e.g., a perceptible vibration force or a series of vibration pulses) that is transmitted from the midsole 24, through the insole 22, to the user's foot. As part of the method 100, the intensity and / or pulse pattern output by the tactile transducer 66 can be limited to situations that warn the user of possible danger.

[0081] An optional third automation feature AF3 may include operating the shoelace motor 64 as a tactile force feedback device that is selectively activated by the footwear controller 44 to quickly tighten and release the shoelace 20. Similarly, the IES 10 may operate with a smartphone 40 (e.g., coordinated flashing of an LED camera light or an eccentric rotating mass (ERM) actuator), or an active clothing element 11 (e.g., coordinated activation of a built-in thermal or tactile device in a user's shirt or shorts). As another option, tactile feedback may be utilized to provide turn-by-turn directions to the user (e.g., the left or right foot vibrates with increasing intensity and / or in a specified pulse pattern to indicate a left or right turn). Likewise, tactile feedback may be used in a similar manner to guide a user along a predetermined route or to warn a user not to take a particular route (e.g., deemed unsafe). Additional information regarding footwear and apparel with tactile feedback may be found, for example, in U.S. Patent Application Publication US2017 / 0154505A1 by Ernest Kim, the entire contents of which are incorporated herein by reference.

[0082] Optionally, IES10 may be provided with an audio system. Figure 1 12C of the upper 12. The resident footwear controller 44, upon confirming that the pedestrian collision threat value is greater than a calibrated threshold, automatically sends a command signal to the audio system speaker 68 to generate a predetermined sound output. For example, the audio system speaker 68 may shout "Warning!" or "Stop!" at an increasing sound level. As another option, the footwear controller 44 may command the shoelace motor 64 to repeatedly tighten / loosen the shoelace 20 as a signal / prompt for, for example, an oncoming car. Footwear-to-infrastructure communications may be enabled (and coordinated) to allow the IES 10 to communicate with a networked "smart city" controller, which in turn may modulate changes in street lighting or traffic lights to improve safety for walkers or runners. Conversely, the "smart city" controller may communicate with the IES 10 to warn the user that they are walking onto a crosswalk with a "Do Not Walk" sign, which signals that pedestrians must give right of way to oncoming vehicles.

[0083] Light features built into the shoe can also be used during sporting events (e.g., to match the colors of a user's favorite sports team) or when exercising (e.g., to light up the road when running at night). Security features can also be installed to make the IES unavailable to unauthorized parties. For example, upon determining that the person wearing the IES 10 is an unauthorized user, the footwear controller 44 can render the shoelace motor 64 inoperable. In conjunction, the controller 44 can send an electronic alert to the user's smartphone 40 or smartwatch 42, notifying them of potential theft or misuse of the IES 10.

[0084] An optional configuration may provide smart electronic shoes or clothing suitable for teaching purposes. For example, a user or instructor may wear IES10 when helping to teach a person how to drive a car. For example, IES10 may be configured so that an instructor can press their foot hard against the passenger compartment floor through the shoe to simulate depressing the brake pedal. The built-in pressure sensor 62 detects the instructor's foot posture, outputs a corresponding signal to the shoe controller 44, and the IES10 communicates with the vehicle 32 brake control module (BCM) to activate the vehicle brakes. In addition, or alternatively, the IES10 may communicate with a pair of smart electronic shoes worn by a student, sending instructions to provide sensory feedback to the student that they should physically depress the brake pedal with their foot to apply the vehicle's braking system. In addition to teaching students how to drive, tactile, auditory, and / or visual feedback from the IES10 may be used to teach the wearer of the footwear a series of steps in a dance move, the correct transfer of body weight when swinging a golf club or baseball bat, the correct timing, gait, and number of steps for hurdles, and the like.

[0085] The remote computing node may take an alternative form to the above, such as a central server computer or a parallel HMI of a residential or commercial security system. When a user 11 of the IES 10 enters a predetermined location (e.g., an entrance, hallway, room, etc.) or is within a preselected proximity of a monitored facility (e.g., as defined by an active geo-fence), Figure 2 The resident footwear controller 44 can send a deactivation command signal to the security system server computer or HMI so that the user 11 can enter the facility without having to manually deactivate the security system. Figure 6 , a representative user 213 is shown approaching the front entrance of a building 232 protected by a commercial security system (represented by a contactless video surveillance entry panel 234). One or two IES 10s worn by the user 213 emit an invisible geo-fence 215 surrounding the user 213. Once the user 213 is close enough to the building 232 so that the video surveillance entry panel 234 breaks through or otherwise penetrates the IES-generated geo-fence 215, the IES 10 automatically sends a security authentication signal to the security system entry panel 234. In this way, the user 213 is authorized to enter the building 232, for example, as shown in FIG. Figure 6 As shown, by automatically opening a security door at the entrance of building 232. Alternative system configurations may use other communication means, including any of the communication means described above and below, to facilitate interaction between IES10 and security system 234.

[0086] As yet another example, the remote computing node may have the properties of a home automation system (or "smart home") that controls the climate, lighting, blinds, appliances, etc., in a user's home. When a user of the IES 10 enters or leaves a predetermined location (e.g., a front door, garage, hallway, room, etc.), or enters or leaves a pre-selected neighborhood of a residence controlled by a home automation system, the resident footwear controller 44 may send one or more command signals to the home automation system to lock or unlock a door, activate or deactivate interior lights, increase or decrease the temperature of a thermostat, or a combination of the foregoing features. For example, in Figure 7 , a representative user 313 is shown walking around a home 332 with various appliances and devices and subsystems that are controlled in whole or in part by a residential home automation system represented by a WiFi-enabled touch screen gateway panel 334. In response to the user 313 moving from a first room to a second room (e.g., from a living room to a bedroom), the IES 10 may automatically send a series of command signals to: (1) turn on the lights in the second room; (2) dim the lights in the first room; (3) turn off one or more devices in the first room (e.g., a television); and (4) adjust the temperature in the second room.

[0087] Figure 2 The IES 10 may be considered particularly useful for interacting with fully assisted or fully autonomous motor vehicles, such as those classified as Society of Automotive Engineers (SAE) Level 3, 4, or 5. In addition to enabling controller authentication and automatic locking, unlocking, and motor starting of the vehicle, the IES 10 may communicate with a route planning module (RPM), and in turn with a powertrain control module (PCM), a brake system control module (BCM), etc., to automatically coordinate the transportation of a user 11 of the IES 10 to a predetermined location. In a specific example, Figure 3 The motor vehicle 32 may broadcast a unique geo-fence signal to pair with multiple users wearing compatible IES. If the user 11 is within the boundaries of the vehicle's geo-fence, the IES 10 notifies the user 11 that they have crossed the geo-fence by automatically generating a first visual, auditory, and / or tactile output. The user 11 may then launch a dedicated mobile app running on their smartphone 40 to identify the current real-time location of the motor vehicle 32, which may be displayed on a GPS or navigation map application. When the user 11 is within the vicinity of the motor vehicle 32 (e.g., ten (10) meters or less), the IES 10 may generate a second visual, auditory, and / or tactile output to notify the user 11 that they are within a predetermined vicinity of the vehicle 32 and should therefore be able to visually identify the vehicle 32.

[0088] Once the user 11 locates the motor vehicle 32, a two-way authentication process will occur between the resident footwear controller 44 of the IES 10 and the central electronic control unit (ECU) of the motor vehicle 32 or a server computer on the back end of the middleware node that facilitates F2V operations. Once authenticated, the motor vehicle 32 will signal the user 11 that they can choose to enter the passenger compartment of the vehicle. The verification key may be issued to the user 11 via the IoAAF system; the user 11 may retrieve the key via the aforementioned smartphone app. If the user 11 chooses to enter the motor vehicle 32, the user 11 may be taken to a designated or undesignated location (the "unlock location") where the reserved products are waiting for the user 11. Once the user 11 arrives at the unlock location, the user 11 may be required to enter the verification key to access the reserved products.

[0089] Figure 8 4 shows a representative electronic navigation assistance system 400 having an intelligent electronic shoe (or "footwear") 410 that communicates with a wireless-enabled handheld computing device (or "smartphone") 440 to provide navigation assistance to a user of the IES 410. Although different in appearance, it is foreseeable that the above referenced Figure 1 and Figure 2 The features and options disclosed in IES10 may be incorporated individually or in any combination into Figure 8 As a similar point, IES410 is depicted as an athletic shoe consisting of a foot-receiving upper 412 mounted on top of an underlying sole structure 414, each of which may employ any of the options and alternatives described above with respect to their respective upper 12 and sole structure 14 counterparts. Figure 1 and 2 Footwear 10, Figure 8 The IES 410 can be divided into a plurality of adjacent anatomical regions (e.g., forefoot, midfoot, and rearfoot regions) and is vertically bifurcated into mediolateral portions (e.g., lateral and medial segments). Another similarity can be drawn from the closed toe and heel construction of the footwear 410, as well as the lace 420 for securely holding the foot within the upper 412, and the tongue 418 extending between the lace 420 and the interior space of the upper 412.

[0090] As another overlapping similarity, Figure 8The IES410 is shown equipped with a controller automatic tensioning system 460 for selectively adjusting the size of the ankle opening (or "throat") 415 in the rear quarter portion of the upper 412, thereby tightening and loosening the upper 412 around the user's foot. According to the illustrated example, the diameter of the opening 415 is reduced and increased by the lace motor 462 applying tension to the lace 420 and releasing tension from the lace 420, respectively. The lace motor 462 is loaded in a protective external motor housing 464, which is securely mounted on the outer surface of the rear quarter portion of the upper 412. The lace 420 is shown passing through a longitudinally elongated lacing guide 416, then through an internal channel in the upper 412, and extending into the motor housing 464 of the lace motor 462. As described above, the lace 420 can be replaced with a strap, a cable, a latch, a pneumatic or hydraulic bladder, or any other mechanism suitable for adjusting the size of the opening 415 and the circumference of the upper 412.

[0091] Automatic tensioning system 460 applies tension to lace 420, for example in response to various user inputs and / or system control commands, in order to tighten and loosen upper 412. As a non-limiting example, Figure 8 The shoelace motor 462 winds the shoelace 420 around the shoelace reel 466 inside the motor housing 464, and conversely, unwinds the shoelace 420 from the shoelace reel 466. The shoelace motor 462 can be embodied as a bidirectional direct current (DC) electric stepper motor, which is powered by a rechargeable energy storage system (RESS) 470, such as a lithium-ion battery module encapsulated in the IES sole structure 414. The activation of the shoelace motor 462 applies torque to the shoelace reel 466 through the rotation of the interconnected motor shaft 468. The rotation of the reel 466 in a first direction (e.g., clockwise) serves to wind the shoelace 420, thereby applying tension thereto, and the rotation of the reel 466 in a second direction (e.g., counterclockwise) serves to unwind the shoelace 420, thereby releasing tension thereto. Alternative architectures may use different motors, transmissions, and / or shoelace winding devices.

[0092] While it is contemplated that the IES 410 may be manufactured with a resident HMI, such as a set of control buttons or a touch screen interface, for managing the operation of the automatic tensioning system 460, the IES 410 may wirelessly communicate with a handheld computing device 440 for selective operation of the shoelace motor 462. For example, the smartphone 440 may download and run a dedicated "shoelace control" software application (app) 472. The high-definition OLED touch screen display device 474 of the smartphone 440 may be used to display information to the user and receive control inputs from the user. The dedicated mobile app 472 provides a graphical user interface for presenting soft control buttons, radio buttons, menus, track pads, etc. Control commands are initiated in response to control inputs made by the user. Example control commands may include, but are not limited to: left shoe selection, right shoe selection, increase tension on the selected shoe or shoes, increase looseness on the selected shoe or shoes, fully open / loosen both shoes, store current tension, recall stored tension, etc.

[0093] Figures 9A to 9D The smartphone 440 is shown communicating with the IES 410 to execute a user navigation assistance protocol to help the user locate a target object and / or a target location. Fig. 9A In the embodiment of the present invention, a search session is initiated to locate a target virtual object, such as an encrypted digital asset 480 associated with a pair of sneakers purchased, which is "hidden" in a virtual location within a designated geographic area, such as a metropolitan area (e.g., Manhattan, New York). The touch screen display device 474 presents the user with an introduction screen and the option to participate in the search. Alternatively, the user may be prompted to "search" for the target virtual object in a physical store by using a photographic "snapshot" or augmented reality function on their handheld personal computing device. In this case, the KickID associated with the purchased pair of shoes may be provided to the user as part of the retail transaction. However, before the digital asset can be transferred to their personal locker, the user may be required to individually find the associated CryptoKick ID hidden in the store or designated area. TM (i.e., the key and virtual object must be obtained separately before the transfer occurs.) Obtaining the cryptographic key may enable the AR engine associated with the user's device to initiate the game, wherein the CryptoKick associated with the key TM The start of the search may be communicated to the user by a first tactile cue, such as activation of the extension of the shoelace motors 462 in both shoes of the user, output by the resident navigation alert system, such as by the selected use of the automatic tensioning system 460. The advantage of using the automatic tensioning system 460 over conventional tactile transducers is the multi-modal application of tactile sensations perceptible to the user: vibration of the shoelace motors 462 and tensioning / loosening of the shoelaces 420.

[0094] When a search for a target virtual object / location is initiated, the display device 474 of the smartphone 440 may display the real-time GPS location of the IES 410 and, therefore, the user. Fig. 9B A smartphone 440 is depicted running a dedicated “shoe hunt” mobile app 473 with a graphical depiction of a user avatar 481. A display device 474 may depict the IES 410 and the user's movements through the simultaneous movement of the user avatar on a street-level map 482 of the city and the locations of other users, landmarks, and nature makers near the IES 410. To assist the user in locating hidden target objects, the resident navigation alert system automatically operates the audio system, lighting system, and / or tactile transducer system of the IES 410 to generate tactile, audio, and / or visual cues perceptible to the user. Continuing with the above example, the mobile app 473 may track the real-time movements of the user along a designated route to the target object / location. While traversing the route, turn-by-turn navigation instructions may be provided to the user to assist them in finding their destination. For example, in Fig. 9B In the embodiment of the present invention, a second tactile prompt is outputted by the resident navigation alert system of IES 410 via the operation of the automatic tensioning system 460, such as a slow pulse, low tension activation of the shoelace motor 462 in only the user's right shoe, to notify the user to turn right at their current position. Similarly, the user can be notified in real time to turn left at a given position by selectively activating the shoelace motor 462 in the user's left shoe without simultaneously activating the shoelace motor 462 in the user's right shoe.

[0095] After the search begins, one or more secondary users can assist the primary user in searching for the virtual target, providing various types of assistance. As the user position becomes closer to the target object / location, a third tactile prompt (e.g., Fig. 9C The ramp pulse activation of the shoelace motor 462 shown in FIG. 4 notifies the user to move forward / advance from its current position. Once the primary user reaches the location of the virtual object, such as Fig.9D As shown, the virtual target object can be accessed. Access to the virtual object can be automatic, or may require additional actions on the part of the user. The completion of the search can be communicated to the user via a fourth tactile prompt, such as a fast, high-voltage pulse activation of the shoelace motor 462 in both shoes of the user, which is output by the resident navigation alert system.

[0096] In some cases, CryptoKick TM May not be associated with a physical product initially, but given to a user as part of a branded campaign, event, moment, or experience. For example, a user at a sporting event may need to search for CryptoKick within the confines of the event stadium. TM, such as using a mobile app and a digital camera on a smartphone device. In this example, the GPS associated with the smartphone device can further limit the optical recognition capability to a specific geo-fenced area. The target object can be virtually disguised in a billboard advertisement, located in a specific seat, hidden in a designated area, etc. Once the CryptoKick TM , the user may be prompted to scan a unique code, such as the barcode on their event ticket. This two-part action can then transfer a token unique to that ticket to the user's locker. After the event, promotion organizers can reclaim any unclaimed KickIDs for use in other promotions.

[0097] Reference now Fig.10 According to various aspects of the present disclosure, a flowchart for performing a process ... Figure 1 IES10 or Figure 8 IES410) to automate operations for users (e.g. Figure 3 Improved method or control strategy for navigation assistance for users 11). Fig.10 Some or all of the operations shown in and described in further detail below may represent an algorithm corresponding to processor-executable instructions that may be stored, for example, in a primary or secondary or remote memory and executed, for example, by a resident or remote controller, a central processing unit (CPU), a control logic circuit, or other module or device to perform any or all of the functions described above or below related to the disclosed concepts. It should be appreciated that the order of execution of the illustrated operational blocks may be changed, that additional blocks may be added, and that some of the blocks described may be modified, combined, or deleted. For example, it is anticipated that the above reference to Figure 5 The features and options disclosed in method 100 may be combined individually or in any combination into Fig.10 In method 500, vice versa.

[0098] The method 500 begins at terminal block 501 with processor executable instructions for a programmable controller or control module or similar suitable processor, e.g. Figure 2 resident footwear controller 44 to invoke the initialization process of the protocol to use the smart electronic shoe or garment, e.g. Figure 1 IES10 or Figure 8IES410, automatic navigation assistance to the user. The initialization process at block 501 can be initiated via a manually input prompt, such as by a user opening a corresponding mobile app running on a user's handheld computing device, or a central system operator starting a "treasure hunt" feature for a group of users. Alternatively, the initialization process can be automatically started by a resident controller or a remote computing node, such as a server-level computer responsible for conducting the target object / location search. Terminal block 501 can optionally be combined with the above-mentioned Figure 5 Any initialization and authentication features described in operations 101 and 103.

[0099] Method 500 advances from terminal block 501 to input / output blocks 503 and 505 to determine the user's desired or current position and the predetermined or estimated position of the target object / place. The desired user position can be preset to a specified starting position, such as a starting line, a public gathering place, a kiosk or terminal for completing the purchase of a pair of shoes, etc. Alternatively, as described above, the user's current real-time position can be determined, and in block 503, for the purpose of navigation assistance, it is set to the starting position. Similarly, in block 505, the position of the target object / place can be predetermined and retrieved from, for example, a remote computing node, a third-party handheld computing device, a resident cache or main memory, etc. On the other hand, the target position can be dynamic or random, or can be manually selected by a suitable HMI.

[0100] At subroutine block 507, the in-shoe footwear controller or the smartphone processing unit or both receive, estimate, identify and / or retrieve (collectively referred to as "determine") path planning data for the user's current itinerary. The path planning data may include any real-time, crowdsourced, map and / or historical data suitable for completing the desired itinerary. At a minimum, the path planning data may include a preset starting point or real-time starting location, a desired, dynamically or randomly determined final destination, one or more intermittent stops, and a predicted route from the user's starting point to the user's destination. For a standalone architecture, the IES can be equipped with an onboard navigation system that utilizes a GPS transceiver in conjunction with navigation software and geolocation mapping services to obtain geographic topography, geodetic data, and traffic information related to the user's current location.

[0101] Establishing a predicted path for the current trip may require predicting one or more upcoming maneuvers required to complete the trip. This may include marking any potential obstacles or hazards, and determining one or more alternative routes. For example, block 507 can predict the primary (first) route for completing the upcoming maneuver, and using a similar process, predict one or more (first, second, third...) alternative routes for reaching the user's destination. Once the path plan is created, a corresponding sequence of navigation instructions for gait movement (walking, running, etc.) from the user's location to the target location can be determined for each route, as shown in subroutine block 509. These navigation instructions can include: forward, backward, left turn, right turn, accelerate, decelerate, start, stop, U-turn, etc., individually or in any combination. Each navigation instruction can be associated with a corresponding location along the derived route; a list of navigation instructions and their associated locations can be saved in a local cache memory for easy retrieval.

[0102] From subroutine block 509, method 500 continues to database block 511 and converts each navigation instruction into a command signal generated by a corresponding controller. The command signal associates a calibrated navigation alarm system prompt with a given navigation instruction. For example, a list of available navigation instructions and their corresponding alarm system outputs and associated command signals can be stored in a server cluster and retrieved simultaneously from the server cluster via a suitable database management system (DBMS). As described above, starting a search can correspond to a first tactile prompt, which can correspond to an extended activation of a shoelace motor in a user's shoe. Conversely, a right turn can correspond to a second tactile prompt, which can correspond to a slow pulse, low tension activation of a shoelace motor in a user's right shoe, while there is no corresponding tactile output for the user's left shoe. These prompts can be supplemented with supplemental visual and auditory outputs, such as via Figure 1 and 2 The resident lighting system 56 and the resident speaker system 68 are provided.

[0103] Continue to refer Fig.10 , processor executable instructions are provided to the footwear controller at input / output block 513 to send command signals to the footwear's resident navigation alert system to output visual, auditory, and / or tactile cues designed to guide the user along the derived route. In order to ensure that turn-by-turn instructions are provided at appropriate times along a given route, the controller may systematically track the user's real-time or near real-time movements as the user moves along the derived route. During user tracking, the controller may continuously evaluate whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions provided at subroutine block 509. In such a case, a command signal may be output via the controller as a direct response to a determination that the user's "new" position corresponds to a corresponding navigation instruction associated with the command signal. Once the foregoing features are completed, Fig.10Method 500 may proceed to terminal block 515 and terminate, or may loop back to terminal block 501 and run in a continuous loop.

[0104] Adaptive apparel and footwear disclosed, including Figure 1 IES10 and Figure 8 IES410 can be used to help users navigate to the physical locations of static and dynamic objects. For example, Figure 1 The resident footwear controller 44 or Figure 8 The handheld computing device 440 can communicate with a location tracking device of a logistics class (delivery) unmanned aerial vehicle (UAV) to track the real-time movement of the UAV and / or determine the delivery location of a package transported by the UAV. As described above, this information can be aggregated and processed to provide turn-by-turn instructions to the user to locate the UAV. The IES10, 410 can also be used to identify the user's position relative to the UAV and / or automatically authenticate the user to the UAV before a package will be released. A similar approach can be used to guide a user to an unmanned passenger aircraft ("flying taxi") or a commercial-grade air taxi or air transportation solicitation center.

[0105] Similar to package delivery assisted by UAVs, the disclosed adaptive apparel and footwear can be adapted for in-store and curbside pickup of goods (e.g., buy online, pick up in store (BOPIS)). In a non-limiting example, a user can place an order online, by phone, or through an app, such as for food or merchandise, and go to a designated pickup location (inside or outside a physical store) to retrieve the order. Upon arrival, the IES can automatically send a message to a store kiosk, a central server, or relevant personnel notifying the retailer of the user's arrival. The store clerk delivers the order to the user's location, which can be provided by any means disclosed herein; the clerk uses a countertop or handheld point of sale (POS) device connected to the IES and / or IOAAF system to locate, identify, and / or wirelessly authenticate the user before transferring the item.

[0106] Further options for using the disclosed adaptive clothing and footwear include physical activities, such as running challenge experiences, which are enhanced by augmented reality, such as a user competing with another user's virtual self ("ghost"). For example, a pair of users select a specified location, route, or distance to conduct a virtual race. On a first date and / or time, the first user can travel to the specified location / route and complete the race (e.g., complete two laps around a 1-mile track in about 10 minutes); this data can be collected and stored by the first user's IES. On a subsequent date / time, the second user travels to the specified location / route and begins a virtual race with the first user. When the second user completes the race, the IES can track their progress and provide them with regular or real-time updates. For example, after completing a lap, the second user is notified through their IES that their first lap time is slower than the first user; if they hope to beat the first user, a notification can be provided to speed up. This information can be provided by tactile feedback, light display, and / or audio output of the IES. The second user's race time and related data can be collected and stored by their IES and sent to the first user's IES. Additional information regarding the use of AR to enhance physical exercise can be found, for example, in U.S. Patent Application Publication No. 2016 / 0346612 A1 to Craig Rowley, which is incorporated herein by reference in its entirety and for all purposes.

[0107] The foregoing concepts can be used for other one-on-one and team-related sports, such as golf, baseball, basketball, football, etc. Some of these sports can be assisted by other sensing and monitoring systems and other wearable electronic devices, such as head-mounted heads-up display (HUD) systems. Additional information about the use of electronic tracking systems and wearable electronic devices to transmit data related to sports events can be found in, for example, commonly owned U.S. Patent Application Publication Nos. 2020 / 0078653A1, 2017 / 0340948A1, 2017 / 0157492A1, and 2017 / 0157490A1, each of which is incorporated herein by reference in its entirety and for all purposes.

[0108] The disclosed adaptive apparel and footwear may also be used as part of an AR or VR team competition, such as a product unlocking experience, where a first team competes with one or more other teams to obtain a limited release item. According to a more specific non-limiting example, a first user goes to a command center that includes a map with the location of a hidden item. The first user communicates with a second user via IES feedback. The second user is located in a puzzle environment; the first user, located in the command center, sends navigation instructions to the second user to help them navigate to the prize. The first and second users are part of a team or team that competes with other teams to be the first to find and unlock the prize.

[0109] Further options may include using the disclosed adaptive apparel and footwear feedback to enable users to greet or otherwise communicate with each other, such as a virtual handshake or greeting substitute, such as in situations where physical contact is not available or desired. Additionally, IoAFF feedback may be used to help users communicate with other users to warn of violations of personal space (e.g., to help maintain social distance). IoAFF feedback may be used to detect if a first user is approaching a second user unexpectedly or quickly from a determined direction. For example, an IES user may be warned that another person is approaching them from behind or from a blind spot to rob or injure them, or alternatively as part of a game or contest.

[0110] In some embodiments, aspects of the present disclosure may be implemented by a computer executable instruction program such as a program module, which is generally referred to as a software application or an application program executed by any controller or controller variant described herein. In a non-limiting example, the software may include routines, programs, objects, components, and data structures that perform specific tasks or implement specific data types. The software may form an interface to allow the computer to react based on an input source. The software may also collaborate with other code segments to initiate various tasks in response to data received along with a received data source. The software may be stored on any of a variety of storage media, such as a CD-ROM, a disk, a bubble memory, and a semiconductor memory (e.g., various types of RAM or ROM).

[0111] Moreover, aspects of the present disclosure can be practiced with a variety of computer systems and computer network configurations, including multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, etc. In addition, aspects of the present disclosure can be practiced in a distributed computing environment, in which tasks are performed by remote processing devices that are resident and linked through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including memory storage devices. Therefore, various hardware, software, or a combination thereof can be combined in a computer system or other processing system to implement various aspects of the present disclosure.

[0112] Any method described herein may include machine-readable instructions to be executed by: (a) a processor, (b) a controller, and / or (c) any other suitable processing device. Any algorithm, software, protocol, or method disclosed herein may be embodied as software stored on a tangible medium (e.g., flash memory, CD-ROM, floppy disk, hard drive, digital versatile disk (DVD), or other storage device). The entire algorithm, control logic, protocol, or method and / or portions thereof may optionally be executed by a device other than a controller and / or embodied in firmware or dedicated hardware in a usable manner (e.g., implemented by an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable logic device (FPLD), discrete logic, etc.). In addition, although specific algorithms are described with reference to the flowcharts described herein, many other methods of implementing the exemplary machine-readable instructions may be used instead.

[0113] Other characteristics may be reflected in the following terms:

[0114] Item 1: An intelligent electronic shoe (IES) for assisting a user in navigating to a target object or location within a geographic area, the IES comprising: a shoe structure configured to attach to and support a user's foot thereon; a navigation alert system mounted to the shoe structure and configured to generate visual, auditory and / or tactile outputs in response to command signals; a wireless communication device configured to wirelessly communicate with a remote computing node; and a controller communicatively connected to the navigation alert system and the wireless communication device, the controller being programmed to: determine a user location of a user; receive a target location of a target object or location from the remote computing node; determine path planning data comprising a derived route for traversing from the user location to the target location within the geographic area; and transmit command signals to the navigation alert system to output visual, auditory and / or tactile cues, the visual, auditory and / or tactile cues being configured to guide the user along the derived route.

[0115] Clause 2: An IES according to clause 1, wherein the path planning data also includes a sequence of navigation instructions for walking movement from the user location to the target location, and wherein each command signal corresponds to a calibrated navigation alert system prompt indicating a corresponding navigation instruction in the sequence of navigation instructions.

[0116] Clause 3: An IES according to clause 2, wherein the controller is further programmed to: track real-time movement of the user along the derived route; and determine whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions in the sequence of navigation instructions, wherein each command signal is sent in response to determining that one of the new user positions corresponds to a corresponding navigation instruction associated with the command signal.

[0117] Clause 4: An IES according to clause 3, wherein each navigation instruction comprises: forward, reverse, turn left, turn right, accelerate, decelerate, start, stop and / or turn around.

[0118] Clause 5: An IES according to any one of clauses 1 to 4, wherein the controller is further programmed to send a start command signal to a navigation alert system to output a visual, audible and / or tactile prompt configured to notify a user to start traveling along the derived route.

[0119] Clause 6: An IES according to any one of clauses 1 to 5, wherein the controller is further programmed to send a completion command signal to a navigation alert system to output a visual, audible and / or tactile prompt configured to notify a user that they have arrived at the target location.

[0120] Clause 7: An IES according to any one of clauses 1 to 6, wherein the target object or place comprises a virtual object located at a virtual location.

[0121] Clause 8: An IES according to any one of clauses 1 to 7, wherein the navigation alert system includes a tactile transducer, and wherein the command signal causes the tactile transducer to generate a tactile cue.

[0122] Clause 9: The IES according to clause 8, further comprising a lace or strap attached to the shoe structure, and wherein the tactile transducer comprises a lace motor mounted on or within the shoe structure and configured to selectively transition the lace or strap between a tensioned state and an untensioned state.

[0123] Clause 10: An IES according to clause 9, wherein the shoe structure includes a left shoe structure and a right shoe structure, each shoe structure being configured to be attached to and support a left foot and a right foot of a user, respectively, and wherein the shoelace motor includes a first and a second shoelace motor mounted on the left shoe structure and the right shoe structure, respectively.

[0124] Clause 11: The IES of clause 10, wherein the command signal individually and cooperatively activates the first and second lace motors to generate tactile cues configured to guide the user along the lead-out route.

[0125] Clause 12: An IES according to clause 11, wherein the command signal adjusts the motor speed and / or applied tension of the first and second lace motors to produce additional tactile cues configured to guide the user along the lead-out route.

[0126] Clause 13: An IES according to any one of clauses 1 to 12, wherein the navigation alert system includes an audio system, and wherein the command signal causes the audio system to produce a predetermined sound output.

[0127] Clause 14: An IES according to any one of clauses 1 to 13, wherein the navigation alert system comprises a lighting system, and wherein the command signal causes the lighting system to produce a predetermined light output.

[0128] Clause 15: The IES of any of clauses 1 to 14, wherein the user has a portable electronic device, and wherein the wireless communication device is further configured to wirelessly connect to the portable electronic device to wirelessly communicate with the remote computing node.

[0129] Clause 16: An IES according to any one of clauses 1 to 15, further comprising a sensor mounted to the shoe structure, which is communicatively connected to the controller and configured to detect the presence of a user's foot in the shoe structure, and wherein the controller is further programmed to receive a sensor signal from the sensor indicating that the foot is in the shoe structure, and the controller transmits a command signal in response to receiving the sensor signal.

[0130] Clause 17: An IES according to any of clauses 1 to 16, wherein the target location of the target object or place includes a geo-fence, and wherein the controller is further programmed to, in response to detecting that the user has crossed the geo-fence, send a completion command signal to the navigation alert system to output a visual, auditory and / or tactile prompt configured to notify the user that they have arrived at the target object or place.

[0131] Item 18: An intelligent electronic shoe (IES) operated to assist a user in navigating to a target object or location within a geographic area, the IES comprising a shoe structure configured to attach to and support a user's foot thereon, the method comprising: receiving, via a controller, location data indicating a user location of the user through a wireless communication device; receiving, via the controller, location data indicating a target location of a target object or location from a remote computing node through a wireless communication device; determining, via the controller, path planning data comprising a derived route for traversing from the user location to the target location within the geographic area; and sending, via the controller, a command signal to a navigation alert system mounted on the shoe structure to output visual, auditory and / or tactile prompts, the visual, auditory and / or tactile prompts being configured to guide the user along the derived route.

[0132] Clause 19: A method according to clause 18, wherein the path planning data also includes a sequence of navigation instructions for walking movement from the user location to the target location, and wherein each command signal corresponds to a calibrated navigation alert system prompt indicating a corresponding navigation instruction in the sequence of navigation instructions.

[0133] Clause 20: The method according to clause 19 also includes: tracking the real-time movement of the user along the derived route; and determining whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions in the navigation instruction sequence, wherein each command signal is sent in response to determining that one of the new user positions corresponds to a corresponding navigation instruction associated with the command signal.

[0134] Clause 21: The method of any of clauses 18 to 20, further comprising sending a start command signal to a navigation alert system via the controller to output a visual, audible and / or tactile prompt configured to notify a user to start traveling along the derived route.

[0135] Clause 22: The method of any of clauses 18 to 21, further comprising sending a completion command signal via the controller to a navigation alert system to output a visual, audible and / or tactile prompt configured to notify a user that they have arrived at the target location.

[0136] Clause 23: A method according to any one of clauses 18 to 22, wherein the target object or location comprises a virtual object located at a virtual location.

[0137] Clause 24: The method of any of clauses 18 to 23, wherein the navigation alert system includes a tactile transducer, and wherein the command signal causes the tactile transducer to generate a tactile cue.

[0138] Clause 25: The method of clause 24, wherein the tactile transducer comprises a lace motor mounted on or within the shoe structure and configured to selectively transition a lace or strap attached to the shoe structure between a tensioned state and an untensioned state.

[0139] Clause 26: A method according to clause 25, wherein the shoe structure includes a left shoe structure and a right shoe structure, each shoe structure is configured to be attached to and support a left foot and a right foot of a user, respectively, and wherein the shoelace motor includes a first and a second shoelace motor mounted on the left shoe structure and the right shoe structure, respectively.

[0140] Clause 27: The method of clause 26, wherein the command signal individually and cooperatively activates the first and second lace motors to generate tactile cues configured to guide the user along the lead-out route.

[0141] Clause 28: The method of clause 27, wherein the command signal adjusts the motor speed and / or applied tension of the first and second lace motors to produce additional tactile cues configured to guide the user along the lead-out route.

[0142] Clause 29: The method of any one of clauses 18 to 28, wherein the navigation alert system comprises an audio system and / or a lighting system, and wherein the command signal causes the audio system to produce a predetermined sound output and / or causes the lighting system to produce a predetermined light output.

[0143] Clause 30: The method of any of clauses 18 to 29, wherein the user has a portable electronic device, and wherein the wireless communication device is wirelessly connected to the portable electronic device to wirelessly communicate with the remote computing node.

[0144] Various aspects of the present disclosure have been described in detail with reference to the illustrated embodiments; however, those skilled in the art will recognize that many modifications may be made thereto without departing from the scope of the present disclosure. The present disclosure is not limited to the precise construction and configuration disclosed herein; any and all modifications, changes and variations apparent from the foregoing description are within the scope of the present disclosure as defined by the appended claims. Moreover, the present concept expressly includes any and all combinations and sub-combinations of the foregoing elements and features.

Claims

1. A smart electronic shoe for helping a user navigate to a target object or location in a geographic area, the user having a portable electronic device, the smart electronic shoe comprising: a shoe structure configured to be attached to and support a user's foot thereon; laces or straps attached to the shoe structure; a navigation alert system mounted to a shoe structure and configured to generate a tactile output in response to a command signal, the navigation alert system comprising a lace motor mounted to the shoe structure and configured to selectively transition the lace or strap between a tensioned state and an untensioned state; a wireless communication device configured to wirelessly connect to the portable electronic device and thereby wirelessly communicate with a remote computing node; as well as A controller communicatively connected to the navigation alert system and the wireless communication device, the controller being programmed to: Determine the user's user location; receiving a target location of a target object or place from a remote computing node; determining path planning data comprising a derived route for traversing from a user location to a target location within a geographic area, the path planning data further comprising a sequence of navigation instructions for pedestrian movement from the user location to the target location; as well as Based on a sequence of navigation instructions for walking motion from the user location to the target location, command signals are transmitted to a navigation alert system to operate a shoelace motor to output tactile cues configured to guide the user along a derived route.

2. The intelligent electronic shoe according to claim 1, wherein: Each command signal corresponds to a calibrated navigation alert system prompt indicating a corresponding navigation instruction in the sequence of navigation instructions.

3. The intelligent electronic shoe according to claim 2, wherein: The controller is also programmed to: tracking real-time movement of the user along the derived route; and determining whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions in the sequence of navigation instructions, Wherein each command signal is sent in response to determining that one of the new user locations corresponds to a respective navigation instruction associated with the command signal.

4. The intelligent electronic shoe according to claim 3, wherein: Each navigation instruction includes: forward, backward, turn left, turn right, accelerate, decelerate, start, stop and / or U-turn.

5. The intelligent electronic shoe according to claim 1, wherein: The controller is also programmed to send a start command signal to the navigation alert system to output a start tactile prompt configured to notify a user to begin traveling along the derived route.

6. The intelligent electronic shoe according to claim 5, wherein: The controller is also programmed to send a completion command signal to the navigation alert system to output a completion tactile cue configured to notify a user that they have arrived at the target location.

7. The intelligent electronic shoe according to any one of claims 1 to 6, wherein: The target object or location includes a virtual object located at a virtual location.

8. The intelligent electronic shoe according to claim 1, wherein: The navigation alert system further includes a tactile transducer, and wherein the command signal causes the tactile transducer to generate one or more additional tactile cues.

9. The intelligent electronic shoe according to claim 1, wherein: The shoe structure includes a left shoe structure and a right shoe structure, which are configured to be attached to and support the user's left foot and right foot respectively, and wherein the shoelace motor includes a first and a second shoelace motor respectively mounted on the left shoe structure and the right shoe structure.

10. The intelligent electronic shoe according to claim 9, wherein: The command signals individually and cooperatively activate the first and second lace motors to generate tactile cues configured to guide the user along the lead-in route.

11. The intelligent electronic shoe according to claim 10, wherein: The command signal adjusts the motor speed and / or applied tension of the first and second lace motors to produce additional tactile cues configured to guide the user along the lead-out route.

12. The intelligent electronic shoe according to claim 1, wherein: The navigation alert system also includes an audio system, and wherein the command signal causes the audio system to generate auditory prompts to guide the user along the derived route.

13. The intelligent electronic shoe according to claim 1, wherein: The navigation alert system further includes a lighting system, and wherein the command signal causes the lighting system to generate visual cues to guide a user along the derived route.

14. The intelligent electronic shoe according to claim 1, wherein: The controller determines the user location by receiving user location data from the portable electronic device and / or the remote computing node.

15. The smart electronic shoe of claim 1 , further comprising a sensor mounted to the shoe structure, communicatively connected to the controller and configured to detect the presence of a user's foot in the shoe structure, and wherein the controller is further programmed to receive a sensor signal from the sensor indicating that the foot is in the shoe structure, the controller transmitting the command signal in response to receiving the sensor signal.

16. The intelligent electronic shoe according to claim 1, wherein: The target location of the target object or place includes a geo-fence, and wherein the controller is further programmed to, in response to detecting that a user has crossed the geo-fence, send a completion command signal to the navigation alert system to output a completion visual, auditory and / or tactile prompt configured to notify the user that they have arrived at the target object or place.

17. A method of operating an intelligent electronic shoe for assisting a user in navigating to a target object or location in a geographic area, the intelligent electronic shoe comprising a shoe structure configured to attach to and support thereon a foot of a user having a portable electronic device, and a shoelace or strap attached to the shoe structure, the method comprising: receiving, via the controller through the wireless communication device, location data indicating a user location of a user; receiving, via the controller through the wireless communication device, location data indicating a target location of a target object or place from a remote computing node via a wireless connection with the portable electronic device; determining, via a controller, path planning data comprising a derived route for traversing from a user location to a target location within a geographic area, the path planning data further comprising a sequence of navigation instructions for pedestrian movement from the user location to the target location; as well as Based on a navigation instruction sequence for walking motion from the user location to the target location, a command signal is sent via a controller to a navigation alert system mounted on the shoe structure to operate a shoelace motor to output tactile prompts, wherein the tactile prompts are configured to guide the user along the derived route, wherein the shoelace motor is configured to selectively convert the shoelaces or straps between a tightened state and an untensioned state.

18. The method according to claim 17, wherein: Each command signal corresponds to a calibrated navigation alert system prompt indicating a corresponding navigation instruction in the sequence of navigation instructions.

19. The method according to claim 18, further comprising: tracking real-time movement of the user along the derived route; as well as determining whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions in the sequence of navigation instructions, Wherein each command signal is sent in response to determining that one of the new user locations corresponds to a respective navigation instruction associated with the command signal.

20. The method of claim 17, further comprising sending a start command signal to the navigation alert system via the controller to output a start tactile prompt configured to notify a user to begin traveling along the derived route.

21. The method of claim 20, further comprising sending a completion command signal to the navigation alert system via the controller to output a completion tactile cue configured to notify a user that they have arrived at the target location.

22. The method according to any one of claims 17 to 21, wherein: The target object or location includes a virtual object located at a virtual location.

23. The method according to claim 17, wherein: The navigation alert system further includes a tactile transducer, and wherein the command signal causes the tactile transducer to generate a tactile prompt.

24. The method of claim 17, wherein: The shoe structure includes a left shoe structure and a right shoe structure, which are configured to be attached to and support the user's left foot and right foot respectively, and wherein the shoelace motor includes a first and a second shoelace motor respectively mounted on the left shoe structure and the right shoe structure.

25. The method according to claim 24, wherein: The command signals individually and cooperatively activate the first and second lace motors to generate tactile cues configured to guide the user along the lead-in route.

26. The method according to claim 25, wherein: The command signal adjusts the motor speed and / or applied tension of the first and second lace motors to produce additional tactile cues configured to guide the user along the lead-out route.

27. The method of claim 17, wherein: The navigation alert system further comprises an audio system and / or a lighting system, and wherein the command signal causes the audio system to generate an audible prompt and / or causes the lighting system to generate a visual prompt.

28. The method of claim 17, wherein: The controller receives location data from the portable electronic device and / or the remote computing node.

Images