Intelligent electronic shoe system with automatic haptic, auditory and visual feedback navigation assistance

By integrating detection tags and controllers in footwear, wireless communication with vehicles and infrastructure is achieved, and automated tactile, auditory and visual feedback is provided, which solves the early warning and avoidance of pedestrian-vehicle collisions, and improves pedestrian safety and navigation assistance capabilities.

CN120403632APending Publication Date: 2025-08-01NIKE INNOVATE CV
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
CN202510426625.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2020-05-15
Filing Date
2021-04-21
Publication Date
2025-08-01

AI Technical Summary

Technical Problem

Existing footwear items lack effective automation functions and safety protection measures, especially when pedestrians and vehicles collide with each other, they cannot be promptly warned and avoided.

Method used

By integrating detection tags and resident controllers in footwear, interacting with vehicle and infrastructure systems using wireless communications, providing automatic tactile, auditory and visual feedback, enabling pedestrian collision threat assessment and early warning, and synergistically operate traffic lights to avoid collisions.

Benefits of technology

It improves pedestrian safety, reduces false alarms caused by blind spots or obstacles in the line of sight, enhances the prevention ability of pedestrians and vehicles, and provides instant navigation and safety tips.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120403632A_ABST
    Figure CN120403632A_ABST
Patent Text Reader

Abstract

Intelligent electronic footwear and garments having controller automation features, methods for making / operating such footwear and garments, and control systems for performing automation features of such footwear and garments are presented. A method for operating an intelligent electronic shoe (IES) includes receiving location data of a user from a GPS satellite service, for example via a controller via a wireless communication device. The controller also receives location data of the target object or location, such as a virtual shoe hidden at a virtual point, for example from a back-end server-level computer or other remote computing node. A controller retrieves or predicts path planning data including a derived route for traversing from a user location to a target location within a geographic area. The controller then sends command signals to a navigation alarm system mounted on the shoe structure of the IES to output visual, audible and / or tactile cues to guide the user along the derived route.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention application with the application date of April 21, 2021, the application number of 202180035363.7, and the invention name of "Intelligent Electronic Shoes and Logic for Navigation Assistance through Automatic Tactile, Auditory, and Visual Feedback".

[0002] Cross - reference to related applications

[0003] This application claims the benefit and priority of U.S. Patent Application No. 16 / 874,944, filed on May 15, 2020. Technical field

[0004] The present disclosure generally relates to wearable electronic devices. More specifically, aspects of the present disclosure relate to systems, methods, and devices for implementing automated features of intelligent electronic shoes and clothing. Background art

[0005] Footwear items, such as shoes, boots, slippers, sandals, etc., typically consist of two main elements: an upper that secures the footwear to the user's foot; and a sole structure that provides underlying support for the foot. The upper can be made of a variety of materials, including textiles, foams, polymers, natural leather, and synthetic leather, which can be stitched, welded, or adhesively bonded together to form a casing or harness for securely housing the foot. For sandals and slippers, the upper can have an open - toe or open - heel construction, or can generally be limited to a series of straps that extend across the instep and, in some designs, around the ankle. In contrast, boots and shoes are designed with a complete upper that has an enclosed - toe or enclosed - heel construction to enclose the user's foot therein. An ankle opening that passes through the rear - quarter portion of the upper provides access to the interior of the footwear, facilitating entry of the foot into the upper or removal of the foot from the upper. Laces or straps can be used to secure the foot within the upper.

[0006] The sole structure is typically attached to the lower portion of the upper, positioned between the user's foot and the ground. In many footwear items, including boots and athletic shoes, the sole structure is a layered construction that typically incorporates an insole for enhanced comfort, a midsole for shock absorption, and an outsole for surface contact. The insole, which can be partially or fully located within the upper, is a thin and compressible member that provides a contact surface for the underside "plantar region" of the user's foot. In contrast, the midsole is mounted beneath the insole, forming the intermediate layer of the sole structure. In addition to attenuating ground reaction forces, the midsole can also help control foot movement and impart stability. The outsole is fixed to the bottom side of the midsole, and the outsole forms the ground - contact portion of the footwear. The outsole is typically made of a durable and wear - resistant material, including tread patterns for improved traction friction. Summary of the invention

[0007] This document presents a smart electronic shoe with accompanying control logic for implementing automated footwear functionality, a method of manufacturing such footwear, a method of using such footwear, and a control system for providing automated features of the smart electronic shoe. By way of example, an Internet of Adaptive Apparel and Footwear (IoAAF) system is presented that wirelessly communicates with a smart electronic shoe (IES) to provide communication between the IES and the following: (1) a supported wireless device (Footwear-to-Device (F2D)); (2) a third-party IES (Footwear-to-Footwear (F2F)); (3) a motor vehicle (Footwear-to-Vehicle (F2V)); (4) a smart transportation or other infrastructure system (Footwear-to-Infrastructure (F2I)); and / or (5) a grid, network, pedestrian, etc. (Footwear-to-Everything (F2X)). In a representative implementation, the IES is equipped with a detection tag, such as a radio frequency (RF) transponder, that receives incoming cue signals. The cue signals can be broadcast by a transmitter-detector module mounted on a stationary structure (such as a building, streetlight pole, or traffic signal pole, etc.) or a mobile structure (such as a person, bicycle, Society of Automotive Engineers (SAE) level 3, 4, or 5 autonomous vehicle, etc.).

[0008] The IES detection tag can reply to an incoming cue signal having RF power with a first frequency by forwarding the incoming signal as a transparent output signal having RF power with a second frequency. The transponder can be equipped with a frequency filter that limits the incoming signal to a signal having the first frequency, a frequency converter that converts the incoming signal to a transparent output signal, and an amplifier that enhances the output signal based on the incoming signal. Scanning the approaching or surrounding area for response signals output by the IES transponder using a vehicle-mounted or structure-mounted RF transmitter-detector module can avoid pedestrian collisions by issuing an early warning before visual recognition.

[0009] By placing detection tags on the IES and automating the communication between the IES detection tags and complementary transmitter-detectors installed on vehicles, streetlight poles, nearby buildings, etc., the networked IoAAF system allows connected parties to "see ahead" of impending collisions by eliminating the need for direct line-of-sight sensing and provides upcoming "awareness" just before the IES is adjacent to the vehicle. In fact, the IoAAF system architecture helps to eliminate false alarms caused by the inability of standard sensor hardware to effectively monitor pedestrians hidden behind blind corners or other visual obstructions. Auditory, visual, and / or tactile warnings can be automatically issued to pedestrians via the IES, or pedestrian traffic can be altered by modulating crosswalk signal timing, further enhancing anti-collision performance. In addition to being able to identify pedestrian safety, the disclosed IoAAF system can also be used in manufacturing facilities, for example, to prevent robots from injuring assembly line workers; in storage facilities, for example, to avoid collisions between workers and forklifts or automated guided vehicles (AGVs); or at road construction sites, for example, to protect construction workers from vehicle injuries. User movement - start, stop, left, right, accelerate, decelerate, etc. - can be controlled by selective actuation of audio, video, and tactile feedback devices within the IES.

[0010] For F2V and F2I applications, the IoAAF system can automatically communicate with smart footwear / apparel to perform pedestrian collision threat assessment based on a large amount of available data. For example, the F2I system can perform pedestrian collision threat assessment ahead of the line of sight between a moving object and an IES user by aggregating, fusing, and analyzing the following data: user dynamic data generated by the IES (e.g., position, speed, trajectory, acceleration / deceleration, etc.); user behavior data (e.g., historical behavior at specific corners of intersections, historical behavior at intersections in general, historical behavior under current surrounding conditions, etc.); environmental data (e.g., intersections with red and green lights, residential vs. urban environments, adverse weather conditions vs. optimal driving conditions); crowdsourced data (the dynamics and behavior of other pedestrians wearing smart footwear / apparel near the IES user). Interoperable component communication is typically wireless and two-way, where data is passed back and forth between ad hoc networks (e.g., using dedicated short-range communication (DSRC)) and infrastructure components. Traffic management monitoring systems can use IES, infrastructure, and vehicle data to set variable speed limits and adjust the phase and timing of traffic signals.

[0011] To enable wireless communication between the IES and remote electronic devices, the IES may support communication sessions established by the user's smartphone, handheld computing device, or other portable electronic device with wireless communication capabilities. Alternatively, the IES may operate as a stand-alone device together with a resident wireless communication device encapsulated within the shoe structure. Other peripheral hardware may include a resident controller, short-wave antenna, rechargeable battery, resident memory, SIM card, etc., all of which are housed within the shoe structure. The IES may be equipped with a human-machine interface (HMI) that allows the user to interact with the footwear and / or the IoAAF system. For example, one or more electroactive polymer (EAP) sensors may be woven or formed into patches mounted on the shoe structure and are operable to receive user input that allows the user to control operational aspects of the IES. Similarly, any accompanying operations for performing automated footwear features may be performed locally by the IES controller or may be performed in a distributed computing manner for execution by a smartphone, handheld computing device, IoAAF system, or any combination thereof.

[0012] As yet another option, the execution of any one or more of the footwear features described herein may initially require secure authentication of the user via the IES controller and / or the IoAAF system server computer. For example, a distributed sensor array within the shoe structure communicates with the IES controller to perform biometric verification, such as confirming the user's weight (e.g., via pressure sensors), shoe size (e.g., via an electro-adaptive responsive lacing (EARL)), footprint (e.g., via an optical fingerprint sensor), gait profile, or other suitable methods. As an extension of this concept, any of the above sensing devices may be used as a binary (ON / OFF) switch to confirm that the IES is actually on the user's foot when attempting to execute an automated feature. Failure to identify, verify, or confirm the presence of the user may result in the IES being inoperable and / or an electronic notification being sent to the registered owner or the IoAAF system indicating that unauthorized use has been detected.

[0013] Providing wireless data exchange to facilitate the execution of automated features may require registering the IES with the IoAAF system. For example, a user may use the IoAAF system to record the IES serial number, which will then issue a verification key to a personal account (e.g., a "digital safe" running on the user's smartphone, tablet, PC, or laptop) to provide additional authentication. Registration can be done manually by the user, for example, or digitally, for example, via a barcode or a Near Field Communication (NFC) tag on the shoe. A unique virtual shoe can be assigned to the IES and stored in the digital safe. Each virtual shoe can be supported by blockchain security technologies designed to help ensure uniqueness and authenticity, such as cryptographic hash functions, trusted timestamps, associated transaction data, etc. Additional information on cryptographic digital assets for footwear items can be found, for example, in U.S. Patent No. 10505726B1 to Christopher Andon et al., which is incorporated herein by reference in its entirety.

[0014] While the footwear item has been described as a representative application of the novel concepts presented herein, it is envisioned that many of the disclosed options and features can be applied to other wearable clothing, including clothing, headgear, glasses, wristbands, ties, legwear, etc. It is also envisioned that the disclosed features are implemented as part of an Augmented Reality (AR) or Virtual Reality (VR) device or system that is operable to overlay data, notifications, and other visual indicators to perform any of the techniques and options presented above and below.

[0015] Other aspects of the present disclosure relate to methods for manufacturing any of the disclosed systems and devices and methods for using any of the disclosed systems and devices. In an example, a method for automating the cooperation between a Smart Transportation Management (ITM) system and one or more Smart Electronic Shoes is proposed. Each IES is provided with an upper and a sole structure, the upper being attached to the user's foot, and the sole structure being attached to the upper and supporting the user's foot thereon. The representative method includes, in any order and in any combination with any of the features and options disclosed above or below: sending a prompt signal to a detection tag attached to the IES sole structure and / or upper via a transmitter-detector module communicatively connected to a traffic system controller of the ITM system; receiving, via the transmitter-detector module, a response signal generated by the detection tag in response to receiving the prompt signal; determining the user's current location based on the response signal via the traffic system controller; identifying a traffic signal proximate to the user's location and communicatively connected to the traffic system controller; determining the current (first) operating state of the traffic signal; and sending a command signal to the traffic signal via the traffic system controller to switch from the current (first) operating state to a different (second) operating state.

[0016] Aspects of the present disclosure relate to networked control systems and attendant logic for performing automated features of electronic shoes and clothing. For example, a system for automating the cooperative operation between a smart transportation management system and smart electronic shoes is proposed. The system includes a transmitter-detector module mounted on a fixed traffic signal pole or similar structure and broadcasting a cue signal. The system further includes a detection tag mounted on the sole structure and / or upper of the IES and operable to receive the cue signal from the transmitter-detector module and reactively send a response signal back to the transmitter-detector module. A traffic system controller is communicatively connected to the transmitter-detector module and operable to execute instructions stored in memory to perform various operations. The system controller is programmed to: determine a user's real-time location based on the response signal output by the IES detection tag; determine the current (first) operating state (e.g., green signal phase) of a traffic signal that is proximate to the user's location and communicatively connected to the traffic system controller; send a phase change command signal to the traffic signal to switch from the current (first) operating state to a different (second) operating state (e.g., red signal phase).

[0017] For any disclosed system, method, and device, the IES can be equipped with a footwear controller and one or more dynamic sensors, all of which are mounted to the sole structure and / or upper. The dynamic sensors generate and output sensor data indicative of the speed and / or forward direction of the IES. The sensor data is transmitted via the IES footwear controller to the traffic system controller, which uses the received data to determine whether to transmit a command signal to the traffic signal to change the signal's operating state. For example, the traffic system controller can use the dynamic sensor data to determine the expected intrusion time of the IES into a traffic lane as defined by the traffic signal. The traffic system controller then determines the estimated phase change time as the difference between the current time and a pre-programmed phase change time when the traffic signal is scheduled to switch from the first operating state to the second operating state. Once calculated, the traffic system controller determines whether the expected intrusion time is less than the estimated phase change time; if so, the traffic system controller automatically sends a phase change command signal to the traffic signal. The traffic system controller can also determine: (1) if the speed of the IES is substantially equal to zero, and (2) if the forward direction of the IES is in a direction away from the traffic lane as defined by the traffic signal. If either (1) or (2) returns an affirmative determination, the traffic system controller is programmed not to send a phase change command signal to the traffic signal.

[0018] For any disclosed system, method, and device, a traffic system controller can determine the current location, speed, and / or trajectory of a motor vehicle in a traffic lane regulated by a traffic signal. The traffic system controller will simultaneously determine whether the current location of a user is within a predetermined proximity of the current location of the vehicle. In such a case, in response to determining that the user location is within the proximity of the vehicle location, a phase change command signal will be sent to the traffic signal. As a further option, the traffic system controller can send a pedestrian collision warning signal to a footwear controller in response to the current location of the user being within a predetermined proximity from the current location of the vehicle. The footwear controller can respond to the receipt of the pedestrian collision warning signal by sending one or more command signals to a dwelling warning system attached to the sole structure / upper and operable to generate a predetermined visual, audible, and / or tactile alert that the user can perceive.

[0019] For any disclosed system, method, and device, a detection tag can include an RF transponder mounted on the IES sole structure and / or upper. In such a case, a prompt signal has a first RF power at a first frequency, while a response signal has a second RF power at a second frequency different from the first frequency. The prompt signal includes an embedded data set; the response signal retransmits a portion of the embedded data set back to the transmitter-detector module. The RF transponder can be equipped with an RF antenna and a frequency filter connected to the RF antenna. The frequency filter is operable to reject any RF signal having an RF power with a frequency different from the first frequency.

[0020] For any disclosed system, method, and device, a dwelling footwear controller can send real-time user location and dynamic data to a traffic system controller. The traffic system controller in turn fuses the real-time user location data and user dynamic data together to determine a pedestrian collision threat value. The pedestrian collision threat value predicts an intrusion of the user relative to the current location and predicted route of a motor vehicle. The footwear controller can also aggregate and transmit behavior data representing the historical behavior of the user while wearing the IES. In such a case, the pedestrian collision threat value is also based on the fusion of the user location and dynamic data with the behavior data. As another option, the traffic system controller can collect crowd-sourced data indicative of the behavior of a plurality of individuals in the vicinity of the user. In such a case, the pedestrian collision threat value is also based on the fusion of the behavior data, user location data, and / or user dynamic data with the crowd-sourced data. The traffic system controller can also aggregate and transmit environmental data indicative of the characteristics of the user's surroundings. The pedestrian collision threat value is also based on the fusion of the behavior data, user location data, user dynamic data, and / or crowd-sourced data with the environmental data.

[0021] For any disclosed system, method, and device, a traffic system controller may send a pedestrian collision warning signal to a footwear controller. Once the warning signal is received, the footwear controller may automatically respond by sending an activation command signal to a resident haptic transducer, causing the haptic transducer to generate a predetermined haptic alert that is designed to warn the user of an impending collision with a motor vehicle. Optionally or alternatively, the footwear controller may automatically respond to receiving the pedestrian collision warning signal by outputting an activation command signal to a resident audio system, which causes an associated audio component to generate a predetermined audible alert that is designed to warn the user of an impending collision. As yet another option, a resident footwear controller may automatically respond to receiving the pedestrian collision warning signal by sending an activation command signal to a resident lighting system, which causes an associated lighting element to generate a predetermined visual alert that is designed to warn the user of an impending collision with a motor vehicle.

[0022] Also presented herein are smart electronic shoes and clothing having assistive control logic and a resident navigation alert system for providing user navigation assistance through automatic haptic, audible, and / or visual feedback. It is envisioned that the disclosed IES and IES control systems can be used as input and / or output devices for location-based and navigation-based games, tours, trips, entertainment, marketing, etc. In a non-limiting example, a pair of automatic lacing motors encapsulated on or within the shoe structure of a pair of IES are operated individually and in concert as haptic force feedback devices to provide navigation instructions to the user. One representative application is to provide turn-by-turn directions to the user through haptic, audible, and / or visual feedback devices resident within the "shoe" to assist them in navigating from a current "start" location or designated origin to a desired "end" location or a selected series of stopping points.

[0023] Another representative application of IES-based navigation assistance includes directions to physical or virtual objects or checkpoints, which may be individually sensed in VR or AR (e.g., via SNKRS Stash TM or CryptokickS TM feature access content). For example, a user may be prompted to "hunt" for a pair of "hidden" virtual CryptoKicks within a physical store by using the photography "snap" or augmented reality features on a wireless-enabled handheld computing device TMAfter determining the user's real-time location, a set of instructions is exported for navigating around the store to locate the target virtual object. These instructions are converted into a corresponding sequence of haptic cues, each haptic cue being adapted to correspond to a specific action (such as forward, backward, left, right, start, stop, etc.). The haptic cues are then delivered to the user through the sequential activation and adjustment of the shoelace motors. Additional information regarding geocaching for target searching of tangible and virtual objects can be found, for example, in U.S. Patent Application Publication No. 2019 / 0080342A1 to Christopher Andon et al., the entire contents of which are incorporated herein by reference for all purposes.

[0024] Aspects of the present disclosure relate to intelligent footwear and clothing for providing user navigation assistance through automated haptic, auditory, and / or visual feedback. In one example, an intelligent electronic shoe is presented for assisting a user in navigating to a target object and / or target location. The IES includes a shoe structure, such as an upper mounted to a sole structure, for attaching to and supporting a user's foot thereon. A navigation alert system mounted on or in the IES shoe structure is selectively operable to generate visual, auditory, and / or haptic outputs in response to an electronic command signal. The IES is also equipped with a wireless communication device operable to wirelessly communicate with a remote computing node, such as by providing data exchange with a backend or middleware server class computer through a hosted session with a handheld smartphone or a wireless-enabled tablet computer.

[0025] Continuing the discussion of the above example, a resident or remote controller is communicatively coupled to the navigation alert system and the wireless communication device. The controller is programmed to receive, retrieve, calculate, estimate, etc. (collectively referred to as "determine") the user's location data and, simultaneously, receive the location data of the target object / location from the remote computing node. Using this information, the controller determines path planning data, including a derived route for traversing from the user location to the target location within a specified geographic area. Once the path planning data is obtained, the controller sends a command signal to the navigation alert system to output visual, auditory, and / or haptic cues designed to guide the user along the derived route.

[0026] Other aspects of the present disclosure are directed to methods for manufacturing smart footwear and clothing to provide user navigation assistance and methods of using smart footwear and clothing. In one example, a method for operating an IES to assist a user in navigating to a target object or location in a geographic area is presented. The representative method includes, in any order and in any combination with the features and options disclosed above or below: receiving, via a controller, location data indicative of a user's location through a wireless communication device; receiving, via the controller, location data indicative of a target location of a target object or place from a remote computing node through the wireless communication device; determining, via the controller, path planning data that includes a derived route for traversing from the user location to the target location within the geographic area; and sending, by the controller, a command signal to a navigation alert system mounted on a shoe structure to output visual, auditory, and / or tactile cues that guide the user along the derived route.

[0027] For any of the disclosed systems, methods, and devices, the path planning data may include a sequence of navigation instructions for a walking motion from the user location to the target location. In such a case, each command signal corresponds to a calibrated navigation alert system cue indicative of the corresponding navigation instruction. The controller may also track the user's real-time movement along the derived route and determine whether each new user location in a sequence of new user locations along the route corresponds to one of the navigation instructions in the path planning data. In such a case, each command signal is sent in response to determining that one of the new user locations corresponds to the corresponding navigation instruction associated with the command signal. Each navigation instruction includes one or more of the following: forward, backward, left turn, right turn, accelerate, decelerate, up, down, start, stop, turn around, etc.

[0028] For any of the disclosed systems, methods, and devices, the controller may also send a start command signal to the navigation alert system to output visual, auditory, and / or tactile cues that are designed to notify the user to start traveling along the derived route. Similarly, the controller may also send a completion command signal to the navigation alert system to output visual, auditory, and / or tactile cues that are designed to notify the user that they have reached the target location. For at least some applications, the target object / location is a virtual object located at a virtual location. The target location may be delineated by a virtual geofence; the controller may respond to the user violating the geofence by sending a completion command signal to the alert system to output a feedback cue that notifies the user that they have reached the target object / location.

[0029] For any of the disclosed systems, methods, and devices, a navigation alert system includes a haptic transducer mounted to a sole structure and operable to generate a haptic cue in response to a command signal to assist a user in navigation. In some system architectures, the haptic transducer is a shoelace motor mounted on or within the shoe structure and operable to selectively transition the shoelaces or straps of the IES between a tightened and an untightened state. The IES can include a left shoe and a right shoe that respectively attach to and support a user's left and right feet. In such a case, the haptic transducer includes discrete shoelace motors mounted on the shoe structures of the left and right shoes. Command signals generated by a controller individually and cooperatively activate the two shoelace motors, thereby generating haptic cues for guiding the user along a derived route. As yet another option, the command signals adjust the motor speed and / or the applied tension of the two shoelace motors, thereby generating haptic cues for guiding the user along a derived route.

[0030] The foregoing summary does not represent every embodiment or every aspect of the present disclosure. Rather, the foregoing summary merely provides examples of some of the novel concepts set forth herein. When taken in conjunction with the accompanying drawings and the appended claims, the above-described features and advantages of the present disclosure, as well as other features and attendant advantages, will become apparent from the following description of illustrative examples and representative modes for implementing the present disclosure. In addition, the present disclosure expressly includes any and all combinations and subcombinations of the elements and features presented above and below. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a side elevational view of a representative smart electronic shoe with controller automated footwear features, in accordance with aspects of the present disclosure.

[0032] Figure 2 is Figure 1 a partial schematic bottom view of the representative smart electronic shoe.

[0033] Figure 3 is a partial schematic perspective view of a representative user wearing Figure 1 and Figure 2 a pair of smart electronic shoes during wireless data exchange to perform one or more automated footwear features, in accordance with aspects of the present disclosure.

[0034] Figure 4 is an overhead perspective view of multiple representative users each wearing Figure 1 and Figure 2 a pair of IESs during wireless data exchange with a representative smart transportation management system to perform one or more automated footwear features and one or more automated transportation system features.

[0035] Figure 5is a flowchart showing a representative automated footwear feature protocol that, in accordance with aspects of the disclosed concepts, may correspond to instructions stored in memory and executed by a resident or remote control logic circuit, programmable controller, or other computer-based device or network of devices.

[0036] Figure 6 is in accordance with aspects of the present disclosure using Figure 1 and 2 a pair of IESs to automatically interact with the security system of a representative building, a perspective view of a representative user.

[0037] Figure 7 is in accordance with aspects of the present disclosure using Figure 1 and Figure 2 a pair of IESs to automatically interact with one or more subsystems of a home automation system, a plan view illustration of a representative user.

[0038] Figure 8 is a partial schematic perspective view of a representative electronic navigation assistance system in accordance with aspects of the present disclosure, the system including a representative wireless-enabled handheld computing device in communication with an IES equipped with a navigation alert system.

[0039] Figures 9A - 9D is Figure 8 a partial schematic view of the representative electronic navigation assistance system, showing the representative handheld computing device in communication with the IES to execute a user navigation assistance application to help the user locate a representative target object and / or location.

[0040] Figure 10 is a flowchart showing a representative IES navigation algorithm for assisting a user to circumnavigate a predetermined path in accordance with aspects of the present disclosure, which may correspond to instructions stored in memory and executed by a resident or remote system controller, control logic circuit, programmable electronic control unit, or other integrated circuit (IC) device or network of IC devices.

[0041] The present disclosure is adaptable to various modifications and alternative forms, and some representative embodiments have been shown by way of example in the drawings and will be described in detail herein. However, it should be understood that the novel aspects of the present disclosure are not limited to the specific forms shown in the above-listed drawings. Rather, the present disclosure will cover all modifications, equivalents, combinations, sub-combinations, permutations, groupings, and alternatives falling within the scope of the present disclosure as covered by the appended claims. Detailed Description

[0042] The present disclosure is amenable to being implemented in many different forms. Representative embodiments of the present disclosure are shown in the drawings and will be described in detail herein. It should be understood that these shown examples are provided as an illustrative exposition of the disclosed principles and not as a limitation on the broad aspects of the present disclosure. In this regard, elements and limitations described in the abstract, technical field, background art, summary of the invention, and detailed description sections but not expressly recited in the claims should not be incorporated into the claims singly or collectively by implication, inference, or otherwise.

[0043] For the purposes of this detailed description, unless otherwise specified: the singular includes the plural and vice versa; the words “and” and “or” shall be both conjunctive and disjunctive; the words “any” and “all” shall each mean “any and all”; and, “comprising”, “including”, and “having” shall each mean “including but not limited to”. Additionally, approximating words such as “about”, “substantially”, “essentially”, “approximately” etc. may be used herein in the sense of “at, near, in the vicinity of” or “within 0 - 5%” or “within acceptable manufacturing tolerances” or any logical combination thereof. Finally, directional adjectives and adverbs such as before, after, inner, outer, proximal, distal, vertical, horizontal, front, back, left, right etc. may be, for example, with respect to a footwear article worn on a user's foot and operatively oriented such that the ground engaging portion of the sole structure is on a flat surface.

[0044] Referring now to the drawings, in which like reference numerals represent like features throughout several views, Figure 1 a representative footwear article is shown, generally designated 10 and depicted herein for discussion purposes as a sports shoe or “sneaker”. The illustrated footwear item 10 (also referred to herein as a “smart electronic shoe” or “IES” for brevity) is merely an exemplary application by which the novel aspects and features of the present disclosure may be practiced. Similarly, the use of this concept in embodiments of wearable electronic devices worn on a human foot should also be understood as a representative application of the concepts disclosed herein. It will be understood that aspects and features of the present disclosure may be integrated into other footwear designs and may be incorporated into any logically related type of wearable electronic device worn on any part of the body. As used herein, the terms “shoe” and “footwear”, including their permutations, may be used interchangeably and synonymously to refer to any relevant type of clothing worn on the foot. Finally, the features shown in the drawings are not necessarily drawn to scale and are provided for illustrative purposes only. Accordingly, the specific and relative dimensions shown in the drawings should not be construed as limiting.

[0045] A representative footwear article 10 is shown in Figure 1 and Figure 2In general, it is described as a two - part construction, mainly consisting of an upper 12 that houses the foot and is mounted on top of a sole structure 14 below. For ease of reference, the footwear 10 can be divided into three anatomical regions: the forefoot region R FF , the midfoot region R MF and the hindfoot (heel) region R HF , as Figure 2 shown. The footwear 10 can also be divided into a lateral section S LA (the distal half of the shoe 10 farthest from the sagittal plane of the human body) and a medial section S ME (the proximal half of the shoe 10 closest to the sagittal plane of the human body). According to accepted anatomical classifications, the forefoot region R FF is located at the front of the footwear 10 and generally corresponds to the phalanges (toes), metatarsals, and any interconnecting joints therebetween. The midfoot region R FF is inserted between the forefoot region and the hindfoot regions R HF and R MF , and this midfoot region generally corresponds to the cuneiform, navicular, and cuboid bones (i.e., the arch region of the foot). Conversely, the heel region R HF is located at the rear of the footwear 10 and generally corresponds to the talus and calcaneus. The lateral and medial sections S LA and S ME of the footwear 10 both extend through all three anatomical regions R FF , R MF , R HF , and each corresponds to the respective lateral side of the footwear 10. Although only a single shoe 10 for the user's left foot is shown in Figure 1 and 2 , a substantially identical mirror image counterpart for the user's right foot can be provided, as Figure 3 shown. It can be appreciated that the shape, size, material composition, and manufacturing method of the shoe 10 can be changed individually or jointly to accommodate virtually any conventional or unconventional application.

[0046] Refer to Figure 1, the upper 12 is depicted as having a closed toe and heel configuration, which is generally defined by three interconnected parts: a toe box 12A that covers and protects the toes; an upper 12B that extends behind the toe box and around the lace eyelets 16 and the tongue 18; and a rear quarter 12C that is behind the upper 12B and includes the rear and sides of the upper 12 that cover the heel. The upper 12 portion of the footwear 10 can be made of any one or a combination of a variety of materials, such as textiles, foams, polymers, natural leather, and synthetic leather, etc., which are stitched, adhesively bonded, or welded together to form an internal void for comfortably accommodating the foot. The individual material elements of the upper 12 can be selected and positioned relative to the footwear 10 so as to, for example, impart durability, breathability, abrasion resistance, flexibility, and comfort. An ankle opening 15 in the rear quarter 12C of the upper 12 provides access to the interior of the shoe 10. Laces 20, straps, buckles, or other mechanisms can be used to vary the circumference of the upper 12 to hold the foot more securely within the shoe 10 and to facilitate entry and exit of the foot from the upper 12. The laces 20 can pass through a series of eyelets in the upper 12; the tongue 18 can extend between the laces 20 and the internal void of the upper 12.

[0047] The sole structure 14 is firmly attached to the upper 12 such that the sole structure 14 extends between the upper 12 and a support surface (e.g., Figure 3 the ground GS1) on which the user stands. In fact, the sole structure 14 acts as an intermediate support platform that separates the user's foot from the ground. In addition to attenuating ground reaction forces and providing cushioning for the foot, Figure 1 and 2 the sole structure 14 can also provide traction, impart stability, and help limit various foot movements, such as inadvertent foot inversion and eversion. According to the illustrated example, the sole structure 14 is manufactured to have a sandwich structure with an uppermost insole 22, an intermediate midsole 24, and a lowermost outsole 26. The insole 22 shown is partially located within the internal void of the footwear 10 and is firmly attached to the lower portion of the upper 12 such that the insole 22 is near the plantar surface of the foot. Below the insole 22 is the midsole 24, which incorporates one or more materials or embedded elements that enhance the comfort, performance, and / or ground reaction force attenuation characteristics of the footwear 10. These elements and materials can individually or in any combination include polymeric foam materials (such as polyurethane or ethyl vinyl acetate (EVA)), filling materials, modifiers, inflatable air bladders, plates, support elements, or motion control members. The outsole 26, which may not be present in certain configurations of the footwear 10, is attached to the lower surface of the midsole 24. The outsole 26 can be formed of a rubber material that provides a durable and abrasion-resistant surface for engaging the ground. Additionally, the outsole 26 can also have a texture to enhance the traction (i.e., friction) performance between the footwear 10 and the underlying support surface.

[0048] Figure 3 is a partial schematic view of an exemplary IES data network and communication system generally designated 30 for providing wireless data exchange to perform one or more automated footwear features for a pair of smart electronic shoes 10 worn by a user or customer 11. Although a single user 11 is shown communicating with a single motor vehicle 32 via the IES system 30, it is contemplated that any number of users may communicate with any number of motor vehicles or other remote computing nodes adapted for wireless exchange of information and data. Figure 3 One or both of the IESs 10 are communicatively coupled to a remote host system 34 or a cloud computing system 36 via a wireless communication network 38. Wireless data exchange between the IESs 10 and the IES system 30 may occur directly, such as in a configuration where the IESs 10 are equipped as stand-alone devices, or indirectly, such as by pairing and hitching the IESs 10 to a smart phone 40, a smart watch 42, a wireless local area network (WiFi) node, or other suitable device. In this regard, the IESs 10 may communicate directly with the motor vehicle 32, for example, via a short-range wireless communication device (e.g., a Bluetooth unit or a near field communication (NFC) transceiver), a dedicated short range communication (e.g., DSRC) component, a radio antenna, etc. Only selected components of the IESs 10 and the IES system 30 are shown and will be described in detail herein. However, the systems and devices discussed herein may include many additional and alternative features as well as other available hardware and well-known peripheral components, for example, to perform the various methods and functions disclosed herein.

[0049] Continuing reference Figure 3, the host system 34 can be implemented as a high-speed server computing device or mainframe computer capable of handling batch data processing, resource planning, and transaction processing. For example, the host system 34 can operate as a host in a client-server interface to perform any necessary data exchange and communication with one or more "third-party" servers to complete a specific transaction. On the other hand, the cloud computing system 36 can be used as middleware for IoT (Internet of Things), WoT (Web of Things), Internet of Adaptive Apparel and Footwear (IoAAF), and / or M2M (Machine-to-Machine) services, connecting various heterogeneous electronic devices to a service-oriented architecture (SOA) via a data network. As an example, the cloud computing system 36 can be implemented as a middleware node to provide different functions for dynamically loading heterogeneous devices, reusing data from each of these devices, and routing data through reconfigurable processing logic for processing and transmission to one or more destination applications. The network 38 can be any available type of network, including a combination of public distributed computing networks (e.g., the Internet) and secure private networks (e.g., local area networks, wide area networks, virtual private networks). It can also include wireless and wired transmission systems (e.g., satellites, cellular networks, terrestrial networks, etc.). In at least some aspects, most (if not all) of the data transaction functions performed by the IES 10 can be carried out over a wireless network such as a wireless local area network (WLAN) or a cellular data network to ensure the freedom of movement of the user 11 and the IES 10.

[0050] The footwear 10 is equipped with various embedded electronic hardware to function as a hands-free, rechargeable, and intelligent wearable electronic device. The various electronic components of the IES 10 are controlled by one or more electronic controller devices, such as the resident footwear controller 44 encapsulated within the sole structure 14 of the footwear 10 ( Figure 2)。The footwear controller 44 can include any one or more combinations of the following: logic circuits, dedicated control modules, electronic control units, processors, application specific integrated circuits, or any suitable integrated circuit device, whether resident, remote, or a combination of both. For example, the footwear controller 44 can include multiple microprocessors, the multiple microprocessors including a main processor, slave processors, and / or auxiliary or parallel processors. As used herein, the controller 44 can include any combination of hardware, software, and / or firmware disposed inside and / or outside the shoe structure of the IES 10, configured to communicate with the IES 10 and buses, computers, processors, devices, services, and / or networks and / or control data transfer therebetween. The footwear controller 44 is generally usable to execute any one or all of the various computer program products, software, applications, algorithms, methods, and / or other processes disclosed herein. During the use or operation of the controller 44, routines can be executed in real time, continuously, systematically, sporadically, and / or at regular intervals, such as every 100 microseconds, 3.125, 6.25, 12.5, 25, and 100 milliseconds, etc.

[0051] The footwear controller 44 can include a resident or remote storage device, or can communicate with a resident or remote storage device, such as a resident footwear memory 46 encapsulated within the sole structure 14 of the footwear 10. The resident footwear memory 46 can include semiconductor memory, including volatile memory (e.g., random access memory (RAM) or multiple RAMs) and non-volatile memory (e.g., read only memory (ROM) or EEPROM), magnetic disk storage media, optical storage media, flash memory, etc. The ability to communicate with remote networking devices can be provided by one or more or all of a cellular network chipset / component, satellite service chipset / component, or wireless modem or chipset / component, all of which are Figure 2 collectively denoted as 48 in . A short-range wireless connection can be provided by a transceiver, radio frequency identification (RFID) tag, NFC device, DSRC component, or radio antenna, all of which are denoted as 50. A resident power source, such as a lithium ion battery 52 having plug-in or cableless (inductive or resonant) rechargeability, can be embedded within the upper 12 or sole structure 14 of the footwear 10. Wireless communication can be further facilitated by implementing BLUETOOTH Low Energy (BLE), Category (CAT) M1, and / or CAT-NB1 wireless interfaces. The various communication devices described above can be configured to exchange data between devices, as part of a system or periodic beacon message broadcast in footwear-to-vehicle (F2V) data exchange and / or footwear-to-everything (F2X) data exchange (e.g., footwear-to-infrastructure (F2I), footwear-to-pedestrian (F2P), or footwear-to-footwear (F2F)).

[0052] The position and movement of the IES10 and thus the user 11 can be tracked by a position tracking device 54, which can be located within the sole structure 14 or the upper 12 or a combination thereof. The position data can be determined by a satellite-based Global Positioning System (GPS) or other suitable navigation system. In one example, a GPS system can use a collaborative group of orbiting GPS satellites to monitor the position of a person, a motor vehicle, or other target object on the Earth. The collaborative group of orbiting GPS satellites communicates with a suitable GPS transceiver to generate a series of timestamped data points in real time. In addition to providing data related to the absolute latitude and absolute longitude position coordinates of the GPS receiver carried by the target object, the data provided by the GPS system can also be modified and used to provide information about the time elapsed during the execution of a specified operation, the distance traveled, the elevation or altitude at a specific location, the elevation change within a specified time window, the direction of movement, the speed of movement, etc. The resident footwear controller 44 can use the aforementioned convergent set of GPS data to estimate the predicted route of the user 11. The GPS system data can be used alone or in combination to supplement and optionally calibrate the speed and distance data based on an accelerometer or other pedometer-based data. To this end, the information collected by the GPS satellite system can be used to generate correction factors and / or calibration parameters for use by the IES10 to help ensure accurate sensor data and thus ensure optimal system operation.

[0053] Even without a GPS receiver, the IES10 can determine position and movement information by cooperating with a cellular system via a process called "triangulation". The cell towers and base stations of the cellular system communicate radio signals and are arranged in a cellular network. A cellular device such as the IES10 can be equipped with a low-power transmitter for communicating with the nearest cell tower, base station, router, or access point. When the user uses the IES10 (e.g., moving from one cell to another), the base station monitors the strength of the transmitter signal. When the IES10 moves towards the edge of a cell, the transmitter signal strength of the current reflecting tower decreases. At the same time, the base station in the approaching cell detects an increase in signal strength. When the user enters a new cell, the reflecting tower transfers the signal from one to another. The resident footwear controller 44 can determine the position of the IES10 based on the measurements of the transmitter signals, such as the angle of approach to the (multiple) cellular reflecting towers, the time taken for each signal to propagate to the multiple reflecting towers, and the respective strengths of each signal when it reaches the corresponding reflecting tower. According to other aspects of this concept, one or more motion sensing devices can be integrated into the shoe structure to determine the dynamic movement (e.g., translation, rotation, speed, acceleration, etc.) of the IES10 around or along one or more axes relative to an established reference or reference (e.g., position, spatial orientation, reaction, force, speed, acceleration, electrical contact, etc.).

[0054] Common reference Figure 1 and Figure 2 , the footwear article 10 can be equipped with a resident illumination system 56 having one or more lighting devices controlled by a footwear controller 44 to selectively illuminate the shoe structure and its surrounding area. The illumination system 56 can employ different types of lighting devices, including light emitting diodes (LEDs), electroluminescent panels (ELPs), compact fluorescent lamps (CFLs), high intensity discharge lamps, flexible and non-flexible organic LED displays, flat liquid crystal displays (LCDs), and other available types of lighting elements. Any number of lighting devices can be disposed on any part of the shoe 10; as shown, the first lighting device 58 is encapsulated within the sole structure 14 located within the midfoot region R of the footwear 10 MF of the shoe. The first lighting device 58 is positioned adjacent to a window 60 ( Figure 1 ), which is sealed within a frame aperture extending through the peripheral wall of the sole structure 14 on the outer side of the shoe 10. The lighting device 58 can operate in an illuminated or "on" state, a non-illuminated or "off" state, a range of illumination intensities (e.g., low, medium, and high light outputs), various colors, and / or various illumination modes. With this arrangement, the first lighting device 58 selectively illuminates a portion of the upper 12 of the shoe, a portion of the sole 14, and a portion of the ground G adjacent to the IES 10 S1 .

[0055] Now referring Figure 5 to the flowchart of, according to aspects of the present disclosure, an improved method or control strategy for automating the cooperation between a wearable electronic device (e.g., Figure 1 and 2 the IES 10) and an intelligent transportation management (ITM) system (which is represented herein by the IES data network and communication system 30 of Figure 3 ) is generally described at 100. Figure 5 Some or all of the operations shown in and further described below may represent algorithms corresponding to processor-executable instructions that can be stored, for example, in a main memory, an auxiliary memory, or a remote memory, and executed, for example, by a resident or remote controller, a central processing unit (CPU), control logic circuitry, or other module or device to perform any or all of the functions described above or below associated with the disclosed concepts. It should be recognized that the order of execution of the shown operation blocks can be changed, additional blocks can be added, and some of the described blocks can be modified, combined, or eliminated.

[0056] The method 100 begins at block 101 with processor-executable instructions for a programmable controller or control module or similar suitable processor, such as Figure 2resident footwear controller 44 to invoke an initializer for a protocol that controls the operation of a wearable electronic device (e.g., Figure 1 IES 10). During use of the smart electronic shoe 10, this routine can be called and executed in real time, continuously, systematically, sporadically, and / or at regular intervals, etc. Referring to Figure 3 the architecture of the IES data network and communication system 30, as a Figure 5 representative implementation of the method described in Figure 3 the initialization process at block 101 can automatically start each time the user 11 approaches a road or road intersection 13, each time the user 11 approaches a vehicle 32 or is approached by a vehicle 32, or each time the user 11 is within a detectable proximity of a moving transmitter-detector module 70 (e.g., mounted on a vehicle 32) or a fixed transmitter-detector module 72 (e.g., mounted on a crosswalk signal pole 74). Using a portable electronic device such as a smartphone 40, a smartwatch 42, the user 11 can launch a dedicated mobile application or a web-based applet that collaborates with a smart transportation system (e.g., represented by a remote host system 34) via an IoAAF middleware node (e.g., represented by a cloud computing system 36) to monitor the user 11, e.g., as part of a pedestrian collision avoidance process.

[0057] The "Digital Safe" operating on a smartphone 40 that connects to software applications and registers through an IoAAF middleware node. Thus, transactions can be achieved through, for example, a combination of personal identification input (such as mother's maiden name, social security number, etc.) and a secret PIN code (such as a six - digit or eight - digit code), or a combination of a password (such as created by user 11) and a corresponding PIN code (such as issued by the host system 34), or a combination of credit card input and a secret PIN number. Additionally or alternatively, a barcode, RFID tag, or NFC tag can be printed on or attached to the IES10 shoe structure and configured to transmit a security authentication code to the IES system 30. Other well - established authentication and security technologies, including blockchain cryptography, can be used to prevent unauthorized access to user accounts, for example, to minimize the impact of unauthorized access to user accounts or to prevent unauthorized access to personal information or funds through user accounts.

[0058] As an alternative or complementary option to manually entering identification information in the predefined process block 103, the security authentication of user 11 can be automatically performed by the resident footwear controller 44. By way of non - limiting example, a pressure sensor 62, which can be of the nature of a binary contact - type sensor switch, can be attached to the footwear 10 (for example, embedded within the midsole 24 of the sole structure 14). This pressure sensor 62 detects a calibrated minimum load on the insole 22, thereby determining the presence of a foot in the upper 12. Any future automated features of the IES10 may first require the controller 44 to confirm the presence of a foot in the upper 12 to the binary pressure sensor 62 through a prompt signal, and thus use the footwear 10 to initiate an automated operation before transmitting a command signal. Although only a single sensor is shown in Figure 2 it is envisioned that the IES10 can be equipped with a distributed sensor array, including pressure, temperature, humidity, and / or shoe kinetics sensors, encapsulated at discrete locations throughout the shoe structure. Similarly, foot presence sensing (FPS) can be determined through various available sensing technologies (including capacitance, electromagnetic, etc.). Additional information regarding foot presence sensing can be found, for example, in U.S. Patent Application Publications US2017 / 0265584A1 and US2017 / 0265594A1 by Steven H. Walker et al., both of which are incorporated herein by reference in their respective entireties and for all purposes.

[0059] In addition to serving as a binary (ON / OFF) switch, the pressure sensor 62 can also employ a multi-mode sensor configuration (e.g., a polyurethane dielectric capacitive biofeedback sensor) that detects any of a variety of biometric parameters, such as the magnitude of the applied pressure generated by the foot in the upper 12, and outputs one or more signals indicative thereof. These sensor signals can be transmitted from the pressure sensor 62 to the resident footwear controller 44, which then aggregates, filters, and processes the received data to calculate the current user weight value. The current user weight calculated for the individual currently using the IES 10 is compared to a previously verified, memory-stored user weight (e.g., a registered user of an existing personal account has been authenticated). In this way, the footwear controller 44 can determine whether the current user weight is equal to or within a predetermined threshold range of the verified user weight. Once the current user is authenticated as a verified user, the resident footwear controller 44 is then able to send command signals to one or more subsystems within the footwear 10 to automate its features.

[0060] As part of the predefined process block 103, automatic security authentication of the user can be achieved through other available techniques, including cross-referencing the characteristics of the current user's foot with the previously verified characteristics of the feet of an authenticated user. For example, a representative IES 10 is shown Figure 2 in which incorporates a powered lacing system that uses a shoelace motor (M) 64 mounted on the footwear 10, and the shoelace motor can be selectively actuated to move the shoelace 20 back and forth between an untensioned (loose) state and one or more tensioned (tightened) states. The shoelace motor 64 can be a bidirectional DC worm gear motor that is housed within the sole structure 14 and is controlled by the resident footwear controller 44. Activation of the shoelace motor 64 can be initiated by a manual activation switch built into the shoe structure or by an app on the user's smartphone 40 or smartwatch 42 via a soft key. Control commands can include, but are not limited to, incremental tightening, incremental loosening, open / fully loosen, store "preferred" tension, and restore / recover tension. Additional information regarding powered shoelace tensioning systems can be found, for example, in U.S. Patent US9,365,387B2, which is incorporated herein by reference in its entirety for all purposes.

[0061] For example, in response to a sensor signal from pressure sensor 62 indicating that a foot has been placed within shoe upper 12, motor control of lace motor 64 can be automated via resident footwear controller 44. During use of IES 10, lace tension can be actively adjusted by controller 44 via controlled operation of lace motor 64, for example, to better hold a foot in response to dynamic user movement. In at least some embodiments, an H-bridge mechanism is employed to measure motor current; the measured current is provided as an input to footwear controller 44. Resident footwear memory 46 stores a look-up table having a list of calibrated currents, with each calibrated current known to correspond to a certain lace tension position. By checking the measured motor current against the calibrated currents recorded in the look-up table, footwear controller 44 can determine the current tension position of lace 20. The foregoing functionality, as well as any other logically related options or features disclosed herein, can be applied to alternative types of wearable apparel, including clothing, headgear, eyewear, wristbands, neckties, legwear, undergarments, and the like. Additionally, lace motor 64 can be adapted to automate the tensioning and loosening of straps, latches, cables, and other commercially available mechanisms for securing a shoe.

[0062] Similar to pressure sensor 62 discussed above, lace motor 64 can function as a binary (ON / OFF) switch that effectively enables and disables the automated features of IES 10. That is, prior to performing automated features, resident footwear controller 44 can communicate with lace motor 64 to determine whether lace 20 is in a tensioned or untensioned state. If the latter, all automated features can be disabled by resident footwear controller 44 to prevent accidental activation of automated functions when IES 10 is not in use. Conversely, upon determining that lace motor 64 has placed lace 20 in a tensioned state, footwear controller 44 is permitted to send automated command signals.

[0063] During operation of the shoelace motor 64, the shoelace 20 can be placed in any of a plurality of discrete, tensioned positions to accommodate feet with different circumferences or users with different tension preferences. A shoelace sensor that can be built into the motor 64 or encapsulated in the sole structure 14 or the upper 12 can be used to detect the current tensioned position of the shoelace 20 for a given user. Alternatively, real-time tracking of the position of the output shaft (e.g., worm gear) of the two-way electric shoelace motor 64 or the position of a designated portion of the shoelace 20 (e.g., the shoelace spool that mates with the worm gear of the motor) can be used to determine the shoelace position. When the shoelace 20 is tensioned, the resident footwear controller 44 communicates with the shoelace motor 64 and / or the shoelace sensor to identify the current tensioned position of the shoelace 20 for the current user. This current tensioned position can then be compared to a previously verified, memory-stored shoelace tensioned position (e.g., for a registered user of an existing personal account). From this comparison, the footwear controller 44 can determine whether the current tensioned position is equal to or within a predetermined threshold range of the verified tensioned position. After authenticating the current user as a verified user, command signals can be transmitted via the resident footwear controller 44 to one or more subsystems within the footwear 10 to automate its features. If the current user cannot be authenticated or verified, the footwear controller 44 can be disabled such that the IES becomes inoperable.

[0064] When the authentication process set forth in the predefined process block 103 is complete, Figure 5 Method 100 proceeds via processor-executable instructions to the input / output block 105 to retrieve sufficient data to track the movement of one or more target objects moving in a designated environment monitored by the IES system 30. According to Figure 3 the example shown, the IES 10, remote host system 34, and / or cloud computing system 36 can directly receive or receive via cooperation with the smartphone 40 or smartwatch 42 position data indicating the current position and speed (rate and direction) of the user 11 and the current position and speed (rate and direction) of the motor vehicle 32. User movement can also be tracked by a dedicated mobile app or route planning app running on the user's smartphone 40. The position and movement of the IES 10 and thus the user 11 can also be determined, for example, by a satellite-based GPS navigation system transceiver built into the upper 12 or sole structure 14. In addition to tracking the implementing user dynamics, a background mediation server, such as the cloud computing system 36 acting as a middleware node, tracks the position and movement of the vehicle 32 in real time, e.g., via an in-vehicle transmission device or via an app on the driver's personal computing device.

[0065] Another technique for determining a user's location and associated dynamics is to employ a detection tag 78 that is carried by the user 11 and communicates with transmitter-detector modules 70, 72 mounted on nearby structures or nearby moving objects. According to Figure 1 and Figure 3 In the representative application shown, the detection tag 78 is implemented as a passive or active radio frequency (RF) transponder mounted on the outer surface of the sole structure 14. Figure 1 The RF transponder 78 includes an omnidirectional (type I) RF antenna coil 80 made of conductive material and shaped to receive and transmit signals in the form of electromagnetic radiation waves. An RF frequency filter 82, which can be of the nature of a lumped Butterworth filter, is electrically connected to the RF antenna 80 and is designed for band-pass operability to allow only those RF powers or signals within a calibrated (first) frequency range to pass. As an alternative, the frequency filter 82 can provide a band-stop function that attenuates and rejects the passage of all signals having RF power with an undesired frequency or within any one or more undesired frequency bands (i.e., outside the calibrated (first) frequency range). An optional dielectric cover 84 is placed over the RF antenna 80, filter 82, and accompanying detection tag electronics to protect the components and improve the performance as an RF transponder. Signal exchange can be routed through a system packet interface (SPI) and general-purpose input / output (GPIO). Frequency and phase-adjustable signal outputs can be provided by a phase-locked loop (PLL) or direct digital synthesis (DDS) synthesizer, harmonic mixer, and a local oscillator based on a PLL or DDS synthesizer.

[0066] When the user 11 approaches Figure 3 the road intersection 13, the detection tag 78 ( Figure 1 ) receives a swept-frequency interrogation signal S P or "ping" transmitted at regular intervals by the moving transmitter-detector module 70 (which can be encapsulated near the front end of the vehicle 32) or the fixed transmitter-detector module 72 (which can be suspended from a crosswalk signal post 74, building wall, or similar suitable fixed structure). P For applications in which the detection tag 78 consists of a passive RF transponder, the transmitter-detector modules 70, 72 can broadcast the interrogation signal S P in a repetitive or substantially continuous manner. Conversely, for an active RF transponder implementation, an incoming interrogation signal S P can be transmitted in response to a callback signal broadcast by the detection tag 78 in a repetitive or substantially continuous manner. PAn embedded data set containing encoded unique information (e.g., transmitter ID, interrogation code, timestamp, etc.). The data can be superimposed on a swept carrier in a narrowband system to help reduce the bandwidth overhead that may be generated in some embodiments. It should be noted that the reverse is also possible, where the detection tag 78 broadcasts and the module 70 receives and re-transmits the prompt signal S P .

[0067] Upon receiving the prompt signal S P , the detection tag 78 processes the signal S in response P and re-transmits the signal S P as an output response signal S R back to the transmitter-detector modules 70, 72. The response signal S R is an electromagnetic field wave that has a distinguishable (second) RF power with a complementary (second) uplink frequency different from the first frequency. The detection tag 78 can be equipped with an RF frequency converter to modulate the incoming prompt signal S P (e.g., by doubling the frequency of the incoming signal), and based on the incoming prompt signal S P , before transmitting the signal S R to the transmitter-detector modules 70, 72, an RF signal amplifier to enhance the response signal S R . To help ensure that the transmitter-detector modules 70, 72 recognize the detection tag 78, the response signal S R returns at least a portion of the embedded data of the prompt signal S P to the transmitter-detector modules 70, 72 in a mechanically mimicking manner. To minimize on-vehicle power usage, the detection tag 78 can operate in two modes: idle mode and active mode. When idle, the detection tag 78 is typically in a sleep state and thus does not draw power from the on-board power source 52 or an off-vehicle power source. In contrast, when the detection tag 78 is active, it temporarily draws power from the on-board power source 52 or is powered by the incoming prompt signal S P . Thus, the detection tag 78 does not transmit a transparent output signal unless and until it receives an incoming signal with RF power at a predetermined frequency.

[0068] As part of performing a pedestrian collision threat assessment, Figures 1 - 3 the intelligent electronic shoe 10 can employ alternative means to exchange data with the IES system 30 and the motor vehicle 32. Instead of using an RF transponder, the detection tag 78 can be fabricated with one or more electroactive polymer (EAP) sensors, each having discrete dielectric EAP elements mounted on the sole structure 14 or the upper 12. According to this example, the incoming prompt signal S Pis an electric field that generates a current with sufficient voltage to cause a change in the physical state (e.g., arcing or swelling) of the implanted dielectric EAP element. Through the normal use of the IES10, the user 11 will unknowingly reverse the physical state change of the EAP sensor, for example, by flattening or compressing the dielectric EAP element with the foot. By doing so, the EAP sensor will generate a current that causes the IES10 to output a response signal S R . It is also envisioned that the IES10 can communicate directly with the vehicle 32, for example, through a device-to-device wireless ad-hoc network (WANET), rather than redirecting all data through the IES system 30 or other pre-existing wireless access points.

[0069] Referring again to Figure 5 , the method 100 proceeds to processing block 107 via processor-executable instructions for sending or receiving a preliminary pedestrian collision warning signal in response to the response signal S indicating that the user is approaching and may enter the road in a manner that could cause a motor vehicle accident R generated upon the sending of. For basic applications, whenever the user 11 approaches an intersection 13 simultaneously with a motor vehicle 32, the pedestrian collision warning signal can be automatically broadcast by the IES system 30 regardless of the auxiliary variables. As shown, for example, in Figure 4 , the wireless transmitter node 86 of the IES system 30 can broadcast a preliminary pedestrian collision warning signal to a first user 11A wearing the IES10 who is approaching a road intersection 13A and is predicted to cross the road intersection 13A simultaneously with a moving vehicle 32A that is about to cross the intersection 13A. Even if the buildings visually obstruct each other, a second user 11B wearing the IES10 and approaching the intersection 13A may receive the preliminary warning signal to notify the user 11B to exercise extra caution regarding the approaching vehicle 32A. A pair of IES10s can be registered for a user 11C who is visually, physically, or mentally impaired; since the likelihood of this individual unknowingly wandering into the intersection 13A when the vehicle 32A passes is increased, the preliminary pedestrian collision warning signal can also be sent to the third user 11C. The warning signal can be sent to multiple users 11A, 11B, 11C and any potential threatening vehicle 32A so that each party can take remedial measures to prevent an accidental collision between a pedestrian and a vehicle.

[0070] For more complex multi-modal applications, the IES system 30 receives data from a variety of sensing devices that use technologies such as optical detection, radar, lidar, ultrasonic, optical, infrared, damped mass, smart materials, or other technologies suitable for object detection and tracking. According to the illustrated example, the IES system 30 may be equipped with or may receive signals from the following: one or more digital cameras, one or more range sensors, one or more speed sensors, one or more dynamic sensors, and any necessary hardware and software for processing raw sensor data filtering, classification, fusion, and analysis. Each sensor generates an electrical signal indicative of the characteristics or conditions of the target object, typically as an estimate with a corresponding standard deviation. While the operating characteristics of these sensors are generally complementary, some sensors are more reliable than others in estimating certain parameters. Most sensors have different operating ranges and coverage areas, and some are capable of detecting different parameters within their operating ranges. Additionally, the performance of many sensor technologies may be affected by different environmental conditions. Thus, sensors typically exhibit disparities, and their operational overlaps provide opportunities for sensing fusion.

[0071] A dedicated control module or a properly programmed processor will converge and preprocess the sensor-based data set, fuse the converged data, combine relevant crowd-sourced data and behavioral data of each target object being evaluated with the fused data, and estimate whether the target object is statistically likely to enter the predicted path of the motor vehicle. For example, at the input / output block 109, the resident footwear controller 44 collects the following data and sends it to the IES system 30: (1) location data having one or more parameters that indicate the real-time location of the IES 10 and thus the user 11 (e.g., latitude, longitude, altitude, geospatial data, etc.), (2) dynamic data having one or more parameters that indicate the real-time movement of the IES 10 and thus the user 11 (e.g., relative or absolute speed, acceleration / deceleration, trajectory, etc.), and (3) behavioral data indicative of the historical behavior of the user 11 when wearing the IES 10. Such historical data may include past trends of a given user when at a particular intersection or a particular geographical location, past trends of a given user overall in an urban or rural environment, past trends of a given user under various weather conditions, past trends of a given user in a particular dynamic scenario, etc. It is contemplated that the IES controller 44 may collect and send other types of data, including predicted path data indicative of the estimated path of the user 11 based on available current and historical information. Any such data may be locally collected and stored on the IES 10 via the IES system 30, via the vehicle 32, via neighboring devices and systems, or any combination thereof.

[0072] At the predefined process block 111, Figure 5Method 100 proceeds via processor-executable instructions for a resident or remote controller to apply a sensor fusion module to the converged raw sensor data to determine the motion of a target object in a monitored environment, such as the likelihood of intrusion of a pedestrian relative to a predicted route and position of a vehicle. The IES system 30, for example, conditions the data received from the resident footwear controller 44 to correlate the received sensor data to ensure overlap with a single, common "reference" time frame, coordinate system, set of standard measurements, etc. Once the received sensor data is adequately conditioned to ensure alignment across relevant metrics, the IES system can execute a data association protocol that classifies each corresponding portion of the sensor data and then correlates the relevant portions of the sensor data based on any complementary classifications. The IES system 30 can then perform a sensor fusion process on the conditioned and classified data as well as the path plan data of the target object and the object vehicle. Sensor fusion can typically be represented as a computational framework for the aggregation, analysis, and combination of data from heterogeneous or homogeneous sources (e.g., the various different sensor types discussed above). For the application shown, sensor fusion can be embodied as a dedicated software device that intelligently combines data from multiple sensors and corrects for the deficiencies of the individual sensors to compute complete, accurate, and understandable information.

[0073] After completing sensor fusion, the IES system 30 calculates a pedestrian collision threat value. This collision threat value can predict the manner in which a monitored target object behaves in a way that is likely to cause a harmful event. According to the example shown, the pedestrian collision threat value can predict the manner of intrusion of user 11, i.e., the manner that at least partially obstructs the predicted route of the target vehicle 32, where the predicted route is related to the current (real-time) position of the target vehicle. This pedestrian collision threat value can be based on the fusion of user location data, user kinematic data, and user behavior data. Optionally, the pedestrian collision threat value can also fuse behavior, user location, and user kinematic data with crowd-sourced data and environmental data. Environmental data can consist of information indicating the user's surrounding environment, such as the current weather conditions, the current vehicle traffic conditions, the current pedestrian traffic conditions, etc. By comparison, crowd-sourced data can consist of information indicating the positions, motions, and / or behaviors of multiple individuals in the vicinity of the user. The remote computing nodes that receive the aforementioned data can include a remote host system 34, a cloud computing system 36, a resident footwear controller of a motor vehicle 32, a resident vehicle controller 76 of a motor vehicle, or a distributed computing combination thereof. Alternatively, the footwear controller 44 can send any or all of the aforementioned data to a central control unit of an intelligent transportation management system via wireless communication devices 48, 50.

[0074] Figure 5Method 100 proceeds to decision block 113 to determine: (1) whether the pedestrian collision threat value PCT1 generated at processing block 111 is greater than a calibrated threshold CV T ; and (2) whether the current (first) operating state OS1 of a nearby traffic control signal is equal to any one of one or more conflicting signal phases SP C For the first query, the calibrated threshold CV can be determined by an empirical test that provides sufficient quantitative data to establish a statistically significant minimum confidence percentage (e.g., 80%). A collision threat value calculated below this minimum confidence percentage is non - decisive or probabilistically infers that a collision event will not occur. Available techniques for identifying the calibrated threshold CV T can include random Gaussian processes, finite mixture model (FMM) estimation protocols, or other normal or continuous probability distribution techniques. T For the latter of the two queries made at decision block 113, the conflicting signal phase SP

[0075] includes any such signal phase in which right - of - way is given to traffic in a manner that does not allow for a safe crossing at a given road segment. Traffic signal phasing can be implemented in a traffic system controller using signal indications, signal heads, and accompanying control logic that controls and coordinates timing, sequence, and duration. The signal phasing settings can be changed as needed, e.g., to accommodate changes in traffic demand, patterns, etc., and in a manner that results in a safe and efficient operation for the prevailing conditions. C

[0076] Figure 3 Referring again to Figure 4 , for example, shows user 11 traveling at a speed and trajectory estimated to place them within the road of intersection 13 approximately simultaneously with vehicle 32 expected to pass through the same intersection 13. When user 11 is detected by the IES system 30 using emitter - detector modules 70, 72, the back - end server computer of the remote host system 34 will identify the traffic signal or group of traffic signals (e.g., Figure 4The three-color traffic control light 88 and the crosswalk signal light 90). Once identified, the remote host system 34 determines the real-time operating state of the traffic signal light, which may include a go state (continuous green light or WALK signal), a warning / yield state (continuous yellow light or flashing WALK signal), a cannot proceed or stop state (continuous red light or DON'T WALK signal), or a transition state between any of the above states (green to yellow, yellow to red, etc.). One or more of these operating states may be characterized as a conflicting signal phase SPC. By way of non-limiting example, the go state, the warning / yield state, and the warning transition state can all be designated as conflicting signal phases SP C .

[0077] If any of the evaluations performed in decision block 113 returns false (block 113 = no), then method 100 may loop back to end block 101 and run in a continuous loop; alternatively, method 100 may proceed to end block 117 and temporarily terminate. Conversely, upon determining that the pedestrian collision threat value PCT1 is actually greater than the calibrated threshold CV T and the current operating state OS1 of the traffic control signal light corresponds to any conflicting signal phase SP C at that time (block 113 = yes), method 100 proceeds to processing block 115, where one or more remedial measures are taken to avoid a collision between the user and the vehicle. By way of example and not limitation, the wireless transmitter node 86 may send a notification of an impending pedestrian collision to the vehicle controller 76; the vehicle controller 76 may immediately respond by sending one or more braking command signals to the vehicle braking system to perform a braking maneuver, e.g., bringing it to a complete stop or reducing the speed to a calculated value that easily allows for an evasive maneuver. Additionally or alternatively, vehicle 32 may perform other autonomous vehicle functions, such as controlling vehicle steering, controlling the operation of the vehicle transmission, controlling the engine throttle, and other autonomous driving functions. Visual and / or audible warnings may be sent to the driver using the vehicle's central console infotainment system, digital dashboard display, or personal portable electronic device.

[0078] Processing block 115 may also include processor-executable instructions for automating the variation of pedestrian and vehicle traffic flow through traffic signal phase modulation. For example, a traffic system controller (in Figure 4The command signal is transmitted to the vehicle traffic control light 88 (represented by the traffic signal control cabinet 92 in the figure) to switch from the first operating state (e.g., green light) to the second operating state (e.g., yellow or red light), in an attempt to stop the motor vehicle 32 before it enters the intersection 13, thereby preventing a collision with the user 11. As described above, the traffic signal phase modification can be based on the user dynamic data (e.g., speed and direction of travel) suggesting that the user 11 will enter the monitored road segment 13 and the vehicle dynamic data (e.g., speed and predicted path) suggesting that the vehicle 32 will enter the same monitored road segment 13. In this regard, the IES system 30 can receive and analyze the IES dynamic sensor data to identify the IES 10 and thus the expected intrusion time when the user 11 is estimated to violate the traffic lane specified by the vehicle traffic control light 88.

[0079] The IES system 30 can also determine the estimated phase change time, which is calculated as the difference between the current (real-time) time and the pre-programmed phase change time when the traffic signal is scheduled to switch from the first current operating state to the alternate operating state. In response to determining that the expected intrusion time is less than the estimated phase change time - before the vehicle traffic control light 88 is pre-programmed to change from green to red, the expected user 11 enters the intersection 13 - the traffic signal control cabinet 92 automatically transmits the phase change command signal to the traffic control light 88. Alternatively, if the expected intrusion time does not place the user 11 within the intersection 13 before the signal phase change, there is no need for the traffic signal control cabinet 92 to intervene and preemptively issue the phase change command signal. This is also the case for situations where the user dynamic data indicates that the user 11 has stopped or will stop before entering the intersection 13, or indicates that the user 11 is in a supplementary or alternative direction of travel that will not place it within the intersection 13. Again, the traffic signal control cabinet 92 does not need to intervene and preemptively issue the phase change command signal. After completing the remedial measures performed at the processing block 115, the method 100 proceeds to the end block 117 and temporarily terminates.

[0080] In addition to facilitating the automation of one or more vehicle operations designed to mitigate or prevent vehicle-pedestrian collisions, the method 100 can also facilitate the automation of one or more IES features designed to mitigate or prevent vehicle-pedestrian collisions at the process block 115. For example, the first command signal can be sent to the first IES subsystem to perform the first automated feature AF1 of the smart electronic shoe. According to Figure 3In the illustrated example, the resident footwear controller 44 receives the pedestrian collision threat value output at block 111, determines at block 113 that the threat value is greater than a threshold, and responsively takes preventative action at block 115. The resident footwear controller 44 responds to this determination automatically (i.e., without any user input or external system prompting) by sending a command signal to the resident lighting system 56 to activate the lighting device 58 to produce a predetermined light output. The selected color and / or pattern is detectable by the user 11 and, optionally, the driver of the vehicle 32, and is sufficiently conspicuous to warn of an impending collision. As a non-limiting example, the resident lighting system 56 may output a flashing bright red light pattern; the use of this particular color and pattern may be limited to warning the user of a potential hazard. The light output of the IES 10 may be coordinated with the light output of the headlights of the motor vehicle 32 to further assist in notifying the user 11 of a predicted vehicle collision.

[0081] It is foreseeable that as Figure 5 As part of the illustrated method 100, any disclosed connected wearable electronic device may automate additional or alternative features. In response to a positive determination at decision block 113, the footwear controller 44 may automatically send a second command signal to the second subsystem to execute a second automated feature AF2 of the wearable electronic device. As a non-limiting example, the illustrated Figure 2 The IES 10 is equipped with a tactile transducer 66 housed within the sole structure 14 in operable communication with the insole 22. To alert the IES 10 of the pedestrian collision threat estimate, the resident footwear controller 44 issues a command signal to the tactile transducer 66 to generate a tactile cue (e.g., a perceptible vibration force or a series of vibration pulses) that is transmitted from the midsole 24, through the insole 22, to the user's foot. As part of the method 100, the intensity and / or pulse pattern output by the tactile transducer 66 can be limited to alert the user to a possible dangerous situation.

[0082] An optional third automation feature AF3 can include operating the shoelace motor 64 as a haptic force feedback device that is selectively activated by the footwear controller 44 to quickly tension and release the shoelaces 20. Similarly, the IES 10 can operate in conjunction with: a smartphone 40 (e.g., coordinated flashing of an LED camera light or an eccentric rotating mass (ERM) actuator), or an active apparel element 11 (e.g., coordinated activation of built-in thermal or haptic devices in the user's shirt or shorts). As another alternative, haptic feedback can be utilized to provide turn-by-turn directions to the user (e.g., vibrating the left or right foot with increased intensity and / or in a specified pulse pattern to indicate a left or right turn). Similarly, haptic feedback can be used in a similar manner to guide the user along a predefined route or to warn the user against taking a particular route (e.g., deemed unsafe). Additional information regarding footwear and apparel with haptic feedback can be found, for example, in U.S. Patent Application Publication No. US2017 / 0154505A1 to Ernest Kim, the entire content of which is incorporated herein by reference.

[0083] Optionally, the IES 10 can be provided with an audio system, represented in Figure 1 by a micro audio speaker 68 attached to the heel counter 12C of the shoe upper 12. The resident footwear controller 44 automatically sends a command signal to the audio system speaker 68 to generate a predefined sound output upon confirming that a pedestrian collision threat value is greater than a calibrated threshold. For example, the audio system speaker 68 might shout "Warning!" or "Stop!" at an increased sound level. As another alternative, the footwear controller 44 can command the shoelace motor 64 to repeatedly tighten / loosen the shoelaces 20 as a signal / cue for, e.g., an oncoming vehicle. Footwear-to-infrastructure communication can be enabled (and coordinated) to allow the IES 10 to communicate with a networked "smart city" controller, which in turn can modulate changes to street lighting or traffic signals to enhance the safety of pedestrians or runners. Conversely, the "smart city" controller can communicate with the IES 10 to warn the user that they are approaching a crosswalk with a "Do Not Walk" sign, signaling that the pedestrian must yield the right-of-way to oncoming vehicles.

[0084] The light feature built into the shoe can also be used during sporting events (e.g., matching the colors of the user's favorite sports team) or during exercise (e.g., illuminating the path during a night run). Security features can also be installed to make the IES unavailable to unauthorized parties. For example, once it is determined that the person wearing the IES 10 is an unauthorized user, the footwear controller 44 can render the shoelace motor 64 inoperable. Collaboratively, the controller 44 can send an electronic alert to the user's smartphone 40 or smartwatch 42 notifying them of the potential theft or misuse of the IES 10.

[0085] Optional configurations can provide intelligent electronic shoes or clothing suitable for teaching purposes. For example, when helping to teach someone how to drive a car, the user or instructor can wear the IES10. For example, the IES10 can be configured so that the instructor can press their foot against the passenger compartment floor through the shoe to simulate pressing the brake pedal. The built-in pressure sensor 62 detects the instructor's foot posture, outputs a corresponding signal to the shoe controller 44, and the IES10 communicates with the vehicle 32 brake control module (BCM) to activate the vehicle brakes. Additionally, or alternatively, the IES10 can communicate with a pair of intelligent electronic shoes worn by the student, sending instructions to provide the student with a sensory feedback that they should physically press down on the brake pedal with their foot, thereby applying the vehicle's braking system. In addition to teaching students how to drive, the tactile, auditory, and / or visual feedback from the IES10 can be used to teach a wearer of the footwear a series of steps in a dance routine, the correct transfer of body weight when swinging a golf club or baseball bat, the correct timing of hurdling, gait, and number of steps, etc.

[0086] The remote computing node can take an alternative form of the above-described form, such as a central server computer or a parallel HMI of a residential or commercial security system. When the user 11 of the IES10 enters a predetermined location (such as an entrance, corridor, room, etc.) or within a preselected proximity range of a monitored facility (such as defined by an active geofence), ​ the resident shoe controller 44 of can send a deactivation command signal to the security system server computer or HMI, enabling the user 11 to enter the facility without having to manually deactivate the security system. For example, in ​ , the representative user 213 is shown approaching the front entrance of a building 232 protected by a commercial security system (represented by a contactless video surveillance entrance panel 234). One or two IES10s worn by the user 213 emit an invisible geofence 215 surrounding the user 213. Once the user 213 is close enough to the building 232 such that the video surveillance entrance panel 234 breaches or otherwise penetrates the geofence 215 generated by the IES, the IES10 automatically sends a security authentication signal to the security system entrance panel 234. In this way, the user 213 is authorized to enter the building 232, for example, as ​ shown, by automatically opening the security door at the entrance of the building 232. Alternative system configurations can use other communication means, including any of the communication means described above and below, to facilitate the interaction between the IES10 and the security system 234.

[0087] As another example, the remote computing node can be of the nature of a home automation system (or "smart home") that controls the climate, lighting, blinds, appliances, etc. in a user's home. When a user of the IES 10 enters or leaves a predefined location (such as the front door, garage, hallway, room, etc.), or enters or leaves a preselected proximity area of the residence controlled by the home automation system, the resident footwear controller 44 can send one or more command signals to the home automation system to lock or unlock doors, activate or deactivate interior lights, increase or decrease the temperature of the thermostat, or a combination of the foregoing features. For example, in ​ a representative user 313 is shown walking around a home 332 with various appliances, devices, and subsystems, all or some of which are controlled by a residential home automation system (represented by a WiFi-enabled touchscreen gateway panel 334). In response to the user 313 moving from a first room to a second room (such as from the living room to the bedroom), the IES 10 can automatically send a series of command signals to: (1) turn on the lights in the second room; (2) dim the lights in the first room; (3) turn off one or more devices (such as the TV) in the first room; and (4) adjust the temperature in the second room.

[0088] ​ The IES 10 of ​ can be considered particularly useful for interacting with fully assisted or fully autonomous motor vehicles, such as those classified as Society of Automotive Engineers (SAE) level 3, 4, or 5. In addition to implementing vehicle controller authentication and automatic locking, unlocking, and motor starting, the IES 10 can communicate with a route planning module (RPM) and, in turn, with a powertrain control module (PCM), a brake system control module (BCM), etc. to automatically coordinate transporting the user 11 of the IES 10 to a predefined location. In a specific example,

[0089] Once user 11 locates motor vehicle 32, a two-way authentication process will occur between the resident footwear controller 44 of IES 10 and the central electronic control unit (ECU) of motor vehicle 32 or a server computer at the backend of a middleware node facilitating F2V operations. Once verified, motor vehicle 32 will signal to user 11 that they can choose to enter the passenger compartment of the vehicle. The verification key can be issued to user 11 along with the IoAAF system; user 11 can retrieve the key through the aforementioned smartphone app. If user 11 chooses to enter motor vehicle 32, user 11 may be taken to a designated or undesignated location (“unlock location”), where the reserved product is waiting for user 11. Once user 11 reaches the unlock location, user 11 may need to enter the verification key to access the reserved product.

[0090] ​ A representative electronic navigation assistance system 400 with intelligent electronic shoes (or “footwear”) 410 is shown, where the intelligent electronic shoes 410 communicate with a wireless-enabled handheld computing device (or “smartphone”) 440 to provide navigation assistance to a user of IES 410. Although different in appearance, it is foreseeable that the features and options disclosed above with reference to ​ and ​ of IES 10 can be incorporated into ​ example IES 410 individually or in any combination, and vice versa. As a point of similarity, IES 410 is depicted as a sports shoe composed of a foot-receiving upper 412 mounted on top of a lower sole structure 414, where each can adopt any of the choices and alternatives described above for the corresponding parts of their respective uppers 12 and sole structures 14. Similar to ​ and 2 footwear 10, ​ IES 410 can be divided into multiple adjacent anatomical regions (such as forefoot, midfoot, and hindfoot regions) and vertically bifurcated into medial and lateral portions (such as outer and inner segments). Another point of similarity can be drawn from the closed toe and heel construction of footwear 410, as well as the shoelaces 420 for firmly holding the foot within the upper 412, and the tongue 418 extending between the shoelaces 420 and the interior space of the upper 412.

[0091] As another overlapping point of similarity, ​The IES410 is shown equipped with a controller automated tensioning system 460 for selectively adjusting the size of an ankle opening (or “throat”) 415 in the rear quarter portion of the shoe upper 412, thereby tightening and relaxing the shoe upper 412 about the user's foot. According to the illustrated example, the diameter of the opening 415 is decreased and increased by the lacing motor 462 applying tension to and releasing tension from the laces 420, respectively. The lacing motor 462 is housed within a protective outer motor housing 464 that is securely mounted to the outer surface of the rear quarter portion of the shoe upper 412. The laces 420 are shown passing through a longitudinally elongated lace guide 416, then through an internal passage in the shoe upper 412, and extending into the motor housing 464 of the lacing motor 462. As noted above, the laces 420 may be replaced with straps, cables, pins, pneumatic or hydraulic bladders, or any other mechanism suitable for adjusting the size of the opening 415 and the circumference of the shoe upper 412.

[0092] The automated tensioning system 460 applies tension to the laces 420, for example in response to various user inputs and / or system control commands, so as to tighten and relax the shoe upper 412. As a non-limiting example, ​ the lacing motor 462 of the laces 420 winds the laces 420 around a lace spool 466 inside the motor housing 464 and, conversely, unwinds the laces 420 from the lace spool 466. The lacing motor 462 may be embodied as a bi-directional direct current (DC) electric stepper motor that is powered by a rechargeable energy storage system (RESS) 470, such as a lithium-ion battery module encapsulated within the IES sole structure 414. Activation of the lacing motor 462 applies torque to the lace spool 466 by rotation of an interconnected motor shaft 468. Rotation of the spool 466 in a first direction (e.g., clockwise) serves to wind the laces 420, thereby applying tension thereto, while rotation of the spool 466 in a second direction (e.g., counterclockwise) serves to unwind the laces 420, thereby releasing tension therefrom. Alternative architectures may use different motors, gearing, and / or lace winding devices.

[0093] Although it is envisioned that the IES410 can be manufactured with a resident HMI, such as a control button group or a touchscreen interface, for managing the operation of the automatic tensioning system 460, the IES410 can communicate wirelessly with a handheld computing device 440 for selective operation of the shoelace motor 462. For example, a smartphone 440 can download and run a dedicated "shoelace control" software application (app) 472. The high-definition OLED touchscreen display device 474 of the smartphone 440 can be used to display information to the user and receive control inputs from the user. The dedicated mobile app 472 provides a graphical user interface for presenting soft control buttons, radio buttons, menus, trackpads, etc. Control commands are initiated in response to control inputs made by the user. Example control commands can include, but are not limited to: left shoe selection, right shoe selection, increase tension on the selected shoe or both shoes, increase looseness on the selected shoe or both shoes, fully open / loosen both shoes, store current tension, recall stored tension, etc.

[0094] ​ It is shown that the smartphone 440 communicates with the IES410 to execute a user navigation assistance protocol to help the user locate a target object and / or a target location. For example, in ​ a search session is initiated to locate a target virtual object, such as an encrypted digital asset 480 associated with a purchased pair of sports shoes, which is "hidden" at a virtual location within a specified geographical area, such as a metropolis (e.g., New York Manhattan). The touchscreen display device 474 presents an introduction screen and options for participating in the search to the user. Alternatively, the user can be prompted to "hunt" for the target virtual object in a physical store by using the photography "snap" or augmented reality feature on their handheld personal computing device. In this case, the KickID associated with the purchased pair of shoes can be provided to the user as part of a retail transaction. However, before the digital asset can be transferred to their personal locker, the user may be required to separately find the relevant CryptoKick hidden within the store or the specified area TM (i.e., the key and the virtual object must be obtained separately before the transfer occurs). Obtaining the cryptographic key can enable the AR engine associated with the user's device to initiate a game in which the CryptoKick associated with the key TM is locally hidden and available for the user to find. The start of the search can be communicated to the user via a first haptic cue, such as an extended activation of the shoelace motor 462 in one of the user's two shoes, which is output by a resident navigation alert system, such as by the selective use of the automatic tensioning system 460. The advantage of using the automatic tensioning system 460 over traditional haptic transducers is the multi-modal application of haptics that can be perceived by the user: the vibration of the shoelace motor 462 and the tensioning / loosening of the shoelace 420.

[0095] When initiating a search for a target virtual object / location, the display device 474 of the smart phone 440 can display the IES 410 and thus the user's real-time GPS location. For example, ​ depicts the smart phone 440 running a dedicated "shoe search" mobile app 473 with a graphical depiction of a user avatar 481. The display device 474 can depict the movement of the IES 410 and the user by the simultaneous movement of the user avatar on a street-level map 482 of the city and the locations of other users, landmarks, and natural makers near the IES 410. To assist the user in locating the hidden target object, the resident navigation alert system automatically operates the audio system, lighting system, and / or haptic transducer system of the IES 410 to generate user-perceivable haptic, audio, and / or visual cues. Continuing with the above example, the mobile app 473 can track the user's real-time movement along a specified route to the target object / location. When traversing the route, turn-by-turn navigation instructions can be provided to the user to help them find their target. For example, in ​ via the operation of the automatic tensioning system 460, a second haptic cue is output by the resident navigation alert system of the IES 410, such as a slow pulse, low-tension activation of the shoelace motor 462 only in the user's right shoe, to notify the user to turn right at their current location. Similarly, the user can be notified in real time to turn left at a given location by selectively activating the shoelace motor 462 in the user's left shoe without simultaneously activating the shoelace motor 462 in the user's right shoe.

[0096] After the search is initiated, one or more secondary users can assist the primary user in searching for the virtual target, providing various types of help. As the user's location gets closer to the target object / location, a third haptic cue output by the navigation alert system via the coordinated operation of the automatic tensioning system 460 (e.g., ​ the ramp pulse activation of the shoelace motor 462 as shown in ​ notifies the user to go forward / ahead from their current location. Once the primary user reaches the location of the virtual object, as shown in

[0097] the virtual target object can be accessed. Access to the virtual object can be automatic or may require additional action on the part of the user. The completion of the search can be conveyed to the user via a fourth haptic cue, such as the rapid, high-voltage pulse activation of the shoelace motors 462 in both of the user's shoes, which is output by the resident navigation alert system.

[0097] In some cases, CryptoKick TM may not initially be associated with a physical product but is given to users as part of a brand promotion campaign, event, moment, or experience. For example, users at a sports event may be required to search for CryptoKick within the confines of the event stadium TM, for example, using a mobile app and the digital camera on a smartphone device. In this example, the GPS associated with the smartphone device can further limit the optical recognition ability to a specific geofenced area. The target object can be virtually camouflaged in a billboard advertisement, located in a specific seat, hidden in a designated area, etc. Once CryptoKick is found TM , the user may be prompted to scan a unique code, such as the barcode on their event ticket. This two-part action can then transfer the token uniquely provided for that ticket to the user's locker. After the event, the promotion organizer can retrieve any unclaimed KickID for use in other promotions.

[0098] Now refer to ​ 's flowchart. According to aspects of the present disclosure, at 500, an improved method or control strategy for automating navigation assistance for a user (such as ​ 's IES10 or ​ 's IES410) is generally described by the operation of a smart electronic shoe or clothing (such as ​ 's user 11). ​ Some or all of the operations shown and further described below may represent algorithms corresponding to processor-executable instructions that can be stored in, for example, primary or secondary or remote memory and executed by, for example, a resident or remote controller, a central processing unit (CPU), control logic circuitry, or other module or device to perform any or all of the functions described above or below related to the disclosed concepts. It should be recognized that the execution order of the shown operation blocks can be changed, additional blocks can be added, and some of the described blocks can be modified, combined, or deleted. For example, it can be foreseen that the features and options disclosed with respect to ​ 's method 100 can be incorporated into ​ 's method 500 individually or in any combination, and vice versa.

[0099] Method 500 begins at terminal block 501 with processor-executable instructions for a programmable controller or control module or similar suitable processor, such as ​ 's resident footwear controller 44, to invoke an initialization process of a protocol to use a smart electronic shoe or clothing, such as ​ 's IES10 or ​The IES410 is automatically navigated to assist the user. The initialization process at block 501 can be initiated via a manually entered prompt, such as by the user opening the corresponding mobile app running on the user's handheld computing device, or by a central system operator starting the "treasure hunt" feature for a group of users. Alternatively, the initialization process can be automatically started by a resident controller or a remote computing node, such as a server-level computer responsible for performing the target object / position search. Terminal block 501 can optionally incorporate any of the initialization and authentication features described above with respect to ​ Operations 101 and 103.

[0100] Method 500 proceeds from terminal block 501 to input / output blocks 503 and 505 to determine the user's desired or current location and the predetermined or estimated location of the target object / location. The desired user location can be preset to a designated starting location, such as a starting line, a common gathering place, a kiosk or terminal for completing the purchase of a pair of shoes, etc. Alternatively, as described above, the user's current real-time location can be determined and set as the starting location for the purpose of navigation assistance at block 503. Similarly, at block 505, the location of the target object / location can be predetermined and retrieved from, for example, a remote computing node, a third-party handheld computing device, a resident cache, or a main memory. On the other hand, the target location can be dynamic or random, or can be manually selected via a suitable HMI.

[0101] At subroutine block 507, the in-shoe footwear controller or the smartphone processing unit or both receive, estimate, identify, and / or retrieve (collectively referred to as "determine") the path planning data for the user's current journey. The path planning data can include any real-time, crowdsourced, map, and / or historical data suitable for completing the desired journey. At a minimum, the path planning data can include a preset starting point or real-time starting location, a desired, dynamic, or randomly determined final destination, one or more intermediate stops, and a predicted route from the user's starting point to the user's destination. For a stand-alone architecture, the IES can be equipped with an on-board navigation system that utilizes a GPS transceiver in cooperation with navigation software and geolocation mapping services to obtain the geographical terrain, geodetic data, and traffic information relevant to the user's current location.

[0102] Building a predicted path for the current itinerary may require predicting one or more upcoming maneuvers needed to complete the itinerary. This may include marking any potential obstacles or hazards, as well as determining one or more alternative routes. For example, block 507 may predict the primary (first) route for completing the upcoming maneuver, and using a similar process, predict one or more (first, second, third...) alternative routes for reaching the user's destination. Once the path plan is created, a corresponding sequence of navigation instructions for gait motion (walking, running, etc.) from the user's location to the target location can be determined for each route, as shown in subroutine block 509. These navigation instructions may include, individually or in any combination: go forward, go backward, turn left, turn right, accelerate, decelerate, start, stop, turn around, etc. Each navigation instruction may be associated with a corresponding position along the derived route; a list of navigation instructions and their associated positions may be saved in local cache for easy retrieval.

[0103] Method 500 continues from subroutine block 509 to database block 511 and converts each navigation instruction into a corresponding command signal generated by the controller. The command signal associates a calibrated navigation alert system prompt with the given navigation instruction. For example, a list of available navigation instructions and their corresponding alert system outputs and associated command signals may be stored in a server farm and retrieved simultaneously from the server farm via a suitable database management system (DBMS). As described above, the start search may correspond to a first tactile prompt, which may correspond to an extended activation of the shoelace motor in the user's shoe. Conversely, turning right may correspond to a second tactile prompt, which may correspond to a slow pulse, low-tension activation of the shoelace motor in the user's right shoe, while there is no corresponding tactile output in the user's left shoe. These prompts may be supplemented with complementary visual and auditory outputs, such as via ​ and 2 the resident lighting system 56 and the resident speaker system 68.

[0104] Continuing to refer to ​ , at input / output block 513, processor-executable instructions are provided to the footwear controller to send the command signal to the resident navigation alert system of the footwear, thereby outputting visual, auditory, and / or tactile prompts that are designed to guide the user along the derived route. To ensure that segment-by-segment instructions are provided at the appropriate times along a given route, the controller may systematically track the user's real-time or near-real-time movement as the user moves along the derived route. During user tracking, the controller may continuously evaluate whether each new user position in a succession of new user positions along the derived route corresponds to one of the navigation instructions provided in subroutine block 509. In such a case, a command signal may be output via the controller as a direct response to determining that the user's "new" position corresponds to the corresponding navigation instruction associated with that command signal. Once the foregoing features are completed, ​The method 500 can proceed to the terminal block 515 and terminate, or can loop back to the terminal block 501 and operate in a continuous loop.

[0105] The disclosed adaptive clothing and footwear include ​ the IES10 and ​ the IES410, which can be used to assist a user in navigating to the physical locations of stationary and dynamic objects. For example, ​ the resident footwear controller 44 or ​ the handheld computing device 440 can communicate with the position tracking device of a logistics class (delivery) unmanned aerial vehicle (UAV) to track the real-time movement of the UAV and / or determine the delivery location of a package being air-transported by the UAV. As described above, this information can be aggregated and processed to provide turn-by-turn instructions to the user to locate the UAV. The IES10, 410 can also be used to identify the user's position relative to the UAV and / or automatically authenticate the user to the UAV before a package will be released. Similar methods can be employed to guide a user to meet an unmanned airliner (“flying taxi”) or a commercial-grade air taxi or an air transportation solicitation center.

[0106] Similar to assisting package delivery via UAV, the disclosed adaptive clothing and footwear can be applicable to in-store and curbside goods pickup (e.g., online purchase, in-store pickup (BOPIS)). In a non-limiting example, a user can place an order online, by phone, or via an app, such as ordering food or merchandise, and go to a designated pickup location (inside or outside a physical store) to retrieve the order. Upon arrival, the IES can automatically send a message to a store kiosk, a central server, or a relevant person, notifying the retailer of the user's arrival. The store clerk transports the order to the user's location, which can be provided in any of the ways disclosed herein; the clerk uses a work surface or a handheld point-of-sale (POS) device connected to the IES and / or the IOAAF system to locate, identify, and / or wirelessly authenticate the user before transferring the item.

[0107] Further options for using the disclosed adaptive apparel and footwear include physical activities, such as running challenge experiences, enhanced by augmented reality, such as a user competing against another user's virtual self (a "ghost"). For example, a pair of users may select a designated location, route, or distance to conduct a virtual race. On a first date and / or time, the first user may travel to the designated location / route and complete the race (e.g., completing two laps around a 1-mile course in approximately 10 minutes); this data may be collected and stored by the first user's IES. On a subsequent date / time, the second user travels to the designated location / route and begins a virtual race against the first user. As the second user completes the race, the IES may track their progress and provide them with periodic or real-time updates. For example, after completing a lap, the second user may be notified through their IES that their first lap time was slower than the first user's; if they wish to beat the first user, they may be notified to speed up. This information may be provided through haptic feedback, light displays, and / or audio outputs of the IES. The second user's race time and related data may be collected and stored by their IES and sent to the first user's IES. Additional information regarding the use of AR to enhance physical exercise can be found, for example, in U.S. Patent Application Publication No. 2016 / 0346612 Al to Craig Rowley, which is incorporated herein by reference in its entirety and for all purposes.

[0108] The foregoing concepts can be applied to other one-on-one and team-related sports, such as golf, baseball, basketball, football, and the like. Some of these sports can be assisted by other sensing and monitoring systems and other wearable electronic devices, such as head-mounted head-up display (HUD) systems. Additional information about the use of electronic tracking systems and wearable electronic devices to transmit data related to sporting events can be found, for example, in commonly owned U.S. Patent Application Publication Nos. 2020 / 0078653A1, 2017 / 0340948A1, 2017 / 0157492A1, and 2017 / 0157490A1, each of which is incorporated herein by reference in its entirety and for all purposes.

[0109] The disclosed adaptive apparel and footwear can also be used as part of an AR or VR team competition, such as a product unlocking experience, in which a first team competes with one or more other teams to obtain a limited-edition item. According to a more specific, non-limiting example, a first user travels to a command center that includes a map with the location of a hidden item. The first user communicates with a second user via IES feedback. The second user is located in a puzzle environment; the first user, located in the command center, sends navigation instructions to the second user to help them navigate to the prize. The first and second users are part of a team or group that competes with other teams to be the first to find and unlock the prize.

[0110] Further options can include using the disclosed adaptive clothing and footwear feedback to enable users to greet each other or otherwise communicate, such as a virtual handshake or greeting alternative, for example, in situations where physical contact is unavailable or not desired. Additionally, IoAFF feedback can be used to assist users in communicating with other users to warn of an invasion of personal space (e.g., to help maintain social distancing). IoAFF feedback can be used to detect whether a first user is approaching a second user unexpectedly or quickly from a determined direction. For example, an IES user may be warned that another person is approaching them from behind or from a blind spot to rob or harm them, or alternatively as part of a game or competition.

[0111] In some embodiments, aspects of the present disclosure can be implemented by a program of computer-executable instructions, such as program modules, which are commonly referred to as software applications or applications executed by any of the controllers or controller variants described herein. In a non-limiting example, the software can include routines, programs, objects, components, and data structures that perform specific tasks or implement specific data types. The software can form an interface to allow the computer to react based on input sources. The software can also cooperate with other code segments to initiate various tasks in response to data received along with the received data source. The software can be stored on any of a variety of storage media, such as CD-ROMs, disks, bubble memories, and semiconductor memories (e.g., various types of RAM or ROM).

[0112] Moreover, aspects of the present disclosure can be practiced with a variety of computer system and computer network configurations, including multiprocessor systems, microprocessor-based or programmable consumer electronic devices, minicomputers, mainframe computers, etc. Additionally, aspects of the present disclosure can be practiced in a distributed computing environment where tasks are performed by remote processing devices that are resident on and linked through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including memory storage devices. Thus, aspects of the present disclosure can be implemented in combination with various hardware, software, or combinations thereof in a computer system or other processing system.

[0113] Any method described herein may include machine-readable instructions to be executed by: (a) a processor, (b) a controller, and / or (c) any other suitable processing device. Any algorithm, software, protocol, or method disclosed herein may be embodied as software stored on a tangible medium (such as flash memory, CD-ROM, floppy disk, hard drive, digital versatile disc (DVD), or other storage device). The entire algorithm, control logic, protocol, or method and / or portions thereof may optionally be executed by a device other than the controller and / or embodied in firmware or dedicated hardware in an available manner (e.g., implemented by an application specific integrated circuit (ASIC), programmable logic device (PLD), field programmable logic device (FPLD), discrete logic, etc.). Additionally, although a particular algorithm is described with reference to the flowcharts described herein, many other methods for implementing the exemplary machine-readable instructions may alternatively be used.

[0114] Other features may be reflected in the following clauses:

[0115] Clause 1: An intelligent electronic shoe (IES) for assisting a user in navigating to a target object or location in a geographic area, the IES comprising: a shoe structure configured to attach to and support a user's foot thereon; a navigation alert system mounted to the shoe structure and configured to generate visual, audible, and / or tactile outputs in response to a command signal; a wireless communication device configured to wirelessly communicate with a remote computing node; and a controller communicatively coupled to the navigation alert system and the wireless communication device, the controller being programmed to: determine a user location of the user; receive a target location of the target object or location from the remote computing node; determine path planning data including a derived route for traversing from the user location to the target location within the geographic area; and transmit a command signal to the navigation alert system to output visual, audible, and / or tactile cues configured to guide the user along the derived route.

[0116] Clause 2: The IES of Clause 1, wherein the path planning data further includes a sequence of navigation instructions for a walking motion from the user location to the target location, and wherein each command signal corresponds to a calibrated navigation alert system cue indicative of a respective navigation instruction in the sequence of navigation instructions.

[0117] Clause 3: The IES of Clause 2, wherein the controller is further programmed to: track the real-time motion of the user along the derived route; and determine whether each new user location in a succession of new user locations along the derived route corresponds to one of the navigation instructions in the sequence of navigation instructions, wherein each command signal is sent in response to determining that one of the new user locations corresponds to the respective navigation instruction associated with the command signal.

[0118] Clause 4: The IES according to Clause 3, wherein each navigation instruction includes: go forward, go backward, turn left, turn right, accelerate, decelerate, start, stop, and / or turn around.

[0119] Clause 5: The IES according to any one of Clauses 1 to 4, wherein the controller is further programmed to send a start command signal to the navigation alert system to output visual, auditory, and / or tactile cues configured to notify the user to start traveling along the derived route.

[0120] Clause 6: The IES according to any one of Clauses 1 to 5, wherein the controller is further programmed to send a completion command signal to the navigation alert system to output visual, auditory, and / or tactile cues configured to notify the user that they have reached the target location.

[0121] Clause 7: The IES according to any one of Clauses 1 to 6, wherein the target object or location includes a virtual object located at a virtual location.

[0122] Clause 8: The IES according to any one of Clauses 1 to 7, wherein the navigation alert system includes a tactile transducer, and wherein the command signal causes the tactile transducer to generate a tactile cue.

[0123] Clause 9: The IES according to Clause 8, further including a shoelace or strap attached to the shoe structure, and wherein the tactile transducer includes a shoelace motor mounted on or inside the shoe structure and configured to selectively switch the shoelace or strap between a tightened state and a non-tightened state.

[0124] Clause 10: The IES according to Clause 9, wherein the shoe structure includes a left shoe structure and a right shoe structure, each shoe structure configured to be attached to and support the user's left foot and right foot respectively thereon, and wherein the shoelace motor includes a first and a second shoelace motor respectively mounted on the left shoe structure and the right shoe structure.

[0125] Clause 11: The IES according to Clause 10, wherein the command signal activates the first and second shoelace motors individually and in cooperation to generate a tactile cue configured to guide the user along the derived route.

[0126] Clause 12: The IES according to Clause 11, wherein the command signal adjusts the motor speed and / or the applied tension of the first and second shoelace motors to generate additional tactile cues configured to guide the user along the derived route.

[0127] Clause 13: The IES according to any one of Clauses 1 to 12, wherein the navigation alert system includes an audio system, and wherein the command signal causes the audio system to generate a predetermined sound output.

[0128] Clause 14: An IES according to any one of Clauses 1 to 13, wherein the navigation alert system includes a lighting system, and wherein the command signal causes the lighting system to produce a predetermined light output.

[0129] Clause 15: An IES according to any one of Clauses 1 to 14, wherein the user has a portable electronic device, and wherein the wireless communication device is further configured to wirelessly connect to the portable electronic device to wirelessly communicate with a remote computing node.

[0130] Clause 16: An IES according to any one of Clauses 1 to 15, further comprising a sensor mounted to the shoe structure, communicatively connected to the controller, and configured to detect the presence of the user's foot in the shoe structure, and wherein the controller is further programmed to receive from the sensor a sensor signal indicating the foot in the shoe structure, and the controller transmits a command signal in response to receiving the sensor signal.

[0131] Clause 17: An IES according to any one of Clauses 1 to 16, wherein the target location of the target object or location includes a geofence, and wherein the controller is further programmed to, in response to detecting that the user has crossed the geofence, send a completion command signal to the navigation alert system to output a visual, auditory, and / or tactile cue configured to notify the user that they have reached the target object or location.

[0132] Clause 18: A method of operating an intelligent electronic shoe (IES) for assisting a user to navigate to a target object or location in a geographical area, the IES including a shoe structure configured to attach to and support the user's foot thereon, the method comprising: receiving, via a controller through a wireless communication device, location data indicating the user's location; receiving, via the controller through the wireless communication device, location data indicating the target location of the target object or location from a remote computing node; determining, via the controller, path planning data including a derived route for traversing from the user location to the target location within the geographical area; and transmitting, via the controller, a command signal to a navigation alert system mounted on the shoe structure to output a visual, auditory, and / or tactile cue configured to guide the user along the derived route.

[0133] Clause 19: The method according to Clause 18, wherein the path planning data further includes a sequence of navigation instructions for a walking motion from the user location to the target location, and wherein each command signal corresponds to a calibrated navigation alert system cue indicating the corresponding navigation instruction in the sequence of navigation instructions.

[0134] Clause 20: The method according to Clause 19 further includes: tracking the real-time movement of the user along the derived route; and determining whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions in the navigation instruction sequence, wherein, in response to determining that one of the new user positions corresponds to the corresponding navigation instruction related to the command signal, each command signal is sent.

[0135] Clause 21: The method according to any one of Clauses 18 to 20 further includes sending a start command signal to the navigation alert system via the controller to output visual, auditory, and / or tactile cues configured to notify the user to start traveling along the derived route.

[0136] Clause 22: The method according to any one of Clauses 18 to 21 further includes sending a completion command signal to the navigation alert system via the controller to output visual, auditory, and / or tactile cues configured to notify the user that they have reached the target location.

[0137] Clause 23: The method according to any one of Clauses 18 to 22, wherein the target object or location includes a virtual object located at a virtual location.

[0138] Clause 24: The method according to any one of Clauses 18 to 23, wherein the navigation alert system includes a tactile transducer, and wherein the command signal causes the tactile transducer to generate a tactile cue.

[0139] Clause 25: The method according to Clause 24, wherein the tactile transducer includes a shoelace motor mounted on or inside the shoe structure and configured to selectively switch between a tightened state and an untightened state a shoelace or strap attached to the shoe structure.

[0140] Clause 26: The method according to Clause 25, wherein the shoe structure includes a left shoe structure and a right shoe structure, each shoe structure configured to be attached to and support the user's left foot and right foot respectively thereon, and wherein the shoelace motors include a first and a second shoelace motor respectively mounted on the left shoe structure and the right shoe structure.

[0141] Clause 27: The method according to Clause 26, wherein the command signal activates the first and second shoelace motors individually and cooperatively to generate a tactile cue configured to guide the user along the derived route.

[0142] Clause 28: The method according to Clause 27, wherein the command signal adjusts the motor speed and / or the applied tension of the first and second shoelace motors to generate an additional tactile cue configured to guide the user along the derived route.

[0143] Clause 29: A method according to any one of Clauses 18 to 28, wherein the navigation alert system includes an audio system and / or a lighting system, and wherein the command signal causes the audio system to produce a predetermined sound output and / or causes the lighting system to produce a predetermined light output.

[0144] Clause 30: A method according to any one of Clauses 18 to 29, wherein the user has a portable electronic device, and wherein the wireless communication device is wirelessly connected to the portable electronic device to wirelessly communicate with a remote computing node.

[0145] Aspects of the present disclosure have been described in detail with reference to the illustrated embodiments; however, those skilled in the art will recognize that many modifications can be made thereto without departing from the scope of the present disclosure. The present disclosure is not limited to the exact construction and composition disclosed herein; any and all modifications, changes, and variations obvious from the foregoing description are within the scope of the present disclosure as defined by the appended claims. Moreover, this concept expressly includes any and all combinations and sub-combinations of the foregoing elements and features.

Claims

1. An intelligent electronic shoe system, the system comprising: A shoe structure configured to attach to and support a user's foot thereon; A fixing mechanism attached to the shoe structure and configured to fix the foot to the shoe structure, the fixing mechanism including shoelaces, straps, buckles, latches or cables; An electric motor attached to the shoe structure and configured to tighten the fixing mechanism; A wireless communication device attached to the shoe structure and configured to wirelessly communicate with a remote computing node; And A controller communicatively connected to the electric motor and the wireless communication device, the controller being programmed to: Receive a user request to tighten the fixing mechanism; In response to receiving the user request, transmit a tightening signal to the electric motor to convert the fixing mechanism from an untightened state to a tightened state; Receive position data indicating the starting position of the user; Receive a target position of a target object or location from the remote computing node; Receive path planning data, which includes a derived route for traversing from the user's position to the target position within a geographical area, and a series of navigation instructions for performing gait movements from the user's position to the target position along the derived route; And Transmit command signals to the electric motor to output a series of tactile cues configured to guide the user along the derived route according to a sequence of navigation instructions for gait movement from the user's position to the target position.

2. The intelligent electronic shoe system according to claim 1, wherein, Each tactile cue output by the electric motor includes the fixing mechanism being tightened and untightened in a predetermined pattern sequence.

3. The intelligent electronic shoe system according to claim 1 or 2, wherein Each command signal transmitted to the electric motor corresponds to a calibrated tactile cue indicating the corresponding navigation instruction in the sequence of navigation instructions.

4. The intelligent electronic shoe system according to claim 3, wherein, The controller is further programmed to: Receive user movement data indicating the user's real-time movement along the derived route; and Determine whether each new user position in a series of new user positions along the derived route corresponds to one of the navigation instructions in the sequence of navigation instructions, wherein, in response to determining that one of the new user positions corresponds to the corresponding navigation instruction associated with the command signal, each command signal is sent.

5. The intelligent electronic shoe system according to claim 4, wherein, Each navigation instruction includes: forward, backward, left turn, right turn, acceleration, deceleration, start, stop and / or U-turn.

6. The intelligent electronic shoe system according to any one of claims 1 to 5, wherein, The controller is further programmed to send a start command signal to the electric motor to output a predetermined tactile start cue configured to notify the user to start traveling along the derived route.

7. The intelligent electronic shoe system according to claim 6, wherein, The controller is further programmed to send a completion command signal to the electric motor to output a predetermined tactile cue configured to notify the user that they have reached the target position.

8. The intelligent electronic shoe system according to any one of claims 1 to 7, wherein, The target object or location includes a virtual object located at a virtual position.

9. The intelligent electronic shoe system according to any one of claims 1 to 8, wherein, The shoe structure includes a left shoe structure and a right shoe structure configured to attach to and support the user's left foot and right foot respectively thereon, and wherein the electric motor includes a first and a second motor respectively mounted on the left shoe structure and the right shoe structure.

10. The intelligent electronic shoe system according to claim 9, wherein, The command signals individually and cooperatively activate the first and second motors, thereby generating tactile cues configured to guide the user along the derived route.

11. The intelligent electronic shoe system according to any one of claims 1 to 8, wherein, The controller is further programmed to adjust the motor speed and / or the applied tension of the motor, thereby better holding the user's foot in the shoe structure in response to the user's dynamic movement.

12. The intelligent electronic shoe system according to any one of claims 1 to 11 further includes a navigation and alert system, the navigation and alert system including an audio component attached to the shoe structure, and wherein, The controller is also programmed to transmit an audio command signal to the navigation alert system to cause an audio component to generate an audible cue configured to guide the user along the derived route.

13. The intelligent electronic shoe system according to any one of claims 1 to 12 further includes a navigation and warning system, the navigation and warning system including a light-emitting component attached to the shoe structure, and wherein, The controller is also programmed to transmit a luminous command signal to the navigation alert system to cause a luminous component to generate a visual cue configured to guide the user along the derived route.

14. The intelligent electronic shoe system according to any one of claims 1 to 13 further comprises a navigation alert system, the navigation alert system including a tactile device attached to the shoe structure, and wherein, The controller is also programmed to transmit a haptic command signal to the navigation alert system to cause a haptic device to generate a haptic cue configured to guide the user along the derived route.

15. The intelligent electronic shoe system according to any one of claims 1 to 14, wherein, The user has a portable electronic device, and wherein the wireless communication device is mounted to the shoe structure and is further configured to be wirelessly connected to the portable electronic device to wirelessly communicate with the remote computing node.

16. The intelligent electronic shoe system according to any one of claims 1 to 15, further comprising a sensor mounted to the shoe structure, communicatively connected to the controller, and configured to detect the presence of the user's foot in the shoe structure, and wherein the controller is also programmed to receive a sensor signal from the sensor indicating the foot in the shoe structure, and the controller transmits the command signal in response to receiving the sensor signal.

17. The intelligent electronic shoe system according to any one of claims 1 to 16, wherein, The target position of the target object or location includes a geofence, and wherein the controller is also programmed to transmit a completion command signal to the electric motor in response to detecting that the user has crossed the geofence to output a completion haptic cue configured to notify the user that they have reached the target object or location.

18. The intelligent electronic shoe system according to any one of claims 1 to 17, wherein, The user has a portable electronic device, and wherein the controller is a resident controller mounted within the shoe structure and communicates with the portable electronic device via the wireless communication device.

19. The intelligent electronic shoe system according to claim 18, further comprising a dedicated mobile application operating on the portable electronic device, and wherein the dedicated mobile application and the portable electronic device assist in receiving location data, receiving a target position, and receiving path planning data.

20. The intelligent electronic shoe system according to claim 19, wherein, The resident controller transmits a command signal to the electric motor to output a series of haptic cues in response to receiving the path planning data.

21. The intelligent electronic shoe system according to claim 20, wherein, The dedicated mobile application and the portable electronic device assist in receiving a user request to tighten the fixing mechanism.

22. An intelligent electronic shoe system, the system comprising: A shoe structure configured to attach to and support a user's foot thereon; A fixing mechanism attached to the shoe structure and configured to fix the foot to the shoe structure, the fixing mechanism including shoelaces, straps, buckles, latches or cables; An electric motor attached to the shoe structure and configured to tighten the fixing mechanism; A wireless communication device attached to the shoe structure and configured to wirelessly communicate with a remote computing node; And A controller communicatively connected to the electric motor and the wireless communication device, the controller being programmed to: Receive a user request to tighten the fixing mechanism; In response to receiving the user request, transmit a tightening signal to the electric motor to convert the fixing mechanism from an untightened state to a tightened state; Receive location data indicating the starting position of the user; Receive a target position of a target object or location from the remote computing node; Receive path planning data including a derived route for traversing from the starting position to the target position within a geographic area; And Transmit command signals to an electric motor to output a series of haptic cues configured to guide a user along a derived route; and Adjust the motor speed or applied pulling force of the electric motor to generate additional haptic cues configured to guide the user along the derived route.

23. The intelligent electronic shoe system according to claim 22, wherein, Each haptic cue output by the electric motor includes a fixation mechanism that tightens and loosens in a sequential pattern of a predetermined mode.

24. The intelligent electronic shoe system according to claim 22 or 23, wherein, Each command signal transmitted by the controller to the electric motor corresponds to a calibrated haptic cue of a corresponding navigation instruction in a sequence of navigation instructions indicating a gait movement from a user location to a target location along the derived route.

25. The intelligent electronic shoe system according to claim 24, wherein, The controller is further programmed to: Receive user movement data indicating the real-time movement of the user along the derived route; and Determine whether each new user location in a succession of new user locations along the derived route corresponds to one of the navigation instructions in the sequence of navigation instructions, wherein, in response to determining that one of the new user locations corresponds to the corresponding navigation instruction associated with the command signal, each command signal is sent.

26. The intelligent electronic shoe system according to any one of claims 22 to 25, wherein, The shoe structure includes a left shoe structure and a right shoe structure configured to respectively attach to and support a user's left and right feet thereon, and wherein the electric motor includes a first and a second motor respectively mounted on the left shoe structure and the right shoe structure.

27. The intelligent electronic shoe system according to claim 26, wherein, The command signals individually and cooperatively activate the first and second motors to generate haptic cues configured to guide the user along the derived route.

28. The intelligent electronic shoe system according to any one of claims 22 to 27 further includes a navigation alert system, the navigation alert system including an audio component attached to the shoe structure, and wherein, The controller is further programmed to transmit audio command signals to a navigation alert system to cause an audio component to generate sound cues configured to guide the user along the derived route.

29. The intelligent electronic shoe system according to any one of claims 22 to 28 further includes a navigation alarm system, the navigation alarm system including a light-emitting component attached to the shoe structure, and wherein, The controller is further programmed to transmit light-emitting command signals to a navigation alert system to cause a light-emitting component to generate visual cues configured to guide the user along the derived route.

30. The intelligent electronic shoe system according to any one of claims 22 to 29 further includes a navigation alert system, the navigation alert system including a haptic device attached to the shoe structure, and wherein, The controller is further programmed to transmit haptic command signals to a navigation alert system to cause a haptic device to generate haptic cues configured to guide the user along the derived route.

Citation Information

Patent Citations

  • System and method for providing cryptographically secured digital assets

    US10505726B1

  • Enhancing Exercise Through Augmented Reality

    US20160346612A1

  • Apparel with ultrasonic position sensing and haptic feedback for activities

    US20170154505A1

  • Golf aid including virtual caddy

    US20170157490A1

  • Electronic tracking system with heads up display

    US20170157492A1