Unlocking augmented reality experience via target image detection
Augmented reality image recognition systems enable users to unlock access to consumer products by capturing target images from another device, addressing limitations in existing systems and enhancing accessibility through social media sharing.
Patent Information
- Application Number
- JP2025112938
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2018-06-19
- Filing Date
- 2025-07-03
- Publication Date
- 2025-09-11
AI Technical Summary
Existing systems for unlocking access to consumer products through augmented reality require consumers to wait in line or meet specific requirements, limiting accessibility and encouraging competition among consumers.
A system that uses augmented reality to recognize target images, allowing users to unlock access to consumer products by capturing and recognizing images from another user's device, enabling access through social media sharing and image recognition.
Facilitates seamless access to consumer products by leveraging augmented reality image recognition, reducing competition and enhancing accessibility through social media sharing.
Smart Images

Figure 2025133866000001_ABST
Abstract
Description
[Technical Field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of and priority to non-provisional U.S. patent application Ser. No. 16 / 011,872, filed June 19, 2018, which claims priority to U.S. Provisional Patent Application Ser. No. 62 / 522,498, filed June 20, 2017, entitled "AUGMENTED REALITY EXPERIENCE UNLOCK VIA TARGET IMAGE DETECTION," both of which are expressly incorporated herein by reference in their entirety for all non-limiting purposes. [Background technology]
[0002] The present disclosure relates to devices, systems, methods, and computer-generated user interfaces that use augmented reality features to unlock selective access to purchase consumer products, such as footwear, clothing, athletic equipment, or any other type of consumer product.
[0003] In recent years, electronic computing devices and their capabilities have seen significant advancements, including advances in augmented reality. Augmented reality may include image recognition devices that can receive commands and input from recognizing captured images. The present disclosure provides apparatus and systems that unlock selective access to purchase consumer products through augmented reality functionality. While systems exist for limited releases of consumer products or for selectively unlocking access to purchase consumer products, these systems typically require consumers to be ready for the release time by waiting in line or meeting requirements to be able to purchase the desired product. These systems encourage competition among consumers to gain access, limiting the number of consumers willing to pursue this access.
[0004] As social media continues to grow, the influence of individuals with significant social media connections expands. Certain individuals have large followings and significantly influence their followers' activities. Endorsements of certain brands or products by these individuals can significantly increase the popularity and demand for those brands or products. Relatedly, individuals seeking to expand awareness and increase their personal brand often do so by building a social media presence. The aspects discussed herein relate to assigning certain influential individuals an image to share through their social media accounts. A first user then uses a mobile device to view the image on social media. While it is displayed on the first user's mobile device, a second user may use another mobile device to capture the image displayed on the first user's mobile device. Upon recognizing the image, the second user's mobile device may unlock selective access for the second user to purchase a consumer product or provide a desired output. Summary of the Invention [Problem to be solved by the invention]
[0005] The present disclosure is directed to systems and methods that overcome one or more of the above and other deficiencies in the art. [Means for solving the problem]
[0006] The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosure. This summary is not an extensive overview of the disclosure. It is not intended to identify key or critical elements of the disclosure, nor is it intended to delineate the scope of the disclosure. The following summary merely presents some concepts of the disclosure in a simplified form as a prelude to the description that follows.
[0007] Various aspects of the present disclosure relate to systems and methods for unlocking selective access to purchase consumer products through augmented reality. In certain embodiments, a user's mobile device may capture an image using augmented reality and recognize a target within the image. Upon recognizing the target within the image, the device may overlay a three-dimensional model of the consumer product and unlock user access to purchase the displayed consumer product. In some aspects, the image may be recognized from a second user's mobile device. As an example, a user may find an image on social media and show it to a friend. The friend may then use their mobile device to capture an image, and if the friend recognizes the image as a predetermined target, the device may communicate with the system and unlock access for the user to purchase the consumer product. Through these features, consumers are prompted to share an image and view the shared image through augmented reality software to determine whether the image is a target image that unlocks access to the consumer product or other desired result. In certain aspects, a user can simply determine whether an image contains a target by viewing the image through a specific program. Thus, users are prompted to share an image, view the image through the augmented reality program, and determine whether the image is a target image recognized by the program. Further, in some aspects, the program may perform target recognition only when capturing an image displayed on another user's device, such that each user can gain access to the consumer product only by capturing an image from another user's device. In certain embodiments, individuals may be granted a first opportunity to share the image through an online platform, such as social media. Each individual who views the image through the augmented reality software may be granted access to purchase the product.
[0008] Although described above in connection with providing access to purchase consumer products, aspects of the present disclosure may be implemented in combination with other features or functions upon recognizing a target in an image. In some aspects, an augmented reality program may alter the display of the device upon recognizing a target in an image. Particular functions may include altering the display to play a video, overlay a three-dimensional image, change the view of the capture device, or otherwise modify certain aspects of the image captured by the image capture device. Indeed, the scope of application of the present disclosure is not limited to unlocking access to purchase consumer products. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 illustrates an example system that may be configured to provide personal training and / or acquire data from a user's physical movements, according to an example embodiment.
[0010] [Figure 2] 2 illustrates an exemplary computing device that may be part of or in communication with the system of FIG. 1.
[0011] [Figure 3] 1A-1C illustrate an exemplary sensor assembly that may be worn by a user, according to an exemplary embodiment.
[0012] [Figure 4] FIG. 10 illustrates another exemplary sensor assembly that may be worn by a user, according to an exemplary embodiment.
[0013] [Figure 5] FIG. 10 illustrates exemplary locations of sensory inputs that may include physical sensors located on / in the user's clothing and / or may be based on identification of a relationship between two moving body parts of the user.
[0014] [Figure 6A] 1A-1C illustrate various examples of overall hardware and network systems that may be used to implement various examples of the present disclosure. [Figure 6B] 1A-1C illustrate various examples of overall hardware and network systems that may be used to implement various examples of the present disclosure. [Figure 6C] 1A-1C illustrate various examples of overall hardware and network systems that may be used to implement various examples of the present disclosure.
[0015] [Figure 7] FIG. 1 illustrates an example of a hardware and network system that may be used to implement various examples of the present disclosure.
[0016] [Figure 8] FIG. 1 is a flowchart illustrating example steps performed as discussed in this disclosure.
[0017] [Figure 9] FIG. 10 shows another flowchart illustrating example execution steps discussed in this disclosure.
[0018] [Figure 10] FIG. 10 illustrates another flowchart illustrating example execution steps disclosed in the present disclosure, including a display associated with a mobile device.
[0019] [Figure 11A] FIG. 10 illustrates another flowchart illustrating example execution steps disclosed in the present disclosure, including a display associated with a mobile device. [Figure 11B] FIG. 10 illustrates another flowchart illustrating example execution steps disclosed in the present disclosure, including a display associated with a mobile device.
[0020] [Figure 12A]FIG. 1 illustrates an example of a display that may be utilized by an augmented reality program.
[0021] [Figure 12B] FIG. 1 illustrates an example of a display that may be utilized by an augmented reality program. DETAILED DESCRIPTION OF THE INVENTION
[0022] Aspects of the present disclosure include using augmented reality functionality to unlock selective access to purchase consumer products, such as footwear, clothing, athletic equipment, or any other type of consumer product. The augmented reality functionality may be given instructions to execute upon recognizing a target image. In some aspects, the target image may be shared through a platform, such as a social media platform. A user may use the augmented reality functionality to search for an image that is a target image that unlocks access to purchase the consumer product. Still further aspects relate to using the augmented reality functionality to generate an output, such as, for example, changing an output display of a mobile device based on the recognition of a target image. These and other aspects will be discussed in the context of the following illustrative example of an augmented reality program and unlocking selective access.
[0023] In the following description of various embodiments, reference is made to the accompanying drawings, which form a part of this specification. In the accompanying drawings, there is shown, by way of illustration, various embodiments in which aspects of the disclosure may be practiced. It is to be understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the scope and spirit of the present disclosure. Further, headings within this disclosure should not be construed as limiting aspects of the disclosure, and example embodiments are not limited to the example headings.
[0024] I. Illustrative Personal Training System A. Exemplary Network Aspects of the present disclosure relate to systems and methods that may be utilized across multiple networks. In this regard, certain embodiments may be configured to adapt to dynamic network environments. Further embodiments are capable of operating in different, separate network environments. FIG. 1 illustrates an example personal training system 100, according to an exemplary embodiment. The exemplary system 100 may include one or more interconnected networks, such as an exemplary body area network (BAN) 102, a local area network (LAN) 104, and a wide area network (WAN) 106. As shown in FIG. 1 (and as described throughout the description of this disclosure), one or more networks (e.g., BAN 102, LAN 104, and / or WAN 106) may overlap or otherwise include one another. Those skilled in the art will appreciate that the exemplary networks 102-106 are logical networks, each including one or more different communication protocols and / or network architectures, and may be further configured to have gateways to each other or to other networks. For example, each of BAN 102, LAN 104, and / or WAN 106 may be operatively connected to the same physical network architecture, such as cellular network architecture 108 and / or WAN architecture 110. For example, portable electronic device 112, which may be considered a component of both BAN 102 and LAN 104, may include a network adapter or network interface card (NIC) configured to convert data and control signals into network messages, and vice versa, through one or more of architectures 108 and / or 110 in accordance with one or more communication protocols, such as Transmission Control Protocol (TCP), Internet Protocol (IP), and User Datagram Protocol (UDP). Such protocols are known in the art and, therefore, will not be discussed in further detail herein.
[0025] Network architectures 108 and 110 may include one or more information distribution networks of any type(s) or topology(s), such as, for example, cable, fiber, satellite, telephone, cellular, wireless, etc., alone or in combination, and thus may be variously configured to have one or more wired or wireless communication channels (including, but not limited to, Wi-Fi, Bluetooth, Near Field Communication (NFC), and / or ANT technologies). Thus, any device in the network of FIG. 1 (such as portable electronic device 112 or any other device described herein) may be considered to encompass one or more of the different logical networks 102-106. With this in mind, exemplary components of an exemplary BAN and LAN (which may be coupled to WAN 106) will now be described.
[0026] 1. Example Local Area Network LAN 104 may include one or more electronic devices, such as, for example, computing device 114. Computing device 114 or any other component of system 100 may include a mobile terminal, such as a phone, music player, tablet, netbook, or any portable device. In other embodiments, computing device 114 may include a media player or recorder, a desktop computer, a server(s), or a gaming console, such as, for example, a Microsoft® XBOX®, Sony® Playstation®, and / or Nintendo® Wii® gaming console. Those skilled in the art will understand that these are merely exemplary devices for illustrative purposes, and that the present disclosure is not limited to any console or computing device.
[0027] Those skilled in the art will appreciate that the design and structure of computing device 114 may vary depending on several factors, such as its intended purpose. One example implementation of computing device 114 is provided in FIG. 2, which illustrates a block diagram of computing device 200. Those skilled in the art will appreciate that the disclosure of FIG. 2 is applicable to any of the devices disclosed herein. Device 200 may include one or more processors, such as processors 202-1 and 202-2 (generally referred to herein as “processors 202” or “processor 202”). Processors 202 may communicate with each other or with other components via an interconnection network or bus 204. Processor 202 may include one or more processing cores, such as core 206-1 and core 206-2 (generally referred to herein as “cores 206” or more generally as “core 206”), which may be implemented on a single integrated circuit (IC).
[0028] Core 206 may include a shared cache 208 and / or a private cache (e.g., cache 210-1 and cache 210-2, respectively). One or more caches 208 / 210 may locally cache data stored in system memory, such as memory 212, for fast access by components of processor 202. Memory 212 may communicate with processor 202 via chipset 216. In some embodiments, cache 208 may be part of system memory 212. Memory 212 may include, but is not limited to, random access memory (RAM), read-only memory (ROM), and may include one or more of solid-state memory, optical or magnetic storage, and / or any other media that may be used to store electronic information. Still other embodiments may omit system memory 212.
[0029] System 200 may include one or more I / O devices (e.g., I / O devices 214-1 through 214-3, each generally referred to as I / O device 214). I / O data from one or more I / O devices 214 may be stored in one or more caches 208, 210 and / or system memory 212. Each of I / O devices 214 may be configured to be in operative communication with components of system 100, either permanently or temporarily, using any physical or wireless communication protocol.
[0030] Returning to FIG. 1 , four exemplary I / O devices (shown as elements 116-122) are shown in communication with computing device 114. Those skilled in the art will appreciate that one or more of devices 116-122 may be standalone devices or may be associated with another device other than computing device 114. For example, one or more I / O devices may be associated with or interact with components of BAN 102 and / or WAN 106. I / O devices 116-122 may include, but are not limited to, athletic data acquisition units such as sensors. One or more I / O devices may be configured to sense, detect, and / or measure athletic parameters from a user, such as user 124. Examples include, but are not limited to, among others: accelerometers, gyroscopes, positioning devices (e.g., GPS), light (including non-visible light) sensors, temperature sensors (including ambient temperature and / or body temperature), sleep pattern sensors, heart rate monitors, image capture sensors, humidity sensors, force sensors, compasses, angular velocity sensors, and / or combinations thereof.
[0031] In further embodiments, I / O devices 116-122 may be used to provide output (e.g., audible, visual, or tactile cues) and / or receive input, such as user input, from athlete 124. Exemplary specifications for such exemplary I / O devices are provided below, although those skilled in the art will appreciate that such discussion merely describes some of the many options within the scope of the present disclosure. Furthermore, any reference to any data acquisition unit, I / O device, or sensor should be construed as disclosing an embodiment that may have one or more I / O devices, data acquisition units, and / or sensors (individually or in combination) disclosed herein or known in the art.
[0032] Information from one or more devices (across one or more networks) may be used (or utilized in a manner that provides) a variety of different parameters, metrics, or physiological characteristics, including, but not limited to, motion parameters such as speed, acceleration, distance, stride length, direction, relative movement of a particular body part or object relative to others, or other motion parameters that may be expressed as angular velocity, linear velocity, or combinations thereof; physiological parameters such as calories, heart rate, sweat detection, effort, oxygen consumption, oxygen kinetics, and other metrics that fall into one or more categories such as pressure, impact force, etc.; information about the athlete such as height and weight, age, demographic information, and combinations thereof.
[0033] System 100 may be configured to transmit and / or receive athletic data, including parameters, metrics, or physiological characteristics, collected within or provided to system 100. As an example, WAN 106 may include server 111. Server 111 may include one or more components of system 200 of FIG. 2. In one embodiment, server 111 includes at least a processor and memory, such as processor 206 and memory 212. Server 111 may be configured to store computer-executable instructions on a non-transitory computer-readable medium. The instructions may include athletic data, such as raw data or processed data, collected within system 100. System 100 may be configured to transmit data, such as energy expenditure points, to a social networking website or host of such sites. Server 111 may be utilized to allow one or more users to access and / or compare athletic data. Accordingly, server 111 may be configured to transmit and / or receive notifications based on athletic data or other information.
[0034] Returning to the LAN 104, the computing device 114 is shown in operative communication with a display device 116, an image capture device 118, sensors 120, and an exercise device 122, which are then discussed below with reference to exemplary embodiments. In one embodiment, the display device 116 may provide audiovisual cues for the athlete 124 to perform a particular athletic movement. The audiovisual cues may be provided in response to computer-executable instructions executed on the computing device 114 or on any other device, including devices in the BAN 102 and / or WAN. The display device 116 may be a touchscreen device or may be configured to receive user input.
[0035] In one embodiment, data may be obtained from image capture device 118 and / or other sensors, such as sensor 120, which may be used alone or in combination with other devices to detect (and / or measure) athletic parameters or stored information. Image capture device 118 and / or sensor 120 may include a transceiver device. In one embodiment, sensor 128 may include an infrared (IR), electromagnetic (EM), or acoustic transceiver. For example, image capture device 118 and / or sensor 120 may transmit waveforms into the environment, including toward athlete 124, receive “reflections,” or otherwise detect alterations in these emitted waveforms. Those skilled in the art will readily appreciate that signals corresponding to numerous different data spectrums may be utilized according to various embodiments. In this regard, device 118 and / or 120 may detect waveforms emitted from an external source (e.g., not system 100). For example, device 118 and / or 120 may detect heat radiating from user 124 and / or the surrounding environment. Thus, image capture device 126 and / or sensor 128 may include one or more thermal imaging devices. In one embodiment, image capture device 126 and / or sensor 128 may include an IR device configured to perform range phenomenology.
[0036] In one embodiment, exercise device 122 may be any device configurable to enable or facilitate physical activity for athlete 124, such as, for example, a treadmill, step machine, or the like. The device need not be stationary. In this regard, wireless technology allows for the use of portable devices; thus, a bicycle or other mobile exercise device may be utilized in accordance with certain embodiments. Those skilled in the art will appreciate that equipment 122 may be or include an interface for receiving an electronic device containing remotely performed athletic data from computing device 114. For example, a user may use a sports device (described below in connection with BAN 102) and, upon returning home or to the location of equipment 122, download the athletic data to element 122 or any other device of system 100. Any I / O device disclosed herein may be configured to receive activity data.
[0037] 2. Body Area Network The BAN 102 may include two or more devices (including passive devices) configured to receive, transmit, or otherwise facilitate the collection of athletic data. Example devices may include one or more data acquisition units, sensors, or devices known in the art or disclosed herein, including, but not limited to, I / O devices 116-122. Two or more components of the BAN 102 may communicate directly, although in other embodiments, communication may be achieved through a third device that may be part of the BAN 102, LAN 104, and / or WAN 106. One or more components of the LAN 104 or WAN 106 may form part of the BAN 102. In certain implementations, whether a device, such as the portable device 112, is part of the BAN 102, LAN 104, and / or WAN 106 may depend on the athlete's proximity to access points that enable communication with the mobile cellular network architecture 108 and / or WAN architecture 110. Additionally, a user's activities and / or preferences may influence whether one or more components are utilized as part of the BAN 102. Exemplary embodiments are provided below.
[0038] A user 124 may be associated with (e.g., hold, carry, wear, and / or interact with) any number of devices, such as a portable device 112, a shoe-mounted device 126, a wrist-worn device 128, and / or sensing locations, such as a sensing location 130, which may include physical devices or locations used to collect information. One or more of the devices 112, 126, 128, and / or 130 may not be specifically designed for fitness or exercise purposes. Indeed, although aspects of the present disclosure relate to utilizing data from multiple devices to collect, detect, and / or measure athletic data, some devices are not fitness devices. In certain embodiments, one or more devices in the BAN 102 (or any other network) may include a fitness or sports device specifically designed for a particular sports application. As used herein, the term “sports device” includes any physical object that may be used during or associated with a particular sports or fitness activity. Exemplary sports devices may include, but are not limited to: golf balls, basketballs, baseballs, soccer balls, footballs, power balls, hockey pucks, weights, bats, clubs, sticks, paddles, mats, and combinations thereof. In further embodiments, exemplary fitness devices may include objects within a sports environment in which a particular sport is played, including the environment itself, such as goal nets, hoops, backboards, portions of the field, such as center lines and outer boundary markers, bases, and combinations thereof.
[0039] In this regard, those skilled in the art will understand that one or more sports devices may also be part of (or form) a structure, or vice versa, and that a structure may include or be configured to interact with one or more sports devices. For example, a first structure may include a basketball hoop and a backboard, which may be removable and replaced with goal posts. In this regard, one or more sports devices may include one or more sensors, such as one or more of the sensors described above with reference to FIGS. 1-3, which may provide information used independently or in conjunction with other sensors, such as one or more sensors associated with one or more structures. For example, a backboard may include a first sensor configured to measure the force and direction of force by a basketball hitting the backboard, and the hoop may include a second sensor for detecting the force. Similarly, a golf club may include a first sensor configured to detect grip attributes on the shaft and a second sensor configured to measure impact by a golf ball.
[0040] Turning to an exemplary portable device 112, it may be a multi-purpose electronic device such as a phone or digital music player, including, for example, IPOD®, IPAD®, or iPhone® brand devices available from Apple Inc. of Cupertino, California, or Zune® or Microsoft® Windows® devices available from Microsoft® of Redmond, Washington. As known to those skilled in the art, a digital media player may serve as an output device, an input device, and / or a storage device for a computer. Device 112 may be configured as an input device for receiving raw or processed data collected from one or more devices within BAN 102, LAN 104, or WAN 106. In one or more embodiments, portable device 112 may include one or more components of computer device 114. For example, portable device 112 may include a display 116, an image capture device 118, and / or one or more data acquisition devices, such as any of the I / O devices 116-122 described above, with or without additional components, to comprise a mobile terminal.
[0041] a. Exemplary Garment / Accessory Sensors In particular embodiments, the I / O devices may be formed within or otherwise associated with the clothing or accessories of the user 124, including a watch, armband, wristband, necklace, shirt, shoes, etc. These devices may be configured to monitor the user's athletic activity. It should be understood that such devices may detect athletic activity during the user's 124 interaction with the computing device 114 and / or operate independently of the computing device 114 (or any other device disclosed herein). For example, one or more devices in the BAN 102 may be configured to function as an all-day activity monitor that measures activity regardless of the user's proximity to or interaction with the computing device 114. It should further be understood that the sensory system 302 shown in FIG. 3 and the device assembly 400 shown in FIG. 4, each described in the following paragraphs, are merely illustrative examples.
[0042] i. Shoe-mounted devices In certain embodiments, device 126 shown in FIG. 1 may include footwear that may include one or more sensors. The one or more sensors may include, but are not limited to, sensors disclosed herein and / or known in the art. FIG. 3 illustrates one example embodiment of a sensor system 302 that provides one or more sensor assemblies 304. Assembly 304 may include one or more sensors, such as, for example, an accelerometer, a gyroscope, a positioning component, a force sensor, and / or any other sensor disclosed herein or known in the art. In the illustrated embodiment, assembly 304 incorporates multiple sensors, which may include a force-sensitive resistor (FSR) sensor 306; however, other sensor(s) may be utilized. Port 308 may be disposed within a sole structure 309 of the shoe and is generally configured for communication with one or more electronic devices. Port 308 may optionally be provided for communication with electronic module 310, and sole structure 309 may optionally include housing 311 or other structure for receiving module 310. Sensor system 302 may also include multiple leads 312 connecting FSR sensor 306 to port 308 to enable communication with module 310 and / or another electronic device through port 308. Module 310 may be contained within a well or cavity in the sole structure of the shoe, and housing 311 may be disposed within the well or cavity. In one embodiment, at least one gyroscope and at least one accelerometer are provided within a single housing, such as module 310 and / or housing 311. In at least further embodiments, one or more sensors configured to provide orientation information and angular velocity data during operation are provided. Port 308 and module 310 include complementary interfaces 314, 316 for connection and communication.
[0043] In certain embodiments, at least one force-sensitive resistor 306 shown in FIG. 3 may include first and second electrodes or electrical contacts 318, 320 and a force-sensitive resistive material 322 disposed between the electrodes 318, 320 to electrically connect the electrodes 318, 320 together. When pressure is applied to the force-sensitive material 322, the resistivity and / or conductivity of the force-sensitive material 322 changes, which changes the electrical potential between the electrodes 318, 320. The change in resistance can be detected by the sensor system 302 to detect the force applied to the sensor 316. The force-sensitive resistive material 322 may change its resistance under pressure in various ways. For example, the force-sensitive material 322 may have an internal resistance that decreases when the material is compressed. Further embodiments may utilize a "capacitance-based resistance" that may be implemented through a "smart material." As another example, the material 322 may change resistance by changing the degree of surface-to-surface contact, such as between two portions of the force-sensitive material 322 or between the force-sensitive material 322 and one or both electrodes 318, 320. In some circumstances, this type of force-sensing resistive behavior may be described as "contact-based resistance."
[0044] ii. Wrist-worn devices As shown in FIG. 4 , device 400 (which may be similar to or include sensory device 128 shown in FIG. 1 ) may be configured to be worn by user 124, such as around the wrist, arm, ankle, neck, etc. Device 400 may include an input mechanism, such as depressible input buttons 402, configured to be used during operation of device 400. Input buttons 402 may be operably connected to a controller 404 and / or to any other electronic components, such as one or more of the elements discussed with respect to computing device 114 illustrated in FIG. 1 . Controller 404 may be incorporated into or be part of housing 406. Housing 406 may be formed from one or more materials, including elastic components, and may include one or more displays, such as display 408. The display may be considered an illuminatable portion of device 400. Display 408 may include a series of individual light elements or light members, such as LED lights 410. The lights may be formed in an array and operably connected to controller 404. Device 400 may include an indicator system 412, which may also be considered a portion or component of the overall display 408. Indicator system 412 may operate in conjunction with and illuminate display 408 (which may have pixel elements 414) or may be completely separate from display 408. Indicator system 412 may also include multiple additional light elements or elements, which in illustrative embodiments may also take the form of LED lights. In particular embodiments, the indicator system may provide a visual indication of a goal, such as by illuminating a portion of the light elements of indicator system 412 to represent progress toward one or more goals. Device 400 may be configured to display, via display 408 and / or indicator system 412, data expressed in terms of activity points or currency earned by the user based on the user's activity.
[0045] The fastening mechanism 416 can be disengaged, the device 400 can be placed around the wrist or portion of the user 124, and the fastening mechanism 416 can then be placed in an engaged position. In one embodiment, the fastening mechanism 416 can include an interface, including but not limited to a USB port, for operational interaction with devices such as the computing device 114 and / or the devices 120 and / or 112. In certain embodiments, the fastening member can include one or more magnets. In one embodiment, the fastening member may have no moving parts and rely entirely on magnetic forces.
[0046] In certain embodiments, device 400 may include a sensor assembly (not shown in FIG. 4). The sensor assembly may include a plurality of different sensors, including sensors disclosed herein and / or known in the art. In exemplary embodiments, the sensor assembly may include or allow for operative connection to any sensor disclosed herein or known in the art. Device 400 and / or its sensor assembly may be configured to receive data obtained from one or more external sensors.
[0047] iii. Clothing and / or body position detection Element 130 in FIG. 1 illustrates an exemplary sensory location, which may be associated with a physical device such as a sensor, data acquisition unit, or other device. In yet other embodiments, the sensory location may be a specific location on a body part or area being monitored, such as via an image capture device (e.g., image capture device 118). In certain embodiments, element 130 may include a sensor, such that elements 130a and 130b may be sensors integrated into clothing, such as athletic wear. Such sensors may be placed at any desired location on the user's 124's body. Sensors 130a / b may communicate (e.g., wirelessly) with one or more devices (including other sensors) on the BAN 102, LAN 104, and / or WAN 106. In certain embodiments, a passive sensing surface may reflect a waveform, such as infrared light, emitted by image capture device 118 and / or sensor 120. In one embodiment, a passive sensor located on the user's 124's clothing may generally include a spherical structure made of glass or other transparent or translucent surface that may reflect a waveform. Different classes of garments may be utilized, where a given garment class has particular sensors configured to be positioned proximate to particular parts of the body of the user 124 when properly worn. For example, golf garments may include one or more sensors positioned on the garment in a first configuration, while soccer garments may include one or more sensors positioned on the garment in a second configuration.
[0048] FIG. 5 illustrates exemplary locations for sensory input (see, e.g., sensor locations 130a-130o). In this regard, the sensors may be physical sensors located on / in the user's clothing, and in yet other embodiments, sensor locations 130a-130o may be based on the identification of a relationship between two moving body parts. For example, sensor location 130a may be determined by identifying the movement of user 124 using an image capture device, such as image capture device 118. Thus, in certain embodiments, a sensor may not be physically located in a particular location (e.g., one or more of sensor locations 130a-130o), but is configured to sense characteristics of that location, such as using other sensor data collected from image capture device 118 or other locations. In this regard, the general shape of the user's body or portions thereof may enable the identification of a particular body part. Whether an image capture device is utilized and / or physical sensors are located on user 124 and / or data from other devices (such as sensory system 302) are used, device assembly 400 and / or any other devices or sensors disclosed herein or known in the art are utilized, the sensors may sense the current position of the body part and / or track the movement of the body part. In one embodiment, sensory data regarding location 130m may be utilized to determine the user's center of gravity (also referred to as center of mass). For example, the relationship between location 130a and locations 130f / 130l relative to one or more of locations 130m-130o may be utilized to determine whether the user's center of gravity has risen along the vertical axis (e.g., during a jump) or whether the user is attempting to "fake" a jump by bending the knees. In one embodiment, sensor location 130n may be located around the sternum of user 124. Similarly, sensor location 130o may be located near the navel of user 124. In certain embodiments, data from sensor locations 130m-130o (alone or in combination with other data) may be utilized to determine the center of gravity of user 124.In further embodiments, the relationship between multiple sensor locations, such as sensors 130m-130o, may be used to determine the orientation of user 124 and / or rotational forces, such as twisting of the torso of user 124. Additionally, one or more locations, such as location(s), may be used as a center (or approximate) of a moment location. For example, in one embodiment, one or more of locations 130m-130o may serve as a center point of the momentary location of user 124. In another embodiment, one or more locations may serve as a center of a particular body part or region at a moment in time.
[0049] 6A-6C illustrate various examples of hardware systems in which systems and user interfaces according to the present disclosure may be implemented and methods according to the present disclosure may be practiced. In one embodiment, multiple users may work together using an augmented reality program to share and capture target images.
[0050] FIG. 6A illustrates a first computing device 600 and a second computing device 602 connected to and communicating with each other via a network 604, such as via an Internet connection, a local area network (LAN), a wide area network (WAN), etc. The two computing devices 600 and 602 may be located remotely from each other. In some embodiments, the computing devices 600 and 602 may be mobile devices such as mobile phones or tablets. As shown in FIG. 6A , the two computing devices 600 and 602 each establish a communication channel within the network 604 to communicate with a messaging server system 606 (comprising one or more server computers), which provides target-related data or information between the computing devices 600 and 602. Any desired communication link and communication protocol may be used to provide and control data exchange between the computing devices 600 and 602. If desired, as described in more detail below, this same server system 606 may provide communication data (text message data, webcam data, etc.) between users on the computing devices 600 and 602. Alternatively, if desired, a separate communications link 608 may be provided to support the transmission of communications data between computing devices 600 and 602 .
[0051] As described in more detail below, any desired type of computing device 600 and 602 may be used, such as any computing device capable of establishing network and / or peer-to-peer connections and providing the necessary display, user interface, and input capabilities, without departing from this disclosure. Some more specific examples of computing devices 600 and 602 that may be used in systems and methods according to at least some examples of the present disclosure include, but are not limited to: desktop computers, personal computers, laptop computers, palmtop computers, handheld computers, mobile phones, personal digital assistants, computer workstations, televisions, etc. Notably, the various computing devices 600, 602, etc. may communicate with network 604 and server system 606 in the same or different manners without departing from this disclosure. Additionally, the computing devices 600, 602, etc. used to display and capture the target image may be of the same or different types (such as one desktop computer and one mobile phone device) without departing from this disclosure, and the computing devices 600, 602, etc. may communicate with each other or with the system database 606 over the same or different communication channels (e.g., both users may connect to the system database over Wi-Fi, or one user may connect to the system database over Wi-Fi and the other user may connect over cellular data). In further aspects, the computing devices may display the target image through the same application or through different applications (e.g., both users may display the target image through a single application, such as Instagram®, or through different applications (e.g., one user may display it through Instagram and the other user may display it through the Facebook® application, etc.)).
[0052] Computing devices 600 and 602 that may be used in systems and methods according to examples of the present disclosure may include one or more input devices and a data processing system (e.g., including one or more microprocessors). Examples of input devices that may be included in computing devices 600, 602 include, but are not limited to, conventional input devices such as a keyboard (hard or soft); a mouse, trackball, rollerball, touchpad, or other pointing device; a stylus or other pen-based input device (e.g., for tablet PC-type computing devices); a disk drive; a USB port; a network connection; a joystick-type controller; a telephone connection; an Ethernet connection; and voice recognition capabilities. Additionally, any desired type of display device may be provided for use with computing devices 600, 602 of systems and methods according to the present disclosure, including a display device integrated with computing device 600, 602 itself or a display device separate from but in communication with computing device 600, 602, such as a projector display or a separate monitor display.
[0053] Computing devices 600 and 602 may be connected to network 604 in any desired manner, including conventional manners known and used in the art, such as any conventional wired or wireless connection, and using any network connection protocol, without departing from this disclosure. The communication channel connection 608 between computing devices 600, 602 may be the same as or different from the system database connection without departing from this disclosure, and this connection 608 may include conventional technology known in the art. In addition to various computer-to-computer communication links known and used in the art to provide live, real-time communication between two (or more) computers, communication channel connection 608 may also include other types of communication channels between computers or users, such as instant messaging channels, peer-to-peer messaging channels, traditional telephone connections, etc. If desired, as another alternative, users may be located in close proximity to each other and be able to communicate directly in face-to-face conversation without the need for a separate communication channel. When provided, the communication channel 608 may use all the same hardware as that involved in the target image data exchange, all different hardware, or a combination thereof (e.g., some users may use the same hardware and other users may use different hardware, etc.).
[0054] As mentioned above (and described in more detail below), systems and methods according to examples of the present disclosure will provide a user interface display on a user's computing device 600, 602. This interface will allow the user to view the target image and will allow the user to display the target image for another user to capture. The user interfaces on the various devices will be provided and controlled by one or more of the computing devices 600, 602 and / or by the server system 606, and data for generating, maintaining, and receiving input through the user interfaces will be generated and provided via computer-readable media included as part of or associated with one or more of the computing devices 600, 602 and / or the server system 606. Examples of such computer-readable media include, but are not limited to, computer-readable memory, both internal to the computer (e.g., a hard drive) or separate from the computer (e.g., a disk, a solid-state or flash memory device, data available via a network connection, etc.), and including any type of computer-readable medium conventionally known and used in the computer arts.
[0055] 6A , software for generating the user interface may reside on a computer-readable medium located on or available to any one of computing device 600, computing device 602, or server system 606. Alternatively, if desired, the software, or at least some portion(s) thereof, may reside on two or more or all of computing device 600, computing device 602, or server system 606. Server system 606 may be operated and maintained by the same organization(s) or individual(s) that operate and maintain at least one of computing devices 600 and 602 and / or network 604, or server system 606 may be operated, controlled, and maintained by a party separate from any or all of these entities. As some more specific examples, server system 606 may be operated and maintained (and the user interface software may also be operated and maintained) by one or more entities (e.g., manufacturers, retailers, vendors selected by manufacturers or retailers, etc.) whose products are traded and accessed through the augmented reality program.
[0056] Another example overall system setup is shown in Figure 6B. The overall network functionality 604 may be the same as or similar to that described above in connection with Figure 6A (e.g., LAN, WAN, Internet, etc.), although in this example setup, the separate, independent server system 606 is omitted. Rather, in the setup of Figure 6B, at least one of the two computing devices 600, 602 (and optionally both computing devices 600, 602) includes software for driving data exchange communications and generating and controlling user interfaces.
[0057] If desired, networked communication between users exchanging data may include functionality that allows users to communicate with each other about target images. Alternatively, as shown in FIG. 6B, a separate user communication link 608 is illustrated. In addition to various computer-to-computer communication links known and used in the art to provide live, real-time communication between two (or more) computers, communication channel connection 608 may further include other types of communication channels between computers or users, such as instant messaging channels, peer-to-peer messaging channels, traditional telephone connections, etc. If desired, as another alternative, users may be located in close proximity to each other and be able to communicate directly in face-to-face conversation without the need for a separate communication channel 608. Communication channel 608 may use the same or different hardware as that used for target image data exchange.
[0058] Additionally, collaboration between users to display and capture target images may occur, in at least some systems and methods according to the present disclosure, via direct communication between computing devices in a peer-to-peer manner, as illustrated in FIG. 6C . Any desired hardware and / or protocols for this type of peer-to-peer communication may be used without departing from this disclosure, including conventional hardware and protocols known and used in computer communications. Also, similar to the examples of FIGS. 6A and 6B discussed above, a separate user communication channel connection 608 may be provided (e.g., for instant messaging, additional peer-to-peer messaging, a traditional telephone connection (potentially using different hardware than that involved in inputting or capturing target image data), etc.). Various other alternatives discussed above with respect to FIGS. 6A and 6B may also be used in the setup of FIG. 6C without departing from this disclosure.
[0059] 8-9 illustrate example embodiments of a method for capturing a target image using an augmented reality program and implementing a predetermined output, such as unlocking access to purchase a consumer product, upon verifying that the captured image is the target image. The steps illustrated in such example flowcharts may be performed by a single computing device, such as a processor included in the first mobile device 705 or the second mobile device 706. Alternatively, execution of the steps may occur through only one of the first mobile device or the second mobile device or in combination with the system database 707. In some aspects, the steps will be performed sequentially, while in other aspects, the steps may be performed in a different order or simultaneously. For example, in some embodiments, capture may be performed by any user device capturing information communicated to the system database, which then determines whether the captured information is recognized as a target image and responds with instructions to the user device. However, in other embodiments, the system database may communicate the target image information and instructions to the mobile device before the user device captures the image. Thus, the capturing of the target image, the recognition of the target image, and the execution of the command may all be performed on either user device 705 or 706 .
[0060] FIG. 7 illustrates an example system for implementing the present disclosure. As shown in FIG. 7, two user devices may include a user interface and a capture device. The user interface may include both a display and an input mechanism, where the input mechanism may be a button, a touchscreen, or other method of inputting information. The image capture devices 702 and 704 may include one or more video cameras. The image capture devices may be configured to capture or record images or videos, including recording or capturing the user interface displays 701 and 703 of the other users' devices. The user devices may be connected to a system database through a network, which analyzes the captured images or videos to determine whether a target image is recognized and can send further instructions to the user devices if recognition of the target image is confirmed.
[0061] FIG. 8 illustrates an example flowchart of steps that certain embodiments may take. First, in step 801, an image may be shared through an online platform. In some aspects, this online platform may be a social media platform such as Instagram®, Twitter®, Facebook®, Google+®, or any other social media platform. The image may include target information to be recognized by the capture device. The image may be shared by a first user through their social media account. As a next step, in 802, the image may be displayed on the first device. This may include via a social media account of a second user. In some aspects, the first user may share the image through the online platform, and the second user may view the image using the same social media platform or through a different social media platform.
[0062] In a next step 803, the second device may capture an image and determine whether it recognizes the image. In some embodiments, the second device may take a still image or record a video of the image using a camera. Upon capturing the image, the second device may communicate with a database to determine whether it recognizes the image as a target. If the device confirms recognition of the target image, in step 804, the device may receive instructions upon recognizing the image. The instructions may include unlocking access to enable a user of the second device to purchase a consumer product. In some embodiments, step 805 may include altering the display of the second device based on the instructions. This may include overlaying the consumer product on the display or altering the display by, for example, presenting a message or video to the consumer, altering the recognized and / or captured image, etc.
[0063] FIG. 9 illustrates an example flowchart showing steps that certain embodiments may take. First, in step 901, an image may be displayed on a first device. In some aspects, this display may occur through an online platform, such as Instagram®, Twitter®, Facebook®, Google+®, or any other social media platform. The image may include target information that is to be recognized by the capture device. The image may be shared by the first user through their social media account. In step 902, an image may then be captured using a second device, including by the second device's camera or image capture device. The second device may then recognize the target image in step 903. This may include communicating with a database to determine whether the database recognizes the image as a target. Once the target image is recognized, in step 904, the second device may communicate with a system or database over a network. For example, the second device may send one or more messages over the network, indicating that the second device has identified the image as a target image. In step 905, the second device may receive instructions from the system or database to grant the user access to purchase the consumer product. Upon receiving such instructions, in step 906, the second device may overlay an image of the consumer product over the display image. The second device may output for display the image of the consumer product overlaid over the display image. The overlay may be one-dimensional, two-dimensional, and / or three-dimensional. For example, the device may overlay a three-dimensional projected representation of the consumer product to be unlocked. In this regard, an image may be overlaid on a recognized target such that as the user moves the camera around, the projected representation will also move, allowing the user to view different angles of the product.In a final step 907, the device may grant the user access to purchase the unlocked consumer product.
[0064] FIG. 10 illustrates another flowchart showing an example of performing steps disclosed in this disclosure, including a display associated with a mobile device. In step 1001, a software application may be displayed on a computing device. The computing device may be a mobile device, such as a cellular device. The mobile application may include a camera application. The mobile application may include one or more user interfaces, each of which may display one or more images. In step 1002, a user of the computing device may be consuming content from one or more sources. For example, the content may be generated by and displayed within a software application. In another example, the content may be from an internet website, such as a restaurant's internet website. In another example, the content may be from an online social media platform. In another example, the content may be sourced from an image capture application running on the computing device. In step 1003, a user may access the image capture application of the computing device. In step 1004, the user may utilize the image capture application to capture a still or video image. In step 1005, the computing device may determine that the captured image is a target image. 8 and 9, validating the captured image as the target image may include communicating with a database. Further, in step 1005, the software application may generate a modified display within the software application's user interface in response to determining that the captured image is the target image. For example, the mobile application may overlay an image of a consumer product over the captured image.The computing device may then display an image of the consumer product overlaid on the captured image. The overlay may be one-dimensional, two-dimensional, or three-dimensional. For example, a three-dimensional image of the consumer product may be overlaid on the captured image. The resulting image may then be displayed within a software application. Alternatively, the resulting image may be displayed by a special augmented reality software application running on the computing device.
[0065] Once the resultant image is displayed (by a special augmented reality software application or software application), the user may unlock the consumer product. In one example, the user may unlock the consumer product by interacting with one or more of the software application, the user interface, and the resultant image. Interaction may include viewing the image, sharing the image, saving the image, etc. If the user successfully unlocks the consumer product, in step 1007, a modified graphical user interface may be output for display. The modified graphical user interface may notify the user that the consumer product has been successfully unlocked. The modified graphical user interface may include one or more graphic buttons that, when selected by the user, allow the user to purchase the consumer product.
[0066] In certain cases, the number of times the consumer product can be unlocked may be limited. If the limit has already been reached, a modified graphical user interface may be output for display in step 1006. Here, the modified graphical user interface may indicate that the user was unable to successfully unlock the consumer product.
[0067] In response to viewing the modified graphical user interface output in step 1007, the user may select to purchase the unlocked consumer product. In step 1008, one or more graphical screens may be generated providing user permission to purchase the consumer product. In step 1009, the user may complete the purchase of the unlocked consumer product.
[0068] In some embodiments of the present disclosure, a first individual may share an image through a platform, where a second individual may view the image on a mobile device. In some embodiments, the platform may be a social media platform. By viewing the image on the display of the mobile device, the second individual may share the image with a third individual. The third individual may then use an image capture device to capture the image as it appears on the second individual's mobile device. Upon recognizing the captured image, the third individual's device may grant the third individual access to purchase the consumer product.
[0069] In some aspects, a user may use a mobile device to capture an image, such as through a camera or other image capture means. In some aspects, the image may be a still image, or the device may be configured to capture video. In particular embodiments, a user may use a mobile device to capture an image of the surrounding environment. The mobile device may also have a user interface that includes a display. In some aspects, the user interface and the camera may be configured to simultaneously display what the camera is recording on the user interface.
[0070] In some embodiments, the mobile device may include an augmented reality program. In these embodiments, a user may capture an image of an environment using a camera on the mobile device. The captured image may be simultaneously output on a user interface display. In some aspects, the mobile device may be configured to recognize a target image once captured by the mobile device camera. Once such a target image is recognized, the mobile device may communicate with a system database over a network to confirm recognition of the target image. The device may then receive instructions from the system database once the target image is confirmed.
[0071] In different embodiments, the instructions may instruct the mobile device, through an augmented reality program, to overlay a three-dimensional projection onto a target image displayed on the user interface. In certain aspects, the projection may be a consumer product. The projection may represent a consumer product available for purchase by the user. In some aspects, the user interface may allow the user to interact with the projected product. This interaction may include user input, such as a button, or the user interface may be a touchscreen that allows the user to click on the projected product by touching it. After interacting with the projected product, the mobile device may grant the user access to purchase the projected product.
[0072] In some examples, the system may present other results upon capturing and recognizing a target image. For example, in some aspects, a user may capture an image through a camera, and after recognizing that the image includes a target, the mobile device may modify the output display in response to recognizing the target image. As an example, the display may continue to output what was captured by the camera, but may modify the output display based on the recognition of additional targets. In some aspects, the device may recognize a product type, brand logo, quantity, design, text, or any other target and replace that target on the output display. As an example, a user may be in a store and use a camera to capture the store's interior. The mobile device may be configured to recognize a particular logo on a product and then output the image captured by the camera on the display, but replace the recognized logo on the display with an image or message for the user.
[0073] In certain embodiments, a user may share an image through a social media platform. An individual may then view the image on social media through the display of their mobile device. The individual viewing the image may share the image with a friend, who may view the image through an image capture device with augmented reality capabilities. Upon recognizing the image, software may display a three-dimensional representation of the consumer product overlaid on the image. This would indicate that the user capturing the image has been granted access to purchase the displayed consumer product. In this embodiment, the user may then choose to search for the image on their social media account and share it with a friend, who may then capture the image using a mobile device with augmented reality capabilities and similarly gain access to purchase the product.
[0074] In some embodiments, a first individual may share an image through social media, where the image includes targeting information that unlocks access to purchase the consumer product. A second individual may view the image on a mobile device with a display. A third individual may capture the image on a mobile device with image capture capabilities, where, through capturing the image, the device recognizes the image and unlocks access to purchase the consumer product for the third individual. In some embodiments, the system may recognize that the image was shared and / or captured from another mobile device. In these embodiments, access may be limited to capturing from another individual's phone or from a specific social media application. The number of users granted access to a product may be limited so that only a certain number of users are granted access before the product sells out. The system may limit the number of times an image can be shared and still unlock access to the product.
[0075] In some embodiments, the target image can be shared through social media. Individuals can view the target image through their social media accounts. Individuals who view the target image can share it with friends, who can then capture the image using a camera on their mobile device. The camera can recognize the target image through an augmented reality program and, upon recognizing the target image, can receive instructions from a system database. These instructions can include overlaying a projection of the consumer product on a user interface on the user's device and unlocking access for the user to purchase the consumer product.
[0076] In some embodiments, the camera may only recognize the target image when it is displayed on the screen of another device. In such embodiments, access to the consumer product is not unlocked unless the target image is captured from another user's screen. In these examples, individuals are prompted to share target images with each other. One user may display the target image on their mobile device, allowing another user to capture the image and unlock the consumer product. A second user may open the target image on their mobile device, allowing the first user to capture and unlock the consumer product.
[0077] In an example embodiment, a user's computing device (which may be mobile, fixed, and / or commercially or privately installed) may include one or more non-transitory computer-readable media that, when executed by a processor, causes the device to capture an image of a second mobile device and, upon capturing the image, recognizes the image as instructions. The mobile device may then communicate with an external system over a network. Upon verifying the captured image, the system may unlock the mobile device access to purchase consumer products.
[0078] Providing access to consumer products through augmented reality encourages users to share images and search for targets within nearly any image. For example, if a user knows that a particular influencer, such as a famous athlete, has released or endorsed a product, the user can scan the athlete's social media account to see if any images shared by the athlete have targets that unlock access to purchase the product. In different aspects, this could be footwear, jerseys, clothing, sports equipment, or any other consumer product. Users are also encouraged to share images with their friends in the hopes that they can find and capture the target image using their mobile devices, such as smartphones.
[0079] In some embodiments, a product launch may be rolled out through social media. In these aspects, the product may be announced, but there is no announcement of when the product will be released. Rather, an image containing target information that will unlock access to purchase the product may be given to an influencer, such as an athlete, chef, social media personality, businessman, celebrity, etc. An augmented reality program may then be configured to recognize the target image when the target image is captured using a mobile device. The influencer may then share the product on social media. In some aspects, the influencer may not announce that the image contains target data. Rather, consumers are prompted to use the augmented reality program to view images and find images with the target information. After discovering that the image contains target information that unlocks access to a new product or that will perform some other function, the user is prompted to share the image with their friends, such as through social media. In these aspects, the image will be shared organically through word of mouth as individuals discover that the image has the unlock function and share the image.
[0080] In some embodiments, the augmented reality programs will be utilized to work with mobile devices, including smartphones such as Apple's iPhone® or Android® phones, tablets, laptops, computers, gaming systems, music players, e-readers, or any other mobile electronic device capable of capturing images.
[0081] In certain embodiments, the target image may be a tangible item. By way of example, the target image may be a restaurant menu. The augmented reality program may then be configured to recognize when a restaurant menu is captured by the mobile device and unlock access to purchase the consumer product. In some embodiments, the mobile device may overlay a projected image on the display while capturing the target image. As shown in FIGS. 11 and 12, this projected image may be a pair of shoes that the user is to unlock for purchase. Upon discovering that a tangible item is the target image recognized by the augmented reality program, the user may capture an image of the tangible item and share it with friends and the like through a social media platform. Other users who view the image may then use the augmented reality program on their mobile device to capture the image and unlock access to purchase the consumer item, or may receive any other output the mobile device is configured to perform upon capturing and recognizing the target image.
[0082] Upon discovering a target image through such functionality, the user is prompted to share the target image. For example, if the target image is a restaurant menu with limited locations, a consumer who does not visit one of the restaurant locations would not be able to capture the menu using the augmented reality program. Thus, the consumer would otherwise be denied access to purchase a consumer product that would be unlocked through capturing that menu. However, by prompting the user to share the target image, the user may unlock access to such a product without seeing the tangible item that is the target image in the real world.
[0083] Certain embodiments may also include features that prompt users to share the target image with their friends through social media. For example, a user may be granted additional access to a particular product based on sharing the target image multiple times or having other individuals capture the target image they shared. As another example, a user may be granted a sales offer, store credit, consumer product, reward points, or social media rewards.
[0084] In some aspects, the user interface on the mobile device may include user input options. Once the target image is captured and recognized by the augmented reality program, the user interface display may prompt the user to provide input to unlock the product. In some aspects, after unlocking the product, the mobile device may connect to an online store whereby the user may purchase the unlocked product.
[0085] In different embodiments, after unlocking and purchasing a product, the user may be prompted to share information about their purchase, such as through social media. In some examples, this may be a predetermined message indicating which product the user purchased and / or where the user found the target image. By sharing this information, the user may instruct other users to locate the target image. In the restaurant menu example, the user's message may be that they purchased the product they unlocked through capturing the target image, which was a menu, and other users interested in unlocking and purchasing the product may be prompted to visit the restaurant or view the menu online or through other means, such as social media. In different examples, the user's message about the product purchase may be shared through social media, such as Instagram®, Twitter®, Facebook®, Google+®, or any other social media platform.
[0086] Further aspects of the present disclosure may include communication between personal devices and back to a system database. Upon unlocking access to a consumer product and / or confirming the purchase of that product, the mobile device may communicate information to other mobile devices or to a system database. In some aspects, this information may include demographic information about the user, information about the purchase such as size, color, the user's geographic location, or any other information related to the user or purchase. This information may be shared with the product seller, who may maintain an information database containing information about the product and users who have successfully unlocked and purchased the product through the augmented reality program.
[0087] Aspects discussed in this disclosure facilitate collaboration between merchants and influencers. Influencers can be athletes, chefs, social media personalities, businesspeople, celebrities, and the like who are looking to expand their personal brands through social media and the like. Thus, influencers known for releasing targeted images that unlock in-demand products will increase social interaction with their followers as well as fans and the public. Relatedly, merchants can more systematically promote their products, messages, and awareness through influencers releasing targeted images.
Claims
1. 1. A method comprising: determining that the geographic location of the user's mobile device is not located within a search area and that the geographic location of the mobile device is located within a participation area; the search area and the participation area are distinct geographic areas; searching, by the mobile device, for a first target that provides information about a plurality of primary users located within the search area and is located at a first target position within the search area; receiving, by the mobile device, a user selection of a first primary user from the plurality of primary users; providing, by the mobile device, to the user, information about the first primary user; providing a reward to the first primary user after the first primary user reaches the first target location; the reward comprises access to purchase a tangible consumer product or a voucher to purchase the tangible consumer product; A method comprising:
2. The tangible consumer product is a clothing product. The method of claim 1.
3. The method further comprises: receiving, by the mobile device, user input for providing assistance to the first primary user in searching for the first target; The method of claim 1 , comprising:
4. The method further comprises: displaying, by the mobile device, an image captured by a first primary user device of the first primary user while searching for the first target; The method of claim 1 , comprising:
5. The method further comprises: providing, by the mobile device, information regarding a plurality of targets, including the first target, located at a plurality of different target locations within the search area; receiving, by the mobile device, a user selection of the first target from the plurality of targets; providing, by the mobile device, information regarding a plurality of primary users, including the first primary user, who are searching for the first target; receiving, by the mobile device, a user selection of the first primary user from the plurality of primary users; The method of claim 1 , comprising:
6. a limited inventory of the tangible consumer product is associated with each of the plurality of targets; and the information about the plurality of targets includes information indicating an amount of the limited inventory available for each of the plurality of targets; The method of claim 5.
7. the information about the plurality of primary users includes information indicating a proximity of each of the primary users to the first target; The method of claim 6.
8. The method further comprises: receiving, at the mobile device, an indication that the limited inventory has been depleted for all of the plurality of targets; providing the reward to the user after all of the limited inventory has been consumed for all of the plurality of targets; The method of claim 7, comprising:
9. 1. An apparatus comprising: one or more processors; and a memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to: determining that the user's geographic location is not located within a search region and that the user's geographic location is located within a participation region; the search area and the participation area are distinct geographic areas; providing information about a plurality of primary users located within the search area and searching for a first target located at a first target position within the search area; receiving a user selection from the plurality of primary users, the selection being associated with a first primary user; providing the user with information about the first primary user; providing a reward to the first primary user after the first primary user reaches the first target location; the reward comprises access to purchase a tangible consumer product or a voucher to purchase the tangible consumer product; An apparatus for carrying out the above.
10. The tangible consumer product is a clothing product.
10. The apparatus of claim 9.
11. The instructions, when executed by the one or more processors, further cause the apparatus to: receiving user input for providing support to the first primary user in searching for the first target; The apparatus of claim 9 ,
12. The instructions, when executed by the one or more processors, further cause the apparatus to: displaying an image captured by a first primary user device of the first primary user while searching for the first target; The apparatus of claim 9 ,
13. The instructions, when executed by the one or more processors, further cause the apparatus to: providing information about a plurality of targets, including the first target, located at a plurality of different target locations within the search area; receiving a user selection of the first target from the plurality of targets; providing information about a plurality of primary users, including the first primary user, who are searching for the first target; receiving a user selection from the plurality of primary users, the selection being associated with the first primary user; The apparatus of claim 9 ,
14. a limited inventory of the tangible consumer product is associated with each of the plurality of targets; and the information about the plurality of targets includes information indicating an amount of the limited inventory available for each of the plurality of targets; The apparatus of claim 13 , wherein the
15. the information about the plurality of primary users includes information indicating a proximity of each of the primary users to the first target; 15. The apparatus of claim 14.
16. The instructions, when executed by the one or more processors, further cause the apparatus to: receiving an indication that the limited inventory has been depleted for all of the plurality of targets; providing the reward to the user after all of the limited inventory has been consumed for all of the plurality of targets; The apparatus of claim 15 ,