Apparatus, system and method for target search and for using geocaching - Patents.com
By employing augmented reality to recognize target images on mobile devices, the system addresses the limitations of traditional consumer good purchasing methods, enhancing access and engagement for users.
Patent Information
- Application Number
- JP2023085097
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-09-12
- Filing Date
- 2023-05-24
- Publication Date
- 2025-04-30
- Estimated Expiration
- 2038-09-11
AI Technical Summary
Existing systems for purchasing consumer goods, such as footwear and clothing, often require consumers to wait in long lines or meet specific requirements, leading to competition and limited access for many.
The use of augmented reality features on mobile devices to unlock selective access to purchase consumer goods by recognizing target images, which can be shared through social media platforms, allowing users to capture and view images to gain access to products.
This approach encourages users to share images and collaborate in finding target images, increasing access to consumer goods and reducing competition, while also providing a unique and engaging shopping experience.
Smart Images

Figure 0007670369000001 
Figure 0007670369000002 
Figure 0007670369000003
Abstract
Description
[Technical field]
[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application is a nonprovisional application claiming priority to U.S. Provisional Application No. 62 / 557,565, filed September 12, 2017, and U.S. Provisional Application No. 62 / 557,102, filed September 11, 2017, both of which are incorporated herein by reference in their entireties.
[0002] (Technical field) The present disclosure relates to devices, systems, methods, and computer-generated user interfaces that use augmented reality features to unlock selective access to purchase consumer goods, such as items of footwear, apparel, athletic equipment, or any other type of consumer goods. [Background technology]
[0003] In recent years, electronic computing devices and their capabilities have undergone significant advances, including advances in augmented reality. Augmented reality may include image recognition devices capable of receiving commands and inputs through perception of captured images. The present disclosure provides an apparatus and system for unlocking selective access to purchase consumer goods through augmented reality features. Although there are systems that provide limited releases of consumer goods or selectively unlock access to purchase consumer goods, such systems typically require consumers to be ready at the release time by waiting in line for long periods or meeting requirements to be able to purchase the desired product. Such systems encourage competition among consumers to gain access, limiting the number of consumers willing to pursue this access.
[0004] As social media continues to grow, the influence of individuals with large social media connections expands. Certain individuals have large numbers of followers and have a significant influence on the activities of their followers. The endorsement of a particular brand or product by such individuals can significantly increase the popularity and demand for that brand or product. Relatedly, individuals seeking to expand awareness and increase their personal brand often do so by increasing their social media presence. The aspects discussed herein relate to consenting to a particular influential individual sharing an image through a social media account. A first user can then use a mobile device to view the image on social media. While displayed on the first user's mobile device, a second user can use another mobile device to capture the image displayed on the first user's mobile device. Upon perceiving the image, the second user's mobile device can unlock the second user's selective access to purchase consumer goods or otherwise consent to a desired output. Summary of the Invention [Problem to be solved by the invention]
[0005] The present disclosure is directed to systems and methods that overcome one or more of the above-referenced deficiencies and other deficiencies in the art. [Means for solving the problem]
[0006] The following is a simplified summary to provide a basic understanding of some aspects of the disclosure. This summary is not an extensive overview of the disclosure. It is not intended to identify key or critical elements of the disclosure or to delineate the scope of the disclosure. The following summary merely presents some concepts of the disclosure in a simplified form as a prelude to the description that follows.
[0007] Various aspects of the present disclosure relate to systems and methods for unlocking selective access to purchase consumer goods through augmented reality. In certain embodiments, a user's mobile device may capture an image using augmented reality and recognize a target in the image. Upon recognizing the target in the image, the device may overlay a three-dimensional model of the consumer good and unlock the user access to purchase the displayed consumer good. In some embodiments, the image may be recognized from a second user's mobile device. As an example, a user may find an image on social media and display the image to a friend. The friend may then capture an image using a mobile device, and upon recognizing the image as a predefined target, the device may communicate with the system and unlock access to purchase the consumer good for the user. Through such features, consumers are prompted to share images and view the shared image through augmented reality software to determine if the image is a target image that unlocks access for the consumer good or other desired result. In certain embodiments, a user may only determine if an image contains a target by viewing the image through a specific program. Thus, users are prompted to share images and view the images through the augmented reality program to determine if the image is a target image recognized by the program. Furthermore, in some aspects, the program may only recognize targets when capturing an image displayed on another user's device, such that each user may only access the consumer product by capturing an image from the other user's device. In certain embodiments, individuals may be given the first opportunity to share images through online platforms such as social media. Each individual who views the image through the augmented reality software may be granted access to purchase the product.
[0008] Aspects of the disclosure also relate to a method that includes determining whether a geographic location of a user's mobile device is located within a search area, providing information about a plurality of targets located at a plurality of different target locations within the search area, receiving a user selection of a first target from among the plurality of targets located at the first target location, monitoring the geographic location of the mobile device, providing information to the user to assist the user in locating the first target, and providing a reward to the user after the mobile device reaches the first target location. The reward may include access to purchase a tangible consumer good or a voucher to purchase a product. The tangible consumer good may be an article of clothing, such as footwear. At least some of such actions may be performed by the mobile device, and in one embodiment, the geographic location is determined and monitored by the mobile device in conjunction with an external device.
[0009] According to one aspect, the mobile device also receives user input to activate the first target when the mobile device reaches the location of the first target. The user input may include capturing an image (using a camera) of a physical object proximate to the location of the first target.
[0010] According to another aspect, the targets are virtual objects, and when the mobile device reaches the location of the first target, the device displays an image captured by the camera and modifies the image to include a representation of the virtual object.
[0011] According to a further aspect, a limited stock of the tangible consumer good may be associated with each of the multiple targets, and the information regarding the multiple targets includes information indicating a quantity of the limited stock available for each of the multiple targets.
[0012] A further aspect of the disclosure relates to a method including: determining that a geographic location of a user's mobile device is not located within a search area; determining that the geographic location of the mobile device is located within a separate participating area; providing information about a plurality of primary users that are located within the search area and searching for a first target located at a location of the first target within the search area; receiving a user selection of a first primary user from among the plurality of primary users; providing information about the first primary user to the user; and providing a reward to the user after the first primary user reaches the location of the first target. The reward may include access to purchase a tangible consumer good or a voucher to purchase a tangible consumer good. The tangible consumer good may be an article of clothing such as footwear. At least some of such actions may be performed by the mobile device, and in one embodiment, the geographic location is determined by the mobile device in conjunction with an external device.
[0013] According to one aspect, the method also includes receiving user input to provide assistance to the first primary user in searching for the first target.
[0014] According to another aspect, the method also includes displaying an image captured by the first primary user device of the first primary user while searching for the first target.
[0015] According to a further aspect, the method also includes providing information about a plurality of targets, including the first target, located at a location of a plurality of different targets within the search area; receiving a user selection of the first target from among the plurality of targets; providing information about a plurality of primary users, including the first primary user, searching for the first target; and receiving a user selection of the first primary user from among the plurality of primary users. In one configuration, a limited stock of a tangible consumer good is associated with each of the plurality of targets, and the information about the plurality of targets includes information indicating an amount of limited stock available for each of the plurality of targets. In this configuration, the method may also include receiving an indication that the limited stock for all of the plurality of targets is sold out, and providing a reward to the user after all of the limited stock for all of the plurality of targets is sold out. In another configuration, the information about the plurality of primary users includes information indicating a proximity of each of the primary users to the first target.
[0016] The method may further provide for use as an observer when the location of the mobile device is not located in the search area or the participation area. The observing user may be provided with information about targets located at different target locations in the search area and information about primary users searching for one or more targets. The observing user may further be provided with search results.
[0017] Other aspects of the disclosure relate to an apparatus, such as a mobile device, server, or other computing device, that includes one or more processors and memory that stores computer-readable instructions that, when executed by the one or more processors, cause the apparatus to perform (or assist in performing) some or all of any of the methods described herein.
[0018] Although described above in connection with providing access to purchase consumer goods, aspects of the present disclosure may also be implemented in conjunction with other features or functions upon recognizing a target in an image. In some embodiments, an augmented reality program may alter the display of the device upon recognizing a target in an image. Particular features may include altering the display to play a video, overlaying a three-dimensional image, changing the view of the capture device, such as by modifying certain aspects of the image captured by the image capture device. Indeed, the scope of application of the present disclosure is not limited to unlocking access to purchasing consumer goods. [Brief description of the drawings]
[0019] [Figure 1] 1 illustrates an example system that may be configured to provide personal training and / or obtain data from a user's physical movements according to an example embodiment. [Diagram 2] 2 illustrates an example computing device that may be part of or in communication with the system of FIG. 1. [Diagram 3] 1 illustrates an exemplary sensor assembly that may be worn by a user, according to an exemplary embodiment. [Figure 4] 1 illustrates another exemplary sensor assembly that may be worn by a user, according to an exemplary embodiment. [Diagram 5] 13 illustrates example locations of sensory input that may include physical sensors located on / in the user's clothing and / or may be based on identifying a relationship between two moving body parts of the user. [Figure 6A] Various examples of overall hardware and network systems that may be used to implement various examples of the present disclosure are illustrated. [Figure 6B] Various examples of overall hardware and network systems that may be used to implement various examples of the present disclosure are illustrated. [Figure 6C]Various examples of overall hardware and network systems that may be used to implement various examples of the present disclosure are illustrated. [Figure 7] An example of a hardware and network system that may be used to implement various examples of the present disclosure is illustrated. [Figure 8] 1 illustrates a flowchart showing example implementation steps discussed in this disclosure. [Figure 9] 3 illustrates another flowchart showing example implementation steps discussed in this disclosure. [Figure 10] 1 illustrates another flowchart showing example implementation steps disclosed in the present disclosure involving a display associated with a mobile device. [Figure 11A] 1 illustrates another flowchart showing example implementation steps disclosed in the present disclosure involving a display associated with a mobile device. [Figure 11B] 1 illustrates another flowchart showing example implementation steps disclosed in the present disclosure involving a display associated with a mobile device. [Figure 12A] 1 illustrates an example of a display that may be utilized by an augmented reality program. [Figure 12B] 1 illustrates an example of a display that may be utilized by an augmented reality program. [Figure 13] 1 illustrates an example system for team-based virtual search using augmented reality in accordance with an example embodiment. [Figure 14] 14 illustrates a method of virtual search using augmented reality using the system of FIG. 13 according to an example embodiment. [Figure 15] 14 illustrates a method of virtual search using augmented reality using the system of FIG. 13 from the perspective of a primary user device according to an exemplary embodiment. [Figure 16] 14 illustrates a method of virtual search using augmented reality using the system of FIG. 13 from the perspective of a secondary user device according to an example embodiment. [Figure 17A]14 illustrates a method of virtual search using augmented reality using the system of FIG. 13 from the perspective of a device such as a server according to an example embodiment. [Figure 17B] 14 illustrates a method of virtual search using augmented reality using the system of FIG. 13 from the perspective of a device such as a server according to an example embodiment. [Figure 18A] 1 illustrates an example interface and progression of user selections from a primary device in a method of virtual search using augmented reality according to an example embodiment. [Figure 18B] 1 illustrates an example interface and progression of user selections from a primary device in a method of virtual search using augmented reality according to an example embodiment. [Figure 18C] 1 illustrates an example interface and progression of user selections from a primary device in a method of virtual search using augmented reality according to an example embodiment. [Figure 19A] 1 illustrates an example interface and progression of user selections from a secondary device in a method of virtual search using augmented reality according to an example embodiment. [Figure 19B] 1 illustrates an example interface and progression of user selections from a secondary device in a method of virtual search using augmented reality according to an example embodiment. [Figure 20] 1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Figure 21] 1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Figure 22] 1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Diagram 23] 1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Figure 24] 1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Diagram 25]1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Figure 26] 1 illustrates a virtual depiction of a city in a system and method for virtual search according to an example embodiment; [Figure 27] 1 illustrates the completion of a puzzle by one or more users in a virtual search system and method according to an example embodiment; [Figure 28] 1 illustrates an arrangement that may appear from a single viewpoint in a system and method for virtual search in accordance with an example embodiment; [Figure 29] 1 illustrates an arrangement that may appear from a single viewpoint in a system and method for virtual search in accordance with an example embodiment; [Diagram 30] 1 illustrates an arrangement that may appear from a single viewpoint in a system and method for virtual search in accordance with an example embodiment; [Diagram 31] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 32] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 33] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 34] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 35] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Figure 35A] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 36] 1 illustrates an example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Figure 37] 1 illustrates another example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Figure 38] 1 illustrates another example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Figure 39] 1 illustrates another example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 40] 1 illustrates another example embodiment of a method for virtual search that may use augmented reality in accordance with an example embodiment. [Diagram 41] 31-36 illustrate an example system for virtual search according to an example embodiment that may be used in conjunction with the methods of FIGS. [Diagram 42] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Diagram 43] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Diagram 44] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Diagram 45] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Diagram 46] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Figure 47] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Figure 48] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Figure 49] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Figure 50] 37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Figure 51]37 illustrates example display screens that may be provided on a mobile device in connection with the methods of FIGS. 31-36. [Figure 52] 1 illustrates a flowchart showing example implementation steps discussed in this disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0020] Aspects of the present disclosure relate to searching for targets in physical and / or geographic space and providing rewards based on locating and / or activating the targets, which may be virtual targets or physical tangible targets. Some aspects include using augmented reality features to unlock selective access to purchase consumer goods, such as footwear, clothing, athletic equipment, or any other type of consumer goods. The augmented reality features may be given instructions to execute upon perceiving the target image. In some aspects, the target image may be shared through a platform, such as a social media platform. A user may use the augmented reality features to search for an image that is a target image that unlocks access to purchase the consumer goods. Further aspects relate to using the augmented reality features to generate an output, such as, for example, changing an output display of a mobile device based on the perception of the target image. Still further aspects relate to using information, such as location information and user information, to promote engagement and / or collaboration between users in the search and rewards, as well as user observation in such searches. Such aspects and other aspects will be discussed in the context of the following illustrative examples of augmented reality programs and systems for implementing.
[0021] In the following description of various embodiments, reference is made to the accompanying drawings, which form a part of this specification, in which are shown, by way of illustration, various embodiments in which aspects of the present disclosure may be practiced. It is to be understood that other embodiments may be utilized and that structural and functional modifications may be made without departing from the scope and spirit of the present disclosure. Additionally, headings within this disclosure should not be construed as limiting aspects of the present disclosure, and illustrated embodiments are not limited to the examples in the headings. I. Exemplary Personal Training System A. Exemplary Network
[0022] Aspects of the present disclosure relate to systems and methods that may be utilized across multiple networks. In this regard, certain embodiments may be configured to accommodate dynamic network environments. Further embodiments are capable of functioning in different and separate network environments. FIG. 1 illustrates an example of a personal training system 100 in accordance with an example embodiment. The example system 100 may include one or more interconnected networks, such as an example body area network (BAN) 102, a local area network (LAN) 104, and a wide area network (WAN) 106. As shown in FIG. 1 (and as described throughout the description of this disclosure), one or more networks (e.g., BAN 102, LAN 104, and / or WAN 106) may overlap or contain each other. Those skilled in the art will appreciate that the example networks 102-106 are logical networks, each of which may include one or more different communication protocols and / or network architectures, and may be configured to have gateways to each other or to other networks. For example, each of the BAN 102, LAN 104, and / or WAN 106 may be operatively connected to the same physical network architecture, such as the cellular network architecture 108 and / or the WAN architecture 110. For example, a portable electronic device 112, which may be considered a component of both the BAN 102 and the LAN 104, may include a network adapter or network interface card (NIC) configured to convert data and control signals into network messages and vice versa through one or more of the architectures 108 and / or 110 in accordance with one or more communication protocols, such as the Transmission Control Protocol (TCP), Internet Protocol (IP), and User Datagram Protocol (UDP). Such protocols are well known to those skilled in the art and therefore will not be discussed in greater detail herein.
[0023] Network architectures 108 and 110 may include one or more information distribution network(s) having any type(s) or topology(s), such as, for example, cable, fiber, satellite, telephone, cellular, wireless, etc., alone or in combination, and thus may be variously configured to have one or more wired or wireless communication channels (including, but not limited to, WiFi, Bluetooth, Near Field Communication (NFC) and / or ANT technologies). Thus, any device in the network of FIG. 1 (such as the portable electronic device 112, or any other device described herein) may be considered to encompass one or more of the different logical networks 102-106. With this in mind, exemplary components of an exemplary BAN and LAN (which may be coupled to WAN 106) will be described. 1. Example Local Area Network
[0024] The LAN 104 may include one or more electronic devices, such as, for example, a computing device 114. The computing device 114 or any other component of the system 100 may include a mobile terminal, such as a phone, a music player, a tablet, a netbook, or any mobile device. In other embodiments, the computing device 114 may include a media player or recorder, a desktop computer, a server(s), a gaming console, such as, for example, a Microsoft® XBOX, a Sony® Playstation, and / or a Nintendo® Wii gaming console. Those skilled in the art will appreciate that such are merely exemplary devices for purposes of illustration and that the present disclosure is not limited to any console or computing device.
[0025] Those skilled in the art will appreciate that the design and structure of computing device 114 may vary depending on a number of factors, such as its intended use. One exemplary implementation of computing device 114 is provided in FIG. 2, which illustrates a block diagram of computing device 200. Those skilled in the art will appreciate that the disclosure of FIG. 2 may apply to any device disclosed herein. Device 200 may include one or more processors, such as processors 202-1 and 202-2 (generally referred to herein as “processors 202” or “processor 202”). Processors 202 may communicate with each other or with other components via an interconnection network or bus 204. Processor 202 may include one or more processing cores, such as core 206-1 and core 206-2 (generally referred to herein as “cores 206” or more generally as “core 206”), which may be implemented on a single integrated circuit (IC).
[0026] Core 206 may include a shared cache 208 and / or a dedicated cache (e.g., cache 210-1 and cache 210-2, respectively). One or more caches 208 / 210 may locally cache data stored in a system memory, such as memory 212, for faster access by components of processor 202. Memory 212 may communicate with processor 202 via chipset 216. In some embodiments, cache 208 may be part of system memory 212. Memory 212 may include, but is not limited to, one or more of random access memory (RAM), read-only memory (ROM), solid-state memory, optical or magnetic storage devices, and / or any other media that may be used to store electronic information. However, other embodiments may omit system memory 212.
[0027] System 200 may include one or more I / O devices (e.g., I / O devices 214-1 through 214-3, each generally referred to as an I / O device 214). I / O data from one or more of I / O devices 214 may be stored in one or more caches 208, 210 and / or system memory 212. Each of I / O devices 214 may be configured to functionally communicate with components of system 100, either permanently or temporarily, using any physical or wireless communication protocol.
[0028] Returning to FIG. 1 , four exemplary I / O devices (shown as elements 116-122) are shown in communication with computing device 114. Those skilled in the art will appreciate that one or more of devices 116-122 may be standalone devices or may be associated with other devices other than computing device 114. For example, one or more of I / O devices may be associated with or interact with components of BAN 102 and / or WAN 106. I / O devices 116-122 may include, but are not limited to, athletic data acquisition units, such as, for example, sensors. One or more of I / O devices may be configured to sense, detect, and / or measure athletic parameters from a user, such as user 124. Examples include, but are not limited to: accelerometers, gyroscopes, position determining devices (e.g., GPS), light (including non-visible light) sensors, temperature sensors (including ambient temperature and / or body temperature), sleep pattern sensors, heart rate monitors, image capture sensors, humidity sensors, force sensors, compasses, angular velocity sensors, and / or combinations thereof, among others.
[0029] In further embodiments, the I / O devices 116-122 may be used to provide output (e.g., audible, visual, or tactile cues) and / or receive input, such as user input, from the athlete 124. Examples of such exemplary I / O devices used are provided below, but those of skill in the art will appreciate that such discussion is merely to illustrate some of the many options within the scope of the present disclosure. Additionally, reference to any data acquisition unit, I / O device, or sensor should be construed as disclosing an embodiment that may have one or more I / O devices, data acquisition units, and / or sensors (individually or in combination) disclosed herein or known to those of skill in the art.
[0030] Information from one or more devices (across one or more networks) can be used to provide (or be utilized in the formation of) a variety of different parameters, metrics, or physiological characteristics, including, but not limited to: motion parameters such as speed, acceleration, distance, steps, direction, relative motion of a particular body part or object relative to another; or other motion parameters expressed as angular velocity, linear velocity, or combinations thereof; physiological parameters such as calories, heart rate, sweat detection, effort, oxygen consumption, oxygen reaction rate; and other metrics within one or more of the following categories: pressure; impact force; information about the exerciser, such as height, weight, age, demographic information, and combinations thereof.
[0031] The system 100 may be configured to transmit and / or receive athletic data, including parameters, metrics, or physiological characteristics, collected within the system 100 or provided to the system 100. As an example, the WAN 106 may include a server 111. The server 111 may have one or more components of the system 200 of FIG. 2. In one embodiment, the server 111 includes at least a processor and a memory, such as a processor 206 and a memory 212. The server 111 may be configured to store computer executable instructions on a non-transitory computer readable medium. The instructions may include athletic data, such as raw data or processed data, collected within the system 100. The system 100 may be configured to transmit data, such as energy expenditure points, to a host, such as a social networking website or such site. The server 111 may be utilized to allow one or more users to access and / or compare athletic data. Thus, the server 111 may be configured to transmit and / or receive notifications based on the athletic data or other information.
[0032] Returning to the LAN 104, the computing device 114 is shown in functional communication with the display device 116, the image capture device 118, the sensor 120, and the exercise device 122, which are then discussed below with reference to exemplary embodiments. In one embodiment, the display device 116 may provide audiovisual cues for the exerciser 124 to perform a particular exercise motion. The audiovisual cues may be provided in response to computer executable instructions executed on the computing device 114 or any other device, including devices of the BAN 102 and / or the WAN. The display device 116 may be a touch screen device or may be configured to receive user input.
[0033] In one embodiment, the data may be obtained from other sensors, such as image capture device 118 and / or sensor 120, which may be used alone or in combination with other devices to detect (and / or measure) exercise parameters or stored information, or may be stored information. Image capture device 118 and / or sensor 120 may include a transmitting / receiving device. In one embodiment, sensor 128 may include an infrared (IR), electromagnetic (EM), or acoustic transmitting / receiving portion. For example, image capture device 118 and / or sensor 120 may transmit a waveform into the environment, including toward the exerciser 124, and receive a "reflection" of the emitted waveform or detect a change. Those skilled in the art will readily appreciate that signals corresponding to a number of different data spectra may be utilized in accordance with various embodiments. In this regard, device 118 and / or 120 may detect a waveform emitted from an external source (e.g., not system 100). For example, device 118 and / or 120 may detect heat emitted from user 124 and / or the surrounding environment. Thus, image capture device 126 and / or sensor 128 may include one or more thermal imaging devices. In one embodiment, image capture device 126 and / or sensor 128 may include an IR device configured to perform range phenomenology.
[0034] In one embodiment, the exercise device 122 may be any device configurable to permit or facilitate the exerciser 124 to perform a physical movement, such as, for example, a treadmill, step machine, or the like. The device need not be stationary. In this regard, wireless technology permits the use of portable devices, such that a bicycle or other mobile exercise device may be utilized in accordance with certain embodiments. Those skilled in the art will appreciate that the equipment 122 may be or may include an interface for accepting an electronic device that includes exercise data performed remotely from the computing device 114. For example, the user may use a sports device (described below in connection with the BAN 102) and upon returning home or to the location of the equipment 122, the exercise data may be downloaded to the element 122 or any other system 100 device. Any of the I / O devices disclosed herein may be configured to receive activity data. 2. Body Area Network
[0035] The BAN 102 may include two or more devices (including passive devices) configured to receive, transmit, or otherwise facilitate the collection of athletic data. Exemplary devices may include one or more data acquisition units, sensors, or devices known to those skilled in the art, including but not limited to I / O devices 116-122, or devices disclosed herein. Two or more components of the BAN 102 may communicate directly, although in other embodiments, communication may occur through a third device that may be part of the BAN 102, the LAN 104, and / or the WAN 106. One or more components of the LAN 104 or the WAN 106 may form part of the BAN 102. In certain implementations, whether a device, such as the mobile device 112, is the BAN 102, the LAN 104, and / or the WAN 106 may depend on the proximity of the athlete to access points that permit communication with the mobile cellular network architecture 108 and / or the WAN architecture 110. Additionally, a user's activities and / or preferences may affect whether one or more components are utilized as part of the BAN 102. Exemplary embodiments are provided below.
[0036] A user 124 may be associated with (e.g., possess, carry, wear, and / or interact with) any number of devices, such as a portable device 112, a shoe-mounted device 126, a wrist-worn device 128, and / or a sensing location, such as a sensing location 130, which may include a physical device or location used to collect information. One or more of the devices 112, 126, 128, and / or 130 may not be specifically designed for fitness or athletic purposes. Indeed, although aspects of the present disclosure relate to utilizing data from multiple devices, some devices are not fitness devices that collect, detect, and / or measure athletic data. In certain embodiments, one or more devices of the BAN 102 (or any other network) may include a fitness device or sports device specifically designed for a particular sports application. As used herein, the term "sports device" includes any physical object that may be used during or associated with a particular sports or fitness activity. Exemplary sports devices may include, but are not limited to: golf balls, basketballs, baseballs, soccer balls, footballs, power balls, hockey pucks, weights, bats, clubs, sticks, paddles, mats, and combinations thereof. In further embodiments, exemplary fitness devices may include the environment itself, including objects within the sports environment in which a particular sport is played, such as goal nets, hoops, backboards, portions of the field, e.g., center lines, outer boundary markers, bases, and combinations thereof.
[0037] In this regard, one skilled in the art will appreciate that one or more sports devices may also be part of (or form) the structure, and vice versa, the structure may include or be configured to interact with one or more sports devices. For example, the first structure may include a basketball hoop and backboard, which may be removable and replaced with goal posts. In this regard, the one or more sports devices may include one or more sensors, such as one or more of the sensors described above with respect to Figures 1-3, which may provide information that may be utilized independently or in conjunction with other sensors, such as one or more sensors associated with the one or more structures. For example, the backboard may include a first sensor configured to measure the force and direction of force by a basketball hitting the backboard, and the hoop may include a second sensor for detecting the force. Similarly, a golf club may include a first sensor configured to detect a grip attribute on the shaft and a second sensor configured to measure an impact by a golf ball.
[0038] Turning to an exemplary portable device 112, it may be a multi-purpose electronic device such as a phone or digital music player, including, for example, IPOD®, IPAD®, or iPhone® branded devices available from Apple, Inc. of Cupertino, Calif., or Zune® or Microsoft® Windows devices available from Microsoft of Redmond, Wash. As known to those skilled in the art, a digital media player may act as an output device, an input device, and / or a storage device for a computer. The device 112 may be configured as an input device to receive raw or processed data collected from one or more devices in the BAN 102, LAN 104, or WAN 106. In one or more embodiments, the portable device 112 may include one or more components of the computer device 114. For example, the portable device 112 may include a display 116, an image capture device 118, and / or one or more data acquisition devices, such as any of the I / O devices 116-122 described above, with or without additional components to comprise a mobile terminal. a. Exemplary Apparel / Accessory Sensors
[0039] In certain embodiments, the I / O devices may be formed within or associated with clothing or accessories of the user 124, including watches, armbands, wristbands, necklaces, shirts, shoes, and the like. Such devices may be configured to monitor the athletic movements of the user. It should be understood that such devices may detect athletic movements during interaction between the user 124 and the computing device 114 and / or may operate independently of the computing device 114 (or any other device disclosed herein). For example, one or more devices in the BAN 102 may be configured to function as an all-day activity monitor that measures activity regardless of the user's proximity to or interaction with the computing device 114. Additionally, it should be understood that the sensory system 302 shown in FIG. 3 and the device assembly 400 shown in FIG. 4 (each described in the following paragraphs) are merely illustrative examples. i. Shoe-mounted devices
[0040] In certain embodiments, the device 126 shown in FIG. 1 may comprise footwear that may include one or more sensors, including but not limited to sensors disclosed herein and / or known to those of skill in the art. FIG. 3 illustrates one example embodiment of a sensor system 302 providing one or more sensor assemblies 304. The assembly 304 may include one or more sensors, such as, for example, an accelerometer, a gyroscope, a position determining component, a force sensor, and / or any other sensor disclosed herein or known to those of skill in the art. In the illustrated embodiment, the assembly 304 incorporates multiple sensors, which may include a force sensitive resistor (FSR) sensor 306; however, other sensor(s) may be utilized. A port 308 may be disposed within a sole structure 309 of the shoe and is generally configured for communication with one or more electronic devices. The port 308 may optionally be provided to communicate with an electronic module 310, which may optionally include a housing 311 or other structure to receive the module 310. The sensor system 302 may also include a number of leads 312 connecting the FSR sensor 306 to the port 308 to enable communication with the module 310 and / or another electronic device through the port 308. The module 310 may be contained within a well or cavity within the sole structure of the shoe, and the housing 311 may be disposed within the well or cavity. In one embodiment, at least one gyroscope and at least one accelerometer are provided within a single housing, such as the module 310 and / or the housing 311. In at least a further embodiment, one or more sensors are provided that are configured to provide orientation information and angular velocity data when operational. The port 308 and the module 310 include complementary interfaces 314, 316 for connection and communication.
[0041] In certain embodiments, at least one force-sensitive resistor 306 shown in FIG. 3 may include first and second electrodes or electrical contacts 318, 320, and a force-sensitive resistive material 322 disposed between the electrodes 318, 320 to electrically connect the electrodes 318, 320 together. When pressure is applied to the force-sensitive material 322, the resistivity and / or conductivity of the force-sensitive material 322 changes, which changes the electrical potential between the electrodes 318, 320. The change in resistance may be detected by the sensor system 302 to detect the force applied to the sensor 316. The force-sensitive resistive material 322 may change resistance under pressure in various ways. For example, the force-sensitive material 322 may have an internal resistance that decreases when the material is compressed. Further embodiments may utilize "volume-based resistance" that may be implemented through "smart materials." As another example, the material 322 may change resistance by changing the amount of surface-to-surface contact, such as between two pieces of force-sensitive material 322, or between the force-sensitive material 322 and one or both electrodes 318, 320. In some circumstances, this type of force-sensing resistance behavior may be described as "contact-based resistance." ii. Wrist-worn devices
[0042] As shown in FIG. 4, the device 400 (which may be similar to or include the sensory device 128 shown in FIG. 1) may be configured to be worn by the user 124 around the wrist, arm, ankle, neck, or the like. The device 400 may include an input mechanism, such as a depressible input button 402 configured to be used during operation of the device 400. The input button 402 may be operably connected to a controller 404 and / or any other electronic components, such as one or more of the elements discussed with respect to the computing device 114 shown in FIG. 1. The controller 404 may be embedded or may be part of a housing 406. The housing 406 may be formed from one or more materials, including an elastic component, and may include one or more displays, such as a display 408. The display may be considered an illuminatable portion of the device 400. The display 408 may include a series of individual light elements or light members, such as LED lights 410. The lights may be formed in an array and operably connected to the controller 404. The device 400 may include an indicator system 412, which may also be considered a portion or component of the overall display 408. The indicator system 412 may operate and illuminate in conjunction with the display 408 (which may have a pixel member 414) or may be completely separate from the display 408. The indicator system 412 may also include a number of additional light elements or members, which in an exemplary embodiment may take the form of LED lights. In certain embodiments, the indicator system may provide a visual indication of a goal, such as illuminating a portion of the light member of the indicator system 412 to represent progress toward one or more goals. The device 400 may be configured to display data expressed in units of activity points or currency earned by the user based on the user's activity through the display 408 and / or the indicator system 412.
[0043] The fastening mechanism 416 may be disengaged, where the device 400 may be placed around the wrist or portion of the user 124, and the fastening mechanism 416 may then be placed in an engaged position. In one embodiment, the fastening mechanism 416 may include an interface, including but not limited to a USB port, for functional interaction with devices such as the computing device 114 and / or devices 120 and / or 112. In certain embodiments, the fastening members may include one or more magnets. In one embodiment, the fastening members may have no moving parts and rely entirely on magnetic forces.
[0044] In certain embodiments, device 400 may include a sensor assembly (not shown in FIG. 4). The sensor assembly may include a number of different sensors, including sensors disclosed herein and / or sensors known to those of skill in the art. In an exemplary embodiment, the sensor assembly may include or allow for a functional connection to any sensor disclosed herein or any sensor known to those of skill in the art. Device 400 and / or its sensor assembly may be configured to receive data from one or more external sensors. iii. Clothing and / or body position sensing
[0045] Element 130 in FIG. 1 illustrates an example sensory location, which may be associated with a physical device such as a sensor, a data acquisition unit, or other device. Additionally, in other embodiments, the location may be a specific location of a body part or area to be monitored, such as via an image capture device (e.g., image capture device 118). In certain embodiments, element 130 may include sensors, such that elements 130a and 130b may be sensors integrated into clothing, such as athletic wear. Such sensors may be placed at any desired location on the body of user 124. Sensors 130a / b may communicate (e.g., wirelessly) with one or more devices (including other sensors) of BAN 102, LAN 104, and / or WAN 106. In certain embodiments, the passive sensing surface may reflect a waveform, such as infrared light, emitted by image capture device 118 and / or sensor 120. In one embodiment, the passive sensor located on the clothing of user 124 may generally include a spherical structure made of glass or other transparent or translucent surface that may reflect a waveform. Different classes of apparel may be utilized, where apparel of a given class has particular sensors configured to be located proximate to particular parts of the body of a user 124 when properly worn. For example, golf apparel may include one or more sensors disposed on the apparel in a first configuration, while soccer apparel may include one or more sensors disposed on the apparel in a second configuration.
[0046] FIG. 5 illustrates exemplary locations for sensory input (see, e.g., sensor locations 130a-130o). In this regard, the sensors may be physical sensors located on / in the user's clothing, and in yet other embodiments, the sensor locations 130a-130o may be based on identifying a relationship between two moving body parts. For example, the sensor location 130a may be determined by identifying the movement of the user 124 using an image capture device, such as the image capture device 118. Thus, in certain embodiments, the sensor may not be physically located at a particular location (such as one or more of the sensor locations 130a-130o), but is configured to sense characteristics of that location, such as with other sensor data collected from the image capture device 118 or other locations. In this regard, the general shape of the user's body, or portions thereof, may permit identification of a particular body part. The sensors may sense the current position of the body part and / or track the movement of the body part, whether or not an image capture device is utilized and / or whether or not a physical sensor is located on the user 124 and / or using data from other devices (such as the sensory system 302), the device assembly 400, and / or any device or sensor disclosed herein or known to one of skill in the art. In one embodiment, sensory data regarding the location 130m may be utilized to determine the user's center of gravity (also referred to as center of mass). For example, the relationship between the location 130a and the location(s) 130f / 130l relative to one or more of the location(s) 130m-130o may be utilized to determine whether the user's center of gravity has risen along the vertical axis (such as during a jump) or whether the user is "faking" a jump by bending and flexing the knees. In one embodiment, the sensor location 1306n may be located around the sternum of the user 124. Similarly, sensor location 130o may be located near the center of gravity of user 124. In particular embodiments, data from sensor locations 130m-130o (alone or in combination with other data) may be utilized to determine the center of gravity of user 124.In further embodiments, relationships between multiple sensor locations, such as sensors 130m-130o, may be utilized to determine orientation of user 124 and / or rotational forces, such as twisting of the torso of user 124. Additionally, one or more locations, such as location(s), may be utilized as (or approximate) a center of moment location. For example, in one embodiment, one or more of location(s) 130m-130o may serve as a center of moment location for user 124. In another embodiment, one or more locations may serve as a center of moment for a particular body part or region.
[0047] 6A-6C illustrate various examples of hardware systems in which systems and user interfaces may be implemented and methods may be practiced in accordance with the present disclosure. In one embodiment, multiple users may work together using an augmented reality program to share and capture target images.
[0048] FIG. 6A illustrates a first computing device 600 and a second computing device 602 that are connected to and communicate with each other via a network 604 (e.g., via an Internet connection, via a local area network (LAN), via a wide area network (WAN), etc.). The two computing devices 600 and 602 may be located remotely from each other. In some embodiments, the computing devices 600 and 602 may be mobile devices such as cell phones or tablets. As illustrated in FIG. 6A, the two computing devices 600 and 602 each establish a communication channel in the network 604 and communicate with a messaging server system 606 (including one or more server computers), which provides data or information regarding targets between the computing devices 600 and 602. Any desired communication link and communication protocol may be used to provide and control data exchange between the computing devices 600 and 602. If desired, as described in more detail below, this same server system 606 may provide communication data (text message data, webcam data, etc.) between users on the computing devices 600 and 602. Alternatively, if desired, a separate communications link 608 may be provided to support the transmission of communications data between computing devices 600 and 602 .
[0049] As described in more detail below, any desired type of computing device 600 and 602 may be used without departing from this disclosure, such as any computing device capable of establishing network and / or peer-to-peer connections and providing the necessary display, user interface, and input capabilities. Some more specific examples of computing devices 600 and 602 that may be used in systems and methods according to at least some examples of the present disclosure include, but are not limited to: desktop computers, personal computers, laptop computers, palmtop computers, handheld computers, cellular telephones, personal digital assistants, computer workstations, televisions, etc. Notably, the various computing devices 600, 602, etc. may communicate with the network 604 and server system 606 in the same or different manners without departing from this disclosure. Additionally, the computing devices 600, 602, etc. used to display and capture the target images may be of the same or different types (such as one desktop computer and one cellular telephone device) without departing from this disclosure, and the computing devices 600, 602, etc. may communicate with each other or with the system database 606 over the same or different communication channels (e.g., both users may connect to the system database through Wi-Fi, or one may connect to the system database through Wi-Fi while the other connects through cellular data). In further aspects, the computing devices may display the target images through the same application or through different applications (e.g., both users may display the target images through a single application such as Instagram, or through different applications (one user may display through Instagram and another user through a Facebook application)).
[0050] The computing devices 600 and 602 that may be used in the systems and methods according to the examples of the present disclosure may include one or more input devices and data processing systems (e.g., including one or more microprocessors). Examples of input devices that may be included in the computing devices 600, 602 include, but are not limited to, the following traditional input devices: keyboard (hard or soft); mouse; trackball, rollerball, touchpad, or other pointing device; stylus or other pen-type input device (e.g., for tablet PC type computing devices); disk drive; USB port; network connection; joystick controller; telephone connection; Ethernet connection; voice recognition function, etc. Also, any desired type of display device may be provided for use in conjunction with the computing devices 600, 602 of the systems and methods according to the present disclosure, including a display device integrated with the computing devices 600, 602 themselves, or a display device separate from but in communication with the computing devices 600, 602, such as a projector display, a separate monitor display, etc.
[0051] The computing devices 600 and 602 may be connected to the network 604 in any desired manner, including conventional manners known in the art, such as any conventional wired or wireless connection, and using any network connection protocol, without departing from this disclosure. The communication channel connection 608 between the computing devices 600, 602 may be the same as or different from the system database connection, without departing from this disclosure, and such connection 608 may include conventional technology and technology known to those skilled in the art. In addition to the various inter-computer communication links known and used in the art to provide live, real-time communication between two (or more) computers, the communication channel connection 608 may further include other types of communication channels between the computers or users (e.g., instant messaging channels, peer-to-peer messaging channels, conventional telephone connections, etc.). If desired, as another alternative, the users may be located in close proximity to one another and be able to communicate directly in face-to-face conversation, without the need for a separate communication channel. If provided, the communications channel 608 may use all the same hardware, all different hardware, or a combination thereof (e.g., some users may use the same hardware and other users may use different hardware) in participating in the target image data exchange.
[0052] As previously mentioned (and as described in more detail below), systems and methods according to examples of the present disclosure will provide a user interface display on a user's computing device 600, 602. The interface will allow the user to view the target image and will allow the user to display the target image for another user to capture. The user interfaces on the various devices will be provided and controlled by one or more of the computing devices 600, 602 and / or the server system 606. And data for generating, maintaining, and receiving input through the user interfaces will be generated and provided via computer readable media included as part of or associated with one or more of the computing devices 600, 602 and / or the server system 606. Examples of such computer readable media include, but are not limited to: computer readable memory (whether internal to the computer (e.g., hard drive) or separate from the computer (disk, solid state or flash memory device, data available via a network connection, etc.)), any type of computer readable media conventionally known and used in the computer industry.
[0053] In the overall example system shown in Figure 6A, software for generating a user interface may reside on a computer-readable medium located on or available to any one of computing device 600, computing device 602, or server system 606. Alternatively, if desired, the software or at least some portion(s) thereof may reside on two or more or all of computing device 600, computing device 602, or server system 606. Server system 606 may be operated and maintained by the same organization(s) or individual(s) that operates and maintains at least one of computing devices 600, 602 and / or network 604, or server system 606 may be operated, controlled, and maintained by a party separate from any or all such entities. As some more specific examples, the server system 606 may be operated and maintained (and the user interface software may also be operated and maintained) by one or more entities whose products are sold through, and to which access is granted, the augmented reality program (e.g., a manufacturer, a retailer, a vendor selected by the manufacturer or retailer, etc.).
[0054] Another example overall system setup is illustrated in Figure 6B. The overall network features 604 may be the same or similar to those previously described in connection with Figure 6A (e.g., LAN, WAN, Internet, etc.), but in the example setup, the separate and independent server system 606 is omitted. Rather, in the setup of Figure 6B, at least one of the two computing devices 600, 602 (and optionally both computing devices 600, 602) includes software for driving data exchange communications and generating and controlling user interfaces.
[0055] If desired, the networked communication between users for data exchange may include features that allow users to communicate with each other about the target image. Alternatively, as shown in FIG. 6B, a separate user communication link 608 is illustrated. In addition to the various inter-computer communication links that are well known and used in the art to provide live, real-time communication between two (or more) computers, the communication channel connection 608 may further include other types of communication channels between the computers or users (e.g., instant messaging channels, peer-to-peer messaging channels, traditional telephone connections, etc.). If desired, as another alternative, the users may be located in close proximity to each other and be able to communicate directly in face-to-face conversation without the need for a separate communication channel 608. The communication channel 608 may use the same or different hardware used in the target image data exchange.
[0056] Also, in at least some systems and methods according to the present disclosure, collaboration between users to display and capture target images may occur via direct communication between computing devices in a peer-to-peer manner as shown in FIG. 6C. Any desired hardware and / or protocols for this type of peer-to-peer communication may be used without departing from the present disclosure, including conventional hardware and protocols known and used in the computer communications industry. Also, similar to the examples of FIG. 6A and FIG. 6B above, a separate user communication channel 608 may be provided (e.g., instant messaging, additional peer-to-peer messaging, conventional telephone connection (which may use different hardware than that involved in inputting or capturing target image data), etc.). Also, various other alternatives previously discussed with respect to FIG. 6A and FIG. 6B may be used in the setup of FIG. 6C without departing from the present disclosure.
[0057] 8 and 9 illustrate an example embodiment of a method for capturing a target image using an augmented reality program and implementing a predefined output, such as unlocking access to purchase a consumer good, if the captured image is verified to be a target image. The steps shown in such example flow charts may be performed by a single computing device, such as a processor included in the first mobile device 705 or the second mobile device 706. Alternatively, execution of the steps may occur through only one of the first mobile device or the second mobile device, or in combination with the system database 707. In some aspects, the steps will be performed in sequence, while in other aspects, the steps may be performed in a different order or simultaneously. For example, in some embodiments, the capture may be performed by any user device capturing information communicated to the system database, where the system database then determines whether the captured information is recognized as a target image and responds with instructions to the user device. However, in other embodiments, the system database may communicate the target image information and instructions to the mobile device prior to the user device capturing the image. Therefore, the capture of the target image, the perception of the target image, and the execution of the instructions may all be performed on either user device 705 or 706 .
[0058] FIG. 7 illustrates an example system for implementing the present disclosure. As shown in FIG. 7, two user devices may include a user interface and a capture device. The user interface may include both a display and an input mechanism, where the input mechanism may be a button, a touch screen, or other information input method. The image capture devices 702 and 704 may include one or more video cameras. The image capture devices may be configured to capture or record images or videos, including recording or capturing the user interface displays 701 and 703 of the other user's devices. The device user devices may be connected to a system database through a network, which may analyze the captured images or videos to determine whether the target image is recognized, and may send further instructions to the user devices when recognition of the target image is confirmed.
[0059] FIG. 8 illustrates an example flow chart of steps that certain embodiments may take. First, in step 801, an image may be shared through an online platform. In some aspects, the online platform may be a social media platform such as Instagram, Twitter, Facebook, Google+, or any other social media platform. The image may include target information recognized by the capture device. The image may be shared through a social media account by a first user. As a next step, the image may be displayed on the first device in 802. This may include through a social media account of a second user. In some aspects, the first user may share the image through an online platform, and the second user may view the image using the same social media platform or through a different social media platform.
[0060] In a next step 803, the second device may capture an image and determine whether the device recognizes the image. In some embodiments, the second device may take a still image using a camera or record a video of the image. Upon capturing the image, the second device may communicate with a database to determine whether it recognizes the image as a target. If the device confirms recognition of the target image, upon recognition of the image in step 804, the device may receive instructions. The instructions may include unlocking access to allow the user of the second device to purchase the consumer good. In some embodiments, step 805 may include modifying the display of the second device based on the instructions. This may include changing the display, such as by overlaying the consumer good on the display or presenting a message or video to the consumer, or changing the recognized and / or captured image.
[0061] FIG. 9 illustrates an example flow chart showing steps that a particular embodiment may take. First, in step 901, an image may be displayed on a first device. In some aspects, this display may occur through an online platform such as Instagram, Twitter, Facebook, Google+, or any other social media platform. The image may include target information that is recognized by a capture device. In step 902, an image may then be captured by using the second device via a camera or image capture device of the second device, or via sharing by the first user through a social media account. The device may then recognize a target image in step 903. Once the target image is recognized, in step 904, the device may communicate with a system or database through a network. In step 905, the device may receive instructions from the system or database to grant the user access to purchase the consumer good. Upon receiving such instructions, in step 906, the second device may overlay an image of the consumer good on the displayed image. For example, the device may overlay a three-dimensionally projected representation of the consumer good to be unlocked. In this regard, an image may be overlaid on the recognized target so that as the user moves the camera around, the projected representation moves, allowing the user to see different angles of the product. In a final step 907, the device may grant the user access to purchase the unlocked consumer good.
[0062] In some embodiments of the present disclosure, a first individual can share an image through a platform where a second individual can view the image on a mobile device. In some embodiments, the platform can be a social media platform. By viewing the image on the display of their mobile device, the second individual can share the image with a third individual. The third individual can then use an image capture device to capture the image as it is displayed on the second individual's mobile device. Upon perceiving the captured image, the third individual's device can grant the third individual access to purchase a consumer good.
[0063] In some aspects, a user can use the mobile device to capture an image, such as through a camera or other image capture means. In some aspects, the image can be a still image or the device can be configured to capture video. In certain embodiments, a user can use the mobile device to capture an image of the surrounding environment. The mobile device can also have a user interface that includes a display. In some aspects, the user interface and the camera can be configured to simultaneously display what the camera is recording on the user interface.
[0064] In some embodiments, the mobile device may include an augmented reality program. In such embodiments, users may capture images in the environment using a camera on their mobile device. The captured images may be simultaneously output on a user interface display. In some aspects, the mobile device may be configured to recognize a target image when captured by the mobile device camera. Once such a target image is recognized, the mobile device may communicate with a system database over a network to confirm recognition of the target image. The device may then receive instructions from the system database once the target image has been confirmed.
[0065] In different embodiments, the instructions may direct the mobile device through an augmented reality program to overlay a three-dimensional projection on top of a target image displayed on the user interface. In certain aspects, the projection may be a consumer good. The projection may represent a consumer good available for purchase by the user. In some aspects, the user interface may allow the user to interact with the projected product. This interaction may include user input such as a button, or the user interface may be a touch screen, allowing the user to click on the projected product by touch. After interacting with the projected product, the mobile device may grant the user access to purchase the projected product.
[0066] In some examples, upon capturing and recognizing the target image, the system may present other results. For example, in some embodiments, a user may capture an image through a camera, and the mobile device may change the output display in response to recognizing the target image after recognizing that the image contains a target. As an example, the display may continue to output what was captured by the camera, but may change the output display based on the recognition of additional targets. In some embodiments, the device may recognize a type of product, a brand logo, a number, a design, a letter, or any other target, and replace that target on the output display. As an example, a user may be in a store and use a camera to capture the store interior. The mobile device may be configured to recognize a particular logo on a product, then output the image captured by the camera on the display, but replace the recognized logo on the display with an image or message for the user.
[0067] In certain embodiments, a user can share an image through a social media platform. An individual can then view the image on social media through a display on a mobile device. An individual who views the image can share the image with a friend, who can view the image through an image capture device with augmented reality capabilities. Upon acknowledging the image, the software may display a three-dimensional product of the consumer good overlaid on the image. This would indicate that the user capturing the image has been granted access to purchase the displayed consumer good. In this embodiment, the user can then choose to search for the image on their social media account and share it with their friend, who can then capture the image using a mobile device with augmented reality capabilities and also gain access to purchase the product.
[0068] In some embodiments, a first individual can share an image through social media, where the image includes target information that unlocks access to purchase the consumer good. A second individual can view the image on a mobile device having a display. A third individual can capture the image on a mobile device having image capture capabilities, where through capturing the image, the device recognizes the image and unlocks access to purchase the consumer good for the third individual. In some embodiments, the system can recognize that the image was shared and / or captured from another mobile device. In such embodiments, access can be limited to capturing from another individual's phone or from a specific social media application. The number of users granted access to the product can be limited, such that only a certain number of users are granted access before the product sells out. The system can limit the number of times the image is shared and still unlock access to the product.
[0069] In some embodiments, the target image may be shared through social media. An individual may view the target image through a social media account. An individual viewing the target image may share the image with a friend, who may then capture the image using a camera on a mobile device. The camera may perceive the target image through an augmented reality program, and upon perceiving the target image, may receive instructions from a system database. Such instructions may include overlaying a projection of the consumer good on a user interface on the user's device and unlocking access to the user to purchase the consumer good.
[0070] In some embodiments, the camera may only perceive the target image if it is displayed on the screen of another device. In such embodiments, access to the consumer good is not unlocked unless the target image is captured from another user's screen. In such examples, individuals are prompted to share the target image with each other. One user can call up the target image on their mobile device so that another user can capture the image and unlock the consumer good. A second user can open the target image on their mobile device so that the first user can capture and unlock the consumer good.
[0071] In an example embodiment, a user's computing device (which may be a mobile device, a stationary device, and / or a device set up for commercial or personal use) may include one or more non-transitory computer-readable media containing computer-executable instructions that, when executed by a processor, cause the device to capture an image of a second mobile device and recognize the image as an instruction upon capturing the image. The mobile device may then communicate with an external system over a network. Upon verifying the captured image, the system may unlock the mobile device access to purchase consumer goods.
[0072] Granting access to consumer goods through augmented reality encourages users to share images and hunt for targets in almost any image. For example, if a user knows that a particular influencer, such as a famous athlete, is releasing or endorsing a product, the user may scan the athlete's social media account to see if there is a target in any image shared by the athlete that unlocks access to purchase the product. In different embodiments, this could be footwear, jerseys, clothing, sports equipment, or any other consumer goods. This also encourages users to share images among friends in the hope that they can find and capture the target image using a mutual mobile device, such as a smartphone.
[0073] In some embodiments, the product launch may be rolled out through social media. In such an embodiment, the product may be announced, but there is no announcement of when the product will be released. Rather, an image containing target information that unlocks access to purchase the product may be given to an influencer, such as an athlete, chef, social media personality, businessman, celebrity, etc. An augmented reality program may then be configured to recognize the target image when the target image is captured using a mobile device. The influencer may then share the product on social media. In some embodiments, the influencer may not announce that the image contains target data. Rather, the consumer is prompted to view the image to find the image with the target information using an augmented reality program. After discovering that the image contains target information that unlocks access to a new product or performs some other function, the user is prompted to share the image with their friends, such as through social media. In such an embodiment, when an individual discovers that the image has an unlock function and shares the image, the image will be shared organically through word of mouth.
[0074] In some embodiments, the augmented reality programs will be utilized to interact with mobile devices including smartphones such as the Apple iPhone or Android phones, tablets, laptops, computers, gaming systems, music players, e-book readers, or any other mobile electronic device capable of image capture.
[0075] In certain embodiments, the target image may be a tangible item. As an example, the target image may be a restaurant menu. The augmented reality program may then be configured to recognize when the restaurant menu is captured by the mobile device and unlock access to purchase the consumer item. In some embodiments, the mobile device may overlay a projected image on the display when it captures the target image. As shown in FIG. 11A and FIG. 12, this projected image may be shoes that the user is unlocked to purchase. Upon discovering that the tangible item is the target image recognized by the augmented reality program, the user may capture an image of the tangible item and share it with friends through social media platforms, etc. Other users who view the image may then unlock access to purchase the consumer item by capturing the image using the augmented reality program on the mobile device, or may receive any other output that the mobile device is configured to perform when it captures and recognizes the target image.
[0076] Upon discovering the target image through such features, the user is prompted to share the target image. For example, if the target image is a restaurant menu with restricted locations, a consumer who does not visit one of the restaurant locations would not be able to capture the menu using the augmented reality program. Thus, the consumer would be denied access to purchase consumer goods that would otherwise be unlocked through capturing that menu. However, by prompting the user to share the target image, the user can unlock access to such products without having to view the tangible item that is the real-world target image.
[0077] Certain embodiments may also include features that prompt the user to share the target image with their friends through social media. For example, a user may be granted access to further specific products based on sharing the target image several times or having other individuals capture the target image that they have shared. As other examples, a user may be granted sales offers, store credits, consumer goods, reward points, or social media rewards.
[0078] In some embodiments, the user interface on the mobile device may include user input options. Once the target image is captured and recognized by the augmented reality program, the user interface display may prompt the user to provide input to unlock the product. In some embodiments, after unlocking the product, the mobile device may connect to an online store whereby the user may purchase the unlocked product.
[0079] In different embodiments, after unlocking and purchasing the product, the user may be prompted to share information about the purchase, such as through social media. In some examples, this may be a predefined message that describes the product the user purchased and / or where the user found the target image. By sharing this information, the user may instruct other users to locate the target image. In the example of a restaurant menu, i.e., the user's message that he or she purchased the product that he or she unlocked through capturing the target image that was a menu, other users who were interested in unlocking and purchasing the product may be prompted to visit the restaurant or view the menu online or through other means such as social media. In different examples, the user's message regarding the product purchase may be shared through social media, such as Instagram, Twitter, Facebook, Google+, or any other social media platform.
[0080] Further aspects of the disclosure may include communication between personal devices back to a system database. Upon unlocking access to a consumer good and / or confirming the purchase of the product, the mobile device may communicate information to other mobile devices or to a system database. In some aspects, this information may include demographic information about the user, information about the purchase such as size and color, the geographic location of the user, or any other information about the user or the purchase. This information may be shared with a distributor of the product, who may maintain an information database that includes products and information about users who have successfully unlocked and purchased the products through an augmented reality program.
[0081] The aspects discussed in this disclosure encourage collaboration between merchants and influencers. Influencers can be athletes, chefs, social media personalities, business people, celebrities, and the like, who are looking to expand their personal brand through social media and the like. Thus, influencers known for releasing targeted images that unlock high-demand products will increase followers, as well as social interaction with fans and the public. Relatedly, merchants can spread their products, messages, and awareness more organically through influencers releasing targeted images. Searching for Virtual Objects with Augmented Reality
[0082] The systems and methods described herein may further be used in conjunction with systems and methods for hunting or searching for targets in the form of virtual objects in geographic space, which may be known as geocaching. The systems and methods may use augmented reality as described herein and may offer rewards for locating the object, which rewards may vary or depend on the time it takes to locate the object. A primary user or searcher physically travels to the location of the virtual object, assisted by GPS data and, optionally, augmented reality (AR) and / or assistance from a secondary user. Figures 13-30 illustrate example embodiments of systems and methods for searching for virtual objects, it being understood that such embodiments may be used in conjunction with any of the systems, architectures, methods, and / or features described herein and shown in Figures 1-12.
[0083] The virtual object may take almost any desired form, and in one embodiment may be a representation of or related to the presented reward, such as a product associated with the reward. The virtual object may be a target image as described herein. The virtual object may be located at the same or close to a real object (e.g., a landmark, statue, etc.), and in one embodiment may be associated with the real object. The presented reward may be tied to the location of the virtual object, such that all users searching for that reward in the same area will be given the same location of the virtual object. In other embodiments, the location of the virtual object may not be associated with the reward, but may be unique to each search session, such as a randomly assigned location, or a location based on information about the user. For example, the location of the object may be based on one or more user preferences, such as favorite places, activities, products, colors, etc., or may be based on the location of the user(s). In another embodiment, the target may not be a virtual object, but rather a real object about which the user can capture an image, or a particular geographic location that the user may need to reach, and the augmented reality features may be used to locate and / or activate the target that is not in the form of a virtual object.
[0084] Completion of the search and location of the virtual object may result in a reward available to some or all of the users involved in the search. In one embodiment, the reward may be an unlocked ability, such as the ability to purchase a particular product, which may be a newly released product or a product with limited availability. In other embodiments, the reward may be a real or virtual gift, such as a product, currency, credits, a change in profile status, etc. The rewards provided to each user's teammates may be the same in one embodiment, or may vary based on different characteristics, such as user selection or preferences, team contributions, or other information.
[0085] FIG. 13 illustrates one embodiment of a system 1300 in which a primary user or “searcher” having a primary device 1301 collaborates in a search with one or more distant secondary users or “squadmates,” each having a secondary device 1302. The primary user, in this embodiment, physically searches for a virtual object or other target by moving his or her location in geographic space to the location of the virtual object. The secondary users can assist the primary user in the search by various techniques, as described in detail herein. The devices 1301, 1302, network, and system database 1307, in this embodiment, may utilize any of the device, network, and server / database components and features described herein. For example, in one embodiment, the primary device 1301 may include at least a processor, memory, display, capture device (e.g., camera), GPS sensor, transceiver, and one or more I / O devices, as well as associated software to support the same. As another example, in one embodiment, each secondary device 1302 may include at least a processor, memory, a display, a transceiver, and one or more I / O devices, as well as associated software to support the same. As a further example, the various computer processes (analyses, determinations, etc.) described herein may be performed in the devices 1301, 1302, the system database 1307 (which may be part of the server 111), or other devices in communication with the devices 1301, 1302 and / or the system database 1307 or the server 111. It is understood that the processor 202 of each computing device may be used for such processes, and that information exchange may be effected by transmission and reception from such devices.
[0086] Figure 14 illustrates one general embodiment of a method for searching for a virtual object using the system 1300 of Figure 13. Figure 15 illustrates one embodiment of the method from the perspective of the primary device 1301, and Figure 18 illustrates an example interface from the primary device 1301 and a progression of user selections. Figure 16 illustrates one embodiment of the method from the perspective of the secondary device 1302, and Figure 19 illustrates an example interface from the secondary device 1302 and a progression of user selections. Figure 19 illustrates one embodiment of the method from the perspective of a server or system database 1307.
[0087] In the embodiment of FIG. 14, a search session is initiated, for example, by a primary user device 1301 initiating the session, and a searching group or team is created at 1401. In one embodiment, the primary device 1301 may be in the vicinity of the geographic location of the object before the session is initiated or before other users can join the group. For example, geographic constraints may be placed on the primary user, such as a minimum distance from the object's location or presence within a city or urban area of choice. Session initiation may also require selection of a virtual object and / or selection of a reward for the object's location (e.g., select and unlock a product purchase) so that multiple different searches may be available with multiple different objects, locations, time limits, and rewards. Item 1801 in FIG. 18 illustrates an example screen for selecting a particular search, and items 1802, 1803 illustrate example screens for initiating a session. The primary device 1301 receives and / or displays additional information related to the search at 1402 (e.g., the GPS location of the primary device 1301, the GPS location information of the virtual object, proximity data, etc.). Items 1802-1804 illustrate a screen displaying the GPS location of the primary device 1301, as well as a map of the city and other primary user locations, which can be zoomed in or out as desired.
[0088] One or more secondary users may join the group at a remote location using secondary devices 1302 at 1403. The primary device 1301 may receive notification that the secondary user(s) have joined the group, such as by a graphical depiction of the avatar(s) of the secondary user(s), as shown in FIG. 18, item 1804. Each secondary device 1302 may receive and / or display information related to the search before and / or after joining the group at 1404, and the information may differ from the information received and / or displayed by the primary device 1301. Information valuable to the secondary users prior to joining the group may include the nature of the reward, the identity of the primary user, or the status of the search (e.g., progress, proximity to the object, or time remaining). After joining the group, the secondary user(s) may then assist the primary user in the search at 1405, offering various types of assistance as described herein. When the primary user reaches the location of the virtual object at 1406, the virtual object may be activated at 1407. Activation of the virtual object may be automatic or may require action on the part of the user as described herein. Once the virtual object is activated, a reward may be made available to the user at 1408, thereby completing the search session.
[0089] In one embodiment, the search may be provided in multiple segments, with sequential "checkpoints," ultimately leading to the location of the virtual object. In one embodiment, reaching one checkpoint unlocks information about the location and / or next checkpoint of the next sequential checkpoint, so that the checkpoints must be completed in sequence. In another embodiment, the checkpoints may be reached in any order, but all checkpoints (or a minimum number of checkpoints) must be reached before the virtual object is located or activated. Reaching all checkpoints may unlock information about the location and / or location of the virtual object. Secondary users may assist with checkpoint discovery, and in one embodiment, each checkpoint may rely on assistance from a different secondary user, such as clues provided specifically for that user, or information related to that user. Additionally, checkpoints may be related to a secondary user, such as based on the user's preferences or characteristics. Image capture and sharing
[0090] The primary user may have the ability to provide image capture to secondary users during a search, and in one embodiment, such image capture may be necessary for locating and / or activating an object. This capability may be selectable on the primary device 1301. A capture device on the primary device 1301 may capture a perspective video or picture, which is provided on the display of the primary device 1301 and / or on the display of each secondary device 1302 for viewing by the secondary user. The primary device 1301 may also be configured to provide other images, such as "selfie" pictures, and the secondary device(s) 1302 may similarly be configured to provide images for viewing by the other devices. The images may be modified with augmented reality to display, for example, virtual objects, assistive information, or various other images that aid in the search, entertain the user, and / or otherwise enhance the experience. In addition, the images displayed on the different devices 1301, 1302 may be the same in one embodiment, or may include different augmented realities in another embodiment. The images provided on the secondary device 1302 may improve the secondary user's ability to assist the primary user. In one embodiment, the primary device 1301 may only be given the option to provide images in close proximity to the object's location, and in another embodiment, the primary device 1301 is required to provide images when in close proximity to the object's location. Object location may be performed by representation of the object in augmented reality on the displays of the devices 1301, 1302, and unlocking the object may also require images from the primary device 1302. Support for secondary users
[0091] Secondary users can assist the primary user using a variety of techniques, both active and passive. The assistance provided by the secondary user(s) can be assistance in locating an object and / or activating an object once located. As an example, a secondary user may have the ability to "ping" an object, or simply reveal the location to the primary user. Item 1905 in FIG. 19 illustrates a secondary user manually pinging an object using a button on the secondary device 1302. Item 1805 in FIG. 18 illustrates a depiction of a ping on the primary device 1301. Although the pings are depicted in FIGS. 18-19 as Doppler pings, in other embodiments, they may be of different forms, such as arrows or other directional indicators, and the forms may vary in accuracy. Secondary users may each have a limited number of pings and / or a "cooldown" between pings, so that a greater number of secondary users are more efficient at locating objects. A final ping may be required to locate the object even if the user is in the vicinity of the object, as shown by item 1808 in FIG. 18. Secondary users may be able to provide different assistance to the primary user, such as text or audio information, or directions to the object. For example, secondary users may be provided with information about the object's location individually and sequentially for a limited period of time, thereby providing assistance to only one secondary user at a time. As another example, each secondary user may be provided with different information about the location, which may provide some information about the object's location, such as clues. The clues may be provided to the secondary users and / or may relate to information about the secondary users, such as location, personal characteristics, or preferences. In one embodiment, the secondary users may be required to perform an action, such as providing information or answering a quiz question, to obtain a clue. In another embodiment, the number and / or quality of clues provided may depend on reward-related information, such as past product purchases, level of participation in sports or other activities, or amount of usage of a particular product-related or fitness-related application.Assistance by secondary users may, in one embodiment, be mandatory, such that clues or other assistance must be provided by each of the secondary users before an object can be located and / or unlocked.
[0092] Passive assistance may be provided in several ways. In one example, the number of secondary users may affect the quality of assistance provided. The addition of secondary users may improve the visibility of an object and / or improve the accuracy of the "ping" and / or reduce the proximity required to activate an object. In another example, characteristics of the secondary users may affect the quality of assistance provided or assistance may be directly related to such characteristics. Secondary user assistance in activating objects is described elsewhere in this disclosure. Creating and convening groups
[0093] When selecting a group, information provided to the secondary user may illustrate each primary user's proximity to the object location, or in the case of a multi-segment search, how many segments the primary user has already completed. This information may be enhanced in one embodiment by augmented reality, and such augmented reality image may also be provided to the primary device 1301 for use or viewing by the primary user. For example, item 1902 in FIG. 19 illustrates a virtual 3D city with avatars of different primary users, proximity indicators to determine proximity to the object location, and images of the object at the object location. Users can view different parts of the virtual city by changing the orientation or viewpoint of the device 1301, 1302, and the virtual display changes accordingly. Brief information about each user may be obtained by selection as shown in FIG. 25, where a selection of one primary user illustrates the number of members currently in the group and the number of group slots available. FIGS. 20-22 illustrate another embodiment of a virtual 3D city, which may be provided with exemplary virtual size dimensions. The augmented reality image may further be made in relation to real objects. For example, as shown in Figure 26, the virtual city may be a virtual replica of a real city with various architectural and land features depicted. As another example, as shown in Figure 23, where the location of an object matches the location of a real object (e.g., a fountain in a park), the primary user is shown in close proximity to the fountain. The augmented reality imagery may further incorporate other artwork or formations, as shown in Figure 25, which depicts the location of an object with a tower that rises above all other virtual buildings in the area.
[0094] In one embodiment, the group is open to any secondary user who wishes to join the group until the limit is reached, i.e., the group is full. The secondary user may be provided with the option to select among multiple different groups and may be provided with information related to the session, such as information about the primary user, the primary user's location, the object's location, reward details, group composition, etc. Items 1901-1904 in FIG. 19 illustrate the information provided to the secondary user and the joining process into the group. In item 1901, the secondary user is provided with the option to select a reward, and in item 1902, the secondary user is provided with an AR depiction of a primary user searching for the same reward, including a depiction of a virtual city, the object's location, and the primary user's avatar and location. The secondary user may be able to select a different primary user and group to view additional details. For example, in item 1903, the secondary user selects a primary user with a full group that they cannot join, and in item 1904, the secondary user selects a primary user with a group with an open slot, thereby allowing the secondary user to join.
[0095] In another embodiment, personal relationships may influence group formation, and various social media platforms and networks may be used for this purpose. Also, integration of such platforms and networks may be used. For example, users may be required or incentivized to join groups that include other users on their friends list. As another example, users may be prohibited from joining groups that include other people on their friends list, or limitations on the number of connected users in a single group may be applied.
[0096] In another embodiment, secondary users may be free to choose one or more groups as they please, but may be restricted from joining certain groups based on certain criteria, such as secondary or primary user characteristics, object location, nature of reward, previous participation, etc. In another embodiment, the primary user may be provided with some input or authority to trigger secondary user(s) to join the group, such as requiring the primary user's approval, or selection of the secondary user(s) by the primary user. In this embodiment, information about potential secondary users would be made available to the primary user. Secondary users already in the group may be provided with similar input or authority for participation by additional secondary users. In a further embodiment, secondary users may be automatically assigned to various groups, randomly or based on various characteristics. Examples of such characteristics include information about the primary or secondary users, group composition and characteristics, search status (e.g., progress or distance from object location), etc., as described herein. Automatic assignment of groups may also be done with objectives such as group diversity or group size, as described herein.
[0097] In another embodiment, the capacity of the group may vary based on various conditions. For example, the capacity of the group may depend on characteristics of the primary and / or secondary users already in the group, such as brand loyalty, knowledge, experience, participation, application usage, activity level, etc. As another example, the capacity of the group may increase as the primary users approach the object location. As a further example, additional group participation may be prevented when the primary users are in close proximity to the object location to encourage search effort and participation by secondary users.
[0098] The group matching process may be configured to incentivize certain group compositions, such as group diversity, group completeness, contributions of all group members, user satisfaction, brand loyalty, and other goals. Incentives may be positive or negative in nature. Group diversity may incorporate geographic diversity (i.e., users from diverse locations across the country or the world). For example, secondary users in different locations may be provided with different clues for assistance, so that a geographically diverse team will have more clues. Geographic diversity may be enforced in another example by a requirement that users from one location be prohibited from joining a group with users from the same location. Group diversity may also incorporate diversity of knowledge and experience. For example, if quiz questions are presented to advance a search, having a team with a diverse knowledge base may improve the ability to answer such questions. As another example, a group may be required or incentivized to include users with both high and low levels of knowledge or experience. Brand loyalty may be incentivized by giving brand-aware users greater choice in joining a group or by rewarding improved groups based on brand loyalty. Group completeness may be incentivized by requiring a certain number of group members to locate and / or activate objects or by increasing the ease or time limits for an increased number of group members to do so.
[0099] Each user may be provided with a profile that includes information such as location, preferences, participation in sports or other activities, usage of certain product-related or fitness-related applications, personal product inventory (e.g., a list of all shoes the user owns), areas of particular knowledge or experience, brand-obsessed (or "VIP") status, etc. This profile information is made available to other users when forming groups to improve group selection and to differentiate users. For example, a user may wish to know the information necessary to form a diverse group, where a diverse team would improve the available assistance or ease of locating objects. Such profile information may, in one embodiment, be searchable by other users in forming groups. Various indicators, such as "skill points" or other points-based systems, colors or icons signifying particular information (e.g., status, location, knowledge, experience, etc.), may also be used in one embodiment to convey the profile information to other users. Such indicators may be icons, colors, highlights, or other visual indicators. Scavenger Hunt
[0100] In another embodiment, the primary user may be required to take a specific route leading to the location of a virtual object or other target, which may be accomplished using a "checkpoint" system, as described herein, by a GPS guidance system, or other techniques similar to a scavenger hunt. In addition, the system may require that specific athletic activities, such as running, jumping, climbing, or other activities, be performed along the route or some segments of the route. Specific performance goals, such as a maximum number of times, steps, or jumps, may also be incorporated into such activities. The system may be further configured such that meeting such performance goals affects the progress or outcome of the search, for example, by having performance conditions for locating or activating objects, providing additional (or fewer) cues or opportunities for secondary user assistance, changing the quality of secondary user assistance, increasing or decreasing rewards, etc. The secondary user may be prompted or required to also perform athletic activities, which may include performance goals. Routes and / or performance goals may be created based on user characteristics, such as profile information regarding skills, abilities, and experience, past athletic performance data, preferences (e.g., incorporating favorite activities or designing a route that passes favorite landmarks), and other information. This route customization may make the search process more enjoyable or challenging for the user(s) and / or level the playing field by presenting more capable or experienced users with more difficult routes and less capable or experienced users with less difficult routes.
[0101] FIG. 52 is an exemplary flow chart of steps that certain embodiments may take. The steps shown in FIG. 52 may be implemented by a computing system such as the server 111. In step 3100, the processor 202 of the server 111 may receive a request to generate multiple routes for multiple users. The request may identify each of the multiple users and may further identify an end user computing device 1301, 1302 associated with each of the users. The request may include one or more constraints among the multiple routes, such as a location constraint, a length constraint, a geographic constraint (e.g., peak elevation and the like), difficulty, and the like. The constraints may be applicable to all of the routes generated or to a subset of the routes generated. Multiple routes may be generated for a scavenger hunt in which multiple users participate.
[0102] In step 3101, the processor 202 may search for user data from the memory 212 of the system 111. The processor 202 may search for separate user data for each of multiple users. The user data may include athletic data including, but not limited to: motion parameters such as speed, acceleration, distance, steps, direction, relative motion of a particular body part or object relative to another; or other motion parameters expressed as angular velocity, linear velocity, or combinations thereof; physiological parameters such as calories, heart rate, sweat detection, effort, oxygen consumption, oxygen reaction rate; and other metrics in one or more of the following categories: pressure; impact force; information about the exerciser, such as height, weight, age, demographic information, and combinations thereof.
[0103] In step 3102, the processor 202 may generate multiple initial routes for multiple users. The processor 202 may generate a customized initial route for each user, and one or more users may have the same customized initial route. The multiple initial routes may be generated based on constraints included in the request received in step 3100 and the user data explored in step 3101. For example, the constraints may specify multiple potential starting location possibilities for the initial route and a maximum distance or completion time for the initial route. The processor 202 generates multiple routes, each starting from one of the potential starting locations and meeting the maximum distance and / or completion time requirements. The route generated for each user may be customized with respect to starting location, completion time, distance, difficulty, and the like, based on the user data explored for that user. That is, the user's individual routes may be handicapped based on the user's prior athletic data. For example, each initial route may require special athletic moves or abilities, such as jumping, running, climbing, etc. Users who demonstrate a high level of athletic ability (based on user data) may be expected to traverse longer distances and / or more difficult terrain (e.g., uphill routes) and / or complete the route in a shorter time. Each of the multiple users must complete the customized route within a particular period of time or reach a particular location by a particular time. In one instance, the multiple users may be assigned different start times based on the expected completion time for each user, such that the users each complete the customized initial route at the same completion time or within the same completion time frame.
[0104] At step 3103, the processor 202 may transmit the multiple routes to the multiple users. As described above, the request received at step 3100 may identify end user computing devices associated with the multiple users. Thus, the processor 202 may transmit the customized route generated for that user to each user via their identified end user computing device. The processor 202 may further transmit a start time to each user. At step 3104, the processor 202 may receive performance results for each of the multiple users. The performance for each user may indicate whether the user completed the initial route, the completion time, and the user's performance data for the initial route. The performance data for the initial route may include information similar to the athletic data sought at step 3101.
[0105] In step 3105, the processor 202 may generate a secondary route. In one case, a secondary route may be generated for each of the multiple users, regardless of whether each user has completed their customized initial route. In another case, a secondary route may be generated only for a subset of the users. The subset of users may be users who have completed their initial route. The secondary route may be generated based on the constraints received in step 3100, the user data searched in step 3101, the initial route generated in step 3102, and the initial performance data received in step 3104. For example, the secondary route may start where the initial route ended. The regular route may include activities similar to those included in the initial route and / or may include different activities. For example, if the initial route for a first user included multiple hills, the secondary route generated for that user may include only a few hills or no hills at all.
[0106] The secondary route may be customized for each user based on the user data discovered for the users in step 3102 and the initial performance data received for the users in step 3104. For example, the first user data for the first user may indicate that the first user excels at uphill climbing. The first initial performance data for the first user may further indicate that the first user has a strong running pace. The second user data for the second user may indicate that the second user has limited experience with uphill climbing and the second initial performance data for the second user has a slower running pace compared to the first user. The processor 202 may utilize such factors when generating the secondary routes for the first and second users. The first secondary route generated for the first user may include a first number of uphill climbs and the first user may be required to set a first running pace for a particular portion of the first secondary route. The second secondary route generated for the second user may include a second number of uphill climbs and the second user may be required to set a second running pace for a particular portion of the second secondary route. The first number of uphill climbs may be greater than the second number of uphill climbs and the first running pace may be greater than the second running pace because the first user has historically excelled at uphill climbing and had a faster running speed during the initial route.
[0107] The use of two users is exemplary; three or more customized running routes may be generated. By generating different customized secondary routes for each user and setting different requirements for the users during portions of the secondary routes, the processor 212 may handicap each user based on their athletic data and performance on the initial route. This helps to create a level playing field among all participants in the scavenger hunt.
[0108] The secondary route may be further customized based on user preferences. For example, a first user may indicate that he is working on improving his running pace, and a second user may indicate that he is working on improving his uphill climbing. A first customized secondary route generated for the first user may include long stretches of flat roads, thereby allowing the first user an opportunity to improve his running pace. Similarly, a second customized secondary route generated for the second user may include a number of hills, thereby allowing the second user an opportunity to improve his uphill climbing.
[0109] At step 3106, the processor 202 may transmit the customized secondary route to the corresponding user via the end user computing device associated with the user. At step 3107, the processor 202 may receive performance data for each user. The performance data for each user may include athletic data indicative of the user's performance on the customized secondary route. In one example (shown in element 3110), the steps of receiving performance data, generating additional routes, and transmitting the additional routes to the user may be repeated one or more times. The number of cycles may depend on the duration of the scavenger hunt. Once the hunt is completed, at step 3108, the processor 202 may select one or more digital and / or physical assets as rewards for the users. The selection of assets may be based on the performance data received for the users upon completion of the hunt route. In one example, the processor 202 may award all participants with a digital asset. In another example, users who achieve a first performance level may be awarded a first digital and / or physical asset, users who achieve a second performance level may be awarded a second digital and / or physical asset, and so on. In another example, the top performers may be awarded a physical asset(s) and the remaining users may be awarded a digital asset(s). In step 3109, the processor 202 may send information regarding the digital and / or physical assets awarded as rewards to the user via the end-user computing device. If the user was awarded a physical asset, the information sent to the end-user computing device may include an image of the asset and instructions on how the user may receive the physical asset. Object location and activation
[0110] When the primary user reaches the location of the virtual object, the location of the object may be identified and the object may be activated. The location may be determined and confirmed by the primary device 1301 and / or an external device (such as the server 1307). As described herein, some assistance by the secondary user(s) may improve the ability to locate the object or may be required for locating the object. Locating the object may require proximity to the object, and the extent of this proximity may improve based on the number, participation, or characteristics of the secondary users. Transmission of image data from the primary device 1301 may also be required for locating, since in one embodiment, the location is shown using augmented reality. Items 1806-1810 in FIG. 18 illustrate the location of the object from the perspective of the display of the primary device 1301. As the user approaches the location of the object, live video is displayed and transmitted by the primary device 1301 at 1806 and 1807, and a ping by the secondary user at 1808 reveals the location of the object. The primary user approaches the object at 1809 and reaches the object at 1810. Once located, in one embodiment the object may be automatically activated when the user is in close proximity, such as at item 1811 in FIG. 18. Items 1906-1907 illustrate the location and activation of the object from the perspective of the secondary device 1302, which also displays live video with augmented reality from the primary device 1301. Items 1812 and 1908 illustrate rewards made available to the primary and secondary users, respectively.
[0111] In another embodiment, one or more users may need to take some additional action to activate the object. For example, the user(s) may need to answer a quiz question or assemble a virtual puzzle in one embodiment. FIG. 27 illustrates an augmented reality depicting a number of virtual items (spheres) that need to be arranged to form a certain shape or virtually "move" to a certain location to activate the object. The primary user may be required to virtually interact with the spheres by physical movements to reposition them. In one embodiment, not all spheres may be displayed to all users, so that cooperation and coordination of all users is required to reposition all of the spheres as needed. In another embodiment, the primary device 1301 (using a capture device) must view the virtual object from a specific perspective to activate the object. FIGS. 28-30 illustrate an augmented reality 3D image that appears in a specific configuration when viewed from the correct perspective. FIG. 28 illustrates a sculpture that appears proper only from a single perspective. As shown in Figures 29 and 30, when viewed from an incorrect angle, the array of spheres appears to be randomly arranged, but as the viewpoint changes, the spheres appear to form a brand logo, thereby activating the object. In further embodiments, one or more users may be required to engage in some activity detected by the activity monitoring apparatus in order to activate the object. Other conditions may be required, including combinations of the conditions described herein. For example, an entire group may be required to activate the object, either as a single condition or in combination with other requirements.
[0112] In other embodiments, the target may not be a virtual object, but may be a physical / tangible object or a geographic location. In such embodiments, the target may further require a specific user action for activation. For example, the target may be a physical object such as a building, monument or other structure, a work of art, a vehicle, or other object, and activation of the target may require photography, or other image capture, of the object. Such image capture may require capturing an image from a particular location or orientation, or capturing an image of a particular portion of the object. As another example, the target may require the presence of a user at a particular location, and activation may be requested once the user reaches the location. As a further example, some or all of the activation techniques described above with respect to virtual objects may be used in conjunction with targets in the form of real objects or particular locations. Search methods involving participatory and / or observing secondary users.
[0113] 31-36 illustrate one embodiment of a method for searching for targets and unlocking rewards in a geographic space using the system 1300 of FIG. 13. FIGS. 31-36 illustrate the method from the perspective of a device with a computer program that enables the device to function as a primary device 1301 or a secondary device 1302 depending on the device's location and / or user selection. In one example, the computer program may be in the form of an application that is provided to be downloaded and / or stored on a mobile device and configured to cause the device to perform the method of FIGS. 31-36 or certain portions thereof. FIGS. 42-51 illustrate display screens that may be displayed by the devices 1301, 1302 in connection with the method of FIGS. 31-36, including the display of user selection options. FIGS. 37-40 illustrate another embodiment of a method for searching for targets and unlocking rewards in a geographic space using the system 1300 of FIG. 13. 37-40 also illustrate the method from the perspective of a device with a computer program that enables the device to function as a primary device 1301 or a secondary device 1302, depending on the device's location and / or user selection. The method in FIGS. 31-40 is shown from the perspective of a user device, and in one embodiment, the user device performs all steps of the method and may utilize information from one or more external devices in its performance. However, it is understood that some or all of the actions described herein may be performed in part or in whole by or may include an exchange of information with an external device, such as an external server or database in communication with the device. It is contemplated that in the course of actions performed by or in conjunction with such external devices, information may be transmitted to, from, and between the external device and the user device. It is also understood that the method of FIGS. 31-40 may include portions of the methods described herein with respect to FIGS. 14-19 and 31, and / or features described herein with respect to FIGS. 20-30.Although not specifically described in Figures 31-40, such methods may utilize augmented reality features in connection with searching for a target and / or activating a target as described herein, and the target may be a virtual object provided using the augmented reality features.
[0114] The method of Figures 31-36 may be configured to perform a targeted search and may utilize one or more different geographic areas to define the user's role. Figure 41 illustrates an example of this configuration. For example, the method may utilize a search area 1308 with defined boundaries such that a user within the search area 1308 qualifies as a primary user or "searcher" (or in one embodiment, the user is required to be a primary user or "searcher"), i.e., the user's device is the primary device 1301. The search area 1308 may be defined such that a user outside the search area 1308 qualifies only as a secondary user, i.e., the user's device is the secondary device 1302. Additionally, in one embodiment, multiple targets 1310 may be provided for the search, and such multiple targets 1310 may be provided in different locations within a single search area 1308, or within multiple different search areas 1308, as shown in Figure 41. The method of Figures 31-36 may utilize a number of different classes of secondary users, including "squadmates" or participating secondary users who may use participating secondary devices 1302A and interact with the searcher and potentially earn rewards if the searcher is successful, and "watchers" or observing secondary users who may use observing secondary devices 1302B and observe the progress of the search but do not benefit from the success of the search. In this embodiment, the method may further use a participation area 1309 with a defined boundary, such that users within the participation area 1309 qualify as participating secondary users. In this configuration, users outside the search area 1308 and participation area 1309 qualify only as observing secondary users. In one embodiment, multiple participation areas 1309 may be provided. Figure 41 illustrates the search area 1308 and participation area 1309 as virtual boundaries defined by a radius from a specified center point, which in one embodiment may be at or near the location of the target 1310.In other embodiments, the areas 1308, 1309 may be defined using different criteria, such as city boundaries, state or country lines, neighborhood boundaries, block-based boundaries, natural boundaries such as rivers or mountains, imaginary boundaries having squares or other simple or complex shapes, or other criteria including arbitrary or irregular boundaries. In further embodiments, the method may be used with only primary users and observing secondary users, such as in Figures 37-40, or the method may be used with only primary users and participating secondary users, without observing secondary users.
[0115] In the exemplary embodiment of FIGS. 31-36, a search area 1308 is defined by or within a specified city, and multiple targets 1310 may be located within the search area 1308, such as different neighborhoods within the city. In this embodiment, a participation area 1309 is defined by or within a second specified city, such that participating users in one city may join teams or "squads" with searchers in the city having the search area 1308 to locate targets 1310 and / or receive rewards from locating or activating targets. This configuration provides users in both the search area 1308 and the participation area 1309 with the ability to potentially receive rewards from locating or activating targets 1310. Additionally, the methods of FIGS. 31-36 provide for the creation of teams by participating users who select searchers by choice, as described herein. In other embodiments, teams may be created using other techniques, including various matching and selection methods, as described herein.
[0116] In the exemplary embodiment of Figures 31-36, the search may have other restrictions in addition to the geographic restrictions, including at least time restrictions and inventory restrictions. The time restrictions may include a start time specification, such that the system does not allow the target to be located or activated before the specified start time, and does not allow the user to provide any information that would allow the user to do so. In this configuration, the user may start the search at any time after the specified start time. The end of the search in the embodiment of Figures 31-36 is subject to inventory restrictions, i.e., the search ends after a specified number of searchers have located or activated the target and / or after a specified number of rewards have been provided. In an embodiment in which multiple targets are provided for the search, each target may be provided with an individual inventory limit, or a collective inventory limit may be provided for all combined targets. In another embodiment, the search may have a time-limited end time instead of an inventory-limited end time, or the search may have both a time limit and an inventory limit, and the search ends if either limit is reached.
[0117] In one embodiment, the method of Figures 31-36 may provide a reward in the form of access to a consumer good to the searcher and possibly some or all of the participating users upon locating or activating the target. The consumer good may be a product that otherwise has limited public access or is not publicly accessible through other channels. For example, the consumer good may be a new product that has not yet been released to the public, and the reward includes access to the product prior to its public release date. In the example screenshots shown in Figures 42-51, the consumer good is a pair of shoes. The access may be in one or more different forms, including exclusive access to a purchase, a voucher for a purchase, a gift or complementary item, or other type of access. In one embodiment, the access or other reward may be provided in a single form, and in another embodiment, the user may select a reward from multiple forms, such as a selection of exclusive access or vouchers. In further embodiments, the reward to the searcher may be provided in one form and the reward to the participating users may be provided in a different form. If the reward is in the form of permitting the purchase of an item, the method may further include an ordering and / or payment screen accessible after the reward has been granted. An inventory of rewards may be maintained in a central server or system database 1307, and rewards may be granted through various devices 1301, 1302 in communication with the server or database.
[0118] As described herein, the method of FIGS. 31-36 may be implemented by a user device 1301, 1302 including a processor 202 and other components in conjunction with a server 111 and / or other external devices. In the embodiment of FIGS. 31-36, the method begins at 2001 with a user first initiating an application on the device. At 2002, it is determined whether the user has used the application before, such determination may include receiving credential information or identifying information by the user, such as, for example, a login ID and password that may be entered into the user device. The information may be checked against information on the server 111. If the user has not used the application before, the device displays introductory information at 2003, which may include, without limitation, welcome information, instructions for use of the application, promotional information, and / or requests user information such as identity or credential information for future use, payment information. The application may require location information of the user device, and in this embodiment, the method includes determining at 2004 whether the user has granted permission to access the location of the user device. If the user has not granted such permission, the method may require access to device location information at 2005, and the application may be configured not to proceed without such access. In one embodiment, the user may be able to provide such access by changing privacy settings on the user device. Once location information is accessible, a determination is made at 2006 whether the location of the user device has already been confirmed, and if not, the location information is received at 2007 and the location is confirmed.
[0119] After verifying the user's location, the system determines whether the user is within a search area at 2008 or determines whether the user is within a participation area at 2009. This determination may be performed by a mobile device in conjunction with the server 111. If the user device location is within the search area 1308, the user is eligible to be a primary user or a searcher. In the embodiment of Figures 31-36, a user within the search area 1308 is a searcher by default and a user within a participation area is a participating user by default. In another embodiment, a user within the search area 1308 can choose to be a searcher or a watching user and / or a user within the participation area 1309 can choose to be a participating user or a watching user. If the search area 1308 and the participation area 1309 overlap, in one embodiment, the user may be a searcher by default or in another embodiment, may be able to choose to be a searcher or a participating user (or potentially a watching user). It is understood that if the user is presented with an option to select a user type, the device may receive a user input for user type selection. When the user type is determined, whether through default or through selection, the process proceeds to FIG. 32 via a searcher path 2010 if the user is a searcher, to FIG. 34 via a participatory path 2011 if the user is a participatory user, or to FIG. 36 via a observing path 2012 if the user is a observing user.
[0120] If the user is assigned to a searcher and the method proceeds via the searcher path 2010, the system may require or allow the user to provide a profile picture and possibly additional identifying information. For example, the system may determine whether the user has previously provided a profile picture at 2013, and if not, the system may prompt the user to upload a profile picture at 2014. The method of Figures 31-36 uses a temporal start restriction, and in this embodiment, the system determines whether the search has been started at 2015. If the start time for the search has not yet been reached, the system may request the user to wait until the start time, and the primary device 1301 may display a wait screen at 2016. In one embodiment, the wait screen may include a countdown, such as a constant countdown or a countdown that begins at a particular time (e.g., one minute or ten seconds) prior to the start time.
[0121] When the search start time arrives, the device displays status and other information in 2017. FIG. 42 illustrates an example of a display screen that may be displayed by the primary device 1301 that includes various search information, including, among other information, potential rewards (in this case, access and purchase price to purchase a particular pair of shoes), the location of the search area 1308, the location area of each target, the inventory of each target, and instructions on how to locate and / or activate the targets. Some or all of the information displayed may be obtained from the server 111. In the embodiment shown in FIG. 42, the search information screen includes location areas for three different targets, identifying the general location area in which each target is located (in this case, the neighborhood), and inventory information associated with each target, which is displayed in FIG. 42 as a percentage of the original inventory of rewards remaining for each target. In this embodiment, each target is associated with the same reward, although in other embodiments, different reward possibilities may be displayed for each virtual item. In addition, in the embodiment of FIG. 42, the search information screen also functions as a selection screen to select among multiple targets for which a search may be performed. The user may select one of the targets by tapping on the appropriate target on the selection screen in FIG. 42, whereby the system receives a selection of a target for the search in 2018. Once a target is selected, the system checks in 2019 whether the target has already been unlocked by the particular searcher, and if so, the method proceeds to step 2030. If the target has not yet been unlocked, the system also determines in 2020 whether inventory is still available for the selected object. In one embodiment, inventory is maintained on the server 111, and the device 1301 communicates with the server to check the status of the inventory. If no inventory remains for the selected object, the method returns in 2017 to the search status screen, and the primary device 1301 may display a message to the user indicating that inventory is not available, i.e., "sold out."If inventory still exists, a search is initiated and the method proceeds through 2010A. It is understood that if inventory runs out before the searcher can locate the target, the server 111 may notify the device 1301 that no inventory remains and the process may be modified accordingly. In one embodiment, the device 1301 may display a notification to the user that inventory associated with the target has run out and the process may return to step 2017.
[0122] In one embodiment, the system may use one or more beacons to aid in location location in the vicinity of the target location, such that the beacon(s) are configured to transmit information to the primary user device 1301. Such beacons may use short-range communication technologies such as WiFi, Bluetooth, Near-Field Communication (NFC) and / or ANT technologies, and if the method uses such beacons, the device 1301 may be required to detect and activate the use of such technologies. If the method proceeds through 2010A, the system may determine in 2021 whether such beacons are being used (and in one embodiment, are required) for target location, and if so, may require activation in 2022 of a feature in the device 1301 that uses such short-range communication. In the illustrated embodiment of FIGS. 31-36, the technology used is Bluetooth. The user may then freely search for and / or attempt to reach the target location, and at 2023 the system may monitor the user's location and provide the user with assistance and / or information related to the search as described herein. In the embodiment of Figs. 31-36, the user may request one or more periodic location checks at 2024, which are received through device 1301. Fig. 44 illustrates an example display screen that provides a button 2025 for the user to request a location check, it being understood that location checks as described herein may be limited in some manner, such as the number or frequency of checks allowed. The button 2025 in Fig. 44 provides distance information when pressed, as shown in Fig. 45, and also provides directional information about the target location. The system may check at 2026 to determine if the user has reached the target location, and if not, provides location information at 2027 to assist the user in locating the target, as described herein. Fig. 45 illustrates an example display screen that provides location information to the user in the form of distance to the target location in response to a location check.Additional location information may also be provided, such as a direction to the target or a route to the target. It is understood that any location information may be provided to the device 1301 from the server 111 in one embodiment. Additionally, in one embodiment, other users (such as participating users 1309) may assist the searcher by providing location information, as described herein.
[0123] When the user reaches the location of the object, the system may request that the user activate the target at 2028, such as through various activation techniques described herein. FIG. 46 illustrates an example display screen that allows the user to indicate that they have reached the target by tapping a button 2029 that reads "ARRIVED." In one embodiment, this action may initiate an activation procedure that may be requested as described herein, while in another embodiment, activation may be accomplished simply by reaching the location and tapping the button 2029. Various activation techniques described herein may be requested, including techniques that utilize image capture and / or augmented reality features. For example, in one embodiment, the user may be requested to photograph or otherwise image capture a particular real or virtual object (e.g., by bringing the object within the camera's field of view) to activate the target and reward. In another embodiment, augmented reality and image capture may not be used, and the user may simply need to reach the target to activate the reward.
[0124] Once the user has located or activated the target, the system may provide a reward to the user, such as by a confirmation sent from the server 111 and received by the device 1301, as described herein, at 2030. In one embodiment, the reward may be exclusive access to purchase a consumer good or a voucher for such product. The device 1301 may display a notification to the user that a prize has been received. FIG. 47 illustrates an example display screen that provides notification of the reward in the form of exclusive access to purchase a commercial good (in this case, a pair of shoes), with an option for the user to select a purchase screen or site, for example, for input of payment information and delivery or store pick-up information. If any participating users are to be rewarded based on the searcher locating or activating the target, the system may also notify and / or provide the reward to such participating users, at 2031. The participating user(s) may, in one embodiment, send a message to the primary user, as described herein. The method may also compile and display information about the search, such as the first user to search for or activate a target, the user who has the fastest time from beginning the search to locating or activating an object, the user who traveled the furthest distance to locate an object, the last user to locate or activate an object, etc. In one embodiment, the system does not compile or display this information until all targets have been located or activated, and this information may be compiled and displayed for each individual object and / or collectively for all objects.
[0125] If the user is assigned to a participating user and the method proceeds via the participation path 2011, the system may require or allow the user to provide a profile picture as well as possibly additional identification information. For example, the system may determine at 2033 whether the user has previously provided a profile picture, and if not, the system may prompt the user to upload a profile picture at 2034. The method of Figures 31-36 uses a time start restriction, and in this embodiment, the system may determine at 2035 whether a search has been started. If the start time of the search has not yet been reached, the system may request the user to wait until the start time, and at 2036 the participating secondary device 1302A may display a wait screen. In one embodiment, the wait screen may include a countdown, such as a constant countdown or a countdown that begins at a particular time (e.g., one minute or ten seconds) prior to the start time. Note that the system may also provide additional instructions for proceeding as a participating user. For example, in one embodiment, device 1302A may notify the user that the user is eligible to receive a reward once 100% of the inventory for all targets is unlocked.
[0126] Once the search start time is reached, the device displays 2037 the status and other information about the search. FIG. 43 illustrates an example of a display screen that may be displayed by a participating secondary device 1302A that includes various search information including, among other information, potential rewards (in this case, access and purchase price to purchase a particular pair of shoes), the location of the search area 1308, the location of the participation area 1309, the location area of each target, and the inventory of each target. In the embodiment shown in FIG. 43, the search information screen includes location areas for three different targets, identifying the general location area in which each target is located (in this case, the neighborhood), and inventory information tied to each target, which is displayed in FIG. 43 as a percentage of the total inventory of rewards unlocked or granted for each target. As described herein, some or all of this information may be provided to the device 1302 from the server 111. In this embodiment, each target is associated with the same reward, although in other embodiments, different reward possibilities may be displayed for each virtual item. Additionally, in the embodiment of FIG. 43, the search information screen also functions as a selection screen for selecting among multiple targets for which a search is to be performed. A user may select to view information about one of the targets, including information about the searcher, who in one embodiment, is searching for the respective target by tapping the appropriate object on the selection screen in FIG. 43. The system thereby receives a selection of one of the targets at 2038. Once a target is selected, the method proceeds to step 2039 in FIG. 35 via 2011A.
[0127] After a target is selected at 2038, the device 1302A displays information about the selected target at 2039, such as the target's general location, inventory information, and other such information. In one embodiment, this information includes a complete or partial list of all searchers designated to search the selected target, as well as additional information about each searcher, such as a photo, status information for the searcher, recent activity by the searcher, and / or the searcher's proximity to the target, which may be qualitative (e.g., close or far) or quantitative (e.g., 0.3 miles away). The information display screen may also double as a searcher selection screen, in one embodiment, providing a participating user with the option to select a searcher to pair with. FIG. 48 illustrates an example display screen that may be displayed by the participating secondary device 1302A, which includes target information, inventory information, and a scrolling list of potential searchers for selection and qualitative proximity information for each searcher. In the embodiment of FIGS. 31-36, only searchers who have not yet located or activated the target are eligible to be selected. The system then receives at 2040 a searcher selection from the participating user through device 1302A and returns at 2041 to the search status screen (FIG. 43). In one embodiment, the system may include requirements that must be met for rewards to be available to the participating users, and the system determines at 2042 whether such requirements have been met and whether rewards are available. Such requirements may include at least that the selected searcher has located or activated the target, and in one embodiment, no participating user is eligible to receive rewards until the search is terminated, i.e., until time or inventory limitations are met.
[0128] When a reward is available, the device 1302A displays a reward notification at 2043 to indicate that the participating user is entitled to the reward and action is required on the part of the participating user to receive the reward. FIG. 49 illustrates an example of a display screen for a reward notification that may be displayed by a participating secondary device 1302A, which requires the user to attempt to receive the reward by pressing an "unlock" button within a time limit. In the example of FIG. 49, if the user does not attempt to secure the reward within the time limit, the reward is not granted and the device 1302A displays a "failed" notification indicating that the reward was not received. If the user attempts to secure the reward, the system determines at 2044 whether the reward has been granted to the participating user. This determination may depend on a number of factors, including whether the searcher selected by the participating user was successful in finding or activating the target, the number of available rewards, the number of participating users eligible to receive the reward, and possibly other considerations. In one embodiment, any participating user who selected a successful searcher (i.e., a searcher who located or activated the target) is eligible to receive the reward. FIG. 35A illustrates one sub-process for determining whether a reward has been granted at 2044. The system first determines at 2045 whether a participating user selected a successful searcher. If not, no reward is granted at 2046. If selected, the participating user is eligible to receive a reward, and the system then determines at 2047 whether the number of available rewards equals or exceeds the number of eligible participating users. If so, all eligible participating users receive the reward at 2048. If not, additional criteria are applied at 2049 to select which eligible users will receive the reward. In one embodiment, reward recipients are randomly selected from a pool of eligible participating users. In other embodiments, other criteria may be applied, such as giving preference to participating users who started the process earlier, granting rewards based on the performance (i.e., speed, distance traveled, etc.) of searchers paired with each participating user, consideration of brand loyalty or other user history, etc.If the reward is not granted to the participating user, the device 1302A displays a "fail" notification that the reward was not received at 2050. If a reward was granted, the user may need to take additional action, such as sending a message (e.g., a credit or thank you message) to a searcher on the same team as the participating user to receive the reward at 2051. The reward is then provided at 2052. Regardless of whether the reward was granted, the post-search information may be compiled and provided at 2053 as described herein. The server 111 may send a confirmation that the reward has been secured and / or in one embodiment, determine whether the reward has been granted.
[0129] If the user is assigned to be an observational user, the method proceeds via an observational path 2012. In one embodiment, the system may request or allow the observational user to provide a profile picture, as well as possibly additional identity information, as described herein. The method of Figures 31-36 uses a time start restriction, and in this embodiment, the system determines whether a search has been started at 2054. If the start time of the search has not yet been reached, the system may request the user to wait until the start time, and the observational secondary device 1302B may display a wait screen at 2055. In one embodiment, the wait screen may include a countdown, such as a constant countdown, or a countdown that begins at a particular time (e.g., one minute or ten seconds) prior to the start time. Note that the system may also provide additional instructions for proceeding as an observational user.
[0130] When the search start time arrives, the device displays at 2056 the status and other information about the search. The display screen that may be displayed by the observing secondary device 1302B may be similar to the search information screen displayed by the participating secondary device 1302A, such as in FIG. 43, and may include the same or similar information. In one embodiment, the search information screen for the observational path includes the same information and layout as in FIG. 43, but with instructions to proceed as an observing user rather than a participating user. In addition, the search information screen may also function as a selection screen to select among multiple targets for which a search is to be performed, similar to the method of the participating device 1302A. The observing user may select to view information about one of the targets, including information about the searcher, who in one embodiment is searching for each target by tapping the appropriate object on the selection screen. The system thereby receives at 2057 a selection of one of the targets, and the device 1302B displays at 2058 information about the selected target. This information may include information displayed by the participating secondary device 1302A, including (among other information) a complete or partial list of all searchers designated to search the selected target, as well as additional information about each searcher, similar to the information illustrated in FIG. 48. Further information about each searcher may be available by selecting a particular searcher. A watchful user may observe the status of the search, each target, and various users throughout the course of the search. Once the search is complete, as determined at 2059, the system may compile and display post-search information at 2060, as described herein.
[0131] 37-40 illustrate another embodiment of a method, which uses many of the features of the method of FIGS. 31-36, but does not incorporate a participating secondary user or participating area 1309. In other words, in the method in FIGS. 37-40, a user is assigned to be either a searcher or a watching secondary user as described herein. As described herein, the method in FIGS. 37-40 may be implemented by a user device 1301, 1302 including a processor 202 and other components in conjunction with a server 111 and / or other external devices. Steps 2061-2068 in FIG. 37 are identical to steps 2001-2008 in FIG. 31 as described herein, and the same variations and alternative embodiments may be used. If the system determines in step 2068 that the user is within the search area 1308, the user is assigned to be a searcher or primary user and proceeds to follow the search path in 2069. If the system determines that the user is not within the search area 1308, the user is assigned to be a observing secondary user and proceeds to follow the observing path at 2070.
[0132] If the user is assigned to a searcher and the method proceeds via searcher path 2069, steps 2071-2078 in FIG. 38 are identical to steps 2013-2020 in FIG. 32 as described herein, and the same variations and alternative embodiments may be used. The reward offered to the searcher in the embodiment of FIG. 37-40 may be in the form of exclusive access to a consumable good or a voucher for a consumable good. In this embodiment, if the system determines in step 2077 that the user has already located or activated the target, the procedure depends on whether the reward is in the form of exclusive access (proceed to 2086A) or a voucher (proceed to 2086B). If the user has not previously located or activated a target, and if in 2078 it is determined that inventory is available for the selected target, the method proceeds to FIG. 39 via 2069A. If the method proceeds through 2069A, steps 2079-2085 are identical to steps 2021-2024 and steps 2026-2028 in Figure 33 as described herein. The system determines whether the reward is provided as exclusive access or as a voucher, at 2086, and determines whether the appropriate reward is available for exclusive access, at 2086A, or for a voucher, at 2086B. In either case, the system may compile and display the post-search information, at 2087, as discussed herein, although this may not occur until the search is completed.
[0133] If the user is assigned to be a viewing user and the method proceeds via viewing path 2070, the viewing path steps (2088-2094) in FIG. 40 are identical to the viewing path steps (2054-2060) in FIG. 36 described herein, and the same variations and alternative embodiments may be used.
[0134] It is understood that all methods described herein may be implemented by a system including a single device 200 or a combination of devices 200, including mobile devices 1301, 1302 (which may be computer devices 114 or portable electronic devices 112), a server 111, or other computing devices described herein. In one embodiment, the mobile devices 1301, 1302 may communicate with the server 111 through a network, such as the functions of the mobile devices 112 and computer devices 114 in FIG. 1. In another embodiment, one device may communicate with a second device through one network, and the second device may communicate with the server 111 through a different network, such as the mobile device 112 communicating through the computer device 114 in FIG. 1. Any or all such devices may comprise a computer program including program code, which when executed by a computing device, causes the device to perform the method and / or communicate with other devices in the implementation of the method. The program may be stored in a (non-transitory) computer-readable recording medium (e.g., memory 212).
[0135] The aspects discussed in this disclosure enhance and encourage collaboration and social interaction between users who have similar interests, including similar brand interests and loyalties. The aspects discussed in this disclosure also provide the ability for remote users to virtually explore areas of a city or other areas that they do not live in, encouraging users to explore their own city as well. The aspects discussed in this disclosure further allow users to have the ability to purchase new or exclusive products through collaboration with other such users, even if they are not physically present at the release of such products. Still further, the aspects discussed in this disclosure provide for the release and sale of new consumer goods, especially high demand products, in a unique and consumer-attractive manner. Additional benefits and advantages of the aspects discussed herein can be recognized by those skilled in the art.
[0136] Several alternative embodiments and examples have been described and illustrated herein. Those skilled in the art will appreciate the features of the individual embodiments and the possible combinations and variations of the components. Those skilled in the art will further appreciate that any of the embodiments may be provided in any combination with other embodiments disclosed herein. It is understood that the present invention may be embodied in other specific forms without departing from its spirit or central characteristics. The present examples and embodiments should therefore be considered in all respects as illustrative and not restrictive, and the present invention should not be limited to the details given herein. The term "plurality" as used herein refers to any number greater than one, disjunctively or conjunctively, as necessary, up to an infinite number. Thus, while specific embodiments have been illustrated and described, numerous modifications are envisioned without significantly departing from the spirit of the present invention, and the scope of protection is limited only by the scope of the claims.
[0137] Exemplary embodiments provide the following:
[0138] A. A method comprising the steps of: determining that a geographic location of a user's mobile device is located within a search area; providing, by the mobile device, information regarding a plurality of targets located at a plurality of different target locations within the search area; receiving, by the mobile device, a user selection of a first target from among the plurality of targets located at the first target location; monitoring the geographic location of the mobile device; providing, by the mobile device, information to the user to assist the user in locating the first target; and providing a reward to the user after the mobile device reaches the first target location, the reward including access to purchase a tangible consumer good or a voucher for purchasing a tangible consumer good.
[0139] B. Method A, tangible consumer goods are clothing.
[0140] C. The method of A or B, further comprising receiving, by the mobile device, a user input to activate the first target when the mobile device reaches a location of the first target.
[0141] D. The method of C, wherein the user input includes using a camera of the mobile device to capture an image of a physical object proximate to the first target location.
[0142] E. The method of any of A-D, wherein the target is a virtual object, and further comprising the steps of displaying by the mobile device an image captured by a camera of the mobile device, and, when the mobile device reaches the location of the first target, modifying the image to include a representation of the virtual object.
[0143] F. Any of the methods of A-E, wherein a limited inventory of the tangible consumer good is associated with each of a plurality of targets, and the information regarding the plurality of targets includes information indicating a quantity of the limited inventory available for each of the plurality of targets.
[0144] G. The method of any of A-F, wherein the steps of determining that the geographic location of the mobile device is located within the search area and monitoring the geographic location of the mobile device are performed by communication between the mobile device and an external device. Further, in any of A-F, or G, the step of providing a reward may be performed by displaying or downloading mobile device data including a voucher, or enabling access to purchase a product.
[0145] H. A method comprising: determining that a geographic location of a user's mobile device is not located within a search area and that the geographic location of the mobile device is located within a participation area, the search area and the participation area being separate geographic areas; providing, by the mobile device, information about a plurality of primary users located within the search area and searching for a first target located at a first target location within the search area; receiving, by the mobile device, a user selection of a first primary user from among the plurality of primary users; providing, by the mobile device, information about the first primary user to the user; and after the first primary user reaches the first target location, providing a reward to the user, the reward including access to purchase a tangible consumer good or a voucher for purchasing a tangible consumer good.
[0146] I. Tangible consumer goods are clothing, method H.
[0147] J. The method of H or I, further comprising receiving, by the mobile device, user input to provide assistance to the first primary user in searching for the first target.
[0148] K. The method of any of H, I, or J, further comprising the step of displaying, by the mobile device, an image captured by the first primary user device of the first primary user while searching for the first target.
[0149] L. The method of any of H-K, further comprising the steps of: providing, by the mobile device, information about a plurality of targets, including a first target, located at a plurality of different target locations within a search area; receiving, by the mobile device, a user selection of the first target from among the plurality of targets; providing, by the mobile device, information about a plurality of primary users, including a first primary user, searching for the first target; and receiving, by the mobile device, a user selection of the first primary user from among the plurality of primary users.
[0150] M. The method of L, wherein a limited inventory of a tangible consumer good is associated with each of a plurality of targets, and the information regarding the plurality of targets includes information indicating a quantity of the limited inventory available for each of the plurality of targets.
[0151] N. The method of L or M, wherein the information about the plurality of primary users includes information indicative of a proximity of each of the primary users to the first target.
[0152] O. The method of M, further comprising the steps of receiving at the mobile device an indication that the limited stock for all of the multiple targets has sold out, and providing a reward to the user after all of the limited stock for all of the multiple targets has sold out.
[0153] In any of H-O, the step of determining that the geographic location of the mobile device is not located within the search area and is located within the participation area may be performed by communication between the mobile device and an external device. Further, in any of H-O, the step of providing a reward may be performed by displaying or downloading mobile device data including a voucher or enabling access to purchase a product.
[0154] P. An apparatus comprising one or more processors and a memory storing computer readable instructions that, when executed by the one or more processors, cause the apparatus to determine that a user's geographic location is located within a search area; provide information about a plurality of targets located at a plurality of different target locations within the search area; receive a user selection of a first target from among the plurality of targets located at the first target location; monitor the user's geographic location; provide information to the user to assist the user in locating the first target; and provide a reward to the user after the user reaches the first target location, the reward including access to purchase a tangible consumer good or a voucher for purchasing the tangible consumer good.
[0155] Q. Tangible consumer goods are clothing, P equipment.
[0156] R. An apparatus of P or Q, the instructions which when executed by the one or more processors cause the apparatus to receive user input to activate the first target when the user reaches the location of the first target.
[0157] S. The device of P, Q, or R, wherein the user input includes using a camera to capture an image of a physical object proximate the first target location.
[0158] T. The apparatus of any of P through S, wherein the target is a virtual object, and further including: displaying an image captured by the user's camera; and, when the user reaches the location of the first target, modifying the image to include a representation of the virtual object.
[0159] U. An apparatus for any of P through T, wherein a limited inventory of a tangible consumer good is associated with each of a plurality of targets, and the information regarding the plurality of targets includes information indicating a quantity of the limited inventory available for each of the plurality of targets.
[0160] V. An apparatus of any of P to U, wherein the apparatus is a mobile device operated by a user and located at the user's geographic location, and determining that the geographic location of the mobile device is located within a search area and monitoring the user's geographic location are performed by communication between the user and an external device.
[0161] An apparatus comprising one or more processors and a memory storing computer-readable instructions, the instructions, when executed by the one or more processors, causing the apparatus to determine that a user's geographic location is not located within a search area and that the user's geographic location is located within a participating area, where the search area and the participating area are separate geographic areas; providing information about a plurality of primary users located within the search area and searching for a first target located at a first target location within the search area; receiving a user selection of a first primary user from among the plurality of primary users; providing information about the first primary user to the user; and providing a reward to the user after the first primary user reaches the first target location, where the reward includes access to purchase a tangible consumer good or a voucher for purchasing the tangible consumer good.
[0162] X. Tangible consumer goods are clothing, W's equipment.
[0163] Y. An apparatus of W or X, the instructions which when executed by the one or more processors further cause the apparatus to receive user input to provide assistance to the first primary user in searching for the first target.
[0164] Z. An apparatus of any of W through Y, wherein the instructions, when executed by one or more processors, cause the apparatus to display an image captured by a first primary user device of a first primary user while searching for a first target.
[0165] ZA. An apparatus of any of W-Z, wherein the instructions, when executed by one or more processors, further cause the apparatus to: provide information about a plurality of targets, including a first target, located at a plurality of different target locations within a search area; receive a user selection of the first target from among the plurality of targets; provide information about a plurality of primary users, including a first primary user, searching for the first target; and receive a user selection of the first primary user from among the plurality of primary users.
[0166] ZB. A ZA device, wherein a limited inventory of a tangible consumer good is associated with each of a plurality of targets, and the information regarding the plurality of targets includes information indicating a quantity of the limited inventory available for each of the plurality of targets.
[0167] ZC. The device of ZA or ZB, wherein the information regarding the plurality of primary users includes information indicating a proximity of each of the primary users to the first target.
[0168] The ZD. instruction, when executed by the one or more processors, further causes the apparatus to receive an indication that limited stock for all of the multiple targets has sold out, and provide a reward to a user after all of the limited stock for all of the multiple targets has sold out.
[0169] ZE. A computer program comprising a program code, which when executed by a mobile device causes the mobile device to perform any of the methods A to O. The program may be stored in a (non-transitory) computer-readable recording medium.
Claims
1. determining, using a location determining device of a user's mobile device, that a geographic location of the mobile device is not located within a search area and that the geographic location of the mobile device is located within a participation area, wherein the search area and the participation area are separate geographic areas; based on determining that the geographic location of the mobile device is not located within the search area and that the geographic location of the mobile device is located within the participation area; receiving, by the mobile device, from a server over a network, information regarding a plurality of primary users located within the search area who are searching for a first target located at a first target location within the search area; accepting, by the mobile device, a user selection selecting a first primary user from the plurality of primary users; receiving, by the mobile device, from the server, information regarding the first primary user; transmitting, by the mobile device, over the network to a secondary device of the first primary user, direction information for moving the first primary user to the first target location; receiving, by the mobile device of the user, data from the secondary device of the first primary user indicating that the first primary user has reached the first target location; causing the mobile device to provide a reward to the user in response to receiving the data indicating that the first primary user has reached the first target location, the reward including access to purchase a tangible consumer good or a voucher for purchasing the tangible consumer good. method.
2. The method of claim 1 , wherein the tangible consumer good is an apparel product.
3. The method of claim 1 , further comprising accepting, by the mobile device, user input that provides assistance to the first primary user in searching for the first target.
4. The method of claim 1 , further comprising displaying, by the mobile device, an image captured by the secondary device of the first primary user while searching for the first target.
5. providing, by the mobile device, information about a plurality of targets, including the first target, located at a plurality of different target locations within the search area; accepting, by the mobile device, a user selection selecting the first target from the plurality of targets; providing information regarding a plurality of primary users, including the first primary user, searching for the first target by the mobile device; and accepting, by the mobile device, a user selection selecting the first primary user from the plurality of primary users. The method of claim 1.
6. 6. The method of claim 5, wherein a limited inventory of the tangible consumer good is associated with each of the plurality of targets, and the information regarding the plurality of targets includes information indicative of an amount of the limited inventory available for each of the plurality of targets.
7. The method of claim 6 , wherein the information regarding the plurality of primary users includes information indicative of a proximity of each of the primary users to the first target.
8. 8. The method of claim 7, further comprising receiving, by the mobile device, an indication that the limited inventory for all of the plurality of targets has been exhausted, and wherein the reward is provided to the user after all of the limited inventory for all of the plurality of targets has been exhausted.
9. one or more processors; and a memory for storing computer readable instructions. An apparatus comprising: The computer readable instructions, when executed by the one or more processors, cause the apparatus to: determining, using a location determining device of a user's mobile device, that the user's geographic location is not located within a search area and that the user's geographic location is located within a participation area, wherein the search area and the participation area are separate geographic areas; based on determining that the geographic location of the mobile device is not located within the search area and that the geographic location of the mobile device is located within the participation area; receiving, by the mobile device, from a server over a network, information regarding a plurality of primary users located within the search area who are searching for a first target located at a first target location within the search area; accepting, by the mobile device, a user selection selecting a first primary user from the plurality of primary users; receiving, by the mobile device, from the server, information regarding the first primary user; transmitting, by the mobile device, over the network to a secondary device of the first primary user, direction information for moving the first primary user to the first target location; receiving, by the mobile device, data from the secondary device of the first primary user indicating that the first primary user has reached the first target location; causing, in response to receiving, by the mobile device, the data indicating that the first primary user has reached the first target location, to provide a reward to the user, the reward including access to purchase a tangible consumer good or a voucher for purchasing the tangible consumer good; Execute the Device.
10. The apparatus of claim 9 , wherein the tangible consumer good is an article of apparel.
11. The computer readable instructions, when executed by the one or more processors, cause the apparatus to: and further causing the mobile device to accept user input that provides assistance to the first primary user in searching for the first target.
10. The apparatus of claim 9.
12. The computer readable instructions, when executed by the one or more processors, cause the apparatus to: and further causing the mobile device to display an image captured by the secondary device of the first primary user while searching for the first target.
10. The apparatus of claim 9.
13. The computer readable instructions, when executed by the one or more processors, cause the apparatus to: providing, by the mobile device, information about a plurality of targets, including the first target, located at a plurality of different target locations within the search area; accepting, by the mobile device, a user selection selecting the first target from the plurality of targets; providing information regarding a plurality of primary users, including the first primary user, searching for the first target by the mobile device; accepting, by the mobile device, a user selection selecting the first primary user from the plurality of primary users; Further execute 10. The apparatus of claim 9.
14. The device described in claim 13, wherein a limited inventory of the tangible consumer good is associated with each of the plurality of targets, and the information regarding the plurality of targets includes information indicating an amount of the limited inventory available for each of the plurality of targets.
15. The apparatus of claim 14 , wherein the information regarding the plurality of primary users includes information indicative of a proximity of each of the primary users to the first target.
16. The computer readable instructions, when executed by the one or more processors, cause the apparatus to: and further comprising receiving, by the mobile device, an indication that the limited inventory for all of the plurality of targets has been exhausted, and the reward is provided to the user after all of the limited inventory for all of the plurality of targets has been exhausted.
15. The apparatus of claim 14.
Citation Information
Patent Citations
Business promotion system using prize supply information and its method
JP2006277124A
Methods, platforms, devices, and systems for mobile device marketing and advertising.
JP2010533326A
Program, information memory medium and game apparatus
JP2013059573A
Game method utilizing map data, game program, game terminal, and game system
JP2017023544A
Mobile Device Marketing and Advertising Platforms, Methods, and Systems
US20090089131A1