Systems and methods for dynamic provision of augmented reality information

Abstract

A method and system for dynamically providing augmented reality information is provided. The method includes acquiring user device-based information from a user device of a user, retrieving rebate information corresponding to the user device-based information, and retrieving user information for the user of the user device. Based on the acquired and retrieved information, the method further tracks movements or activities of the user device and determines whether a predetermined condition is met. If it is determined that the predetermined condition is met, the method displays one or more rebates in augmented reality (AR) on image information displayed on a display of the user device. However, if it is determined that the predetermined condition is not met, the method continues tracking movements or activities of the user device until it is determined that the predetermined condition is met.

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Non-Provisional Patent Application No. 17 / 988,308, filed November 16, 2022, which is incorporated herein by reference in its entirety.

[0002] FIELD OF THE DISCLOSURE The present disclosure generally relates to systems and methods for dynamically providing augmented reality information based on user device-based information. [Background technology]

[0003] The developments described in this section are known to the inventors. However, unless otherwise specified, it should not be assumed that any of the developments described in this section qualify as prior art or that those developments were known to those of skill in the art merely by virtue of being described in this section.

[0004] Currently proposed rebate programs are not user-friendly and require users to research and plan ahead for one or more existing rebates before making a purchase. Once research and planning for existing rebates is done, the discovered rebates may prompt users to take action. If available rebates are not planned ahead, even though rebates may be available for use, the rebates are not acquired for use at the corresponding locations. Furthermore, users may not even know about available rebates or promotions at the retailers or stores they visit until they search for them after visiting the respective retailers or stores. Therefore, distribution of rebate or promotion information is ineffective. Summary of the Invention

[0005] According to one aspect of the present disclosure, there is provided a method for dynamically providing augmented reality information, the method including, using a processor and a memory, acquiring user device-based information from a user device of a user, retrieving rebate information corresponding to the user device-based information, retrieving the user information for the user of the user device, tracking movements or activities of the user device, determining whether a predetermined condition is met, displaying one or more rebates in augmented reality (AR) over image information displayed on a display of the user device if it is determined that the predetermined condition is not met, and continuing to track the movements or activities of the user device until it is determined that the predetermined condition is met.

[0006] According to another aspect of the present disclosure, the user device-based information is image information captured by the user.

[0007] According to another aspect of the present disclosure, the user device-based information is location information.

[0008] According to yet another aspect of the present disclosure, the user device-based information is map information.

[0009] According to another aspect of the present disclosure, the method further includes determining the availability of a special reward corresponding to the one or more rebates, tracking user actions after determining that the predetermined condition is met, and determining whether a condition for activating the special reward is met based on the user actions, wherein the predetermined condition is a predetermined distance from a location of the user device.

[0010] According to a further aspect of the present disclosure, the triggering condition is the performance of a predetermined user movement.

[0011] According to yet another aspect of the present disclosure, the triggering condition is the utterance of a phrase.

[0012] According to a further aspect of the present disclosure, the triggering condition includes being located in a predetermined area.

[0013] According to another aspect of the present disclosure, the method further includes receiving a selection of a rebate from among one or more rebates displayed in augmented reality, and generating a travel route to a retail location corresponding to the selected rebate.

[0014] According to a further aspect of the present disclosure, the method further includes determining whether a purchase has been made at a retailer corresponding to one or more rebates in augmented reality, and if it is determined that a purchase has been made at a retailer corresponding to one or more rebates in augmented reality: applying any applicable rebates and permitting a review of the made purchase.

[0015] According to a further aspect of the present disclosure, the method further includes determining whether a purchase was made at a retailer corresponding to one or more rebates in the augmented reality, and if it is determined that a purchase was not made at a retailer corresponding to one or more rebates in the augmented reality, updating user information based on the non-purchase.

[0016] According to a further aspect of the present disclosure, the method further includes applying one or more artificial intelligence (AI) or machine learning (ML) techniques to provide future rebate offers via augmented reality based on whether the purchase was made at the retail store.

[0017] According to a further aspect of the present disclosure, the displayed image information is a map.

[0018] According to a further aspect of the present disclosure, the displayed image information is an image of one or more retail stores corresponding to the one or more rebates.

[0019] According to a further aspect of the present disclosure, the displayed image information is an image of an area including one or more retail stores that support the one or more rebates.

[0020] According to a further aspect of the present disclosure, the method further includes displaying product offers provided by the retailer corresponding to the one or more rebates.

[0021] According to a further aspect of the present disclosure, the method further includes displaying reviews related to the retailer corresponding to the one or more rebates.

[0022] According to a further aspect of the present disclosure, the method further includes displaying a moving virtual object in augmented reality corresponding to the one or more rebates, the moving virtual object directing the user to a retail store corresponding to the one or more rebates.

[0023] According to another aspect of the present disclosure, a system for dynamically providing augmented reality information is disclosed. The system includes a user device of a user and a server including at least a memory and a processor. The processor is configured to: acquire user device-based information from the user device; retrieve rebate information corresponding to the user device-based information; retrieve the user information of the user of the user device; track movements or activities of the user device; determine whether a predetermined condition is met; if it is determined that the predetermined condition is met, display one or more rebates in an augmented reality (AR) environment on image information displayed on a display of the user device; and, if it is determined that the predetermined condition is not met, continue tracking the movements or activities of the user device until it is determined that the predetermined condition is met.

[0024] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program for dynamically providing augmented reality information is disclosed, wherein the computer program, when executed by a processor, acquires user device-based information from a user device of a user, retrieves rebate information corresponding to the user device-based information, retrieves the user information for the user of the user device, tracks movements or activities of the user device, determines whether a predetermined condition is met, displays one or more rebates in augmented reality (AR) on image information displayed on a display of the user device if it is determined that the predetermined condition is not met, and continues tracking the movements or activities of the user device until it is determined that the predetermined condition is met.

[0025] The present disclosure will be further described in the following detailed description by way of non-limiting examples of preferred embodiments of the present disclosure with reference to the mentioned several drawings, in which like characters represent like elements throughout the several views of the drawings. [Brief explanation of the drawings]

[0026] [Figure 1] 1 illustrates a computer system for implementing a dynamic augmented reality provisioning system (DARPS), according to an exemplary embodiment. [Figure 2] 1 shows an exemplary diagram of a network environment comprising DARPS, according to an exemplary embodiment. [Figure 3] FIG. 1 is a system diagram for implementing DARPS, according to an exemplary embodiment. [Figure 4A] 1 illustrates a method for dynamically providing augmented reality information based on user device information, according to an example embodiment. [Figure 4B]1 illustrates a method for dynamically providing augmented reality information based on user device information, according to an example embodiment. [Figure 5A] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. [Figure 5B] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. [Figure 5C] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. [Figure 5D] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. [Figure 5E] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. [Figure 5F] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. [Figure 5G] 1 illustrates providing augmented reality information in accordance with an exemplary embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0027] It is intended that one or more of the advantages specifically described above and set forth below be derived through one or more of the various aspects, embodiments, and / or specific features or subcomponents of the present disclosure.

[0028] Examples may also be embodied as one or more non-transitory computer-readable media having stored thereon instructions for one or more aspects of the technology as described and illustrated by the examples herein. The instructions in some examples include executable code that, when executed by one or more processors, causes the processors to perform the steps necessary to implement the methodologies of the examples of the technology as described and illustrated herein.

[0029] As is conventional in the field of this disclosure, the exemplary embodiments are described and illustrated in the drawings in terms of functional blocks, units, and / or modules. Those skilled in the art will understand that these blocks, units, and / or modules are physically implemented by electronic (or optical) circuits, such as logic circuits, discrete components, microprocessors, hardwired circuits, memory elements, hardwired connections, etc. These may be formed using semiconductor-based or other manufacturing technologies. When the blocks, units, and / or modules are implemented by microprocessors or the like, they may be programmed using software (e.g., microcode) to perform various functions discussed herein and may optionally be driven by firmware and / or software. Alternatively, each block, unit, and / or module may be implemented by dedicated hardware or as a combination of dedicated hardware that performs some functions and processors (e.g., one or more programmed microprocessors and associated circuitry) that perform other functions. Also, each block, unit, and / or module of the exemplary embodiments may be physically separated into two or more interacting discrete blocks, units, and / or modules without departing from the scope of the inventive concept. Furthermore, the blocks, units, and / or modules of the exemplary embodiments may be physically combined into more complex blocks, units, and / or modules without departing from the scope of the present disclosure.

[0030] FIG. 1 illustrates a computer system for implementing a dynamic augmented reality provision system (DARPS) according to an exemplary embodiment.

[0031] System 100 is shown generally and may include a computer system 102, which is also shown generally. Computer system 102 may include a set of instructions that may be executed to cause computer system 102, alone or in combination with other described devices, to perform any one or more of the methods or computer-based functions disclosed herein. Computer system 102 may operate as a standalone device or may be connected to other systems or peripherals. For example, computer system 102 may include or be included within any one or more computers, servers, systems, communication networks, or cloud environments. Furthermore, the instructions may be operable in such cloud-based computing environments.

[0032] In a networked deployment, computer system 102 may operate in a server capacity or as a client user computer in a server-client user network environment, as a client user computer in a cloud computing environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. Computer system 102, or portions thereof, may be implemented as or incorporated into a variety of devices, such as a personal computer, tablet computer, set-top box, personal digital assistant, mobile device, palmtop computer, laptop computer, desktop computer, communication device, wireless smartphone, personal trusted device, wearable device, global positioning satellite (GPS) device, web appliance, or other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Furthermore, while a single computer system 102 is illustrated, additional embodiments may include any collection of systems or subsystems that individually or collectively execute instructions or perform a function. Throughout this disclosure, the term system is intended to include any collection of systems or subsystems that individually or collectively execute a set or sets of instructions to perform one or more computer functions.

[0033] As shown in FIG. 1 , the computer system 102 may include at least one processor 104. The processor 104 is tangible and non-transitory. As used herein, the term “non-transitory” should be interpreted as a characteristic of a state that persists for a period of time, rather than as a permanent characteristic of a state. The term “non-transitory” specifically disregards fleet characteristics, such as the characteristics of a particular carrier wave or signal, or other form that exists only temporarily at any time and in any place. The processor 104 is an article of manufacture and / or a machine part. The processor 104 is configured to execute software instructions to perform functions as described in various embodiments herein. The processor 104 may be a general-purpose processor or part of an application-specific integrated circuit (ASIC). The processor 104 may also be a microprocessor, microcomputer, processor chip, controller, microcontroller, digital signal processor (DSP), state machine, or programmable logic device. Processor 104 may also be a logic circuit including a programmable gate array (PGA), such as a field programmable gate array (FPGA), or another type of circuit including discrete gate and / or transistor logic. Processor 104 may also be a central processing unit (CPU), a graphics processing unit (GPU), or both. Additionally, any processor described herein may include multiple processors, parallel processors, or both. Multiple processors may be included in or connected to a single device or multiple devices.

[0034] The computer system 102 may also include computer memory 106. The computer memory 106 may include static memory, dynamic memory, or both in communication. Memory, as described herein, is a tangible storage medium capable of storing data and executable instructions and that is non-transitory while the instructions are stored therein. Again, as used herein, the term "non-transitory" should be interpreted as a characteristic of a state that persists for a period of time, rather than as a permanent characteristic of a state. The term "non-transitory" specifically disregards fleet characteristics, such as the characteristics of a particular carrier wave or signal, or other form that exists only temporarily at any place at any time. Memory is an article of manufacture and / or a machine part. Memory, as described herein, is a computer-readable medium from which data and executable instructions can be read by a computer. The memory described herein may be random access memory (RAM), read-only memory (ROM), flash memory, electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disk, cache, removable disk, tape, compact disk, read-only memory (CD-ROM), digital versatile disk (DVD), floppy disk, Blu-ray disk, or any other form of storage medium known in the art. Memory may be volatile or non-volatile, secure and / or encrypted, or unsecure and / or unencrypted. Of course, computer memory 106 may include any combination of memories or may include a single storage.

[0035] The computer system 102 may further include a display 108, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a flat panel display, a solid state display, a cathode ray tube (CRT), a plasma display, or other known display.

[0036] The computer system 102 may also include at least one input device 110, such as a keyboard, a touch-sensitive input screen or pad, voice input, a mouse, a remote control device with a wireless keypad, a microphone connected to a voice recognition engine, a camera such as a video camera or a still camera, a cursor control device, a global positioning system (GPS) device, an altimeter, a gyroscope, an accelerometer, a proximity sensor, or any combination thereof. Those skilled in the art will appreciate that various embodiments of the computer system 102 may include multiple input devices 110. Furthermore, those skilled in the art will appreciate that the exemplary input devices 110 described above are not exhaustive and that the computer system 102 may include any additional or alternative input devices 110.

[0037] Computer system 102 may also include a media reader 112 configured to read any one or more sets of instructions, e.g., software, from any of the memories described herein. The instructions, when executed by the processor, may be used to perform one or more of the methods and processes described herein. In particular embodiments, the instructions may reside completely or at least partially within memory 106, media reader 112, and / or processor 110 during execution by computer system 102.

[0038] Additionally, computer system 102 may include any additional devices, components, parts, peripherals, hardware, software, or any combination thereof commonly known and understood as associated with or included within a computer system, such as, but not limited to, a network interface 114 and output devices 116. Network interface 114 may include, but is not limited to, communications circuitry, a transmitter, or a receiver. Output devices 116 may include, but are not limited to, speakers, audio output, video output, remote control output, printer, or any combination thereof.

[0039] The components of computer system 102 may be interconnected and communicate via a bus 118 or other communication link. As shown in FIG. 1, the components may each interconnect and communicate via an internal bus. However, one skilled in the art will appreciate that any of the components may also be connected via an expansion bus. Furthermore, bus 118 may enable communication via any commonly known and understood standard or other specification, such as, but not limited to, Peripheral Component Interconnect, Peripheral Component Interconnect Express, Parallel Advanced Technology Attachment, Serial Advanced Technology Attachment, etc.

[0040] The computer system 102 may communicate with one or more additional computer devices 120 via a network 122. The network 122 may be, but is not limited to, a local area network, a wide area network, the Internet, a telephone network, a short-range network, or other networks commonly known and understood in the art. A short-range network may include, for example, Bluetooth, Zigbee, infrared, near-field communication, ultraband, or any combination thereof. Those skilled in the art will appreciate that additional known and understood networks 122 may additionally or alternatively be used, and that the illustrative network 122 is not intended to be limiting or exhaustive. Also, while the network 122 is shown in FIG. 1 as a wireless network, those skilled in the art will appreciate that the network 122 may also be a wired network.

[0041] Additional computing device 120 is shown in FIG. 1 as a personal computer. However, those skilled in the art will understand that in alternative embodiments of the present application, computing device 120 may be a laptop computer, a tablet PC, a personal digital assistant, a mobile device, a palmtop computer, a desktop computer, a communications device, a wireless telephone, a personal trusted device, a web appliance, a server, or any other device capable of executing a set of instructions, sequential or otherwise, that specify actions to be taken by the device. Of course, those skilled in the art will understand that the above devices are merely exemplary devices, and that device 120 may be any additional device or equipment commonly known and understood in the art without departing from the scope of the present application. For example, computing device 120 may be the same as or similar to computer system 102. Furthermore, those skilled in the art will also understand that a device may be any combination of devices and equipment.

[0042] Of course, those skilled in the art will understand that the above-described components of computer system 102 are merely exemplary and are not intended to be exhaustive and / or comprehensive. Furthermore, the above-described component examples are also exemplary and similarly not exhaustive and / or comprehensive.

[0043] In accordance with various embodiments of the present disclosure, the methods described herein may be implemented using a hardware computer system executing a software program. Furthermore, in exemplary, non-limiting embodiments, implementations may include distributed processing, component / object distributed processing, and modes of operation with parallel processing capabilities. Virtual computer system processes may be constructed to implement one or more of the methods or functions described herein, and the processors described herein may be used to support virtual processing environments.

[0044] FIG. 2 illustrates an exemplary diagram of a network environment comprising DARPS, according to an exemplary embodiment.

[0045] DARPS 202 may be implemented on one or more computer systems similar to computer system 102 described with respect to FIG.

[0046] DARPS 202 may store one or more applications that include executable instructions that, when executed by DARPS 202, cause DARPS 202 to perform actions, such as, for example, executing, sending, receiving, or otherwise processing network messages, or other actions as described and illustrated below with reference to the figures. Applications may be implemented as modules or components of other applications. Additionally, applications can be implemented as operating system extensions, modules, plug-ins, etc.

[0047] Furthermore, applications may be operable in a cloud-based computing environment or other network environment. Applications may be executed within virtual machines or virtual servers that may be managed in the cloud-based computing environment. Applications, and even DARPS 202 itself, may be located within virtual servers running in the cloud-based computing environment rather than being tied to one or more specific physical network computing devices. Applications may also be executed in one or more virtual machines (VMs) running on DARPS 202. Additionally, in one or more embodiments of the present technology, the virtual machines running on DARPS 202 may be managed or overseen by a hypervisor.

[0048] 2, DARPS 202 is connected to multiple server devices 204(1)-204(n), which host multiple databases 206(1)-206(n), and is also connected to multiple client devices 208(1)-208(n) via communications network 210. According to an exemplary embodiment, databases 206(1)-206(n) may be configured to store data related to a distributed ledger, a blockchain, a user account identifier, a biller account identifier, and a payment provider identifier. A communication interface of DARPS 202, such as network interface 114 of computer system 102 in FIG. 1, operatively connects and communicates between DARPS 202, server devices 204(1)-204(n), and / or client devices 208(1)-208(n), all of which are connected by communication network 210, although other types and / or numbers of communication networks or systems having other types and / or numbers of connections and / or configurations to other devices and / or elements may also be used.

[0049] 1, although DARPS 202, server devices 204(1)-204(n), and / or client devices 208(1)-208(n) may be connected via other topologies. Additionally, network environment 200 may include other network devices, such as, for example, one or more routers and / or switches, which are well known in the art and therefore not described herein.

[0050] By way of example only, communications network 210 may include a local area network (LAN) or a wide area network (WAN) and may use TCP / IP and industry standard protocols over Ethernet, although other types and / or numbers of protocols and / or communications networks may also be used. Communications network 210 in this example may employ any suitable interface mechanism and network communications technology, including, for example, any suitable form of teletraffic (e.g., voice, modem, etc.), a public switched telephone network (PSTN), an Ethernet-based packet data network (PDN), combinations thereof, etc.

[0051] DARPS 202 may be a standalone device or may be integrated with one or more other devices or apparatuses, such as, for example, one or more of server devices 204(1)-204(n). In one particular example, DARPS 202 may be hosted by one of server devices 204(1)-204(n), although other configurations are possible. Furthermore, one or more devices of DARPS 202 may be in the same or different communication networks, including, for example, one or more public, private, or cloud networks.

[0052] The plurality of server devices 204(1)-204(n) may be the same as or similar to the computer system 102 or computer device 120 described with respect to FIG. 1 and may include any feature or combination of features described with respect thereto. For example, any of the server devices 204(1)-204(n) may include, among other features, one or more processors, memory, and communication interfaces connected by a bus or other communication link, although other numbers and / or types of network devices may be used. The server devices 204(1)-204(n) in this example may process requests received from the DARPS 202 over the communication network 210 according to, for example, an HTTP-based protocol, although other protocols may also be used. According to further aspects of the present disclosure, the user interface may be a Hypertext Transfer Protocol (HTTP) web interface, although the disclosure is not limited thereto.

[0053] Server devices 204(1)-204(n) may be hardware or software and may represent a system having multiple servers in a pool, which may include an internal network or an external network. Server devices 204(1)-204(n) host databases 206(1)-206(n) configured to store metadata sets, data quality rules, and newly generated data.

[0054] Although server devices 204(1)-204(n) are illustrated as single devices, one or more actions of each of server devices 204(1)-204(n) may be distributed across one or more separate network computing devices that together comprise one or more of server devices 204(1)-204(n). Furthermore, server devices 204(1)-204(n) are not limited to any particular configuration. Thus, server devices 204(1)-204(n) may include multiple network computing devices that operate using a master / slave scheme, whereby one of the network computing devices of server devices 204(1)-204(n) operates to manage and / or otherwise coordinate the operation of the other network computing devices.

[0055] The server devices 204(1)-204(n) may operate as multiple networked computing devices in, for example, a cluster architecture, a peer-to-peer architecture, a virtual machine, or a cloud architecture. Therefore, the technology disclosed herein should not be construed as being limited to a single environment, and other configurations and architectures are also contemplated.

[0056] The multiple client devices 208(1)-208(n) may be the same as or similar to the computer system 102 or computer device 120 described with respect to Figure 1 and include any feature or combination of features described with respect thereto. A client device in this context refers to any computing device that interfaces with the communications network 210 to obtain resources from one or more server devices 204(1)-204(n) or other client devices 208(1)-208(n).

[0057] According to an exemplary embodiment, client devices 208(1)-208(n) in this example may include any type of computing device capable of facilitating implementation of DARPS 202 that may efficiently provide a platform for implementing a cloud-native DARPS module, although the present disclosure is not limited thereto.

[0058] Client devices 208(1)-208(n) may execute an interface application, such as a standard web browser or standalone client application, that may provide an interface for communicating with DARPS 202 over communications network 210 to communicate user requests. Client devices 208(1)-208(n) may further include, among other features, a display device, such as a display screen or touch screen, and / or an input device, such as a keyboard.

[0059] Although an exemplary network environment 200 having DARPS 202, server devices 204(1)-204(n), client devices 208(1)-208(n), and communication network 210 is described and illustrated herein, other types and / or numbers of systems, devices, components, and / or elements in other topologies may be used. It should be understood that the example systems described herein are for illustrative purposes, and that many variations of the specific hardware and software used to implement the examples are possible, as would be understood by one of ordinary skill in the relevant art.

[0060] For example, one or more of the devices shown in network environment 200, such as DARPS 202, server devices 204(1)-204(n), or client devices 208(1)-208(n), may be configured to operate as virtual instances on the same physical machine. For example, DARPS 202, server devices 204(1)-204(n), or one or more of client devices 208(1)-208(n) may operate on the same physical device rather than as separate devices communicating over communications network 210. Additionally, there may be more or fewer DARPS 202, server devices 204(1)-204(n), or client devices 208(1)-208(n) than shown in FIG. 2 . According to an exemplary embodiment, DARPS 202 may be configured to transmit code at runtime to remote server devices 204(1)-204(n), although the disclosure is not limited in this regard.

[0061] Additionally, in any example, two or more computing systems or devices may be substituted for any one of the systems or devices. Accordingly, principles and advantages of distributed processing, such as redundancy and replication, may also be implemented as desired to enhance the robustness and performance of example devices or systems. Additionally, the present examples may be implemented on computer systems that extend to any suitable network using any suitable interface mechanisms and traffic technologies, including, by way of example only, any suitable form of teletraffic (e.g., voice and modem), wireless traffic networks, cellular traffic networks, packet data networks (PDNs), the Internet, intranets, and combinations thereof.

[0062] FIG. 3 is a system diagram for implementing DARPS, according to an example embodiment.

[0063] As shown in FIG. 3, the system 300 may include a DARPS 302 incorporating API modules 306, a server 304, a database 312, a number of client devices 308(1)...308(n), and a communication network 310.

[0064] According to an exemplary embodiment, DARPS 302, including API module 306, may be connected to server 304 and database 312 via communications network 310. While only one database is shown, the disclosure is not limited in this regard. Any number of databases may be utilized. DARPS 302 may also be connected to multiple client devices 308(1)...308(n) via communications network 310, although the disclosure is not limited in this regard.

[0065] 3 as including API module 306, but may include other rules, policies, modules, databases, or applications, for example. According to an exemplary embodiment, database 312 may be embedded within DARPS 302. According to an exemplary embodiment, database 312 may be configured to store configuration details data, user information data, etc., corresponding to desired data fetched from one or more data sources, although the disclosure is not limited thereto.

[0066] According to an exemplary embodiment, the API module 306 may be configured to receive a real-time feed of data or data at predetermined intervals from multiple client devices 308(1)-308(n) via a communications network 310.

[0067] The API module 306 may be configured to implement a user interface (UI) platform configured to enable DARPS as a service for a desired data processing scheme. The UI platform may include an input interface layer and an output interface layer. The input interface layer may require preset input fields provided by a user according to an automation template selection. The UI platform may receive user input of configuration details corresponding to desired data to be fetched from one or more data sources via the input interface layer. The user may specify, for example, data sources, parameters, destinations, rules, etc. The UI platform may further fetch the desired data from the one or more data sources based on the configuration details utilized for the desired data processing scheme, automatically execute a transformation algorithm on the configuration details and the desired data corresponding to the desired data processing scheme, output the transformed data in a predetermined format, and transmit the transformed data to a downstream application or system via the output interface layer.

[0068] A plurality of client devices 308(1)...308(n) are shown as communicating with DARPS 302. In this regard, the plurality of client devices 308(1)...308(n) may be “clients” of DARPS 302 and are described as such herein. Nevertheless, it is known and understood that the plurality of client devices 308(1)...308(n) are not necessarily “clients” of DARPS 302 or any of the entities described in relation thereto herein. Additional, alternative, or no relationships may exist between either or both of the plurality of client devices 308(1)-308(n) and DARPS 302.

[0069] The first client device 308(1) may be, for example, a smartphone. Of course, the first client device 308(1) may be any additional device described herein. The second client device 308(n) may be, for example, a personal computer (PC). Of course, the second client device 308(n) may be any additional device described herein. According to an exemplary embodiment, the server 304 may be the same as or equivalent to the server device 204 as shown in FIG. 2.

[0070] This process may be performed over a communications network 310, which may include multiple networks as described above. For example, in an exemplary embodiment, one or more of multiple client devices 308(1)...308(n) may communicate with DARPS 302 via broadband or cellular communications. Of course, these embodiments are merely exemplary and not limiting or exhaustive.

[0071] Computing device 301 may be the same as or similar to any one of client devices 208(1)-208(n) described with respect to Figure 2 and include any feature or combination of features described with respect thereto. DARPS 302 may be the same as or similar to DARPS 202 described with respect to Figure 2 and include any feature or combination of features described with respect thereto.

[0072] 4A-4B illustrate a method for dynamically providing augmented reality information based on user device information according to an example embodiment. FIGURES 5A-5G illustrate providing augmented reality information according to an example embodiment.

[0073] In operation S401, user device information is acquired from a user device of a user by a server via a network. According to an exemplary embodiment, the user device information may include, but is not limited to, the location of the user device, images acquired by the user device, map information displayed on the user device, and any information related to the user device. For example, the images acquired by the user device may be images captured in real time or may be pre-captured images. Furthermore, in one example, the location of the user device may be determined by position triangulation using a GPS signal, or the like. According to an exemplary embodiment, the user device may include, but is not limited to, a mobile terminal (e.g., a smartphone, a tablet, a personal digital assistant, a mobile computing device, etc.) and a wearable computing device (e.g., augmented reality eyewear, a smart watch, etc.).

[0074] In operation S402, rebate information corresponding to the user device information is retrieved. According to an exemplary embodiment, the rebate information may include a percentage or amount of a purchase amount that may be returned to the user, reward points, coupons for current or future purchases, etc. Although rebate information is disclosed herein, aspects of the disclosure are not limited thereto, and other promotional / marketing information may be retrieved for presentation in augmented reality. Furthermore, the rebate information may additionally include, but is not limited to, text-based information, image information, video information, holographic, moving images (e.g., two-dimensional or three-dimensional), time limits, etc.

[0075] In operation S403, membership information is retrieved. In one example, memberships corresponding to the retailer and / or payment type for which rebate information was retrieved may be obtained. For example, the membership information may include, but is not limited to, a membership profile, biographical information, collected loyalty / membership points, past purchase information, etc.

[0076] At operation S404, opportunities for special rewards or prizes, if any, are retrieved. According to exemplary embodiments, additional or special rewards or prizes may be offered as promotions to users who perform a particular action or movement or a particular song. Furthermore, special rewards or prizes may be offered as promotions if a user utters a particular phrase or makes a particular gesture. In one example, the performance of a particular action, song, or movement may be designated by a retailer. The performance of such an action may be designated to occur at a particular location or venue. For example, a user may be offered an additional or special reward or prize for performing a Super Mario punch action or a particular gesture designated by the retailer in front of a video game store. In another example, an additional or special reward or prize may be offered to a user who sings a designated song (e.g., a commercial song) or utters a designated phrase (e.g., a brand-related phrase). In yet another example, an additional or special reward or prize may be offered to a user who plays a designated song (e.g., "Saria's Song") on an ocarina.

[0077] Additionally, the availability of special rewards or prizes may be provided in a different form than the rebate information (e.g., different color, different banner, etc.), however, aspects of the present disclosure are not limited in this respect, and this operation may not be performed if no special reward or prize opportunities exist for the retailer.

[0078] At operation S405, movement or activity by the user device is monitored. According to an exemplary embodiment, movement of the user device may be tracked with an accelerometer or camera included in the user device based on location information (e.g., GPS information, location triangulation, etc.) or other location or movement tracking technology. In one example, movement or activity performed by the user device may include moving along a particular path or area or performing a particular action. However, aspects of the present disclosure are not limited in this regard, and movement of the user device may also be tracked using data from an external camera.

[0079] In operation S406, a determination is made as to whether a predetermined condition is met while tracking the movements or activities performed by the user device in operation S405. According to an exemplary embodiment, the predetermined condition may be determined to be met if the user device is detected to be within a predetermined distance of a retailer for which rebate information was retrieved. According to a further embodiment, the predetermined condition may stipulate that the rebate information corresponds to the retrieved membership information. For example, if the rebate information is specific to a particular credit card, the rebate information may be provided only if the membership information identifies that the user owns the particular credit card. Alternatively, if the membership information specifies that the user does not own the particular credit card, the rebate information may be provided along with an option to register for the particular credit card. Furthermore, if the user device is detected to have performed a particular activity, it may further be determined that a predetermined condition for displaying an earned special reward or prize has also been met. According to an exemplary embodiment, the predetermined condition may be system-specified, user-specified, or retailer-specified.

[0080] If it is determined that the predetermined condition is not met, the method returns to operation S405 to continue tracking the movement or activity performed on the user device. On the other hand, if it is determined that the predetermined condition is met, the method proceeds to operation S407 to overlay and display augmented reality information. According to exemplary aspects, the augmented reality information may be displayed on an image provided on a display of the user device. In one example, the image provided on the display of the user device may include an image captured via a camera of the user device or a corresponding device. According to further aspects, the augmented reality may be provided in a text format, an image format (e.g., a still image or a moving image), a video format, a holographic format, or the like. Furthermore, the augmented reality may be provided in a single or multiple windows or panes, or the like. For example, the augmented reality may be provided as a virtual object (e.g., a virtual ninja character) running toward a store (e.g., a comic book store) offering a rebate.

[0081] For example, as shown in FIG. 5A, if a user device is determined to be within a predetermined distance of a retailer that has a corresponding rebate or other promotional information, the rebate or promotional information may be displayed in augmented reality on the user device's display. Further, in one example, if the user device's display is off, a notification that a rebate is available may be displayed before the augmented reality information is displayed. As shown in FIG. 5A, the rebate information, along with review information, may be provided on a real-world image of the respective retailer, along with the retailer's logo.

[0082] Alternatively, when a retailer's name or logo is captured by the user device's camera, the rebate or promotional information may be displayed in augmented reality (AR) on the user device's display. For example, the user device may perform image recognition on the words or logo captured by the user device and retrieve the corresponding rebate or promotional information for display in augmented reality. In one example, the user device may perform image recognition based on the entire retailer's name, as shown in FIG. 5A, or based on a partial image of the retailer's name, as shown in FIG. 5B. Furthermore, as shown in FIG. 5B, the augmented reality information may be positioned on different portions of the display to provide a simultaneous view of the real-world image of the retailer's name or logo and the corresponding augmented reality information. According to an exemplary embodiment, the image recognition performed may identify the location of the retailer's name on the displayed image and provide the corresponding augmented reality information in a location on the display that does not obstruct the display of the real-world image.

[0083] In addition to the above, as shown in FIG. 5C, multiple companies with rebate information may be recognized and displayed simultaneously.

[0084] However, aspects of the present disclosure are not limited in this regard, and rebate or promotional information may be displayed without the retailer's name or logo. As shown in FIG. 5D , an image of a particular location or landmark may be sufficient to identify a retailer within a predetermined distance that may be associated with a rebate or promotional offer. The retailer's identification may be displayed in augmented reality along with other relevant information (e.g., address, hours of operation, phone number, etc.). Furthermore, the display of the rebate or promotional information in augmented reality may be triggered when it is determined that the user device is moving toward a particular area (e.g., a city, shopping center, tourist attraction, hotel, or other area of ​​interest).

[0085] In addition to the above, additional information corresponding to a retailer may be displayed in augmented reality. As exemplarily shown in FIG. 5E, information related to the retailer may be displayed along with rebate information in multiple information panels. According to exemplary embodiments, the display of the corresponding information may be initiated simultaneously with the rebate or promotion information. Alternatively, the corresponding information may be displayed in response to a selection of the corresponding rebate or promotion displayed in augmented reality. As shown in FIG. 5E, the information related to the retailer may include recent reviews that may be displayed in one panel of augmented reality information, and an image of the restaurant or a dish offered by the restaurant along with its business hours may be displayed in another panel. However, aspects of the present disclosure are not limited in this regard, and the additional information may be provided or the augmented reality information may be displayed in any suitable manner.

[0086] As shown in FIG. 5F, the augmented reality generated retail store information may indicate the presence of a message directed to the user. In one example, the message may be generated by an employee, a friend, a contact, a member of a social group, etc. Additionally, the message may include reviews or recommendations of the store, specific products, etc. Additionally, the message may include additional transferable promotions, points, virtual items, etc.

[0087] 5G, the augmented reality generated information may also provide rebate information along with various images of products for purchase. In one example, the various images may show popular items, recently released items, or items selectively selected for the user based on past shopping history using one or more artificial intelligence (AI) or machine learning (ML) algorithms. Additionally, options may be provided to send or leave messages, manage social networks, and visit the retailer's online store.

[0088] In operation S408, movements or activities by the user device are monitored. For example, movements or activities performed may include approaching a retail store, entering a particular store, or performing a designated activity to receive a special reward / prize.

[0089] In operation S409, the augmented reality information may be updated based on the movement or activity performed in operation S408. For example, if the movement or activity performed indicates that the user device has entered retail store A, the augmented reality information for other retail stores may be removed from the display. Additionally, additional information for retail store A may be provided, such as reviews, promotional items, availability of special reward(s) or prize(s), terms and conditions for obtaining, etc.

[0090] At operation S410, a selection of one or more rebates to be displayed is received. For example, the selection of one or more rebates may be detected from among retailers within a predetermined radius (e.g., 0.5 miles) of the user offering rebates. According to an exemplary embodiment, upon receiving such a selection, non-selected rebate information may be temporarily hidden. Alternatively, selected rebate offers may be highlighted and non-selected rebate offers may be grayed out. However, aspects of the present disclosure are not limited in this respect, and any display method that distinguishes between selected and non-selected retailers may be utilized.

[0091] At operation S411, a route may be generated based on the selection information received at operation S410. According to an exemplary embodiment, the route may be generated based on shortest distance, ease of the route, density of people along the route, location of nearby landmarks or other popular places, etc. Additionally, a route may be generated for multiple selections. For example, a route may be generated based on priorities set by a user, stock levels of promotional items, expiration dates of rebates, preferred routes, etc.

[0092] In operation S412, movement or activity is tracked. According to an exemplary embodiment, movement or activity may be tracked based on location information of a user device operated or worn by a user. In one example, the user device may include, but is not limited to, a mobile terminal, a smart watch, augmented reality glasses, other wearable electronic devices, etc. The tracked movement or activity may include, but is not limited to, direction of travel, pace of travel, number of steps, one or more body movements, heart rate, other biometric information, etc.

[0093] In operation S413, it is determined whether a prize or reward activation condition has been met. According to an exemplary embodiment, the activation condition may include, but is not limited to, entering a particular store or retailer, saying a particular phrase, performing a particular action (e.g., performing a particular movement) within a predetermined distance of the respective store or retailer, using a particular form of payment, using a loyalty membership, etc. However, aspects of the present disclosure are not so limited, and any activation condition may be specified by the retailer or affiliated organization. Furthermore, if no prize or reward is offered, this step may not be performed.

[0094] If it is determined at operation S413 that the trigger condition is not met, the method returns to operation S412. On the other hand, if it is determined at operation S413 that the trigger condition is met, then at operation S414, a predetermined prize or reward is activated or generated for presentation to the user. According to exemplary embodiments, the prize or reward may be in physical or digital form and may be designated or provided by a retailer or affiliated organization. In one example, the reward or prize may be provided independent of or only upon purchase at a particular retailer. Such requirements may be specified by the respective retailer or by a system administrator.

[0095] In operation S415, it is further determined whether a purchase was made to qualify for the rebate specified in the rebate information. If it is determined that the user did not make a final purchase, in operation S417, the user information is updated to reflect visits to the retailer offering the rebate and the user's disinterest. Based on the aggregation of such information, one or more artificial intelligence (AI) or machine learning (ML) algorithms may be applied to provide tailored rebate information to the user. For example, an AI or ML algorithm may determine that a particular user is interested in certain types of retailers and not others, and adjust the display of the augmented reality information accordingly. In one example, certain rebate information may be hidden or its display may be adjusted (e.g., enlarged text, highlighted, bordered, text shading, etc.). Furthermore, AI or ML algorithms may be utilized to provide differentiated offers to users. For example, greater promotions or differentiated prizes / rewards may be offered to different users based on the user's shopping history, value to the retailer, timing of last purchase, etc.

[0096] Generally, an AI or ML algorithm may be implemented to perform data pattern detection and provide an output or render a decision based on the data pattern detection. More specifically, an output may be provided based on historical patterns of data, such that with more or more recent data, a more accurate output and / or decision may be provided or rendered. Thus, an ML or AI model may be constantly updated after a predetermined number of runs or iterations. According to exemplary aspects, machine learning may refer to a computer algorithm that may automatically improve through the use of data. A machine learning algorithm may build an initial model based on sample or training data and may be iteratively improved as additional data is acquired.

[0097] More specifically, machine learning / artificial intelligence and pattern recognition may include supervised learning algorithms, such as k-medoids analysis, regression analysis, decision tree analysis, random forest analysis, k-nearest neighbor analysis, logistic regression analysis, k-fold cross-validation analysis, balanced class weight analysis, etc. In another exemplary embodiment, the machine learning analysis techniques may include unsupervised learning algorithms, such as apriori analysis, k-means clustering analysis, etc. In another exemplary embodiment, the machine learning analysis techniques may include reinforcement learning algorithms, such as Markov decision process analysis.

[0098] In another exemplary embodiment, the ML or AI model may be based on a machine learning algorithm, which may include at least one of a process and a set of rules for a computer to follow in calculations and other problem-solving operations, such as, for example, a linear regression algorithm, a logistic regression algorithm, a decision tree algorithm, and / or a Naive Bayes algorithm.

[0099] In another exemplary embodiment, the ML or AI model may include a training model, such as a machine learning model, that is generated to be further trained with additional data. Once the training model is sufficiently trained, it may be deployed to various connected systems for use. In another exemplary embodiment, the training model may be sufficiently trained when a model evaluation method, such as a holdout method, a k-fold cross-validation analysis method, or a bootstrap method, determines that at least one of the least squares error rate, true positive rate, true negative rate, false positive rate, and false negative rate of the training model is within a predetermined range.

[0100] In another exemplary embodiment, the trained model may be operational, i.e., actively used by the organization, as it continues to train using new data. In another exemplary embodiment, the ML or AI model may be generated using at least one of artificial neural network techniques, decision tree techniques, support vector machine techniques, Bayesian network techniques, and genetic algorithm techniques.

[0101] On the other hand, if it is determined in operation S415 that a purchase was made at a retailer offering a rebate, the user may be permitted to enter a review of their experience for display in augmented reality in operation S416. The review may be automatically fed to the user's social connections and groups. Additionally, the user information or profile may be updated using one or more AI or ML algorithms to reflect the purchase and corresponding rebates and prizes / rewards for adjustment of future rebate or prize / reward offers to the user.

[0102] Further, once the rebate has been applied and a review of the purchase is permitted in operation S416, the method proceeds to operation S417 to reflect the purchase at the retailer offering the rebate. Based on such aggregation of information, one or more AI or ML algorithms may be applied to provide tailored rebate information to the user. For example, an AI or ML algorithm may determine that a particular user is interested in certain types of retailers and not others, and adjust the display of the augmented reality information accordingly. In one example, a particular rebate information may be promoted, highlighted, or displayed differently (e.g., enlarged text, highlighting, changing borders, shading text, etc.). Additionally, AI or ML algorithms may be utilized to provide differentiated offers to users. For example, greater promotions or differentiated prizes / rewards may be offered to different users based on the user's shopping history, value to the retailer, timing of last purchase, etc.

[0103] While the present invention has been described with reference to certain illustrative embodiments, it should be understood that the words that have been used are words of description and illustration, rather than words of limitation. Changes may be made, within the purview of the appended claims, as presently described and as amended, without departing from the scope and spirit of the invention. While the invention has been described with reference to particular means, materials, and embodiments, the invention is not intended to be limited to the details disclosed; rather, the invention extends to all functionally equivalent structures, methods, and uses, such as are within the scope of the appended claims.

[0104] For example, while a computer-readable medium may be described as a single medium, the term "computer-readable medium" includes a single medium or multiple media, such as a centralized or distributed database, and / or associated caches and servers that store one or more sets of instructions. The term "computer-readable medium" is also intended to include any medium capable of storing, encoding, or carrying a set of instructions for execution by a processor or that causes a computer system to perform any one or more of the embodiments disclosed herein.

[0105] The computer-readable medium may include non-transitory computer-readable medium(s) and / or may include transitory computer-readable medium(s). In certain non-limiting exemplary embodiments, the computer-readable medium may include solid-state memory, such as a memory card or other package containing one or more non-volatile read-only memories. Further, the computer-readable medium may be random access memory or other rewritable volatile memory. In addition, the computer-readable medium may include magneto-optical or optical media, such as disks or tapes, or other storage devices for capturing carrier wave signals, such as signals communicated over transmission media. Thus, the present disclosure is deemed to include any computer-readable medium or other equivalent and successor medium on which data or instructions may be stored.

[0106] Although this application describes particular embodiments that may be implemented as a computer program or code segments in a computer-readable medium, it should be understood that dedicated hardware implementations, such as application-specific integrated circuits, programmable logic arrays, and other hardware devices, may be constructed to implement one or more of the embodiments described herein. Applications that may include the various embodiments described herein broadly include various electronic and computer systems. Thus, this application may encompass software, firmware, and hardware implementations, or combinations thereof. Nothing in this application should be interpreted as being or being operable solely in software rather than hardware.

[0107] Although this specification describes components and functions that may be implemented in particular embodiments with reference to particular standards and protocols, the present disclosure is not limited to such standards and protocols. Such standards are periodically superseded by faster, more efficient equivalents having essentially the same functionality. Accordingly, replacement standards and protocols having the same or similar functionality are considered equivalents thereof.

[0108] The illustrations of the embodiments described herein are intended to provide a general understanding of various embodiments. The illustrations are not intended to serve as a complete description of all of the elements and features of apparatus and systems that utilize the structures or methods described herein. Many other embodiments will be apparent to those skilled in the art upon reviewing this disclosure. Other embodiments can be utilized and derived from this disclosure, such that structural and logical substitutions and changes can be made without departing from the scope of the disclosure. Additionally, the illustrations are representative only and may not be drawn to scale. Certain proportions within the illustrations may be exaggerated, while others may be minimized. Therefore, the disclosure and the diagrams should be considered illustrative and not limiting.

[0109] One or more embodiments of the present disclosure may be individually and / or collectively referred to herein by the term "invention," but this is for convenience only and is not intended to voluntarily limit the scope of the present application to any particular invention or inventive concept. Furthermore, while specific embodiments have been illustrated and described herein, it should be understood that any subsequent configurations designed to achieve the same or similar purpose may be substituted for the specific embodiment illustrated. The present disclosure is intended to cover any and all adaptations or variations of the various embodiments. Combinations of the above embodiments with other embodiments not specifically described herein will be apparent to those skilled in the art upon review of the description.

[0110] The Abstract of the disclosure is submitted with the understanding that it will not be used to interpret or limit the claims or their meaning. Moreover, in the foregoing Detailed Description, various features may be grouped together or described in a single embodiment for the purpose of streamlining the disclosure. This disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter may be directed to less than all features of any of the disclosed embodiments. Accordingly, the following claims are incorporated into the Detailed Description, with each claim standing on its own as defining separately claimed subject matter.

[0111] The above disclosed subject matter is illustrative and not limiting, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments that fall within the true spirit and scope of the present disclosure. Accordingly, the scope of the present disclosure, to the maximum extent permitted by law, should be determined by the broadest permissible interpretation of the following claims and their equivalents, and should not be limited or constrained by the foregoing detailed description.

Claims

1. 1. A method for dynamically providing augmented reality information, comprising: Obtaining user device-based information from a user device of the user; retrieving rebate information corresponding to the user device-based information; retrieving user information for the user of the user device; Tracking the movements or activities of the user device; Determining whether a predetermined condition is met; If it is determined that the predetermined condition is satisfied, displaying one or more rebates in augmented reality (AR) on the image information displayed on the display of the user device; and if it is determined that the predetermined condition is not satisfied, continuing to track the movement or activity of the user device until it is determined that the predetermined condition is satisfied; A method comprising:

2. The method of claim 1 , wherein the user device-based information is image information captured by the user.

3. The method of claim 1 , wherein the user device-based information is location information.

4. The method of claim 1 , wherein the user device-based information is map information.

5. determining the availability of special rewards corresponding to said one or more rebates; tracking user actions after determining that the predetermined condition is met; and determining whether the special reward activation condition is met based on the user's action; further comprising the predetermined condition is a predetermined distance from the location of the user device; The method of claim 1.

6. The method of claim 5 , wherein the triggering condition is the performance of a predetermined user movement.

7. The method of claim 5 , wherein the triggering condition is the utterance of a phrase.

8. The method of claim 1 , wherein the triggering condition includes being located in a predetermined area.

9. receiving a rebate selection from among one or more rebates displayed in augmented reality; and generating a travel route to a retail location corresponding to the selected rebate; The method of claim 1 further comprising:

10. Determining whether a purchase has been made at a retail store corresponding to one or more rebates in augmented reality; and If it is determined that a purchase was made at a retailer that supports one or more augmented reality rebates: Apply any applicable rebates; and Allowing reviews of said purchases; The method of claim 1 further comprising:

11. Determining whether a purchase has been made at a retail store corresponding to one or more rebates in augmented reality; and If it is determined that no purchase was made at a retail store corresponding to one or more augmented reality rebates, updating the user information based on the no purchase being made; The method of claim 1 further comprising:

12. 12. The method of claim 11, further comprising applying one or more artificial intelligence (AI) or machine learning (ML) techniques to provide future rebate offers via augmented reality based on whether the purchase was made at the retail store.

13. The method of claim 1 , wherein the displayed graphical information is a map.

14. The method of claim 1 , wherein the displayed graphical information is an image of one or more retail stores corresponding to the one or more rebates.

15. The method of claim 1 , wherein the displayed graphical information is an image of an area including one or more retail stores that offer the one or more rebates.

16. The method of claim 1 , further comprising displaying product offers provided by retailers that correspond to the one or more rebates.

17. The method of claim 1 , further comprising displaying a review of a retailer corresponding to the one or more rebates.

18. 10. The method of claim 1, further comprising: displaying a moving virtual object in augmented reality corresponding to the one or more rebates, the moving virtual object directing a user to a retail store corresponding to the one or more rebates.

19. 1. A system for dynamically providing augmented reality information, comprising: a user device of the user; A server including at least a memory and a processor, the processor comprising: Obtaining user device-based information from the user device; retrieving rebate information corresponding to the user device-based information; retrieving user information for the user of the user device; Tracking the movements or activity of the user device; Determine whether a predetermined condition is met; If it is determined that the predetermined condition is satisfied, displaying one or more rebates in augmented reality (AR) on the image information displayed on the display of the user device; and if it is determined that the predetermined condition is not satisfied, continuing to track the movement or activity of the user device until it is determined that the predetermined condition is satisfied; a server configured to: A system including:

20. 1. A non-transitory computer-readable storage medium storing a computer program for dynamically providing augmented reality information, the computer program, when executed by a processor, comprising: Obtaining user device-based information from a user device of the user; Search for corresponding rebate information; Retrieving user information; Tracking the movements or activities of the user device; Determining whether a predetermined condition is met; If it is determined that the predetermined condition is met, displaying one or more rebates in augmented reality on the displayed image information; and if it is determined that the predetermined condition is not satisfied, continuing tracking until it is determined that the predetermined condition is satisfied; A non-transitory computer-readable storage medium for executing a process including:

Images