System and method for dynamically providing augmented reality information

Abstract

A method and system for dynamically providing augmented reality information is provided. The method includes obtaining user device-based information from a user device of a user, retrieving rebate information corresponding to the user device-based information, and retrieving user information of a user of the user device. Based on the acquired and retrieved information, the method also tracks movement or activity of the user device and determines whether a predetermined condition is satisfied. When it is determined that the predetermined condition has been satisfied, the method displays one or more rebate in an augmented reality manner on image information displayed on a display of the user device. When it is determined that the predetermined condition is not satisfied, the method continues to track the movement or activity of the user equipment until it is determined that the predetermined condition is satisfied.

Description

[0001] Cross - Reference to Related Applications

[0002] This application claims the benefit of U.S. Non - Provisional Patent Application No. 17 / 988,308, filed on November 16, 2022, which is hereby incorporated by reference in its entirety. Technical Field

[0003] The present disclosure generally relates to systems and methods for dynamically providing augmented reality information based on information of a user device. Background Art

[0004] The developments described in this section are known to the inventors. However, unless otherwise stated, it should not be assumed that any development described in this section constitutes prior art solely because it is included in this section, nor should it be assumed that these developments are known to a person of ordinary skill in the art.

[0005] Currently provided rebate programs are not user - friendly. It is necessary to pre - study and plan before shopping to understand one or more existing rebates. When studying and planning existing rebates, the discovered rebates may drive user behavior. If no available rebates are pre - planned, even if there may be available rebates, the rebates will not be obtained and used at the corresponding place. In addition, users may not even know that there are any available rebates or promotions at the retailer or store they may be visiting until they search for them after visiting the corresponding retailer or store. Therefore, the distribution of rebate or promotion information is ineffective. Summary of the Invention

[0006] According to one aspect of the present disclosure, a method for dynamically providing augmented reality information is provided. The method includes performing, using a processor and a memory: obtaining information of a user device based on the user device from a user; retrieving rebate information corresponding to the information of the user device based on the user device; retrieving user information of the user of the user device; tracking the movement or activity of the user device; determining whether a predetermined condition is met; when it is determined that the predetermined condition has been met, displaying one or more rebates in an augmented reality manner on image information displayed on a display of the user device; and when it is determined that the predetermined condition is not met, continuing to track the movement or activity of the user device until it is determined that the predetermined condition is met.

[0007] According to another aspect of the present disclosure, the information of the user device based on the user device is image information captured by the user.

[0008] According to another aspect of the present disclosure, the information of the user device based on the user device is location information.

[0009] According to yet another aspect of the present disclosure, the information of the user device based on the user device is map information.

[0010] According to another aspect of the present disclosure, the method further includes determining the availability of a special reward corresponding to one or more rebates; tracking user actions after determining that the predetermined conditions have been met; and determining whether the activation conditions for the special reward have been met based on the user actions, wherein the predetermined condition is a predetermined distance from the location of the user device.

[0011] According to another aspect of the present disclosure, the activation condition is the performance of a predetermined user movement.

[0012] According to still another aspect of the present disclosure, the activation condition is to say a specific phrase.

[0013] According to another aspect of the present disclosure, the activation condition includes being located in a predetermined area.

[0014] According to another aspect of the present disclosure, the method further includes: receiving a selection of a rebate from among one or more rebates displayed in an augmented reality manner; and generating a travel path to the location of the retailer corresponding to the selected rebate.

[0015] According to another aspect of the present disclosure, the method further includes: determining whether a purchase has been made at a retailer corresponding to the one or more rebates in the augmented reality; and when it is determined that a purchase has been made at the retailer corresponding to the one or more rebates in the augmented reality: applying the applicable rebate and allowing the purchase to be evaluated.

[0016] According to another aspect of the present disclosure, the method further includes: determining whether a purchase has been made at a retailer corresponding to the one or more rebates in the augmented reality; and when it is determined that no purchase has been made at the retailer corresponding to the one or more rebates in the augmented reality, updating the user information based on the non - purchase.

[0017] According to another aspect of the present disclosure, the method further includes: applying one or more artificial intelligence (AI) or machine learning (ML) based on whether the purchase has been made at the retailer, for providing future rebate offers via augmented reality.

[0018] According to another aspect of the present disclosure, the displayed image information is a map.

[0019] According to another aspect of the present disclosure, the displayed image information is an image of one or more retailers corresponding to the one or more rebates.

[0020] According to another aspect of the present disclosure, the displayed image information is an image of an area including one or more retailers corresponding to the one or more rebates.

[0021] According to another aspect of the present disclosure, the method further includes: displaying product offers provided by retailers corresponding to the one or more rebates.

[0022] According to another aspect of the present disclosure, the method further includes: displaying reviews of retailers corresponding to the one or more rebates.

[0023] According to another aspect of the present disclosure, the method further includes: displaying a mobile virtual object corresponding to the one or more rebates in an augmented reality manner, wherein the mobile virtual object guides the user to a retailer corresponding to the one or more rebates.

[0024] According to another aspect of the present disclosure, a system for dynamically providing augmented reality information is disclosed. The system includes: a user's user device; and a server including at least a memory and a processor. The processor is configured to perform: obtaining information based on the user device from the user device; retrieving rebate information corresponding to the information based on the user device; retrieving user information of the user of the user device; tracking the movement or activity of the user device; determining whether a predetermined condition is met; when it is determined that the predetermined condition has been met, displaying one or more rebates in an augmented reality manner on the image information displayed on the display of the user device; and when it is determined that the predetermined condition is not met, continuing to track the movement or activity of the user device until it is determined that the predetermined condition is met.

[0025] According to another aspect of the present disclosure, a non - transitory computer - readable storage medium storing a computer program for dynamically providing augmented reality information is disclosed. When the computer program is executed by a processor, it: obtains information based on the user device from the user's user device; retrieves rebate information corresponding to the information based on the user device; retrieves user information of the user of the user device; tracks the movement or activity of the user device; determines whether a predetermined condition is met; when it is determined that the predetermined condition has been met, displays one or more rebates in an augmented reality manner on the image information displayed on the display of the user device; and when it is determined that the predetermined condition is not met, continues to track the movement of the user device until it is determined that the predetermined condition is met. Description of the Drawings

[0026] In the following detailed description, which refers to the multiple drawings mentioned, the present disclosure is further described by way of non - limiting examples of preferred embodiments of the present disclosure, wherein, in all views of the drawings, the same characters represent the same elements.

[0027] Figure 1Shows a computer system for implementing a dynamic augmented reality provisioning system (DARPS) according to an exemplary embodiment.

[0028] Figure 2 Shows an example diagram of a network environment with DARPS according to an exemplary embodiment.

[0029] Figure 3 Shows a system diagram for implementing DARPS according to an exemplary embodiment.

[0030] Figures 4A to 4B Shows a method for dynamically providing augmented reality information based on user device information according to an exemplary embodiment.

[0031] Figures 5A to 5G Shows the provision of augmented reality information according to an exemplary embodiment. Detailed Description

[0032] According to one or more aspects of the present disclosure, embodiments and / or specific features or sub-components of the present disclosure are intended to bring one or more of the advantages specifically described above and mentioned below.

[0033] Examples can also be embodied as one or more non-transitory computer-readable media having instructions stored thereon for one or more aspects of the techniques described and illustrated by the examples herein. In some examples, the instructions include executable code that, when executed by one or more processors, causes the processors to perform the steps necessary to implement the example methods of the techniques described and illustrated herein.

[0034] As is traditional in the art of the present disclosure, example embodiments are described in terms of functional blocks, units, and / or modules and illustrated in the figures. Those skilled in the art will understand that these blocks, units, and / or modules are physically implemented by electronic (or optical) circuits, such as logic circuits, discrete components, microprocessors, hardwired circuits, memory elements, wiring connections, etc., which may be formed using semiconductor-based manufacturing technology or other manufacturing technologies. In the case where the blocks, units, and / or modules are implemented by a microprocessor or the like, they may be programmed with software (e.g., microcode) to perform the various functions discussed herein and may optionally be driven by firmware and / or software. Alternatively, each block, unit, and / or module may be implemented by dedicated hardware or as a combination of dedicated hardware performing some functions and a processor (e.g., one or more programmed microprocessors and associated circuits) performing other functions. Moreover, without departing from the scope of the inventive concept, each block, unit, and / or module of the example embodiments may be physically divided into two or more interacting and discrete blocks, units, and / or modules. Additionally, without departing from the scope of the present disclosure, the blocks, units, and / or modules of the example embodiments may be physically combined into more complex blocks, units, and / or modules.

[0035] Figure 1 A computer system for implementing a dynamic augmented reality provisioning system (DARPS) according to an exemplary embodiment is shown.

[0036] System 100 is generally shown and may include what is generally referred to as computer system 102. Computer system 102 may include an instruction set that may be executed to cause computer system 102 to perform any one or more of the methods or computer-based functions disclosed herein, either alone or in combination with other described devices. Computer system 102 may operate as a stand-alone device or may be connected to other systems or peripheral devices. For example, computer system 102 may include or be included in any one or more computers, servers, systems, communication networks, or cloud environments. Further, the instructions may operate in such a cloud-based computing environment.

[0037] In a networked deployment, computer system 102 can operate in the capacity of a server or as a client user computer in a server-client user network environment, as a client user computer in a cloud computing environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. Computer system 102 or portions thereof can be implemented as or incorporated into various devices, such as a personal computer, tablet computer, set-top box, personal digital assistant, mobile device, handheld computer, laptop computer, desktop computer, communication device, wireless smart phone, personal trust device, wearable device, global positioning satellite (GPS) device, web appliance, or any other machine capable of (sequentially or otherwise) executing a set of instructions that specify actions to be taken by that machine. Additionally, although a single computer system 102 is shown, additional embodiments can include any collection of systems or subsystems that individually or jointly execute instructions or perform functions. Throughout this disclosure, the term system should be regarded as including any collection of systems or subsystems that individually or jointly execute one or more sets of instructions to perform one or more computer functions.

[0038] As Figure 1 shown, computer system 102 can include at least one processor 104. Processor 104 is tangible and non-transitory. As used herein, the term "non-transitory" should not be construed as a permanent property of a state, but rather as a property of a state that will persist for a period of time. The term "non-transitory" specifically excludes transient properties, such as the properties of a particular carrier wave or signal, or other forms of properties that exist only temporarily at any given time and place. Processor 104 is a manufactured product and / or a machine component. Processor 104 is configured to execute software instructions to perform the functions described in various embodiments herein. Processor 104 can be a general-purpose processor or can be part of an application specific integrated circuit (ASIC). Processor 104 can also be a microprocessor, microcomputer, processor chip, controller, microcontroller, digital signal processor (DSP), state machine, or programmable logic device. Processor 104 can also be a logic circuit that includes a programmable gate array (PGA), such as a field programmable gate array (FPGA), or can be another type of circuit that includes discrete gates and / or transistor logic. Processor 104 can be a central processing unit (CPU), a graphics processing unit (GPU), or both. Additionally, any processor described herein can include multiple processors, parallel processors, or both. Multiple processors can be included in a single device or multiple devices, or can be coupled to a single device or multiple devices.

[0039] The computer system 102 may also include a computer memory 106. The computer memory 106 may include static memory, dynamic memory, or both in communication connection. The memories described herein are tangible storage media that can store data and executable instructions and are non-transitory during the time the instructions are stored therein. Again, the term "non-transitory" as used herein should not be construed as a permanent property of a state, but rather as a property of a state that will persist for a period of time. The term "non-transitory" specifically excludes transient properties such as the properties of a particular carrier wave or signal or other forms of properties that exist only temporarily at any given time and place. The memory is a manufactured product and / or a machine component. The memories described herein are computer-readable media from which a computer can read data and executable instructions. The memory as described herein may be random access memory (RAM), read-only memory (ROM), flash memory, electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, caches, removable disks, magnetic tapes, compact disc read-only memory (CD-ROM), digital versatile disc (DVD), floppy disks, Blu-ray discs, or any other form of storage medium known in the art. The memory may be volatile or non-volatile, secure and / or encrypted, insecure and / or unencrypted. Of course, the computer memory 106 may include any combination of memories or individual storage devices.

[0040] The computer system 102 may further include a display 108, such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), a flat panel display, a solid state display, a cathode ray tube (CRT), a plasma display, or any other known display.

[0041] The computer system 102 may also include at least one input device 110, such as a keyboard, a touch-sensitive input screen or tablet, voice input, a mouse, a remote control device with a wireless keypad, a microphone coupled to a voice recognition engine, a camera (such as a video camera or a still camera), a cursor control device, a global positioning system (GPS) device, an altimeter, a gyroscope, an accelerometer, a proximity sensor, or any combination thereof. Those skilled in the art will understand that various embodiments of the computer system 102 may include multiple input devices 110. In addition, those skilled in the art should also understand that the exemplary input devices 110 listed above are not meant to be exhaustive, and the computer system 102 may include any additional or alternative input devices 110.

[0042] The computer system 102 may also include a media reader 112 configured to read any one or more instruction sets, such as software, from any of the memories described herein. When executed by the processor, the instructions can be used to perform one or more of the methods and processes described herein. In a particular embodiment, during execution by the computer system 102, the instructions may reside, in whole or at least in part, within the memory 106, the media reader 112, and / or the processor 110.

[0043] In addition, the computer system 102 may include any additional devices, components, parts, peripherals, hardware, software, or any combination thereof that are commonly known and understood to be included in or within a computer system, such as, but not limited to, a network interface 114 and an output device 116. The network interface 114 may include, but is not limited to, communication circuitry, a transmitter, or a receiver. The output device 116 may be, but is not limited to, a speaker, an audio output, a video output, a remote control output, a printer, or any combination thereof.

[0044] Each component of the computer system 102 may be interconnected and communicate via a bus 118 or other communication link. As Figure 1 shown, the components may be interconnected and communicate via an internal bus. However, those skilled in the art will understand that any component may also be connected via an expansion bus. In addition, the bus 118 may enable communication via any commonly known and understood standard or other specification, such as, but not limited to, Peripheral Component Interconnect, Peripheral Component Interconnect Express, Parallel Advanced Technology Attachment, Serial Advanced Technology Attachment, etc.

[0045] The computer system 102 may communicate with one or more additional computer devices 120 via a network 122. The network 122 may be, but is not limited to, a local area network, a wide area network, the Internet, a telephone network, a short-range network, or any other network commonly known and understood in the art. The short-range network may include, for example, Bluetooth, Zigbee, infrared, near field communication, ultra-wideband, or any combination thereof. Those skilled in the art will understand that additional networks 122 that are known and understood may be used additionally or alternatively, and the exemplary network 122 is not restrictive or exhaustive. Moreover, although the network 122 is shown as a wireless network in Figure 1 it will be understood by those skilled in the art that the network 122 may also be a wired network.

[0046] The additional computer devices 120 are in Figure 1is shown as a personal computer. However, those skilled in the art should understand that in alternative embodiments of the present application, the computer device 120 can be a laptop computer, a tablet PC, a personal digital assistant, a mobile device, a palmtop computer, a desktop computer, a communication device, a wireless phone, a personal messaging device, a web appliance, a server, or any other device capable of sequentially or otherwise executing a set of instructions specifying actions to be taken by the device. Of course, those skilled in the art should understand that the devices listed above are merely exemplary devices, and the device 120 can be any additional device or apparatus commonly known and understood in the art, as long as it does not depart from the scope of the present application. For example, the computer device 120 can be the same as or similar to the computer system 102. In addition, those skilled in the art similarly understand that the device can be any combination of devices and apparatuses.

[0047] Of course, those skilled in the art should understand that the components of the computer system 102 listed above are merely exemplary and are not intended to be exhaustive and / or comprehensive. In addition, the examples of the components listed above are also intended to be exemplary and similarly are not intended to be exhaustive and / or comprehensive.

[0048] According to various embodiments of the present disclosure, the methods described herein can be implemented using a hardware computer system that executes software programs. In addition, in exemplary non-limiting embodiments, the implementation can include distributed processing, component / object distributed processing, and an operating mode with parallel processing capabilities. A virtual computer system process can be constructed to implement one or more of the methods or functions described herein, and the processors described herein can be used to support a virtual processing environment.

[0049] Figure 2 An example diagram of a network environment with DARPS according to an exemplary embodiment is shown.

[0050] DARPS 202 can be implemented using one or more computer systems similar to the computer system 102 described with respect to Figure 1 described.

[0051] DARPS 202 can store one or more applications that can include executable instructions that, when executed by DARPS 202, cause DARPS 202 to perform actions such as executing, transmitting, receiving, or otherwise processing network messages, etc., for example, performing other actions described and illustrated below with reference to the accompanying drawings. The application can be implemented as a module or component of other applications. In addition, the application can be implemented as an operating system extension, a module, a plug-in, etc.

[0052] Further, the application may operate in a cloud-based computing environment or other network environment. The application may execute within or as a virtual machine or virtual server that is manageable within a cloud-based computing environment. Additionally, the application, and even DARPS 202 itself, may be located within a virtual server operating within a cloud-based computing environment rather than being tied to one or more specific physical network computing devices. Further, the application may run within one or more virtual machines (VMs) executing on DARPS 202. Additionally, in one or more embodiments of the present technology, virtual machines running on DARPS 202 may be managed or supervised by a hypervisor.

[0053] In Figure 2 network environment 200 of, DARPS 202 is coupled to a plurality of server devices 204(1)-204(n) that host a plurality of databases 206(1)-206(n), and is also coupled via a communication network 210 to a plurality of client devices 208(1)-208(n). According to an exemplary aspect, databases 206(1)-206(n) may be configured to store data related to distributed ledgers, blockchains, user account identifiers, ledger party account identifiers, and payment provider identifiers. A communication interface of DARPS 202 (such as Figure 1 network interface 114 of computer system 102 of) is operatively coupled and communicative between DARPS 202, server devices 204(1)-204(n), and / or client devices 208(1)-208(n), all of which are coupled together via communication network 210, although other types and / or amounts of communication networks or systems with other types and / or amounts of connections and / or configurations to other devices and / or elements may also be used.

[0054] Communication network 210 may be the same or similar to network 122 as described with respect to Figure 1 although DARPS 202, server devices 204(1)-204(n), and / or client devices 208(1)-208(n) may be coupled together via other topologies. Additionally, network environment 200 may include other network devices, such as one or more routers and / or switches, which are well known in the art and thus will not be described further herein.

[0055] By way of example only, communication network 210 may include a local area network (LAN) or a wide area network (WAN), and may use TCP / IP over Ethernet and industry standard protocols, although other types and / or amounts of protocols and / or communication networks may be used. The communication network 210 in this example may employ any suitable interface mechanism and network communication technology, including, for example, telecommunications services in any suitable form (e.g., voice, modem, etc.), a public switched telephone network (PSTN), an Ethernet-based packet data network (PDN), and combinations thereof, among others.

[0056] For example, DARPS 202 may be a stand-alone device or integrated with one or more other devices or apparatuses, such as one or more of server devices 204(1)-204(n). In a particular example, DARPS 202 may be hosted by one of server devices 204(1)-204(n), and other arrangements are also possible. Additionally, for example, one or more devices of DARPS 202 may be in the same or different communication networks, which may include one or more public networks, private networks, or cloud networks.

[0057] The multiple server devices 204(1)-204(n) may be the same as or similar to the computer system 102 or computer device 120 as described with respect to Figure 1 including any features or combinations of features described thereof. For example, among other features, any one of server devices 204(1)-204(n) may include one or more processors, a memory, and a communication interface coupled together via a bus or other communication link, although other amounts and / or types of network devices may also be used. In this example, the server devices 204(1)-204(n) may process requests received from DARPS 202 via the communication network 210, for example, according to an HTTP-based protocol, although other protocols may also be used. According to another aspect of the present disclosure, the user interface may be a hypertext transfer protocol (HTTP) web interface, but the present disclosure is not limited thereto.

[0058] The server devices 204(1)-204(n) may be hardware or software, or may represent a system having multiple servers in a pool, which may include internal or external networks. The server devices 204(1)-204(n) host databases 206(1)-206(n), which are configured to store metadata sets, data quality rules, and newly generated data.

[0059] Although the server devices 204(1)-204(n) are shown as a single device, one or more actions of each of the server devices 204(1)-204(n) may be distributed across one or more different network computing devices, which together include one or more of the server devices 204(1)-204(n). Additionally, the server devices 204(1)-204(n) are not limited to a particular configuration. Thus, the server devices 204(1)-204(n) may comprise multiple network computing devices operating using a master / slave method, whereby one of the network computing devices of the server devices 204(1)-204(n) operates to manage and / or otherwise coordinate the operation of the other network computing devices.

[0060] For example, the server devices 204(1)-204(n) may operate as multiple network computing devices within a cluster architecture, a peer-to-peer architecture, a virtual machine, or a cloud architecture. Thus, the techniques disclosed herein should not be construed as limited to a single environment, and other configurations and architectures are also contemplated.

[0061] The multiple client devices 208(1)-208(n) may also be the same as or similar to the computer system 102 or the computer device 120 as described with respect to Figure 1 including any features or combinations of features described thereof. A client device in this context refers to any computing device that interfaces with the communication network 210 to obtain resources from one or more of the server devices 204(1)-204(n) or other client devices 208(1)-208(n).

[0062] According to an exemplary embodiment, the client devices 208(1)-208(n) in this example may include any type of computing device capable of facilitating the implementation of the DARPS 202, which may effectively provide a platform for implementing a cloud-native DARPS module, but the present disclosure is not limited thereto.

[0063] The client devices 208(1)-208(n) may run an interface application, such as a standard web browser or a stand-alone client application, which may provide an interface to communicate with the DARPS 202 via the communication network 210 for communicating user requests. Among other features, for example, the client devices 208(1)-208(n) may also include a display device (such as a display screen or a touch screen) and / or an input device (such as a keyboard).

[0064] Although an exemplary network environment 200 having DARPS 202, server devices 204(1)-204(n), client devices 208(1)-208(n), and a communication network 210 is described and illustrated herein, other types and / or quantities of systems, devices, components, and / or elements in other topologies may be used. It should be understood that, as would be understood by those of ordinary skill in the relevant art, the systems of the examples described herein are for exemplary purposes, as many variations of the specific hardware and software used to implement the examples are feasible.

[0065] For example, one or more of the devices depicted in network environment 200 (such as DARPS 202, server devices 204(1)-204(n), or client devices 208(1)-208(n)) may be configured to operate as virtual instances on the same physical machine. For example, one or more of DARPS 202, server devices 204(1)-204(n), or client devices 208(1)-208(n) may operate on the same physical device rather than communicate as separate devices via communication network 210. Additionally, there may be more or fewer DARPS 202, server devices 204(1)-204(n), or client devices 208(1)-208(n) than Figure 2 shown. According to an exemplary embodiment, DARPS 202 may be configured to send code to remote server devices 204(1)-204(n) at runtime, but the present disclosure is not limited thereto.

[0066] Furthermore, for any one of the computing systems or devices in any of the examples, it may be replaced by two or more computing systems or devices. Thus, the principles and advantages of distributed processing (such as redundancy and replication) may also be implemented as needed to improve the robustness and performance of the example devices and systems. The examples may also be implemented on a computer system that is extended over any suitable network using any suitable interface mechanism and business technology, including, for example, telecommunications services, wireless service networks, cellular service networks, packet data networks (PDNs), the Internet, intranets, and combinations thereof, in any suitable form (such as voice and modems).

[0067] Figure 3 A system diagram for implementing DARPS according to an exemplary embodiment is shown.

[0068] As Figure 3 shown, system 300 may include DARPS 302, a server 304, a database 312, a plurality of client devices 308(1)…308(n), and a communication network 310 in which a set of API modules 306 are embedded.

[0069] According to an exemplary embodiment, the DARPS 302 including the API module 306 can be connected to the server 304 and the database 312 via the communication network 310. Although only one database is shown, the present disclosure is not limited thereto. Any number of databases can be utilized. The DARPS 302 can also be connected to a plurality of client devices 308(1)…308(n) via the communication network 310, but the present disclosure is not limited thereto.

[0070] According to an exemplary embodiment, the DARPS 302 is described and shown in Figure 3 as including the API module 306, although it can include, for example, other rules, policies, modules, databases, or applications. According to an exemplary embodiment, the database 312 can be embedded within the DARPS 302. According to an exemplary embodiment, the database 312 can be configured to store configuration detail data, user information data, etc. corresponding to the desired data to be extracted from one or more data sources, but the present invention is not limited thereto.

[0071] According to an exemplary embodiment, the API module 306 can be configured to receive data or a real-time feed of data from a plurality of client devices 308(1)…308(n) at a predetermined interval via the communication network 310.

[0072] The API module 306 can be configured to implement a user interface (UI) platform, which is configured to enable the DARPS to act as a service for a desired data processing scenario. The UI platform can include an input interface layer and an output interface layer. The input interface layer can request preset input fields provided by the user according to the selection of an automation template. The UI platform can receive user input of configuration detail data corresponding to the desired data to be extracted from one or more data sources via the input interface layer. The user can specify, for example, data sources, parameters, destinations, rules, etc. The UI platform can also extract the desired data from the one or more data sources based on the configuration detail data to be used for the desired data processing scenario, automatically implement a transformation algorithm for the desired data corresponding to the configuration detail data and the desired data processing scenario to output the transformed data in a predefined format, and transmit the transformed data to a downstream application or system via the output interface layer.

[0073] Multiple client devices 308(1)…308(n) are illustrated as communicating with DARPS 302. In this regard, the multiple client devices 308(1)…308(n) may be “clients” of DARPS 302 and are described as such herein. However, it should be known and understood that the multiple client devices 308(1)…308(n) are not necessarily “clients” of DARPS 302 or any entity described in connection herewith. Any additional or alternative relationship may exist between any one or both of the multiple client devices 308(1)…308(n) and DARPS 302, or no relationship may exist between them.

[0074] The first client device 308(1) may be, for example, a smart phone. Of course, the first client device 308(1) may be any additional device described herein. The second client device 308(n) may be, for example, a personal computer (PC). Of course, the second client device 308(n) may also be any additional device described herein. According to an exemplary embodiment, the server 304 may be the same as or equivalent to the server device 204 as Figure 2 shown.

[0075] This process may be performed via a communication network 310, which may include multiple networks as described above. For example, in an exemplary embodiment, one or more of the multiple client devices 308(1)…308(n) may communicate with DARPS 302 via broadband or cellular communication. Of course, these embodiments are merely exemplary and not restrictive or exhaustive.

[0076] The computing device 301 may be the same as or similar to any one of the client devices 208(1)-208(n) as described with respect to Figure 2 including any features or combinations of features described thereof. The DARPS 302 may be the same as or similar to the DARPS 202 as described with respect to Figure 2 including any features or combinations of features described thereof.

[0077] Figures 4A to 4B A method for dynamically providing augmented reality information based on user device information according to an exemplary embodiment is shown. Figures 5A to 5G The provision of augmented reality information according to an exemplary embodiment is shown.

[0078] In operation S401, the server obtains user device information from the user's user device via a network. According to an exemplary aspect, the user device information may include, but is not limited to, the location of the user device, an image captured by the user device, map information displayed on the user device, and any information related to the user device. For example, the image captured by the user device may be a real-time captured image or a pre-captured image. Additionally, in an example, the location of the user device may be determined using a GPS signal, by position triangulation, etc. According to an exemplary aspect, the user device may include, but is not limited to, a mobile terminal (e.g., a smart phone, a tablet computer, a personal digital assistant, a mobile computing device, etc.) and a wearable computing device (e.g., augmented reality glasses, a smart watch, etc.).

[0079] In operation S402, rebate information corresponding to the user device information is retrieved. According to an exemplary aspect, the rebate information may include a percentage or amount of the purchase amount that can be provided back to the user, reward points, coupons for current or future purchases, etc. Although rebate information is disclosed herein, aspects of the present disclosure are not limited thereto, such that other promotional / marketing information may be retrieved for providing in an augmented reality manner. Additionally, the rebate information may further include, but is not limited to, text-based information, image information, video information, holograms, moving images (e.g., two-dimensional or three-dimensional), time limits, etc.

[0080] In operation S403, member information is retrieved. In an example, a member corresponding to the retailer and / or payment form for which the rebate information is retrieved may be obtained. For example, the member information may include, but is not limited to, a member profile, personal basic information, accumulated loyalty / member points, previous purchase information, etc.

[0081] In operation S404, a special reward or reward opportunity is retrieved, if available. According to an exemplary aspect, an additional or special reward or incentive may be provided promotionally to a user who performs certain actions or movements or sings certain songs. Additionally, a special reward or incentive may be provided promotionally to a user who states a specific phrase or makes a specific gesture. In an example, certain actions, songs, or movements that need to be performed may be specified by the retailer. The performance of these behaviors may be specified to be carried out at a specific location or venue. For example, if a user completes a Super Mario punching action or makes a specific gesture specified by the retailer in front of a video game retailer, an additional or special reward or incentive may be obtained. In another example, if a user sings a specified song (e.g., a commercial) or states a specified phrase (e.g., a brand-related phrase), an additional or special reward or incentive may be obtained. In yet another example, if a user plays a specified song (e.g., Saria's Song) on an ocarina, an additional or special reward or incentive may be obtained.

[0082] In addition, the availability of special rewards or incentives can be provided in a form different from the rebate information (e.g., different colors, different promotional identifiers, etc.). However, aspects of the present disclosure are not limited thereto, such that if there are no special reward or incentive opportunities for the retailer, this operation may not be performed.

[0083] In operation S405, the movement or activity performed by the user device is monitored. According to an exemplary aspect, based on location information (e.g., GPS information, location triangulation, etc.) or other location or movement tracking technologies, the accelerometer or camera included in the user device can be utilized to track the movement of the user device. In an example, the movement or activity performed by the user device can include movement along a specific path or area, or the execution of a specific action. However, aspects of the present disclosure are not limited thereto, such that data from an external camera can also be used to track the movement of the user device.

[0084] In operation S406, when the movement or activity performed by the user device is tracked in operation S405, it is determined whether a predetermined condition is met. According to an exemplary aspect, if the user device is detected to be within a predetermined distance of the retailer from which the rebate information was retrieved, it can be determined that the predetermined condition has been met. According to other aspects, the predetermined condition can specify that the rebate information corresponds to the retrieved membership information. For example, if the rebate information is specific to a particular credit card, the rebate information can be provided only if the membership information indicates that the user has that particular credit card. Or, if the membership information indicates that the user does not have that particular credit card, the rebate information and an option to register for that particular credit card can be provided. In addition, if the user device is detected to perform a specific activity, it can further be determined that a predetermined condition for displaying a won special reward or incentive is also met. According to an exemplary aspect, the predetermined condition can be system-specified, user-specified, or retailer-specified.

[0085] If it is determined that the predetermined condition is not met, the method returns to operation S405 to continue tracking the movement or activity performed by the user device. On the other hand, if it is determined that the predetermined condition has been met, the method proceeds to operation S407 to display augmented reality information in an overlay manner. According to an exemplary aspect, the augmented reality information can be displayed on an image provided on the display of the user device. In an example, the image provided on the display of the user device can include an image captured via the camera of the user device or a corresponding device. According to a further aspect, the augmented reality can be provided in a text format, an image format (e.g., still or moving), a video format, a hologram format, etc. In addition, the augmented reality can be provided on a single or multiple windows or panes, etc. For example, the augmented reality can be provided as a virtual object (e.g., a virtual ninja character) that runs towards the store offering the rebate (e.g., a comic book store).

[0086] For example, as Figure 5AAs shown, when it is determined that the user device is within a predetermined distance of a retailer with corresponding rebate or other promotional information, the rebate or promotional information can be displayed on the display of the user device in an augmented reality manner. Additionally, in the example, if the display of the user device is in the off state, a notification of rebate availability can be pushed first, and then the augmented reality information can be displayed. As Figure 5A shown, the rebate information, the logo of the retailer, and the review information can be provided on the real-world image of the corresponding retailer.

[0087] Alternatively, when the name or logo of a retailer is captured by the camera of the user device, the rebate or promotional information can be displayed on the display of the user device in an augmented reality manner. For example, the user device can perform image recognition on the word or logo captured by the user device and retrieve the corresponding rebate or promotional information for display in an augmented reality manner. In the example, the user device can perform image recognition based on the whole of the name of the retailer as Figure 5A shown or based on a partial image of the name of the retailer as Figure 5B shown. Additionally, as Figure 5B shown, the augmented reality information can be located in different areas of the display, so that while presenting the real-world image of the name or logo of the retailer, the corresponding augmented reality information is synchronously displayed. According to an exemplary aspect, image recognition can be performed to confirm the position of the name of the retailer on the displayed image, and the corresponding augmented reality information is presented on the display at a position that does not block the display of the real-world image.

[0088] In addition to the above, multiple enterprises with rebate information can be simultaneously recognized and displayed, as Figure 5C shown.

[0089] However, aspects of the present disclosure are not limited thereto, such that the rebate information or promotional information can be displayed in the absence of the name or logo of the retailer. As Figure 5D shown, an image of a certain location or landmark may be sufficient to identify retailers within a predetermined range that can be associated with rebate or promotional offers. The logo of the retailer and other relevant information (such as address, business hours, phone number, etc.) can be displayed in an augmented reality manner. Additionally, when it is determined that the user device is moving towards a specific area (such as a city, shopping mall, tourist attraction, hotel, or other area of interest), the display of the rebate or promotional information in an augmented reality manner can be triggered.

[0090] In addition to the above, additional information corresponding to the retailer can also be displayed in an augmented reality manner. As Figure 5EAs exemplarily shown, information related to a retailer can be displayed in a plurality of information panels together with rebate information. According to an exemplary aspect, the display of corresponding information can be initiated simultaneously with rebate or promotional information. Alternatively, the corresponding information can be displayed in response to a selection of the corresponding rebate or promotion displayed in an augmented reality manner. As Figure 5E shown, the information related to the retailer can include recent reviews that can be displayed in one panel of the augmented reality information, while an image of the restaurant or the dishes served by the restaurant and the business hours can be displayed on another panel. However, aspects of the present disclosure are not limited thereto, such that additional information can be provided and the augmented reality information can be displayed in any suitable manner.

[0091] As Figure 5F shown, the information generated for the retailer in augmented reality can also indicate the presence of a message for the user. In an example, the message can be generated by an employee, a friend or contact, a member of a social group, etc. Additionally, the message can include reviews or recommendations of a store, a particular item, etc. Additionally, the message can additionally include transferable promotions, points, virtual items, etc.

[0092] Additionally, as Figure 5G shown, the information generated in augmented reality can provide rebate information as well as images of various products to be purchased. In an example, the various images can indicate popular items, recently sold items, or items that can be selectively picked for the user based on a previous shopping history using one or more artificial intelligence (AI) or machine learning (ML) algorithms. Additionally, options for sending a message or leaving a note, managing a social network, and accessing the retailer's online store can be provided for selection.

[0093] In operation S408, the movement or activity performed by the user device is monitored. For example, the movement or activity performed can include approaching a retailer or entering a specific store, performing a designated activity to obtain a special reward / bonus, etc.

[0094] In operation S409, the augmented reality information can be updated based on the movement or activity performed in operation S408. For example, if the movement or activity performed indicates that the user device has entered retailer A, the augmented reality information of other retailers can be removed from the display. Additionally, additional information about retailer A can be provided. For example, reviews, promotional items, the availability of special rewards or bonuses, and the conditions for obtaining them, etc.

[0095] In operation S410, a selection of one or more rebates shown is received. For example, among the retailers offering rebates within a predetermined radius (e.g., 0.5 miles) of the user, a selection of one or more rebates can be detected. According to an exemplary aspect, when such a selection is received, the unselected rebate information can be temporarily hidden from the view. Alternatively, the selected rebate offers can be highlighted, and / or the unselected rebate offers can be grayed out. However, aspects of the present invention are not limited thereto, such that any display method can be utilized to show the difference between the selected retailers and the unselected retailers.

[0096] In operation S411, a path can be generated based on the selection information received in operation S410. According to an exemplary aspect, the path can be generated based on the shortest distance, ease of the path, density of people along the path, location of local landmarks or other popular places, etc. Additionally, paths can be generated for multiple selections. For example, the paths can be generated based on priorities set by the user, inventory levels of promotional items, expiration times of rebates, preferred routes, etc.

[0097] In operation S412, movement or activity is tracked. According to an exemplary aspect, the movement or activity can be tracked based on the location information of a user device that the user is operating or wearing. In an example, the user device can include, but is not limited to, a mobile terminal, a smartwatch, augmented reality glasses, other wearable electronic devices, etc. The movement or activity being tracked can include, but is not limited to, direction of travel, speed of travel, number of steps taken, one or more body movements, heart rate, other biometric information, etc.

[0098] In operation S413, it is determined whether the activation conditions for a reward or prize have been met. According to an exemplary aspect, the activation conditions can include, but are not limited to, walking into a specific store or retailer, saying a specific phrase, performing a designated action (e.g., performing a specific movement) within a predetermined distance of the corresponding store or retailer, using a specific payment form, using a loyalty membership, etc. However, aspects of the present disclosure are not limited thereto, such that any activation conditions can be specified by the retailer or the partnering organization. Additionally, if no reward or prize is offered, this step may not be performed.

[0099] If it is determined in operation S413 that the activation conditions are not met, the method returns to operation S412. On the other hand, if it is determined in operation S413 that the activation conditions have been met, the designated reward or prize is activated or generated in operation S414 to be presented to the user. According to an exemplary aspect, the reward or prize can be in physical or digital form and can be specified or provided by the retailer or the partnering organization. In an example, the reward or prize can be offered independently of a purchase at a specific retailer, or it can be offered only when purchasing from a specific retailer. Such requirements can be specified by the corresponding retailer or the system administrator.

[0100] In operation S415, it is further determined whether the purchase was made using the rebate specified in the rebate information. If it is determined that the user did not ultimately make a purchase, then in operation S417 the user information is updated to reflect the user's access to the retailer offering the rebate and the user's lack of interest. Based on the aggregation of such information, one or more artificial intelligence (AI) or machine learning (ML) algorithms can be applied to provide user-customized rebate information. For example, the AI or ML algorithms can determine that a particular user is interested in a certain type of retailer over others and can adjust the display of the augmented reality information accordingly. In an example, certain rebate information can be hidden from view and adjustments can be made in how the rebate information is displayed (e.g., larger text, highlighting, different borders, shadows on the text, etc.). Additionally, AI or ML algorithms can be utilized to provide differentiated offers to users. For example, a larger promotion or differentiated rewards / incentives can be provided to different users based on the user's shopping history, value contribution to the retailer, time of the last purchase, etc.

[0101] Generally, AI or ML algorithms can be executed to perform data pattern detection and provide an output or make a decision based on the data pattern detection. More specifically, the output can be provided based on the historical patterns of the data such that with more data or more recent data, a more accurate output and / or decision can be provided or presented. Thus, the ML or AI model can be continuously updated after a predetermined number of runs or iterations. According to an exemplary aspect, machine learning can refer to computer algorithms that can be automatically improved by using data. Machine learning algorithms can build an initial model based on samples or training data, and the initial model can be iteratively improved when additional data is acquired.

[0102] More specifically, machine learning / artificial intelligence and pattern recognition can include supervised learning algorithms such as k-medoids analysis, regression analysis, decision tree analysis, random forest analysis, k-nearest neighbor analysis, logistic regression analysis, k-fold cross-validation analysis, balanced class weight analysis, etc. In another exemplary embodiment, machine learning analysis techniques can include unsupervised learning algorithms such as apriori analysis, K-means clustering analysis, etc. In another exemplary embodiment, machine learning analysis techniques can include reinforcement learning algorithms such as Markov decision process analysis, etc.

[0103] In another exemplary embodiment, the ML or AI model can be based on machine learning algorithms. Machine learning algorithms can include at least one of the processes and set of rules to be followed by a computer in computational and other problem-solving operations such as linear regression algorithms, logistic regression algorithms, decision tree algorithms, and / or naive Bayes algorithms.

[0104] In another exemplary embodiment, the ML or AI model may include a training model, e.g., a machine learning model that is generated to be further trained on additional data. Once the training model has been sufficiently trained, the training model can be deployed onto various connected systems for utilization. In another exemplary embodiment, when a model evaluation method (e.g., holdout method, k-fold cross-validation method, and bootstrap method) determines that at least one of the least squares error rate, true positive rate, true negative rate, false positive rate, and false negative rate of the training model is within a predetermined range, the training model can be sufficiently trained.

[0105] In another exemplary embodiment, the training model may be operable, i.e., actively utilized by an organization while continuing to be trained using new data. In another exemplary embodiment, at least one of artificial neural network technology, decision tree technology, support vector machine technology, Bayesian network technology, and genetic algorithm technology may be used to generate the ML or AI model.

[0106] On the other hand, if it is determined in operation S415 that a purchase has been made at a retailer that offers a rebate, then in operation S416 the user is allowed to enter a comment on the user experience to be displayed in augmented reality. The comment can be automatically fed to the user's social connections or groups. Additionally, the user information or profile can be updated to reflect the purchase and the corresponding rebate and reward(s) to use one or more AI or ML algorithms to customize future rebates or rewards offered to the user.

[0107] Furthermore, once the rebate has been applied and commenting on the purchase has been allowed in operation S416, the method proceeds to operation S417 to reflect the purchase at the retailer that offers the rebate. Based on the aggregation of such information, one or more AI or ML algorithms can be applied to provide user-customized rebate information. For example, the AI or ML algorithms can determine that a particular user is interested in a certain type of retailer rather than others and can accordingly adjust the display of the augmented reality information. In an example, certain rebate information can be promoted for display, highlighted, or adjusted in the way of display (e.g., larger text, highlighting, different borders, shadows of text, etc.). Additionally, AI or ML algorithms can be utilized to provide differentiated offers to the user. For example, greater promotions or differentiated rewards can be offered to different users based on the user's shopping history, value contribution to the retailer, time of the last purchase, etc.

[0108] Although the present invention has been described with reference to several exemplary embodiments, it should be understood that the terms used are descriptive and illustrative, not restrictive. Without departing from the scope and spirit of the various aspects of the present disclosure, changes may be made within the scope of the appended claims as presently stated and modified. Although the present invention has been described with reference to specific means, materials, and embodiments, the present invention is not intended to be limited to the disclosed details; rather, the present invention extends to all functionally equivalent structures, methods, and uses such as are within the scope of the appended claims.

[0109] For example, although a computer-readable medium may be described as a single medium, the term "computer-readable medium" includes a single medium or multiple media, such as a centralized or distributed database, and / or associated caches and servers that store one or more instruction sets. The term "computer-readable medium" should also include any medium that can store, encode, or carry an instruction set for a processor to execute or cause a computer system to execute any one or more of the embodiments disclosed herein.

[0110] The computer-readable medium may include one or more non-transitory computer-readable media, and / or may include one or more transitory computer-readable media. In certain non-limiting exemplary embodiments, the computer-readable medium may include solid-state memory, such as a memory card or other package that houses one or more non-volatile read-only memories. Additionally, the computer-readable medium may be random access memory or other volatile rewritable memory. Further, the computer-readable medium may include magneto-optical or optical media (such as a disk or tape) or other storage devices for capturing carrier signals (such as signals communicated over a transmission medium). Accordingly, the present disclosure is considered to include any computer-readable medium or other equivalent and successor media in which data or instructions may be stored.

[0111] Although the present application describes specific embodiments that may be implemented as computer programs or code segments in a computer-readable medium, it should be understood that dedicated hardware implementations, such as application-specific integrated circuits, programmable logic arrays, and other hardware devices, may be constructed to implement one or more of the embodiments described herein. Applications that may include the various embodiments set forth herein may generally include a variety of electronic and computer systems. Accordingly, the present application may cover software, firmware, and hardware implementations or combinations thereof. Nothing in the present application should be construed as being implementable or achievable only in software and not in hardware.

[0112] Although this specification describes components and functions that may be implemented in specific embodiments with reference to specific standards and protocols, the present disclosure is not limited to such standards and protocols. Such standards are periodically replaced by equivalent ones that are faster or more efficient with substantially the same functionality. Accordingly, alternative standards and protocols with the same or similar functionality are considered to be their equivalents.

[0113] The illustrations of the embodiments described herein are intended to provide a general understanding of the various embodiments. The illustrations are not intended to serve as a complete description of all elements and features of the apparatus and systems that utilize the structures or methods described herein. Many other embodiments may be apparent to those skilled in the art upon reading this disclosure. Other embodiments may be derived from and utilized from this disclosure, such that structural and logical substitutions and changes may be made without departing from the scope of this disclosure. Additionally, the illustrations are only representative and may not be drawn to scale. Some of the scales in the illustrations may be enlarged while others may be minimized. Accordingly, this disclosure and the drawings are to be regarded as illustrative rather than restrictive.

[0114] In this document, one or more embodiments of this disclosure may, for convenience only, be referred to individually and / or collectively by the term "invention", and are not intended to actively limit the scope of this application to any particular invention or inventive concept. Moreover, although specific embodiments have been shown and described herein, it should be understood that any subsequent arrangement designed to achieve the same or similar purpose may replace the specific embodiments shown. This disclosure is intended to cover any and all subsequent modifications or variations of the various embodiments. Combinations of the above embodiments and other embodiments not specifically described herein will be apparent to those skilled in the art upon reading this specification.

[0115] It should be understood that the abstract of this disclosure submitted is not used to interpret or limit the scope or meaning of the claims. Additionally, in the above detailed description, for the purpose of simplifying this disclosure, various features may be grouped together or described in a single embodiment. It should not be, nor is it intended to be, construed that the claimed embodiments require more features than those expressly recited in each claim. On the contrary, as reflected by the appended claims, the inventive subject matter may be directed to only some, rather than all, of the features of any of the disclosed embodiments. Accordingly, the appended claims are incorporated into the detailed description, where each claim independently defines the separately claimed subject matter.

[0116] The subject matter disclosed above is considered illustrative rather than restrictive, and the appended claims are intended to cover all such modifications, improvements, and other embodiments that fall within the true spirit and scope of this disclosure. Accordingly, to the fullest extent permitted by law, the scope of this disclosure will be determined by the appended claims and the broadest permissible interpretation of their equivalents, and should not be restricted or limited by the foregoing detailed description.

Claims

1. A method for dynamically providing augmented reality information, the method comprising: Obtaining information based on a user device from the user's user device; Retrieving rebate information corresponding to the information based on the user device; Retrieving user information of the user of the user device; Tracking the movement or activity of the user device; Determining whether a predetermined condition is met; When it is determined that the predetermined condition has been met, displaying one or more rebates in an augmented reality manner on the image information displayed on the display of the user device; And When it is determined that the predetermined condition is not met, continuing to track the movement or activity of the user device until it is determined that the predetermined condition is met.

2. The method according to claim 1, wherein The information based on the user device is image information captured by the user.

3. The method according to claim 1, wherein The information based on the user device is location information.

4. The method according to claim 1, wherein The information based on the user device is map information.

5. The method according to claim 1, further comprising: Determining the availability of a special reward corresponding to the one or more rebates; After determining that the predetermined condition has been met, tracking user actions; And Based on the user actions, determining whether the activation condition of the special reward has been met, wherein the predetermined condition is a predetermined distance of the location of the user device.

6. The method according to claim 5, wherein, The activation condition is the performance of a predetermined user movement.

7. The method according to claim 5, wherein the activation condition is saying a specific phrase.

8. The method according to claim 1, wherein the activation condition includes being located in a predetermined area.

9. The method according to claim 1, further comprising: Receiving a selection of a rebate among the one or more rebates displayed in an augmented reality manner; And Generating a travel path to the retailer location corresponding to the selected rebate.

10. The method according to claim 1, further comprising: Determining whether a purchase has been made at a retailer corresponding to the one or more rebates in augmented reality; And When it is determined that a purchase has been made at the retailer corresponding to the one or more rebates in augmented reality: Applying the applicable rebate, and Allowing an evaluation of the purchase.

11. The method according to claim 1, further comprising: Determining whether a purchase has been made at a retailer corresponding to the one or more rebates in augmented reality; And When it is determined that no purchase has been made at the retailer corresponding to the one or more rebates in augmented reality, updating the user information based on the non-purchase.

12. The method according to claim 11 further comprises: Based on whether the purchase has been made at the retailer, applying one or more artificial intelligence (AI) or machine learning (ML) to provide future rebate offers via augmented reality.

13. The method according to claim 1, wherein, The displayed image information is a map.

14. The method according to claim 1, wherein The displayed image information is an image of one or more retailers corresponding to the one or more rebates.

15. The method according to claim 1, wherein The displayed image information is an image of an area including one or more retailers corresponding to the one or more rebates.

16. The method according to claim 1, further comprising: Displaying product offers provided by retailers corresponding to the one or more rebates.

17. The method according to claim 1, further comprising: Display reviews of retailers corresponding to the one or more rebates.

18. The method according to claim 1, further comprising: Displaying, in an augmented reality manner, a mobile virtual object corresponding to the one or more rebates, wherein the mobile virtual object guides the user to a retailer corresponding to the one or more rebates.

19. A system for dynamically providing augmented reality information, the system comprising: A user device of a user; And A server including at least a memory and a processor, wherein the processor is configured to: Obtain information based on the user device from the user device; Retrieve rebate information corresponding to the information based on the user device; Retrieve user information of the user of the user device; Track the movement or activity of the user device; Determine whether a predetermined condition is met; When it is determined that the predetermined condition has been met, display one or more rebates in an augmented reality manner on the image information displayed on the display of the user device; And When it is determined that the predetermined condition is not met, continue to track the movement or activity of the user device until it is determined that the predetermined condition is met.

20. A non-transitory computer-readable storage medium storing a computer program for dynamically providing augmented reality information, the computer program, when executed by a processor, performs a process including the following: Obtain information based on the user device from the user device of the user; Retrieve corresponding rebate information; Retrieve user information; Track the movement or activity of the user device; Determine whether a predetermined condition is met; When it is determined that the predetermined condition has been met, display one or more rebates in an augmented reality manner on the displayed image information; And When it is determined that the predetermined condition is not met, continue the tracking until it is determined that the predetermined condition is met.

Images