Techniques for enabling dynamic interactive on-demand user interface subscriptions

Abstract

Techniques for implementing dynamic interactive on-demand user interface subscriptions are set forth. Specifically, in one embodiment, a method for providing an interactive user interface is disclosed. The method may include receiving a request from an input peripheral to present a content item on the interactive user interface; presenting the content item on the interactive user interface; receiving an input from the input peripheral for selecting an object associated with the content item presented on the interactive user interface; in response to receiving the input, information relating to the object and at least one graphical user element configured to enable a purchase event to be performed are presented.

Description

Technical Field

[0001] The described embodiments set forth techniques for implementing dynamic interactive on-demand user interface ordering. Background Art

[0002] Content items (e.g., songs, movies, videos, podcasts, transcriptions, etc.) are conventionally played via computing devices such as smart phones, laptops, desktop computers, televisions, etc. The industry associated with content item playback and / or streaming is huge. Typically, people consume content items (e.g., watch television programs, movies, and / or streaming content) and see one or more objects included in the content items that attract their attention. Objects may be related to goods (e.g., products) and / or services. However, there is currently no convenient way to obtain objects that people desire in content items displayed via a user interface. Summary of the invention

[0003] This application describes techniques for implementing dynamic interactive on-demand user interface ordering.

[0004] One embodiment describes a method for providing an interactive user interface. According to some embodiments, the method includes the following steps: (1) receiving a request from an input peripheral device to present a content item on the interactive user interface; (2) presenting the content item on the interactive user interface; (3) receiving input from the input peripheral device to select an object associated with the content item presented on the interactive user interface; and (4) in response to receiving the input, presenting information related to the object and at least one graphical user element configured to enable execution of a purchase event.

[0005] Another embodiment describes a tangible, non-transitory computer-readable medium storing instructions that, when executed, cause a processing device to: (1) receive a request from an input peripheral device to present a content item on an interactive user interface; (2) present the content item on the interactive user interface; (3) receive input from the input peripheral device to select an object associated with the content item presented on the interactive user interface; and (4) in response to receiving the input, present information related to the object and at least one graphical user element configured to enable execution of a purchase event.

[0006] Another embodiment includes a system comprising a memory device storing instructions and a processing device communicatively coupled to the memory device. The processing device executes the instructions to cause the system to: (1) receive a request from an input peripheral device to present a content item on the interactive user interface; (2) present the content item on the interactive user interface; (3) receive input from the input peripheral device to select an object associated with the content item presented on the interactive user interface; and (4) in response to receiving the input, present information related to the object and at least one graphical user element configured to enable execution of a purchase event.

[0007] Other embodiments include a hardware computing device that includes a processor that can be configured to cause the hardware computing device to implement the methods and techniques described in this disclosure.

[0008] Other aspects and advantages of the present invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate by way of example the principles of the described embodiments.

[0009] The present disclosure is provided for the purpose of summarizing some example embodiments only, so as to provide a basic understanding of some aspects of the subject matter described herein. Therefore, it should be understood that the above-mentioned features are only examples and should not be construed as narrowing the scope or essence of the subject matter described herein in any way. Other features, aspects and advantages of the subject matter described herein will become apparent through the following detailed description, drawings and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The present disclosure will be more readily understood through the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals designate like structural elements.

[0011] Figure 1 Illustrate system architecture according to some embodiments disclosed herein.

[0012] Figure 2 Conceptual diagram illustrating example interactions between a wireless device and an interactive user interface according to some embodiments disclosed herein.

[0013] Figure 3 An example interactive user interface that provides information related to a selected object and options for executing a purchase event according to some embodiments disclosed herein is illustrated.

[0014] Figure 4 Illustrate an example user interface of an application that enables ordering of a selected object according to some embodiments disclosed herein.

[0015] Figure 5A method for providing an interactive user interface that enables dynamic on-demand ordering according to some embodiments disclosed herein is illustrated.

[0016] Figure 6 A method for executing a purchase event in response to receiving a selection of a graphical user element is illustrated according to some embodiments disclosed herein.

[0017] Figure 7 A method for enabling execution of a purchase event for an object while playback of a content item is paused is illustrated according to some embodiments disclosed herein.

[0018] Figure 8 Illustrated is a detailed view of a representative computing device that can be used to implement the various techniques described herein, according to some embodiments. DETAILED DESCRIPTION

[0019] Representative applications of the methods and apparatus according to the present application are described in this section. These examples are provided only to add context and aid in understanding the described embodiments. Therefore, it will be apparent to those skilled in the art that the described embodiments may be practiced without some or all of these specific details. In other cases, in order to avoid unnecessarily obscuring the described embodiments, well-known processing steps are not described in detail. Other applications are possible, so that the following examples should not be considered limiting.

[0020] In the following detailed description, reference is made to the accompanying drawings which form a part of the specification and in which are shown by way of illustration specific embodiments in accordance with the described embodiments. Although these embodiments are described in sufficient detail to enable those skilled in the art to practice the described embodiments, it is to be understood that these examples are not limiting; other embodiments may be used and modifications may be made without departing from the spirit and scope of the described embodiments.

[0021] The described embodiment sets forth the technology for providing a dynamic on-demand interactive user interface for ordering an object displayed via a computing device. Any content item can be played and / or streamed via computing devices such as televisions, monitors, smart phones, independent computing devices. There may be multiple objects displayed or included in the content item. For example, a woman may wear certain clothes, carry certain accessories (e.g., handbags, waist bags, etc.), walk a certain type of dog, etc. The consumer of a content item can watch the content item and expect to obtain one or more objects in the object presented in the content item. Routinely, consumers can perform an Internet search for the objects they see in the content item and want to obtain. However, this technology is inefficient because consumers lack the precise detailed information related to the object. Therefore, there is a need for more efficient and accurate collection of the objects presented in the content item.

[0022] The present disclosure provides a technical solution that enables consumers of content items to obtain the object in an on-demand manner based on dynamically updated information related to one or more objects presented in the content item. That is, the information related to the object can be updated in real time or near real time (e.g., real time can refer to less than two (2) seconds, while near real time can refer to a time period between two (2) seconds and ten (10) seconds) via a third-party service and / or application programming interface (API) managed by an entity associated with the object. For example, a company that makes a particular brand of handbags can update pricing information related to its handbags, and the information can be propagated via a communicatively coupled server, API, service, etc., so as to be dynamically displayed on an interactive user interface provided by some embodiments disclosed herein. The interactive user interface can enable a user to view the identified objects included in the scene of the content item, and allow the user to select a desired object. In some embodiments, the interactive user interface can pause the playback of the content item and enhance the visual representation of one or more objects presented in the content item. The user can use an input peripheral device (e.g., a microphone, keyboard, mouse, touch screen, remote controller, smart phone, etc.) to select a desired object to view information related to the object. The user may then use the input peripheral to perform a purchasing event, such as adding the desired object to a virtual shopping cart and / or purchasing the object immediately.

[0023] In some embodiments, a user can purchase an object using stored payment information (e.g., credit card details, payment service details via a single input, etc.). The single input can be a single click on a graphical user element, a spoken word into a microphone, etc. In this way, the disclosed embodiments provide a technical solution for reducing computing resources by reducing interactions with computing devices. In addition, the disclosed embodiments provide a technical solution by providing an enhanced graphical user interface that is interactive, on-demand, dynamic, and allows users to order objects presented in the user interface in real time or near real time.

[0024] These and other embodiments are referred to below. Figures 1 to 8 Discussion is made; however, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for illustrative purposes only and should not be construed as limiting.

[0025] Figure 1 Illustrated is a system architecture 100 that may include one or more computing devices 102 communicatively coupled to a computing system 116 and / or a digital media device 106 of one or more users.

[0026] According to some embodiments, digital media device 106 can be configured or controlled by a mobile device (e.g., a smart mobile phone). Digital media device 106 can be an electronic device programmed to download and / or stream multimedia content including pictures, audio or video. For example, digital media device 106 can be a digital mobile radio (DMR), a digital audio or video player, a mobile or fixed computing device, a digital camera, an Internet-enabled television, a game console, etc. Digital media device 106 may include or be coupled to a display device (e.g., a television) that presents an interactive user interface 122. Interactive user interface 122 can present dynamic information related to the identified object in the content item played via the display device. A user can use an input peripheral device to interact with interactive user interface 122 to perform a purchase event in real time or near real time to obtain a desired object. A content item may include an advertisement with one or more objects that can be ordered.

[0027] In some embodiments, the computing system 116 may also be configured or controlled by a mobile device (e.g., a smart mobile phone). The computing system 116 may be an electronic device programmed to download or play multimedia content including pictures, audio, or video. For example, the computing system 116 may be a DMR, a digital audio or video player, a mobile or fixed computing device, a digital camera, an Internet-enabled television, a game console, etc. The computing system 116 may include or be coupled to a display device that presents the interactive user interface 122.

[0028] Each of the components included in wireless device 102, digital media device 106, and computing system 116 may include one or more processing devices, memory devices, and / or network interface cards. The network interface card may enable communication via a wireless protocol for sending data over a short distance, such as Bluetooth, ZigBee, NFC, etc. Additionally, the network interface card may enable data to be communicated over a long distance, and in one example, computing device 12 and computing system 116 may communicate with network 112. Network 112 may be a public network (e.g., connected to the Internet via a wired (Ethernet) or wireless (Wi-Fi) connection), a private network (e.g., a local area network (LAN) or a wide area network (WAN)), or a combination thereof. Network 112 may also include one or more nodes on the Internet of Things (IoT).

[0029] The wireless device 102 may be any suitable computing device, such as a laptop, a tablet computer, a smart phone, a wearable computer, etc. The wireless device 102 may include a memory device storing computer instructions implementing an application 118 executed by a processing device. When executed, the application 118 may present a user interface (e.g., on a display to which the wireless device 102 is communicatively coupled) and an object selected by a user via an interactive user interface 122, may present a virtual shopping cart including the selected object, may present one or more graphical user elements that enable the user to order the selected one or more objects, etc. Thus, the application 118 may present various user interface screens to the user.

[0030] In some embodiments, computing system 116 may include one or more servers 128 forming a distributed computing architecture. In some embodiments, computing system 116 may be a set-top box, such as an Apple The server 128 may be a rack server, a router computer, a personal computer, a portable digital assistant, a mobile phone, a laptop computer, a tablet computer, a camera, a camcorder, a netbook, a desktop computer, a media center, any other device capable of acting as a server, or any combination thereof. Each server in the server 128 may include one or more processing devices, memory devices, data storage, and / or a network interface card. The servers 128 may communicate with each other via any suitable communication protocol. The server 128 may execute an artificial intelligence (AI) engine 140 that uses one or more machine learning models 132 to execute at least one of the embodiments disclosed herein. The computing system 116 may also include a database 150 storing data, knowledge, and data structures for executing various embodiments. For example, the database 150 may store content items, information related to objects included in the content items, and the like. In some embodiments, the database 150 may be hosted on one or more servers in the server 128.

[0031] In some embodiments, the computing system 116 may include a training engine 130 capable of generating one or more machine learning models 132. The machine learning model 132 may be trained to perform image analysis to identify one or more objects included in the content item, and to label the one or more objects via enhancement, highlighting, outlining, coloring, modification, etc. The one or more machine learning models 132 may be trained using training data including labeled inputs mapped to labeled outputs. For example, a content item may consist of a plurality of image frames, and the image frames may include labels identifying certain objects included in each image frame. In one example, a handbag may be labeled with a logo indicating that the handbag is a handbag made by a certain brand, sold at a certain price, etc. The labeled output may include information related to the labeled input (e.g., brand, price, etc.). The one or more machine learning models 132 may be generated by the training engine 130 and may be implemented in computer instructions that may be executed by the training engine 130 and / or one or more processing devices of the server 128. In order to generate the one or more machine learning models 132, the training engine 130 may train the one or more machine learning models 132.

[0032] The training engine 130 may be a rack-mounted server, a router computer, a personal computer, a portable digital assistant, a smart phone, a laptop computer, a tablet computer, a netbook, a desktop computer, an Internet of Things (IoT) device, any other desired computing device, or any combination thereof. The training engine 130 may be cloud-based, may be a real-time software platform, may include privacy software or protocols, and / or may include security software or protocols. To generate one or more machine learning models 132, the training engine 130 may train one or more machine learning models 132.

[0033] One or more machine learning models 132 may refer to model artifacts created by the training engine 130 using training data including training inputs and corresponding target outputs. The training engine 130 may find patterns in the training data, where such patterns map the training inputs to the target outputs, and generate a machine learning model 132 that captures these patterns. For example, the machine learning model may receive a content item, parse an image frame of the content item, identify objects in the image frame of the content item, mark the object with certain tags, obtain information related to the marked object via a third-party service and / or application programming interface, and / or output the marked, identified objects and their associated information. Although depicted separately from the server 128, in some embodiments, the training engine 130 may reside on the server 128. Furthermore, in some embodiments, the database 150 and / or the training engine 130 may reside on the computing device 102 and / or the digital media device 106.

[0034] As described in detail below, one or more machine learning models 132 may include, for example, a single-stage linear or nonlinear operation (e.g., a support vector machine (SVM)), or the machine learning model 132 may be a deep network, i.e., a machine learning model that includes multiple stages of nonlinear operations. Examples of deep networks are neural networks, including generative adversarial networks, convolutional neural networks, recursive neural networks with one or more hidden layers, and fully connected neural networks (e.g., each neuron may send its output signal to the inputs of the remaining neurons and to itself). For example, a machine learning model may include multiple layers and / or hidden layers that perform calculations (e.g., dot products) using various neurons.

[0035] Figure 2 A conceptual diagram 200 illustrates an example interaction between a wireless device 102 and an interactive user interface 122 according to some embodiments disclosed herein. As shown, a digital media device 106 is presenting an interactive user interface 122. In this example, the digital media device 106 is a television and is communicatively connected to a computing system 116 (e.g., an Apple ). The computing system 116 may be communicatively coupled to one or more servers 128 via the network 112, which provide the one or more content items on demand to a user who selects the one or more content items. For example, the computing system 116 may provide streaming of the content items in real time or near real time. Furthermore, in this example, the wireless device 102 may be a smart phone executing the application 118 to perform one or more selections of objects and purchase events of the selected objects.

[0036] In the depicted example, the user has paused a content item (e.g., "Movie X") using the wireless device 102. While the content item is paused, there are two objects 206 and 208 identified in the interactive user interface 122. The two objects 206 and 208 may be enhanced, highlighted, outlined, colored, etc. in order to be identified. In some embodiments, one or more machine learning models 132 may be trained to identify one or more objects included in each image frame of the content item.

[0037] Additionally, in the depicted example, the user has selected object 206 (as represented by shading in interactive user interface 122) using wireless device 102. The user interface of application 118 presented on wireless device 102 shows the object identified in the content item and further shows that the user has selected object 206 (as represented by shading in application 118).

[0038] Figure 3A conceptual diagram 300 illustrating an example interactive user interface 122 that provides information 301 related to a selected object 206 and options for performing a purchase event according to some embodiments disclosed herein. The information 301 includes the brand name of the entity that produced the object 206 (e.g., "Brand Y"). In this example, the object can be a handbag. In some embodiments, the object 206 can be any suitable good or service. For example, a user can schedule a yard service, a contractor, a doctor's appointment, a dentist's appointment, etc. The information 301 also includes a description of the object 206. In addition, the information 301 may include a price for the selected object 206. The information 301 may be presented in an overlay screen 302 displayed on the interactive user interface 122.

[0039] In some embodiments, the content item does not need to be paused to order the objects identified in the content item. For example, the content item can be streamed, and the objects can be enhanced so that they are identified in the interactive user interface 122. In some embodiments, a separate portion of the interactive user interface 122 can be used to display a list of objects included in each image frame of the content item being streamed. The user can select one or more of the objects from the interactive user interface 122 to perform a purchase event (e.g., add to a virtual shopping cart or order directly). The playback of the content item can also be modified (e.g., slowed down) to provide the user with additional time to select an available object.

[0040] Figure 4 An example user interface 400 of an application that enables ordering of a selected object according to some embodiments disclosed herein is illustrated. The user interface is displayed on a wireless device 102. The user interface is provided via an application 118 being executed on the wireless device 102. As depicted, the user interface presents a graphical element representing a virtual shopping cart including a selected handbag for $1,695. The user may select the virtual shopping cart to continue ordering the handbag, and the handbag may be shipped from an entity, a third-party distributor, or the like. Another graphical user element may represent an option for purchasing the selected object immediately. The graphical user element reduces the number of clicks or inputs required to order the selected object. In addition, another graphical user element may enable the user to continue purchasing other objects in the content item, in another content item, on the Internet, or the like.

[0041] Figure 5A method 500 for providing an interactive user interface for implementing dynamic on-demand ordering according to some embodiments disclosed herein is illustrated. The method 500 may be performed by processing logic, which may include hardware (circuitry, dedicated logic, etc.), software, or a combination of both. The method 500 and / or each of their individual functions, subroutines, or operations may be implemented by a computing device implementing the method 500 (e.g., any component of the computing system 116 (server 128, training engine 130, machine learning model 132, etc.), a digital media device 106, Figure 1 The wireless device 102 and / or Figure 8 The method 500 may be implemented as computer instructions stored on a memory device and executable by one or more processors. In some implementations, the method 500 may be performed by a single processing thread. Alternatively, the method 500 may be performed by two or more processing threads, each thread implementing one or more separate functions, routines, subroutines, or operations of the method.

[0042] At step 502, the processing device may receive a request for presenting a content item on the interactive user interface 122 from an input peripheral device. The input peripheral device may include a microphone, a touch screen, a mouse, a remote controller, a keyboard, or some combination thereof. The input peripheral device may be included in the wireless device 102, the digital media device 106, and / or the computing system 116. Again, training data may be used to train one or more machine learning models 132 to perform image recognition on the content item to indicate one or more objects so that the one or more objects can be identified on the interactive user interface 122. In some embodiments, based on the received input, the appearance of the object may be modified by highlighting, shading, coloring, outlining, enhancing, or some combination thereof. For example, an object selected by a user using an input peripheral device is shaded. In some embodiments, when the content item is being played or streamed on the interactive user interface 122, input for selecting an object may be received in real time or near real time.

[0043] At step 504, the processing device may present the content item on an interactive user interface. The content item may include one or more objects that may be available for purchase and / or added to a virtual shopping cart. In some embodiments, the objects may be identified while the content item is playing. For example, one or more objects may be graphically identified via highlighting, outlining, shading, coloring, enhancing, bolding, etc. In some embodiments, one or more objects may be graphically identified when playback of the content item is modified (e.g., slowed down, paused, etc.).

[0044] At step 506, the processing device may receive input from an input peripheral device for selecting an object associated with a content item presented on the interactive user interface 122. In some embodiments, the object may include an advertisement for a service provided by an entity, and the input for selecting the object may include scheduling a service. In some embodiments, the object may be a good (e.g., a product) and / or a service.

[0045] At step 508, in response to receiving the input, the processing device may present information related to the object and at least one graphical user element configured to enable execution of a purchase event. In some embodiments, the information related to the object may include a brand of an entity associated with the object, a description of the object, a price of the object, an image of the object, or some combination thereof. In some embodiments, such as Figure 3 As depicted, the information may be presented as an overlay screen on the interactive user interface 122 presenting the content item.

[0046] In some embodiments, an object may be associated with an entity, and the entity may continuously, constantly, or periodically modify information related to the object. The entity may modify the description of the object, the price of the object, the image of the object, or some combination thereof. The processing device may communicate with a third-party service and / or application programming interface associated with the entity to receive updated information associated with the object. Therefore, when a user selects an object using an input peripheral device, the latest information related to the object may be presented on the interactive user interface 122. In this way, the interactive user interface 122 is dynamic because the information related to the object can be modified in real time or near real time as the entity modifies the information via its third-party service or application programming interface.

[0047] Figure 6 1. A method 600 for executing a purchase event in response to receiving a selection of a graphical user element according to some embodiments disclosed herein is illustrated. The method 600 may be performed by processing logic, which may include hardware (circuitry, dedicated logic, etc.), software, or a combination of both. The method 600 and / or each of their individual functions, subroutines, or operations may be performed by a computing device implementing the method 600 (e.g., any component of the computing system 116 (server 128, training engine 130, machine learning model 132, etc.), a digital media device 106, Figure 1 The wireless device 102 and / or Figure 8 The method 600 may be implemented as computer instructions stored on a memory device and executable by one or more processors. In some implementations, the method 600 may be performed by a single processing thread. Alternatively, the method 600 may be performed by two or more processing threads, each thread implementing one or more separate functions, routines, subroutines, or operations of the method.

[0048] At step 602, the processing device may receive a selection of at least one graphical user element. The selection may be received via an input peripheral device. The graphical user element may be a button, a checklist, a slider, a radio button, an input box, etc.

[0049] At step 604, in response to receiving a selection of at least one graphical user element, the processing device may add the object to a virtual shopping cart associated with the user account, or the processing device may perform a purchase event using information associated with the user account. The purchase event may include the processing device communicating with a third-party service or application programming interface. The interface user interface 122 may be on-demand due to the ability of the user to order objects presented in the content item in real time or near real time via the click of a button. In some embodiments, the purchase event may include placing an order to purchase the object or adding the object to a virtual shopping cart to order at a subsequent time.

[0050] Figure 7 1. Method 700 for enabling execution of a purchase event for an object while playback of a content item is paused according to some embodiments disclosed herein. Method 700 may be performed by processing logic, which may include hardware (circuitry, dedicated logic, etc.), software, or a combination of both. Method 700 and / or each of their individual functions, subroutines, or operations may be executed by a computing device implementing method 700 (e.g., any component of computing system 116 (server 128, training engine 130, machine learning model 132, etc.), digital media device 106, Figure 1 The wireless device 102 and / or Figure 8 The method 700 may be implemented as computer instructions stored on a memory device and executable by one or more processors. In some implementations, the method 700 may be performed by a single processing thread. Alternatively, the method 700 may be performed by two or more processing threads, each thread implementing one or more separate functions, routines, subroutines, or operations of the method.

[0051] Prior to receiving input for selecting an object displayed in the interactive user interface, the processing device may receive a first request for pausing playback of a content item at step 702. The processing device may pause playback of the content item at step 704. A user may pause a content item using an input peripheral device such as a smart phone, a remote control, a touch screen, etc.

[0052] At step 706, the processing device may display one or more objects using highlighting on an interactive user interface while playback of the content item is paused. One or more machine learning models 132 may be trained to identify one or more objects in the content item. One or more machine learning models 132 may be trained to mark or identify objects using a flag or indicator. One or more objects may be visually enhanced, highlighted, outlined, colored, bolded, etc., so that the object can be emphasized when the content item is paused. The user may select an object using an input peripheral device.

[0053] At step 708, the processing device may receive input for selecting an object. The input may be received via an input peripheral device. At step 710, the processing device may receive a second request for resuming playback of the content item. After the object is selected, a purchase event may be performed. The purchase event may include adding the object to a virtual shopping cart or directly purchasing the object. At step 712, the processing device may resume playback of the content item via the interactive user interface 122.

[0054] Figure 8 Detailed view of a representative computing device 800 that may be used to implement the various methods described herein according to some embodiments is illustrated. Specifically, the detailed view illustrates various components that may be included in a wireless device 102, a digital media device 106, a computing system 116, etc. Figure 8 As shown, the computing device 800 may include a processor or processing device 802 representing a microprocessor or controller for controlling the overall operation of the computing device 800. The computing device 800 may also include a user input device 808 that allows a user of the computing device 800 to interact with the computing device 800. For example, the user input device 808 can take a variety of forms, such as buttons, keypads, dials, touch screens, audio input interfaces, visual / image capture input interfaces, input terminals in the form of sensor data, etc. Further, the computing device 800 can include a display 810 that can be controlled by the processor 802 to display information to the user. The data bus 816 can facilitate data transmission between at least the storage device 840, the processor 802, and the controller 813. The controller 813 can be used to interact with and control different equipment through the equipment control bus 814. The computing device 800 may also include a network / bus interface 811 communicatively coupled to the data link 812. In the case of a wireless connection, the network / bus interface 811 may include a wireless transceiver.

[0055] The computing device 800 also includes a storage device 840, which may include a single disk or multiple disks (e.g., a hard drive), and includes a storage management module that manages one or more partitions within the storage device 840. In some embodiments, the storage device 840 may include flash memory, semiconductor (solid-state) memory, etc. The computing device 800 may also include a random access memory (RAM) 820 and a read-only memory (ROM) 822. The ROM 822 may store programs, utilities, or processes to be executed in a non-volatile manner. The RAM 820 may provide volatile data storage and store instructions related to the operation of the computing device 800. The computing device 800 may also include a secure element (SE) 824 for cellular wireless system access by the computing device 800.

[0056] The various aspects, embodiments, specific implementations or features of the described embodiments may be used individually or in any combination. Various aspects of the described embodiments may be implemented by software, hardware, or a combination of hardware and software. The described embodiments may also be implemented as computer-readable code on a non-transient computer-readable medium. A non-transient computer-readable medium is any data storage device that can store data, which can then be read by a computer system. Examples of non-transient computer-readable media include read-only memory, random access memory, CD-ROM, HDD, DVD, magnetic tape, and optical data storage devices. Non-transient computer-readable media may also be distributed on network-coupled computer systems so that the computer-readable code is stored and executed in a distributed manner.

[0057] In connection with this disclosure, it is understood that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of the authorized use should be clearly stated to users.

[0058] For the purpose of explanation, the foregoing description uses specific nomenclature to provide a thorough understanding of the described embodiments. However, it will be apparent to those skilled in the art that specific details are not required in order to practice the described embodiments. Therefore, the foregoing description of specific embodiments is presented for the purpose of illustration and description. The foregoing description is not intended to be exhaustive or to limit the described embodiments to the precise form disclosed. It will be apparent to those of ordinary skill in the art that, in view of the above teachings, many modifications and variations are possible.

Claims

1. A method for providing an interactive user interface, the method comprising: At the computing device: receiving a request from an input peripheral device to present a content item on the interactive user interface; presenting the content item on the interactive user interface; receiving input from the input peripheral for selecting an object associated with the content item presented on the interactive user interface; as well as In response to receiving the input, information related to the object and at least one graphical user element configured to enable execution of a purchase event are presented.

2. The method according to claim 1, further comprising: receiving a selection of the at least one graphical user element; as well as In response to receiving the selection of the at least one graphical user element, the object is added to a virtual shopping cart associated with a user account.

3. The method according to claim 1, further comprising: receiving a selection of the at least one graphical user element; as well as In response to receiving the selection of the at least one graphical user element, executing the purchase event using information associated with a user account, wherein the purchase event includes the computing device communicating with a third-party service or application programming interface. 4 . The method of claim 1 , wherein based on the input, the appearance of the object is modified by highlighting, shading, coloring, outlining, enhancing, or some combination thereof.

5. The method according to claim 1, wherein: The information related to the object includes a brand of an entity associated with the object, a description of the object, a price of the object, an image of the object, or some combination thereof, and The object includes goods or services.

6. The method according to claim 1, further comprising: The information is presented in an overlay screen on the interactive user interface that includes the content item.

7. The method of claim 1, wherein the input for selecting the object is received in real time or near real time while the content item is being played or streamed on the interactive user interface.

8. The method according to claim 1, further comprising: Prior to receiving said input for selecting said object: receiving a first request to pause playback of the content item; pausing playback of the content item; displaying one or more objects on the interactive user interface using highlighting while the playback of the content item is paused, wherein the object is included in the one or more objects; receiving said input for selecting said object; receiving a second request to resume playback of the content item; as well as Playback of the content item is resumed via the interactive user interface.

9. The method of claim 1, wherein the input peripheral device comprises a microphone, a touch screen, a mouse, a remote control, a keyboard, or some combination thereof.

10. The method of claim 1, wherein the object comprises an advertisement for a service provided by an entity, and the input for selecting the object comprises scheduling the service.

11. The method according to claim 1, further comprising: One or more objects are labeled using one or more machine learning models trained to perform image recognition on the content items.

12. The method according to claim 1, further comprising: Updated information associated with the object is received from one or more third-party services or application programming interfaces, wherein the updated information includes an updated price of the object, an updated image of the object, an updated description of the object, or some combination thereof.

13. A non-transitory computer-readable storage medium configured to store instructions that, when executed by at least one processor included in a computing device, cause the computing device to provide an interactive user interface by performing steps comprising: receiving a request from an input peripheral device to present a content item on the interactive user interface; presenting the content item on the interactive user interface; receiving input from the input peripheral for selecting an object associated with the content item presented on the interactive user interface; as well as In response to receiving the input, information related to the object and at least one graphical user element configured to enable execution of a purchase event are presented.

14. The non-transitory computer readable storage medium of claim 13, wherein the steps further comprise: receiving a selection of the at least one graphical user element; as well as In response to receiving the selection of the at least one graphical user element, the object is added to a virtual shopping cart associated with a user account.

15. The non-transitory computer readable storage medium of claim 13, wherein the steps further comprise: receiving a selection of the at least one graphical user element; as well as In response to receiving the selection of the at least one graphical user element, executing the purchase event using information associated with a user account, wherein the purchase event includes the computing device communicating with a third-party service or application programming interface.

16. The non-transitory computer-readable storage medium of claim 13, wherein based on the input, the appearance of the object is modified by highlighting, shading, coloring, outlining, enhancing, or some combination thereof.

17. The non-transitory computer readable storage medium of claim 13, wherein: The information related to the object includes a brand of an entity associated with the object, a description of the object, a price of the object, an image of the object, or some combination thereof, and The object includes goods or services.

18. The non-transitory computer readable storage medium of claim 13, wherein the steps further comprise: The information is presented in an overlay screen on the interactive user interface that includes the content item.

19. The non-transitory computer-readable storage medium of claim 13, wherein the input for selecting the object is received in real time or near real time while the content item is being played or streamed on the interactive user interface.

20. The non-transitory computer readable storage medium of claim 13, wherein the steps further comprise: Prior to receiving said input for selecting said object: receiving a first request to pause playback of the content item; pausing playback of the content item; displaying one or more objects on the interactive user interface using highlighting while the playback of the content item is paused, wherein the object is included in the one or more objects; receiving said input for selecting said object; receiving a second request to resume playback of the content item; as well as Playback of the content item is resumed via the interactive user interface.

21. The non-transitory computer-readable storage medium of claim 13, wherein the input peripheral device comprises a microphone, a touch screen, a mouse, a remote control, a keyboard, or some combination thereof.

22. The non-transitory computer-readable storage medium of claim 13, wherein the object comprises an advertisement for a service provided by an entity, and the input for selecting the object comprises scheduling the service.

23. The non-transitory computer readable storage medium of claim 13, wherein the steps further comprise: One or more objects are labeled using one or more machine learning models trained to perform image recognition on the content items.

24. The non-transitory computer readable storage medium of claim 13, wherein the steps further comprise: Updated information associated with the object is received from one or more third-party services or application programming interfaces, wherein the updated information includes an updated price of the object, an updated image of the object, an updated description of the object, or some combination thereof.

25. A computing device configured to provide an interactive user interface, the computing device comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the computing device to perform steps comprising: receiving a request from an input peripheral device to present a content item on the interactive user interface; presenting the content item on the interactive user interface; receiving input from the input peripheral for selecting an object associated with the content item presented on the interactive user interface; as well as In response to receiving the input, information related to the object and at least one graphical user element configured to enable execution of a purchase event are presented.

26. The computing device of claim 25, wherein the steps further comprise: receiving a selection of the at least one graphical user element; as well as In response to receiving the selection of the at least one graphical user element, the object is added to a virtual shopping cart associated with a user account.

27. The computing device of claim 25, wherein the steps further comprise: receiving a selection of the at least one graphical user element; as well as In response to receiving the selection of the at least one graphical user element, executing the purchase event using information associated with a user account, wherein the purchase event includes the computing device communicating with a third-party service or application programming interface.

28. The computing device of claim 25, wherein based on the input, the appearance of the object is modified by highlighting, shading, coloring, outlining, enhancing, or some combination thereof.

29. The computing device of claim 25, wherein: The information related to the object includes a brand of an entity associated with the object, a description of the object, a price of the object, an image of the object, or some combination thereof, and The object includes goods or services.

30. The computing device of claim 25, wherein the steps further comprise: The information is presented in an overlay screen on the interactive user interface that includes the content item.

31. The computing device of claim 25, wherein the input for selecting the object is received in real time or near real time while the content item is being played or streamed on the interactive user interface.

32. The computing device of claim 25, wherein the steps further comprise: Prior to receiving said input for selecting said object: receiving a first request to pause playback of the content item; pausing playback of the content item; displaying one or more objects on the interactive user interface using highlighting while the playback of the content item is paused, wherein the object is included in the one or more objects; receiving said input for selecting said object; receiving a second request to resume playback of the content item; as well as Playback of the content item is resumed via the interactive user interface.

33. The computing device of claim 25, wherein the input peripheral comprises a microphone, a touch screen, a mouse, a remote control, a keyboard, or some combination thereof.

34. The computing device of claim 25, wherein the object comprises an advertisement for a service provided by an entity, and the input for selecting the object comprises scheduling the service.

35. The computing device of claim 25, wherein the steps further comprise: One or more objects are labeled using one or more machine learning models trained to perform image recognition on the content items.

36. The computing device of claim 25, wherein the steps further comprise: Updated information associated with the object is received from one or more third-party services or application programming interfaces, wherein the updated information includes an updated price of the object, an updated image of the object, an updated description of the object, or some combination thereof.

37. A computing device configured to provide an interactive user interface, the computing device comprising: means for receiving, from an input peripheral device, a request for presenting a content item on the interactive user interface; means for presenting the content item on the interactive user interface; means for receiving input from the input peripheral for selecting an object associated with the content item presented on the interactive user interface; and Means for presenting, in response to receiving the input, information related to the object and at least one graphical user element configured to enable execution of a purchase event.

38. The computing device of claim 37, further comprising: means for receiving a selection of the at least one graphical user element; and Means for adding the object to a virtual shopping cart associated with a user account in response to receiving the selection of the at least one graphical user element.

39. The computing device of claim 37, further comprising: means for receiving a selection of the at least one graphical user element; and Means for executing the purchase event using information associated with a user account in response to receiving the selection of the at least one graphical user element, wherein the purchase event comprises the computing device communicating with a third party service or application programming interface.

40. The computing device of claim 37, wherein based on the input, the appearance of the object is modified by highlighting, shading, coloring, outlining, enhancing, or some combination thereof.

41. The computing device of claim 37, wherein: The information related to the object includes a brand of an entity associated with the object, a description of the object, a price of the object, an image of the object, or some combination thereof, and The object includes goods or services.

42. The computing device of claim 37, further comprising: Means for presenting the information in an overlay screen on the interactive user interface including the content item.

43. The computing device of claim 37, wherein the input for selecting the object is received in real time or near real time while the content item is being played or streamed on the interactive user interface.

44. The computing device of claim 37, further comprising: Means for performing the following operations prior to receiving the input for selecting the object: receiving a first request to pause playback of the content item; pausing playback of the content item; displaying one or more objects on the interactive user interface using highlighting while the playback of the content item is paused, wherein the object is included in the one or more objects; receiving said input for selecting said object; receiving a second request to resume playback of the content item; as well as Playback of the content item is resumed via the interactive user interface.

45. The computing device of claim 37, wherein the input peripheral comprises a microphone, a touch screen, a mouse, a remote control, a keyboard, or some combination thereof.

46. ​​The computing device of claim 37, wherein the object comprises an advertisement for a service provided by an entity, and the input for selecting the object comprises scheduling the service.

47. The computing device of claim 37, further comprising: Means for labeling one or more objects using one or more machine learning models trained to perform image recognition on the content item.

48. The computing device of claim 37, further comprising: Means for receiving updated information associated with the object from one or more third-party services or application programming interfaces, wherein the updated information includes an updated price for the object, an updated image of the object, an updated description of the object, or some combination thereof.

Images