Contract and synchronization using received audio or visual cues

Abstract

Methods, apparatuses, and computer-readable media for contract and synchronization using received audio or visual cues. A method for content synchronization includes receiving, by an electronic device (300), video content for display on a display (355) associated with the electronic device, identifying, by the electronic device, an indicator (606) included in the video content, and in response to identifying the indicator, identifying, by the electronic device, additional content (608) to include in the video content displayed on the display. The method further includes determining, by the electronic device, based on the video content, when to include the video content and the additional content, and providing, by the electronic device, based on the determination, the additional content for display on the display in the video content.

Description

Technical Field

[0001] The present disclosure generally relates to electronic devices. More specifically, the present disclosure relates to agreements and synchronization using received audio or visual cues.

Background Art

[0002] The use of electronic devices has expanded significantly, largely due to their usability, convenience, computing power, etc. One result of recent technological developments is that while electronic devices are becoming smaller, the number of functions performed by a given device is increasing. For example, some electronic devices support functions such as digital media playback, game play, reading electronic books (e-books), digital image capture, calendar scheduling, wireless communication, Internet search, etc. Advances in mobile computing technology have enabled users to interact with various functions and be provided with new information.

Summary of the Invention

Problems to be Solved by the Invention

[0003] Embodiments of the present disclosure provide agreements and synchronization using received audio or visual cues.

Means for Solving the Problems

[0004] In one embodiment, a method for content synchronization is provided. The method includes receiving, by an electronic device, video content for display on a display associated with the electronic device, identifying, by the electronic device, an indicator included in the video content, and in response to identifying the indicator, identifying, by the electronic device, additional content to include in the video content to be displayed on the display. The method further includes determining, by the electronic device, when to include additional content in the video content based on the video content, and providing, by the electronic device, additional content for display on the display based on the determination.

[0005] In another embodiment, an electronic device is provided. The electronic device includes a communication interface configured to receive video content for display on a display associated with the electronic device, and a processor operably coupled to the communication interface. The processor is configured to identify an indicator included in the video content, in response to identifying the indicator, identify additional content to include in the video content to be displayed on the display, determine when to include additional content in the video content based on the video content, and provide additional content for display on the display based on the determination.

[0006] In yet another embodiment, a non-transitory computer-readable medium is provided. When executed by a processor of an electronic device, the non-transitory computer-readable medium causes the electronic device to receive video content for display on a display associated with the electronic device, identify an indicator included in the video content, in response to identifying the indicator, identify additional content to include in the video content displayed on the display, based on the video content, determine when to include the additional content in the video content, and based on the determination, provide the additional content for display on the display together with the video content, including program code.

[0007] Other technical features may be readily apparent to those skilled in the art from the following figures, description, and claims.

[0008] As used herein, the term "coupled" and its derivatives refer to any direct or indirect communication between elements, whether or not the two or more elements are in physical contact with each other. The terms "transmit," "receive," and "communicate," and their derivatives, encompass both direct and indirect communication. The terms "comprise" and "include," and their derivatives, mean inclusion without limitation. The term "or" is inclusive and means "and / or." The phrase "associated with" and its derivatives mean "include, be included within, interconnect with, contain, be contained within, be connected to or with, be coupled to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be joined to or with, have, have the characteristics of, have a relationship to or with respect to." The term "controller" means any device, system, or part thereof that controls at least one operation. Such a controller may be implemented in hardware, or in a combination of hardware and software and / or firmware. The functions associated with any particular controller may be centralized or distributed, whether local or remote. The phrase "at least one of" when used with a list of items means that different combinations of one or more of the listed items may be used, and only one item in the list may be required. For example, "at least one of A, B, and C" includes any of the following combinations: A, B, C, A and B, A and C, B and C, and A and B and C.

[0009] Furthermore, the various functions described below can be implemented or supported by one or more computer programs each formed from computer-readable program code and embodied in a computer-readable medium. The terms "application" and "program" refer to one or more computer programs, software components, instruction sets, procedures, functions, objects, classes, instances, related data, or portions thereof that are adapted for implementation in appropriate computer-readable program code. The phrase "computer-readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer-readable medium" includes any type of medium that can be accessed by a computer, such as read-only memory (ROM), random access memory (RAM), hard disk drive, compact disc (CD), digital video disc (DVD), or any other type of memory. The term "non-transitory" computer-readable medium excludes wired, wireless, optical, or other communication links that transmit transient electrical signals or other signals. Non-transitory computer-readable media include media that can permanently store data and media that can store data and later overwrite it, such as rewritable optical discs or erasable memory devices.

[0010] Definitions of other specific words and phrases are provided throughout this patent document. Those of ordinary skill in the art should understand that, in most, if not all cases, such definitions apply to the prior and future use of such defined words and phrases.

[0011] To better understand the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings. In the drawings, like reference numerals represent like parts.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5A

Figure 5B

Figure 6A

Figure 6B

Figure 6C

[0013] The following FIGS. 1 to 6C described below, and various embodiments used to explain the principles of the present disclosure in this patent document, are for illustrative purposes only and should never be construed as limiting the scope of the present disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged system or device.

[0014] An electronic device according to an embodiment of the present disclosure can include a user equipment (UE) such as a mobile phone. The electronic device can also refer to any component such as a mobile station, a subscriber station, a remote terminal, a wireless terminal, a receiving point, a vehicle, or a user device. The electronic device can be a mobile phone, a smartphone, a monitoring device, an alarm device, a fleet management device, an asset tracking device, an automobile, a desktop computer, an entertainment device, an infotainment device, a vending machine, an electricity meter, a water meter, a gas meter, a security device, a sensor device, an apparatus, etc. Further, the electronic device can include a personal computer (such as a laptop, a desktop, etc.), a workstation, a server, a television, an apparatus, etc. In a particular embodiment, the electronic device can be, among other things, a portable electronic device such as a portable communication device (such as a smartphone or a mobile phone), a laptop, a tablet, an e-book reader (such as an e-reader), a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a virtual reality headset, a portable game console, a camera, and a wearable device. Further, the electronic device can be at least one of furniture or a part of a building / structure, an electronic board, an electronic signature receiving device, a projector, or a measuring device. The electronic device is one or a combination of the devices listed above. Further, the electronic device disclosed herein is not limited to the devices listed above and can include new electronic devices according to the development of technology. It should be noted that as used herein, the term "user" can indicate a human being or another device (such as an artificial intelligence electronic device) that uses the electronic device.

[0015] Embodiments of the present disclosure take into account the effort of content developers to provide new and unique ways for engaging with users of electronic devices. For example, successful content development can provide users with useful content and information when the user may desire the information. That is, if useful information is provided at a time that is inconvenient for the user or at a time when the user has no interest in the content, the provided content may be ignored by the user. For example, if a user is watching a video and content related to another scene within the video is provided to the user (e.g., by a pop-up notification, an overlay, etc.), the user may ignore the information because it is not relevant to the current scene. However, if a user is watching a video (including a pre-recorded event or a live stream) and a specific event occurs, the user may feel that specific information related to the event is useful while the event is occurring. Similarly, when a user is playing a video game, simply displaying information at a specific time instance within the game may not be useful to the user if the user is not at a specific location within the game. Further, even if the user is at a specific location within the game where the information may be useful, if a specific object is not being displayed, the information may still not be useful to the user.

[0016] Embodiments of the present disclosure provide a system and method for synchronizing when information is provided to a user. For example, if a video of a live event that can also be watched later is being broadcast live, embodiments of the present disclosure describe a method for providing information when it is relevant to the user.

[0017] Embodiments of the present disclosure also provide a system and method for including an indicator in a video stream. The video stream can be accessed on a video-based platform (or streaming service) such as YOUTUBE®, TWITCH, FACEBOOK®. As disclosed herein, an indicator can be included at a specific location within the video that causes an overlay or popup to display specific information that may be useful for viewing when detected on a viewing device associated with a user.

[0018] Embodiments of the present disclosure also provide a system and method for providing a reward system for engaging with users of an electronic device. For example, a content developer can provide a reward (physical or digital) to a user based on a specific action performed by the user. For example, the content developer can provide a reward to the user for being at a specific location or for viewing specific content.

[0019] Embodiments of the present disclosure also provide a system and method for providing physical feedback to a user. In a VR or augmented reality (AR) environment, video stimuli can be provided via a head-mounted display (HMD), and audio stimuli can be provided by headphones or speakers. Embodiments of the present disclosure describe using haptic feedback on a controller held by the user to provide yet another immersive element to the user (in addition to video and / or auditory stimuli). When a user is playing a displayed video game, a user interface device can provide haptic feedback to the user. For example, an electronic device (such as an egg, action figure, user interface controller (such as a mouse or game controller), etc.) having an input device (such as a microphone, light sensor, etc.) can vibrate in response to receiving an input, such as when a particular sound is received, or when a particular light color, wavelength, blinking light pattern, etc. is detected. For example, the controller can vibrate in response to detecting a particular light-based signal (such as a predetermined pulse pattern of light, a particular color pulsed at a particular frequency, etc.) by the controller. As another example, when the controller detects a particular sound output from a speaker while the user is playing a video game, the controller can vibrate. The vibration can occur in a selected situation in response to the detection of a particular sound, thereby further immersing the user in the gameplay (in addition to video and audio stimuli).

[0020] FIG. 1 shows an exemplary networked system 100 in which various embodiments of the present disclosure may be implemented. The embodiment of the networked system 100 shown in FIG. 1 is for illustrative purposes only. Other embodiments of the networked system 100 may be used without departing from the scope of the present disclosure.

[0021] As shown in FIG. 1, system 100 includes a network 101 that facilitates communication between various components within system 100. For example, network 101 can communicate Internet Protocol (IP) packets or other information between network addresses. Network 101 can include one or more local area networks (LANs); metropolitan area networks (MANs); wide area networks (WANs); virtual private networks (VPNs); all or a portion of a global network such as the Internet; or any other one or more communication systems located in one or more locations.

[0022] Network 101 facilitates communication between various servers 102-104 and various client devices 106-114. Each of servers 102-104 can be any suitable electronic computing device or processing device capable of providing a computing service that includes software for one or more client devices 106-114. Each of servers 102-104 can include, for example, one or more processing devices, one or more memories for storing instructions and data, and one or more network interfaces that facilitate communication via network 101. For example, as described in more detail below, server 102 can use one or more of client devices 106-114 to provide or manage the provision of instructions in media content for synchronizing content, the provision of user feedback (such as tactile feedback), etc. In another example, server 102 can provide or manage a reward system based on notifications received from one or more of client devices 106-114. The reward system can be associated with a user and can be associated with an account linked to one or more of client devices 106-114.

[0023] Each of the client devices 106-114 represents any suitable electronic computing device or processing device that interacts with at least one server or other computing device via the network 101. In this example, the client devices 106-114 include desktop computers 106, mobile phones or smartphones 108, tablet computers 110, laptop computers 112, video game consoles 114, set-top boxes and / or televisions, and the like. However, in the networked system 100, any other or additional client devices can also be used. For example, any Internet or network connectable device or Internet of Things (IoT) device (e.g., smart TV, refrigerator, Raspberry PI, etc.) can be used as one of the client devices 106-114 within the system 100. In another example, peripheral devices (such as game controllers, mice, keyboards, etc.) can also be used as one of the client devices 106-114 within the system 100. As will be described below, in various embodiments, the client devices 106-114 participate in processing various tasks such as sending and receiving signals for user contract purposes under the coordination of the server 102. For example, as described herein, the client devices 106-114 can execute various video games or interactive applications, including the ability to display content in a synchronized manner based on events within a video game and to provide feedback (such as tactile feedback) to the user. Further, in various embodiments, any of the client devices 106-114 can generate, transmit, and / or analyze signals such as audio signals, radio frequency (RF) signals, optical signals (such as various colors, varying wavelengths, various frequencies of light pulses, etc.), other types of electromagnetic signals or electromagnetic waves. In some embodiments, the individual client devices 106-114 can communicate directly or indirectly with each other or with the server using, for example, peer-to-peer, ad hoc, and / or mesh-based networks, regardless of the presence of a centralized server.In certain embodiments, the individual client devices 106 - 114 can communicate with each other or with the server using Wi-Fi, near field communication (NFC), BLUETOOTH®, infrared, voice, or any other RF signals.

[0024] FIG. 1 shows an example of a networked system 100, but various changes can be made to FIG. 1. For example, the system 100 can include any number of each component in any suitable arrangement, and each of the servers 102 - 104 and client devices 106 - 114 can represent any number of servers and / or client devices that are part of the system 100. In general, computing and communication systems exist in a wide variety of configurations, and FIG. 1 does not limit the scope of the present disclosure to any particular configuration. FIG. 1 shows one operating environment in which the various features disclosed in this patent document can be used, but these features can be used in any other suitable system.

[0025] FIGS. 2 and 3 show exemplary computing devices in a networked system according to various embodiments of the present disclosure. In particular, FIG. 2 shows an exemplary server 200, and FIG. 3 shows an exemplary client device 300. In this exemplary example, the server 200 can represent any one of the servers 102 - 104 of FIG. 1, and the electronic device 300 can represent one or more of the client devices 106 - 114 of FIG. 1.

[0026] As shown in FIG. 2, server 200 includes a bus system 205 that supports communication between a processor 210, a storage device 215, a communication interface 220, and an input / output (I / O) unit 225. The processor 210 executes instructions that may be loaded into a memory 230. The processor 210 may include any suitable number and type of processors or other devices in any suitable arrangement. Exemplary types of the processor 210 include microprocessors, microcontrollers, digital signal processors, field programmable gate arrays, application specific integrated circuits, and discrete circuits.

[0027] Memory 230 and persistent storage 235 are examples of the storage device 215 and represent any structure capable of storing information (such as data, program code, and / or other suitable information, whether temporary or persistent) and facilitating retrieval of that information. The memory 230 may represent random access memory or any other suitable volatile or non-volatile storage device. The persistent storage 235 may include one or more components or devices that support long-term storage of data, such as read-only memory, hard drives, flash memory, or optical disks. For example, the persistent storage 235 may store one or more databases of data, client applications, reward systems (including unpaid rewards), video data, text data, audio data, etc. for delivery via the network 101.

[0028] The communication interface 220 supports communication with other systems or devices. For example, the communication interface 220 may include a network interface card or a wireless transceiver that facilitates communication via the network 101. The communication interface 220 may support communication via any suitable physical or wireless communication link.

[0029] The I / O unit 225 enables data input and output. For example, the I / O unit 225 may provide a connection for user input via a keyboard, mouse, keypad, touch screen, or other suitable input device. The I / O unit 225 may also send the output to a display, printer, or other suitable output device.

[0030] FIG. 2 shows an example of the server 200, but various changes can be made to FIG. 2. For example, various components in FIG. 2 can be combined, further subdivided, or omitted, and additional components can be added according to specific needs. As a specific example, although shown as one system, the server 200 may include a plurality of server systems that may be remotely located. In another example, different server systems may provide some or all of the processing, storage, and / or communication resources for the purposes of synchronization and contracting according to various embodiments of the present disclosure.

[0031] FIG. 3 shows an exemplary client device 300 according to an embodiment of the present disclosure. The embodiment of the electronic device 300 shown in FIG. 3 is for illustrative purposes only, and one or more of the client devices 106-114 in FIG. 1 can have the same or similar configurations. However, client devices exist in a wide variety of configurations, and FIG. 3 does not limit the scope of the present disclosure to any particular implementation form of the electronic device.

[0032] As shown in FIG. 3, the electronic device 300 includes an antenna 305, a communication interface 310, a microphone 320, and a speaker 330. The electronic device 300 also includes a processor 340, an I / O interface 345, an input 350, a display 355, a memory 360, and a sensor 365. The memory 360 includes an operating system (OS) 361 and one or more applications 362.

[0033] The communication interface 310 can be similar to the communication interface 220 in FIG. 2. The communication interface 310 supports communication with other systems or devices. For example, the communication interface 310 can include a network interface card or a wireless transceiver that facilitates communication via the network 101. The communication interface 310 may support communication via any suitable physical or wireless communication link. In embodiments that utilize wireless communication, the communication interface 310 can include an RF transceiver, a BLUETOOTH transceiver, a WI-FI transceiver, a ZIGBEE transceiver, an infrared transceiver, a radio frequency identifier (RFID) tag (e.g., active or passive), and various other transceivers for receiving and / or transmitting wireless communication signals. The communication interface 310 can receive an input RF signal (via the antenna 305) using various wireless communication protocols (such as BLUETOOTH, Wi-Fi, cellular, LTE communication protocol, etc.). The signal can be transmitted from an access point (such as a base station, a WI-FI router, or a BLUETOOTH device) or another device on the network 101 (such as WI-FI, BLUETOOTH, cellular, 5G, LTE, LTE-A, WiMAX, or any other type of wireless network). The communication interface 310 can also receive data from the processor that is to be transmitted to an access point or another device on the network 101 via an RF signal.

[0034] The microphone 320 according to one embodiment may receive sound and convert the sound into an electrical signal. The received sound may be in the audible spectrum, the non-audible spectrum, or both.

[0035] The speaker 330 according to one embodiment may output an electrical signal as sound. For example, the speaker 330 may output an audio signal outside the electronic device 300. The speaker 330 may be used for general purposes such as playing audio content. In a specific embodiment, the speaker 330 can output sound in both the audible spectrum and the inaudible spectrum.

[0036] The processor 340 may include one or more processors or other processing devices. The processor 340 can execute instructions stored in the memory 360 such as the OS 361 to control the overall operation of the electronic device 300. The processor 340 may include any appropriate number and type of processors or other devices in any appropriate arrangement. For example, in a specific embodiment, the processor 340 includes at least one microprocessor or microcontroller. Exemplary types of the processor 340 include microprocessors, microcontrollers, digital signal processors, field programmable gate arrays, application specific integrated circuits, and discrete circuits.

[0037] The processor 340 can also execute other processes and programs resident in the memory 360, such as operations of receiving and storing data. The processor 340 can cause data to enter and exit the memory 360 as required by the running processes. In a specific embodiment, the processor 340 is configured to execute one or more applications 362 based on the OS 361 or in response to signals received from an external source or operator. Exemplary applications 362 can include video games, videos, location identification applications (such as the Global Positioning System (GPS)), VR or AR applications, camera applications (for still images and videos), video call applications, email clients, social media clients, SMS messaging clients, virtual assistants, and the like.

[0038] Processor 340 is also coupled to an I / O interface 345 that provides the electronic device 300 with the ability to connect to other devices such as client devices 106-114. The I / O interface 345 is a communication path between these accessories and the processor 340.

[0039] Processor 340 is also coupled to an input 350 and a display 355. An operator of the electronic device 300 can use the input 350 to input data or input into the electronic device 300. The input 350 can be a keyboard, touch screen, mouse, trackball, controller (such as a video game controller), joystick, voice input, sound, or other device that can function as a user interface that enables a user to interact with the electronic device 300. For example, the input 350 can include voice recognition processing, thereby enabling the user to input voice commands. In another example, the input 350 can include a touch panel, (digital) pen sensor, keys, or ultrasonic input device. The touch panel can recognize touch input in at least one mode such as a capacitance mode, a pressure-sensitive mode, an infrared mode, or an ultrasonic mode. The input 350 can be associated with the sensor 365 and / or the camera by providing additional input to the processor 340. In certain embodiments, the sensor 365 includes one or more inertial measurement units (IMUs) (such as an accelerometer, gyroscope, and magnetometer), a motion sensor, an optical sensor, a camera, a pressure sensor, a heart rate sensor, an altimeter, etc. The input 350 can also include a control circuit. In the capacitance mode, the input 350 can recognize touch or proximity.

[0040] The display 355 can be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic LED (OLED), an active matrix OLED (AMOLED), or other display capable of rendering text and / or graphics from a website, video, game, image, etc. The display 355 can be sized to fit within the HMD. The display 355 can be a single display screen or multiple display screens capable of creating a stereoscopic display. In certain embodiments, the display 355 is a head-up display (HUD). The display 355 can display 3D objects such as animated 3D objects.

[0041] The memory 360 is coupled to the processor 340. A portion of the memory 360 can include RAM, and another portion of the memory 360 can include flash memory or other ROM. The memory 360 can include a persistent storage (not shown) representing any structure capable of storing information (such as data, program code, and / or other suitable information) and facilitating retrieval of that information. The memory 360 can include one or more components or devices, such as read-only memory, hard drive, flash memory, or optical disk, that support long-term storage of data. The memory 360 can also include media content. The media content can include various types of media such as images, videos, 3D content, VR content, AR content, animated and static 3D objects.

[0042] The electronic device 300 further includes one or more sensors 365 that can measure a physical quantity, detect an operating state of the electronic device 300, and convert the measured or detected information into an electrical signal. For example, the sensor 365 can include one or more buttons for touch input, a camera, a gesture sensor, an IMU sensor (such as a gyroscope or gyro sensor and an accelerometer), an eye tracking sensor, a barometric pressure sensor, a magnetic sensor or magnetometer, a grip sensor, a proximity sensor, a color sensor, a biophysical sensor, a temperature / humidity sensor, an illuminance sensor, an ultraviolet (UV) sensor, an electromyogram (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an IR sensor, an ultrasonic sensor, an iris sensor, a fingerprint sensor, a color sensor (such as a red green blue (RGB) sensor / camera, etc.), a depth sensor, a D-RGB sensor (depth red green blue sensor / camera), a position sensor (such as GPS, etc.), an RFID receiver, and the like. The sensor 365 can further include a control circuit for controlling any of the sensors included therein.

[0043] As will be described in more detail below, one or more of these sensors 365 can include a tactile sensor. The tactile sensor can convert an electrical signal into a mechanical stimulus (such as vibration or movement) or an electrical stimulus, which may be recognized by the user via the user's tactile or kinesthetic sense. According to one embodiment, the tactile sensor may include, for example, a motor, a piezoelectric element, an electrical stimulation device, and the like.

[0044] Figures 2 and 3 show examples of electronic devices, but various changes can be made to Figures 2 and 3. For example, various components in Figures 2 and 3 can be combined, further subdivided, omitted, and additional components can be added according to specific needs. As a specific example, the processor 340 can be divided into a plurality of processors such as one or more central processing units (CPUs) and one or more graphics processing units (GPUs). Further, similar to computing and communication, the electronic device and the server may exist in a wide variety of configurations, and Figures 2 and 3 do not limit the present disclosure to any specific electronic device or server.

[0045] Embodiments of the present disclosure describe various ways to engage users, including providing empirical evidence that includes providing tactile feedback, registering user participation, and rewards upon detecting certain sounds or signals. For example, the empirical evidence can provide user credit, which may be an enhanced user experience by trading accumulated credit from one or more previous contracts for physical and digital objects. Credit can be provided to the user for viewing certain content, being in a certain location, etc. In another example, the empirical evidence can also provide tactile feedback to the user. This is described in the following examples and embodiments, such as the examples and embodiments of FIGS. 4A and 4B.

[0046] FIG. 4A shows an exemplary timing diagram 400 according to an embodiment of the present disclosure. FIG. 4B shows an exemplary method 470a for a contract according to an embodiment of the present disclosure. The steps of method 470a in FIG. 4B can be executed by any of client devices 106-114 of FIG. 1, such as electronic device 300 of FIG. 3. Timing diagram 400 and method 470a are for illustrative purposes only, and other embodiments can be used without departing from the scope of the present disclosure.

[0047] Timing diagram 400 of FIG. 4A shows electronic device 410, electronic device 420, and server 430. Electronic device 410 and electronic device 420 can be similar to any of client devices 106-114 of FIG. 1 and can include internal components similar to those of electronic device 300 of FIG. 3. Similarly, server 430 can be similar to any of servers 102-104 of FIG. 1 and can include internal components similar to those of server 200 of FIG. 2. In certain embodiments, server 430 is omitted from timing diagram 400.

[0048] In certain embodiments, electronic device 410 is a portable device while electronic device 420 is a stationary device. In this example, server 430 can provide rewards to an account associated with a user of electronic device 410 when electronic device 410 moves within a predetermined distance from electronic device 420 and the like.

[0049] In this embodiment, electronic device 410, which is a portable device, transmits a signal (step 442). For example, electronic device 410 can move with the user. For example, electronic device 410 can be carried by the user (such as in the user's hand), placed in a pocket of the clothing worn by the user, attached to the clothing worn by the user, placed in a bag carried by the user, and so on. The signal transmitted by electronic device 410 can be an audible or inaudible sound wave generated by a speaker such as speaker 330 in FIG. 3. The signal transmitted by electronic device 410 can also be an RF signal, an infrared (IR) signal, an audio signal, an optical signal, or the like. The signal can be transmitted continuously or based on a pattern or a detected event. In some embodiments, electronic device 410 may include an RFID tag for actively or passively communicating such a signal. For example, an RFID receiver at a certain location can detect the presence of electronic device 410 near that location to receive the signal, and this signal does not necessarily have to be actively transmitted by electronic device 410.

[0050] In step 444, electronic device 420 receives the signal transmitted by electronic device 410. In this example, electronic device 420 is stationary and is located at a specific location. For example, if electronic device 420 is placed at a concert or a meeting and receives a signal transmitted from electronic device 410, electronic device 410 can determine that it is at the same location as electronic device 420.

[0051] In step 450, the electronic device 420 performs an action. In this example, the action may be to generate a notification and send it to the server 430. This notification may be transmitted to the server 430 via the network 101. The notification can inform the server 430 that the electronic device 410 is located at the same or a similar location as the electronic device 420.

[0052] In step 460, the server 430 receives the notification sent by the electronic device 420. In step 462, the server 430 performs an operation. For example, the server 430 can determine the location of the electronic device 410 based on the known location of the electronic device 420. Then, the server 430 can search for the reward account associated with the user of the electronic device 410. When there is a reward account associated with the user of the electronic device 410, the server provides a reward to the reward account. In certain embodiments, the reward may have a monetary value. In certain embodiments, the reward can be linked to the user's profile. The user's profile can indicate how many locations the user has visited. In certain embodiments, the reward can be expressed as points. For example, the points can be spent in a game for character upgrades, avatar improvements representing the user, acquisition of digital content, etc.

[0053] In certain embodiments, the electronic device 410 is stationary, and the electronic device 420 may be stationary or portable. In this example, the server 430 can provide a reward to the account associated with the user of the electronic device 420. It should be noted that this example is different from the above-described embodiments in that (i) the electronic device 410 is portable while the electronic device 420 is stationary, and (ii) the server 430 provides a reward to the electronic device 410.

[0054] In this embodiment, the electronic device 410 is stationary and emits sound via a speaker such as the speaker 330 in FIG. 3 (step 442). For example, the electronic device 410 can be associated with a speaker (such as the speaker 330 in FIG. 3) in events such as a concert environment, a commercial environment, an industrial environment, or a residential environment. The sound can be audible (such as musical instrument sound or speech sound), inaudible, or both. The electronic device 410 can also transmit an RF signal in addition to, or instead of, the sound wave.

[0055] As described above, the electronic device 420 can be either stationary or portable. For example, the electronic device 420 can be carried by a user (such as in the user's hand), placed in a pocket of clothing worn by the user, attached to the clothing worn by the user, placed in a bag carried by the user, etc. In another example, the electronic device 420 can be stationary, such as a listening device that stays in a specific location and listens for specific sounds. In yet another example, the electronic device 420 can be used to interact with another electronic device such as a game controller or a mouse.

[0056] In step 444, the electronic device 420 receives the signal transmitted by the electronic device 410. For example, the electronic device 420 can include a microphone similar to the microphone 320 in FIG. 3 for converting sound into an electrical signal. In another example, the electronic device 420 can include a receiver (or transceiver) similar to the communication interface 310 in FIG. 3 for receiving an RF signal.

[0057] In step 450, the electronic device 420 performs an action. For example, based on the type of signal or an indicator associated with the signal, the electronic device 420 can perform various actions. In one example, the electronic device 420 can send a notification to the server 430. The notification can inform the server that the electronic device 420 has received a specific signal from another device that is identified as the electronic device 410. For example, the notification can inform the server 430 that the electronic device 420 is in a location similar to that of the electronic device 410 (since it was able to receive the signal transmitted by the electronic device 410). The notification can also inform the server 430 that the user of the electronic device 420 is listening to a specific audio. In another example, upon receiving a signal, the electronic device can provide haptic feedback to the user. For example, the electronic device 420 can be a game controller (such as a mouse) that vibrates when it detects a specific sound while the user is playing a video game (emitted from the electronic device 410). In another example, the action may be related to unlocking a property of the electronic device 420 or associated with it. For example, the electronic device 420 may be an egg or an action figure associated with a game or video. Based on the reception or detection of a specific number of chirps or other sounds (for example, as evidence that the user having the electronic device 420 has been present in a location for a specific amount of time or consumed digital content for a specific amount of time), the egg may hatch, or the capabilities associated with the action figure may be unlocked or improved.

[0058] In some examples, the electronic device 420 may be associated with a digital good, such as a non-fungible token (NFT). In such embodiments, the electronic device 420 may be the personal electronic device of the owner of the digital good, and the user of the electronic device 420 may detect that they are to receive a reward (e.g., for content consumption or participation in a location as described above). As a result, the server 430 may determine to improve or modify the value, appearance, or other quality of the digital good as the reward. In some embodiments, the digital good may be an action figure, character, or object within a game or video. In some examples, improving or modifying the quality of the digital good may include modifying the appearance or capabilities of an action figure within a game or video.

[0059] In other examples of actions performed, the action may be associated with either or both a physical representation and a digital representation. For example, in addition to receiving or modifying a digital good, a physical object such as a badge or game object may have modified physical characteristics such as light or color and be associated with a digital good having corresponding modified digital characteristics.

[0060] Block 470, which includes steps 444 and 450, is described in more detail in method 470a of FIG. 4B.

[0061] In step 460, the server 430 receives the notification transmitted by the electronic device 420.

[0062] In step 462, server 430 executes an operation. For example, server 430 can determine the location of electronic device 420 based on the known location of electronic device 410. Server 430 can search for a reward account associated with the user of electronic device 420. When there is a reward account associated with the user of electronic device 420, server 430 provides a reward to the reward account. For example, the reward can be given in exchange for the user being in a location similar to that of electronic device 410. In certain embodiments, the reward may have a monetary value. In certain embodiments, the reward can be linked to the user's profile. For example, the user's profile can indicate how many locations the user has visited. In certain embodiments, the reward can be represented as points. For example, the points can be spent in a game for character upgrades, avatar improvements representing the user, acquisition of digital content, acquisition or modification of digital goods, etc.

[0063] Note that steps 460 and 462 may be omitted if the action performed by electronic device 420 in step 450 did not send a notification. In another example, electronic device 420 can locally store information about an event for a period of time. The information about the event can be transmitted in response to another event occurring, such as when the electronic device is scanned at a later time.

[0064] Method 470a in FIG. 4B describes block 470 in FIG. 4A in more detail. In step 444, electronic device 420 receives a signal. The signal can be transmitted from electronic device 410. The signal can be audible, inaudible, RF, etc.

[0065] In step 446, the electronic device 420 identifies information related to the received signal. The information can be identified based on the signal itself, sensors associated with the electronic device 420 (such as sensor 365 in FIG. 3), etc. For example, the relevant information can be identified based on the signal type (being audio, RF, or a specific RF signal). For example, a BLUETOOTH® signal can indicate something different from an audible voice signal. Similarly, the signal itself can represent the relevant information. In another example, the relevant information can be identified based on whether sensors of the electronic device 420 detect physical measurements such as detection of light, darkness, pressure, altitude, movement, etc. For example, the relevant information can indicate whether the electronic device 420 is portable as compared to a stationary device based on movement being detected at a time close to when the signal is received. In yet another example, the relevant information may be based on the type of the device of the electronic device 420. For example, the relevant information can indicate that the electronic device 420 is an interface item such as a mouse, keyboard, game controller, etc.

[0066] In step 448, the electronic device 420 determines the signal type. The signal can represent a proof of experience. The proof of experience can cause tactile feedback or physical movement of a peripheral device. The proof of experience can also provide the user with a reward that can be redeemed at a later date and / or at a certain location. The determination of the signal type may be based on the relevant information and the received signal. For example, the determination of the signal type may be based on whether the signal is BLUETOOTH® as compared to an audio-based sound. In another example, the determination of the signal type may be based on whether the electronic device 420 is moving or is stationary. In another example, the determination of the signal type may be based on the device category of the electronic device 420.

[0067] When it is determined (in step 448) that the signal is classified as a first signal type, the electronic device 420 executes step 450a. For example, step 450a can be executed based on the determination of the location of the electronic device 420 indicated by one or more sensors (such as a concert venue or the location where the electronic device 410 is placed). For example, the location can be identified via a location type sensor (such as GPS) of the electronic device 420. In another example, step 450a can be executed based on the content associated with the signal. For example, the signal itself can specify that it is a first type of signal.

[0068] In step 452, the electronic device 420 generates a notification. The notification can indicate the presence of the electronic device 410. For example, the notification can indicate that the electronic device 410 is within a predetermined distance of the electronic device 420. The notification can also indicate information associated with the content of the received signal. For example, the notification can indicate that the user of the electronic device 420 is listening to specific content (based on the voice signal received from step 444). For example, when the user of the electronic device 420 and the electronic device 420 are in the same location (such as when the electronic device 420 is worn by the user), the electronic device 420 acquires the same voice signal heard by the user via a microphone (such as the microphone 320 in FIG. 3). Therefore, the generated notification can specify what content the user of the electronic device 420 has listened to. Based on that indication, the server 430 can provide a reward to the reward account associated with the user of the electronic device 420.

[0069] In step 454, the electronic device transmits the notification to the server 430. Based on the indication included in this notification, the server 430 provides a specific reward to the reward account associated with the user of the electronic device 420.

[0070] When it is determined that the signal is classified as a second signal type (at step 448), the electronic device 420 executes step 450b. For example, step 450b can be executed based on the content associated with the signal. For example, the signal itself can specify that it is a second type of signal. In another example, step 450b can be executed when the electronic device is classified as a particular device type, such as a user interface controller similar to a mouse.

[0071] At step 456, the electronic device 420 executes haptic feedback based on the received signal. In certain embodiments, the electronic device 420 can execute different vibration patterns based on different received signals. That is, a plurality of signals can be classified as a second signal type, where each signal indicates that the electronic device 420 is to execute a different vibration pattern.

[0072] In these embodiments, a user of the electronic device 410 / 420 is provided with rewards and / or participation credits for viewing content or passively participating in an event without the need to provide information to or register for the provided event or content. Further, an event or content provider or promoter can better identify and engage with participants without requiring the participants to register directly with the event or content provider or promoter.

[0073] FIG. 4A shows a timing diagram 400 and FIG. 4B shows a method 470a, although various changes can be made to FIGS. 4A and 4B. For example, although method 470a is shown as a series of steps, the various steps can overlap, occur in parallel, occur in a different order, or occur multiple times. In another example, steps can be omitted or replaced with other steps. For example, the steps of method 470a can be executed in a different order.

[0074] Embodiments of the present disclosure describe various methods for synchronizing content within a video. This is described in the following examples and embodiments, such as the examples and embodiments of FIGS. 5A - 6C.

[0075] FIGS. 5A and 5B respectively show exemplary methods 500 and 510 for synchronizing content within a video according to an embodiment of the present disclosure. In particular, method 500 of FIG. 5A describes a method executed by a server for synchronizing content within a video according to an embodiment of the present disclosure. Method 510 of FIG. 5B describes a method executed by a user device for synchronizing content within a video according to an embodiment of the present disclosure. FIGS. 6A, 6B, and 6C show exemplary diagrams of an electronic device 602 for displaying content according to an embodiment of the present disclosure. The steps of method 500 in FIG. 5A can be executed by any one of servers 102 - 104 in FIG. 1, such as server 200 in FIG. 2. The steps of method 510 in FIG. 5B can be executed by any one of client devices 106 - 114 in FIG. 1, such as electronic device 300 in FIG. 3. Methods 500 and 510 and the diagrams of FIGS. 6A - 6C are for illustrative purposes only, and other embodiments can be used without departing from the scope of the present disclosure.

[0076] Method 500 in FIG. 5A describes a server that includes an indicator within a video stream for synchronizing content. In step 502, server 300 acquires content associated with a predetermined event within the video. The video may be live - streamed or pre - recorded. The video may be for streaming to an end - user's electronic device (such as any of client devices 106 - 114 in FIG. 1 and electronic device 300 in FIG. 3). In certain embodiments, the video may be VR or AR. The content may be generated by a third party independent of the creator of the video itself.

[0077] In step 504, server 200 embeds an indicator into the video. The indicator is embedded (or added as an overlay) at a specific time instance corresponding to a predetermined event within the video. In a particular embodiment, the indicator may be pixels of a predetermined color added at a specific location within the frame of the video corresponding to a predetermined event. In a particular embodiment, the indicator may be a predetermined shape embedded at a specific location within the frame of the video corresponding to a predetermined event. In a particular embodiment, the indicator may be a barcode or a Quick Response (QR) code. After the indicator is embedded in the video, the video is received and viewed by an end user.

[0078] In step 506, server 200 receives a notification that the indicator has been identified by the viewing device. In step 508, server 200 transmits the retrieved content for display to the viewing device. Thereby, the viewing device can display the content at a specific instance in response to pixels being displayed on the display of the viewing device.

[0079] Method 510 of FIG. 5B illustrates a viewing device that synchronizes content in response to the identification of an indicator within a video stream. For example, if different users are viewing the video stream at different time instances, the synchronized content may be presented to the users based on a specific time or event occurrence in the video rather than all viewers receiving the content at the same time instance.

[0080] In step 512, the electronic device 300 receives and displays a video. The video may be of a live event or a pre-recorded event. The video may be streamed. In step 514, while displaying the video, the electronic device 300 identifies an indicator embedded at a specific point within the video. The indicator may be specific pixels of a predetermined color arranged at a specific location within a frame or a series of frames.

[0081] In step 516, the electronic device 300 sends a notification to the server that a specific indicator was included in the video. The notification generated by the electronic device 300 can be sent to a specific server (such as server 200 in FIG. 2 or server 430 in FIG. 4A) that specifies various parameters of the indicator. The indicator parameters can include color, location within the frame, size, shape, etc. By sending the indicator parameters to the server, the server can be enabled to determine what information to send to the electronic device 300. For example, the server can include in its memory (such as memory 215 in FIG. 2) a lookup table that associates specific information to be sent as synchronized content with specific parameters of the indicator. In other embodiments, the electronic device 300 can use the identified parameters of the indicator to determine what content to include in the video by the electronic device 300 without the need to send the parameters to the server for determination. In another example, the indicator and / or the parameters of the indicator enable the electronic device 300 to know when to display content so that additional content is synchronized with the displayed content. For example, this additional content may be pre-loaded on the client and waiting to be executed, or the indicator may indicate when to request the additional content.

[0082] In step 518, the electronic device 300 can receive content from the server. In step 520, the electronic device 300 displays the received content. In certain embodiments, the electronic device 300 displays the content on top of the video as an overlay. For example, the content creator can request that viewers vote on an action associated with the content (e.g., an action to take in a video game) or provide feedback. Since the content may not be consumed when it is created (e.g., whether due to on-demand viewing or a slight time difference due to transmission and / or processing delays), the electronic device 300 can present the overlay at an appropriate time during the display of the content, regardless of when the content was created. In other examples, the overlay content may be supplementary content for personalizing or enhancing the viewer's viewing experience. For example, the supplementary content may be a modification to the appearance of an object or person within the content or bonus content that enables a particular viewer to have a different or enhanced viewing experience.

[0083] In other embodiments, the content may already be on the electronic device 300. For example, the electronic device 300 can look at an indicator and react to display the content without having to signal the server to obtain the requested content. For example, the content can be preloaded on the client, and the electronic device 300 uses the indicator as a way to synchronize the time when local content is displayed, for example, to reduce the waiting time from having to request the content.

[0084] In certain embodiments, the indicator identified in step 514 may be an encoded symbol such as a barcode or a QR code (registered trademark). The electronic device 300 can scan (or read) the indicator and display the content as an overlay, as described above in step 520. In this embodiment, steps 516 and 518 may be omitted. The electronic device 300 using the Internet (or any other network such as network 101 in FIG. 1) can search for the content that will be displayed based on the indicator. In other examples, the embedded indicator can be read and interpreted by the electronic device 300, and the overlay display can be started immediately without the need to communicate back to any server. For example, the electronic device 300 can identify a "game start" command via the embedded indicator, and then the electronic device 300 interprets it to create an overlay that is locally executed on the browser of the electronic device 300 and pop up a "game start" menu.

[0085] In other embodiments, step 516 may be performed and step 518 may not be performed. For example, since the electronic device 300 can perform signaling of the code streamed in 516 in synchronization with the server, by signaling back to the server, the server can be informed of when the content was started in the electronic device 300. For example, in a video streaming scenario, this signaling may enable the live streamer to know when a member of its audience has completed the current event. For example, if the streamer wants to select a winner by lottery, the streamer needs to know, for example, when all have completed entering their names, which means that the streamer may need to wait for the audience members to watch the start and end portions of the event streamed on the video before selecting a winner from the participants.

[0086] Figures 6A, 6B, and 6C show an electronic device 602 that displays content on a display 604. The electronic device 602 can be similar to any of the client devices 106-114 of FIG. 1, the electronic device 300 of FIG. 3, the electronic device 410, the electronic device 420, etc. The display 604 can be similar to the display 355 of the electronic device 300 of FIG. 3.

[0087] FIG. 6A shows the electronic device 602 at time T 0 FIG. 6B shows the electronic device 602 at time T 1 FIG. 6C shows the electronic device 602 at time T 2 Note that times T 0 , T 1 , and T 2 represent consecutive time instances, with T 0 < T 1 < T 2 .

[0088] As shown in FIG. 6A, the electronic device 602 is displaying content on the display 604. This may be similar to step 512 of FIG. 5B. FIG. 6B also shows that the electronic device 602 is displaying content and an indicator 606 on the display 604. The indicator 606 is included in the received content being displayed. In certain embodiments, the indicator 606 is a QR code (registered trademark). FIG. 6C shows the electronic device 602 displaying video content and content 608. In certain embodiments, the content 608 may be an overlay that is displayed on top of the video content. For example, as described above, the overlay may be associated with a request for viewer feedback, such as voting or requesting that a particular action be performed during a video game or other content. Also, the size of the video content can be adjusted so that the content 608 does not overlap with any of the video content.

[0089] FIG. 5A shows method 500, FIG. 5B shows method 510, FIGS. 6A-6C show various diagrams, and various changes can be made to FIGS. 5A-6C. For example, although methods 500 and 510 are shown as a series of steps, the various steps may overlap, occur in parallel, occur in a different order, or occur multiple times. In another example, steps may be omitted or replaced with other steps. For example, the steps of methods 500 and 510 can be executed in a different order.

[0090] The above flowcharts show exemplary methods that can be implemented in accordance with the principles of the present disclosure, and various changes can be made to the methods shown in the flowcharts herein. For example, although shown as a series of steps, the various steps in each figure may overlap, occur in parallel, occur in a different order, or occur multiple times. In another example, steps may be omitted or replaced with other steps.

[0091] In various embodiments, a method for content synchronization is provided. The method includes receiving, by an electronic device, video content for display on a display associated with the electronic device, identifying, by the electronic device, an indicator included in the video content, in response to identifying the indicator, identifying, by the electronic device, additional content to include with the video content displayed on the display, determining, by the electronic device, based on the video content, when to include the additional content with the video content, and providing, by the electronic device, based on the determination, the additional content for display on the display with the video content.

[0092] In any of the above embodiments, identifying the additional content to include with the video content further includes transmitting, by the electronic device, a notification of the identification of the indicator and receiving, by the electronic device, information associated with the additional content to include with the video content.

[0093] In any of the above embodiments, identifying additional content to include with video content further includes the electronic device identifying parameters of an indicator included in the video content and the electronic device identifying additional content to include with the video content based on the parameters of the indicator.

[0094] In any of the above embodiments, determining when to include additional content with video content further includes identifying a time within the displayed video content based on when an indicator is displayed within the video content and determining when to include additional content for display on a display with the video content based on the identified time within the video content.

[0095] In any of the above embodiments, determining when to include additional content with video content further includes identifying an event occurring within the displayed video content based on when an indicator is displayed within the video content and determining when to include additional content for display on a display with the video content based on the identified event occurring within the video content.

[0096] In any of the above embodiments, the method further includes the electronic device receiving a signal associated with an event and the electronic device transmitting a notification associated with detecting the signal associated with the event.

[0097] In any of the above embodiments, the method further includes the electronic device identifying receipt or modification of a digital good relevant to a user of the electronic device as a result of detecting a signal associated with an event.

[0098] The figures show different examples of user equipment, but various changes can be made to the figures. For example, the user equipment can include any number of each component in any suitable arrangement. In general, the figures do not limit the scope of the present disclosure to a specific configuration. Further, the figures show an operating environment in which various user equipment features disclosed in this patent document can be used, but these features can be used in any other suitable system. None of the descriptions in this application should be read as implying that any particular element, step, or function is an essential element that must be included in the claims.

[0099] The present disclosure has been described using exemplary embodiments, but various changes and modifications may be suggested to those skilled in the art. The present disclosure is intended to embrace such changes and modifications as fall within the scope of the appended claims.

Claims

1. An electronic device (300), comprising: a communication interface (310) configured to receive video content for display on a display (355) associated with the electronic device; a processor (340) operably coupled to the communication interface; wherein the processor (340) is configured to: identify an indicator (606) included in the video content; in response to the identification of the indicator, identify additional content (608) to include with the video content to be displayed on the display; determine when to include the additional content in the video content based on the video content; and provide the additional content for display on the display with the video content based on the determination. An electronic device (300) configured as such.

2. The communication interface is further configured to: send a notification of the identification of the indicator; and receive information associated with the additional content to be included in the video content. The processor is further configured to identify the additional content to be included in the video content based on the received information. An electronic device according to claim 1.

3. To identify the additional content to be included with the video content, the processor is further configured to: identify parameters of the indicator included in the video content; and identify the additional content to be included in the video content based on the parameters of the indicator. An electronic device according to claim 1.

4. To determine when to include the additional content in the video content, the processor is further configured to: identify a time within the video content being displayed based on when the indicator is displayed within the video content; and determine when to include the additional content for display on the display in the video content based on the identified time within the video content. An electronic device according to claim 1.

5. To determine when to include the additional content in the video content, the processor is further configured to: ​ ​ ​ ​ ​ ​ ​ ​ Identify events occurring within the displayed video content based on when the indicator is displayed within the video content, Determine when to include the additional content for display on the display in the video content based on the identified events occurring within the video content, and is further configured to The electronic device according to claim 1.

6. The communication interface Receives signals associated with events, and transmits notifications associated with the detection of the signals associated with the events, and is further configured to The electronic device according to claim 1.

7. The electronic device according to claim 13, wherein the processor is further configured to identify receipt or modification of a digital product related to a user of the electronic device as a result of the detection of the signal associated with the event.

8. When executed by a processor (340) of an electronic device (300), cause the electronic device to Receive video content for display on a display (355) associated with the electronic device, Identify an indicator (606) included in the video content, In response to identifying the indicator, identify additional content (608) to include in the video content displayed on the display, Based on the video content, determine when to include the additional content in the video content, Based on the determination, provide the additional content for display on the display in the video content, A non-transitory computer-readable medium (360) including program code (362) for causing this to be done.

9. When executed, the program code that causes the electronic device to identify the additional content to include with the video content, when executed by the processor of the electronic device, causes the electronic device to Transmit a notification of the identification of the indicator, Receive information associated with the additional content to include in the video content and further includes program code for causing this to be done, The non-transitory computer-readable medium according to claim 8.

10. ​ When executed, the program code that causes the electronic device to identify the additional content to be included with the video content, when executed by the processor of the electronic device, causes the electronic device to cause the electronic device to identify parameters of the indicator included in the video content cause the electronic device to identify the additional content to be included in the video content based on the parameters of the indicator further includes program code for causing the above to be done The non-transitory computer-readable medium according to claim 8. **Claim 11** When executed, the program code that causes the electronic device to determine when to include the additional content with the video content, when executed by the processor of the electronic device, causes the electronic device to identify a time within the displayed video content based on when the indicator is displayed within the video content determine when to include the additional content to be displayed on the display in the video content based on the identified time within the video content further includes program code for causing the above to be done The non-transitory computer-readable medium according to claim 8. **Claim 12** When executed, the program code that causes the electronic device to determine when to include the additional content with the video content, when executed by the processor of the electronic device, causes the electronic device to identify an event occurring within the displayed video content based on when the indicator is displayed within the video content determine when to include the additional content to be displayed on the display in the video content based on the identified event occurring within the video content further includes program code for causing the above to be done The non-transitory computer-readable medium according to claim 8. **Claim 13** When executed by the processor of the electronic device, the electronic device receives a signal associated with an event sends a notification associated with the detection of the signal associated with the event As a result of the detection of the signal associated with the event, identifying receipt or modification of a digital product related to a user of the electronic device further comprising program code for causing this to be done, the non-transitory computer-readable medium according to claim 8.

14. A method for executing a process by an electronic device according to any one of claims 1 to 7.

Images