Methods and systems for management of media content associated with message context on mobile computing devices
Patent Information
- Application Number
- IN202217012829
- Authority / Receiving Office
- IN · IN
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-08-12
- Filing Date
- 2022-03-09
- Publication Date
- 2026-10-23
- Estimated Expiration
- 2040-08-12
AI Technical Summary
Current mobile devices lack personalized and efficient methods for managing contact-related content, such as ring tones and videos, which often go stale without significant user effort, and do not provide rich interactions upon contact events.
A system and method for sender-controlled contact media content that uses a computer-to-computer interface to associate hash tags with messages, employing natural language processing to determine the theme, emotion, and intent of messages, and matching these with candidate hash tags for customized content display on recipient devices during contact events, such as calls or texts.
Enables rich, personalized interactions on mobile devices by allowing users to create and control custom content, like videos and ring tones, which are automatically played or displayed on recipient devices during contact events, enhancing user engagement and interaction.
Abstract
Description
METHODS AND SYSTEMS FOR MANAGEMENT OF MEDIA CONTENT ASSOCIATED WITH MESSAGE CONTEXT ON MOBILE COMPUTING DEVICESRELATED APPLICATIONS
[0001] This application is a bypass continuation-in-part of International ApplicationPCT / US2018 / 064962 filed on December 11, 2018, and published as WO / 2019 / 118469 on June 20, 2019, which claims the benefit of U.S. Provisional Pat. App. No. 62 / 597,309, filed on December 11, 2017.
[0002] This application claims the benefit of U.S. Provisional Pat. App. No.62 / 885,562, filed on August 12, 2019.
[0003] This application is related to U.S. Pat. App. No. 16 / 158,000 filed on October 11, 2018, which is a continuation of U.S. Pat. App. No. 15 / 725,645 filed on October 5, 2017 (now U.S. Pat. No. 10,104,228), which claims the benefit of U.S. Provisional Pat. App. No. 62 / 459,742 filed on February 16, 2017, and U.S. Provisional Pat. App. No.62 / 486,495 filed on April 18, 2017. U.S. Pat. App. No. 15 / 725,645 filed on October 5,2017 is a bypass continuation-in-part of International Application PCT / US2016 / 30083 filed on April 29, 2016, and published as WO2016 / 178984, which claims priority to U.S. Provisional Pat. App. No. 62 / 155,706 filed on May 1, 2015. Each of the above-identified applications is hereby incorporated by reference in its entirety as if fully set forth herein.TECHNICAL FIELD
[0004] This application relates to the field of mobile devices, and more particularly to the management of content, such as ring tones and video, that may be played when one user contacts another via a mobile device.BACKGROUND
[0005] The proliferation of mobile devices has enabled a wide range of highly personalized social interactions, such as sharing of photos, videos, and music, among other types of content. However, the contact function of atypical mobile device is quite generic, typically providing an alphabetized list of names, with phone numbers and other basic contact information. Calls and texts between users typically identify the user, and may even play a selected ring tone that is selected by the recipient of the call or text to play when a particular individual calls or texts, but the event of a call or text is otherwise un customized.
[0006] Users might create content that could be played upon contact events, but in current systems another user would need to undertake significant interactions in order for them to be played, and the content would tend to go stale without significant effort on the part of a receiver of a call or text.
[0007] A need exists for improved methods and systems for managing the contacts modules and functions of mobile devices.SUMMARY
[0008] In embodiments, methods and systems of content matching may include a system that includes a computer to computer interface configured to facilitate communication between a messaging platform that is adapted to associate a hash tag with a message and a content matching platform, the communication between the messaging platform and the content matching platform comprising at least one of messages and hash tags. The system may include a natural language processing facility of the content matching platform producing an output comprising at least one of an understanding, theme, emotion, and intent of a message communicated from the messaging platform. The system may also include a metadata matching facility in communication with the content matching platform, the metadata matching facility configured to identify candidate hash tags by determining similarity of hash tags in a pool of hash tags with an output of the natural language processing, the content matching facility communicating at least one of the candidate hash tags to the messaging platform over the computer to computer interface. The system may further include an electronic user interface that facilitates user selection of one or more of the candidate hash tags that the content matching facility communicates to the messaging platform for associating with the message processed by the natural language processing facility. In the system, the computer to computer interface may include an Application Programming Interface (API). In the system, determining similarity of hash tags with an output of the natural language processing of the message may include determining similarity of metadata associated with the hash tags. In the system, the metadata associated with the hash tags may be generated by processing the hash tags with the natural language processing facility. In the system, the at least one of the candidate hash tags may indicate an emotion of the message. In the system, the at least one of the candidate hash tags may indicate an intent of the message. In the system, the content matching platform may tag the message with the at least one candidate hash tags and communicates the tagged message to the messaging platform. The system may further include the content matching platform communicating the output of natural language processing of the message to the messaging platform.
[0009] In embodiments, methods and systems of content matching may include a system that includes a computer to computer interface configured to facilitate communication between a messaging platform that is adapted to associate a hash tag with a message and a content matching platform, the communication between the messaging platform and the content matching platform comprising at least one of messages and hash tags. The system may further include a natural language processing facility of the content matching platform producing an output comprising at least one of an understanding, theme, emotion, and intent of a message communicated from the messaging platform and of a plurality of hash tags in a pool of hash tags. The system may further include a metadata matching facility configured to determine candidate hash tags by determining similarity of an output of the natural language processing for the plurality of hash tags with an output of the natural language processing for the message communicated from the messaging platform, the content matching facility communicating at least one candidate hash tag based on the determined similarity to the messaging platform over the computer to computer interface. In the system, the output of the natural language processing of the at least one candidate hash tag may be more similar to the output of the natural language processing of the message than the natural language processing of any of the other hash tags in the pool of hash tags. The system may further include an electronic user interface that facilitates user selection of one or more of the candidate hash tags that the content matching facility communicates to the messaging platform for associating with the message processed by the natural language processing facility. In the system, the computer to computer interface may be an Application Programming Interface (API). In the system, determining similarity of hash tags with an output of the natural language processing of the message may include determining similarity of metadata associated with the hash tags. In the system, the metadata associated with the hash tags may be generated by processing the hash tags with the natural language processing facility.
[0010] In embodiments, methods and systems of content matching may include communicating a portion of a message from a messaging platform to a content matchingplatform. The method may also include processing text in the portion of the message with natural language processing, thereby generating an NLP output comprising at least one of a theme, understanding, intent, and emotion of the message. The message may also include determining similarity of the NLP output with a plurality of hash tags. The method may also include communicating at least one candidate hash tag for the message to the messaging platform based on the determined similarity. In the method, determining similarity may include comparing a portion of the NLP output with the hash tags. In the method, determining similarity may include comparing a portion of the NLP output with metadata descriptive of the hash tags. The method may further include facilitating user selection of the at least one candidate hash tag by presenting in an electronic user interface a plurality of hash tags based on the determined similarity. In the method, the communicating a portion of a message and communicating at least one candidate hash tag may utilize an Application Programming Interface between the content matching platform and the messaging platform.
[0011] Provided herein are methods and systems for a sender-controlled contact media content type (referred to herein in some cases as “SCCMC”) that can be sent among mobile devices, including addressing the contacts systems and methods of such devices to provide rich interactions among users upon the occurrence of contact events. Such methods and systems may occur at the level of the contacts functions of a mobile device, such as being initiated directly upon a contact independent of the need for an application on the recipient’s mobile device. In embodiments, the SCCMC can play, for example, on the lock screen of the recipient’s mobile device as an incoming call occurs, or the SCCMC can display on a contact screen when the phone is unlocked and active, including, without limitation, on the home screen of the recipient’s mobile device, on a screen that displays when the recipient is on a phone call and / or when the recipient is using an application on the recipient’s mobile device. The methods and systems described herein may allow a first user (user A) to create custom photos, videos, ring tones and the like that are played, under control of user A, on the mobile device of another user (user B), such as when user A calls or texts user B’s device. For example, user A may create a video, with associated audio content, and deliver that content to user B’s phone, and have the video and audio play on user B’s phone when user A contacts user B, such as by text or call. The content may, in a single broadcast act, comprise both voice layer and data layer content and use, in a coordinated fashion, voice layer and data layer transmission mediums. Such content isreferred to herein as a sender-controlled contact media content item (“SCCMC”) or, in some cases as a “Ving” or a “Vyng.”
[0012] Provided herein are methods and systems for providing a sender-controlled contact media content data structure that is adapted to be created using a mobile device of a sender and sent to at least one mobile device of at least one recipient; and a host computing system including at least one server for managing the sender-controlled contact media content data structure; wherein the sender-controlled contact media data structure is adapted to be displayed via the contacts function of the mobile device of a recipient under control of the sender of the sender-controlled contact media content data structure.
[0013] Methods and systems are provided herein, including methods and systems that include a sender-controlled contact media content data structure that is adapted to be created using a mobile device of a sender and sent to at least one mobile device of at least one recipient; and a host computing system including at least one server for managing the sender-controlled contact media content data structure; wherein the sender-controlled contact media data structure is adapted to be displayed on a screen of a recipient’s mobile device when the recipient’s device is turned on and able to receive at least one of a data signal and a voice signal, wherein the sender-controlled contact media data structure displays content that is under the control of the sender of the sender-controlled contact media content data structure.
[0014] In embodiments, the sender-controlled contact media content data structure uses voice layer and data layer transmission mediums in a single broadcast act by the sender. In embodiments, the screen of the recipient’s mobile device is the screen that displays upon the occurrence of a contact event at the recipient’s mobile device. In embodiments, the screen of the recipient’s mobile device is the lock screen of the recipient’s mobile device. In embodiments, the screen of the recipient’s mobile device is the home screen of the recipient’s mobile device. In embodiments, the screen of the recipient’s mobile device is an active screen of the recipient’s mobile device that displays when the mobile device is unlocked. In embodiments, the screen of the recipient’s mobile device is a screen that displays while the recipient is on a phone call using the recipient’s mobile device.
[0015] The methods and systems disclosed herein may include an installable application running on the host computing system for establishing a data connection between the mobile device of the sender and the at least one mobile device of the at least one recipient. In embodiments, the installable application is configured to allow discovery of peer devices in proximity to allow an exchange of the sender-controlled contact media content data structure between the mobile device of the sender and the at least one mobile device of the at least one recipient. In embodiments, the installable application enables a user interface that allows the creation of the sender-controlled contact media content data structure on the mobile device of the sender.
[0016] In embodiments, the host computing system enables downloading of the sender-controlled contact media content data structure on the at least one mobile device of the at least one recipient.
[0017] In embodiments, the mobile device of the sender and the at least one mobile device of the at least one recipient are communicatively coupled to the server, and wherein the server is a content server. In embodiments, the mobile device of the sender is communicatively coupled to mobile devices of a plurality of recipients, such that each of the recipient devices receives the sender-controlled contact media content data structure. In some cases, this is described as a “bomb,” a “Vyng bomb,” or the like.
[0018] In embodiments, a plurality of sender-controlled contact media data structures is organized into a channel, such that at least one recipient’s mobile device plays a series of the sender-controlled contact media data structures upon a plurality of contact events from at least one sender. In embodiments, the channel is associated with at least one of a topic of interest to a sender, a topic of interest to at least one recipient and a social graph of at least one of a sender and at least one recipient. In embodiments, the sender-controlled contact media data structures are selected by the sender from a curated library of sender-controlled contact media data structures. In embodiments, the library is curated by an algorithm based on a topic of interest indicated by at least one of the sender and the recipient. In embodiments, the library is curated by an editor based on the subject matter of the channel.
[0019] The methods and systems described herein may include methods and systems for taking a sender-controlled contact media content data structure that is created using a mobile device of a sender; providing a host system that enables transmission of the sender-controlled contact media content data structure from the mobile device of the sender to at least one mobile device of at least one recipient; and causing the display of the sender-controlled contact media content data structure on a screen of the at least one mobile device of the at least one recipient when the at least one recipient’s device is turned on and able to receive at least one of a data signal and a voice signal, wherein the sender-controlled contact media data structure displays content that is under the control of the sender of the sender-controlled contact media content data structure. In embodiments, the sender-controlled contact media content data structure uses voice layer and data layer transmission mediums in a single broadcast act by the sender. In embodiments, the screen of the recipient’s mobile device is the screen that displays upon the occurrence of a contact event at the recipient’s mobile device. In embodiments, the screen of the recipient’s mobile device is the lock screen of the recipient’s mobile device. In embodiments, the screen of the recipient’s mobile device is the home screen of the recipient’s mobile device. In embodiments, the screen of the recipient’s mobile device is an active screen of the recipient’s mobile device that displays when the mobile device is unlocked. In embodiments, the screen of the recipient’s mobile device is a screen that displays while the recipient is on a phone call using the recipient’s mobile device. In embodiments, the sender-controlled contact media content data structure comprises one or more of audio, video, contact data, and metadata. In embodiments, sending the sender-controlled contact media content data structure comprises sending a text message, wherein the text message includes an embedded link to facilitate installation of an application by the at least one recipient on the at least one mobile device of the at least one recipient upon tapping of the embedded link by the at least one recipient, wherein the installable application establishes a data connection between the mobile phone of the sender and the mobile phone of the at least one recipient.
[0020] In embodiments, the methods and systems described herein may further include downloading of the sender-controlled contact media content data structure on the at least one mobile device of the at least one recipient using the embedded link, wherein the downloading of the sender-controlled contact media content data structure enables displaying a contact of the sender as being associated with the sender-controlled contact media content data structure on the at least one mobile device of the at least one recipient.
[0021] In embodiments, the methods and systems described herein may further include initiating a contact by the mobile device of the sender with the at least one mobile device of the at least one recipient such that the sender-controlled contact media content data structure is displayed on the at least one mobile device of the at least one recipient when the contact between the mobile device of the sender and the at least one mobile device of the at least one recipient initiates. In embodiments, the contact is initiated between the mobile device of the sender and the at least one mobile device of the at least one recipient when the sender places a phone call. In embodiments, the contact is initiated between the mobile device of the sender and the at least one mobile device of the at least one recipient when the sender sends a text message to the at least one mobile device of the at least one recipient.
[0022] In embodiments, the methods and systems described herein may further include enabling a user interface on the mobile device of the sender to allow the creation of the sender-controlled contact media content data structure through the user interface. In embodiments, the user interface further allows editing of the sender-controlled contact media content data structure from an external source that stores the sender-controlled contact media content data structure. In embodiments, the external source comprises one of a cloud repository and a library of a third-party content provider. In embodiments, the user interface allows for the creating the sender-controlled contact media content data structure associated with an emotional state of the sender. In embodiments, the emotional state is indicated through a data field in metadata associated with the sender-controlled contact media content data structure. In embodiments, the emotional state is indicated by one or more of a facial expression, an image, a sound, and an emoticon.
[0023] In embodiments, the methods and systems described herein may further include setting a privacy control through the installable application to limit publication of the sender-controlled contact media content data structure to a select audience.
[0024] The methods and systems disclosed herein may include methods and systems for segregating the created sender-controlled contact media content data structure into one or more of audio, video, and metadata components; associating each of the components of the created sender-controlled contact media content data structure with a particular tone; and storing the tone for each of the components locally on the mobile device of the sender. In embodiments, the methods and systems described herein may further include uploading the tone for each of the components on an application server or a content server. In embodiments, the methods and systems described herein may further include allowing previewing the sender-controlled contact media content data structure; and adding custom details to the sender-controlled contact media content data structure, either before or after sending the sender-controlled contact media content data structure to the at least one recipient. In embodiments, causing the display of the sender-controlled contact mediacontent data structure on the screen of the at least one mobile device is triggered by detection of the passing of the recipient’s mobile device into an area defined by a geofence.
[0025] The methods and systems disclosed herein may include establishing a personal channel having at least one media item by accessing an installable application from the mobile device and selecting at least one pre-configured menu item that permits access to the at least one media item as part of the personal channel. The personal channel may include the at least one media item selected from at least one media content source. The at least one media content source may include at least one of sender-controlled contact media content received from other devices, content available locally on the mobile device, content created or captured by the mobile device, content obtained from social network servers, and combinations thereof. The methods and systems disclosed herein may further include sharing the personal channel of the sender with at least one recipient of the sender-controlled contact media content data structure.
[0026] The methods and systems may further include initiating a contact with the mobile device of the at least one recipient for notifying the mobile device of the at least one recipient to provide a media content for use as the sender-controlled contact media content data structure associated with the at least one recipient. In some examples, the at least one recipient may be selected from a contact list or phonebook available on the sender’s mobile device. The methods and systems may enable providing a link to a website to the at least one recipient for uploading some media content that may be used as the sender-controlled contact media content data structure associated with the at least one recipient.
[0027] Methods and systems are provided herein for establishing a personal channel of media content items to be displayed on the lock-screen of a user’s mobile device in response to a triggering contact event. These may include providing a host system that enables handling of contact media content data structures for controlled display of the contact media content data structures on the lock-screen of at least one mobile device; causing a display of the contact media content data structure on a screen of the at least one mobile device of the at least one recipient when the at least one recipient’s device is turned on and able to receive at least one of a data signal and a voice signal, where the contact media data structure displays media content on the lock-screen of the at least one mobile device upon receipt of a triggering contact event to the at least one mobile device; and enabling a user to establish a personal channel of contact media content having at least one media item by accessing an installable application on the at least one mobile device and selecting at least one pre-configured menu item that designates the at least one media item as part of the personal channel. In embodiments, the personal channel includes the at least one media item selected from at least one media content source, where the at least one media content source includes at least one of a sender-controlled contact media content received from another device, content available locally on the at least one mobile device, content created using the mobile device, and content obtained from a server. The methods and systems may further include enabling the user to share the personal channel with at least one other user of a mobile application that is configured to interact with the host system. The methods and systems may further include initiating a contact with the mobile device of the at least one other user of a mobile device that is configured to interact with the host system to request that the other user designate a contact media content item to be displayed when the other user initiates a triggering contact to the user of the at least one mobile device. In embodiments, the at least one other user is selected from a contact list available on the mobile device of the sender. In embodiments, notifying the mobile device of the at least one other user includes sending a link for a website where the other user is invited to upload the media content to be displayed when the other user initiates a triggering contact to the user of the at least one mobile device.
[0028] In embodiments, methods and systems described herein may include a systems that may include a lock-screen capable application executing on a recipient computing device, the lock-screen capable device facilitating user interface access to a communication function of the recipient computing device while the computing device remains in a locked state, wherein the lock-screen capable application intercepts a communication received by the recipient device, the communication associated with at least one communication application or service operable on the recipient computing device. The system may further include a content association application executing on the recipient computing device, wherein the content association application facilitates associating a content item with the communication, based on a relevance of the content item with the communication, the relevance determined from processing the intercepted communication to identify an association based on metadata descriptive of content items stored in a library of content items. The system may further include automatically associating a content item in response to detecting an indication of an intercepted communication. Automatically associating may include associating at least one of a GIF and a video with the communication. Automatically associating may further include determining an emotional state of the communication and associating content in response to the determined emotional state. Automatically associating may further include determining a context of the communication and associating content in response to the determined context.
[0029] Methods and systems described herein may include a system that may include a sender computing device configured with a sender-controlled contact media content-based application (SCCMC application), the SCCMC application executing on the sender device and interfacing with a sender state detection application executing on the sender device, wherein the sender state detection application detects at least one of a mood of the sender, a physical status of the sender, an emotional state of the sender and a mental state of the sender, and wherein the SCCMC application uses the detected state of the sender to determine an SCCMC structure that corresponds to the detected state and associates information that identifies the determined SCCMC structure with an outgoing message for a recipient. In the system, the outgoing message is associated with a phone call from the sender to a recipient. In the system, the SCCMC application further determines a content channel associated with at least one of the sender and the recipient and bases the determined SCCMC structure on the determined content channel.
[0030] Methods and systems described herein may include a method that may include adapting a sender-controlled contact media content structure in response to receiving an indication of a current state of a sender of the sender-controlled contact media content structure, wherein the state is one of a mood, a physical status, an emotional status, and a mental status. In the method, the state is determined in response to facial recognition of the sender contemporaneously with the sender sending a message from a sender’s computing device to a recipient’s computing device. In the method, adapting occurs while a recipient computing device is processing a contact event resulting from receipt of a message from a sender’s computing device.
[0031] Methods and systems described herein may include a method that may include operating a sender-controlled contact media content structure creation platform on a computing device that, in response to intercepting a message being communicated between messaging applications resident on a sender’s mobile device and a recipient’s mobile device, offers customized services of the platform to a user of the mobile device on which the message is intercepted. In the method, the message is intercepted on a sender mobile device prior to the message being sent to the recipient. In the system, the message is intercepted on a recipient mobile device prior to the messaging application resident on the recipient’s mobile device receiving the message. In the system, intercepting includes developing an understanding of the message with natural language processing, the understanding further used to facilitate making suggestions for video / image / audio of an SCCMC to be associated with the message.
[0032] Methods and systems described herein may include a method that may include operating a sender-controlled contact media content (SCCMC) structure contact event handling platform. The platform may perform the steps including intercepting a message associated with other messaging applications resident on the mobile device, wherein the message is targeted to a first messaging application of the other messaging applications; processing the message with natural language processing to determine at least one SCCMC structure; forwarding the determined at least one SCCMC structure to an SCCMC unified messaging user interface; processing the SCCMC structure with the unified messaging interface; presenting at least one of text and imagery determined from the processing of the SCCMC structure in the unified messaging interface; and delivering a message that is compatible with the other messaging applications to the first messaging application. In the method, the message is intercepted on a recipient mobile device. In the method, the platform operation may be performed while the recipient’s mobile device is locked. In the method, the message is intercepted on a sender’s mobile device.
[0033] Methods and systems described herein may include a method that may include integrating at least one of audio, video, imagery, and text indicated by a sender-controlled contact media content (SCCMC) structure into an augmented reality environment in response to detecting a mobile-to-mobile device contact event, the integrating indicating the contact event.
[0034] Methods and systems described herein include a lock-screen capable application executing on a recipient computing device. The lock-screen capable application is configured to facilitate user interface access to a communication function of the recipient computing device while the recipient computing device remains in a locked state. The lock-screen capable application is configured to intercept a communication received by the recipient computing device. The intercepted communication is associated with at least one of a communication application or a communication service operable on the recipient computing device. The methods and systems further include a contentassociation application executing on the recipient computing device. The content association application is configured to facilitate associating a media content item with the intercepted communication based on a relevance of the media content item with the intercepted communication. The relevance is determined by automatically processing the intercepted communication to identify an association based on metadata descriptive of media content items stored in a library of the media content items.
[0035] In embodiments, the associating of the media content item is performed automatically by the content association application in response to detecting an indication of the intercepted communication.
[0036] In embodiments, the content association application is configured to associate at least one of a GIF and a video with the intercepted communication.
[0037] In embodiments, the processing automatically of the intercepted communication to identify the association includes automatically determining an emotional state of the intercepted communication and automatically associating at least one of the media content items in response to the automatically determined emotional state.
[0038] In embodiments, the processing automatically of the intercepted communication to identify the association includes determining a context of the intercepted communication and associating at least one of the media content items in response to the determined context.
[0039] Methods and systems described herein include a sender computing device configured with a sender-controlled contact media content-based application (SCCMC application). The SCCMC application is configured to execute on the sender device and interface with a sender state detection application that executes on the sender device. The sender state detection application is configured to detect a detected state that includes at least one of a mood of the sender, a physical status of the sender, an emotional state of the sender and a mental state of the sender. The SCCMC application uses the detected state of the sender to determine an SCCMC structure that corresponds to the detected state and associates information that identifies the determined SCCMC structure with an outgoing message for a recipient.
[0040] In embodiments, the outgoing message is associated with a phone call from the sender to a recipient.
[0041] In embodiments, the SCCMC application is configured to determine a content channel associated with at least one of the sender and the recipient and to base the determined SCCMC structure on the determined content channel.
[0042] Methods and systems described herein include adapting a sender-controlled contact media content structure in response to receiving an indication of a current state of a sender of the sender-controlled contact media content structure. The current state of the sender is one of a mood, a physical status, an emotional status, and a mental status.
[0043] In embodiments, the current state of the sender is determined in response to facial recognition of the sender contemporaneously with the sender sending a message from a sender’s computing device to a recipient’s computing device.
[0044] In embodiments, the adapting of the sender controlled contact media content occurs while a recipient’s computing device is processing a contact event resulting from receipt of a message from a sender’s computing device.
[0045] Methods and systems described herein include operating a sender-controlled contact media content structure creation platform on a computing device that, in response to intercepting a message being communicated between messaging applications resident on a sender’s mobile device and a recipient’s mobile device, offers customized services of the platform to a user of the mobile device on which the message is intercepted.
[0046] In embodiments, the message is intercepted on a sender mobile device prior to the message being sent to the recipient.
[0047] In embodiments, the message is intercepted on a recipient mobile device prior to the messaging application resident on the recipient’s mobile device receiving the message.
[0048] In embodiments, the intercepting includes developing an understanding of the message with natural language processing, and wherein the understanding is further used to facilitate making suggestions for video / image / audio of a sender-controlled contact media content to be associated with the message.
[0049] Methods and systems described herein include operating a sender-controlled contact media content (SCCMC) structure contact event handling platform including intercepting a message associated with other messaging applications resident on the mobile device, wherein the message is targeted to a first messaging application of the other messaging applications. The methods and system also include processing the message with natural language processing to determine at least one SCCMC structure and forwardingthe determined at least one SCCMC structure to an SCCMC unified messaging user interface. The methods and systems further include processing the SCCMC structure with the unified messaging interface, presenting at least one of text and imagery determined from the processing of the SCCMC structure in the unified messaging interface, and delivering the message that is compatible with the other messaging applications to the first messaging application.
[0050] In embodiments, the message is intercepted on a recipient’s computing device.
[0051] In embodiments, the message is intercepted on a recipient computing device while the recipient’s computing device is locked.
[0052] In embodiments, the message is intercepted on a sender’s computing device.
[0053] Methods and systems described herein include integrating at least one of audio, video, imagery, and text indicated by a sender-controlled contact media content (SCCMC) structure into an augmented reality environment in response to detecting a mobile-to-mobile device contact event. The integrating of the at least one of audio, video, imagery, and text is an indicator of the contact event.
[0054] In embodiments, the methods and systems include adapting the sender-controlled contact media content structure in response to receiving an indication of a current state of a sender of the sender-controlled contact media content structure. The current state of the sender is one of a mood, a physical status, an emotional status, and a mental status.
[0055] In embodiments, the current state of the sender is determined in response to facial recognition of the sender contemporaneously with the sender sending a message from a sender’s computing device to a recipient’s computing device.
[0056] In embodiments, integrating includes developing an understanding of the message from the sender with natural language processing, and wherein the understanding is further used to facilitate making suggestions for video / image / audio of a sender-controlled contact media content to be associated with the message.
[0057] In embodiments, a smart phone dialer app may be adapted to work collaboratively with a business app and an SCM app / platform / service to enable a method of operating a smart phone dialer app executing on a processor of a smart phone. The method may include exchanging call information descriptive of a type of call capable of being made through the dialer with a business application via a business application computer interface. The method may further include sharing a portion of the callinformation with a sender controlled media (SCM) platform through a SCM platform computer interface. The method may further include receiving, responsively to the sharing, information descriptive of an SCM data structure that may be available to the platform and that may be associated with the call. The method may further include configuring a visual portion of the SCM data structure to be rendered in a user interface of the dialer app in connection with a call of the described type. In embodiments, the visual portion may be configured to be rendered contemporaneously with making the call through the dialer. In embodiments, the visual portion may be configured to be rendered after the dialer receives an indication of the call being answered. In embodiments, the visual portion may be configured to be rendered during dialing. In embodiments, the visual portion includes an offer that encourages a recipient to answer the call. In embodiments, the visual portion may be configured to be rendered after completion of the call. In embodiments, the visual portion includes an interactive element through which a recipient of the call can provide feedback on the call. In embodiments, rendering the visual portion occurs responsive to receiving an indication from the SCM platform of an action occurring responsive to the call being made, wherein the action occurring may be associated with a second smart phone to which the call was made. In embodiments, at least a portion of the visual portion of the SCM data structure may be streamed to the dialer app over a cellular network. In embodiments, sharing a portion of the call information descriptive of the call includes sharing a purpose of the call. In embodiments, sharing the purpose of the call includes transmitting a code that corresponds to an SCM content channel, the channel being selectable from a set of business-specific SCM content channels comprising a plurality of SCM data structures that are related to the purpose of the call. In embodiments, wherein sharing a portion of the call information descriptive of the call includes sharing an identifier of a target recipient of the call. In embodiments, sharing the identifier of the target recipient of the call includes transmitting a phone number of a target recipient smart phone through the SCM platform computer interface. In embodiments, the dialer may make the call to a target recipient identified in the information descriptive of the call. In embodiments, exchanging the call information descriptive of the call may occur before the dialer making the call. In embodiments, sharing the portion of the call information descriptive of the call occurs before the dialer making the call. In embodiments, the dialer makes the call responsive to the exchange of information descriptive of the call via the business application computer interface. In embodiments, the smart phone dialer app may be a native dialer app of the smart phone and the business application computer interface comprises an application programming interface of the smart phone adapted by a set of visual caller id business development tools to enable the native dialer app to interact with the business application.
[0058] In embodiments, a smart phone dialer app may be adapted to work collaboratively with a business app and an SCM app / platform / service smart phone dialer app that may be executable on a processor of a smart phone. The dialer app may include a business application computer interface through which the dialer app exchanges, with the business application, call information descriptive of a type call capable of being made through the dialer app. The dialer app may also include a sender-controlled media (SCM) platform computer interface through which the dialer app shares a portion of the call information and receives, responsively thereto, information descriptive of SCM content available to the platform that may be associated with the call. The dialer app may further include a computer user interface through which a visual portion of the SCM content may be rendered by a processor in connection with a call of the described type. In embodiments, the information descriptive of the call includes an identifier of a target recipient of the call. In embodiments, the identifier of the target recipient may be a phone number of the call being made through the dialer. In embodiments, the information descriptive of the call includes a business purpose for the call. In embodiments, the portion of information shared through the SCM platform computer interface includes a code that indicates a channel of SCM content, the channel being selectable from a set of business-specific SCM content channels. In embodiments, the portion of information shared through the SCM platform computer interface includes a code that indicates a SCM data structure required to be available on a call receiving device of a recipient of the call prior to the call being connected to the call receiving device. In embodiments, the call information descriptive of the call may be exchanged prior to the dialer initiating the call. In embodiments, the dialer initiates the call responsive to receiving the call information from the business application. In embodiments, the dialer app may be a native dialer app of the smart phone and the business application interface comprises an application programming interface of the smart phone adapted by a set of visual caller id business development tools to enable the native dialer app to interact with the business application. In embodiments, the visual portion may be rendered after the dialer receives an indication of the call being answered. In embodiments, the visual portion may be rendered during dialing. In embodiments, thevisual portion may be configured to be rendered after completion of the call. In embodiments, the visual portion includes an interactive element through which a caller can provide feedback on the call.
[0059] In embodiments, a smart phone dialer app may be adapted to work collaboratively with a business app and an SCM app / platform / service to enable a method of adapting a native smart phone dialer app comprising. The method may include configuring an application programming computer interface of a business application to be responsive to communication from an application programming computer interface of a smart phone dialer app and to initiate communication with the smart phone dialer app based on an activity of a workflow of the business application. The method may further include configuring an application programming computer interface of the smart phone dialer app to communicate call descriptive information with a sender-controlled media (SCM) platform application programming computer interface, the call descriptive information having been received via the configured application programming computer interface of the business application, the smart phone application programming computer interface further configured to receive information descriptive of at least one SCM data structure available to the SCM platform based on the call descriptive information communicated to the SCM platform application programming interface.
[0060] In embodiments, workflow-specific SCM content presented on a recipient (customer) screen may be determined by a method that includes identifying call information available from a business application executing on a processor performing a call-action step of a business workflow. The method may further include providing that a smart phone portion of a sender-controlled media (SCM) data structure identifiable by at least a portion of the call information may be available to a dialer app executing on a smart phone of a customer identifiable in the call information by communicating at least one of an identifier of the SCM data structure and the smart phone portion thereof to the dialer app of the customer smart phone over a computer network. The method may yet further include updating the business application with indications of customer interactions with a user interface of the dialer app responsive to a call placed to the customer smart phone during the call-action step of the business workflow. In embodiments, the call information includes customer and call purpose. In embodiments, the identifier of the SCM data structure includes a link to content of an advertising network, wherein the link may be based on the call information. In embodiments, the method may further include using the call information available from the business application and context of the call placed to the customer to determine and incorporate at least one of a link to content of an advertising network and content of the advertising network into the information communicated to the dialer app of the customer. In embodiments, the smart phone portion may be configured to be rendered after the dialer receives an indication of the call being answered. In embodiments, the smart phone portion may be configured to be rendered during dialing. In embodiments, the smart phone portion includes an offer that encourages a recipient to answer the call. In embodiments, the smart phone portion may be configured to be rendered after completion of the call. In embodiments, the smart phone portion includes an interactive element through which a recipient of the call can provide feedback on the call.
[0061] In embodiments, workflow-specific SCM content presented on a recipient (customer) screen may be determined by a system that includes a business application executing on a processor performing a call-action step of a business workflow. The system may further include a source-controlled media (SCM) platform executing on a processor managing content rendering on a smart phone of a customer associated with the workflow. The system may further include a service constructed to identify customer and call purpose of the call-action from the business application, communicate the identified call action information to the SCM platform, and update the business application of customer actions that are responsive to the SCM platform managing the content rendering. The SCM platform may further be constructed to provide that a smart phone portion of an SCM data structure identifiable by a portion of the identified call action information may be available to a dialer app executing on the smart phone of the customer. In embodiments, the dialer app executing on the smart phone may be capable of rendering visual content referenced in the smart phone portion of the SCM data structure. In embodiments, the dialer app renders the visual content on a lockscreen of the customer smart phone. In embodiments, the smart phone portion may be configured to be rendered during dialing. In embodiments, the smart phone portion includes an offer that encourages a recipient to answer the call. In embodiments, the smart phone portion may be configured to be rendered after completion of the call. In embodiments, the smart phone portion includes an interactive element through which a recipient of the call can provide feedback on the call. In embodiments, to provide that the smart phone portion of the SCM data structure may be available to the customer smart phone dialer app, the SCM platform may be constructed with a computer-to-computer interface through which at least one of an identifier of the SCM data structure and the smart phone portion thereof may be communicated to the dialer app of the customer smart phone over a computer network. In embodiments, the dialer app executing on the smart phone of the customer may be constructed to communicate with the SCM platform via an application programming computer interface that may be customized with business-specific communication and rendering features. In embodiments, the system may further include a dialer app on a caller smart phone that may be constructed to initiate a call to the customer smart phone responsive to the identified customer information of the call-action. In embodiments, the dialer app on the caller smart phone may be further constructed to render call purpose related information on a user interface of the caller smart phone contemporaneously with initiating the call. In embodiments, the dialer app on the caller smart phone may be further constructed to render call purpose related information on a user interface of the caller smart phone responsive to receiving an indication of the call being answered. In embodiments, the dialer app on the caller smart phone may be further constructed to render information related to the business workflow on a user interface of the caller smart phone responsive to receiving an indication of a customer action determined by the customer smart phone dialer app. In embodiments, caller smart phone dialer app may be a native dialer app of the smart phone that may be constructed with an application programming interface that may be adapted by a set of visual caller id business development tools to enable the native dialer app to interact with the business application.
[0062] In embodiments, configuring a set of services to enable a business application to control content presented on a dialer screen of a customer placing a call to a business may be enabled by a system that includes a business application constructed to activate an ordered set of business workflow tasks responsive to receiving call related information of an incoming call to a business. The system may further include a set of visual content services providing that business-relevant visual content may be available to a dialer application of a device making the call. The system may further include a call handling set of services operating on a networked server. The services may have one or more functions including: a call intercepting function for intercepting the incoming call, a computer interface to the business application through which call related information may be provided to the business application contemporaneously with intercepting the call, a computer interface to the set of visual content services through which at least one of caller identification information and call context may be provided, a call evaluation circuit that determines a relationship of the caller with the business and updates the call related information based thereon, and a call connecting circuit that connects the intercepted incoming call to a business user based on aspects of the activated ordered set of business workflow tasks. The business application may be further constructed to present visual content on a dialer app screen of the connected business user, the visual content facilitating at least one of the ordered set of workflow tasks. In embodiments, the call handling set of services further indicates a candidate call type to the business application and the set of visual content services based on the determined caller relationship. In embodiments, the set of visual content services identifies a business-specific channel of content based on the candidate call type to be made available to the dialer application making the call. In embodiments, the business application validates the candidate call type based on context of the call that is available from the call handling set of services. In embodiments, the identifier of the data structure includes a link to content of an advertising network, wherein the link is based on the call information. In embodiments, the call handling set of services comprises using the call related information and the call context to determine and incorporate at least one of a link to content of an advertising network and content of the advertising network into the information communicated to the dialer application of the customer. In embodiments, the dialer application of a device making the call may be a native dialer app that may be constructed with an application programming interface that may be adapted by a set of visual caller id business development tools to enable the native dialer app to interact with the set of visual content services. In embodiments, the call evaluation circuit further determines call purpose based on the call context and updates the call related information based thereon.
[0063] In embodiments, configuring a set of services to enable a business application to control content presented on a dialer screen of a customer placing a call to a business may enable a method including intercepting an incoming call to a business. The method may further include determining a relationship of the caller with the business. The method may further include updating a set of call related information based thereon. The method may further include transmitting the set of call related information about the incoming call contemporaneously with intercepting the call to a business application constructed to activate an ordered set of business workflow tasks responsive to receiving the call related information. The method may yet further include transmitting a portion of the set of call related information to a set of visual content services that are constructed to provide that caller-specific visual content may be available to a dialer application of a device making the call. The method may further include connecting the intercepted incoming call to a business user based on aspects of the activated ordered set of business workflow tasks. The caller-specific visual content may be constructed for rendering in a user interface screen of the dialer application on the device making the call. In embodiments, the method may further include transmitting a candidate call type to the business application and to the set of visual content services based on the determined caller relationship. In embodiments, the method may further include identifying a business-specific channel of content, based on the candidate call type, to be made available to the dialer application making the call. In embodiments, the visual content services identify a business-specific channel of content, based on the candidate call type, to be made available to the dialer application making the call. In embodiments, the business application validates the candidate call type based on context of the call that is available from the call handling set of services. In embodiments, ensuring that caller-specific visual content is available to a dialer application of a device making the call includes streaming to the dialer application over a cellular network.
[0064] In embodiments, configuring a set of services to enable a business application to control content presented on a dialer screen of a customer placing a call to a business may enable a method of configuring a set of services to enable a business application to control content presented on a dialer screen of a customer calling a business. The method may include constructing a business application to activate an ordered set of business workflow tasks responsive to receiving call related information of an incoming call. The method may include constructing a set of visual content services that provide that caller-specific visual content may be available to a dialer application of a device making the call. The method may include constructing a call intercepting function for intercepting the incoming call. The method may include constructing a computer interface to the business application through which call related information may be provided to the business application contemporaneously with intercepting the call. The method may include constructing a computer interface to the set of visual content services through which at least one of caller identification information and call context may be provided. The method may include constructing a caller identification circuit that determines a relationship of the caller with the business and updates the call related information based thereon. The method may include constructing a call connecting circuit that connects the intercepted incoming call to a business user based on aspects of the activated ordered set of business workflow tasks. The caller-specific visual content may be constructed for rendering in a user interface screen of the dialer application on the device making the call.
[0065] In embodiments, configuring a set of services to enable business application control of and receipt of feedback from at least attempting to present call-specific SCM content to a customer as part of an interaction, e.g., via a phone call with the customer may enable a method. The method may include configuring a business application that performs a customer interaction workflow to make available, through an application programming interface, interaction information descriptive of a customer and a purpose of an interaction associated with an instance of execution of the workflow. The method may further include configuring a set of interaction setup services that accesses the available interaction information through the application programming interface and presents it to a smart phone dialer content rendering management platform that provides that content for rendering that may be identifiable by the interaction information may be available to a smart phone dialer app executing on a smart phone of the customer. The method may yet further include configuring a set of interaction response services that update the business application with information from the content rendering management platform that may be descriptive of customer actions that are responsive to the rendering. In embodiments, the set of interaction response services communicate with the business application through the application programming interface. In embodiments, the content rendering management platform provides that content for rendering may be available to the dialer application by communicating at least one of an identifier of a data structure comprising the content for rendering and the caller-specific visual content portion thereof to the dialer application over a computer network. In embodiments, the set of interaction setup services may be further configured to determine and incorporate at least one of a link to content of an advertising network and content of the advertising network into the information communicated to the dialer application of the customer. In embodiments, the business application is configured to make available a phone number of the customer. In embodiments, the identifier of the data structure includes a link to content of an advertising network, wherein the link is based on the call information. In embodiments, the business application may be configured with a set of visual caller id business development tools. The set of visual caller id business development tools may include a set of softwaredevelopment kits (SDKs), a set of application programming interfaces (APIs), and a set of services for data processing and handling. In embodiments, the set of services comprises a set of microservices.
[0066] In embodiments, a system may include a dialer app may execute on a processor of a smart phone through which a user is enabled to sequentially selects numbers from a dial pad interface of the dialer app. The system may include a phrase forming circuit that forms phrases from alphabetic characters associated with the selected numbers, wherein the phrases are formed to match the sequence of dialer pad selections. The system may include a candidate entity search engine that performs search activity responsive to the forming phrases and returns a ranked set of search results to the dialer app. The dialer app may present at least one result of the set of search results in a contact portion of the dial pad interface and responsive to a user selection thereof, dials the selected contact. The phrase forming circuit may form phrases based on a plurality of sets of contact resources that include a set of user contacts. The set of contact resources further may include a set of candidate contacts determined from user contact activity conducted through the smart phone. The set of contact resources further may include results of search engine activity based on Internet searches of at least one of the set of candidate phrases. The set of contact resources further may include results of a smart phone app query comprising at least one of the phrases. The smart phone app manages curated lists of business contacts based on business type and location. The set of contact resources further may include a set of Sender Controlled Media (SCM) platform participants. The set of contact resources further may include a set of sponsored contacts. The set of sponsored contacts may be sponsored via the SCM platform. The dialer app may be adapted to communicate with a Sender Controlled Media (SCM) platform contemporaneously with dialing the selected contact.
[0067] In embodiments, a method may include receiving with a server dial pad selections in a selection order from a dialer app on a smart phone. The method may further include forming with a processor of the server the ordered dial pad selections into partial phrases based on alphabetic characters associated with the dial pad selections through the dialer app as the dial pad selections are received. The method may further include determining with the server a set of candidate phrases from the partial phrases based on sets of contact resources available to the smart phone. The method may further include refining with the server the set of candidate phrases based on user context. The method may further include causing a call to be placed via the dialer app on the smart phoneresponsive to receiving a user selection of one of the candidate phrases. In embodiments, the sets of contact resources may include a set of user contacts. The sets of contact resources may include a set of candidate contacts determined from user contact activity through the smart phone. The sets of contact resources may include results of search engine activity based on Internet searches of at least one of the set of candidate phrases. The sets of contact resources may include results of a smart phone app query comprising at least one of the set of candidate phrases. The smart phone app manages curated lists business contacts based on business type and location. The sets of contact resources may include a set of Sender Controlled Media (SCM) platform participants. The sets of contact resources may include a set of sponsored contacts. The set of sponsored contacts may be sponsored via the SCM platform.
[0068] In embodiments, a method may include forming with a processor an ordered stream of numeric values representing dial pad element selections into partial phrases based on alphabetic characters associated with each dial pad element. The method may include determining with the processor a set of candidate contact entities based on results of search engine activity responsive to at least one of the partial phrases. The method may include refining with the processor the set of candidate contact entities based on user context. The method may include causing a call to be placed by a source of the ordered stream responsive to receiving a user selection from the refined set of candidate contact entities, wherein the call is caused to be placed to the user-selected contact entity.
[0069] In embodiments, a method may include presenting a set of user selectable elements arranged as a dial pad in an electronic interface of a computing device capable of placing a phone call, wherein at least one of the selectable elements is associated with a single digit number and a plurality of alphabetic characters. The method may include with a processor of the computing device sequential selection of the dial pad elements. The method may include forming with the processor the detected sequence into alphabetic phrases based on the alphabetic characters associated with selected dial pad elements. The method may include forwarding the alphabetic phrases while they are being formed to a candidate contact entity recommendation facility. The method may include, responsive to receiving a response to the forwarding, presenting in the electronic interface at least one candidate contact entity in a contact portion of the dial pad. The candidate contact recommendation facility may determine a set of candidate contact entities based on results of search engine activity responsive to at least one of the alphabetic phrases. Forwarding the alphabetic phrases may include forwarding a context of a user associated with a device on which the sequence of dial pad elements is detected. The method further may include causing the set of candidate contact entities to be refined based on the context.
[0070] In embodiments, a method may include detecting a request to connect a phone call to a user. The method may include facilitating presentation of an incentive offer in an incoming call display on a lockscreen of a smart phone of the user, wherein the incentive offer requires that the user accept the incoming call as a condition for activation. The method may include responsive to a user interaction with the incoming call display on the lockscreen, performing at least one of connecting the phone call to the user’s smart phone plus storing an indication that the user has accepted the incentive offer, and declining the request to connect the phone call to the user.
[0071] In embodiments, facilitating presentation of the incentive offer may include configuring a sender controlled media (SCM) data structure that includes a visual portion with the incentive offer and making the configured SCM data structure available to a dialer app controlling the incoming call display screen. In embodiments, facilitating presentation of the incentive offer may include making an SCM data structure that includes a visual portion with the incentive offer available to a dialer app controlling the incoming call display screen. In embodiments, making the SCM data structure available may include uploading at least the visual portion to the smart phone from a server with which the smart phone is networked, prior to presentation of the incentive offer. Making the SCM data structure available may include uploading at least the visual portion to the smart phone from a server with which the smart phone is networked. Making the SCM data structure available may include uploading a link for the SCM data structure to the smart phone from a server with which the smart phone is networked. Uploading the link may be responsive to detecting the request to connect the phone call.
[0072] In embodiments, a method may include presenting an incentive offer in association with an incoming call in an incoming call display screen on a lockscreen of a user’s smart phone, wherein the incentive offer requires that the user accept the incoming call as a condition for activation. The method may include, responsive to a user interaction with the incoming call display on the lockscreen, performing at least one of connecting the call to the user’s smart phone plus storing an indication that the user has accepted the incentive offer, and declining the request to connect the phone call to the user. Presenting the incentive offer may include configuring a sender controlled media (SCM) datastructure that includes a visual portion with the incentive offer and making the configured SCM data structure available to a dialer app controlling the incoming call display screen. Presenting the incentive offer may include making an SCM data structure that includes a visual portion with the incentive offer available to a dialer app controlling the incoming call display screen. Making the SCM data structure available may include uploading at least the visual portion to the smart phone from a server with which the smart phone is networked, prior to presentation of the incentive offer. Making the SCM data structure available may include uploading at least the visual portion to the smart phone from a server with which the smart phone is networked. Making the SCM data structure available may include uploading a link for the SCM data structure to the smart phone from a server with which the smart phone is networked. In embodiments, computer implemented method executable on a processor, the method may include accessing a library of Sender Controlled Media (SCM) dialer app functions. The method may include selecting in the library at least one SCM dialer app function for inclusion use with a first dialer app. The method may include using a software development kit. Using a software development kit may include configuring the selected at least one SCM dialer app function for operation with the first dialer app. Using a software development kit may include preparing dialer app modification instructions for adapting the first dialer app to perform the configured SCM dialer app function. Using a software development kit may include preparing generating a second dialer app comprising the first dialer app adapted to perform the configured SCM dialer app function. The method may include installing the second dialer app on a smart phone as a primary dialer app for handling incoming and outgoing calls. The library of SCM dialer app functions may include at least one function selected from a list of functions consisting of (i) rendering content other than generic caller ID content in a call answer screen of a dialer app; (ii) access to content other than generic caller ID content for rendering in response to an incoming call; (iii) matching incoming call identification to a content data structure that includes visual content for rendering; (iv) coordinating rendering with call connection; (v) support for user interaction with rendered content; (vi) access to phone audio / video capture capability for capturing content for delivery to a recipient of a call; (vii) storage of captured content; (viii) replacing standard caller ID content for an outgoing call with custom content, wherein the custom content includes a link to content to be rendered; and (ix) secondary channel communication with at least one other SCM function-capable dialer app.
[0073] A system may include a library of Sender Controlled Media (SCM) dialer app functions stored in a non-transient computer storage media and being accessible to a processor. The system may include a software development kit operating on the processor and constructed to enable a user to select in the library at least one SCM dialer app function for inclusion use with a first dialer app. The software development kit may enable a user to configure the selected at least one SCM dialer app function for operation with the first dialer app. The software development kit may enable a user to prepare dialer app modification instructions for adapting the first dialer app to perform the configured SCM dialer app function. The software development kit may enable a user to generate a second dialer app comprising the first dialer app adapted to perform the configured SCM dialer app function. The software development kit may enable a user to install the second dialer app on a smart phone as a primary dialer app for handling incoming and outgoing calls. The library of SCM dialer app functions may include at least one function selected from a list of functions consisting of (i) rendering content other than generic caller ID content in a call answer screen of a dialer app; (ii) access to content other than generic caller ID content for rendering in response to an incoming call; (iii) matching incoming call identification to a content data structure that includes visual content for rendering; (iv) coordinating rendering with call connection; (v) support for user interaction with rendered content; (vi) access to phone audio / video capture capability for capturing content for delivery to a recipient of a call; (vii) storage of captured content; (viii) replacing standard caller ID content for an outgoing call with custom content, wherein the custom content includes a link to content to be rendered; and (ix) secondary channel communication with at least one other SCM function-capable dialer app.
[0074] In embodiments, a method may include receiving with a processor of a smart phone an encoded set of call-specific metadata contemporaneously with an incoming call, wherein the call-specific metadata is descriptive of the incoming call. The method may include decoding with the processor the set of call-specific metadata prior to connecting the incoming call. The method may include causing a call handling function to be performed by activating a link that is present in the call-specific metadata, wherein the call handling function impacts presentation of visual content on an incoming call interface in a lockscreen of a smart phone to which the incoming call is directed. The call handling function may include a dialer app of the smart phone. Th call handling function may include an app on the smart phone other than a dialer app. The call handling function may include a server-based function. The call handling function validates the call-specific metadata by verifying that caller ID information in the metadata matches call-source information in the metadata. In embodiments, the call-source information is immutable. In embodiments, the call handling function references community intelligence of a Sender Controlled Media (SCM) platform that facilitates determining an integrity of a caller associated with the incoming call. In embodiments, the call handling function is a visual content management service of a Sender Controlled Media (SCM) platform that facilitates access to the visual content to be presented on the incoming call interface of the smart phone. In embodiments, activating the link present in the call-specific metadata includes first populating at least one variable field in the link with data representative of a context of the call. In embodiments, the at least one variable field is populated with a name of a user of the smart phone. In embodiments, the link that is present in the call-specific metadata may include an indication that a source device for the incoming call is configured with a Sender Controlled Media (SCM) compatible dialer app.
[0075] In embodiments, a system may include a call interceptor that receives incoming calls and associated encoded call-specific metadata that are destined for a smart phone. The system may include a call-specific metadata handler that decodes, validates, and makes accessible to the call interceptor the call-specific metadata. The system may include a call handling function executing on a server, the call handling function executing in response to the call interceptor activating a link that is present in the call-specific metadata, wherein the call handling function causes an internet protocol-based communication app on the smart phone to be activated and connected with a companion internet protocol-based communication app on a computing device from which the incoming call originated. The call handling function may include a dialer app of the smart phone. The call handling function may include an app on the smart phone other than a dialer app. The call handling function may include a server-based function. The call handling function validates the call-specific metadata by verifying that caller ID information in the metadata matches call-source information in the metadata. In embodiments, the call-source information is immutable. The call handling function references community intelligence of a Sender Controlled Media (SCM) platform that facilitates determining an integrity of a caller associated with the incoming call. The call handling function is a visual content management service of a Sender Controlled Media (SCM) platform that facilitates access to the visual content to be presented on the incoming call interface of the smart phone. In embodiments, activating the link present in the call-specific metadata includes first populating at least one variable field in the link with data representative of a context of the call. In embodiments, the at least one variable field is populated with a name of a user of the smart phone. In embodiments, decoding may include use of a public key of a phone service provider that originated the incoming call. In embodiments, the link that is present in the call-specific metadata may include an indication that a source device for the incoming call is configured with a Sender Controlled Media (SCM) compatible dialer app.
[0076] In embodiments, a method may include receiving an incoming call with a Sender Controlled Media (SCM) configured dialer app. The method may include presenting visual content in an interactive user interface of a smart phone controlled by the dialer app, wherein the user interface is presented in a lockscreen of the dialer app. The method may include responsive to detecting user activity responsive to content presented in the user interface, activating a secondary channel of communication between an originator of the incoming call and a user of the smart phone via the lockscreen-based interactive user interface, wherein the secondary channel facilitates exchange of digital information contemporaneously with the incoming call. The secondary channel may be operative during at least one of a pre-call phase of the incoming call, an in-call phase of the incoming call, and a post-call phase of the incoming call. The secondary channel may be operative independent of maintaining the smart phone in a locked state.
[0077] In embodiments, a method may include receiving an incoming call with a Sender Controlled Media (SCM) configured dialer app. The method may include presenting visual content in an interactive user interface of a smart phone controlled by the dialer app, wherein the user interface is presented in a lockscreen of the dialer app. The method may include responsive to detecting user activity responsive to content presented in the user interface, retrieving information from a network resource based on the user activity and presenting at least a portion of the retrieved information in the lockscreen-based user interface. In embodiments, the user interface is operative during at least one of a pre-call phase of the incoming call, an in-call phase of the incoming call, and a post-call phase of the incoming call. In embodiments, the user interface is operative independent of maintaining the smart phone in a locked state. The method may further include activating, responsive to the detected user activity, a secondary channel of communication between an originator of the incoming call and a user of the smart phone via the lockscreen-based interactive user interface, wherein the secondary channel facilitates exchange of digital information contemporaneously with the incoming call.BRIEF DESCRIPTION OF THE FIGURES
[0078] In the accompanying figures, like reference numerals refer to identical or functionally similar elements throughout the separate views and together with the detailed description below are incorporated in and form part of the specification, serve to further illustrate various embodiments and to explain various principles and advantages all in accordance with the systems and methods disclosed herein.
[0079] FIG. 1 illustrates an architecture for a method and system for an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0080] FIGS. 2A and 2B illustrate a process for creating and sharing an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0081] FIG. 2C illustrates a process for initiating a phone call in accordance with an embodiment of the systems and methods disclosed herein.
[0082] FIGS. 3A-3G illustrate the creation of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0083] FIGS. 4A-4F illustrate examples of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0084] FIGS. 5 A, 5B, and 5C illustrate User A sharing an SCCMC with User B in accordance with an embodiment of the systems and methods disclosed herein.
[0085] FIG. 6 illustrates User A adding custom details to an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0086] FIG. 7 illustrates User B setting an SCCMC received from User A in accordance with an embodiment of the systems and methods disclosed herein.
[0087] FIG. 8 illustrates User B creating an SCCMC and sharing the SCCMC with User A and others in accordance with an embodiment of the systems and methods disclosed herein.
[0088] FIG. 9 illustrates an SCCMC created by User B for his or her significant other in accordance with an embodiment of the systems and methods disclosed herein.
[0089] FIG. 10 illustrates a Home-Feed screenshot of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0090] FIGS. 11A and 11B illustrate Notifications screenshots of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0091] FIG. 12 illustrates a Menu screenshot of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0092] FIG. 13 illustrates a Settings screenshot of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0093] FIGS. 14A-14I illustrate screenshots of a process to enable contact editing between users in accordance with an embodiment of the systems and methods disclosed herein.
[0094] FIGS. 15 A, 15B, and 15C illustrate screenshots of a process to deliver a contact with an SCCMC that automatically, or under user control, updates on the phone contacts of another user in accordance with an embodiment of the systems and methods disclosed herein.
[0095] FIG. 16 illustrates a process for transferring an SCCMC from User A to User B in accordance with an embodiment of the systems and methods disclosed herein.
[0096] FIGS. 17A-17D illustrate user community growth of an SCCMC through a viral sharing effect in accordance with an embodiment of the systems and methods disclosed herein.
[0097] FIGS. 18 A, 18B, and 18C illustrate monetization examples of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0098] FIGS. 19-21 illustrate trigger examples of an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0099] FIG. 22 illustrates a flow in which a second user’s reaction to an SCCMC is recorded and shared with another party.
[0100] FIG. 23 illustrates a flow in which the playing of an SCCMC may be triggered by a triggering event.
[0101] FIG. 24 illustrates a computer system.
[0102] FIG. 25 illustrates a mobile device.
[0103] FIG. 26 illustrates a screenshot of a user interface for setting a personal channel for an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0104] FIGS. 27 and 28 illustrate screenshots of a user interface for enabling a media content based on an identity of a user in accordance with an embodiment of the systems and methods disclosed herein.
[0105] FIG. 29 illustrates a screenshot of a user interface for creating a video for an SCCMC in accordance with an embodiment of the systems and methods disclosed herein.
[0106] FIG. 30 illustrates a flowchart of a method for providing a setup of a contextual video message in accordance with an embodiment of the systems and methods disclosed herein.
[0107] FIGS. 31A-31E illustrate screenshots of a user interface for a messaging interaction in accordance with embodiments of the systems and methods disclosed herein.
[0108] FIG. 32 illustrates a block diagram of a unified messaging platform in accordance with an embodiment of the systems and methods disclosed herein.
[0109] FIG. 33 illustrates an embodiment of a media content library in accordance with an embodiment of the systems and methods disclosed herein.
[0110] FIG. 34 illustrates an embodiment of composite media content library in accordance with an embodiment of the systems and methods disclosed herein.
[0111] FIG. 35 illustrates an embodiment of separate media and SCCMC structure libraries in accordance with an embodiment of the systems and methods disclosed herein.
[0112] FIG. 36 illustrates an embodiment of a sender device configuration in accordance with an embodiment of the systems and methods disclosed herein.
[0113] FIG. 37 illustrates an embodiment of a unified messaging user interface for media content selection in accordance with an embodiment of the systems and methods disclosed herein.
[0114] FIG. 38 illustrates an embodiment of a recipient device configuration in accordance with an embodiment of the systems and methods disclosed herein.
[0115] FIG. 39 illustrates an embodiment of a unified messaging interface for responding to a modified media content message in accordance with an embodiment of the systems and methods disclosed herein.
[0116] FIG. 40 illustrates an embodiment of the system of FIG. 32 further including speech to text for transcribing audio messages for use with NLP.
[0117] FIG. 41 illustrates a flow chart of processing an audio message with an embodiment of the platform of FIG. 40.
[0118] FIG. 42 illustrates a flowchart of communicating between a messaging platform via an API and a content matching platform to recommend hash tags rather than image content.
[0119] FIG. 43 illustrates exemplary screens of generating and playing back visual caller ID.
[0120] FIG. 44 illustrates exemplary screens for leaving a video voice mail.
[0121] FIG. 45 illustrates a flow for handling unknown callers.
[0122] FIG. 46 illustrates post call experience user screens.
[0123] FIG. 47 illustrates an architecture and a flow for a call community firewall.
[0124] FIG. 48 illustrates call participant validation user screens.
[0125] FIG. 49 illustrates user screens for saving and playing back visual / video voice mail.
[0126] FIG. 50 illustrates embodiments of business application development tools for use with the architecture.
[0127] FIG. 51 illustrates exemplary embodiments of caller registration.
[0128] FIG. 52 illustrates exemplary actions responsive to caller registration.
[0129] FIG. 53 illustrates on-device functional flow responsive to caller registration.
[0130] FIG. 54 illustrates an exemplary process associated with an unknown caller or unexpected call.
[0131] FIG. 55 illustrates communicating with a caller via audio messaging.
[0132] FIG. 56 illustrates techniques for determining a perspective of an unknown caller or unexpected call.
[0133] FIG. 57 illustrates an embodiment of an incoming call presented on a screen of a target recipient device.
[0134] FIG. 58 illustrates an embodiment of an SCM platform operating with a business system.
[0135] FIG. 59 illustrates an embodiment of an SCM platform operating through a set of services with a business application.
[0136] FIG. 60 illustrates an embodiment of an SCM platform operating with a call receiving interceptor and with a business application.
[0137] FIG. 61 illustrates an embodiment of an SCM platform operating through a set of interaction setup services and a set of interaction response services with a business application.
[0138] FIG. 62 illustrates multiple customer call data and control flow scenarios for operating a business application with an SCM platform.
[0139] FIG. 63 illustrates searching from a dial pad.
[0140] FIG. 64 illustrates data flow for forming words / names with a dial pad for use in an SCM content data structure.
Claims
CLAIMSWhat is Claimed is:
1. A system comprising:a dialer app executing on a processor of a smart phone through which a user is enabled to sequentially selects numbers from a dial pad interface of the dialer app;a phrase forming circuit that forms phrases from alphabetic characters associated with the selected numbers, wherein the phrases are formed to match the sequence of dialer pad selections;a candidate entity search engine that performs search activity responsive to the forming phrases and returns a ranked set of search results to the dialer app;wherein the dialer app presents at least one result of the set of search results in a contact portion of the dial pad interface and responsive to a user selection thereof, dials the selected contact.
2. The system of claim 1, wherein the phrase forming circuit forms phrases based on a plurality of sets of contact resources that include a set of user contacts.
3. The system of claim 2, wherein the set of contact resources further includes a set of candidate contacts determined from user contact activity conducted through the smart phone.
4. The system of claim 2, wherein the set of contact resources further includes results of search engine activity based on Internet searches of at least one of the set of candidate phrases.
5. The system of claim 2, wherein the set of contact resources further includes results of a smart phone app query comprising at least one of the phrases.
6. The system of claim 5, wherein the smart phone app manages curated lists of business contacts based on business type and location.
7. The system of claim 2, wherein the set of contact resources further includes a set of Sender Controlled Media (SCM) platform participants.
8. The system of claim 2, wherein the set of contact resources further includes a set of sponsored contacts.
9. The system of claim 8, wherein the set of sponsored contacts are sponsored via theSCM platform.
10. The system of claim 1, wherein the dialer app is adapted to communicate with a Sender Controlled Media (SCM) platform contemporaneously with dialing the selected contact.
11. A method comprising:receiving with a server dial pad selections in a selection order from a dialer app on a smart phone;forming with a processor of the server the ordered dial pad selections into partial phrases based on alphabetic characters associated with the dial pad selections through the dialer app as the dial pad selections are received;determining with the server a set of candidate phrases from the partial phrases based on sets of contact resources available to the smart phone;refining with the server the set of candidate phrases based on user context; and causing a call to be placed via the dialer app on the smart phone responsive to receiving a user selection of one of the candidate phrases.
12. The method of claim 11, wherein the sets of contact resources include a set of user contacts.
13. The method of claim 12, wherein the set of contact resources further includes a set of candidate contacts determined from user contact activity through the smart phone.
14. The method of claim 12, wherein the set of contact resources further includes results of search engine activity based on Internet searches of at least one of the set of candidate phrases.
15. The method of claim 12, wherein the set of contact resources further includes results of a smart phone app query comprising at least one of the set of candidate phrases.
16. The method of claim 15, wherein the smart phone app manages curated lists business contacts based on business type and location.
17. The method of claim 12, wherein the set of contact resources further includes a set of Sender Controlled Media (SCM) platform participants.
18. The method of claim 12, wherein the set of contact resources further includes a set of sponsored contacts.
19. The method of claim 18, wherein the set of sponsored contacts are sponsored via the SCM platform.
20. The method of claim 11, wherein determining the set of candidate phrases is further based on results of search engine activity responsive to at least one of the partial phrases.
21. The method of claim 11 , wherein receiving comprises:presenting a set of user selectable elements arranged as a dial pad in an electronic interface of a computing device capable of placing a phone call, wherein at least one of the selectable elements is associated with a single digit number and a plurality of alphabetic characters; anddetecting with a processor of the computing device sequential selection of the dial pad elements.
22. The method of claim 21, further comprising forwarding the partial phrases to a candidate contact recommendation facility that determines a set of candidate contact entities based on results of search engine activity responsive to at least one of the partial phrases.
23. The method of claim 22, wherein forwarding the partial phrases comprises forwarding a context of a user associated with a device on which the sequence of dial pad elements is detected.
24. The method of claim 23, further causing the set of candidate contact entities to be refined based on the context.
25. A method comprising:detecting a request to connect a phone call to a user;facilitating presentation of an incentive offer in an incoming call display on a lockscreen of a smart phone of the user, wherein the incentive offer requires that the user accept the incoming call as a condition for activation; andresponsive to a user interaction with the incoming call display on the lockscreen, performing at least one of connecting the phone call to the user’s smart phone plus storing an indication that the user has accepted the incentive offer, and declining the request to connect the phone call to the user.
26. The method of claim 25, wherein facilitating presentation of the incentive offer comprises configuring a sender controlled media (SCM) data structure that includes a visual portion with the incentive offer and making the configured SCM data structure available to a dialer app controlling the incoming call display screen.
27. The method of claim 25, wherein facilitating presentation of the incentive offer comprises making an SCM data structure that includes a visual portion with the incentive offer available to a dialer app controlling the incoming call display screen.
28. The method of claim 27, wherein making the SCM data structure available comprises uploading at least the visual portion to the smart phone from a server with which the smart phone is networked, prior to presentation of the incentive offer.
29. The method of claim 27, wherein making the SCM data structure available comprises uploading at least the visual portion to the smart phone from a server with which the smart phone is networked.
30. The method of claim 27, wherein making the SCM data structure available comprises uploading a link for the SCM data structure to the smart phone from a server with which the smart phone is networked.
31. The method of claim 30, wherein uploading the link is in response to detecting the request to connect the phone call.
32. The method of claim 25 further comprising presenting the incentive offer in association with the incoming call in the incoming call display.
33. The method of claim 32, wherein presenting the incentive offer comprises configuring a sender controlled media (SCM) data structure that includes a visual portion with the incentive offer and making the configured SCM data structure available to a dialer app controlling the incoming call display screen.
34. The method of claim 32, wherein presenting the incentive offer comprises making an SCM data structure that includes a visual portion with the incentive offer available to a dialer app controlling the incoming call display screen.
35. The method of claim 34, wherein making the SCM data structure available comprises uploading at least the visual portion to the smart phone from a server with which the smart phone is networked, prior to presentation of the incentive offer.
36. The method of claim 34, wherein making the SCM data structure available comprises uploading at least the visual portion to the smart phone from a server with which the smart phone is networked.
37. The method of claim 34, wherein making the SCM data structure available comprises uploading a link for the SCM data structure to the smart phone from a server with which the smart phone is networked.
38. A system comprising:a library of Sender Controlled Media (SCM) dialer app functions stored in a non transient computer storage media and being accessible to a processor;a software development kit operating on the processor and constructed to enable a user to:select in the library at least one SCM dialer app function for inclusion use with a first dialer app;configure the selected at least one SCM dialer app function for operation with the first dialer app;prepare dialer app modification instructions for adapting the first dialer app to perform the configured SCM dialer app function;generate a second dialer app comprising the first dialer app adapted to perform the configured SCM dialer app function; andinstall the second dialer app on a smart phone as a primary dialer app for handling incoming and outgoing calls.
39. The system of claim 38, wherein the library of SCM dialer app functions includes at least one function selected from a list of functions consisting of (i) rendering content other than generic caller ID content in a call answer screen of a dialer app; (ii) access to content other than generic caller ID content for rendering in response to an incoming call; (iii) matching incoming call identification to a content data structure that includes visual content for rendering; (iv) coordinating rendering with call connection; (v) support for user interaction with rendered content; (vi) access to phone audio / video capture capability for capturing content for delivery to a recipient of a call; (vii) storage of captured content; (viii) replacing standard caller ID content for an outgoing call with custom content, wherein the custom content includes a link to content to be rendered; and (ix) secondary channel communication with at least one other SCM function-capable dialer app.
40. The system of claim 38 wherein the software development kit enables a user to access the library of Sender Controlled Media (SCM) dialer app functions.
41. The system of claim 40, wherein the software development kit enables a user to disable the first dialer app.
42. A method comprising:receiving with a processor of a smart phone an encoded set of call-specific metadata contemporaneously with an incoming call, wherein the call-specific metadata is descriptive of the incoming call;decoding with the processor the set of call-specific metadata prior to connecting the incoming call; andcausing a call handling function to be performed by activating a link that is present in the call-specific metadata, wherein the call handling function impacts presentation of visual content on an incoming call interface in a lockscreen of a smart phone to which the incoming call is directed.
43. The method of claim 42, wherein the call handling function comprises a dialer app of the smart phone.
44. The method of claim 42, wherein the call handling function comprises an app on the smart phone other than a dialer app.
45. The method of claim 42, wherein the call handling function comprises a server-based function.
46. The method of claim 42, wherein the call handling function validates the call-specific metadata by verifying that caller ID information in the metadata matches call-source information in the metadata.
47. The method of claim 46, wherein the call-source information is immutable.
48. The method of claim 42, wherein the call handling function references community intelligence of a Sender Controlled Media (SCM) platform that facilitates determining an integrity of a caller associated with the incoming call.
49. The method of claim 42, wherein the call handling function is a visual content management service of a Sender Controlled Media (SCM) platform that facilitates access to the visual content to be presented on the incoming call interface of the smart phone.
50. The method of claim 42, wherein activating the link present in the call-specific metadata includes first populating at least one variable field in the link with data representative of a context of the call.
51. The method of claim 50, wherein the at least one variable field is populated with a name of a user of the smart phone.
52. The method of claim 42, wherein the link that is present in the call-specific metadata comprises an indication that a source device for the incoming call is configured with a Sender Controlled Media (SCM) compatible dialer app.
53. The method of claim 42, wherein:receiving is performed by a call interceptor that receives incoming calls and associated encoded call-specific metadata that are destined for a smart phone;decoding is formed by a call-specific metadata handler that decodes, validates, and makes accessible to the call interceptor the call-specific metadata; andthe call handling function executes on a server in response to the call interceptor activating a link that is present in the call-specific metadata, wherein the call handling function causes an internet protocol-based communication app on the smart phone to be activated and connected with a companion internet protocol-based communication app on a computing device from which the incoming call originated.
54. The method of claim 53, wherein the call handling function comprises a dialer app of the smart phone.
55. The method of claim 53, wherein the call handling function comprises an app on the smart phone other than a dialer app.
56. The method of claim 53, wherein the call handling function comprises a server-based function.
57. The method of claim 53, wherein the call handling function validates the call-specific metadata by verifying that caller ID information in the metadata matches call-source information in the metadata.
58. The method of claim 57, wherein the call-source information is immutable.
59. The method of claim 53, wherein the call handling function references community intelligence of a Sender Controlled Media (SCM) platform that facilitates determining an integrity of a caller associated with the incoming call.
60. The method of claim 53, wherein the call handling function is a visual content management service of a Sender Controlled Media (SCM) platform that facilitates access to the visual content to be presented on the incoming call interface of the smart phone.
61. The method of claim 53, wherein activating the link present in the call-specific metadata includes first populating at least one variable field in the link with data representative of a context of the call.
62. The method of claim 61, wherein the at least one variable field is populated with a name of a user of the smart phone.
63. The method of claim 53, wherein decoding comprises use of a public key of a phone service provider that originated the incoming call.
64. The method of claim 53, wherein the link that is present in the call-specific metadata comprises an indication that a source device for the incoming call is configured with a Sender Controlled Media (SCM) compatible dialer app.
65. A method comprisingreceiving an incoming call with a Sender Controlled Media (SCM) configured dialer app;presenting visual content in an interactive user interface of a smart phone controlled by the dialer app, wherein the user interface is presented in a lockscreen of the dialer app; andresponsive to detecting user activity responsive to content presented in the user interface, retrieving information from a network resource based on the user activity and presenting at least a portion of the retrieved information in the lockscreen-based user interface.
66. The method of claim 65, wherein the secondary channel is operative during at least one of a pre-call phase of the incoming call, an in-call phase of the incoming call, and a post-call phase of the incoming call.
67. The method of claim 65, wherein the secondary channel is operative independent of maintaining the smart phone in a locked state.
68. The method of claim 65, further comprising responsive to detecting user activity, activating a secondary channel of communication between an originator of the incoming call and a user of the smart phone via the lockscreen-based interactive user interface, wherein the secondary channel facilitates exchange of digital information contemporaneously with the incoming call.
69. The method of claim 68, wherein the user interface is operative during at least one of a pre-call phase of the incoming call, an in-call phase of the incoming call, and a post-call phase of the incoming call.
70. The method of claim 68, wherein the user interface is operative independent of maintaining the smart phone in a locked state.
