Method, system, and computer-readable storage medium for generating a context sending menu

By generating contextual sending menus and action bars, the problem of difficult to present media content that users are interested in in social networking systems is solved, and user experience and participation are improved.

CN118714108BActive Publication Date: 2025-05-27SNAP INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410753620.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-06-10
Filing Date
2021-06-10
Publication Date
2025-05-27
Estimated Expiration
2041-06-10

AI Technical Summary

Technical Problem

The prior art is difficult to effectively present media content of users' interest in social networking systems and provide a graphical user interface that attracts users' attention, especially in messaging systems.

Method used

By generating a context send menu, users can access the application platform on their client devices and generate an action bar based on the device context, including previews of media content items and optional items, so that users can quickly access relevant users.

Benefits of technology

Improves the user experience, enables users to more conveniently access media content and interaction functions of interest, and enhances users' participation in social networking systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118714108B_ABST
    Figure CN118714108B_ABST
Patent Text Reader

Abstract

The present application discloses a method, a system, and a computer-readable storage medium for generating a context sending menu. The method begins with a processor causing a display screen of a first client device to display a first portion and a second portion of the display screen at an inactive position by: causing the first portion to display an application interface associated with an application, and causing the second portion to display an action bar associated with a messaging system. In response to receiving a selection of a chat option included in the application interface, the processor generates a media content item based on the context of the first client device, and causes the first portion and the second portion of the display screen to be displayed at an active position by causing the first portion of the display screen to shrink and the second portion of the display screen to expand and include a preview of the media content item and selectable items associated with a second user. Other embodiments are also disclosed herein.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of a Chinese patent application filed on December 9, 2022, with application number 202180041725.3 and invention title "Context Sending Menu". The international filing date of the corresponding PCT international application of the above-mentioned parent application is June 10, 2021, and the international application number is PCT / US2021 / 070692. This application claims the priority benefit of US Provisional Application Serial No. 63 / 037,557, filed on June 10, 2020, the entire content of which is incorporated herein by reference. Technical Field

[0002] The present invention relates to the processing of messages, specifically to a context sending menu, and more specifically to a method, a computer-readable storage medium, and a system for generating a context sending menu. Background Art

[0003] Electronic messaging, especially instant messaging, continues to be popular worldwide. Users can quickly share electronic media content items including text, electronic images, audio, and video with each other instantaneously. Summary of the Invention

[0004] A method for generating a context sending menu according to the present invention includes: causing a display screen of a first client device to display a first portion and a second portion of the display screen at an inactive position by a processor: causing the first portion to display an application interface associated with an application, and causing the second portion to display an action bar associated with a messaging system; receiving a selection of a chat selectable item in the application interface from a first user of the first client device, wherein the chat selectable item is associated with a communication interface of the messaging system; generating a media content item based on the context of the first client device in response to receiving the selection of the chat selectable item included in the application interface; and causing the first portion and the second portion of the display screen to be displayed at an active position by: causing the first portion of the display screen to shrink, and causing the second portion of the display screen to expand and include a preview of the media content item and selectable items associated with a second user.

[0005] A non-transitory computer-readable storage medium storing instructions according to the present invention, the instructions when executed by a processor cause the processor to perform operations, the operations including: causing a display screen of a first client device to display a first portion and a second portion of the display screen at an inactive position by: causing the first portion to display an application interface associated with an application, and causing the second portion to display an action bar associated with a messaging system; receiving a selection of a chat selectable item in the application interface from a first user of the first client device, wherein the chat selectable item is associated with a communication interface of the messaging system; in response to receiving the selection of the chat selectable item in the application interface from the first user of the first client device, generating a media content item based on the context of the first client device; and causing the first portion and the second portion of the display screen to be displayed at an active position by: causing the first portion of the display screen to shrink, and causing the second portion of the display screen to expand and include a preview of the media content item and selectable items associated with a second user.

[0006] A system for generating a context send menu according to the present invention includes: a processor; and a memory storing instructions, the instructions when executed by the processor cause the system to perform operations, the operations including: causing a display screen of a first client device to display a first portion and a second portion of the display screen at an inactive position by: causing the first portion to display an application interface associated with an application, and causing the second portion to display an action bar associated with a messaging system; receiving a selection of a chat selectable item in the application interface from a first user of the first client device, wherein the chat selectable item is associated with a communication interface of the messaging system; in response to receiving the selection of the chat selectable item in the application interface from the first user of the first client device, generating a media content item based on the context of the first client device; and causing the first portion and the second portion of the display screen to be displayed at an active position by: causing the first portion of the display screen to shrink, and causing the second portion of the display screen to expand and include a preview of the media content item and selectable items associated with a second user. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. To easily identify the discussion of any particular element or action, one or more of the highest-order digits in the reference numeral refer to the figure number in which the element was first introduced. Some embodiments are shown by way of example and not limitation in the figures of the drawings, in which:

[0008] Figure 1Is a graphical representation of a networked environment in which some examples of the present disclosure may be deployed.

[0009] Figure 2 Is a graphical representation of a messaging system having both client-side functionality and server-side functionality according to some examples.

[0010] Figure 3 Is a graphical representation of a data structure maintained in a database according to some examples.

[0011] Figure 4 Is a graphical representation of a message according to some examples.

[0012] Figure 5 Illustrates an interface 500 according to one embodiment.

[0013] Figure 6 Illustrates an interface 600 according to one embodiment.

[0014] Figure 7 Illustrates an interface 700 according to one embodiment.

[0015] Figure 8 Illustrates a process 800 for generating a context send menu according to one embodiment.

[0016] Figure 9 Is a graphical representation of a machine in the form of a computer system in which a set of instructions may be executed to cause the machine to perform any one or more of the methods discussed herein.

[0017] Figure 10 Is a block diagram showing a software architecture in which examples may be implemented. Detailed Description

[0018] As the number of users on a social networking system increases, each user also has a growing network of individuals she follows. Thus, to maintain a user's engagement on the social networking system, it is most important for the system to have the ability to present to each user the media content items that she is most interested in or most relevant to. In addition to the need to curate media content items, the social networking system also faces the challenge of providing a graphical user interface that attracts a user's attention and allows her to view the curated media content items and further interact with the network of individuals she follows.

[0019] In a messaging system, a user connects to various other users with whom she has different levels and types of relationships. Users can interact with each other in the messaging system by exchanging messages, audiovisual content, links to content on the Internet, and the like.

[0020] Embodiments of the present disclosure improve the functionality of electronic messaging software and systems by generating a platform on which users can access applications and by generating an action bar based on the context of the user's client device. Specifically, the action bar generated and displayed on the user's client device is context-aware because the content of the action bar menu can depend on the application currently running on the user's client device. In response to a selection in the application, the action bar can also be caused to display a context-aware send interface that includes a preview of media content items from the application to be sent and a list of users associated with the application or the user on the messaging device. Selectable items (e.g., icons, images, text) that identify these users can also be displayed in the context-aware send menu, enabling the user to quickly access these users in order to send them application-related content or messages.

[0021] Embodiments of the present disclosure also improve the functionality of electronic messaging software and systems by providing a shared placement of an action bar through which a settings menu can be accessed among applications executed on a client device. The action bar can be native to the messaging system but is dynamically adapted to incorporate elements related to the current context of the client device, such as the application that the user is currently accessing on the client device. By ensuring the shared placement of the action bar and the context-aware aspects of the settings menu, embodiments of the messaging system improve the user experience, enabling further increased user engagement with the messaging system.

[0022] Networked computing environment

[0023] Figure 1 is a block diagram illustrating an example messaging system 100 for exchanging data (e.g., messages and associated content) over a network. The messaging system 100 includes multiple instances of client devices 106, each of the multiple instances hosting a number of applications including a messaging client 108. Each messaging client 108 is communicatively coupled via a network 102 (e.g., the Internet) to other instances of the messaging client 108 and a messaging server system 104.

[0024] The messaging client 108 is capable of communicating and exchanging data with other messaging clients 108 and the messaging server system 104 via the network 102. The data exchanged between the messaging clients 108 and between the messaging client 108 and the messaging server system 104 includes functionality (e.g., commands that trigger functionality) and payload data (e.g., text, audio, video, or other multimedia data).

[0025] The messaging server system 104 provides server - side functions to a specific messaging client 108 via the network 102. Although certain functions of the messaging system 100 are described herein as being performed by the messaging client 108 or by the messaging server system 104, the location of certain functions within the messaging client 108 or the messaging server system 104 can be a design choice. For example, it may be technically preferable to initially deploy certain technologies and functions within the messaging server system 104, but later migrate the technology and functions to the messaging client 108 when the client device 106 has sufficient processing power.

[0026] The messaging server system 104 supports various services and operations provided to the messaging client 108. Such operations include sending data to the messaging client 108, receiving data from the messaging client, and processing data generated by the messaging client. The data can include, by way of example, message content, client device information, geolocation information, media enhancements and overlays, message content persistence conditions, social network information, and live event information. The data exchange within the messaging system 100 is initiated and controlled through functions available via the user interface (UI) of the messaging client 108.

[0027] Now turning specifically to the messaging server system 104, an application programming interface (API) server 112 is coupled to an application server 110 and provides a programming interface to the application server. The application server 110 is communicatively coupled to a database server 116, which facilitates access to a database 122 that stores data associated with messages processed by the application server 110. Similarly, a web server 124 is coupled to the application server 110 and provides a web - based interface to the application server 110. To this end, the web server 124 processes incoming network requests via the Hyper - Text Transfer Protocol (HTTP) and several other related protocols.

[0028] The Application Programming Interface (API) server 112 receives and sends message data (e.g., commands and message payloads) between the client device 106 and the application server 110. In particular, the Application Programming Interface (API) server 112 provides a set of interfaces (e.g., routines and protocols) that the messaging client 108 can call or query to trigger the functionality of the application server 110. The Application Programming Interface (API) server 112 exposes various functions supported by the application server 110, including: account registration; login functionality; sending messages from a particular messaging client 108 to another messaging client 108 via the application server 110; sending media files (e.g., images or videos) from the messaging client 108 to the messaging server 114; and setting a collection of media data (e.g., stories) for access by other messaging clients 108, retrieving a friend list of the user of the client device 106, retrieving such collections, retrieving messages and content, adding and deleting entities (e.g., friends) to and from an entity graph (e.g., a social graph), locating friends in the social graph, and opening application events (e.g., related to the messaging client 108).

[0029] The application server 110 hosts a number of server applications and subsystems, including for example the messaging server 114, the image processing server 118, and the social network server 120. The messaging server 114 implements a number of message processing techniques and functions that particularly relate to the aggregation and other processing of content (e.g., text and multimedia content) included in messages received from multiple instances of the messaging client 108. As will be described in further detail, text and media content from multiple sources can be aggregated into content collections (e.g., referred to as stories or galleries). These collections are then made available to the messaging client 108. Given the hardware requirements for other processor and memory-intensive processing of the data, such processing can also be performed on the server side by the messaging server 114.

[0030] The application server 110 also includes an image processing server 118 that is dedicated to performing various image processing operations generally with respect to images or videos within the payload of messages sent from or received at the messaging server 114.

[0031] The social network server 120 supports and makes available various social networking functions and services to the messaging server 114. To this end, the social network server 120 maintains and accesses an entity graph 308 within the database 122 (as Figure 3as shown). Examples of functions and services supported by the social network server 120 include identifying other users in the messaging system 100 that have a relationship with or are "following" a particular user, and identifying the interests of a particular user and other entities.

[0032] System Architecture

[0033] Figure 2 is a block diagram showing further details regarding the messaging system 100 according to some examples. Specifically, the messaging system 100 is shown to include a messaging client 108 and an application server 110. The messaging system 100 includes a number of subsystems that are supported on the client side by the messaging client 108 and on the server side by the application server 110. These subsystems include, for example, a transient timer system 202, a collection management system 204, an enhancement system 206, a map system 210, and a game system 212.

[0034] The transient timer system 202 is responsible for implementing temporary or time-limited access to content by the messaging client 108 and the messaging server 114. The transient timer system 202 includes a number of timers that selectively enable access (e.g., for presentation and display) to messages and associated content via the messaging client 108 based on the duration and display parameters associated with a message or a collection of messages (e.g., a story). Additional details regarding the operation of the transient timer system 202 are provided below.

[0035] The collection management system 204 is responsible for managing groups and collections of media (e.g., collections of text, image, video, and audio data). Collections of content (e.g., messages including images, videos, text, and audio) can be organized into an "event gallery" or an "event story". Such collections can be made available for a specified period of time, e.g., for the duration of an event related to the content. For example, content related to a concert can be made available as a "story" for the duration of that concert. The collection management system 204 can also be responsible for publishing an icon that provides a notification of the existence of a particular collection to the user interface of the messaging client 108. In one embodiment, the collection management system 204 can be responsible for managing a shared collection of media content items that can only be viewed by a selected group of users (e.g., a private group) in the messaging system by the creator of the shared collection. In one embodiment, the shared collection of media content items can be modified by the creator of the shared collection and other members of the private group. For example, the collection management system 204 only processes and implements modifications such as adding, deleting, or editing media content items included in the shared collection received from the client devices 102 of the members of the private group. The shared collection can also be a "shared story" such that the shared collection is available for a specified period of time implemented by the transient timer system 202.

[0036] In addition, the collection management system 204 also includes a curation interface 208 that allows a collection manager to manage and curate a particular content collection. For example, the curation interface 208 enables an event organizer to curate a collection of content related to a particular event (e.g., delete inappropriate content or redundant messages). In addition, the collection management system 204 employs machine vision (or image recognition technology) and content rules to automatically curate content collections. In some examples, compensation can be paid to users for including user-generated content in a collection. In such cases, the curation management system 204 operates to automatically pay such users for using their content.

[0037] The enhancement system 206 provides various functions that enable a user to enhance (e.g., annotate or otherwise modify or edit) media content associated with a message. For example, the enhancement system 206 provides functions related to generating and publishing media overlays for messages processed by the messaging system 100. The enhancement system 206 operably supplies a media overlay or enhancement (e.g., an image filter) to the messaging client 108 based on the geolocation of the client device 106. In another example, the enhancement system 206 operably supplies a media overlay to the messaging client 108 based on other information such as the social network information of a user of the client device 106. The media overlay can include audio and visual content and visual effects. Examples of audio and visual content include pictures, text, logos, animations, and sound effects. Examples of visual effects include color overlays. The audio and visual content or visual effects can be applied to a media content item (e.g., a photo) at the client device 106. For example, the media overlay can include text or an image that can be overlaid on a photo taken by the client device 106. In another example, the media overlay includes a location identifier overlay (e.g., Venice Beach), a live event name or a merchant name overlay (e.g., Beach Café). In another example, the enhancement system 206 uses the geolocation of the client device 106 to identify a media overlay that includes the name of a merchant at the geolocation of the client device 106. The media overlay can include other markers associated with the merchant. The media overlay can be stored in the database 122 and accessed via the database server 116. In one embodiment, the enhancement system 206 generates an invitation media overlay for a shared set of media content items. The invitation overlay can include text identifying the shared set of media content items. The invitation overlay can also include an avatar associated with the user who created the shared set. In some embodiments, the invitation overlay can also include avatars associated with users in a private group.

[0038] In some examples, the enhancement system 206 provides a user-based publishing platform that enables a user to select a geolocation on a map and upload content associated with the selected geolocation. The user can also specify an environment in which a particular media overlay should be provided to other users. The enhancement system 206 generates a media overlay that includes the uploaded content and associates the uploaded content with the selected geolocation.

[0039] In other examples, the enhancement system 206 provides a merchant-based publishing platform that enables a merchant to select a particular media overlay associated with a geolocation via a bidding process. For example, the enhancement system 206 associates the media overlay of the highest bidding merchant with the corresponding geolocation for a predefined amount of time.

[0040] The map system 210 provides various geolocation functions and supports presenting map-based media content and messages by the messaging client 108. For example, the map system 210 enables the display on a map of user icons or avatars (e.g., stored in the profile data 316) to indicate the current or past locations of a user's "friends" in the context of the map, as well as media content (e.g., a collection of messages including photos and videos) generated by such friends. For example, a message posted by a user from a specific geolocation to the messaging system 100 can be displayed to the "friends" of the specific user at that specific location in the context of the map on the map interface of the messaging client 108. A user can also share his or her location and status information with other users of the messaging system 100 (e.g., using an appropriate status avatar) via the messaging client 108, where the location and status information is similarly displayed to the selected users in the context of the map interface of the messaging client 108.

[0041] The game system 212 provides various game functions in the context of the messaging client 108. The messaging client 108 provides a game interface that provides a list of available games that can be launched by a user in the context of the messaging client 108 and played with other users of the messaging system 100. The messaging system 100 also enables a specific user to invite such other users to participate in playing a specific game by sending an invitation from the messaging client 108 to the other users. The messaging client 108 also supports both voice messaging and text messaging (e.g., chat) in the context of playing a game, provides a leaderboard for the game, and also supports providing in-game rewards (e.g., coins and items).

[0042] Data Architecture

[0043] Figure 3 is a schematic diagram showing a data structure 300 that can be stored in the database 122 of the messaging server system 104 according to some examples. Although the contents of the database 122 are shown as including several tables, it should be understood that the data can be stored in other types of data structures (e.g., as an object-oriented database).

[0044] The database 122 includes message data stored within the message table 302. For any particular message, the message data includes at least message sender data, message recipient (or receiver) data, and a payload. Further details regarding information that can be included in a message and that is included in the message data stored in the message table 302 are described below with reference to Figure 4 describes additional details about the information that can be included in a message and that is included in the message data stored in the message table 302.

[0045] The entity table 306 stores entity data and is linked (e.g., to a reference ground) to the entity graph 308 and the profile data 316. Entities for which records are maintained within the entity table 306 can include individuals, corporate entities, organizations, objects, locations, events, etc. Any entity for which the messaging server system 104 stores data about it can be an identified entity, regardless of the entity type. Each entity is provided with a unique identifier and an entity type identifier (not shown).

[0046] The entity graph 308 stores information about the relationships and associations between entities. Such relationships may be merely social, professional (e.g., working in the same company or organization), interest-based, or activity-based, for example.

[0047] The profile data 316 stores various types of profile data about a specific entity. Based on the privacy settings specified by the specific entity, the profile data 316 can be selectively used and presented to other users of the messaging system 100. In the case where the entity is an individual, the profile data 316 includes, for example, a username, a phone number, an address, settings (e.g., notification and privacy settings), and an avatar representation (or a set of such avatar representations) selected by the user. Then, a specific user can selectively include one or more of these avatar representations in the content of messages transmitted via the messaging system 100 and on a map interface displayed by the messaging client 108 to other users. The set of avatar representations can include "status avatars" that present graphical representations of statuses or activities that the user can choose to convey at a specific time.

[0048] In the case where the entity is a group, in addition to the group name, members, and various settings (e.g., notifications) of the related group, the profile data 316 of the group can similarly include one or more avatar representations associated with the group.

[0049] The database 122 also stores enhancement data, such as overlays or filters, in the enhancement table 310. The enhancement data is associated with videos (video data is stored in the video table 304) and images (image data is stored in the image table 312) and is applied to the videos and images.

[0050] In one example, a filter is an overlay that is displayed as covering an image or a video during presentation to a receiving user. Filters can be of various types, including filters selected by a user from a set of filters presented to the sending user by the messaging client 108 when the sending user is composing a message. The filters selected by the user can include an invitation media overlay associated with a shared set of media content items.

[0051] Other types of filters include geolocation filters (also known as geo-filters), which can be presented to the sending user based on geolocation. For example, based on geolocation information determined by the Global Positioning System (GPS) unit of the client device 106, the messaging client 108 can present in the user interface geolocation filters specific to nearby or special locations.

[0052] Another type of filter is a data filter, which can be selectively presented to the sending user by the messaging client 108 based on other inputs or information collected by the client device 106 during the message creation process. Examples of data filters include the current temperature at a specific location, the current speed at which the sending user is traveling, the battery life of the client device 106, or the current time.

[0053] Other enhanced data that can be stored in the image table 312 includes augmented reality content items (e.g., corresponding to app lenses or augmented reality experiences). Augmented reality content items can be real-time special effects and sounds that can be added to an image or video.

[0054] As described above, enhanced data includes augmented reality content items, overlays, image transformations, AR images, and similar items that refer to modifications that can be applied to image data (e.g., video or image). This includes real-time modifications that modify the image when the image is captured using the device sensors of the client device 106 (e.g., one or more camera devices) and then displayed on the screen of the client device 106 in the modified case. This also includes modifications to stored content (e.g., video clips in a gallery that can be modified). For example, in the client device 106 with access to multiple augmented reality content items, the user can use a single video clip with multiple augmented reality content items to see how different augmented reality content items would modify the stored clip. For example, by selecting different augmented reality content items for the same content, multiple augmented reality content items applying different pseudo-random motion models can be applied to the same content. Similarly, real-time video capture can be used with the shown modifications to show how the video image currently captured by the sensors of the client device 106 would modify the captured data. Such data can simply be displayed on the screen without being stored in the memory, or the content captured by the device sensors can be recorded and stored in the memory with or without modification (or both). In some systems, a preview feature can show how different augmented reality content items would look in different windows within the display simultaneously. For example, this can enable viewing multiple windows with different pseudo-random animations on the display at the same time.

[0055] Thus, data of augmented reality content items and various systems that use such data or other such transformation systems that modify content using such data can involve detection of objects (e.g., faces, hands, bodies, cats, dogs, surfaces, objects, etc.), tracking of such objects as they leave, enter, and move around within the field of view in a video frame, and modification or transformation of such objects as they are being tracked. In various embodiments, different methods can be used to implement such transformations. Some examples can involve generating a three-dimensional mesh model of one or more objects and using transformations and animated textures of the model within the video to implement the transformation. In other examples, tracking of points on an object can be used to place an image or texture (which can be two-dimensional or three-dimensional) at the tracked locations. In further examples, neural network analysis of video frames can be used to place an image, model, or texture within the content (e.g., an image or frame of a video). Thus, augmented reality content items refer both to the images, models, and textures used to create transformations within content and to the additional modeling and analysis information required to implement such transformations using object detection, tracking, and placement.

[0056] Real-time video processing can be performed using any kind of video data (e.g., video stream, video file, etc.) stored in the memory of any kind of computerized system. For example, a user can load a video file and save it in the memory of a device, or can use the sensors of the device to generate a video stream. Additionally, computer animation models can be used to process any object, such as parts of a human face and body, animals, or inanimate objects (e.g., chairs, cars, or other objects).

[0057] In some examples, when a specific modification is selected along with the content to be transformed, the element to be transformed is identified by the computing device and then, if the element to be transformed is present in the frames of the video, the element to be transformed is detected and tracked. The elements of the object are modified according to the modification request, thereby transforming the frames of the video stream. For different kinds of transformations, the transformation of the frames of the video stream can be performed by different methods. For example, for a frame transformation that mainly refers to the changing form of the elements of an object, the feature points of each element of the object are calculated (e.g., using an active shape model (ASM) or other known methods). Then, a grid based on the feature points is generated for each of at least one element of the object. This grid is used for the subsequent stages of tracking the elements of the object in the video stream. During the tracking process, the mentioned grid of each element is aligned with the position of each element. Then, additional points are generated on the grid. A first set of first points is generated for each element based on the modification request, and a set of second points is generated for each element based on this set of first points and the modification request. Then, the frames of the video stream can be transformed by modifying the elements of the object based on this set of first points, this set of second points, and the grid. In such a method, the background of the modified object can also be changed or distorted by tracking and modifying the background.

[0058] In some examples, a transformation that uses the elements of an object to change some regions of the object can be performed by calculating the feature points of each element of the object and generating a grid based on the calculated feature points. Points are generated on the grid and then various regions are generated based on these points. Then, the elements of the object are tracked by aligning the regions of each element with the position of each of at least one element, and the attributes of the regions can be modified based on the modification request, thereby transforming the frames of the video stream. Depending on the specific modification request, the attributes of the mentioned regions can be transformed in different ways. Such modifications can involve: changing the color of the region; removing at least part of the region from the frames of the video stream; including one or more new objects in the region based on the modification request; and modifying or distorting the region or the elements of the object. In various embodiments, any combination of such modifications or other similar modifications can be used. For certain models to be animated, some feature points can be selected as control points for determining the entire state space of the options for model animation.

[0059] In some examples of computer animation models that use face detection to transform image data, a specific face detection algorithm (e.g., Viola-Jones) is used to detect faces in the image. Then, the active shape model (ASM) algorithm is applied to the face region of the image to detect face feature reference points.

[0060] In other examples, other methods and algorithms suitable for face detection can be used. For example, in some embodiments, landmarks are used to locate features, where the landmarks represent distinguishable points that exist in most of the images under consideration. For example, for face landmarks, the location of the left eye pupil can be used. If the initial landmarks are not recognizable (e.g., if the person has an eye patch), secondary landmarks can be used. Such landmark recognition processes can be used for any such object. In some examples, a set of landmarks forms a shape. The shape can be represented as a vector using the coordinates of the points in the shape. One shape is aligned with another using a similarity transformation (which allows translation, scaling, and rotation) that minimizes the average Euclidean distance between the shape points. The average shape is the average of the aligned training shapes.

[0061] In some examples, a search for landmarks begins from an average shape that is aligned with the position and size of the face determined by a full-face detector. Then, such a search repeats the steps of: suggesting a tentative shape by adjusting the positioning of the shape points through template matching of the image texture around each point, and then conforming the tentative shape to a global shape model until convergence occurs. In some systems, individual template matches are unreliable, and the shape model pools the results of weak template matches to form a stronger overall classifier. The entire search is repeated at each level of an image pyramid from a coarse resolution to a fine resolution.

[0062] The transformation system can capture an image or video stream on a client device (e.g., client device 106) and perform complex image manipulations locally on the client device 106 while maintaining an appropriate user experience, computation time, and power consumption. Complex image manipulations can include size and shape changes, emotion transfer (e.g., changing a face from a frown to a smile), state transfer (e.g., aging a subject, reducing apparent age, changing gender), style transfer, application of graphical elements, and any other suitable image or video manipulations implemented by a convolutional neural network that has been configured to execute efficiently on the client device 106.

[0063] In some examples, a computer animation model for transforming image data can be used by a system in which a user can capture an image or video stream of the user (e.g., a selfie) using a client device 106 having a neural network operating as part of a messaging client application 104 operating on the client device 106. A transformation system operating within the messaging client 108 determines the presence of a face within the image or video stream and provides a modification icon associated with the computer animation model to transform the image data, or the computer animation model can be presented as being associated with the interfaces described herein. The modification icon includes a change that can be the basis for modifying the face of the user within the image or video stream as part of a modification operation. Once the modification icon is selected, the transformation system initiates a process of converting the user's image to reflect the selected modification icon (e.g., generating a smiling face on the user). Once the image or video stream is captured and the specified modification is selected, the modified image or video stream can be presented in a graphical user interface displayed on the client device 106. The transformation system can implement a complex convolutional neural network on a portion of the image or video stream to generate and apply the selected modification. That is, once the modification icon is selected, the user can capture an image or video stream and the result of the modification can be presented in real time or near real time. Additionally, when a video stream is being captured, the modification can be persistent and the selected modification icon remains toggled. A machine-taught neural network can be used to implement such modifications.

[0064] A graphical user interface presenting the modifications performed by the transformation system can supply additional interaction options to the user. Such options can be based on the interface used to initiate content capture and selection for a particular computer animation model (e.g., initiated from a content creator user interface). In various embodiments, the modification can be persistent after an initial selection of the modification icon. The user can turn the modification on or off and store it for later viewing or browsing to other areas of the imaging application by tapping or otherwise selecting the face modified by the transformation system. In cases where multiple faces are modified by the transformation system, the user can globally turn the modification on or off by tapping or selecting an individual face modified and displayed within the graphical user interface. In some embodiments, individual faces within a group of multiple faces can be modified separately, or such modifications can be toggled individually by tapping or selecting each individual face or a series of individual faces displayed within the graphical user interface.

[0065] The story table 314 stores data regarding a collection of messages and associated image, video, or audio data, which are compiled into a collection (e.g., a story or a gallery). The creation of a particular collection can be initiated by a particular user (e.g., each user whose record is maintained in the entity table 306). A user can create a "personal story" in the form of a collection of content that has been created and sent / broadcast by that user. To this end, the user interface of the messaging client 108 can include user-selectable icons to enable the sending user to add specific content to his or her personal story.

[0066] The collection can also constitute a "live story" as a collection of content from multiple users, which is created manually, automatically, or using a combination of manual and automatic techniques. For example, a "live story" can constitute a curated stream of user-submitted content from different locations and events. Options can be presented to users whose client devices have location services enabled and are at a public location event at a particular time, via the user interface of the messaging client 108 for example, to contribute content to a particular live story. The live story can be identified to the user by the messaging client 108 based on his or her location. The end result is a "live story" told from a community perspective.

[0067] Another type of content collection is referred to as a "location story", which enables users whose client devices 106 are located within a particular geolocation (e.g., on a college or university campus) to contribute to a particular collection. In some embodiments, contributing to a location story may require a second degree of authentication to verify that the end user belongs to a particular organization or other entity (e.g., is a student on a university campus).

[0068] As mentioned above, the video table 304 stores video data, which, in one example, is associated with messages whose records are maintained in the message table 302. Similarly, the image table 312 stores image data associated with messages whose message data is stored in the entity table 306. The entity table 306 can associate various enhancements from the enhancement table 310 with the various images and videos stored in the image table 312 and the video table 304.

[0069] Data Communication Architecture

[0070] Figure 4FIG. 0 is a schematic diagram showing the structure of a message 400 according to some examples, the message being generated by a messaging client 108 for transmission to another messaging client 108 or a messaging server 114. The content of a particular message 400 is used to populate a message table 302 stored in a database 122, which can be accessed by the messaging server 114. Similarly, the content of the message 400 is stored in memory as "in-transit" or "in-flight" data of a client device 106 or an application server 110. The message 400 is shown as including the following example components:

[0071] · Message identifier 402: A unique identifier that identifies the message 400.

[0072] · Message text payload 404: Text to be generated by a user via a user interface of the client device 106 and included in the message 400.

[0073] · Message image payload 406: Image data captured by a camera device component of the client device 106 or retrieved from a memory component of the client device 106 and included in the message 400. The image data for a sent or received message 400 can be stored in an image table 312.

[0074] · Message video payload 408: Video data captured by a camera device component or retrieved from a memory component of the client device 106 and included in the message 400. The video data for a sent or received message 400 can be stored in a video table 304.

[0075] · Message audio payload 410: Audio data captured by a microphone or retrieved from a memory component of the client device 106 and included in the message 400.

[0076] · Message enhancement data 412: Enhancement data (e.g., filters, stickers, or other annotations or enhancements) representing an enhancement to be applied to the message image payload 406, the message video payload 408, or the message audio payload 410 of the message 400. The enhancement data for a sent or received message 400 can be stored in an enhancement table 310.

[0077] · Message duration parameter 414: A parameter value indicating, in seconds, the amount of time that the content of the message (e.g., the message image payload 406, the message video payload 408, the message audio payload 410) is to be presented to or accessible by a user via the messaging client 108.

[0078] · Message Geolocation Parameter 416: Geolocation data (e.g., latitude coordinates and longitude coordinates) associated with the content payload of a message. Multiple Message Geolocation Parameter 416 values may be included in the payload, each of these parameter values being associated with a content item included in the content (e.g., a specific image in the Message Image Payload 406, or a specific video in the Message Video Payload 408).

[0079] · Message Story Identifier 418: An identifier value that identifies one or more content collections (e.g., "stories" identified in the Story Table 314), where a specific content item in the Message Image Payload 406 of the Message 400 is associated with one or more content collections. For example, an identifier value may be used to associate each of multiple images within the Message Image Payload 406 with multiple content collections.

[0080] · Message Tag 420: Each Message 400 may be tagged with multiple tags, each of such multiple tags indicating a topic of the content included in the message payload. For example, in the case where a specific image included in the Message Image Payload 406 depicts an animal (e.g., a lion), a tag value may be included within the Message Tag 420 indicating the relevant animal. The tag value may be manually generated based on user input, or may be automatically generated using, for example, image recognition.

[0081] · Message Sender Identifier 422: An identifier (e.g., a messaging system identifier, an email address, or a device identifier) that indicates the user of the client device 106 on which the Message 400 is generated and from which the Message 400 is sent.

[0082] · Message Recipient Identifier 424: An identifier (e.g., a messaging system identifier, an email address, or a device identifier) that indicates the user of the client device 106 to which the Message 400 is addressed.

[0083] The content (e.g., values) of the components of the Message 400 may be pointers to the locations in the tables where the content data values are stored. For example, the image value in the Message Image Payload 406 may be a pointer to a location within the Image Table 312 (or an address of a location within the Image Table). Similarly, the value within the Message Video Payload 408 may point to data stored within the Video Table 304, the value stored within the Message Enhancement 412 may point to data stored within the Enhancement Table 310, the value stored within the Message Story Identifier 418 may point to data stored within the Story Table 314, and the values stored within the Message Sender Identifier 422 and the Message Recipient Identifier 424 may point to user records stored within the Entity Table 306.

[0084] Context Send Menu

[0085] As Figure 2 shown, game system 212 provides various game functions in the context of messaging client 108. Games that can be launched in the context of messaging client 108 can include smaller applications (e.g., "mini-apps") that are sub-applications of a larger main application and that provide utilities for a larger user base of the main application. The mini-apps can be designed to fit the platform provided by messaging system 100 and leverage features of messaging system 100, including the user and the user's list of friends in the social graph.

[0086] The mini-apps can be hypertext markup language version 5 (HTML5) web applications, which are games or other programs that can be executed within messaging system 100. A processor in game system 212 or client device 106 or a processor in application server 110 can cause an interface to be displayed by client device 106, either alone or in combination. Figure 5 An interface 500 is shown in accordance with one embodiment, where a first portion 502 and a second portion 504 are in an inactive position.

[0087] A user of client device 106 can launch a mini-app by selecting a selectable item (e.g., an icon, text, or image) associated with the mini-app. Game system 212 can generate list selectable items associated with a list of available mini-apps that can be executed by client device 106 within messaging system 100. Each of the available mini-apps can be associated with an app icon that can be selected to execute the mini-app on client device 106. As Figure 5 shown, in response to a user of client device 106 selecting a selectable item associated with a mini-app, game system 212 causes interface 500 to be displayed by client device 106. Interface 500 includes a first portion 502 and a second portion 504 of the display screen in an inactive position. As Figure 5 shown, the first portion 502 of the display screen is the top portion of the display screen, and the second portion 504 of the display screen is the bottom portion of the display screen. The first portion 502 of the display screen in the inactive position is larger in size than the second portion 504 of the display screen in the inactive position.

[0088] The first portion 502 includes an app interface 506 associated with the mini-app selected and activated by the user. In Figure 5In it, the mini - application is a prediction game that displays a question to the user (e.g., "Weeknd is still at the top! Who will knock him off the top of the Billboard Hot 100?") and provides answer options (e.g., Drake, Roddy Ricch, Dua Lipa, Doja Cat, and others) that the user can select. As shown in the application interface 506, the game system 212 causes the client device 106 to display the question from the mini - application and multiple selectable items (e.g., selectable item 518) associated with the multiple answer options. The selectable items can be text, links, images, icons, etc.

[0089] The second part 504 includes an action bar 516 associated with the game system 212 of the messaging system 100. The action bar 516 can be native to the game system 212 such that the action bar is always present when any mini - application is selected and displayed in the first part 502. The appearance and function of the action bar 516 can vary based on the context or state of the client device 106 or the user of the client device 106.

[0090] The action bar 516 can include a selectable item 508 that can be selected to exit from the mini - application. By activating the selectable item 508, the client device 106 is caused to return the user to the interface from which the user launched the mini - application.

[0091] When generating the action bar 516, the game system 212 can determine that the context of the client device 106 includes the user selecting an icon associated with the mini - application from the communication interface of a communication session among multiple users for the messaging system 100. In this example, when the user selects the selectable item 508, the client device 106 is caused to display the communication interface.

[0092] In another example, the game system 212 can determine that selectable items associated with the micro - application selected by the user are displayed in the media item viewing interface, which allows the user to view images, videos, texts, and messages available on the messaging system 100. The selectable items associated with the micro - application can be an overlay on the media content items received by the client device 106 and viewed on the media content item viewing interface displayed by the client device 106. Alternatively, the media content item viewing interface can be an interface (e.g., a micro - application search interface, a micro - application suggestion interface, etc.) that allows the user to search for or view a list of micro - applications that can be executed on the messaging system 100. The game system 212 can generate list selectable items respectively associated with the list of available micro - applications that can be executed by the client device 106 within the messaging system 100. In this example, since the selectable items associated with the user - selected micro - application are displayed in the media item viewing interface, when the user selects the selectable item 508, the client device 106 is caused to display the media item viewing interface.

[0093] The action bar 516 can also include a text input element 510 that can receive text input by the user to be shared in the communication interface of a communication session between the user of the client device 106 and other users in the messaging system 100.

[0094] The microphone icon 512 in the action bar 516, when activated, can cause the microphone of the client device 106 to start recording sound signals. Specifically, the microphone icon 512 can be activated to record the voice of the user of the client device 106 to allow the user to send a voice message to the user in the communication session. The voice recording can be displayed as a selectable item in the communication interface and played back by other users who receive the voice recording on their client devices. Alternatively, a voice communication connection can be established between the users in the communication session, which allows the users to communicate via audio when the microphone icon 512 is activated.

[0095] As Figure 5 shown, the action bar 516 can also include a settings selectable item 514 associated with the settings menu. When the settings selectable item 514 is activated by the user of the client device 106, the game system 212 receives a request to display the settings menu. The game system 212 generates the settings menu based on the context of the client device 106.

[0096] The context may include information about the micro - application currently running in the application interface 506. For example, information about the micro - application may include the identification of the micro - application (e.g., name, icon, image, etc.), the application type of the micro - application (e.g., single - player, multi - player, etc.), or the theme associated with the micro - application (e.g., categories such as meditation and wellness, fitness, food, culture, fashion, etc.). The context may also include information about the user of the client device 106, such as user activity information or user selection information about the micro - application, user game score information about the micro - application, user ranking information about the micro - application. The context may also include a list of users associated with the user on the micro - application, or a list of users associated with the user on the messaging system 100.

[0097] Figure 6 FIG. 600 shows an interface generated by the client device 106 when a user selects one of the selectable items in the application interface 506 according to one embodiment. For example, when the user activates Figure 5 the selectable item 518 in to provide "Drake" as his answer, the game system 212 may cause the client device 106 to display the media content item 604 in the application interface 506.

[0098] The game system 212 generates the media content item 604 based on the context of the client device 106. In Figure 5 and Figure 6 example, the context of the client device 106 may be that the micro - application currently running on the application interface 506 is a prediction application, the current state of the micro - application (e.g., the question the user answered (e.g., "The Weeknd is still at the top! Who will knock him off the top of the Billboard Hot 100?" )), the selection the user made in the application interface 506 (e.g., the selectable item 518 associated with the "Drake" answer), etc.

[0099] In Figure 6In [the above scenario], when the user selects the selectable item 518 associated with the answer "Drake", the game system 212 generates a media content item 604 to include the answer "Drake". As shown in the interface 600, the media content item 604 includes the text stating that "Drake will knock The Weeknd off the top of the Billboard Hot 100". The media content item 604 may also include context-embedded links. When the client device associated with the second user displays the media content item 604 and the second user selects the media content item 604, the link is activated, and the client device associated with the second user loads the micro application and displays the application interface 506 with context. For example, the micro application may be loaded onto the client device associated with the second user to include the first user's answer (e.g., "Drake") or to display the question being answered.

[0100] As Figure 6 Further shown in [the above], the game system 212 may also cause a chat selectable item 602 to be displayed in the application interface 506, which allows users to share the media content item 604 with other users associated with the micro application or users on the messaging system 100.

[0101] Figure 7 An interface 700 according to one embodiment is shown, where the first part of the display screen and the second part of the display screen are in the active position. The game system 212 causes the interface 700 to be displayed in response to detecting the user's selection of the chat selectable item 602.

[0102] As shown in the interface 700, the first part 502 is shrunk, while the second part 504 is expanded and includes a context sending interface (or context sending menu), which includes a preview 704 of the media content item 604 and multiple selectable items (e.g., selectable item 702, user selectable item 706, selectable item 708).

[0103] In Figure 7 [the above situation], the game system 212 positions the first part 502 and the second part 504 in the active position, including shrinking the first part 502 of the display screen upward by a predetermined distance. In Figure 7 the first part 502 of [the above], the application interface 506 is pushed upward. Thus, as Figure 6 shown, the top of the application interface 506 is no longer visible in Figure 7 [the above situation]. The game system 212 also causes Figure 6The second part 504 of the middle display extends upward by a predetermined distance vacated by the first part 502. In some embodiments, the context sending interface is displayed on the client device 106 and appears as if it exists behind the application interface 506. For example, when the application interface 506 is pushed upward, the second part 504 extends in a manner that shows the settings menu from behind the application interface 506.

[0104] The context sending interface in the second part 504 of the interface 700 is context-sensitive because the context sending interface can include the name of the micro-application currently displayed in the application interface 506 (e.g., PredictionMaster) and a preview 704 of the media content item 604 associated with the micro-application.

[0105] In one embodiment, the game system 212 generates a preview 704 that is a preview of the media content item 604 to be sent to the user associated with the user in the micro-application or the messaging system 100.

[0106] The context sending interface in the second part 504 of the interface 700 can also be context-sensitive because it can include multiple selectable items (e.g., user selectable items 706) associated with each user in the user list associated with the user on the micro-application. The user selectable items 706 can be associated with a user group or an individual user associated with the user on the micro-application. For example, the users associated with the user on the micro-application can be other users who are also running the micro-application on their client devices. For example, if the micro-application is a multiplayer game, the users associated with the user on the micro-application are the other users who are playing the multiplayer game with that user. In Figure 7 this, the user can select the chat selectable item 602 to communicate with individual users (e.g., Ya Mir, Patrick Mandia, Jeremy Voss) to send them the media content item 604 associated with the micro-application, or request the messaging system 100 to cause a notification to appear on the client devices of the individual users (e.g., by activating Figure 7 the selectable text marked "Call" in this to call the user Jeremy Voss).

[0107] The context sending interface can also include a selectable item 708 that, when activated by the user, allows the user to view more of the context sending interface. When the selectable item 708 is activated, the game system 212 receives a request to display additional information included in the context sending interface and causes the second part 504 to further expand or become larger. For example, by clicking on the selectable item 708, additional user selectable items 706 can be displayed in the expanded second part 504.

[0108] When the selectable item 708 is activated, or when the user provides an input on the display device (e.g., a scrolling input on the second portion 504), the game system 212 can also make the second portion 504 a scrollable interface. A scrollable interface is an interface that a user can browse through using user input (e.g., including up and down, side-to-side scrolling movements on the display screen) to view interface portions that are not visible on the display screen.

[0109] In one embodiment, the game system 212 generates a settings menu based on the context of the client device 106, including: identifying the micro-applications displayed in the application interface 506, determining the settings associated with the micro-applications, and establishing the configuration of the settings menu. The configuration of the settings menu can include the height of the settings menu and the fixed or scrollable aspect of the settings menu. The height of the settings menu can then be used to determine a predetermined distance for the contraction of the first portion 502 and the expansion of the second portion 504.

[0110] The context sending interface can also include a selectable item 702 (e.g., "Back to Prediction Master") associated with a request to return to the micro-application (e.g., the interface 500). The selectable item 702 is generated based on the context of the client device 106 because it can indicate the identity of the micro-application currently in the application interface 506. When the user activates the selectable item 702 on his client device 106, the game system 212 receives an input corresponding to the request to return to the unactivated position as Figure 5 shown. This request allows the user to return to playing or using the micro-application from the context sending interface. In response to receiving this request, the game system 212 causes the first portion 502 and the second portion 504 of the display screen to be displayed by the client device 106 at the Figure 5 unactivated position in.

[0111] Although not shown, the user can request to return to the interface 500 by selecting and dragging down Figure 7 the first portion 502 in. In response to this selection and drag input request, the game system 212 can cause the client device 106 to display Figure 7 the first portion 502 in as expanding downward, thus revealing the top of the application interface 506 that is not visible in Figure 7 . Simultaneously and proportionally with the expansion of the first portion 502, the game system 212 can cause the client device 106 to display Figure 7 the second portion 504 in as contracting downward, so that the context sending interface disappears from view and returns to the Figure 5 action bar 516 in.

[0112] The process of generating the context sending menu

[0113] Although the described flowcharts may show operations as sequential processes, many operations can be performed in parallel or simultaneously. Additionally, the order of operations can be rearranged. When the operations of the process are completed, the process terminates. The process can correspond to a method, procedure, algorithm, etc. The operations of the method can be performed in whole or in part, can be performed in combination with some or all of the operations in other methods, and can be performed by any number of different systems (such as the systems described herein) or any part thereof (such as a processor included in any system).

[0114] Figure 8 A process 800 for generating a context send menu according to one embodiment is shown. At operation 802, the processor causes a display screen of the first client device 106 to display a first portion 502 of the display screen and a second portion 504 of the display screen in an inactive position. The processor can cause the first portion 502 to display an application interface associated with an application and cause the second portion 504 to display an action bar associated with the messaging system 100.

[0115] At operation 804, the processor receives a selection of a chat selectable item 602 in the application interface 506 from a first user of the first client device 106. The chat selectable item 602 is associated with a communication interface of the messaging system 100. At operation 806, in response to receiving the selection of the chat selectable item 602, the processor generates a media content item 604 based on the context of the first client device 106.

[0116] Then, at operation 808, the processor causes the first portion 502 and the second portion 504 of the display screen to be displayed in an active position. In one embodiment, to cause the first portion 502 and the second portion 504 to be displayed in the active position, the processor can cause the first portion 502 of the display screen to shrink. To cause the first portion 502 and the second portion 504 to be displayed in the active position, the processor can also cause the second portion 504 of the display screen to expand and include a preview 704 of the media content item 604 and user selectable items 706 associated with a second user.

[0117] At operation 810, the processor receives a selection of the user selectable items 706 associated with the second user from the first user, and at operation 812, the processor transmits the media content item 604 to a second client device 106 associated with the second user. In one embodiment, the processor also causes a communication interface for the communication session to be displayed at the second client device 106. In this example, the first user and the second user are users of the messaging system 100, and the communication session is between a plurality of client devices including the first client device 106 and the second client device 106. The processor can also cause the media content item 604 to be displayed in the communication interface at the second client device 106.

[0118] Machine architecture

[0119] Figure 9 is an illustrative representation of a machine 900, in which instructions 910 (e.g., software, program, application, applet, app, or other executable code) can be executed to cause the machine 900 to perform any one or more of the methods discussed herein. For example, the instructions 910 can cause the machine 900 to perform any one or more of the methods described herein. The instructions 910 transform the general, non-programmed machine 900 into a particular machine 900 programmed to perform the described and shown functions in the described manner. The machine 900 can operate as a stand-alone device or can be coupled (e.g., networked) to other machines. In a networked deployment, the machine 900 can operate in the capacity of a server machine or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine 900 can include, but is not limited to: server computers, client computers, personal computers (PCs), tablet computers, laptop computers, netbooks, set-top boxes (STBs), personal digital assistants (PDAs), entertainment media systems, cellular telephones, smart phones, mobile devices, wearable devices (e.g., smart watches), smart home devices (e.g., smart appliances), other smart devices, network devices, network routers, network switches, network bridges, or any machine capable of sequentially or otherwise executing the instructions 910 specifying the actions to be taken by the machine 900. Further, although only a single machine 900 is shown, the term "machine" shall also be taken to include a collection of machines that individually or jointly execute the instructions 910 to perform any one or more of the methods discussed herein. For example, the machine 900 can include any one of the client devices 106 or several server devices forming part of the messaging server system 104. In some examples, the machine 900 can also include both a client system and a server system, where certain operations of a particular method or algorithm are executed on the server side and where certain operations of a particular method or algorithm are executed on the client side.

[0120] Machine 900 may include a processor 904, a memory 906, and an input / output I / O component 638 that may be configured to communicate with each other via a bus 940. In an example, the processor 904 (e.g., a central processing unit (CPU), a reduced instruction set computing (RISC) processor, a complex instruction set computing (CISC) processor, a graphics processing unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a radio frequency integrated circuit (RFIC), another processor, or any suitable combination thereof) may include, for example, a processor 908 and a processor 912 that execute instructions 910. The term "processor" is intended to include a multi-core processor, which may include two or more independent processors (sometimes referred to as "cores") that may execute instructions simultaneously. Although Figure 9 multiple processors 904 are shown, machine 900 may include a single processor with a single core, a single processor with multiple cores (e.g., a multi-core processor), multiple processors with a single core, multiple processors with multiple cores, or any combination thereof.

[0121] Memory 906 includes a main memory 914, a static memory 916, and a storage unit 918, all of which may be accessed by processor 904 via bus 940. The main memory 906, the static memory 916, and the storage unit 918 store instructions 910 that implement any one or more of the methods or functions described herein. The instructions 910 may also reside, completely or partially, within the main memory 914, within the static memory 916, within the machine-readable medium 920 within the storage unit 918, within at least one of the processors 904 (e.g., within the cache memory of the processor), or within any suitable combination thereof during execution by the machine 900.

[0122] The I / O component 902 may include various components for receiving input, providing output, generating output, transmitting information, exchanging information, capturing measurement results, and so on. The specific I / O components 902 included in a particular machine will depend on the type of the machine. For example, a portable machine such as a mobile phone may include a touch input device or other such input mechanism, while a headless server machine may not include such a touch input device. It should be appreciated that the I / O component 902 may include Figure 9Many other components not shown. In various examples, the I / O component 902 may include a user output component 926 and a user input component 928. The user output component 926 may include visual components (e.g., displays such as plasma display panels (PDPs), light-emitting diode (LED) displays, liquid crystal displays (LCDs), projectors, or cathode ray tubes (CRTs)), audio components (e.g., speakers), tactile components (e.g., vibration motors, resistance mechanisms), other signal generators, etc. The user input component 928 may include alphanumeric input components (e.g., keyboards, touchscreens configured to receive alphanumeric input, optical keyboards, or other alphanumeric input components), point-based input components (e.g., mice, touchpads, trackballs, joysticks, motion sensors, or other pointing instruments), tactile input components (e.g., physical buttons, touchscreens that provide the location and / or force of a touch or touch gesture, or other tactile input components), audio input components (e.g., microphones), etc.

[0123] In another example, the I / O component 902 may include: a biometric component 930, a motion component 932, an environmental component 934, or a location component 936, as well as a variety of other components. For example, the biometric component 930 includes components for detecting expressions (e.g., hand expressions, facial expressions, voice expressions, body postures, or eye tracking), measuring biometric signals (e.g., blood pressure, heart rate, body temperature, sweating, or brain waves), identifying people (e.g., voice recognition, retina recognition, facial recognition, fingerprint recognition, or electroencephalogram-based recognition), etc. The motion component 932 includes acceleration sensor components (e.g., accelerometers), gravity sensor components, rotational sensor components (e.g., gyroscopes).

[0124] The environmental component 934 includes, for example: one or more camera devices (with still image / photo and video capabilities), lighting sensor components (e.g., photometers), temperature sensor components (e.g., one or more thermometers that detect ambient temperature), humidity sensor components, pressure sensor components (e.g., barometers), sound sensor components (e.g., one or more microphones that detect background noise), proximity sensor components (e.g., infrared sensors that detect nearby objects), gas sensors (e.g., gas detection sensors that detect the concentration of hazardous gases for safety or measure pollutants in the atmosphere), or other components that can provide an indication, measurement, or signal corresponding to the surrounding physical environment.

[0125] Regarding the imaging device, the client device 106 may have an imaging device system that includes, for example, a front imaging device on the front surface of the client device 106 and a rear imaging device on the rear surface of the client device 106. The front imaging device may be used, for example, to capture still images and videos of the user of the client device 106 (e.g., "selfies"), and then the still images and videos may be enhanced with the above-described enhancement data (e.g., filters). For example, the rear imaging device may be used to capture still images and videos in a more conventional imaging device mode, and these images are similarly enhanced with the enhancement data. In addition to the front imaging device and the rear imaging device, the client device 106 may further include a 360° imaging device for capturing 360° photos and videos.

[0126] Furthermore, the imaging device system of the client device 106 may include a dual rear imaging device (e.g., a main imaging device and a depth sensing imaging device), or even a triple, quadruple, or quintuple rear imaging device configuration on the front and rear sides of the client device 106. For example, these multi-imaging device systems may include a wide-angle imaging device, an ultra-wide-angle imaging device, a telephoto imaging device, a macro imaging device, and a depth sensor.

[0127] The location component 936 includes a positioning sensor component (e.g., a GPS receiver component), an altitude sensor component (e.g., an altimeter or barometer that detects air pressure, from which altitude can be obtained), an orientation sensor component (e.g., a magnetometer), etc.

[0128] Various techniques may be used to implement communication. The I / O component 902 also includes a communication component 938 that is operable to couple the machine 900 to the network 922 or the device 924 via a corresponding coupling or connection. For example, the communication component 938 may include a network interface component or other suitable device that interfaces with the network 922. In another example, the communication component 938 may include a wired communication component, a wireless communication component, a cellular communication component, a near field communication (NFC) component, components (e.g., low power consumption), components, and other communication components that provide communication via other modalities. The device 924 may be another machine or any of various peripheral devices (e.g., a peripheral device coupled via USB).

[0129] In addition, the communication component 938 can detect an identifier, or include components operable to detect an identifier. For example, the communication component 938 can include a radio frequency identification (RFID) tag reader component, an NFC smart tag detection component, an optical reader component (e.g., an optical sensor for detecting one-dimensional barcodes such as Universal Product Code (UPC) barcodes, multi-dimensional barcodes such as Quick Response (QR) codes, Aztec codes, Data Matrix, Dataglyph, MaxiCode, PDF417, Ultra Code, UCC RSS-2D barcodes, and other optical codes), or an acoustic detection component (e.g., a microphone for identifying tagged audio signals). In addition, various information can be obtained via the communication component 938, such as a location via Internet Protocol (IP) geolocation, a location via signal triangulation, a location via detecting an NFC beacon signal, etc., where the NFC beacon signal can indicate a specific location.

[0130] Various memories (e.g., main memory 914, static memory 916, and the memory of the processor 904) and the storage unit 918 can store one or more sets of instructions and data structures (e.g., software) implemented or used by any one or more of the methods or functions described herein. When executed by the processor 904, these instructions (e.g., instructions 910) cause various operations to implement the disclosed examples.

[0131] The instructions 910 can be sent or received via a network interface device (e.g., the network interface component included in the communication component 938), using a transmission medium and using any one of a plurality of well-known transmission protocols (e.g., Hypertext Transfer Protocol (HTTP)), over the network 922. Similarly, the instructions 910 can be sent or received using a transmission medium via a coupling (e.g., a peer-to-peer coupling) to the device 924.

[0132] Regarding the embodiments including the above embodiments, the following technical solutions are also disclosed:

[0133] Solution 1. A method, comprising:

[0134] causing, by a processor, a display screen of a first client device to display a first portion and a second portion of the display screen at an inactive position by:

[0135] causing the first portion to display an application interface associated with an application, and

[0136] causing the second portion to display an action bar associated with a messaging system;

[0137] Receiving a selection of a chat option in the application interface from a first user of the first client device, wherein the chat option is associated with a communication interface of the messaging system;

[0138] In response to receiving the selection of the chat option, generating a media content item based on the context of the first client device;

[0139] Causing a first portion and a second portion of the display screen to be shown in an active position by:

[0140] Shrinking the first portion of the display screen, and

[0141] Expanding the second portion of the display screen to include a preview of the media content item and options selectable associated with a second user;

[0142] Receiving a selection of the options selectable associated with the second user from the first user; and

[0143] Transmitting the media content item to a second client device associated with the second user.

[0144] Solution 2. The method according to Solution 1, further comprising:

[0145] Causing the communication interface for the communication session to be displayed at the second client device.

[0146] Solution 3. The method according to Solution 2,

[0147] wherein the first user and the second user are users of the messaging system, and wherein the communication session is carried out among a plurality of client devices including the first client device and the second client device.

[0148] Solution 4. The method according to Solution 3, further comprising:

[0149] Causing the media content item to be displayed in the communication interface at the second client device.

[0150] Solution 5. The method according to Solution 1, wherein the context of the first client device is based on information including: user information, activity information about the application, selection information about the application, game score information about the application, ranking information about the application, a user list associated with the first user on the application, or a user list associated with the first user on the messaging system.

[0151] Solution 6. The method according to Solution 1, further comprising:

[0152] Cause an application icon to be displayed on the display screen, the icon being associated with the application;

[0153] Receive a selection of the application icon, wherein, in response to the selection of the application icon, the processor causes the display screen of the first client device to display the application interface.

[0154] Solution 7. The method according to Solution 1, wherein the first portion of the display screen in the unactivated position is larger in size than the second portion of the display screen in the unactivated position.

[0155] Solution 8. The method according to Solution 1, wherein the first portion of the display screen is the top portion of the display screen, and the second portion of the display screen is the bottom portion of the display screen.

[0156] Solution 9. The method according to Solution 8, wherein causing the first and second portions of the display screen to be in the activated position further includes:

[0157] Cause the first portion of the display screen to contract upward by a predetermined distance, wherein the application interface displayed in the first portion is pushed upward, and

[0158] Cause the second portion of the display screen to expand upward by the predetermined distance.

[0159] Solution 10. The method according to Solution 1, further including:

[0160] In response to the media content item being transmitted, cause the first and second portions of the display screen to be displayed by the first client device in the unactivated position.

[0161] Solution 11. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform operations, the operations including:

[0162] Cause a first portion and a second portion of a display screen of a first client device to be displayed in an unactivated position by the following:

[0163] Cause the first portion to display an application interface associated with an application, and

[0164] Cause the second portion to display an action bar associated with a messaging system;

[0165] Receive a selection of a chat selectable item in the application interface from a first user of the first client device, wherein the chat selectable item is associated with a communication interface of the messaging system;

[0166] In response to receiving a selection of the chat option, generate a media content item based on the context of the first client device;

[0167] Cause a first portion and a second portion of the display screen to be displayed in an active position by:

[0168] Shrink the first portion of the display screen, and

[0169] Expand the second portion of the display screen to include a preview of the media content item and selectable options associated with a second user;

[0170] Receive a selection of the selectable options associated with the second user from the first user; and

[0171] Transmit the media content item to a second client device associated with the second user.

[0172] Scheme 12. The non-transitory computer-readable storage medium according to Scheme 11, wherein the operations further include:

[0173] Cause the communication interface for the communication session to be displayed at the second client device.

[0174] Scheme 13. The non-transitory computer-readable storage medium according to Scheme 12,

[0175] wherein the first user and the second user are users of the messaging system, and wherein the communication session is conducted among a plurality of client devices including the first client device and the second client device.

[0176] Scheme 14. The non-transitory computer-readable storage medium according to Scheme 13, wherein the operations further include:

[0177] Cause the media content item to be displayed in the communication interface at the second client device.

[0178] Scheme 15. The non-transitory computer-readable storage medium according to Scheme 11, wherein the context of the first client device is based on information including: user information, activity information about the application, selection information about the application, game score information about the application, ranking information about the application, a user list associated with the first user on the application, or a user list associated with the first user on the messaging system.

[0179] Scheme 16. The non-transitory computer-readable storage medium according to Scheme 11, wherein the operations further include:

[0180] Cause an application icon to be displayed on the display screen, where the icon is associated with the application;

[0181] Receive a selection of the application icon, where, in response to the selection of the application icon, the processor causes the display screen of the first client device to display the application interface.

[0182] Solution 17. The non-transitory computer-readable storage medium according to Solution 11, wherein the first portion of the display screen in the unactivated position is larger in size than the second portion of the display screen in the unactivated position.

[0183] Solution 18. The non-transitory computer-readable storage medium according to Solution 11, wherein the first portion of the display screen is the top portion of the display screen, and the second portion of the display screen is the bottom portion of the display screen.

[0184] Solution 19. The non-transitory computer-readable storage medium according to Solution 18, wherein causing the first portion and the second portion of the display screen to be in the activated position further includes:

[0185] Cause the first portion of the display screen to contract upward by a predetermined distance, wherein the application interface displayed in the first portion is pushed upward, and

[0186] Cause the second portion of the display screen to expand upward by the predetermined distance.

[0187] Solution 20. The non-transitory computer-readable storage medium according to Solution 11, wherein the operation further includes:

[0188] In response to the media content item being transmitted, cause the first portion and the second portion of the display screen to be displayed by the first client device in the unactivated position.

[0189] Solution 21. A system, comprising:

[0190] A processor; and

[0191] A memory having instructions stored thereon, the instructions when executed by the processor cause the system to perform operations, the operations including:

[0192] Cause the first portion and the second portion of the display screen of the first client device to be displayed in the unactivated position by the following:

[0193] Cause the first portion to display an application interface associated with an application, and

[0194] Cause the second portion to display an action bar associated with a messaging system;

[0195] Receive a selection of a chat option in the application interface from a first user of the first client device, where the chat option is associated with a communication interface of the messaging system;

[0196] In response to receiving the selection of the chat option, generate a media content item based on the context of the first client device;

[0197] Cause a first portion and a second portion of the display screen to be displayed in an active position by:

[0198] Cause the first portion of the display screen to contract, and

[0199] Cause the second portion of the display screen to expand and include a preview of the media content item and selectable options associated with a second user;

[0200] Receive a selection of the selectable options associated with the second user from the first user; and

[0201] Transmit the media content item to a second client device associated with the second user.

[0202] Software Architecture

[0203] Figure 10 is a block diagram 1000 showing a software architecture 1004 that can be installed on any one or more of the devices described herein. The software architecture 1004 is supported by hardware such as a machine 1002 including a processor 1020, a memory 1026, and I / O components 1038. In this example, the software architecture 1004 can be conceptualized as a stack of layers, where each layer provides a specific function. The software architecture 1004 includes layers such as an operating system 1012, libraries 1010, frameworks 1008, and applications 1006. In operation, the application 1006 invokes API calls 1050 through the software stack and receives messages 1052 in response to the API calls 1050.

[0204] The operating system 1012 manages hardware resources and provides common services. The operating system 1012 includes, for example, a kernel 1014, services 1016, and drivers 1022. The kernel 1014 acts as an abstraction layer between the hardware layer and other software layers. For example, the kernel 1014 provides memory management, processor management (e.g., scheduling), component management, networking, and security settings, among other functions. The services 1016 can provide other common services for other software layers. The drivers 1022 are responsible for controlling or interfacing with the underlying hardware. For example, the drivers 1022 can include a display driver, a camera device driver, or Low-power drivers, flash drives, serial communication drivers (e.g., USB drives), drivers, audio drivers, power management drivers, etc.

[0205] Library 1010 provides the common low-level infrastructure used by application 1006. Library 1010 may include system library 1018 (e.g., C standard library), and the system library provides functions such as memory allocation functions, string manipulation functions, mathematical functions, etc. In addition, library 1010 may include API library 1024, such as a media library (e.g., a library for supporting the presentation and manipulation of various media formats, such as Moving Picture Experts Group 4 (MPEG4), High Efficiency Video Coding (H.264 or AVC), Moving Picture Experts Group Layer 3 (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR) audio codec, Joint Photographic Experts Group (JPEG or JPG), or Portable Network Graphics (PNG)), a graphics library (e.g., the OpenGL framework for presenting graphics content in two-dimensional (2D) and three-dimensional (3D) on a display), a database library (e.g., SQLite that provides various relational database functions), a web library (e.g., WebKit that provides web browsing functions), etc. Library 1010 may also include various other libraries 1028 to provide many other APIs to application 1006.

[0206] Framework 1008 provides the common high-level infrastructure used by application 1006. For example, framework 1008 provides various graphical user interface (GUI) functions, advanced resource management, and advanced location services. Framework 1008 may provide a wide range of other APIs that can be used by application 1006, and some of these APIs may be specific to a particular operating system or platform.

[0207] In an example, application 1006 may include a home application 1036, a contacts application 1030, a browser application 1032, a book reader application 1034, a location application 1042, a media application 1044, a messaging application 1046, a game application 1048, and various other applications such as third-party application 1040. Application 1006 is a program that executes the functions defined in the program. One or more of the applications 1006 can be created using various programming languages, such as object-oriented programming languages (e.g., Objective-C, Java, or C++) or procedural programming languages (e.g., C language or assembly language). In a specific example, the third-party application 1040 (e.g., an application developed using the ANDROID TM or IOS TM software development kit (SDK)) can be an application on, such as IOSTM 、ANDROID TM 、 Mobile software running on the Android mobile operating system or another mobile operating system. In this example, the third-party application 1040 can trigger an API call 1050 provided by the operating system 1012 to facilitate the functions described herein.

[0208] Glossary

[0209] "Carrier signal" means any non - tangible medium capable of storing, encoding, or carrying instructions executable by a machine and includes digital or analog communication signals or other non - tangible media to facilitate the communication of such instructions. Instructions can be sent or received over a network using a transmission medium via a network interface device.

[0210] "Client device" means any machine that interfaces with a communication network to obtain resources from one or more server systems or other client devices. A client device can be, but is not limited to, a mobile phone, desktop computer, laptop computer, portable digital assistant (PDA), smartphone, tablet computer, ultrabook, netbook, laptop, multiprocessor system, microprocessor - based or programmable consumer electronics, game console, set - top box, or any other communication device that a user can use to access a network.

[0211] "Communication network" means one or more portions of a network, which can be an ad - hoc network, intranet, extranet, virtual private network (VPN), local area network (LAN), wireless LAN (WLAN), wide area network (WAN), wireless WAN (WWAN), metropolitan area network (MAN), the Internet, a portion of the Internet, a portion of the public switched telephone network (PSTN), plain old telephone service (POTS) network, cellular telephone network, wireless network, A network, another type of network, or a combination of two or more such networks. For example, a network or a part of a network may include a wireless network or a cellular network, and the coupling may be a Code Division Multiple Access (CDMA) connection, a Global System for Mobile Communications (GSM) connection, or other types of cellular or wireless couplings. In this example, the coupling may implement any of various types of data transmission technologies, such as Single-Carrier Radio Transmission Technology (1xRTT), Evolution-Data Optimized (EVDO) technology, General Packet Radio Service (GPRS) technology, GSM Enhanced Data Rates for GSM Evolution (EDGE) technology, the Third Generation Partnership Project (3GPP) including 3G, Fourth Generation Wireless (4G) networks, Universal Mobile Telecommunications System (UMTS), High-Speed Packet Access (HSPA), Worldwide Interoperability for Microwave Access (WiMAX), Long-Term Evolution (LTE) standards, other data transmission technologies defined by various standards-setting organizations, other long-distance protocols, or other data transmission technologies.

[0212] "Component" refers to a device, physical entity, or logic having the following boundaries: the boundaries are defined by functions or subroutine calls, branch points, APIs, or other techniques provided for partitioning or modularizing a particular processing or control function. A component can be combined with other components via its interfaces to perform a machine process. A component can be an encapsulated functional hardware unit designed to be used with other components and can be part of a program that typically performs a particular function among related functions. A component can constitute a software component (e.g., code implemented on a machine-readable medium) or a hardware component. A "hardware component" is a tangible unit capable of performing certain operations and can be configured or arranged in some physical manner. In various example embodiments, one or more computer systems (e.g., a stand-alone computer system, a client computer system, or a server computer system) or one or more hardware components of a computer system (e.g., a processor or a group of processors) can be configured by software (e.g., an application or a part of an application) to operate to perform certain operations as described herein as a hardware component. A hardware component can also be implemented mechanically, electronically, or in any suitable combination thereof. For example, a hardware component can include dedicated circuitry or logic that is permanently configured to perform certain operations. A hardware component can be a dedicated processor, such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). A hardware component can also include programmable logic or circuitry that is temporarily configured by software to perform certain operations. For example, a hardware component can include software executed by a general-purpose processor or other programmable processor. Once configured by such software, the hardware component becomes a particular machine (or a particular component of a machine) uniquely customized to perform the configured function and is no longer a general-purpose processor. It will be understood that the decision to implement a hardware component mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) can be driven by cost and time considerations. Accordingly, the phrase "hardware component" (or "hardware-implemented component") should be understood to include a tangible entity, i.e., an entity that is physically constructed, permanently configured (e.g., hardwired), or temporarily configured (e.g., programmed) to operate in some manner or to perform certain operations described herein. Considering embodiments where a hardware component is temporarily configured (e.g., programmed), each of the hardware components need not be configured or instantiated at any given moment. For example, in the case where a hardware component includes a general-purpose processor that is configured by software to become a dedicated processor, the general-purpose processor can be configured into different dedicated processors (e.g., including different hardware components) at different times. Thus, software configures one or more particular processors to constitute, for example, a particular hardware component at one moment and different hardware components at different moments. A hardware component can provide information to other hardware components and receive information from other hardware components. Thus, the described hardware components can be considered communicatively coupled.In the presence of multiple hardware components, communication can be achieved by transmitting signals between or among two or more hardware components (e.g., via appropriate circuitry and buses). In embodiments where multiple hardware components are configured or instantiated at different times, communication between such hardware components can be achieved, for example, by storing information in a memory structure accessible to the multiple hardware components and retrieving the information from the memory structure. For example, one hardware component can perform an operation and store the output of the operation in a memory device communicatively coupled thereto. Then, other hardware components can access the memory device at a subsequent time to retrieve the stored output and process it. Hardware components can also initiate communication with input or output devices and can operate on resources (e.g., collection of information). Various operations of the example methods described herein can be performed at least in part by one or more processors, which are temporarily configured (e.g., via software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors can constitute processor-implemented components that operate to perform one or more of the operations or functions described herein. As used herein, a "processor-implemented component" refers to a hardware component implemented using one or more processors. Similarly, the methods described herein can be implemented at least in part by a processor, where a particular one or more processors are examples of hardware. For example, at least some of the operations of the method can be performed by one or more processors 1004 or processor-implemented components. Additionally, one or more processors can also operate to support the execution of relevant operations in a "cloud computing" environment or as "software as a service" (SaaS) operations. For example, at least some of the operations can be performed by a group of computers (as examples of machines including processors), where the operations are accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., APIs). Execution of certain operations can be distributed among processors, which can reside not only within a single machine but also be deployed across several machines. In some example embodiments, the processor or processor-implemented components can be located in a single geographical location (e.g., within a home environment, an office environment, or a server farm). In other example embodiments, the processor or processor-implemented components can be distributed across several geographical locations.

[0213] "Computer-readable storage medium" refers to both machine storage media and transmission media. Thus, the term includes both storage devices / media and carrier / modulated data signals. The terms "machine-readable medium", "computer-readable medium", and "device-readable medium" mean the same thing and can be used interchangeably in this disclosure.

[0214] "Ephemeral message" refers to a message that is accessible within a time-limited duration. The ephemeral message can be text, image, video, etc. The access time of the ephemeral message can be set by the message sender. Alternatively, the access time can be a default setting or a setting specified by the recipient. Regardless of the setting technique, the message is temporary.

[0215] "Machine storage medium" refers to a single or multiple storage devices and media (e.g., centralized or distributed databases, and associated caches and servers) that store executable instructions, routines, and data. Thus, the term should be considered to include, but not be limited to, solid-state memories, as well as optical and magnetic media, including memories internal or external to a processor. Specific examples of machine storage media, computer storage media, and device storage media include: non-volatile memories, including, for example, semiconductor memory devices such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGA, and flash memory devices; magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The terms "machine storage medium", "device storage medium", and "computer storage medium" mean the same thing and can be used interchangeably in this disclosure. The terms "machine storage medium", "computer storage medium", and "device storage medium" expressly exclude carrier waves, modulated data signals, and other such media, at least some of which are covered by the term "signal medium".

[0216] "Non-transitory computer-readable storage medium" refers to a tangible medium that can store, encode, or carry instructions executable by a machine.

[0217] "Signal medium" refers to any intangible medium that can store, encode, or carry instructions executable by a machine, and "signal medium" includes digital or analog communication signals or other intangible media for facilitating the transmission of software or data. The term "signal medium" should be considered to include any form of modulated data signal, carrier wave, etc. The term "modulated data signal" refers to a signal whose one or more characteristics are set or changed in such a way that information is encoded in the signal. The terms "transmission medium" and "signal medium" mean the same thing and can be used interchangeably in this disclosure.

Claims

1. A method, comprising: causing a display screen of a first client device associated with a first user to display a first portion of the display screen and a second portion of the display screen at an inactive position by a processor: causing the first portion to display an application interface associated with an application, and causing the second portion to display an action bar associated with a messaging system; in response to receiving a selection of a chat selectable item included in the application interface, generating a media content item based on the context of the first client device, wherein the media content item includes information associated with the first user in the application; causing the first portion and the second portion of the display screen to be displayed at an active position by: causing the first portion of the display screen to shrink, and causing the second portion of the display screen to expand and include a preview of the media content item and selectable items associated with a second user, wherein the selectable items include a name or an avatar associated with the second user.

2. The method according to claim 1, further comprising: receiving a selection of the selectable items associated with the second user from the first user; transmitting the media content item to a second client device associated with the second user; and causing a communication interface of the messaging system for a communication session to be displayed at the second client device.

3. The method according to claim 2, wherein the first user and the second user are users of the messaging system, and wherein the communication session is conducted between a plurality of client devices including the first client device and the second client device.

4. The method according to claim 3, further comprising: causing the media content item to be displayed in the communication interface at the second client device.

5. The method according to claim 1, wherein the context of the first client device is based on information including: user information, activity information about the application, selection information about the application, game score information about the application, ranking information about the application, a user list associated with the first user on the application, or a user list associated with the first user on the messaging system.

6. The method according to claim 1, further comprising: causing an application icon associated with the application to be displayed by the display screen; receiving a selection of the application icon, wherein the processor causes the display screen of the first client device to display the application interface in response to the selection of the application icon.

7. The method according to claim 1, wherein the first portion of the display screen at the inactive position is larger in size than the second portion of the display screen at the inactive position.

8. The method according to claim 1, wherein the first portion of the display screen is the top portion of the display screen, and the second portion of the display screen is the bottom portion of the display screen.

9. The method according to claim 8, wherein causing the first portion and the second portion of the display screen to be at the active position further includes: Shrink a first portion of the display screen upward by a predetermined distance, wherein the application interface displayed in the first portion is pushed upward, and Expand a second portion of the display screen upward by the predetermined distance.

10. The method according to claim 1, further comprising: In response to the media content item being transmitted, causing the first portion and the second portion of the display screen to be displayed by the first client device at the inactive position.

11. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform operations, the operations comprising: Causing a first portion of the display screen of a first client device associated with a first user to be displayed at an inactive position and a second portion of the display screen by: Causing the first portion to display an application interface associated with an application, and Causing the second portion to display an action bar associated with a messaging system; In response to receiving a selection of a chat selectable item in the application interface from a first user of the first client device, generating a media content item based on the context of the first client device, wherein the media content item includes information associated with the first user in the application; Causing the first portion and the second portion of the display screen to be displayed at an active position by: Shrinking the first portion of the display screen, and Expanding the second portion of the display screen to include a preview of the media content item and selectable items associated with a second user, wherein the selectable items include a name or avatar associated with the second user.

12. The non-transitory computer-readable storage medium according to claim 11, wherein, The operations further include: Receiving a selection of the selectable item associated with the second user from the first user; Transmitting the media content item to a second client device associated with the second user; and Causing a communication interface of the messaging system for the communication session to be displayed at the second client device.

13. The non-transitory computer-readable storage medium according to claim 12, wherein, The first user and the second user are users of the messaging system, and wherein the communication session is conducted between a plurality of client devices including the first client device and the second client device.

14. The non-transitory computer-readable storage medium according to claim 13, wherein, The operations further include: Causing the media content item to be displayed in the communication interface at the second client device.

15. The non-transitory computer-readable storage medium according to claim 11, wherein, The context of the first client device is based on information including: user information, activity information about the application, selection information about the application, game score information about the application, ranking information about the application, a user list associated with the first user on the application, or a user list associated with the first user on the messaging system.

16. The non-transitory computer-readable storage medium according to claim 11, wherein, the operation further includes: causing an application icon associated with the application to be displayed on the display screen; receiving a selection of the application icon, wherein in response to the selection of the application icon, the processor causes the display screen of the first client device to display the application interface.

17. The non-transitory computer-readable storage medium according to claim 11, wherein, the first portion of the display screen in the unactivated position is larger in size than the second portion of the display screen in the unactivated position.

18. The non-transitory computer-readable storage medium according to claim 11, wherein, the first portion of the display screen is the top portion of the display screen, and the second portion of the display screen is the bottom portion of the display screen.

19. The non-transitory computer-readable storage medium according to claim 18, wherein, causing the first and second portions of the display screen to be in the activated position further includes: causing the first portion of the display screen to contract upward by a predetermined distance, wherein the application interface displayed in the first portion is pushed upward, and causing the second portion of the display screen to expand upward by the predetermined distance.

20. The non-transitory computer-readable storage medium according to claim 11, wherein, the operation further includes: in response to the media content item being transmitted, causing the first and second portions of the display screen to be displayed by the first client device in the unactivated position.

21. A system, comprising: a processor; and a memory having instructions stored thereon, which when executed by the processor cause the system to perform operations, the operations including: causing a first portion and a second portion of a display screen of a first client device associated with a first user to be displayed in an unactivated position by: causing the first portion to display an application interface associated with an application, and causing the second portion to display an action bar associated with a messaging system; in response to receiving a selection of a chat selectable item in the application interface from a first user of the first client device, generating a media content item based on the context of the first client device, wherein the media content item includes information associated with the first user in the application; causing the first portion and the second portion of the display screen to be displayed in an activated position by: causing the first portion of the display screen to contract, and causing the second portion of the display screen to expand and include a preview of the media content item and selectable items associated with a second user, wherein the selectable items include a name or avatar associated with the second user.

Citation Information

Patent Citations

  • Suggested items for use with embedded applications in chat conversations

    CN110709869A

  • Shared content presentation with integrated messaging

    US20170093769A1