Customizing influencer streams for follower audiences

Abstract

A method and system for generating a video stream for followers of an influencer during a session includes capturing a video image of the influencer's environment, the environment including the influencer viewing an online content channel, detecting surface parameters within the environment and processing the surface parameters to identify three-dimensional features associated with the surface parameters, identifying followers viewing the influencer, and generating an overlay image for at least one of the surface parameters. The overlay image is configured to dynamically contour to the identified three-dimensional features during the session. The overlay image is selected based on a profile of the follower such that the video stream received by the follower when viewing the influencer is customized based on the follower's profile.

Description

[Technical Field]

[0001] FIELD OF THE DISCLOSURE The present disclosure relates generally to video streams, and more particularly to methods and systems for generating customized video streams for followers of an influencer during a session. [Background technology]

[0002] 2. Description of Related Art Digital marketing has undergone many changes over the years, along with the rise of social media. In particular, influencer marketing, which involves endorsements and product placements by influencers (e.g., people or organizations considered to have expert-level knowledge or social influence in their field), has grown in popularity over the years. To this end, influencers have sought ways to develop sophisticated operations that enhance consumer engagement, which can help generate significant revenue for influencers and their sponsors.

[0003] A growing trend in digital marketing is the growth of influencer marketing, in which companies partner with influencers to endorse their products, services, brands, etc. Influencers are typically compensated for endorsing products, services, brands, etc., with the amount of compensation based on several factors. These factors may include the influencer's total number of followers, the amount of engagement they receive from their followers through their social media posts, the number of social media posts, and the frequency of their social media posts. Unfortunately, many of an influencer's followers are not interested in the products and services they endorse. For example, viewers who tune into an influencer's social media channel may be interested in fitness and living a healthy lifestyle. While tuned in, viewers may stop tuned in to the influencer's social media channel if the influencer recommends products that the viewers are not interested in (e.g., fast food, junk food, etc.). Influencers may run the risk of their audience churn from their channel because they dislike the product the influencer is promoting, which could result in viewers or other followers unsubscribing from the influencer's channel, thereby reducing the influencer's revenue.

[0004] It is in these situations that embodiments of the present disclosure arise. Summary of the Invention

[0005] Embodiments of the present disclosure include devices, methods, and systems related to generating customized video streams for followers of an influencer. In some embodiments, followers can connect to the influencer's channel to view content created by the influencer. In one embodiment, the influencer can create content for their channel while using multiple cameras to record the influencer and their environment. An influencer channel can include various types of content. In one example, the content can be a recording (e.g., a live or broadcast) showing the influencer watching and reacting to a player's content channel. In some embodiments, various surfaces of real-world objects in the influencer's environment can be identified and designated as markers. The markers can be used as target locations to generate overlay images (e.g., advertisements, sponsorships, logos, etc.) on the marker's surface area. In some embodiments, the overlay images can be selected based on the follower's profile, resulting in a customized video stream for each follower.

[0006] In one embodiment, a method for generating a video stream for followers of an influencer during a session is disclosed. In this embodiment, the method includes capturing video images of the influencer's environment, the environment including the influencer watching an online content channel. The method includes detecting surface parameters within the environment and processing the surface parameters to identify three-dimensional features associated with the surface parameters. The method includes identifying followers watching the influencer. The method includes generating an overlay image for at least one of the surface parameters, the overlay image configured to dynamically contour to the identified three-dimensional features during the session. The overlay image is selected based on a profile of the follower such that the video stream received by the follower when watching the influencer is customized based on the follower's profile.

[0007] In another embodiment, a method for generating a video stream for followers of an influencer during a session is disclosed. The method includes capturing video images of an environment of the influencer, the environment including the influencer viewing an online content channel. The method includes detecting surface parameters within the environment and processing the surface parameters to identify three-dimensional features associated with the surface parameters. The method includes identifying a plurality of followers viewing the influencer. The method includes generating an overlay image for at least one of the surface parameters. The overlay is selected based on information identified in profiles of the plurality of followers. The video stream received by the followers is customized during the session.

[0008] Other aspects and advantages of the present disclosure will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the disclosure. [Brief explanation of the drawings]

[0009] The present disclosure can be better understood by referring to the following description in conjunction with the accompanying drawings.

[0010] [Figure 1A] 1 is an embodiment showing an influencer and multiple spectators connected to a content channel of a player, and multiple followers connected to the influencer channel, according to an embodiment of the present disclosure.

[0011] [Figure 1B] 1 is an embodiment illustrating multiple followers connected to an influencer channel to view a video recording of the influencer watching and commenting on a player's gameplay, according to an embodiment of the present disclosure.

[0012] [Figure 2] 1 illustrates an embodiment of an influencer's environment 104 and multiple surfaces that have been identified and designated as markers, according to an embodiment of the present disclosure.

[0013] [Figure 3A] 10 is an embodiment illustrating a follower interface showing an influencer's environment after generating an overlay image for surface parameters associated with marker locations, according to an embodiment of the present disclosure.

[0014] [Figure 3B-1] 10A-10C illustrate embodiments of overlay images generated on an influencer's shirt with the influencer's arms in different positions, according to embodiments of the present disclosure. [Figure 3B-2] 10A-10C illustrate embodiments of overlay images generated on an influencer's shirt with the influencer's arms in different positions, according to embodiments of the present disclosure. [Figure 3C-1] 10A-10C illustrate embodiments of overlay images generated on an influencer's shirt with the influencer's arms in different positions, according to embodiments of the present disclosure. [Figure 3C-2]10A-10C illustrate embodiments of overlay images generated on an influencer's shirt with the influencer's arms in different positions, according to embodiments of the present disclosure. [Figure 3D-1] 10A-10C illustrate embodiments of overlay images generated on an influencer's shirt with the influencer's arms in different positions, according to embodiments of the present disclosure. [Figure 3D-2] 10A-10C illustrate embodiments of overlay images generated on an influencer's shirt with the influencer's arms in different positions, according to embodiments of the present disclosure.

[0015] [Figure 4A] 1 illustrates an embodiment of a follower interface that provides a view from the follower's perspective when the follower is connected to an influencer channel, according to an embodiment of the present disclosure.

[0016] [Figure 4B] 1 illustrates an embodiment of a follower interface that provides a view from the follower's perspective when the follower is connected to an influencer, according to an embodiment of the present disclosure.

[0017] [Figure 4C] 1 illustrates an embodiment of a follower interface that provides a view from the follower's perspective when the follower is connected to an influencer channel, according to an embodiment of the present disclosure.

[0018] [Figure 5] 1 illustrates an embodiment of a method for generating a video stream for followers of an influencer during a session by generating an overlay image for at least one surface parameter in the influencer's environment, according to an embodiment of the present disclosure.

[0019] [Figure 6] 6 illustrates components of an exemplary device 600 that can be used to implement aspects of various embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0020] The following embodiments of the present disclosure provide devices, methods, and systems for generating a customized video stream for followers of an influencer during a session. Specifically, the present disclosure provides followers of an influencer with a customized video stream that includes multiple overlay images (e.g., advertisements, sponsorships, logos, etc.) generated on various surfaces in the influencer's environment. The overlay images can be selected based on the follower's interests, which can enhance follower engagement and help generate more revenue for the influencer.

[0021] In one embodiment, a method is disclosed that enables generating a customized video stream for followers of an influencer. The method includes capturing a video image of the influencer's environment and detecting surface parameters in the influencer's environment. In one embodiment, the method includes processing the surface parameters to identify three-dimensional features associated with the surface parameters. In yet another embodiment, the method further includes generating an overlay image for at least one of the surface parameters detected in the influencer's environment. However, it will be apparent to those skilled in the art that the present disclosure may be practiced without some or all of the specific details currently described. In other instances, well-known process operations have not been described in detail in order to not unnecessarily obscure the present disclosure.

[0022] According to one embodiment, multiple followers can connect to an influencer's channel over a network to view content (e.g., video, audio, photos, etc.) created by the influencer. In one example, an influencer can create content that includes a recording of the influencer watching a player's content channel that shows players competing in a live gaming event (e.g., an esports event). The influencer can provide a play-by-play commentary of what is happening at the live gaming event while watching the players competing in the event. In response, when a follower connects to view the content of the influencer's channel, the follower may have a view of the live gaming event, a view of the influencer watching the live gaming event, and an audio feed of the influencer's play-by-play commentary of the live gaming event. In some embodiments, multiple spectators may connect to a player's content channel to view the content created by the player. As a result, in some embodiments, influencers and spectators can view a player's content by connecting directly to the player's content channel, while followers can view a player's content by connecting to the influencer's channel.

[0023] According to another embodiment, when a follower connects to view content on an influencer's channel, the content being viewed may include content, such as video content, that provides a view into the influencer's environment. In some embodiments, the influencer's environment (e.g., a bedroom, a recording studio, an internet cafe, a public place, etc.) may include various objects and audiovisual equipment that the influencer may use to record content for their channel. According to one embodiment, markers may be physically affixed to or embedded in real-world objects. For example, markers may be physically affixed to clothing worn by the influencer and / or to various real-world objects in the influencer's environment (e.g., bookshelves, picture frames, cabinets, etc.). In some embodiments, the markers need not be physically affixed to real-world objects. Instead, the markers may be virtual markers with visually distinguishable points, such as shirt buttons, shirt sleeves, bookcase edges, picture frame corners, etc. In some embodiments, the surface area on which the markers are located has multiple surface parameters associated with the surface area. These parameters may include three-dimensional surface contours, wrinkles, undulations, creases, shading, occlusion, texture, curvature, shadowing, etc.

[0024] According to another embodiment, an overlay image can be generated at a location associated with a surface region of an object. The overlay image can include various images, such as sponsorship logos, advertisements, symbols identifying a company's products or services, etc. In some embodiments, the specific overlay image generated on the surface region of the object can be selected based on the follower's interests and preferences. As described above, the surface region of an object may include multiple surface parameters, such as three-dimensional surface contours, wrinkles, undulations, folds, shading, occlusion, texture, curvature, and shadowing. When an overlay image is generated on the surface of an object, the overlay image can appear to be integrated into the surface region of the object (e.g., a shirt, a bookshelf, a closet, etc.). In other words, the overlay image can also include surface parameters related to the surface of the object. For example, an influencer's shirt includes several wrinkles, undulations, and shading. When an overlay image of a "Batman" logo is superimposed on the surface region of the shirt, the Batman logo may also include similar wrinkles, undulations, and shading on its surface.

[0025] With the above summary in mind, the following provides some illustrative figures to facilitate understanding of example embodiments.

[0026] FIG. 1A illustrates an embodiment showing an influencer 102 and multiple spectators 120 connected to a content channel 108 of a player 114, as well as multiple followers 110 connected to an influencer channel 106. As illustrated, FIG. 1A shows multiple followers 110a-110n connected to the influencer channel 106 to view the influencer's 102 content. In one embodiment, the content created by the influencer 102 provides a view into the influencer's 102's environment captured by a camera 122 having a camera POV 124. For example, the influencer 102 may create content including a recording of the influencer 102 candidly discussing a recently released new PlayStation video game. The camera 122 is used to record the influencer 102 in the influencer's environment (e.g., a bedroom) while the influencer discusses the new video game. In another embodiment, the influencer 102 is connected to the content channel 108 so that the influencer 102 can view content created by the player 114. In some embodiments, the content channel 108 includes footage of the player 114 captured by a camera 116 having a camera POV 125. In yet another embodiment, multiple spectators 120 are connected to the content channel 108 to view the content created by the player 114.

[0027] In some embodiments, a plurality of followers 110 are connected to the influencer channel 106 to view content provided by the influencer 102. In one embodiment, the plurality of followers 110 are people who follow or subscribe to the influencer channel 106 because they are interested in the content that the influencer 102 creates and makes available via the influencer channel 106. In one example, the influencer 102 may be a famous pop singer with a large fan base. Each week, the pop singer creates new video content and releases it on the influencer channel 106, and the followers 110 are notified that the new content is available to view. In some embodiments, the influencer channel 106 may include content available for live viewing and / or content that is rebroadcast and can be viewed at any time.

[0028] In some embodiments, the influencer 102 creates various content and makes it available for viewing on the influencer channel 106. The influencer 102 may be an individual with a significant following on video and / or social media platforms (e.g., Sony, YouTube®, Instagram, Twitter, Facebook, etc.). The influencer 102 may create trends and provide their followers 110 with their opinions on various services, products, brands, etc. to help companies market their services and products. In some embodiments, the influencer 102 may be a professional gamer, performing artist, visual artist, athlete, industry expert, or other respected individual with expertise in a particular niche or industry. In some embodiments, the content created by the influencer 102 may be captured by a camera 122. For example, the influencer 102 may be an individual familiar with the video game industry and known for reviewing and commenting on horror video games. The camera 122 may be used to assist the influencer 122 in creating content for the influencer channel 106. For example, the camera 122 may be used to record the influencer 102 previewing and reviewing a new horror video game that has just been released. In some embodiments, the influencer 102 may edit the recorded video content to enhance the content (e.g., adding background music, sound effects, graphics, images, etc.) and / or customize it to make it more appealing to followers 110. In one embodiment, the content created by the influencer 102 may be a video recording, an audio recording, an image, or any combination thereof.

[0029] In some embodiments, an influencer 102 can connect to a content channel 108 to view content created by a player 114. The content channel 108 of a player 114 can include various types of content created by the player 114, such as video recordings, audio recordings, images, or any combination thereof. In some embodiments, a camera 116 is used to record the player 114 performing various activities, such as playing a video game or recommending a product. The recorded video can be used as content and viewed on the content channel 108. In some embodiments, multiple spectators 120a-120n can connect to the content channel 108 to view the content created by the player 114. As shown in FIG. 1A , in one embodiment, the influencer 102 and spectators 120 can view the content of the player 114 by connecting directly to the content channel 108, while followers 110 can view the player's content by connecting to the influencer channel 106.

[0030] 1B illustrates an embodiment in which multiple followers 110a-110n are connected to an influencer channel to view a video recording of an influencer 106 watching and commenting on a gameplay of a player 114. As shown, this embodiment includes followers 110a-110n, an influencer channel 106, a player 114, a content channel 108, and spectators 120a-120n. In one embodiment, the followers 110a-110n are connected to the influencer channel 106 through a network 112 and can view content associated with the influencer 102 via the influencer channel 106. As described above, multiple followers 110 can subscribe to the influencer channel 106 and view content that the influencer 102 releases and makes available through the influencer channel 106. In some embodiments, followers 110 connect to an influencer channel 106 because of an interest in the content that the influencer 102 creates, or because of an interest in the character of the influencer 102, regardless of the subject of the content. For example, the influencer 102 may be a comedian with a likeable personality that many people find enjoyable to watch. If the comedian creates content related to a new action movie that was recently released, some followers may not be interested in the new action movie, but the content may still be appealing to the followers because they find the influencer entertaining to watch.

[0031] In one embodiment, various content (e.g., video, audio, photos, etc.) created by the influencer 102 may be viewed on the influencer channel 106. In one example, the influencer channel 106 includes video content available for live viewing and / or rebroadcast and available for viewing at any time. The type of content created by the influencer 102 may depend on what the influencer 102 creates and shares with their followers 110. For example, the influencer 102 may create a "reaction video" that includes a recording of the influencer 102 viewing media content that they have not seen before. To further illustrate this example, as shown in FIG. 1B , the influencer 102 is connected to a content channel 108 to view content available through the player's content channel 108. As shown, the influencer 102 is shown watching a player 114 playing a video game. Various audiovisual equipment (e.g., microphones and cameras) located in the influencer's 102 environment 104 are configured to record the influencer 102 while the influencer 102 watches and listens to the gameplay and reacts to what is happening in the gameplay.

[0032] In other embodiments, spectators 120a-120n can connect to the content channel 108 via the network 112 to view content from the player 114. As shown in FIG. 1B, the content channel 108 can include recordings of the player 114 playing a game in which soldiers engage in combat. As noted above, both the influencer 102 and the spectators 120 can connect directly to the content channel 108 to view the gameplay of the player 114. However, in some embodiments, the follower 110 can view the gameplay of the player 114 by connecting and viewing through the influencer channel 106.

[0033] FIG. 2 illustrates one embodiment of the influencer's 102 environment 104 and multiple surfaces that have been identified and designated as markers. In one embodiment, the system designates various surfaces and content (e.g., picture-in-picture frames) associated with objects in the influencer's 102 environment 104 as markers so that overlay images can be superimposed at the marker locations. In one example, various surfaces on objects such as clothing worn by the influencer and furniture located in the environment 104 can be designated as markers (e.g., 220a-220b, 221a-221b, 223, 224a-224c, 226a-226b). These marker locations can then be used to superimpose various overlay images, thereby generating a video stream for the follower. In some embodiments, the markers may be physically affixed to various real-world objects in the influencer's 102 environment 104. The markers can be encoded with data and used to communicate the marker's location relative to the camera 122.

[0034] In some embodiments, the environment 104 is the physical location where the influencer 102 creates and records the content that the influencer shares on the influencer channel 106. The environment 104 can be any physical location, such as a bedroom, a recording studio, an internet cafe, a public place, etc. As shown in FIG. 2, the influencer 102 is shown sitting at a desk wearing headphones 206 while viewing content on a computer monitor 204. A microphone 222 and cameras 122a-122n can be used to record the influencer 102 as he or she creates content for the influencer channel 106. The influencer's environment 104 can include various real-world objects, such as a chair 202, a bookshelf 208, picture frames 210a-210b, and a closet 214. For example, as shown in FIG. 2, multiple surfaces within the influencer's environment 104 are identified and designated as markers. Markers 221a-221b are located on the surface of influencer's shirt (e.g., the sleeve and front, respectively). Marker 223 is located on the surface of computer monitor 204. Markers 226a-226b are located on the surface of bookshelf 208 (e.g., the side and shelf, respectively). Markers 220a-220b are located on the surfaces of picture frames 210a-210b in which content is placed, respectively. Markers 224a-224c are located on the surface of closet 214 (e.g., the top front, bottom front, and side, respectively).

[0035] In some embodiments, the markers may be anything, such as edges, corners, and shirt buttons, as long as they have sufficiently unique and identifiable points. In one example, the buttons and collar of a shirt worn by influencer 102 may be suitable markers because they include unique and identifiable visual points. In another example, the corners and edges of picture frames 210a-210b may also be suitable markers because the corners and edges of picture frames are unique and identifiable points. In some embodiments, the surface area associated with the marker location may include multiple surface parameters that characterize the surface area. These surface parameters may include various associated three-dimensional features, such as surface contours, wrinkles, undulations, creases, shading, occlusion, texture, curvature, and shadowing. For example, the influencer's shirt may have various wrinkles, undulations, and creases in different areas of the shirt. The sleeves of the shirt may have more wrinkles, undulations, and creases than the front of the shirt because they are more susceptible to movement (e.g., bending of the arms) than the front of the shirt. Thus, in one example, the surface area associated with the location of marker 221a (eg, the sleeve of a shirt) may have different surface parameters than the surface area associated with the location of marker 221b (eg, the front of the shirt).

[0036] According to another embodiment, cameras 122a-122n may be positioned at various locations within influencer 102's environment 104 and configured to record influencer 102 and any objects within that point of view (POV). Each camera is positioned at a different location within environment 104 and captures a unique view of environment 104. Each camera 122 includes an associated camera POV 124a-124n and captures any objects within that POV. For example, as shown in FIG. 2, camera 122a is positioned above closet 214, and corresponding camera POV 124a captures a partial view of bookshelf 208, picture frames 210a-210b, and influencer 102. Camera 122b is positioned above closet 214, and corresponding camera POV 124b captures a partial view of influencer 102 and bookshelf 208. Camera 122n is positioned above picture frame 210a, and corresponding camera POV 124n captures a partial view of influencer 102, closet 214, picture frame 210b, and picture frame 210a.

[0037] In some embodiments, the cameras 122a-122n may be configured to recognize, track, and process markers. The cameras 122a-122n may be mounted on a three-axis gimbal that allows the cameras to freely rotate around any axis to enable capture of various angles of the influencer 102. In one embodiment, the cameras 122a-122n may be pan-tilt-zoom cameras that can be configured to automatically zoom in and track the influencer's body movements and various markers within the environment 104. In one example, the influencer 102 may be watching a music video on the content channel 108 and be completely immersed in the content. The influencer 102 may not be aware that the influencer is dancing and moving around while watching the music video. As the influencer 102 makes various movements while watching the music video, the cameras 122a-122n may track the influencer's position along with the markers 221a-221b on the influencer's shirt.

[0038] FIG. 3A is an embodiment illustrating a follower interface 302 showing the influencer's 102 environment 104 after generating an overlay image for surface parameters associated with the marker locations. The follower interface provides a view from the follower's 110's perspective when the follower 110 is connected to the influencer channel 106. In the illustrated embodiment, FIG. 3A shows exemplary video content created by the influencer 102 for the follower 110 to view on the influencer channel 106. As shown, the influencer's content includes the influencer 102 watching a content channel 108 and commenting on what is happening on the content channel 108. For example, in some embodiments, the content channel 108 may be a recording (e.g., live or replay) of a player 114 competing in an esports event. While the player 114 competes in the esports event, the influencer 102 may commentate and analyze the sequence of events occurring within the event. Accordingly, as shown in FIG. 3A, the follower interface 302 includes a view of the influencer 102 within the environment 104 combined with a view of the player 114 into the content channel 108.

[0039] As further shown in FIG. 3A , in one embodiment, various overlay images can be superimposed on locations associated with the surface region of the marker. This provides a customized video stream to the follower 110, as the selected overlay image can be based on the interests and preferences of the follower 110. According to one embodiment, to determine which overlay image to generate for a particular follower 110, an artificial intelligence (AI) module is configured to receive data from the influencer channel 106 and data associated with the follower's 110 profile. The follower profile can include various attributes related to the follower 110, such as the follower's interests, preferences, likes, dislikes, gaming experience, and skill level. The AI ​​module performs one or more machine learning operations that take the follower profile and the data from the influencer channel 106 as inputs. The data from the influencer channel 106 can provide the AI ​​module with context for what the follower is viewing on the influencer channel 106, such as the type of content and the subject matter of the content.

[0040] In one example, the AI ​​module can determine that the follower 110 is connected to the influencer channel 106 and is watching a video in which the influencer 102 reacts to action movies. Based on the follower's 110 profile, the AI ​​module can learn that the follower 110 is interested in comic books and video games. In response, the AI ​​module can select an overlay image that includes an advertisement related to the new "Batman" movie being released in the next few weeks. As a result, generating overlay images that may match the interests and preferences of the follower 110 can result in increased follower engagement and increased revenue for the influencer 102.

[0041] In some embodiments, the system may identify additional followers during a session as they connect to the influencer channel 106 and join the session to view content on the influencer channel 106. In one embodiment, for each additional follower, the system may generate an additional overlay image during the session that is dynamically contoured to the identified three-dimensional features associated with the marker locations. In some embodiments, for each additional follower, the overlay image is based on the additional follower's respective profile, resulting in a customized video stream for each additional follower. Thus, because the overlay image is different for each follower and selected based on the follower's profile, each additional follower may receive a different video stream when viewing the influencer channel 106. In another embodiment, when one or more additional followers are identified, the selected overlay image is further based on a combination of the follower's profile and the one or more additional followers' profiles, such that the follower and each additional follower receives an overlay image in the video stream. Instead of each follower receiving a different overlay image, the followers may receive the same overlay image when connected to view content on the influencer channel 106. Accordingly, in this embodiment, the video stream and overlay image are customized for the group that includes the follower and one or more additional followers.

[0042] 3A, the diagram shows multiple overlay images generated on influencer 102's shirt and various objects within environment 104. Specifically, overlay images representing "Batman" (e.g., 312a) and "RCA Records" (e.g., 313) are dynamically outlined onto three-dimensional features of influencer 102's shirt where markers 221a-221b are located, respectively. An overlay image representing "Legacy Recordings" (e.g., 310) is dynamically outlined onto three-dimensional features on the back of computer monitor 204 where marker 223 is located. Overlay images representing "Gaikai" (e.g., 308a) and "Insomniac Games, Inc." (e.g., 308b) are dynamically outlined onto three-dimensional features of bookshelf 208 where markers 226a-226b are located. Overlay images representing "Epic Records" and "Bad Boy Records" are dynamically outlined onto the three-dimensional features of picture frames 210a-210b where markers 220a-220b, respectively, are located. Additionally, overlay images representing "Columbia Pictures Industries," "Startime International," and "PlayStation 5" are dynamically outlined onto the three-dimensional features of the surface of closet 214 where markers 224a-224c, respectively, are located.

[0043] 3B-1 through 3D-2 illustrate embodiments of overlay images generated on an influencer's shirt when the influencer's arm is in different positions. Specifically, FIGS. 3B-1 through 3D-2 illustrate overlay images depicting "Batman" (e.g., 312b through 312c) as an example. In some embodiments, the surface region associated with the influencer's 102 shirt may include various surface parameters. The surface parameters may include various associated three-dimensional features, such as surface contours, wrinkles, undulations, folds, shading, occlusion, texture, curvature, and shadowing. When the influencer 102 moves their arm, the surface parameters of the shirt change because the arm movement and position can cause the shirt to stretch, bend, pull, etc. at different angles and directions. As a result, forces (e.g., tension, compression, bending, etc.) are applied to the shirt as the influencer's arm moves to different positions. This causes the surface parameters associated with the shirt to change because different forces are applied to the shirt at each arm position. And since the overlay image is superimposed on the surface of the shirt, changes in the surface parameters can also be reflected on the surface of the overlay image, so that the overlay image looks as realistic as if it were printed on the shirt.

[0044] In one embodiment, as shown in FIG. 3B-1 , the figure illustrates a “Batman” overlay image 312b generated on the shirt of influencer 102. As shown, overlay image 312b appears realistic, as if overlay image 312b were integrated into the shirt. The figure further illustrates how influencer 102 is holding controller 314 with arm 315 extended and pointing upward. Arm angle 326a is the angle formed between reference line 328 and arm reference line 330. Generally speaking, reference line 328 is generally fixed because reference line 328 is parallel to the surface on which the influencer is standing. Thus, arm angle 326a can dynamically change as the influencer changes the position of their arm 315.

[0045] Referring to FIG. 3B-2, this figure shows a close-up of the overlay image 312b shown in FIG. 3B-1, along with the corresponding surface parameters 316b. As previously described, the influencer's shirt may include various surface parameters for a given position on the influencer's arm. Accordingly, the overlay image 312b includes various surface parameters 316b, such as texture 318, three-dimensional surface contours 320a-320b, wrinkles 322a-322b, and undulations 324a-324b. When an overlay image is generated on the shirt, the physical characteristics of the shirt's fabric may be incorporated into the overlay image to make it appear more realistic. For example, the influencer's shirt may be made of various fabrics, such as cotton, silk, wool, tweed, etc. Each type of fabric may have its own type of surface texture (e.g., soft, smooth, rough, etc.) that is visually and physically distinguishable. 3B-2, the overlay image 312b includes a texture 318 that resembles the texture of the influencer's shirt. Because the texture of the shirt is incorporated into the overlay image, the overlay image appears more realistic.

[0046] In another embodiment, the influencer's shirt may include various three-dimensional surface contours. To further enhance the features of overlay image 312b and thereby create a more realistic appearance, overlay image 312b may include three-dimensional surface contours 320a-320b that also appear in various regions of the influencer's shirt as a result of various forces being applied to the shirt. In some embodiments, three-dimensional surface contours 320a-320b may bulge away from the surface of the influencer's arm and protrude in various directions in three-dimensional space. The three-dimensional surface contours may protrude outward due to the texture of the fabric, which causes the base of the three-dimensional surface contour to fold or fold over.

[0047] In another embodiment, the influencer's shirt may include multiple wrinkles 322a-322b. Wrinkles may appear on the shirt because the shirt's fabric may be susceptible to wrinkles, which may form due to various environmental conditions (e.g., humidity and temperature). As shown in FIG. 3B-2, wrinkles 322a-322b begin at the top of the image and extend into a portion of overlay image 312b. In another embodiment, the influencer's shirt may include undulations 324a-324b. In some embodiments, undulations 324a-324b may be caused by loose fabric, and various forces may cause the fabric to fold. For example, when influencer 102 bends his or her arm, the inner material compresses, causing undulations to appear on the outside of the shirt. As shown in FIG. 3B-2, undulations 324a-324b begin on the outer portion of overlay image 312b and naturally extend into a portion of overlay image 312b.

[0048] In another embodiment, FIG. 3C-1 illustrates another position of the influencer's 102's arm that produced a "Batman" overlay image 312c on the influencer's 102's shirt. As illustrated, the influencer 102 is shown holding the controller 314 with the arm 315 extended and pointing upward. Arm angle 326b is the angle formed between reference line 328 and arm reference line 330. Generally, arm angle 326b in the embodiment illustrated in FIG. 3C-1 is greater than arm angle 326a in FIG. 3B-1. Correspondingly, surface parameters 316c of the embodiment of FIG. 3C-1 may differ from surface parameters 316b of FIG. 3B-1 because the influencer's arm 315 is positioned at a different position and angle.

[0049] Referring to FIG. 3C-2, this figure shows a close-up of the overlay image 312c shown in FIG. 3C-1, along with the corresponding surface parameters 316c. As previously described, as the influencer's arm moves to a new position, the shirt may be stretched, bent, or pulled at different angles and directions, resulting in different forces being applied to the shirt and new surface parameters 316c. As shown in FIG. 3C-2, as the angle of the influencer's arm, e.g., arm angle 326b, increases, an overlay image 312c is obtained with surface parameters 316c including texture 318, three-dimensional surface contour 320, wrinkles 322c-322d, and undulations 324b-324c.

[0050] In another embodiment, FIG. 3D-1 illustrates another position of the influencer's arm that produced a "Batman" overlay image 312d on the influencer's 102's shirt. As illustrated, the influencer 102 is shown holding the controller 314 with the arm 315 extended and pointing downward. Arm angle 326c is the angle formed between reference line 328 and arm reference line 330. Because the shirt experiences less stretching, bending, and pulling forces when the influencer's arm is extended downward, the force exerted on the shirt with the influencer's arm extended downward may be less than in the embodiments of FIGS. 3B-1 and 3C-1. In this position, gravity may pull the shirt downward. Referring to FIG. 3D-2, this figure illustrates a close-up of the overlay image 312d shown in FIG. 3D-1, along with corresponding surface parameters 316d. As shown in FIG. 3D-2, extending the influencer's arm downwards may result in an overlay image 312d having surface parameters 316d that include only texture 318 and wrinkles 322e-322f.

[0051] 4A illustrates an embodiment of a follower interface 402a that provides a view from the perspective of a follower 110 when the follower 110 is connected to an influencer channel 106. As shown, the follower interface 402a includes a spliced ​​view of the content channel 108 and the influencer channel 106. In one embodiment, the follower 110 has a greater interest in the content displayed in the content channel 108, and therefore the view of the content channel 108 is larger than the influencer channel 106. As described above, the influencer 102 can connect to view content from a player 114 on the content channel 108. In the example illustrated in FIG. 4A, the content channel 108 shows gameplay from a player 114 playing a game that engages soldiers in combat. During gameplay, followers 110 may also have a view of influencer channel 106, which allows followers 110 to see and hear influencers 102 comment on the gameplay of players 114 as the game progresses.

[0052] FIG. 4A further illustrates multiple overlay images generated over various objects in the content channel 108 and the influencer channel 106. The overlay images can be generated over various surfaces and content associated with objects in the influencer's 102's environment 104, the player's 114's environment, and the content channel's 108 environment. The system can designate various surfaces and content associated with objects in each environment as markers, allowing overlay images to be generated at the marker locations. For example, as shown in FIG. 4A, the player's 114's content channel 108 includes a gameplay scene including helicopters 404a-404b, a tank 406, and a soldier 408. As shown, overlay images representing "RCA Records" and "Bad Boy Records" are generated over the surface areas associated with the designated markers for helicopters 404a and 404b. An overlay image representing "Epic Records" is generated over the surface area associated with the designated marker for tank 406. An overlay image representing "Legacy Recordings" is generated over the surface area of ​​soldier 408 where the virtual markers are designated.

[0053] FIG. 4B illustrates an embodiment of a follower interface 402b that provides a view from the perspective of a follower 110 when the follower 110 is connected to an influencer channel 106. As shown, the follower interface 402b includes a view of the content on the influencer channel 106 and the content on the content channel 108. In one embodiment, the views of the influencer channel 106 and the content channel 108 can be configured to be substantially the same size. FIG. 4B also illustrates multiple overlay images generated on various objects in the influencer's 102 environment and the content channel 108 environment. For example, with reference to the influencer channel 106, the illustration shows overlay images representing "Epic Records" and "Bad Boy Records" generated on the surface area associated with picture frames 210a and 210b, respectively. Overlay images representing "Columbia Pictures Industries," "Startime International," and "PlayStation 5" are generated on the surface area associated with closet 214. Overlay images representing "Gaikai" and "Insomniac Games, Inc." are generated on the surface area associated with bookshelf 208. Overlay images representing "Batman" and "RCA Records" are generated on influencer 102's shirt. Referring to content channel 108, overlay images representing "RCA Records" and "Bad Boy Records" are generated on the surface area associated with helicopters 404a and 404b. An overlay image representing "Epic Records" is generated on the surface area associated with tank 406. An overlay image representing "Legacy Recordings" is generated on the surface area associated with soldier 408.

[0054] FIG. 4C illustrates an embodiment of a follower interface 402c that provides a view from the perspective of a follower 110 when the follower 110 is connected to an influencer channel 106. As shown, follower interface 402b includes views of influencer channel 106, content channel 108a, and content channel 108b. In one embodiment, an influencer 102 can simultaneously connect to multiple content channels, e.g., content channels 108a-108b. For example, as shown in FIG. 4C, influencer 102 is connected to and viewing content channel 108a and content channel 108b. Content channel 108a shows gameplay of player 114a playing a war game involving soldiers. Content channel 108b shows gameplay of player 114b playing a kickboxing game. Because the influencer 102 is viewing content from content channels 108a and 108b, the influencer 102 can provide commentary on both content channels as both games are being played. As described above, multiple overlay images can be generated over various objects located in the influencer channel 106 and the content channel 108. With reference to content channel 108b, overlay images representing "Legacy Recordings" and "TriStar Pictures" are generated over the surface areas associated with the first kickboxer 410 and the second kickboxer, respectively.

[0055] 5 illustrates an embodiment of a method for generating a video stream for followers of an influencer during a session by generating an overlay image for at least one surface parameter in the influencer's environment. In one embodiment, the method includes an operation 502 of capturing video images of the influencer's 102's environment 104 and the influencer 102 watching an online content channel 108. As described above, cameras 122a-122n can be used to record the influencer 102 in their environment 104 as they create content for their influencer channel 106 (e.g., reaction videos, product reviews, product endorsements, comedy skits, etc.). The cameras 122a-122n can be positioned in different areas within the environment 104 to capture unique vantage points so that followers 110 can have different perspectives of the influencer 102 and the environment 104. In one embodiment, cameras 122a-122n may be RGB depth-sensing cameras that include depth sensing so that three-dimensional models can be created. RGB depth-sensing cameras can provide both color and dense depth images that can facilitate three-dimensional mapping of the captured images.

[0056] The method proceeds to operation 504, where the operation is configured to detect surface parameters within the environment 104 of the influencer 102. In one embodiment, operation 504 is configured to scan video images captured by the multiple cameras 116 to detect various surfaces and surface parameters associated with objects within the environment 104 of the influencer 102. The surface parameters may include various associated three-dimensional features such as surface contours, wrinkles, undulations, creases, shading, occlusion, texture, curvature, shadowing, etc. In some embodiments, the identified surfaces associated with the object may be designated as markers, allowing an overlay image to be generated at the location of the marker.

[0057] In other embodiments, the markers may be physically affixed to or embedded in real-world objects, such as clothing worn by the influencer, and / or various objects in the influencer's 102's environment 104. In some embodiments, the markers may be virtual markers. For example, a virtual marker may be anything in a video image that is recognizable and distinguishable from frame to frame, such as a shirt button. As the influencer moves around, the shirt button can be continuously tracked and detected at some point. In some embodiments, a machine learning model is trained to identify various real-world objects and various features of the human body. For example, the machine learning model can distinguish between the front and back of a person. Thus, the machine learning model may be useful for determining whether a marker is on the back or front of a person's shirt.

[0058] The method proceeds to operation 506, where the operation is configured to process the surface parameters to identify three-dimensional features associated with the surface parameters. As described above, surface parameters associated with an object may include various three-dimensional features such as surface contours, wrinkles, undulations, folds, shading, occlusion, texture, curvature, shadowing, etc. For example, the system may detect a bookshelf in the influencer's environment and process the surface parameters of the bookshelf to identify three-dimensional features that result in flat surface areas and rough textures. In another example, the system may detect that the influencer is wearing a wool sweater. A wool sweater may be loose-fitting and designed to fit the influencer comfortably. Because the sweater is loose-fitting, surface parameters associated with areas of the wool sweater include multiple undulations, curvatures, and surface contours. In some embodiments, other factors may affect the three-dimensional features associated with the surface parameters of clothing worn by the influencer. These factors may include the type of fabric, the fit (e.g., loose, normal, slim), the influencer's body position and movement, etc.

[0059] In some embodiments, operation 506 is configured to process the surface parameters to extract depth data from three-dimensional features. In one embodiment, the depth data may include three-dimensional features that can be used to generate a wireframe model of an object in the environment associated with the surface parameters being processed. In one embodiment, operation 506 may include one or more machine learning operations that aid in predicting depth data when depth data is unavailable.

[0060] In operation 508, the operations are configured to generate an overlay image for at least one of the surface parameters detected in the influencer's environment. In some embodiments, the overlay image is configured to dynamically contour to the identified three-dimensional features so that the overlay image can appear as realistic as if it had originally been printed or embroidered on the object. For example, the influencer 102 may be wearing a knit beanie that includes multiple undulations, wrinkles, folds, and occlusions. If the overlay image is generated on the surface of the knit beanie, the overlay image is dynamically contoured to the various undulations, wrinkles, folds, and occlusions associated with the knit beanie. In generating the overlay image, the depth and various three-dimensional features of the knit beanie are incorporated into the overlay image, resulting in an enhanced realism in the appearance of the overlay image.

[0061] In some embodiments, operation 508 is configured to process the overlay image to enable active contouring of the identified three-dimensional features. Operation 508 can include one or more machine learning operations to help estimate invisible object geometry and surface parameters so that the overlay image can be generated for the surface parameters. In one embodiment, during a session, operation 508 is configured to adjust the shape of the overlay image to follow changes in the object's surface parameters and changes in the geometric viewing angle of the surface parameters. For example, when surface parameters associated with an influencer's shirt change during a session, operation 508 can adjust the shape of the overlay image (e.g., a Batman logo) to adjust for the change in surface parameters.

[0062] In some embodiments, to further enhance the realism of the appearance of the overlay image, the overlay image is dynamically contoured to adjust its lighting and shadowing parameters based on visible changes in the object's surface parameters during a session. For example, if a light source is pointed from a direction behind the influencer's shoulder, an overlay image applied to the front portion of the influencer's shirt may contain shadows or appear darker because the overlay image is not directly facing the light source. Without applying some type of shadowing to the overlay image, or other areas where shadows are expected to appear, the overlay image may appear too artificial and unrealistic.

[0063] In another embodiment, the overlay image may be selected based on the follower's profile, such that the video stream received by the follower when watching the influencer channel 106 is customized based on the follower's profile. In one embodiment, the overlay image may be selected using an artificial intelligence (AI) module configured to receive as input data from the influencer channel 106, data from the content channel 108, and the follower's 110 profile data. The data from the influencer channel 106, the content channel 108 may be used to determine what the follower 110 is watching and the context of the content. The follower profile may include various attributes associated with the follower 110, such as the follower's interests, preferences, likes, dislikes, gaming experience, and skill level. Using the above inputs, the AI ​​module performs one or more machine learning operations to predict which overlay image to select and overlay for a given follower 110. For example, based on the profile data of followers 110, the AI ​​module may determine that 75% of the followers 110 currently connected to the influencer channel 106 are logged in from Japan. Based on the profile data and other factors such as what is currently popular in Japanese culture, the follower's demographics, and the time of day, the AI ​​module may make predictions about the types of overlay images that the follower 110 may be interested in.

[0064] In some embodiments, the overlay image may change based on changes in followers 110 and / or based on engagement related to the content of the influencer channel 106. For example, during a session, as followers connect or disconnect from viewing content due to their interest or lack of interest in the content of the influencer channel 106, the overlay image may be updated to reflect the changes in followers.

[0065] According to another embodiment, the method proceeds to operation 510, where the operation is configured to track surface parameters associated with the object in preparation for changes in the alignment of the surface parameters. In some embodiments, operation 510 is configured to track the position and orientation of the surface parameters of the object so that the wireframe model can be updated during a session. This allows the system to know the position of the surface parameters at any time. For example, as the influencer moves or naturally changes position, the system can generate an overlay image in a position that blends with the scene. For example, the top of the influencer's shirt sleeve can be designated as a marker position. The surface parameters associated with the marker position may include various three-dimensional features such as wrinkles, folds, undulations, and surface contours at an initial time point (e.g., time t0). At a later time point (e.g., time t10), the influencer moves their arm to a different position, which may result in various changes in the three-dimensional features associated with the surface parameters. Thus, at time t10, the associated positions and three-dimensional features and the surface parameters (e.g., wrinkles, folds, undulations, and surface contours) may be different from those at time t0. As a result, as the position of an object in the environment changes, the system can track the position of the surface parameters so that an overlay image can be generated in the appropriate position, taking into account changes in the three-dimensional features associated with the surface parameters.

[0066] FIG. 6 illustrates components of an exemplary device 600 that can be used to implement aspects of various embodiments of the present disclosure. The block diagram illustrates device 600, which can incorporate or be a personal computer, video game console, personal digital assistant, server, or other digital device suitable for implementing embodiments of the present disclosure. Device 600 includes a central processing unit (CPU) 602 for executing software applications and optionally an operating system. CPU 602 may be comprised of one or more homogeneous or heterogeneous processing cores. For example, CPU 602 is one or more general-purpose microprocessors having one or more processing cores. Further embodiments can be implemented using one or more CPUs with a microprocessor architecture particularly suited for highly parallel and computationally intensive applications, such as interpreting queries, identifying contextually relevant resources, and immediately implementing and rendering the contextually relevant resources within a video game. Device 600 may be localized to a player playing a game segment (e.g., a game console), or remote from the player (e.g., a back-end server processor), or one of many servers using virtualization in a game cloud system for remote streaming of gameplay to clients.

[0067] Memory 604 stores applications and data used by CPU 602. Storage 606 provides non-volatile storage and other computer-readable media for applications and data and may include fixed disk drives, removable disk drives, flash memory devices, and CD-ROM, DVD-ROM, Blu-ray, HD-DVD, or other optical storage devices, as well as signal transmission and storage media. User input device 608 communicates user input from one or more users to device 600; examples of user input device 608 may include a keyboard, mouse, joystick, touchpad, touchscreen, still or video recorder / camera, gesture-recognizing tracking device, and / or microphone. Network interface 614 enables device 600 to communicate with other computer systems over an electronic communications network, which may include wired or wireless communications over a local area network or a wide area network such as the Internet. The audio processor 612 is adapted to generate analog or digital audio output from instructions and / or data provided by the CPU 602, memory 604, and / or storage 606. The components of the device 600, including the CPU 602, memory 604, data storage 606, user input device 608, network interface 610, and audio processor 612, are connected via one or more data buses 622.

[0068] A graphics subsystem 620 is further coupled to the data bus 622 and the components of device 600. Graphics subsystem 620 includes a graphics processing unit (GPU) 616 and a graphics memory 618. The graphics memory 618 includes display memory (e.g., a frame buffer) used to store pixel data for each pixel of an output image. The graphics memory 618 may be integrated into the same device as the GPU 608, connected as a separate device from the GPU 616, and / or incorporated within memory 604. Pixel data may be provided to the graphics memory 618 directly from the CPU 602. Alternatively, the CPU 602 may provide data and / or instructions defining a desired output image to the GPU 616, from which the GPU 616 generates pixel data for one or more output images. The data and / or instructions defining a desired output image may be stored in memory 604 and / or the graphics memory 618. In an embodiment, GPU 616 includes 3D rendering functionality for generating pixel data for output images from instructions and data defining scene geometry, lighting, shading, texturing, motion, and / or camera parameters. GPU 616 may further include one or more programmable execution units capable of executing shader programs.

[0069] Graphics subsystem 614 periodically outputs image pixel data from graphics memory 618 for display on display device 610. Display device 610 may be any device capable of displaying visual information in response to signals from device 600, including CRT, LCD, plasma, and OLED displays. Device 600 may provide analog or digital signals to display device 610, for example.

[0070] It should be noted that access services distributed over a wide geographic area, such as providing access to games in the current embodiment, often use cloud computing. Cloud computing is a computing paradigm in which dynamically scalable, often virtualized resources are provided as a service over the Internet. Users do not need to be experts in the technical infrastructure of the "cloud" that supports them. Cloud computing can be categorized into different services, such as Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS). Cloud computing services often provide common applications, such as video games, online, accessed through a web browser, but the software and data are stored on servers in the cloud. The term cloud is used as a metaphor for the Internet, based on how the Internet is depicted in computer network diagrams, and is an abstract concept that hides a complex infrastructure.

[0071] In some embodiments, a game server may be used to perform the operation of a persistent information platform for video game players. Most video games played over the Internet operate through a connection to a game server. Typically, the game uses a dedicated server application that collects data from players and distributes the collected data to other players. In other embodiments, the video game may be executed by a distributed game engine. In these embodiments, the distributed game engine may run on multiple processing entities (PEs), such that each PE executes a functional segment of the given game engine on which the video game is executed. Each processing entity is viewed by the game engine as simply a computational node. A game engine typically performs a functionally diverse set of operations to execute a video game application along with additional services for the user experience. For example, the game engine implements game logic and performs game calculations, physics, geometry transformations, rendering, lighting, shading, audio, and additional in-game or game-related services. The additional services may include, for example, messaging, social utilities, audio communication, gameplay playback functions, help functions, etc. The game engine may run on an operating system virtualized by a hypervisor on a particular server, but in other embodiments the game engine itself may be distributed across multiple processing entities, each residing on a different server unit in a data center.

[0072] According to this embodiment, for execution, each processing entity may be a server unit, a virtual machine, or a container, depending on the needs of each game engine segment. For example, if a game engine segment is responsible for camera transformations, since it will be performing a lot of relatively simple mathematical operations (e.g., matrix transformations), that particular game engine segment may be provisioned with a virtual machine associated with a graphics processing unit (GPU). Other game engine segments, requiring fewer but more complex operations, may be provisioned with processing entities associated with one or more more powerful central processing units (CPUs).

[0073] By distributing the game engine, the game engine has elastic computational characteristics that are not bound by the capabilities of a physical server unit. Instead, the game engine is provisioned with more or fewer computational nodes as needed to meet the demands of the video game. From the perspective of the video game and the video game player, a game engine that is distributed across multiple computational nodes is indistinguishable from a non-distributed game engine running on a single processing entity, as a game engine manager or supervisor distributes the workload and seamlessly integrates the results to provide the video game output component to the end user.

[0074] Users access remote services through client devices that include at least a CPU, display, and I / O. The client devices may be PCs, cell phones, netbooks, PDAs, etc. In one embodiment, a network running on the game server recognizes the type of device used by the client and adjusts the communication method employed. In another case, the client device accesses applications on the game server over the Internet using standard communication methods such as HTML.

[0075] It should be understood that a given video game or game application may be developed for a particular platform and a particular associated controller device. However, when such games are made available through a game cloud system as presented herein, users may access the video game with different controller devices. For example, a game may be developed for a game console and its associated controller, but a user may access a cloud-based version of the game from a personal computer utilizing a keyboard and mouse. In such a scenario, the input parameter configuration may define a mapping from inputs that can be generated by the user's available controller device (in this case, a keyboard and mouse) to inputs that are acceptable for execution of the video game.

[0076] In another example, a user may access the cloud gaming system via a tablet computing device, a touchscreen smartphone, or other touchscreen-driven device. In this case, the client device and controller device are integrated into the same device, with inputs provided as detected touchscreen inputs / gestures. For such devices, the input parameter configuration can define specific touchscreen inputs that correspond to game inputs for a video game. For example, buttons, directional pads, or other types of input elements can be displayed or overlaid during the execution of the video game to indicate locations on the touchscreen that a user can touch to generate game input. Gestures such as swipes in specific orientations or specific touch motions can also be detected as game inputs. In one embodiment, to familiarize a user with control operations on the touchscreen, a tutorial showing how to input gameplay inputs via the touchscreen can be provided to the user, for example, before beginning gameplay of the video game.

[0077] In some embodiments, the client device serves as a connection point for the controller device. That is, the controller device communicates with the client device via a wireless or wired connection and transmits inputs from the controller device to the client device. The client device may then process these inputs and then transmit the input data to a cloud gaming server over a network (e.g., a network accessed through a local network device such as a router). However, in other embodiments, the controller itself may be a networked device capable of communicating inputs directly to the cloud gaming server over a network, without the need for such inputs to first be communicated through the client device. For example, the controller may connect to a local network device (such as the router mentioned above) and transmit data to and receive data from the cloud gaming server. Thus, while the client device may still be required to receive video output from the cloud-based video game and render it on a local display, input latency may be reduced by allowing the controller to transmit inputs directly to the cloud gaming server over the network, bypassing the client device.

[0078] In one embodiment, the networked controller and client device can be configured to transmit certain types of input directly from the controller to the cloud gaming server and other types of input via the client device. For example, inputs whose detection does not rely on any additional hardware or processing separate from the controller itself can be transmitted directly from the controller to the cloud gaming server over the network, bypassing the client device. These inputs can include button inputs, joystick inputs, embedded motion-sensing inputs (e.g., accelerometers, magnetometers, gyroscopes), etc. However, inputs that utilize additional hardware or require processing by the client device can be transmitted by the client device to the cloud gaming server. These can include video or audio captured from the game environment that can be processed by the client device before transmission to the cloud gaming server. Additionally, inputs from the controller's motion-sensing hardware can be processed by the client device in conjunction with the captured video to detect the position and movement of the controller, which is then communicated by the client device to the cloud gaming server. It should be understood that controller devices according to various embodiments can also receive data (e.g., feedback data) from the client device or directly from the cloud gaming server.

[0079] It should be understood that the various embodiments defined herein may be combined or assembled into specific implementations using various features disclosed herein. Thus, the examples provided are only some of the possible examples and are not intended to limit the various embodiments that may be defined by combining various elements. In some instances, an embodiment may include fewer elements without departing from the spirit of the disclosed or equivalent embodiments.

[0080] Embodiments of the present disclosure may be practiced with a variety of computer system configurations including handheld devices, microprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, etc. Embodiments of the present disclosure may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a wire-based or wireless network.

[0081] Although the method operations have been described in a particular order, it should be understood that other housekeeping operations may be performed between operations, or operations may be arranged to occur at slightly different times, or operations may be distributed within the system to allow processing operations to occur at various processing-related intervals, so long as the processing of telemetry data and game state data to generate a modified game state is performed in the desired manner.

[0082] One or more embodiments may also be fabricated as computer-readable code on a computer-readable medium. The computer-readable medium may be any data storage device that can store data, which can then be read by a computer system. Examples of computer-readable media include hard drives, network-attached storage (NAS), read-only memory, random-access memory, CD-ROMs, CD-Rs, CD-RWs, magnetic tape, and other optical and non-optical data storage devices. The computer-readable medium may include tangible computer-readable media distributed over network-connected computer systems so that the computer-readable code is stored and executed in a distributed fashion.

[0083] Although the foregoing embodiments have been described in some detail for clarity of understanding, it will be apparent that certain changes and modifications may be practiced within the scope of the appended claims. The present embodiments are therefore to be considered as illustrative and not restrictive, and the present embodiments should not be limited to the details set forth herein but may be modified within the scope of the appended claims and their equivalents.

Claims

1. 1. A method of generating a video stream for followers of an influencer during a session, comprising: capturing a video image of the influencer's environment, the environment including the influencer watching an online content channel; designating at least one surface area associated with an article of clothing worn by the influencer as a marker; Detecting different types of surface parameters in the surface region associated with the position of each marker depending on the fabric material of the clothing worn by the influencer; processing the surface parameters to identify three-dimensional features associated with the surface parameters; Identifying followers who are viewing the influencer; generating an overlay image for at least one of the surface parameters, the overlay image configured to dynamically contour to the identified three-dimensional features during the session; superimposing the overlay image on the position of each marker; Including, The method, wherein the overlay image is selected based on a profile of the follower such that the video stream received by the follower when viewing the influencer is customized based on the follower's profile.

2. identifying additional followers of the influencer during the session; generating, for each additional follower, an additional overlay image during said session that is dynamically contoured to said identified three-dimensional features; The method of claim 1 further comprising:

3. The method of claim 2 , wherein each of the additional followers is provided with the video stream that is customized based on the additional follower's respective profile.

4. The method of claim 3 , wherein each of the additional followers and the followers receives the video stream including a different image of the overlay image or additional overlay image.

5. 2. The method of claim 1, wherein identifying the follower includes identifying one or more additional followers, and the selected overlay image is further based on a combination of the profile of the follower and profiles of the one or more additional followers, such that the follower and each of the additional followers receive the same image of the overlay image in the video stream.

6. The method of claim 5 , wherein the video stream and the overlay image are customized for a group that includes the follower and the one or more additional followers.

7. processing the surface parameters to extract depth data from the three-dimensional features, the depth data being used to generate wireframe models of objects in the environment associated with the surface parameters being processed; tracking the object and updating the wireframe model during the session; processing the overlay image to enable active contouring of the identified three-dimensional features; The method of claim 1 further comprising:

8. 8. The method of claim 7, wherein the active contouring is configured to adjust the shape of the overlay image to follow changes in the surface parameters of the object during the session, and the object in the environment is associated with the influencer's image.

9. 8. The method of claim 7, wherein the active contouring is configured to occlude one or more portions of the overlay image based on visible changes in the surface parameters of the object during the session, and the object in the environment is associated with the image of the influencer.

10. 8. The method of claim 7, wherein the active contouring is configured to adjust lighting parameters of the overlay image based on visible changes in the surface parameters of the object during the session, and the object in the environment is associated with the influencer's image.

11. 8. The method of claim 7, wherein the active contouring is configured to adjust the shape of the overlay image to follow a geometric viewing angle of the surface parameters of the object during the session, and the object in the environment is associated with a real-world object in the environment of the influencer.

12. 1. A method of generating a video stream for followers of an influencer during a session, comprising: capturing a video image of the influencer's environment, the environment including the influencer watching an online content channel; designating at least one surface area associated with an article of clothing worn by the influencer as a marker; Detecting different types of surface parameters in the surface region associated with the position of each marker depending on the fabric material of the clothing worn by the influencer; processing the surface parameters to identify three-dimensional features associated with the surface parameters; Identifying a plurality of followers who are viewing the influencer; generating an overlay image for at least one of the surface parameters, the overlay image being selected based on information identified in profiles of the plurality of followers; superimposing the overlay image on the position of each marker; Including, The method, wherein the video stream received by the follower is customized during the session.

13. The method of claim 12 further comprising modifying the overlay image based on changes in the follower.

14. The method of claim 13 , wherein the change in the followers includes one or more followers stopping the viewing of the influencer or one or more followers joining the viewing of the influencer.

15. The method of claim 13 , wherein the change in the followers further comprises a change in engagement in the viewership of the influencer.

16. A non-transitory computer-readable storage medium storing a computer program, program instructions for capturing a video image of an influencer's environment, the environment including the influencer watching an online content channel; program instructions for designating at least one surface area associated with an article of clothing worn by the influencer as a marker; program instructions for detecting different types of surface parameters in the surface region associated with the position of each marker depending on the fabric material of the clothing worn by the influencer; program instructions for processing the surface parameters to identify three-dimensional features associated with the surface parameters; program instructions for identifying followers who are viewing the influencer; generating an overlay image for at least one of the surface parameters, the overlay image configured to dynamically contour to the identified three-dimensional features during a session; and program instructions for superimposing the overlay image at the location of each marker; Including, A non-transitory computer-readable storage medium, wherein the overlay image is selected based on a profile of the follower such that a video stream received by the follower when viewing the influencer is customized based on the follower's profile.

17. 17. The storage medium of claim 16, wherein the three-dimensional features include one or more of a surface contour, or a wrinkle, or an undulation, or a fold, or a shading, or an occlusion, or a texture, or a curvature, or a shadowing.

18. program instructions for identifying additional followers of the influencer during the session; program instructions for generating, for each additional follower, an additional overlay image during the session that is dynamically contoured to the identified three-dimensional feature; The storage medium of claim 16 further comprising:

19. 17. The storage medium of claim 16, wherein the identifying of the follower includes identifying one or more additional followers, and the selected overlay image is further based on a combination of the profile of the follower and profiles of the one or more additional followers, such that the follower and each of the additional followers receive the same image of the overlay image in the video stream.

20. 17. The storage medium of claim 16, wherein the active contouring is configured to adjust the shape of the overlay image to follow changes in the surface parameters of objects in the environment during the session, the objects in the environment being associated with the influencer's image.

Images