Medium reproduction by gesture operation on touch screen
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- 余田 ひとみ
- Filing Date
- 2023-04-25
- Publication Date
- 2026-05-15
AI Technical Summary
Existing user interfaces for playing media content on touch screens do not fully utilize gesture operations, limiting the intuitive interaction capabilities of touch screen devices.
A user interface that utilizes gesture operations on a touch screen to navigate and select media content, including orthogonal gestures to switch between media content, and a server system that recommends related media content based on relevance criteria such as title, genre, upload account, author, and distribution history.
Enhances the intuitive interaction with media content on touch screens by allowing seamless navigation and recommendation of relevant media content through gesture-based operations, improving user experience and content discovery.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a system and method for playing media content such as still images, videos, and music, and more particularly to a user interface for playing media content on a touch screen. [Background technology]
[0002] Media content such as videos and music may be played on information devices such as personal computers and smartphones. For example, videos posted on video posting services such as YouTube provided by Google and TikTok provided by ByteDance may be played on information devices. For example, music by artists distributed on a music distribution service such as Spotify provided by Spotify Technology may be played on information devices. In addition, photos (still images) posted on a photo posting service such as Pinterest provided by Pinterest may be played on information devices. As such, the development of still image, video, and music posting services has been remarkable, and many services are provided.
[0003] Patent Document 1 discloses an example of a user interface for playing back media content such as still images, videos, and music on an information device. [Patent Document 1] Patent Publication No. 2015-170365 Summary of the Invention [Problem to be solved by the invention]
[0004] In recent years, the number of information devices equipped with touch screens, especially smartphones, has been increasing. On a touch screen, users can intuitively operate the device by using gestures such as flicking or swiping the screen with their finger. When playing media content on an information device equipped with a touch screen, a user interface that makes the most of gesture operations is desired.
[0005] An object of the present invention is to provide a user interface for playing back media content on a touch screen that makes maximum use of gesture operations. [Means for solving the problem]
[0006] According to one aspect of the present invention, there is provided a program for causing a computer having a touch screen that accepts a gesture operation to execute a method for playing media content distributed from a server via a network. The method includes a first step of displaying a plurality of pieces of media content information corresponding to at least a portion of a plurality of pieces of media content held in the server, arranged in a screen scroll direction. The method includes a second step of playing media content (first media content) corresponding to selected media content information from the displayed plurality of pieces of media content information. The method includes a third step of switching a display of the media content information (third media content information) subjected to the orthogonal gesture operation to a display of media content information (fourth media content information) indicating another media content (fourth media content) related to the media content (third media content) indicated by the third media content information, in response to an orthogonal gesture operation including a gesture in a direction substantially orthogonal to the screen scroll direction, on any one of the plurality of pieces of media content information displayed in the first step. The method includes a fourth step of, during playback of the media content in the second step, identifying a second media content, which is another media content related to the first media content being played, according to a first condition and starting playback in response to a first gesture operation on the playback screen, the first gesture operation including a gesture in either a vertical or horizontal direction on the playback screen, and starting playback of the second media content according to a second condition and starting playback in response to a second gesture operation including the other of a vertical or horizontal gesture on the playback screen.
[0007] According to one aspect of the present invention, the first and second conditions are selected from (A) high relevance based on a title given to the first media content, (B) high relevance based on a genre given to the first media content, (C) high relevance based on a user account that uploaded the first media content to the server, (D) high relevance based on at least one of the author and performer of the media related to the first media content, and (E) high relevance based on a distribution history, which is a history of past distribution of media content from the server to a user account logged in to the server from the computer. In addition, according to one aspect of the present invention, the fourth media content is selected based on a condition selected from the following: (A) high relevance based on the title given to the third media content; (B) high relevance based on the genre given to the third media content; (C) high relevance based on the user account that uploaded the third media content to the server; (D) high relevance based on at least one of the author and performer of the media related to the third media content; and (E) high relevance based on a distribution history, which is a history of past distribution of media content from the server to a user account logged in to the server from the computer. Effect of the Invention
[0008] According to the present invention, it is possible to provide a user interface for playing back media content on a touch screen, making maximum use of gesture operations. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing a system according to an embodiment. [Diagram 2] FIG. 2 is a flowchart showing the flow of account creation by the server. [Diagram 3] FIG. 3 is a flowchart showing the flow of login processing by the server. [Figure 4] FIG. 4 is a flowchart showing a flow of a process of accepting upload of media content by the server. [Diagram 5] FIG. 5 is a diagram showing an example of a database in which the server manages media contents. [Figure 6] FIG. 6 is a diagram showing an example of a database in which the server manages media contents. [Figure 7] FIG. 7 is a flowchart showing the flow of media playback processing by the server. [Figure 8] FIG. 8 is a diagram showing an example of a user interface displayed on a user terminal, the user interface displaying a list of a plurality of playable media contents. [Figure 9] FIG. 9 is a diagram showing an example of a user interface displayed on a user terminal, the user interface displaying a list of a plurality of playable media contents. [Figure 10] FIG. 10 is a diagram showing an example of a user interface displayed on a user terminal when playing back media content. [Figure 11] FIG. 11 is a diagram showing an example of a user interface displayed on a user terminal when playing back media content. [Figure 12] FIG. 12 is a diagram showing gesture operations accepted on a user interface during playback of media content. [Figure 13] FIG. 13 is a diagram showing gesture operations accepted on a user interface during playback of media content. [Figure 14] FIG. 14 is a diagram showing gesture operations accepted on a user interface during playback of media content. [Figure 15] FIG. 15 is a diagram showing gesture operations accepted on a user interface displaying a list of multiple media contents. [Figure 16] FIG. 16 is a flowchart showing a flow of display control of a user interface that displays a list of a plurality of playable media contents. [Figure 17] FIG. 17 is a diagram showing an example of a user interface that displays a list of multiple playable media contents on a user terminal. [Figure 18] FIG. 18 is a diagram showing an example of a user interface that displays a list of a plurality of playable media contents in a matrix on a user terminal. [Figure 19] FIG. 19 is a diagram illustrating an example of a database in which the server manages favorite account information. [Figure 20] FIG. 20 is a diagram showing an example of a user interface that displays a list of a plurality of playable media contents in a matrix on a user terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a system 1 according to an embodiment of the present invention. The system 1 includes a plurality of user terminals 100 and a server 200 that performs streaming distribution of media content. Each user terminal 100 is an information device used by a user, such as a personal computer, a smartphone, or a tablet, and has a touch screen and an application program (app) installed thereon for playing media content streamed from the server 200 via a network. The server 200 is a server on a network, and has a function of at least temporarily holding media content uploaded or streamed from the user terminal 100 or other devices via the network, and streaming the held media content to the user terminal 100. The network includes at least one of a LAN (local area network), a WAN (wide area network), the Internet network, a cellular communication network, and the like.
[0011] Each user terminal 100 and the server 200 can communicate with each other through a communication C1 via a network. Each user terminal 100 can connect to the server 200 through the communication C1, sign up to create an account, log in with the created account, and upload media content in the terminal. The server 200 receives an ID and password from the user terminal 100 connected through the communication C1, performs a sign-up process to register a new account, performs a login process to accept and authenticate an input of an ID and password from the user terminal 100, and stores media content uploaded from the logged-in user terminal 100 in association with the login account. Alternatively or additionally, the server 200 stores a plurality of media contents delivered in advance from an external media content creator, regardless of the media content uploaded from the user terminal 100. For example, the server 200 stores music content delivered from external media content creators such as record companies and artists, and video content related to video works such as movies and dramas delivered from external media content creators such as movie production companies and video production companies. Furthermore, each user terminal 100 can connect to the server 200 via communication C1, select any of the media content held by the server 200, request playback, and play the media content streamed from the server 200 in response to the request. In response to a playback request from a user terminal 100 connected via communication C1, the server 200 identifies the requested media content from the media content it holds, and streams it to the user terminal 100 that made the request.
[0012] The user terminal 100 is a computer terminal such as a personal computer, a smartphone, or a tablet. The user terminal 100 includes a storage medium such as a random access memory (RAM), a hard disk drive (HDD), a solid state drive (SSD), or an SD card. For example, the user terminal 100 includes a camera, and when a photograph is taken with the camera, the user terminal 100 stores still images and videos generated by the photograph in response to the photograph in the storage medium. The user terminal 100 includes a processor that processes media content stored in the storage medium. The processing of the media content includes, for example, playing the media content and uploading the media content to the server 200.
[0013] The user terminal 100 has a touch screen and accepts gesture operations using a user's finger or a stylus on the screen. As an example, gesture operations include a tap operation in which one point on the screen is pressed and immediately released (pressure is released), a multi-tap operation in which multiple points on the screen are pressed substantially simultaneously and immediately released (pressure is released), a swipe operation in which one point on the screen is pressed and then traced (dragged) in either direction, a pinch-in operation in which two points on the screen are pressed substantially simultaneously and then traced (dragged) to bring the two points closer together, a pinch-out operation in which two points on the screen are pressed substantially simultaneously and then traced (dragged) to move the two points apart, and the like.
[0014] The server 200 has an account creation unit 201 that receives an ID and a password from the user terminal 100 connected by communication C1 and creates a new account. FIG. 2 is a flowchart showing a flow of account creation by the account creation unit 201. The server 200 accepts access from the user terminal 100, and provides the user terminal 100 with a page for creating an account and causes it to display (S10). The user terminal 100 inputs registration information such as an ID and a password on the page for creating an account and transmits it to the server 200 (S11). The registration information includes, for example, the user's name, address, email address, telephone number, and other user-specific contact information, an account name to be given to the account, and the like. The server 200 receives the registration information (S12) and registers it as a new account (S13). The server 200 registers multiple accounts having different registration information for multiple user terminals 100. An account is used to distinguish a delivery destination of media content or a source of uploading media content, and is also called a channel for each user to deliver media content.
[0015] The server 200 has a login processing unit 202 that accepts login from the user terminal 100 using the ID and password of a registered account in order to upload and play back media content. FIG. 3 is a flowchart showing the flow of login processing by the login processing unit 202. The server 200 accepts access from the user terminal 100, and provides a login page for the user terminal 100 to display (S20). The user terminal 100 inputs registration information such as an ID and password on the login page, and transmits it to the server 200 to log in (S21). The server 200 collates the received registration information with registration information of the account held therein and authenticates it (S22). As a result, the server 200 accepts login from the user terminal 100 using any of the accounts.
[0016] The server 200 includes an upload reception unit 203 that receives an upload of media content from the user terminal 100 after the user terminal 100 logs in. FIG. 4 is a flowchart showing the flow of the upload reception process by the upload reception unit 203. The server 200 includes a storage that holds media content uploaded from each user terminal 100. After logging in, the user terminal 100 uploads (transmits) the selected media content in the terminal to the server 200 (S23). In S23, the user terminal 100 receives a user selection of media content to be uploaded, as well as a user input of the title of the media content, a user input of a genre that is a category to which the media content belongs, and a user input of a sentence for a brief description of the content of the media content, and transmits the input information to the server 200 together with the media content as metadata of the media content. The server 200 receives the uploaded (transmitted) media content (S24) and holds it in the storage (S25). In S25, the server 200 holds the media content in association with the account to which the media content was uploaded. In S25, the server 200 stores the media content in association with the metadata such as the title, genre, and description transmitted together with the media content.
[0017] Moreover, the server 200 holds one or more media contents delivered in advance from an external media content creator, regardless of whether the contents are uploaded from the user terminal 100. The external media content creator is, for example, a record company or artist that creates music content, a video production company such as a movie production company that creates video content related to dramas and movies, or a TV station or program production company that creates video content related to news programs and variety programs, and is an individual or a corporation or other organization that produces and delivers media content. As an example, the media content is held on a physical recording medium such as a DVD-R or an SD card, sent from the external media content creator to the operator of the server 200, and copied from this recording medium to the server 200. As an example, the media content is delivered by being uploaded from the computer of the external media content creator to the server 200 via a network, and then downloaded to the server 200. The method of delivery of the media content does not matter. Each media content is provided by a media content creator with metadata such as the title of the media content, the author or performer of the media content, the genre to which the media content belongs, the publication date of the media content, and a brief description of the content of the media content. The server 200 stores the delivered media content in association with the metadata such as the title, author or performer, genre, publication date, and description that have been provided to the media content.
[0018] The server 200 holds and manages each media content in a database. FIG. 5 shows a database 10A, which is an example of a database that manages media content uploaded from the user terminal 100. As shown in FIG. 5, in the database 10A, media content uploaded by logging in with the account (S21 to S25) is managed for each account. In the example shown in FIG. 5, for example, three video contents (oden01.mp4, oden02.mp4, oden03.mp4) uploaded from an account with the account name "Oden ch" in which the email address aaa.oden@xxx.com is registered as registration information are managed. The video content oden01.mp4 is uploaded with the title "I tried singing the song AA", the genres "music" and "variety", and the description "I got carried away and tried the difficult song AA" (S23), and was accepted and held by the server 200 on December 20, 2022 (S25). The video content oden02.mp4 is uploaded with the title "Infiltrating the popular ramen shop BB!", the genres "Gourmet" and "Variety", and the description "To that famous shop in a fierce battleground that has a line every day" (S23), and accepted and held by the server 200 on January 2, 2023 (S25). The video content oden03.mp4 is uploaded with the title "(Seriously) The stocks I bought last year have crashed", the genre "Investment", and the description "Someone help me. I'm running out of funds and I'm about to die" (S23), and accepted and held by the server 200 on January 12, 2023 (S25). Similarly, for accounts other than "Oden ch", the media content uploaded for each account is managed in the database 10.In this way, each time media content is uploaded, the server 200 associates the media content with the account from which it was uploaded, and stores the media content in association with its title, genre, description, and upload date and time (timestamp), and manages it in the database 10.
[0019] In the database 10A, the server 200 may analyze the uploaded media content and automatically generate a title, genre, and description instead of the title, genre, and description input by the account from which the upload is made, and may retain the generated information as corresponding metadata. For example, the server 200 may use a predetermined video analysis algorithm to analyze objects and people in a video, audio content, color, video composition, camera angle, etc., and use the information to automatically generate a title and description suitable for the video content, or automatically identify a genre (e.g., variety, sports, game commentary, news, quiz, etc.) suitable for the video content. In the case of music content, an audio analysis algorithm may be used to analyze the tempo, rhythm, melody, chords, tone, lyrics, etc. of the music, and automatically generate a title and description suitable for the music content, or automatically identify a genre (e.g., pop, rock, techno, dance, enka, ballad, hip hop, etc.). The video analysis algorithm and the audio analysis algorithm include a learning model that is machine-learned using, for example, a neural network, etc.
[0020] FIG. 6 shows a database 10B, which is an example of a database for managing media contents delivered from an external media content creator. As shown in FIG. 6, in the database 10B, each media content is managed in association with metadata including the title given to the media content, the author and performer (lyricist, composer, singer), genre, and publication time (announcement time). In the example shown in FIG. 6, for example, three music contents (Sunrise.mp3, Flower.mp3, Skyline.mp3) are managed. The music content Sunrise.mp3 is the music content of the song "Sunrise", which is pop music with lyrics written by AA, music composed by BB, and vocals by CC and released in 1998. The music content Flower.mp3 is the music content of the song "Flower", which is rock music with lyrics, music composed, and vocals all by PP and released in 2003. The music content Skyline.mp3 is the music content of the song "Skyline", a ballad composed by YY and written and sung by XX, released in 2022. The release date may be the year of release, or may be a period divided into a certain number of years (for example, 10 years) such as the 1990s, 2000s, etc. The genre may be one selected from a finite number of genres.
[0021] In the database 10B, the server 200 may analyze the media content to automatically generate a genre, instead of a genre previously assigned by an external media content creator, and hold the generated genre as metadata. For example, the server 200 uses a predetermined video analysis algorithm to analyze objects and people in a video, audio content, color, video composition, camera angle, etc., and automatically identifies a genre (e.g., action, science fiction, horror, suspense, comedy, etc.) suitable for the video content using the information. In the case of music content, an audio analysis algorithm is used to analyze the tempo, rhythm, melody, chords, tone, lyrics, etc. of the music, and automatically identifies a genre (e.g., pop, rock, techno, dance, enka, ballad, hip hop, etc.) suitable for the music content. The video analysis algorithm and the audio analysis algorithm include a learning model that is machine-learned using, for example, a neural network, etc.
[0022] The databases 10A and 10B are collectively referred to as database 10, and database 10 refers to at least one of database 10A and database 10B.
[0023] The server 200 has a media playback processing unit 204 that, after the user terminal 100 logs in, streams any of the media contents stored in the server 200 to the user terminal 100 in response to a request from the user terminal 100. FIG. 7 is a flowchart showing a flow of processing by the media playback unit 204. After the user terminal 100 logs in, the server 200 transmits information (content information) of a plurality of media contents stored in the storage (managed by the database 10) to the user terminal 100 (S31), and the user terminal 100 displays a list of playable media contents on a graphical user interface (GUI) by referring to the content information (S32). In S31, the server 200 may select some of the media contents stored in the storage, and transmit content information related to the selected plurality of media contents to the user terminal 100. In S31, the server 200 may transmit content information related to recommended contents identified by a recommended content identification unit 205 (described later) to the user terminal 100. The content information includes information for simply informing the user of the contents of the media contents and information for identifying the media contents. Examples of content information include the title of the media content, a unique ID (content ID) assigned to each media content to identify each media content in the database 10, a thumbnail of the media content, the account name of the account from which the media content was uploaded, and the author and performer of the media content. In S32, the user terminal 100 refers to the received content information and displays a list of information on the media content indicated by the content information on a GUI. Figures 8 and 9 show an example of a GUI 101 displayed on the user terminal 100 in S32. The GUI 101 refers to the content information and displays a list of information on multiple media contents indicated by the content information, and as an example, displays media content information 102 for each media content.In the example shown in Fig. 8, for example, database 10A is referenced for each media content information 102, and the information includes a title 103 of the media content, an account name 104 of an account from which the media content is uploaded, and a thumbnail 105 of the media content. In the example shown in Fig. 9, for example, database 10B is referenced for each media content information 102, and the information includes a title 103 of the media content, a singer name 106 of the media content, and a thumbnail 105 of the media content. The GUI 101 is displayed on the touch screen of the user terminal 100, and displays a plurality of pieces of media content information 102 corresponding to a plurality of media contents in a manner that allows scrolling by a swipe operation in one direction (for example, vertically).
[0024] The user terminal 100 accepts a user input to select one of the media contents displayed in the list on the GUI 101, and requests the server 200 to stream the media content selected by the user input (S33). The user input includes an input to select the media content information 102 (title 103, account name 104, thumbnail 105, singer name 106) of the corresponding media content by a tap operation. In S33, the user terminal 100 transmits a request message to the server 200, which includes information identifying the selected media content (e.g., title 103 or content ID).
[0025] The server 200 receives a request from the user terminal 100 (S34), identifies the requested media content from the database 10, and streams the identified media content to the user terminal 100 (S35). The streaming is performed using a streaming protocol such as HTTP Live Streaming, MPEG-DASH, RTSP (Real Time Streaming Protocol), or RTMP (Real Time Messaging Protocol). Streaming also includes progressive download.
[0026] The user terminal 100 receives the streaming of the media content from the server 200 (S36) and plays it (S37). In S37, the user terminal 100 plays the media content on a new GUI to which the GUI 101 is transitioned. FIG. 10 shows an example of a GUI 110 displayed in S37 (to which the GUI 101 is transitioned). The GUI 110 includes a playback screen 111 and a seek bar 112. The playback screen 111 displays the media content being played. If the media content includes video such as video content, the playback screen 111 displays the video being played. If the media content does not include video such as music content, the playback screen 111 displays the title and thumbnail of the media content (corresponding to the title 103 and thumbnail 105), or information associated with the music content such as music lyrics and CD jacket images. The seek bar 112 visually indicates the temporal playback position of the media content being played, i.e., which position is currently being played within the duration of the media content (the time it takes to complete playback = the temporal length of the media content). A control 113 is displayed on the seek bar 112. The control 113 moves on the seek bar 112 as the media content is played, thereby visually indicating which position is currently being played within the duration indicated by the end of the seek bar 112. In addition, the user terminal 100 accepts a drag operation that moves the control 113 on the seek bar 112, and by moving the control 113, it is possible to fast-forward or rewind the playback of the media content to the moved position.
[0027] 11, the playback screen 111 may be displayed so as to occupy substantially the entire GUI 110, i.e., substantially in a full-screen mode. In this case, the seek bar 112 and the controls 113 may be displayed at the bottom or top of the playback screen 111 displayed substantially in full screen. The user terminal 100 may also receive a tap operation at any position on the playback screen 111 of the GUI 110, and display the seek bar 112 and the controls 113 in a form superimposed on the playback screen 111 in response to the tap operation.
[0028] During playback of media content, user terminal 100 accepts a gesture operation on playback screen 111 of GUI 110 and transmits information corresponding to the gesture operation to server 200, and in response, server 200 selects new media content and starts streaming distribution (S39 to S41). Through S38 to S41, while playing back media content on user terminal 100, it is possible to instantly change or add media content to be played back in response to gesture operations on playback screen 111. The control in response to gesture operations relating to S38 to S41 will be described in detail later.
[0029] The server 200 has a recommended content identification unit 205 that identifies media content that is recommended to the user according to conditions as recommended media content. The recommended content identification unit 205 identifies recommended media content for each user according to a predetermined condition, for example, according to the preferences of the user. The recommended media content identification unit 205 performs processing to identify media content that is likely to be of interest to the user, for example, for each user account, based on a history (viewing history) of media content that the user has previously selected and viewed. The recommended media content identification unit 205 performs processing to identify other media content that is likely to be of interest to the user currently playing the media content in S36, based on the media content currently being streamed in S35, and to suggest the media content to the user.
[0030] (Recommended 1) The recommended media content specification unit 205 specifies other media content (second media content) that is highly related to the first media content during delivery of the media content (first media content) in S35, for example. As an example, the database 10 is referenced to specify other media content whose title contains a highly related keyword that is the same as or similar to the keyword contained in the title of the first media content as the second media content. With reference to the database 10A, the second media content may be selected only from other media content (older) whose upload date and time is earlier than the upload date and time of the first media content, or only from other media content (newer) whose upload date and time is later than the upload date and time of the first media content, or only from other media content whose upload date and time is the same as the upload date and time of the first media content, or a combination of these. With reference to database 10B, the second media content may be selected from only other media content (older) that was released before the release date of the first media content, or from only other media content (newer) that was released after the release date of the first media content, or from only other media content that was released the same as the release date of the first media content, or a combination of these. According to this recommendation 1 method, for example, as the second media content for a first media content titled "I tried singing the song AA", other media content including "song AA" in its title or other media content including "I tried singing" in its title may be selected.
[0031] (Recommended 2) The recommended media content specification unit 205 specifies other media content (second media content) that is highly related to the first media content during delivery of the media content (first media content) in S35, for example. As an example, the database 10 is referenced to specify other media content that is assigned a highly related genre that is the same as or similar to the genre assigned to the first media content as the second media content. With reference to the database 10A, the second media content may be selected only from other media content (older) that is assigned an upload date and time earlier than the upload date and time of the first media content, may be selected only from other media content (newer) that is assigned an upload date and time after the upload date and time of the first media content, may be selected only from other media content that is assigned an upload date and time the same as the upload date and time of the first media content, or may be a combination of these. With reference to the database 10B, the second media content may be selected from only other media content (older) that has a release date earlier than the release date of the first media content, or may be selected from only other media content (newer) that has a release date after the release date of the first media content, or may be selected from only other media content (newer) that has a release date the same as the release date of the first media content, or may be a combination of these. According to this recommendation method 2, for example, other media content with the genre "suspense" or other media content with the genre "horror" may be selected as the second media content for the first media content with the title of the genre "suspense horror".
[0032] (Recommended 3) The recommended media content specification unit 205 specifies other media content (second media content) that is highly related to the first media content during delivery of the media content (first media content) in S35, for example. As an example, the database 10A is referenced to specify other media content uploaded from the account from which the first media content is uploaded as the second media content. With reference to the database 10A, the second media content may be selected only from other media content (older) that has an upload date and time earlier than the upload date and time of the first media content, or only from other media content (newer) that has an upload date and time later than the upload date and time of the first media content, or only from other media content that has an upload date and time the same as the upload date and time of the first media content, or a combination of these. In addition, at this time, with reference to the database 10A, only other media content that has a highly related genre that is the same as or similar to the genre that is assigned to the first media content may be selected. According to this recommendation method 3, for example, as a second media content for a first media content uploaded from the account "Oden ch", another media content uploaded from the "Oden ch" account may be selected.
[0033] (Recommended 4) For example, during the distribution of a media content (first media content) in S35, the recommended media content specification unit 205 specifies other media content (second media content) that is highly related to the first media content. As an example, the database 10B is referenced, and other media content that is assigned to an author or performer that is highly related to the first media content and is the same or similar to the author or performer assigned to the first media content is specified as the second media content. In the case of music content as shown in FIG. 6, for example, other media content that is assigned to at least one of the lyricist, composer, and singer assigned to the first media content is selected. Although not shown, in the case of video content, for example, other media content that is assigned to at least one of the director, screenwriter, original author, and each actor assigned to the first media content is selected. With reference to the database 10B, the second media content may be selected from only other media content (older) that has a release date earlier than the release date of the first media content, or from only other media content (newer) that has a release date after the release date of the first media content, or from only other media content that has the same release date as the release date of the first media content, or a combination of these. In addition, at this time, with reference to the database 10B, only other media content that has a genre that is the same as or similar to the genre that is assigned to the first media content and has a high relevance may be selected. According to this recommendation method 4, for example, as the second media content for the first media content whose singer is CC, other media content whose singer is CC may also be selected.
[0034] (Recommended 5) For example, each time the server 200 performs streaming distribution of media content in accordance with S34 to S35, the recommended content identification unit 205 accumulates and analyzes metadata information attached to the media content for each user account to which the streaming distribution is to be performed, and identifies highly relevant media content as recommended media content (second media content) for the user account based on the streaming distribution history. For example, the database 10 may be referred to, and the titles given to the media contents that have been streamed may be analyzed to identify the second media contents based on the frequently occurring keywords included in the titles, or the genres given to the media contents that have been streamed may be analyzed to identify the second media contents based on the frequently occurring genres, or the accounts from which the media contents that have been streamed may be uploaded may be analyzed to identify the second media contents based on the frequently occurring accounts, or the descriptions of the media contents that have been streamed may be analyzed to identify the second media contents based on the frequently occurring keywords included in the descriptions, or the authors and performers of the media contents that have been streamed may be analyzed to identify the second media contents based on the frequently occurring authors and performers, or the release dates of the media contents that have been streamed may be analyzed to identify the second media contents based on the frequently occurring release dates, or a combination of these may be used. The recommended content identification unit 205 analyzes the metadata using an analysis algorithm including a learning model that has been machine-learned using a neural network or the like.In the recommendation 5 method, the recommended content identification unit 205 may identify the second media content only from media content having the same origin (same upload source, author, etc.) as the media content (first media content) being streamed in S35, may identify the second media content only from media content having a different origin (different upload source, author, etc.) from the media content (first media content) being streamed in S35, or may identify the second media content regardless of the origin. According to the recommendation 5 method, for example, for a user who frequently streams media content (high playback frequency) with a title including the keyword "ramen" and a genre "variety", a media content with a title including "ramen" and a genre "variety" may be preferentially identified and selected as the second media content.
[0035] (Gesture-based control) In S38, the gesture operation includes a swipe operation in a first direction on the playback screen 111 and a swipe operation in a second direction different from the first direction on the playback screen 111. As an example, the first direction and the second direction are directions that are substantially opposite to each other. For example, the first direction is the left direction (arrow L direction in FIG. 12), and the second direction is the right direction (arrow R direction in FIG. 12). For example, the first direction is the upward direction (arrow U direction in FIG. 12), and the second direction is the downward direction (arrow D direction in FIG. 12). As another example, the first direction and the second direction are directions that are not substantially opposite to each other. For example, the first direction is the horizontal direction (LR direction in FIG. 12), and the second direction is the vertical direction (UD direction in FIG. 12). At this time, the swipe operation in the first direction includes a swipe operation in the 1-1 direction and a swipe operation in the 1-2 direction that are substantially opposite to each other, and the swipe operation in the second direction includes a swipe operation in the 2-1 direction and a swipe operation in the 2-2 direction that are substantially opposite to each other. For example, the 1-1 direction is the left direction (arrow L direction in FIG. 12), the 1-2 direction is the right direction (arrow R direction in FIG. 12), the 2-1 direction is the up direction (arrow U direction in FIG. 12), and the 2-2 direction is the down direction (arrow D direction in FIG. 12). In S38, the user terminal 100 identifies each of the received swipe operations and transmits identification information for identifying the swipe operation to the server 200. The server 200 identifies recommended media content by the recommended media content identification unit 205 according to the received identification information, and automatically starts streaming distribution of the identified media content (S39 to S41).
[0036] The recommended media content identification unit 205 identifies the recommended media content (second media content) under different conditions depending on whether the identified swipe operation is a swipe operation in the first direction or a swipe operation in the second direction. For example, the recommended media content identification unit 205 identifies the second media content according to one of the methods of recommendations 1 to 5 in response to a swipe operation in the first direction, and identifies the second media content according to another method of recommendations 1 to 5 in response to a swipe operation in the second direction. For example, the recommended media content identification unit 205 identifies the second media content that is older than the first media content according to one of the methods of recommendations 1 to 4 in response to a swipe operation in the first direction, and identifies the second media content that is newer than the first media content according to one of the methods of recommendations 1 to 4 in response to a swipe operation in the second direction. For example, in response to a swipe operation in a first direction, the recommended media content identification unit 205 identifies a second media content from among media content limited to those having the same origin as the first media content (same upload source, author, etc.) according to the above-mentioned recommendation 3 or 4 method, and in response to a swipe operation in the second direction, identifies the second media content from among media content that also has media content having a different origin from the first media content (different upload source, author, etc.) according to a method other than the above-mentioned recommendation 3 or 4.
[0037] For example, the recommended media content identification unit 205 identifies the second media content according to one of the above-mentioned methods of recommendations 1 to 5 in response to a swipe operation in the 1-1 direction, and identifies the second media content according to another method of recommendations 1 to 5 in response to a swipe operation in the 1-2 direction. For example, the recommended media content identification unit 205 identifies the second media content that is older than the first media content according to one of the above-mentioned methods of recommendations 1 to 4 in response to a swipe operation in the 1-1 direction, and identifies the second media content that is newer than the first media content according to one of the above-mentioned methods of recommendations 1 to 4 in response to a swipe operation in the 1-2 direction. For example, in response to a swipe operation in the 1-1 direction, the recommended media content identification unit 205 identifies the second media content from among media content limited to those having the same origin as the first media content (same upload source, author, etc.) according to the above-mentioned recommendation 3 or 4 method, and in response to a swipe operation in the 1-2 direction, identifies the second media content from among media content that also has media content having a different origin from the first media content (different upload source, author, etc.) according to a method other than the above-mentioned recommendation 3 or 4.
[0038] For example, the recommended media content identification unit 205 identifies the second media content according to one of the above-mentioned methods of recommendations 1 to 5 in response to a swipe operation in the 2-1 direction, and identifies the second media content according to another method of recommendations 1 to 5 in response to a swipe operation in the 2-2 direction. For example, the recommended media content identification unit 205 identifies the second media content that is older than the first media content according to one of the above-mentioned methods of recommendations 1 to 4 in response to a swipe operation in the 2-1 direction, and identifies the second media content that is newer than the first media content according to one of the above-mentioned methods of recommendations 1 to 4 in response to a swipe operation in the 2-2 direction. For example, in response to a swipe operation in the 2-1 direction, the recommended media content identification unit 205 identifies the second media content from among media content limited to those having the same origin as the first media content (same upload source, author, etc.) according to the above-mentioned recommendation 3 or 4 method, and in response to a swipe operation in the 2-2 direction, identifies the second media content from among media content that also has media content having a different origin from the first media content (different upload source, author, etc.) according to a method other than the above-mentioned recommendation 3 or 4.
[0039] For example, in response to a swipe operation in the 1-1 direction, the recommended media content identification unit 205 identifies the second media content according to one of the methods (first method) of the above-mentioned recommendations 1 to 5, in response to a swipe operation in the 1-2 direction, identifies the second media content according to another method (second method) of the above-mentioned recommendations 1 to 5, in response to a swipe operation in the 2-1 direction, identifies the second media content according to yet another method (third method) of the above-mentioned recommendations 1 to 5, and in response to a swipe operation in the 2-2 direction, identifies the second media content according to yet another method (fourth method) of the above-mentioned recommendations 1 to 5. For example, in response to a swipe operation in the 1-1 direction, the recommended media content identification unit 205 identifies a second media content that is older than the first media content according to any one of the methods (first method) of the above-mentioned recommendations 1 to 4, in response to a swipe operation in the 1-2 direction, identifies a second media content that is newer than the first media content according to the first method of the above-mentioned recommendations 1 to 4, in response to a swipe operation in the 2-1 direction, identifies a second media content that is older than the first media content according to another method (second method) of the above-mentioned recommendations 1 to 4, and in response to a swipe operation in the 2-2 direction, identifies a second media content that is newer than the first media content according to the second method of the above-mentioned recommendations 1 to 4.For example, in response to a swipe operation in the 1-1 direction, the recommended media content identification unit 205 identifies a second media content that is older than the first media content from among the media contents limited to the first media content having the same origin (same upload source, author, etc.) according to the above-mentioned recommendation 3 or 4 method, and in response to a swipe operation in the 1-2 direction, identifies a second media content that is newer than the first media content from among the media contents limited to the first media content having the same origin (same upload source, author, etc.) according to the above-mentioned recommendation 3 or 4 method. 2. Identify media content, and in response to a swipe operation in the 2-1 direction, identify second media content that is older than the first media content from among media content that has a different origin from the first media content (different upload source, author, etc.) according to a method other than recommendations 3 and 4 described above, and in response to a swipe operation in the 2-2 direction, identify second media content that is newer than the first media content from among media content that has a different origin from the first media content (different upload source, author, etc.) according to a method other than recommendations 3 and 4 described above.
[0040] The recommended media content identification unit 205 may identify recommended media content (second media content) under different conditions depending on not only the direction of the swipe operation identified on the playback screen 111 but also on which position on the playback screen 111 the swipe operation was performed. For example, the playback screen 111 is divided into a predetermined number of regions along the vertical or horizontal direction, and the user terminal 100 distinguishes and identifies the swipe operation performed in each region, and transmits identification information for identifying the swipe operation to the server 200. The server 200 identifies recommended media content by the recommended media content identification unit 205 according to the received identification information, and automatically starts streaming distribution of the identified media content (S39 to S41). FIG. 13 shows an example in which the playback screen 111 is divided into three regions vertically as an example. In the example shown in FIG. 13, the playback screen 111 is divided into three regions, region A, region B, and region C from the top, and the recommended content identification unit 205 identifies recommended media content under different conditions according to the swipe operation performed in each region. For example, the horizontal direction is defined as the first direction, and the recommended content identification unit 205 distinguishes between a horizontal swipe operation (in the direction of arrow R1 in FIG. 13) performed on area A, a horizontal swipe operation (in the direction of arrow R2 in FIG. 13) performed on area B, and a horizontal swipe operation (in the direction of arrow R3 in FIG. 13) performed on area C, and identifies recommended media contents under different conditions. As the different conditions, any of the above-mentioned recommendation methods 1 to 5 may be selected. As an example, in response to a swipe operation in a first direction in area A, the recommended media content identification unit 205 identifies a second media content based on the title assigned to the first media content according to the above-mentioned recommendation 1 method, in response to a swipe operation in a first direction in area B, identifies a second media content based on the genre assigned to the first media content according to the above-mentioned recommendation 2 method, and in response to a swipe operation in a first direction in area C, identifies a second media content based on the origin of the first media content (upload source, author, etc.) according to the above-mentioned recommendation 3 or 4 method.
[0041] As shown in FIG. 14, in the playback screen 111, in each area (areas A, B, C) that accepts a swipe operation, a tag 114 indicating a condition for identifying a second media content in response to a swipe operation performed in the corresponding area may be displayed. For example, in response to a swipe operation in the first direction in area A, when identifying a second media content based on a title given to the first media content according to the method of recommendation 1 described above, a tag 114 indicating "title" is displayed. For example, in response to a swipe operation in the first direction in area B, when identifying a second media content based on a genre given to the first media content according to the method of recommendation 2 described above, a tag 114 indicating "genre" is displayed. For example, in response to a swipe operation in the first direction in area C, when identifying a second media content based on an account from which the first media content is uploaded according to the method of recommendation 3 described above, a tag 114 indicating "account" is displayed.
[0042] As described above, by combining swipe operations in different directions on the playback screen 111, the playback content can be changed quickly from the GUI 110, which is highly convenient for the user.
[0043] (Gesture operation on GUI101) In S31, the server 200 transmits content information on the multiple recommended contents identified by the recommended content identification unit 205, and in S32, the user terminal 100 refers to the received content information and displays the media content information 102 corresponding to each of the multiple recommended contents on the GUI 101 in the above-mentioned scroll direction. That is, in S31, the recommended content identification unit 205 identifies multiple media contents that satisfy various conditions that are likely to match the user's preferences from among the media contents in the database 10 in order to present multiple playable media contents to the GUI 101. For example, the recommended content identification unit 205 identifies multiple recommended media contents based on the media content viewing history (streaming distribution history for the user terminal 100 of this account) in the account of the logged-in user terminal 100. For example, the recommended media content identification unit 205 identifies multiple media contents related to media contents that have been streamed so far according to the method of recommendation 5 described above.
[0044] In S32, the user terminal 100 refers to the received content information, and displays the media content information 102 of the multiple recommended media contents indicated by the content information in a manner that allows scrolling in one direction (for example, vertical direction) on the GUI 101. The user terminal 100 also accepts a gesture operation on the GUI 101, and controls the display of the GUI 101 in response to the gesture operation. As an example, the user terminal 100 accepts a swipe operation in a direction (scroll direction) in which the multiple pieces of media content information 102 arranged on the GUI 101 are scrolled, and scrolls and displays the multiple pieces of media content information 102 in response to the swipe operation. That is, the GUI 101 can be scrolled in response to a swipe operation in the scroll direction at any position on the GUI 101 including the media content information 102, and the displayed media content information 102 can be changed.
[0045] Furthermore, in S32, the user terminal 100 accepts a gesture operation on the media content information 102 (title 103, account name 104, or thumbnail 105) of each media content, and switches the display of the media content information 102 that has been gesture-operated to the display of media content information 102 of other recommended media content related to the media content that has been gesture-operated in response to the gesture operation. The gesture operation includes a swipe operation in the 3-1 direction on the media content information 102, and a swipe operation in the 3-2 direction opposite to the 3-1 direction on the media content information 102. The 3-1 direction and the 3-2 direction may be collectively referred to as the third direction. Both the 3-1 direction and the 3-2 direction are substantially perpendicular to the scroll direction. As shown in FIG. 15, when a plurality of pieces of media content information 102 are arranged vertically (arrow UD direction in FIG. 15) and the scroll direction is vertical, the third direction is horizontal (arrow LR direction in FIG. 15), the 3-1 direction is rightward (arrow R direction in FIG. 15) and the 3-2 direction is leftward (arrow L direction in FIG. 15), or conversely, the 3-1 direction is leftward (arrow L direction in FIG. 15) and the 3-2 direction is rightward (arrow R direction in FIG. 15). Contrary to the example of FIG. 15, when a plurality of pieces of media content information 102 are arranged horizontally and the scroll direction is horizontal, the third direction is vertical, the 3-1 direction is upward and the 3-2 direction is downward, or conversely, the 3-1 direction is downward and the 3-2 direction is upward. In S32, the user terminal 100 identifies the received swipe operation in the third direction and switches the display of the media content information 102 according to the swipe operation. At this time, the display of the media content information 102 other than the media content information 102 on which the swipe operation has been performed is maintained without being changed.
[0046] For example, in the example illustrated in FIG. 15, when a swipe operation in the third direction is performed on the media content information 102 corresponding to the media content with the title "I called a scammer" uploaded by the account name "AAA Channel", in response to this, the display of the media content information 102 of the "I called a scammer" transitions to the display of media content information 102 for other recommended media content related to the media content of the "I called a scammer". That is, the display of the media content information 102 of the "I called a scammer" disappears, and the media content information 102 of other media content related to the "I called a scammer" is displayed instead. At this time, the display of the media content information 102 of "I tried singing a popular song" and "A collection of super soccer plays", which are other than the media content information 102 of "I called a scammer" on which the swipe operation was performed, is maintained.
[0047] FIG. 16 is a flowchart showing a flow for controlling the display of the GUI 101. As shown in FIG. 16, in S32, the user terminal 100 accepts a swipe operation on the media content information 102, and transmits identification information indicating the accepted swipe operation to the server 200 (S300). In S300, the user terminal 100 transmits information (identification information: for example, the title 103 or a content ID) that identifies the media content corresponding to the swipe-operated media content information 102 together with the identification information indicating the swipe operation. The server 200 receives the identification information and the identification information of the swipe operation (S301), and identifies the recommended media content according to the identification information and the identification information by the recommended content identification unit 205 (S302). The server 200 returns information (content information) related to the identified recommended media content to the user terminal 100 (S303). The user terminal 100 receives the content information (S304), and displays the new media content information 102 by referring to the content information (S305). That is, in S305, the display of the media content information 102 that was swiped in S300 is erased, and instead, the media content information 102 corresponding to the content information received in S304 is displayed.
[0048] In S302, the recommended content identification unit 205 identifies one recommended media content according to the identification information and the identification information indicating the swipe operation in the third direction. For example, the recommended media content identification unit 205 identifies the recommended media content according to a method of recommendation 1' to 4' similar to any one of the methods of recommendation 1 to 4 described above.
[0049] (Recommended 1´) The recommended media content identification unit 205, for example, refers to the database 10, and identifies one other media content (fourth media content) whose title includes a highly relevant keyword that is the same as or similar to the keyword included in the title of the media content corresponding to the swiped media content information 102, i.e., the media content (third media content) indicated by the identification information received in S301 (S302). With reference to the database 10A, the fourth media content may be selected only from other media content (old) that has an upload date and time earlier than the upload date and time of the third media content, may be selected only from other media content (new) that has an upload date and time after the upload date and time of the third media content, may be selected only from other media content that has an upload date and time the same as the upload date and time of the third media content, or may be a combination of these. With reference to the database 10B, the fourth media content may be selected from only other media content (older) that was released before the release date of the third media content, or may be selected from only other media content (newer) that was released after the release date of the third media content, or may be selected from only other media content that was released the same as the release date of the third media content, or may be a combination of these. According to this recommendation 1' method, for example, as the fourth media content for the third media content titled "I tried singing the song AA", other media content including "song AA" in the title or other media content including "I tried singing" in the title may be selected.
[0050] (Recommended 2´) The recommended media content identification unit 205, for example, refers to the database 10, and identifies one other media content (fourth media content) to which a genre that is the same as or similar to the genre to which the media content corresponding to the swiped media content information 102, i.e., the media content (third media content) indicated by the identification information received in S301, is assigned (S302). With reference to the database 10A, the fourth media content may be selected only from other media content (old) to which an upload date and time is earlier than the upload date and time of the third media content, may be selected only from other media content (new) to which an upload date and time is later than the upload date and time of the third media content, may be selected only from other media content to which an upload date and time is the same as the upload date and time of the third media content, or may be a combination of these. With reference to the database 10B, the fourth media content may be selected from only other media content (old) that has a release date earlier than the release date of the third media content, or may be selected from only other media content (new) that has a release date after the release date of the third media content, or may be selected from only other media content (new) that has a release date the same as the release date of the third media content, or may be a combination of these. According to this recommendation method 2', for example, other media content with the genre "suspense" or other media content with the genre "horror" may be selected as the fourth media content for the third media content with the title of the genre "suspense horror".
[0051] (Recommended 3´) The recommended media content specification unit 205, for example, refers to the database 10A and specifies one other media content (fourth media content) uploaded from the account that is the upload source of the media content corresponding to the swiped media content information 102, that is, the media content (third media content) indicated by the specification information received in S301 (S302). With reference to the database 10A, the fourth media content may be selected only from other media content (old) with an upload date and time earlier than the upload date and time of the third media content, or only from other media content (new) with an upload date and time after the upload date and time of the third media content, or only from other media content with the same upload date and time as the upload date and time of the third media content, or a combination of these. In addition, at this time, with reference to the database 10A, it may be selected only from other media content with a genre that is the same as or similar to the genre assigned to the third media content and has a high relevance. According to this recommendation method 3', for example, as a fourth media content for a third media content uploaded from the account "Oden ch", another media content uploaded from the "Oden ch" account may be selected.
[0052] (Recommended 4´) The recommended media content specification unit 205, for example, refers to the database 10B, and specifies one (fourth media content) of other media content to which the author or performer attached to the media content corresponding to the swiped media content information 102, i.e., the media content (third media content) indicated by the specification information received in S301 is highly related and is the same or similar to the author or performer attached to the media content (fourth media content) (S302). In the case of music content as shown in FIG. 6, for example, other media content in which at least one of the lyricist, composer, and singer attached to the third media content is the same or similar is selected. Although not shown, in the case of video content, for example, other media content in which at least one of the director, screenwriter, original author, and each actor attached to the third media content is the same or similar is selected. With reference to the database 10B, the fourth media content may be selected from only other media content (old) that has a release date earlier than the release date of the third media content, or from only other media content (new) that has a release date after the release date of the third media content, or from only other media content that has the same release date as the release date of the third media content, or a combination of these. In addition, at this time, with reference to the database 10B, only other media content that has a genre that is the same as or similar to the genre that is assigned to the third media content and has a high relevance may be selected. According to this method of recommendation 4', for example, as the fourth media content for the third media content whose singer is CC, other media content whose singer is CC may also be selected.
[0053] In S302, the recommended media content identification unit 205 may identify the recommended media content (fourth media content) under different conditions depending on whether the identified swipe operation is a swipe operation in the 3-1 direction or a swipe operation in the 3-2 direction. For example, the recommended media content identification unit 205 identifies the fourth media content according to one of the above-mentioned methods of recommendations 1' to 4' in response to a swipe operation in the 3-1 direction, and identifies the fourth media content according to another method of recommendations 1' to 4' in response to a swipe operation in the 3-2 direction. For example, the recommended media content identification unit 205 identifies the fourth media content that is older than the third media content according to one of the above-mentioned methods of recommendations 1' to 4' in response to a swipe operation in the 3-1 direction, and identifies the fourth media content that is newer than the third media content according to one of the above-mentioned methods of recommendations 1' to 4' in response to a swipe operation in the 3-2 direction. For example, in response to a swipe operation in the 3-1 direction, the recommended media content identification unit 205 identifies the fourth media content from among media content limited to those having the same origin as the third media content (same upload source, author, etc.) according to the above-mentioned recommendation 3' or 4' method, and in response to a swipe operation in the 3-2 direction, it identifies the fourth media content from among media content that also has media content having a different origin from the third media content (different upload source, author, etc.) according to a method other than the above-mentioned recommendation 3' or 4'.
[0054] Figure 17 shows an example in which, in response to a swipe operation in the third direction on media content information 102 (see Figure 15) for "I called a scammer" uploaded from the account "AAA Channel," the display of the media content information 102 for "I called a scammer" is switched to the display of media content information 102 for "New Year's monologue," also uploaded from the "AAA Channel" and identified as recommended media content (fourth media content) in S302.
[0055] (Preview playback) The GUI 101 moves the display of the plurality of media content information 102 displayed in a list in response to a scroll operation in the scroll direction. In other words, the GUI 101 hides the media content information 102 from the top that was displayed in response to the scroll operation, and displays the media content information 102 that was hidden. In response to this scroll operation, the position in the scroll direction in which each media content information 102 is displayed in the GUI 101 moves. Here, the GUI 101 previews and plays back media content corresponding to the media content information 102 that is located at a specific position in the scroll direction in the GUI 101. For example, when the scroll direction is vertical, the specific position is a position that is a predetermined pixel away from the top or bottom edge of the screen of the GUI 101. For example, when the scroll direction is horizontal, the specific position is a position that is a predetermined pixel away from the left or right edge of the screen of the GUI 101. For example, the specific position is a position that is approximately at the center of the GUI 101 in the scroll direction. In response to the scroll operation of the user, the user terminal 100 previews and plays back media content corresponding to the media content information 102 located at the specific position.
[0056] Preview playback includes playing the media content while displaying the media content information 102 in its current position. For example, preview playback repeatedly plays a short portion (e.g., a few seconds) of the duration of the media content in a digest-like manner. If the media content includes video, such as video content, preview playback may play the video in place of at least one of the title 103, account name 104, and thumbnail 105 without changing the position of the media content information 102. If the media content does not include video, such as music content, preview playback may play music while maintaining the display of the media content information 102.
[0057] In S300, the user terminal 100 may be configured to accept gesture operations only for media content information 102 for which preview playback is being performed. In this case, the user terminal 100 does not accept gesture operations for media content information 102 for which preview playback is not being performed, and even if a gesture operation is performed for media content information 102 for which preview playback is not being performed, the user terminal 100 does not transmit identification information or specific information corresponding to the swipe operation (S300).
[0058] As described above, on GUI101, which is the list display screen before playing media content, by performing a swipe operation in a direction other than the screen scroll direction, it is possible to display information on more media content that is a candidate for playback, allowing the user to find preferred media content more quickly, resulting in high user convenience.
[0059] (Variation of GUI101) FIG. 18 shows a GUI 130, which is another example of the GUI in which the user terminal 100 displays the media content information 102 in S32. The GUI 130 displays a matrix table with the account name 107 of the account from which the media content is uploaded on the horizontal axis and the time information 106 indicating the time when the media content was uploaded on the vertical axis, and displays the media content information 102 of the corresponding media content in the table. In a manner similar to a television program guide, the media content information 102 is displayed in the square of the table where the account name 107 corresponding to the account name from which the media content is uploaded and the time information 106 corresponding to the upload date and time of the media content intersect for each media content. The account name 107 displays the account name of one or more specific accounts among the multiple accounts managed in the database 10. The time information 106 displays the time specifying at least one of the year, month, day, hour, and minute when the media content was uploaded.
[0060] As an example, the account name 107 in the table of the GUI 130 displays the account name of the account (favorite account) that the user has registered as a favorite, and displays the media content information 102 of the media content from which the favorite account is the upload source. As shown in FIG. 19, the server 200 holds, for each account, information 10a of other accounts that the user of the account has registered as a favorite in the database 10A. Favorite registration is performed, for example, by the user terminal 100 accepting a selection operation of the account name 104 in the media content information 102 on the GUI 101, or a selection operation of selecting an account from which the media content being played back is uploaded on the GUI 110, and transmitting a request (favorite registration request) to the server 200 to register the selected account as a favorite. In response to the favorite registration request, the server 200 registers the account requested in the favorite registration request in the database 10A as a favorite account of the account of the user terminal 100 that is the request source. Through these procedures, each time server 200 receives a favorites registration request from user terminal 100, server 200 registers the account requested in the favorites registration request as a favorite account of the login account of user terminal 100. Through these procedures, one or more other accounts that are registered as favorites are registered for each account in database 10.
[0061] As an example, in S31, the server 200 refers to the favorite account information 10a registered in the login account of the user terminal 100 in the database 10, identifies one or more media contents uploaded by each of the one or more favorite accounts indicated in the favorite account information 10a, and transmits content information indicating the media contents of the identified favorite accounts to the user terminal 100. The content information includes, for each favorite account, the title, upload date and time, thumbnail, etc. of the media content uploaded by the favorite account. In S32, the user terminal 100 refers to the received content information, and displays, for each favorite account, media content information 102 of the media content uploaded by the favorite account on the GUI 130. In S32, the user terminal 100 refers to the upload date and time of the media content for each favorite account, and displays the media content information 102 at the position of the time information 106 corresponding to the upload date and time on the GUI 130. In the example shown in Figure 20, on the GUI 130, for example, media content information 102 of the media content "A leisurely commentary on the latest movies", which was uploaded from an account "XXX Channel" registered as a favorite account, is displayed at the intersection of the account name 107 of "XXX Channel" and the time information 106 corresponding to January 2, 2023, when "A leisurely commentary on the latest movies" was uploaded.
[0062] The user terminal 100 receives a tap operation to select media content information 102 on the GUI 130, and in response to the tap operation, plays back the media content indicated by the selected media content information 102 (S33 to S38).
[0063] GUI 130 arranges multiple pieces of time information 106 vertically on the vertical axis, but there are cases where they do not fit on one screen. In this case, a swipe operation in the vertical direction (the direction of the arrows UD in FIG. 20) is accepted on GUI 130, and GUI 130 is scrolled vertically in response to this swipe operation. This scroll causes at least one piece of time information 106 that was displayed before the scroll to become hidden, and at least one piece of adjacent time information 106 that was hidden before the scroll to be displayed.
[0064] In GUI 130, when account names 107 corresponding to multiple favorite accounts indicated in favorite account information 10a are arranged on the horizontal axis, they may not fit on one screen. In this case, a swipe operation in the horizontal direction (the direction of arrows L and R in FIG. 19) is accepted on GUI 130, and GUI 130 is scrolled in the horizontal direction in response to this swipe operation. This scroll causes at least one account name 107 that was displayed before the scroll to be hidden and not displayed, and at least one account name 107 that was hidden and not displayed before the scroll to be displayed.
[0065] In the above, an example has been shown in which the account name 107 is displayed on the horizontal axis and the time information 106 is displayed on the vertical axis, but conversely, the time information 106 may be displayed on the horizontal axis and the account name 107 may be displayed on the vertical axis on the GUI 130. In this case, conversely to the above, the display of the account name 107 is transitioned in response to a swipe operation in the vertical direction (the direction of the arrow UD in FIG. 20) on the GUI 130, and the display of the time information 106 is transitioned in response to a swipe operation in the horizontal direction (the direction of the arrow LR in FIG. 19) on the GUI 130.
[0066] In this way, the GUI 130 allows users to quickly search for media content they want to watch across multiple favorite accounts and multiple time slots, just like a TV program guide. Users can quickly search for their preferred media content while comparing multiple favorite accounts and multiple time slots, providing high convenience to users.
[0067] (Hardware configuration) Next, an example of the hardware configuration of the user terminal 100 and the server 200 will be described. The server 200 is a computer device such as a personal computer or a workstation, and has a web server function. The server 200 includes a communication circuit, a memory, a processor, a storage, and the like, which are connected by a bus. The communication circuit is a communication circuit that establishes communication C1 with the user terminal 100, and includes, for example, a network board for connecting to the Internet. The processor is a control unit including a processing unit such as a CPU or an MPU, and performs various controls of the server 200 by reading and executing program instructions stored in the memory. The memory includes a ROM and a RAM, and stores data used by the processor temporarily or permanently, computer programs executed by the processor, and the like. In this embodiment, data such as uploaded media content, the database 10, and various information received from the user terminal 100 are stored in the memory. In this embodiment, a computer program including program instructions corresponding to the steps executed by the server 200, such as S10, S12, S13, S20, S22, S24, S25, S31, S34, S35, S39 to S41, and S301 to S303, is held in the memory, and these program instructions are read and executed by the processor. The storage is a storage unit including a storage medium such as an HDD or SSD, and data such as uploaded media content, the database 10, the computer program, and various information received from the user terminal 100 is stored in the storage. The memory and the storage may be integrated. The server 200 may be physically composed of one computer device, or may be composed of multiple computer devices.
[0068] The user terminal 100 is a computer device such as a personal computer or a smartphone. The user terminal 100 includes a communication circuit, a memory, a processor, a storage, a touch screen, and the like, which are connected by a bus. The communication circuit is a communication circuit that establishes communication C1 with the server 200, and includes, for example, a network board for connecting to the Internet and a cellular communication circuit. The processor is a control unit including a processing unit such as a CPU or an MPU, and performs various controls of the user terminal 100 by reading and executing program instructions stored in the memory. The memory includes a ROM and a RAM, and stores data used by the processor temporarily or permanently, computer programs executed by the processor, and the like. In this embodiment, data such as various information received from the server 200 is stored in the memory. In this embodiment, a computer program including program instructions corresponding to the steps executed by the user terminal 100, such as S10, S11, S20, S21, S23, S32, S33, S36 to S38, S300, S304, and S305, is held in the memory, and these program instructions are read and executed by the processor. The storage is a storage unit including a storage medium such as an HDD or SSD, and the computer program and data such as various information received from the server 200 are stored in the storage. The memory and the storage may be integrated. The touch screen is an integrated display device and input device, and displays characters and images, and accepts gesture operations using a user's finger or stylus on the screen. The touch screen is also called a touch panel.
[0069] The computer program stored in the user terminal 100 may be an app that is pre-installed when the user terminal 100 is manufactured and sold, or it may be an app that is installed at the user's discretion, such as by downloading it from an external app store via the Internet.
[0070] The computer programs stored in server 200 may be apps that are pre-installed when server 200 is manufactured and sold, or apps that are installed at the user's discretion, such as by downloading them from an external app store via the Internet.
[0071] Although the embodiment of the present invention has been described above with reference to Figures 1 to 20, this is for illustrative purposes only and is not limiting. It is apparent that various modifications and changes can be made to the embodiment without departing from the spirit of the present invention as set forth in the claims. [Explanation of symbols]
[0072] 10. Database 100 user terminals 101 GUI 102 Media Content Information 103 Titles 104 Account Name 105 Thumbnails 110 GUI 111 Playback screen 112 Seek Bar 113 Controls 200 Servers 201 Account Creation Department 202 Login processing section 203 Upload Reception 204 Media playback processing unit 205 Content Identification Section
Claims
1. A program that causes a computer equipped with a touchscreen that accepts gesture controls to perform a method of playing media content delivered from a server over a network, The aforementioned method, A first step is to play a first media content which is one of the media contents held on the aforementioned server, During playback of the first media content, a second step is to identify a second media content related to the first media content according to a first condition and start playback in response to a first gesture operation, including a gesture in a first direction, on the playback screen, on the playback screen; A program comprising: a third step during playback of a first media content, in response to a second gesture operation on the playback screen, which includes a gesture in a second direction different from the first direction, the program identifies a third media content associated with the first media content according to a second condition different from the first condition, and starts playback.
2. The program according to claim 1, A program in which the first condition is one of (A) to (E) below, and the second condition is another one of (A) to (E) below. (A) High relevance based on the title attached to the aforementioned first media content. (B) High relevance based on the genre assigned to the first media content. (C) The first media content is highly relevant based on the user account that uploaded it to the server. (D) The media content in question is highly related based on at least one of the authors and performers of the media. (E) The computer has a high degree of relevance to the user account logged into the server, based on the delivery history, which is the history of media content previously delivered from the server to that user account.