Information processing method, information processing device, and information processing program
The described user interface enhances UX by dynamically switching content display elements and synchronizing background effects with genre, addressing the separation of operations in conventional interfaces and improving immersion.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-12-18
- Publication Date
- 2026-03-19
AI Technical Summary
Conventional user interfaces for viewing content via communication networks lack immersion and unity, with separate operations for interface interaction and content playback, leading to degraded user experience (UX) due to static displays and accidental transitions.
Implement a user interface that switches content display elements in a carousel area based on directional input, sets a switching threshold for movement, extends preview playback time, and synchronizes background effects with content genre, using machine learning to predict content preferences.
Enhances user interface operability and UX by providing immersive and genre-appropriate content presentation, improving user engagement and interaction.
Smart Images

Figure 0007833607000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a technology suitable for use when playing and viewing content distributed via a communication network on a user terminal.
Background Art
[0002] As a conventional technique for viewing a video distributed via a communication network on a user terminal, there is provided a user trend database that acquires and accumulates user trend data that is a user's operation history, and based on the user trend data, selects a keyword related to the user trend, selects content data based on this keyword, creates a playlist that associates the playback order of the selected multimedia content with the location address of the multimedia content related to the playback, and transmits it to the user terminal, and a media viewing application that is executed on the user terminal device, receives the multimedia content from the content distribution server according to the playlist, and plays it. A multimedia viewing system including the above is known (see Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, in mobile apps and web services, various user interfaces are used to display content. However, the conventional user interface has a problem that the linkage with the playback of content is limited, and there is a lack of immersion and production effects as a user experience (UX: User Experience).
[0005] In particular, the user interface for viewing promotional videos is predominantly static carousel displays or list-type layouts, and because user interface operation and content playback are separated, there is a problem in that it lacks a sense of unity as a user experience (UX). Furthermore, there are problems such as screen transitions due to accidental operation during playback and a lack of presentation appropriate to the genre of content, which degrades the quality of the user experience (UX) and diminishes immersion.
[0006] Therefore, in one aspect, the present invention aims to provide a technology that can improve the operability of the user interface and enhance the quality of the user experience (UX). [Means for solving the problem]
[0007] To solve the above problems, the information processing method according to the present invention is a method executed by an information processing device, and includes the steps of: switching content display elements arranged and displayed in a carousel display area of a user interface screen displayed on the output unit of the information processing device in response to a movement instruction operation along a first direction input via the input unit of the information processing device; and previewing and playing back content corresponding to the content display elements arranged and displayed in the carousel display area, wherein a switching threshold value, which is a boundary value for whether or not to switch the content display elements arranged and displayed in the carousel display area, is set as a predetermined dimension along the first direction, and the preview playback time is extended when the amount of movement of the movement instruction operation along the first direction is less than the switching threshold value.
[0008] The information processing method according to the present invention includes a step of starting the preview playback and the background effect to be displayed in the background effect area of the user interface screen in a synchronized manner, and the background effect may be changed according to the genre of content corresponding to the content display element that is being previewed.
[0009] The information processing method according to the present invention may restrict predetermined operations input via the input unit during the preview playback.
[0010] The information processing method according to the present invention may also involve using training data, in which machine learning is performed to generate a trained model, with the composition ratio of the content by genre corresponding to the content display element previewed and played for N times as input data, and the genre of the content corresponding to the content display element previewed and played for N+1 times as output data. The data relating to the preview playback up to N times in the execution is used as input data for prediction, and based on the trained model, the genre of the content to be previewed and played for N+1 times, corresponding to the input data for prediction, is estimated.
[0011] Furthermore, the information processing device according to the present invention includes means for switching content display elements arranged and displayed in a carousel display area of a user interface screen displayed on an output unit in response to a movement instruction operation along a first direction input via an input unit, and means for previewing and playing back content corresponding to the content display elements arranged and displayed in the carousel display area, wherein a switching threshold value, which is a boundary value for whether or not to switch the content display elements arranged and displayed in the carousel display area, is set as a predetermined dimension along the first direction, and the preview playback time is extended when the amount of movement of the movement instruction operation along the first direction is less than the switching threshold.
[0012] The information processing device according to the present invention has means for starting the preview playback and the background effect to be displayed in the background effect area of the user interface screen in a synchronized manner, and may change the background effect according to the genre of content corresponding to the content display element that is being previewed.
[0013] Furthermore, the information processing program according to the present invention is a program executed in an information processing device, and the information processing device functions as a means for switching content display elements arranged and displayed in a carousel display area of a user interface screen displayed on the output unit of the information processing device in response to a movement instruction operation along a first direction input via the input unit of the information processing device, and a means for previewing and playing back content corresponding to the content display elements arranged and displayed in the carousel display area, wherein a switching threshold value, which is a boundary value for whether or not to switch the content display elements arranged and displayed in the carousel display area, is set as a predetermined dimension along the first direction, and the preview playback time is extended when the amount of movement of the movement instruction operation along the first direction is less than the switching threshold.
[0014] The information processing program according to the present invention may function as a means for synchronizing the start of the preview playback and the background effect to be displayed in the background effect area of the user interface screen, and may change the background effect according to the genre of content corresponding to the content display element that is being previewed. [Effects of the Invention]
[0015] According to the present invention, in one respect, it is possible to improve the operability of the user interface and enhance the quality of the user experience (UX). [Brief explanation of the drawing]
[0016] [Figure 1] This is a schematic diagram of the overall configuration of a video distribution system according to an embodiment of the present invention. [Figure 2] Figure 1 is a block diagram showing the configuration of the video distribution device in the video distribution system. [Figure 3] Figure 1 is a block diagram showing the configuration of user terminals in the video distribution system. [Figure 4]It is a diagram showing an example of a user interface screen displayed on a user terminal of the video distribution system in FIG. 1. [Figure 5] It is a flowchart showing a processing procedure in the video distribution system of FIG. 1. [Figure 6A] It is a diagram for explaining a switching threshold value for a swipe operation on the user interface screen in FIG. 4. [Figure 6B] It is a diagram for explaining a switching threshold value for a swipe operation on the user interface screen in FIG. 4. [Figure 6C] It is a diagram for explaining a switching threshold value for a swipe operation on the user interface screen in FIG. 4. [Figure 7] It is a flowchart showing a processing procedure for controlling background effects in a user terminal of the video distribution system in FIG. 1. [Figure 8] It is a diagram showing an example of a full-screen playback screen displayed on a user terminal of the video distribution system in FIG. 1. [Figure 9] It is a flowchart showing a processing procedure for operation restrictions during preview playback of a video in a user terminal of the video distribution system in FIG. 1.
Mode for Carrying Out the Invention
[0017] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the following embodiments, a case where the information processing method according to the present invention is implemented in a video distribution system will be described as an example.
[0018] <000The video distributed in the video distribution service provided by the video distribution system on which the information processing method according to the present invention is implemented may, for example, be a video related to a book or a promotional video for a book.
[0020] (Overall structure) Figure 1 is a schematic diagram of the overall configuration of a video distribution system 100 that provides a video distribution service according to an embodiment, as an example of a specific configuration including the implementation of the information processing method according to the present invention.
[0021] The video distribution system 100 in this embodiment is comprised of a video distribution device 10 and a user terminal 20. The user terminal 20 comprising the video distribution system 100 may be one or multiple.
[0022] The video distribution device 10 is a device that has the function of providing video distribution services via the communication network 90.
[0023] The video distribution device 10 is connected to the user terminal 20 via a communication network 90 so that they can communicate with each other.
[0024] The communication network 90 is a communication network for performing communications including the transmission and reception of various signals such as control signals and data signals, and may be configured as a communication network that includes at least one of the communication methods of wired communication and wireless communication.
[0025] The communication network 90 is comprised of a communication network that includes at least one of the following: the Internet, an intranet, a WAN (Wide Area Network), a LAN (Local Area Network), and a Virtual Private Network (VPN), which are implemented by at least one of the following communication methods: wired communication and wireless communication.
[0026] The user terminal 20 is a device used by a person who uses the video distribution service provided by the video distribution device 10 via the communication network 90, i.e., a user in this invention.
[0027] The user terminal 20 is connected to the video distribution device 10 via the communication network 90 so that it can communicate with each other.
[0028] The video distribution device 10 and the user terminal 20 may be implemented by a computer device.
[0029] The video distribution device 10 may be implemented by various devices that can communicate with the user terminal 20 via a communication network 90 using at least one of the communication methods, wired communication or wireless communication.
[0030] The user terminal 20 may be implemented by various devices capable of communicating with the video distribution device 10 via the communication network 90 using at least one of the following communication methods: wired communication and wireless communication.
[0031] As shown in Figure 2, the video distribution device 10 includes a control unit 11, a storage unit 12, a communication unit 13, an input unit 14, and an output unit 15. The user terminal 20 also includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, and an output unit 25, as shown in Figure 3.
[0032] The control unit 11 of the video distribution device 10 and the control unit 21 of the user terminal 20 are configured to include a processor such as a CPU (Central Processing Unit) that performs calculations.
[0033] The storage unit 12 of the video distribution device 10 and the storage unit 22 of the user terminal 20 are configured to include a storage device such as memory for storing data.
[0034] The storage unit 12 of the video distribution device 10 and the storage unit 22 of the user terminal 20 may be configured to include, for example, volatile memory such as RAM (Random Access Memory) that provides a working area (memory) and non-volatile memory such as ROM (Read Only Memory) that provides a storage area (storage). The storage unit 12 of the video distribution device 10 and the storage unit 22 of the user terminal 20 may also be configured to include auxiliary storage devices such as HDD (Hard Disk Drive) or SSD (Solid State Drive) that provide storage areas (storage), as needed.
[0035] The video file database 121 is stored in the storage unit 12 of the video distribution device 10. The video file database 121 stores video data of videos distributed in the video distribution service provided by the video distribution system 100. In other words, the video file database 121 records and stores video data files for each video.
[0036] The background effect database 122 is stored in the memory unit 12 of the video distribution device 10. The background effect database 122 stores background effect data corresponding to the genre of video distributed in the video distribution service provided by the video distribution system 100. In other words, the background effect database 122 records and stores background effect data files for each type of video genre.
[0037] The communication unit 13 of the video distribution device 10 and the communication unit 23 of the user terminal 20 are configured to include a communication interface / network interface that performs at least one of wired communication and wireless communication, and are connected to the communication network 90 so as to be able to communicate with it.
[0038] The communication interface / network interface constituting the communication unit 13 of the video distribution device 10 and the communication unit 23 of the user terminal 20 is equipped with a function (i.e., a communication processing function) to send and receive various signals such as control signals and data signals with other external devices via the communication network 90.
[0039] For example, various signals such as control signals and data signals provided by the video distribution device 10 are transmitted to the user terminal 20 via the communication network 90 according to the control of the communication unit 13 and received according to the control of the communication unit 23.
[0040] For example, various signals such as control signals and data signals generated by the user terminal 20 are transmitted to the video distribution device 10 via the communication network 90 according to the control of the communication unit 23 and received according to the control of the communication unit 13.
[0041] The input unit 14 of the video distribution device 10 and the input unit 24 of the user terminal 20 are configured to include an input device that accepts input operations. The input devices that make up the input unit 14 of the video distribution device 10 and the input unit 24 of the user terminal 20 may be, for example, a keyboard, mouse, touchscreen, microphone, etc.
[0042] The output unit 15 of the video distribution device 10 and the output unit 25 of the user terminal 20 are configured to include output devices that display and output the content of input operations performed via the input unit 14 of the video distribution device 10 or the input unit 24 of the user terminal 20, as well as various other information. The output devices constituting the output unit 15 of the video distribution device 10 and the output unit 25 of the user terminal 20 may be, for example, a display, a speaker, an audio jack, etc. The output unit 15 of the video distribution device 10 and the output unit 25 of the user terminal 20 may also be configured to include an interface for outputting print data to a printer (not shown).
[0043] The input unit 14 and output unit 15 of the video distribution device 10 may be devices that integrate input and output functions, such as a touchscreen.
[0044] The input unit 24 of the user terminal 20 includes at least a touchscreen. The touchscreen included as at least the input unit 24 of the user terminal 20 is configured as a device capable of detecting touch gestures (in other words, screen contact operations) such as touch and drag, swipe, and flick, and identifying the type of touch gesture detected.
[0045] In other words, the user terminal 20 may be equipped with a touchscreen that combines the functions of an input unit 24 and an output unit 25.
[0046] The video distribution device 10 may be configured, for example, by a server computer.
[0047] The user terminal 20 may be a fixed terminal or a mobile terminal consisting of, for example, a desktop computer, a laptop computer, a notebook computer, a tablet terminal, or a smartphone.
[0048] (User terminal) The storage unit 22 of the user terminal 20 stores a content playback program 26 (which corresponds to the information processing program according to the present invention), which is a computer program that is read by the control unit 21, including the CPU (processor), and executed to realize various control processes for the overall operation of the user terminal 20 and each function of the control unit 21.
[0049] When the content playback program 26 stored in the memory unit 22 is executed in the control unit 21, which includes a CPU (processor), the computer device acting as a user terminal 20 operates and functions as a content playback device (which corresponds to the information processing device according to the present invention).
[0050] When a predetermined program (including the content playback program 26) stored in the memory unit 22 is read and executed in the control unit 21, the control unit 21 generates an operation detection unit 211 (corresponding to the operation detection means of the information processing device according to the present invention), a display control unit 212 (corresponding to the display control means of the information processing device according to the present invention), a playback control unit 213 (corresponding to the playback control means of the information processing device according to the present invention), a background control unit 214 (corresponding to the background control means of the information processing device according to the present invention), and an operation restriction unit 215 (corresponding to the operation restriction means of the information processing device according to the present invention).
[0051] In this description, "transmission" includes the exchange of information and data through writing to and reading from the storage unit 22.
[0052] (User terminal screen configuration) Figure 4 shows an example of the display of the touchscreen, which serves as the input unit 24 and output unit 25 of the user terminal 20, when the content playback program 26 is executed on the user terminal 20, and is a diagram showing an example of the user interface screen 50 displayed on the touchscreen of the user terminal 20.
[0053] The user interface screen 50 may be implemented as a web page displayed by a web browser.
[0054] The user interface screen 50 has, in general terms, an upper preview playback area 51 and background effect area 57, and a lower carousel display area 52.
[0055] The user interface screen 50 may include a search bar 59. The search bar 59 may be positioned, for example, below the preview playback area 51 (see the example shown in Figure 4), or above the preview playback area 51.
[0056] The preview playback area 51 is the area where the video corresponding to the content display element 53 is previewed and played.
[0057] The preview playback area 51 may be configured to display at least one of the following: an icon indicating the video playback status (e.g., play, pause, stop) and a seek bar indicating the current playback position within the entire video data.
[0058] Content display elements are placed and displayed in the carousel display area 52. In the example shown in the figure, three content display elements 53A, 53B, and 53C are arranged and displayed along the left-right direction.
[0059] The content display elements placed and displayed in the carousel display area 52 may be one, two, or four or more.
[0060] When referring to any of the content display elements, or when referring to all of the content display elements together, without distinguishing each of them individually, the notation "Content Display Element 53" is used.
[0061] The carousel display area 52 may be configured in a multi-layered manner as a tag structure (in other words, so that each category / section is displayed separately) (see the example shown in Figure 4), or it may be configured in a single layer without a tag structure (in other words, so that it is displayed without classification / sectioning).
[0062] If the carousel display area 52 is configured in a multi-layered tag structure, for example, tags (in other words, classifications / categories) such as genre, author, and persona may be provided for the content display element 53.
[0063] Each content display element 53 is associated with one of the video data files for each video that are recorded and stored in the video file database 121 stored in the storage unit 12 of the video distribution device 10. In other words, each content display element 53 identifies the video data file stored in the video distribution device 10.
[0064] Each content display element 53 includes a thumbnail image, a title, and a genre label. Specifically, for example, content display element 53A includes a thumbnail image 54A, a title 55A, and a genre label 56A.
[0065] In the example shown in the figure, the content display element 53 is of card type, but it is not limited to card type; it can take any form as long as it is an element that is arranged and displayed independently of others. For example, the content display element 53 may be various forms of icon type, button type, ribbon type, or sticker type.
[0066] If the video distributed in the video distribution service provided by the video distribution system 100 is a video related to a book or a promotional video for a book, the thumbnail images 54A, 54B, and 54C may be a scene from the video (i.e., a still image preview), or they may be the cover of the book.
[0067] If the video distributed in the video distribution service provided by the video distribution system 100 is a video related to a book or a promotional video for a book, then the titles 55A, 55B, and 55C may be the titles of the books, and the genre labels 56A, 56B, and 56C may be the genres of the books.
[0068] The genre labels 56A, 56B, and 56C of the content display elements 53A, 53B, and 53C are not limited to being displayed or expressed in text, but may also be displayed or expressed by the color of part or all of the card (or part or all of an icon, button, ribbon, or sticker).
[0069] When a book's genre is used as genre label 56A, 56B, or 56C, the specific genre is not limited to a particular type, and may include, for example, action, dynamic, human drama, lyric, suspense, horror, fantasy, and romance.
[0070] The background is displayed in the background display area 57 while the video is playing in the preview playback area 51.
[0071] In the example shown in Figure 4, the background effect area 57 is set only on the upper part of the user interface screen 50. However, the background effect area 57 may be set over a wider area than shown in Figure 4, that is, over the entire or nearly entire user interface screen 50.
[0072] The background displayed in background effect area 57 may be, for example, an image or video that expresses and creates the atmosphere of a movie theater screening hall. Specifically, for example, the screen may be darkened and red-toned lighting may be turned on.
[0073] The background displayed in the background effect area 57 may be configured to dynamically change the background image, colors (in other words, the overall tone), and lighting depending on the genre of the video being played. For example, if the genre of the video being played is action or dynamic, the lighting may be configured to blink or flash with high saturation and strong tones. If the genre of the video being played is human drama or lyrical, the lighting may be configured to fade in and fade out with low saturation and subdued tones.
[0074] (Video data) Each content display element 53 displayed on the user interface screen 50 is associated with one of the video data files stored in the video distribution device 10.
[0075] For example, each of the content display elements 53 is assigned an identification number that allows each of these content display elements 53 to be individually identified.
[0076] The video file database 121 stored in the storage unit 12 of the video distribution device 10 records and stores data that combines the identification number of each content display element 53 with the video data file related to the video corresponding to that content display element 53.
[0077] Each of the genre types displayed as genre labels 56A, 56B, and 56C for content display elements 53A, 53B, and 53C is associated with one of the background effect data files stored in the video distribution device 10.
[0078] For example, each genre type displayed as a genre label is assigned an identification number that allows each of these genre labels / genre types to be individually identified.
[0079] The background effect database 122 stored in the memory unit 12 of the video distribution device 10 stores and records combination data of an identification number for each genre label / genre type and a background effect data file related to the background effect (specifically, an effect performed using the displayed background) corresponding to that genre label / genre type.
[0080] (Processing procedure for video distribution system) Figure 5 is a flowchart showing the processing procedure in the video distribution system 100 according to the embodiment.
[0081] In the following description, "preview playback" refers to the operation of playing a video with limited playback time or range in order to check the content of the video corresponding to each content display element 53. For example, a video preview playback may be performed by playing only the beginning of the video for a predetermined time, playing only the main part of the video for a predetermined time, or playing a digest video edited to a predetermined length.
[0082] Furthermore, "full playback" refers to the action of playing the entire video corresponding to each content display element 53 from the beginning.
[0083] When the content playback program 26 is executed on the user terminal 20, the initial state of the user interface screen 50 displayed on the touchscreens, which serve as the input unit 24 and output unit 25 of the user terminal 20, may be such that content display elements 53 are placed and displayed in the carousel display area 52, or the content display elements 53 may not be placed (i.e., not displayed).
[0084] First, the user performs a swipe operation 58 by sliding their finger left or right on the input section 24 (specifically, the touchscreen) of the user terminal 20 (step S1-1).
[0085] The content display elements 53 (in the example shown in the figure, three content display elements 53A, 53B, and 53C) arranged and displayed in the carousel display area 52 of the user interface screen 50 slide along the left-right direction when the user performs a swipe operation 58 by sliding their finger along the left-right direction on the touchscreen.
[0086] As the content display element 53 slides, it disappears from the left and right edges, and new content display elements 53 appear from the left and right edges. This switches the content display elements 53 that are placed and displayed in the carousel display area 52.
[0087] As part of the processing on the user terminal 20, the operation detection unit 211 of the control unit 21 detects a swipe operation 58 made by the user along the left-right direction on the input unit 24 (specifically, the touchscreen).
[0088] When the user swipes left or right (step S1-1), the content display elements 53 placed and displayed in the carousel display area 52 are switched, and the user stops swiping when the content display element 53 they want to view is displayed. This selects the content display element 53 that the user wishes to view (step S1-2).
[0089] The user performs a leftward or rightward swipe operation 58, multiple times as necessary, so that the content display element 53 related to the video they wish to preview or play in full is positioned in the carousel display area 52.
[0090] The content display element 53 that is placed at a predetermined position (referred to as the "playback target position") in the carousel display area 52 by a swipe operation 58 performed by the user in the left-right direction may be the content display element 53 selected by the user.
[0091] For example, when two content display elements 53 are placed and displayed in the carousel display area 52, the selected content display element 53 may be either the right-hand content display element 53 or the left-hand content display element 53 (i.e., the position of the right-hand content display element 53 or the position of the left-hand content display element 53 may be the playback target position). Also, when three content display elements 53 are placed and displayed in the carousel display area 52, the selected content display element 53 may be the central content display element 53 (content display element 53B in the example shown in Figure 4) (i.e., the position of the central content display element 53 may be the playback target position).
[0092] Since each content display element 53 is associated with one of the video data files stored in the video distribution device 10, the selection of a content display element 53 identifies the video data file stored in the video distribution device 10.
[0093] As part of the processing on the user terminal 20, a control signal corresponding to the content of the operation on the input unit 24 (specifically, the touchscreen) is transmitted from the operation detection unit 211 of the control unit 21 to the display control unit 212. In the processing of step S1-2, a control signal corresponding to a leftward swipe operation 58, or a control signal corresponding to a rightward swipe operation 58, is transmitted.
[0094] The display control unit 212 controls the movement of content display elements 53 arranged and displayed in the carousel display area 52 along the left-right direction based on a control signal corresponding to a leftward swipe operation 58 or a control signal corresponding to a rightward swipe operation 58 transmitted from the operation detection unit 211. It moves content display elements 53 located at the edges in the left-right direction out of the carousel display area 52 to hide them, and makes new content display elements 53 appear from the left-right edges of the carousel display area 52 to display them.
[0095] Between steps S1-1 and S1-2, nothing may be displayed in the preview playback area 51, or an icon (for example, a triangle) indicating the start of playback (in other words, a playback waiting state) may be displayed.
[0096] Next, in step S1-2, a trigger is fired to preview the video corresponding to the content display element 53 selected by the user (step S1-3).
[0097] Specifically, after a predetermined time (referred to as the "trigger firing time") has elapsed since the user stopped swiping 58 in the left-right direction, the content display element identification number and the genre label / genre type identification number assigned to the content display element 53 selected in step S1-2 are transmitted from the user terminal 20 to the video distribution device 10 via the communication unit 23 of the user terminal 20 and the communication network 90.
[0098] The transmission of the content display element identification number and the genre label / genre type identification number from the user terminal 20 to the video distribution device 10 triggers the preview playback of the video.
[0099] As part of the processing on the user terminal 20, when the time period during which the operation detection unit 211 of the control unit 21 does not detect a swipe operation 58 along the left or right direction on the input unit 24 (specifically, the touchscreen) by the user has elapsed, a control signal corresponding to the trigger for preview playback of the video is transmitted from the operation detection unit 211 to the display control unit 212.
[0100] When the display control unit 212 receives a control signal from the operation detection unit 211 that corresponds to a trigger for preview playback of the video, it obtains the identification number of the content display element and the identification number of the genre label / genre type that are assigned to the content display element 53 selected in the processing of step S1-2.
[0101] The display control unit 212 transmits the acquired identification number to the video distribution device 10 via the communication unit 23 and the communication network 90.
[0102] The trigger firing time is not limited to a specific duration, but may be set to any duration within the range of, for example, 0.8 seconds to 2.0 seconds.
[0103] Next, video preview playback starts on the user terminal 20 (step S1-4).
[0104] The video distribution device 10 receives the identification number of the content display element and the identification number of the genre label / genre type transmitted from the user terminal 20 via the communication unit 13.
[0105] When the video distribution device 10 receives the identification number of the content display element and the identification number of the genre label / genre type, it identifies a video data file from among the video data files stored in the video file database 121 stored in the storage unit 12 whose identification number matches the identification number of the received content display element.
[0106] The identified video data file is transmitted from the video distribution device 10 to the user terminal 20 via the communication unit 13 and communication network 90 of the video distribution device 10 (it may also be transmitted via streaming).
[0107] Then, on the user terminal 20, a preview playback of the video corresponding to the content display element 53 selected in step S1-2 is started.
[0108] As part of the processing on the user terminal 20, the video data transmitted from the video distribution device 10 to the user terminal 20 (for example, streamed) is received via the communication unit 23.
[0109] The received video data is transmitted to the playback control unit 213 of the control unit 21. The playback control unit 213 performs video playback processing based on the transmitted video data and displays the played video in the preview playback area 51 of the user interface screen 50 displayed on the output unit 25 (specifically, the touchscreen).
[0110] The playback control unit 213 also starts measuring the elapsed time (referred to as "preview elapsed time") since the start of playback of the video (specifically, preview playback of the video) as a process in step S1-4.
[0111] Along with the preview playback of the video, synchronization of the background effects (specifically, effects performed using the displayed background) displayed in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 of the user terminal 20 is started (step S1-5).
[0112] The video distribution device 10 receives the genre label / genre type identification number along with the identification number of the content display element transmitted from the user terminal 20.
[0113] When the video distribution device 10 receives the genre label / genre type identification number along with the content display element identification number, it identifies a background effect data file from among the background effect data files stored in the background effect database 122 stored in the storage unit 12 whose identification number matches the genre label / genre type identification number received in the processing of step S1-4.
[0114] The identified background effect data file is transmitted from the video distribution device 10 to the user terminal 20 via the communication unit 13 and communication network 90 of the video distribution device 10.
[0115] Then, on the user terminal 20, the background animation corresponding to the genre label (i.e., the type of genre) of the content display element 53 selected in step S1-2 is started.
[0116] In other words, the transmission of the identification number of the content display element 53 and the identification number of the genre label / genre type from the user terminal 20 to the video distribution device 10 triggers the synchronous start of video preview playback and background effects.
[0117] As part of the processing on the user terminal 20, background effect data transmitted from the video distribution device 10 to the user terminal 20 is received via the communication unit 23.
[0118] The received background effect data is transmitted to the background control unit 214 of the control unit 21. The background control unit 214 performs background generation processing based on the transmitted background effect data and displays the generated background in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 (specifically, the touchscreen).
[0119] Specifically, background effects are achieved by dynamically changing the background image, colors (in other words, the overall tone), and lighting displayed in the background effect area 57 of the user interface screen 50, which is displayed on the output unit 25 of the user terminal 20, according to the genre of the video being played.
[0120] Here, the background effect database 122 may be stored in the storage unit 22 of the user terminal 20. In this case, after the user stops the swipe operation 58 in the left-right direction and the trigger firing time has elapsed, the display control unit 212 may obtain the identification number of the content display element and the identification number of the genre label / genre type assigned to the content display element 53 selected in the processing of step S1-2, and transmit the obtained genre label / genre type identification number to the background control unit 214.
[0121] The background control unit 214 may then identify a background effect data file from among the background effect data files stored in the background effect database 122 stored in the storage unit 22 whose identification number matches the genre label / genre type identification number transmitted from the display control unit 212.
[0122] The background control unit 214 may then execute a background generation process based on the identified background effect data file and display the generated background in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 (specifically, the touchscreen).
[0123] Next, it is determined whether the preview playback time of the video started in step S1-4 (i.e., the elapsed preview time) has exceeded a predetermined time (referred to as "preview playback time") (step S1-6).
[0124] The preview playback time is not limited to a specific duration; for example, it may be set to any duration within the range of 5 to 15 seconds.
[0125] As part of the processing on the user terminal 20, the playback control unit 213 of the control unit 21 determines whether the elapsed preview time measured in step S1-4 is longer than the preview playback time.
[0126] If the preview playback time has not elapsed (Step S1-6: No), the preview playback and background effects of the video in question (i.e., the video currently being played) continue (Step S1-7). The process in Step S1-6 is then repeated. In other words, the elapsed preview time is constantly monitored, and it is always determined whether or not the elapsed preview time is less than or equal to the preview playback time.
[0127] As processing on the user terminal 20, if the preview elapsed time is less than or equal to the preview playback time (step S1-6: No), the playback control unit 213 of the control unit 21 continues to perform video playback processing and displays the played video in the preview playback area 51 of the user interface screen 50 displayed on the output unit 25, while the background control unit 214 continues to perform background generation processing and displays the generated background in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 (step S1-7).
[0128] Here, the video preview playback time may be extended by user actions during video preview playback. That is, a predetermined amount of time may be added to the remaining preview playback time at that point when the user performs a predetermined action during video preview playback.
[0129] Specifically, as shown in Figure 6A, three content display elements 53A, 53B, and 53C are arranged and displayed in the carousel display area 52 of the user interface screen 50, which is displayed on the touchscreen acting as the input unit 24 and output unit 25 of the user terminal 20, and a video corresponding to the central content display element 53B, which is the playback target position, is currently being previewed.
[0130] At this time, as shown in Figure 6B, the user places their finger on the carousel display area 52 on the touchscreen and slides their finger slightly along the left-right direction (to the right in the example shown in the figure) (reference numeral 60 in the figure).
[0131] Here, a switching threshold is set for the content display elements 53 that are placed and displayed in the carousel display area 52, in response to a swipe operation 58 that follows the left-right direction.
[0132] Specifically, the switching threshold is set as a predetermined dimension along the left-right direction, and in the example shown in Figure 6B, the dimension St along the left-right direction is set as the switching threshold.
[0133] Furthermore, when the amount of movement of the user's finger along the left-right direction on the touchscreen (in other words, the distance moved) is less than the switching threshold St, the content display elements 53B placed and displayed in the carousel display area 52 move along the left-right direction by the amount of movement of the user's finger, but then automatically return to their original positions (see Figure 6C).
[0134] In other words, the content display elements 53A, 53B, and 53C, which are placed and displayed in the carousel display area 52, remain unchanged and are not switched. The switching threshold St can be described as the tolerance for switching the content display elements 53 in response to the swipe operation 58.
[0135] The switching threshold St is not limited to a specific dimension, but may be set to any dimension within the range of 3 mm to 10 mm, for example.
[0136] The switching threshold St may be set to either the rightward or leftward direction only. For example, if the switching threshold St is set to the rightward direction only, when the user's finger moves to the right (indicated by 60 in Figure 6B), if the amount of rightward movement of the finger is less than the switching threshold St, the content display element 53 will not be switched. However, when the user's finger moves to the left, the content display element 53 will be switched.
[0137] In this case, when a leftward swipe operation with respect to the carousel display area 52 moves the content display element 53 located at the left edge of the carousel display area 52 out of the area and hides it, and simultaneously makes a new content display element 53 appear from the right edge of the carousel display area 52 and displays it, it is possible to ensure the comfort of switching to display a new content display element 53 without activating the switching threshold St for a rightward movement of the user's finger (indicated by 60 in Figure 6B), while not activating the switching threshold St for a leftward swipe operation.
[0138] In this case, if the amount of rightward movement of the user's finger is greater than or equal to the switching threshold St, the content display element 53 located at the right edge moves out of the carousel display area 52 and becomes invisible, while the previously displayed content display element 53 (i.e., the one that moved out of the area and became invisible) reappears and is displayed from the left edge of the carousel display area 52.
[0139] Once a switching threshold St is set, if the amount of movement of the user's finger along the left-right direction on the touchscreen (in other words, the distance moved) is less than the switching threshold St, a predetermined amount of time (referred to as "additional playback time") is added to the remaining preview playback time of the video being previewed, i.e., the preview playback time is extended.
[0140] The additional playback time is not limited to a specific duration; for example, it may be set to any duration within the range of 5 to 15 seconds.
[0141] In other words, in the video distribution service according to the embodiment, a switching threshold St, which is a boundary value for whether or not to switch the content display elements 53 arranged and displayed in the carousel display area 52, is set as a predetermined dimension along a first direction (for example, the left-right direction), and when the amount of movement of a movement instruction operation (for example, a swipe operation) along the first direction (for example, the left-right direction) is less than the switching threshold St, the preview playback time is extended.
[0142] Furthermore, a switching threshold St, which serves as a boundary value for whether or not to switch the content display elements 53 placed and displayed in the carousel display area 52, may be set as a predetermined dimension along a first orientation (e.g., facing right), and the preview playback time may be extended when the amount of movement of a movement instruction operation (e.g., a swipe operation) along the first orientation (e.g., facing right) is less than the switching threshold St. In this case, the first orientation (e.g., facing right) may be the opposite of the second orientation (e.g., facing left), which is the orientation of the movement instruction operation (e.g., a swipe operation) to make a new content display element 53 appear and be displayed in the carousel display area 52.
[0143] The additional playback time may vary depending on the speed at which the user's finger moves along the left-right direction.
[0144] For example, the additional playback time may be longer when the user's finger moves slowly along the left-right direction (provided the finger movement is less than the switching threshold St) than when it is moved quickly. In other words, the additional playback time may be longer when the user's finger moves slowly along the left-right direction than when it moves quickly.
[0145] The additional playback time may also vary depending on the amount of movement (in other words, distance) along the user's finger in the left-right direction.
[0146] For example, the additional playback time may be longer when the amount of movement along the user's finger in the left-right direction (provided it is less than the switching threshold St) is longer than when it is shorter. In other words, the additional playback time may be longer when the distance of movement along the user's finger in the left-right direction is longer than when it is shorter.
[0147] To allow the user to decide whether or not to extend the preview playback time, the remaining preview playback time may be displayed on the user interface screen 50, for example, on one of the four corners of the preview playback area 51.
[0148] On the other hand, regarding the determination (step S1-6) of whether the preview playback time (i.e., the elapsed preview time) of the video started in step S1-4 has exceeded the preview playback time, if the preview playback time has exceeded the time (step S1-6: Yes), the preview playback of the video in question (i.e., the video currently being played) ends, and the preview playback of the video corresponding to the new content display element 53 begins (step S1-8).
[0149] Specifically, the position of each content display element 53 located in the carousel display area 52 is shifted one position to the left, and the content display element 53 to the right of the previewed content display element 53 (in the example shown in the figure, the content display element 53C to the right of content display element 53B) is placed at the playback target position.
[0150] In other words, when the preview playback time has elapsed since the start of preview playback of a video corresponding to a certain content display element 53, the content display elements 53 placed and displayed in the carousel display area 52 are automatically switched, and preview playback of the video corresponding to the newly moved content display element 53 at the playback target position is automatically started.
[0151] At this point, the processing procedure in the video distribution system 100 returns to the processing in step S1-5, and the processing in steps S1-5 through S1-8 is repeated.
[0152] As part of the processing on the user terminal 20, if the preview elapsed time is longer than the preview playback time (step S1-6: Yes), the playback control unit 213 of the control unit 21 terminates the video playback process for the video in question (i.e., the video currently being played) and transmits a control signal corresponding to the end of preview playback to the display control unit 212 and the background control unit 214.
[0153] Based on a control signal transmitted from the playback control unit 213 that corresponds to the end of preview playback, the background control unit 214 terminates the background generation process and ends the display of the background in the background effect area 57 of the user interface screen 50 displayed on the output unit 25.
[0154] Based on a control signal transmitted from the playback control unit 213 that corresponds to the end of preview playback, the display control unit 212 controls the movement of the content display elements 53 placed and displayed in the carousel display area 52 to the left, moving the content display element 53 located at the left end (content display element 53A in the example shown in the figure) out of the carousel display area 52 and making it invisible, while simultaneously making a new content display element 53 appear from the right end of the carousel display area 52 and displaying it.
[0155] The playback control unit 213 starts preview playback of the video corresponding to the content display element 53 that has newly moved to the playback target position (step S1-8), and the playback control unit 213 and background control unit 214 perform the processing in steps S1-5 to S1-7.
[0156] During the processing of steps S1-1 to S1-8, if an upward flick or swipe operation is detected on a content display element 53 that was selected in the processing of step S1-2, among the content display elements 53 that are placed and displayed in the carousel display area 52, the video corresponding to the content display element 53 that was the target of the flick or swipe operation may be played in full.
[0157] In this case, as part of the processing on the user terminal 20, when the operation detection unit 211 of the control unit 21 detects an upward flick or swipe operation by the user on the input unit 24 (specifically, the touchscreen), the operation detection unit 211 outputs a control signal that triggers the preview playback of the video. Based on this control signal, the playback control unit 213 plays the full video corresponding to the content display element 53 that was the target of the flick or swipe operation.
[0158] In other words, the video distribution service according to the embodiment includes the steps of: step S1-1, which switches content display elements 53 arranged and displayed in the carousel display area 52 of the user interface screen 50 displayed on the output unit 25 of the user terminal 20 in accordance with a movement instruction operation (e.g., swipe operation 58) along a first direction (e.g., left-right direction) input via the input unit 24 of the user terminal 20; step S1-4, which previews and plays content (e.g., video) corresponding to the content display elements 53 arranged and displayed in the carousel display area 52; and step S1-4, which fully plays the content (e.g., video) corresponding to the content display elements 53 arranged and displayed in the carousel display area 52 in accordance with a movement instruction operation (e.g., flick operation or swipe operation) along a second direction (e.g., up-down direction) input via the input unit 24, wherein the first direction (e.g., left-right direction) and the second direction (e.g., up-down direction) are mutually orthogonal.
[0159] Furthermore, the procedure may include the steps of: switching the content display elements 53 arranged and displayed in the carousel display area 52 of the user interface screen 50 displayed on the output unit 25 of the user terminal 20 in accordance with a movement instruction operation (e.g., swipe operation) along a second direction (e.g., leftward) input via the input unit 24 of the user terminal 20; previewing and playing the content (e.g., video) corresponding to the content display elements 53 arranged and displayed in the carousel display area 52; and fully playing the content (e.g., video) corresponding to the content display elements 53 arranged and displayed in the carousel display area 52 in accordance with a movement instruction operation (e.g., flick operation or swipe operation) along a third direction (e.g., upward) input via the input unit 24, wherein the second direction (e.g., leftward) and the third direction (e.g., upward) are mutually orthogonal.
[0160] (Processing procedure for controlling background effects) Figure 7 is a flowchart showing the processing procedure for controlling background effects in the user terminal 20 of the video distribution system 100 according to the embodiment.
[0161] Specifically, the control of background effects in the video distribution system 100 involves controlling the background displayed in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 when a video is played on the user terminal 20, and controlling the effects performed using the background (i.e., background effects).
[0162] The video distribution service according to this embodiment includes step S2-3, which starts by synchronizing preview playback with background effects to be displayed in the background effects area 57 of the user interface screen 50, and changes the background effects according to the genre of content (for example, video) corresponding to the content display element 53 that is being previewed.
[0163] First, the genre type assigned to the content display element 53 located at the playback target position is obtained (step S2-1).
[0164] Specifically, through the processing of steps S1-4 in the processing procedure of the video distribution system 100 as explained with reference to Figure 5, the video distribution device 10 receives the genre label / genre type identification number.
[0165] Next, a performance pattern is selected based on the genre type obtained in step S2-1 (step S2-2).
[0166] The video distribution device 10 identifies a background effect data file from among the background effect data files stored in the background effect database 122 stored in the storage unit 12 whose identification number matches the genre label / genre type identification number received in the processing of step S2-1.
[0167] Furthermore, the processing in step S2-2 corresponds to a part of the processing in step S1-5 of the processing procedure in the video distribution system 100 explained with reference to Figure 5.
[0168] Next, control of the background effects displayed in the background effects area 57 of the user interface screen 50 displayed on the output unit 25 of the user terminal 20 is initiated (step S2-3).
[0169] The control of the background effects displayed in the background effects area 57 of the user interface screen 50 is triggered by the transmission of the identification number of the content display element 53 and the identification number of the genre label / genre type from the user terminal 20 to the video distribution device 10 (step S1-3 of the processing procedure in the video distribution system 100 explained using Figure 5), and starts simultaneously with the start of video preview playback. This synchronizes the start of video preview playback with the start of background effects.
[0170] Next, the data necessary for background effects is acquired (Step S2-4).
[0171] Specifically, the background effect data file identified in step S2-2 is transmitted from the video distribution device 10 to the user terminal 20 via the communication unit 13 and communication network 90 of the video distribution device 10.
[0172] Furthermore, the processing in step S2-4 corresponds to a part of the processing in step S1-5 of the processing procedure in the video distribution system 100 described with reference to Figure 5.
[0173] As a control of background effects, the background displayed in the background effect area 57 of the user interface screen 50 may be generated to match the genre of the video being previewed. For example, a collection of materials for generating backgrounds may be recorded and stored in the background effect data file stored in the background effect database 122, for each type of video genre, and the background control unit 214 may combine the materials to generate a background according to the genre of the video being previewed.
[0174] The background effect database 122 may also be stored in the storage unit 22 of the user terminal 20. In this case, the genre label / genre type identification number assigned to the content display element 53 placed at the playback target position is obtained, and the background effect data file is identified based on the obtained genre label / genre type identification number.
[0175] Next, the background effects are executed (Step S2-5).
[0176] Specifically, as processing on the user terminal 20, the background control unit 214 of the control unit 21 executes a background effect in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 (specifically, the touchscreen) that corresponds to the type of genre of the content display element 53 acquired in the processing of step S2-1.
[0177] Furthermore, the processing in step S2-5 corresponds to a part of the processing in step S1-5 of the processing procedure in the video distribution system 100 described with reference to Figure 5.
[0178] Next, it is determined whether or not it is time to finish previewing the currently playing video (step S2-6).
[0179] Specifically, as part of the processing on the user terminal 20, the background control unit 214 of the control unit 21 determines whether or not a control signal corresponding to the end of preview playback has been transmitted from the playback control unit 213.
[0180] If no control signal indicating the end of preview playback has been transmitted (step S2-6: No), the background effects corresponding to the video in question (i.e., the video currently being played) continue (step S2-7). The process in step S2-6 is then repeated. In other words, the transmission of a control signal indicating the end of preview playback is constantly monitored, and it is always determined whether or not such a control signal has been transmitted.
[0181] If, as a process at the user terminal 20, a control signal corresponding to the end of preview playback has not been transmitted (step S2-6: No), the background control unit 214 of the control unit 21 continues to execute the background generation process and displays the generated background in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 (step S2-7).
[0182] On the other hand, if a control signal corresponding to the end of preview playback is transmitted (step S2-6: Yes), the background generation process corresponding to the video in question (i.e., the video currently being played) is terminated, and the display of the background in the background effect area 57 of the user interface screen 50 displayed on the output unit 25 is terminated (step S2-8).
[0183] The control of the background effect displayed in the background effect area 57 of the user interface screen 50 is triggered by the transmission of a control signal corresponding to the end of preview playback from the playback control unit 213 of the control unit 21 to the background control unit 214, and ends simultaneously with the end of the video preview playback. As a result, the end of the video preview playback and the end of the background effect are synchronized.
[0184] Furthermore, the process in step S2-6 corresponds to the process in step S1-6 of the processing procedure in the video distribution system 100 described with reference to Figure 5.
[0185] By starting background effect control in sync with the start of video preview playback, specifically by starting control of the background displayed in the background effect area 57 of the user interface screen 50, which is selected to match the genre of the video being previewed, the visual immersion of video playback is enhanced.
[0186] Background effects may be displayed even when the video is playing in full, and the background may be selected to match the genre of the video being played in full.
[0187] Figure 8 shows an example of the display of the touchscreen, which serves as the input unit 24 and output unit 25 of the user terminal 20, when the content playback program 26 is executed on the user terminal 20, and is a diagram showing an example of the full playback screen 70 displayed on the touchscreen of the user terminal 20.
[0188] The full playback screen 70 has a general configuration consisting of a full playback area 71 and background effect area 72 that extend from the top to the middle section, and a carousel display area 73 at the bottom.
[0189] The full playback area 71 is the area in which the video corresponding to the content display element 53 that was targeted by an upward flick or swipe operation is fully played during the processing of steps S1-1 to S1-8.
[0190] The title 74 of the video being played in full in the full playback area 71 may be displayed below the background effect area 72.
[0191] Content display elements are placed and displayed in the carousel display area 73. In the example shown in the figure, seven content display elements 75a, 75b, ..., 75g are arranged and displayed along the left-right direction.
[0192] The content display elements placed and displayed in the carousel display area 73 may be one to six, or eight or more.
[0193] Content display elements 75a, 75b, ..., 75g may each include a thumbnail image and a title.
[0194] Content display elements 75a, 75b, ..., 75g are card type in the example shown in the figure, but are not limited to card type; they can take any form as long as they are elements that are arranged and displayed independently of each other. Content display elements 75a, 75b, ..., 75g may be, for example, various forms of icon type, button type, ribbon type, sticker type, etc.
[0195] The background is displayed in the background display area 72 while the video is playing in the full playback area 71.
[0196] In the example shown in Figure 8, the background effect area 72 is set only in the upper to middle section of the full playback screen 70. However, the background effect area 72 may be set over a wider area than shown in Figure 8, that is, over the entire or nearly entire full playback screen 70.
[0197] The background displayed in the background effect area 72 of the full playback screen 70 is a background effect corresponding to the genre label (i.e., the type of genre) of the content display element 53 selected in the processing of step S1-2.
[0198] The full playback screen 70 may display a description of the video being played in the full playback area 71, and may also include a comment section. The full playback screen 70 may also include a button to return to the user interface screen 50 (in other words, to switch screens).
[0199] (Restrictions on operations during video preview playback) Figure 9 is a flowchart showing the processing procedure for restricting operations during video preview playback on the user terminal 20 of the video distribution system 100 according to the embodiment.
[0200] The restrictions on operations during video preview playback are processes applied to user operations on the input unit 24 (specifically, the touchscreen) while a video preview playback is taking place on the user terminal 20.
[0201] The video distribution service according to this embodiment restricts predetermined operations that are input via the input unit 24 during preview playback.
[0202] The restriction on operations during video preview playback is triggered when the trigger for video preview playback is activated (step S3-1).
[0203] Step S3-1 corresponds to step S1-3 of the processing procedure in the video distribution system 100 described with reference to Figure 5.
[0204] As part of the processing on the user terminal 20, when the time period during which the operation detection unit 211 of the control unit 21 does not detect a swipe operation 58 along the left or right direction on the input unit 24 (specifically, the touchscreen) by the user has elapsed since the trigger firing time, a control signal equivalent to a notification to start preview playback of the video is transmitted from the operation detection unit 211 to the operation restriction unit 215.
[0205] As a result, the operation restriction unit 215 detects that video preview playback has started.
[0206] Next, the user terminal 20 switches to operation restriction mode (step S3-2).
[0207] Specifically, as part of the processing on the user terminal 20, a flag (referred to as the "operation restriction flag") that specifies the disabling of user operations on the input unit 24 (specifically, the touchscreen) is set to ON, thereby enabling the function of the operation restriction unit 215 in the control unit 21.
[0208] By switching to operation restriction mode, user operations on the input unit 24 of the user terminal 20 are monitored (step S3-3).
[0209] The following operations on the input unit 24 may be designated as monitored operations (a) through (c). a) Touchstart i) Swipe along the left or right direction. U) Tap
[0210] As part of the processing on the user terminal 20, the operation restriction unit 215 of the control unit 21 receives a control signal from the operation detection unit 211 that corresponds to the content of the operation on the input unit 24 (specifically, the touchscreen), and sequentially grasps and monitors the content of the operation.
[0211] Next, it is determined whether the conditions for lifting the restrictions on operations during video preview playback have been met (step S3-4).
[0212] The following conditions may be set as conditions for the operation restrictions during video preview playback to be lifted, that is, for the operation restriction flag to be set to OFF. (c) End of video preview playback (k) User settings
[0213] The user setting described above includes setting the operation restriction flag to OFF when the user performs a predetermined operation on the input unit 24. For example, the operation restriction flag may be set to OFF when a downward flick or swipe operation is performed on any of the content display elements 53 that are placed and displayed in the carousel display area 52.
[0214] In addition to the conditions described above (k) and (ki), other conditions may also be set for lifting the restrictions on operations during video preview playback.
[0215] Then, if the conditions for removing the restrictions on operation during video preview playback are met (Step S3-4: Yes), the restrictions on operation during video preview playback are removed (Step S3-5).
[0216] Specifically, the restrictions on operations during video preview playback may be removed when the above conditions (k) or (ki) are met.
[0217] The above "Ka" corresponds to the case where the judgment result in step S1-6 of the processing procedure in the video distribution system 100 explained using Figure 5 is "Yes" (i.e., when the preview elapsed time is longer than the preview playback time).
[0218] As part of the process on the user terminal 20, the operation restriction flag is set to OFF, thereby disabling the function of the operation restriction unit 215 in the control unit 21.
[0219] On the other hand, if the conditions for lifting the restrictions on operations during video preview playback are not met (step S3-4: No), it is determined whether the operations on the input unit 24 of the user terminal 20, as detected by monitoring in step S3-3, are subject to restrictions (step S3-6).
[0220] If the operation on the input unit 24 of the user terminal 20 is not subject to restriction (step S3-6: No), the process returns to step S3-3, monitoring of user operations on the input unit 24 continues, and the process from step S3-3 onwards is repeated. In other words, user operations on the input unit 24 are constantly monitored, and it is always determined whether or not the operation on the input unit 24 is subject to restriction.
[0221] If, as part of the processing on the user terminal 20, the operation on the input unit 24 is not subject to restriction (step S3-6: No), the operation restriction unit 215 of the control unit 21 continues to obtain control signals from the operation detection unit 211 that correspond to the content of the operation on the input unit 24 (specifically, the touchscreen), and sequentially grasps and monitors the content of the operation.
[0222] On the other hand, if the operation of the input unit 24 of the user terminal 20 is subject to restriction (step S3-6: Yes), the operation restriction during video preview playback is applied and executed (step S3-7).
[0223] The following restrictions on operations may be applied to operations on the input section 24 of the user terminal 20. (S) Disables swipe gestures that follow the left or right direction. C) Disable tap operation. (S) Warning ended
[0224] The termination of the above warning may include, for example, the closing of the user interface screen 50 or the display of a screen indicating that the restricted operation has been performed.
[0225] By applying operation restrictions to predetermined operations on the input unit 24 of the user terminal 20, it is prevented that the preview playback may be interrupted or terminated due to accidental operation during video preview playback, and consequently, the visual immersion of video playback is prevented from being hindered.
[0226] Furthermore, operations that are not monitored during the processing of step S3-3 (in this case, operations other than those described in A through C above) may be treated as valid operations.
[0227] After the operation restrictions during video preview playback are applied and executed (step S3-7), the process returns to step S3-3, and monitoring of user operations on the input unit 24 continues, and the process from step S3-3 onwards is repeated. In other words, user operations on the input unit 24 are constantly monitored, and it is always determined whether or not the operations on the input unit 24 are subject to restrictions.
[0228] (Application of machine learning to control background effects) The control of the background effects may include predicting the type of video genre (i.e., the genre label of the content display element 53) corresponding to the content display element 53 selected by the user in step S1-2 of the processing procedure in the video distribution system 100 described with reference to Figure 5.
[0229] For example, a video streaming service may use training data, in which the composition ratio of content (e.g., videos) corresponding to the previewed content display element 53 played up to N times is used as input data, and the genre of the content (e.g., video) corresponding to the previewed content display element 53 played up to N times is used as output data. Machine learning is performed to generate a trained model, and the data related to the previewed playback up to N times in that execution is used as input data for prediction. Based on the trained model, the genre of the content (e.g., video) to be previewed up to N+1 times, corresponding to the input data for prediction, is estimated.
[0230] For example, machine learning is performed using training data in which the composition ratio of the genre types of videos previewed up to the Nth time (in other words, each time the content playback program 26 is launched) based on each user's past video preview playback history is used as input data, and the genre types of videos previewed on the N+1th time are used as output data, thereby generating a pre-trained model.
[0231] Furthermore, in a new execution of the content playback program 26 (in other words, the current execution), the composition ratio of the genre types of previewed videos up to the Nth time is used as input data for prediction (in other words, estimation), and based on the trained model, the genre type of the video to be previewed on the N+1th time (i.e., next), corresponding to the input data for prediction, is estimated.
[0232] Furthermore, it is permissible to include full video playback in the past video playback history.
[0233] Furthermore, the input data may include playback patterns from past video playback history. Specifically, the input data may include the order of genre types of videos played up to the Nth time for each execution (in other words, each launch) of the content playback program 26 (i.e., a sequence of connections, for example, action → action → action → suspense).
[0234] The trained model may be configured so that training data is added and updated each time the content playback program 26 is executed by the user in question.
[0235] In controlling background effects, the type of genre of the next video to be previewed is predicted, and based on the prediction result, preparation processing for the background to be displayed in the background effect area 57 of the user interface screen 50 is performed as a preprocessing step, thereby suppressing display delay at the start of preview playback.
[0236] For example, in the processing step S1-2 of the processing procedure in the video distribution system 100 explained using Figure 5, information on the genre label attached to the selected content display element 53 is obtained, thereby preparing data for preview playback up to N times.
[0237] Therefore, at this stage, the data related to the preview playback up to the Nth time in the execution is used as input data for prediction, and based on the trained model, it becomes possible to estimate the genre of the video that will be previewed on the N+1th time (i.e., next), corresponding to the input data for prediction.
[0238] Therefore, if the genre label assigned to the content display element 53 selected in step S1-2 (i.e., the N+1 time) matches the predicted genre type, the background effect in step S1-5 can be started immediately, and the display delay at the start of preview playback is suppressed.
[0239] Furthermore, if the background displayed in the background effect area 57 of the user interface screen 50 is generated to match the genre of the video being previewed, the effect of suppressing display delay at the start of preview playback will be further enhanced.
[0240] The processing on the user terminal 20 may involve the background control unit 214 of the control unit 21 generating or updating the trained model, as well as estimating the genre of the next video to be previewed and played.
[0241] (Effects and Benefits) In the video distribution service according to the embodiment, a switching threshold St, which is a boundary value for whether or not to switch the content display elements 53 arranged and displayed in the carousel display area 52, is set as a predetermined dimension along a first direction (e.g., left-right direction), and when the amount of movement of a movement instruction operation (e.g., swipe operation 58) along the first direction (e.g., left-right direction) is less than the switching threshold St, the preview playback time is extended. This allows for smooth linking of user operations and video preview playback, ultimately providing a smooth user experience (UX), improving the operability of the user interface, and enhancing the quality of the user experience (UX).
[0242] The video distribution service according to this embodiment also includes a process to synchronize the start of preview playback with the background effect displayed in the background effect area 57 of the user interface screen 50, and changes the background effect according to the genre of the content (for example, video) corresponding to the content display element 53 that is being previewed. As a result, the display of the background during video playback can be synchronized with the start of playback of the video and the content can be changed according to the genre of the video, thereby enhancing the visual immersion of video playback and ultimately improving the quality of the user experience (UX).
[0243] According to the video distribution service of this embodiment, since predetermined operations input via the input unit 24 during preview playback are restricted, it is possible to prevent the preview playback from being interrupted or terminated due to accidental operations during video preview playback, thereby preventing the visual immersion of video playback from being hindered, and ultimately ensuring the stability of the user experience (UX).
[0244] Although embodiments of the present invention have been described above, the specific configurations of the present invention are not limited to the embodiments described above. The present invention also includes forms in which modifications and changes are made to the above embodiments without departing from the spirit of the invention.
[0245] For example, in the above embodiment, a video / video data file is associated with the content display element 53, but the objects that can be associated with the content display element are not limited to video / video data files. For example, music / music data files or ebooks / ebook data files may be associated with the content display element. In addition, two or more types of content from among video / video data files, music / music data files, and ebooks / ebook data files may be associated, that is, multiple types of content may be mixed together.
[0246] Furthermore, in the above embodiment, the user operates the touchscreen, which serves as the input unit 24 and output unit 25 of the user terminal 20, with their finger. However, operations equivalent to the user operations on the touchscreen described in the above embodiment (for example, swipe operations 58 and flick operations) may be performed using a mouse. In this case, the output unit 25 of the user terminal 20 may be a display that does not have touchscreen functionality.
[0247] In this description of the present invention, the term "movement instruction operation" includes operations in which a user attempts to move a content display element 53 on a touchscreen using their finger, operations in which a user attempts to move a content display element 53 using a mouse, and operations in which a user attempts to move a content display element 53 using other input means.
[0248] Furthermore, in the above-described embodiment, the content display elements 53 in the carousel display area 52 of the user interface screen 50 are switched along the left-right direction. That is, the content display elements 53 are moved out of the area from the left and right edges of the carousel display area 52 to hide them, and new content display elements 53 are made to appear and be displayed from the left and right edges of the carousel display area 52. However, the content display elements 53 may also be switched along the up-down direction. That is, the content display elements 53 are moved out of the area from the top and bottom edges of the carousel display area 52 to hide them, and new content display elements 53 are made to appear and be displayed from the top and bottom edges of the carousel display area 52.
[0249] In this case, the content display elements 53 displayed in the carousel display area are switched when the user performs a swipe operation along the vertical direction (in other words, a move instruction operation), and a switching threshold may be set for a swipe operation along the vertical direction (in other words, a move instruction operation) (i.e., the switching threshold is set as a predetermined dimension along the vertical direction).
[0250] In this case, the video corresponding to one of the content display elements 53 placed and displayed in the carousel display area may be played in full when the user performs a leftward or rightward flick or swipe operation (in other words, a movement instruction operation) on that content display element 53.
[0251] In other words, in the present invention, the direction of operation for switching the content display elements 53 arranged and displayed in the carousel display area of the user interface screen coincides with the direction of the dimension, which is the boundary value for whether or not to switch the content display elements 53 arranged and displayed in the carousel display area, and the direction of operation for fully playing the video corresponding to the content display element 53 is mutually orthogonal. [Industrial applicability]
[0252] The information processing method according to the present invention can improve the operability of the user interface and enhance the quality of the user experience (UX), and is therefore useful, for example, in the field of playing and viewing content delivered via a communication network on a user's terminal. [Explanation of Symbols]
[0253] 10 Video distribution device 11 Control Unit 12 Storage section 121 Video File Database 122 Background Effects Database 13 Communications Department 14 Input section 15 Output section 20 User Terminals 21 Control Unit 211 Operation detection unit 212 Display Control Unit 213 Regeneration Control Unit 214 Background Control Unit 215 Operation Restriction Unit 22 Memory section 23 Communications Department 24 Input section 25 Output section 26 Content Playback Program 50 User Interface Screens 51 Preview Playback Area 52 Carousel display area 53, 53A, 53B, 53C Content display elements 54A, 54B, 54C Thumbnail images 55A, 55B, 55C Title 56A, 56B, 56C Genre Labels 57 Background production area 58. Swipe operation 59 Search bar 70 Full playback screen 71 Full playback area 72 Background production area 73 Carousel display area 74 titles 75a, 75b, 75c, 75d, 75e, 75f, 75g Content display elements 90 Communication Networks 100 Video Streaming Systems
Claims
1. This is a method performed by an information processing device. The steps include switching content display elements arranged and displayed in the carousel display area of the user interface screen displayed on the output unit of the information processing device in accordance with a movement instruction operation along a first direction input via the input unit of the information processing device, The step includes previewing and playing back the content corresponding to the content display elements placed and displayed in the carousel display area, A switching threshold, which is a boundary value for whether or not to switch the content display elements arranged and displayed in the carousel display area, is set as a predetermined dimension along the first direction. When the amount of movement of the movement instruction operation along the first direction is less than the switching threshold, the preview playback time is extended. An information processing method characterized by the following:
2. The step includes starting the preview playback and the background effect to be displayed in the background effect area of the user interface screen in sync, The background effect is changed according to the genre of content corresponding to the content display element that is being previewed and played back. The information processing method according to feature 1.
3. Restricting predetermined operations input via the input unit during the preview playback, The information processing method according to feature 1.
4. Machine learning is performed using training data in which the composition ratio of the content by genre type corresponding to the content display element previewed up to N times is used as input data, and the genre type of the content corresponding to the content display element previewed on the N+1th time is used as output data, thereby generating a trained model. The data relating to the preview playback up to the Nth time in the execution is used as input data for prediction, and based on the trained model, the type of genre of the content to be previewed and played on the N+1th time, corresponding to the input data for prediction, is estimated. The information processing method according to feature 2.
5. A means for switching content display elements, which are arranged and displayed in the carousel display area of the user interface screen displayed on the output unit, in accordance with a movement instruction operation along a first direction input via the input unit, The carousel display area includes means for previewing and playing back content corresponding to the content display elements that are placed and displayed in the carousel display area, A switching threshold, which is a boundary value for whether or not to switch the content display elements arranged and displayed in the carousel display area, is set as a predetermined dimension along the first direction. When the amount of movement of the movement instruction operation along the first direction is less than the switching threshold, the preview playback time is extended. An information processing device characterized by the following:
6. The system includes means for synchronizing the start of the preview playback and the background effect to be displayed in the background effect area of the user interface screen, The background effect is changed according to the genre of content corresponding to the content display element that is being previewed and played back. The information processing apparatus according to feature 5.
7. A program executed in an information processing device, Means for switching content display elements arranged and displayed in the carousel display area of a user interface screen displayed on the output unit of the information processing device in response to a movement instruction operation along a first direction input via the input unit of the information processing device, The information processing device is configured to function as a means for previewing and playing back content corresponding to the content display elements arranged and displayed in the carousel display area. A switching threshold, which is a boundary value for whether or not to switch the content display elements arranged and displayed in the carousel display area, is set as a predetermined dimension along the first direction. When the amount of movement of the movement instruction operation along the first direction is less than the switching threshold, the preview playback time is extended. An information processing program characterized by the following features.
8. The information processing device is configured to synchronize the start of the preview playback and the background effect to be displayed in the background effect area of the user interface screen. The background effect is changed according to the genre of content corresponding to the content display element that is being previewed and played back. The information processing program according to feature 7.
Citation Information
Patent Citations
Display apparatus, control method thereof, input apparatus, and display system
JP2013143774A
Image processing method, device, electronic device, storage medium, and program
JP2025536354A
Mixture composition of powder ane syrup for drinks
KR102148188B1
Video preview based browsing user interface
US20120141095A1
Display device, display method, and computer program
WO2014083953A1