Information processing device, method, program, and system

Abstract

To provide a variety of user experience about a content including a moving image.SOLUTION: A program causes a computer to function as: means for reproducing a sub-content including audio independently of a player which is software capable of reproducing a main content including a moving image; means for monitoring the operation state of the player; and means for performing first processing to urge synchronization between the main content and sub-content when the player does not reproduce the main content even if the sub-content is reproducing exceeding a predetermined reproduction time.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, method, program, and system.

Background Art

[0002] By preparing various sub-audio contents in addition to the main audio content for video content, it is possible to meet various user needs.

[0003] Patent Document 1 contemplates diversifying the output mode of content according to user needs, and discloses a technical idea of reproducing sub-content transmitted from a content distribution device in synchronization with reproduction at an output device in accordance with an exchange of synchronization signals with the content distribution device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the technical idea of Patent Document 1, it is not assumed to synchronously reproduce sub-content other than the sub-content prepared on the distribution side of the content to be synchronized. That is, there are restrictions on the sub-content available to the user.

[0006] An object of the present disclosure is to provide various user experiences for content including video.

Means for Solving the Problems

[0007] A program according to one aspect of the present disclosure causes a computer to function as means for playing sub-content including audio, means for monitoring the operating state of a player, and means for performing a first process for promoting synchronization between main content and sub-content when the player is not playing the main content even if the sub-content is played for a predetermined playback time exceeding the predetermined playback time, independently of a player which is software capable of playing main content including moving images.

Brief Description of Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are basically denoted by the same reference numerals, and the repeated explanation thereof is omitted.

[0010] (1) Configuration of Information Processing System The configuration of the information processing system will be described. FIG. 1 is a block diagram showing the configuration of the information processing system of this embodiment.

[0011] As shown in FIG. 1, the information processing system 1 includes a client device 10 and a server 30. The client device 10 and the server 30 are connected via a network (for example, the Internet or an intranet) NW. Further, at least one of the client device 10 or the server 30 and the main content server 50 are connected via the network NW.

[0012] The client device 10 is an example of an information processing device. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0013] The server 30 is an example of an information processing device. The server 30 is, for example, a server computer. The server 30 provides the client device 10 with sub-content, which will be described later, in response to a request from the client device 10.

[0014] The main content server 50 is an example of an information processing device. The main content server 50 is a server computer. The main content server 50 provides, for example, an on-demand video service. As an example, the main content server 50 provides the client device 10 with main content, which will be described later, in response to a request from the client device 10.

[0015] (1-1) Configuration of the Client Device The configuration of the client device will be described. FIG. 2 is a block diagram showing the configuration of the client device of the present embodiment.

[0016] As shown in FIG. 2, the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, and a communication interface 14. The client device 10 is connected to a display 21.

[0017] The storage device 11 is configured to store programs and data. The storage device 11 is, for example, a combination of a ROM (Read Only Memory), a RAM (Random Access Memory), and a storage (e.g., a flash memory or a hard disk).

[0018] The program includes, for example, the following programs. · Program of an OS (Operating System) · Programs of applications that execute information processing (e.g., a main content player for playing main content and a sub-content player for synchronously playing sub-content with the main content)

[0019] The data includes, for example, the following data. · Database referred to in information processing · Data obtained by executing information processing (i.e., the execution result of information processing) · Content data (e.g., data of downloaded main content or sub-content)

[0020] The processor 12 is a computer that realizes the functions of the client device 10 by starting the programs stored in the storage device 11. The processor 12 is, for example, at least one of the following. · CPU (Central Processing Unit) · GPU (Graphic Processing Unit) · ASIC (Application Specific Integrated Circuit) · FPGA (Field Programmable Gate Array)

[0021] The input / output interface 13 is configured to acquire information (e.g., a user instruction) from an input device connected to the client device 10 and output information (e.g., an image (in the following description, "image" may include one or both of a video and a still image) or audio) to an output device connected to the client device 10.

[0022] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display 21, a speaker, or a combination thereof.

[0023] The communication interface 14 is configured to control communication between the client device 10 and an external device (e.g., the server 30 or the main content server 50).

[0024] The display 21 is configured to display an image. The display 21 is, for example, a liquid crystal display or an organic EL display.

[0025] (1-2) Configuration of the server The configuration of the server will be described. FIG. 3 is a block diagram showing the configuration of the server according to the present embodiment.

[0026] As shown in FIG. 3, the server 30 includes a storage device 31, a processor 32, an input / output interface 33, and a communication interface 34.

[0027] The storage device 31 is configured to store programs and data. The storage device 31 is, for example, a combination of a ROM, a RAM, and a storage (e.g., a flash memory or a hard disk).

[0028] The program includes, for example, the following programs. · An OS program · A program of an application that executes information processing

[0029] The data can include, for example, the following data. · Database referenced in information processing · Execution result of information processing · Sub-content

[0030] The processor 32 is a computer that realizes the functions of the server 30 by starting the program stored in the storage device 31. The processor 32 is, for example, at least one of the following. · CPU · GPU · ASIC · FPGA

[0031] The input / output interface 33 is configured to acquire information (for example, a user instruction) from an input device connected to the server 30 and output information (for example, an image) to an output device connected to the server 30.

[0032] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0033] The communication interface 34 is configured to control communication between the server 30 and an external device (for example, the client device 10 or the main content server 50).

[0034] (2) One aspect of the embodiment One aspect of this embodiment will be described. FIG. 4 is an explanatory diagram of one aspect of this embodiment. FIG. 5 is an explanatory diagram of one aspect of this embodiment.

[0035] As shown in FIG. 4, the client device 10 functions as a sub-content player 12a and a main content player 12b by the processor 12 executing the program stored in the storage device 11 (memory).

[0036] The main content player 12b is software capable of playing main content. The main content includes at least video and may further include other elements such as main audio. The main content is typically video content provided in an on-demand video service. The main content may be stored in the main content server 50. The main content player 12b may stream or download and play the main content via the main content server 50.

[0037] The sub-content player 12a is software capable of playing sub-content independently of the main content player 12b. The sub-content includes at least audio and may further include other elements such as video. The sub-content is created, for example, by recording (at least recording and may further include video recording) the reaction (such as a murmur, a scream, or a call to the viewers of the sub-content, etc.) made by the person (performer) watching the corresponding main content during the viewing of the main content. The performer is not particularly limited and may include, for example, voice actors, idols, actors, comedians, distributors of video posting / live broadcast services, singers, or athletes, etc. For one main content, various sub-contents can be created. When the sub-content includes video, the sub-content player 12a may play the sub-content in the PiP (Picture in Picture) format. The sub-content is created on the premise that at least a part of it is played synchronously with the main content described later. The sub-content player 12a may stream or download and play the sub-content via the server 30.

[0038] In addition, the sub-content player 12a can monitor the operating state of the main-content player 12b. Monitoring of the operating state can be realized, for example, by using the API (Application Programming Interface) of the main-content player 12b. The sub-content player 12a executes, as necessary, a process (hereinafter referred to as "synchronization support process") for promoting the synchronization between the main content and the sub-content according to the playback time of the sub-content and the monitoring result of the operating state of the main-content player 12b.

[0039] Specifically, as shown in FIG. 4, it is assumed that the sub-content player 12a starts playing the sub-content at time t1. At time t2, the sub-content player 12a continues to play the sub-content. A synchronization start timing (an example of the "predetermined playback time") is predetermined for the sub-content. By giving an instruction to start playing the main content to the main-content player 12b by the user in accordance with the synchronization start timing, the main content and the sub-content are played in substantially synchronization. In the example of FIG. 4, after time t2, this synchronization start timing arrives.

[0040] When the arrival of the synchronization start timing occurs and the user gives an instruction to start playing the main content to the main content player 12b, the main content player 12b starts playing the main content. When the sub-content exceeds the synchronization start timing at time t3, if the sub-content player 12a can confirm that the main content player 12b is playing the main content, the sub-content player 12a continues to play the sub-content. The delay from the synchronization start timing to time t3 can be determined in consideration of, for example, the reaction time of a human or the ability to recognize synchronization deviation. Thereby, the user can enjoy the reaction of the performer when viewing the main content in addition to the main content itself. This is a user experience different from simply viewing the main content. Furthermore, even for the same main content, by changing the sub-content to be combined, it becomes possible to provide various user experiences.

[0041] On the other hand, assume that even when the synchronization start timing arrives, the user does not give an instruction to start playing the main content to the main content player 12b due to forgetfulness or an operation mistake. In this case, as shown in FIG. 5, when the sub-content exceeds the synchronization start timing at time t3, the sub-content player 12a confirms that the main content player 12b is playing the main content, and the sub-content player 12a executes synchronization support processing. In the synchronization support processing, the user is prompted to give an instruction to start playing the main content to the main content player 12b when the synchronization start timing arrives. Thereby, even if the user fails in the operation, the user can be guided toward realizing synchronization. Details of the synchronization support processing will be described later.

[0042] As described above, according to the client device 10 of the present embodiment, since the user manually synchronizes the main content with the sub-content, it is possible to easily create sub-content that can be enjoyed together with the main content without incorporating a mechanism for realizing automatic synchronization in the sub-content player 12a or the main content player 12b. That is, it is possible to provide various user experiences for content including videos.

[0043] (3) Database The database of the present embodiment will be described. The following databases are stored in the storage device 11 and the storage device 31.

[0044] (3-1) Sub-content database The sub-content database of the present embodiment will be described. FIG. 6 is a diagram showing the data structure of the sub-content database of the present embodiment.

[0045] The sub-content database stores sub-content information. The sub-content information is information regarding the sub-content (in particular, metadata). The sub-content database stored in the storage device 31 can be updated in response to the creation (start of provision) or deletion (end of provision) of the sub-content. The sub-content database stored in the storage device 11 can have a record corresponding to the purchased sub-content added each time the user purchases the sub-content, for example.

[0046] As shown in FIG. 6, the sub-content database includes a "sub-content ID" field, a "main content ID" field, a "synchronization start timing" field, and a "synchronization end timing" field. Each field is associated with each other.

[0047] The "sub-content ID" field stores the sub-content ID. The sub-content ID uniquely identifies the sub-content.

[0048] The "main content ID" field stores the main content ID. The main content ID uniquely identifies the main content corresponding to the sub-content (hereinafter referred to as the "target sub-content") identified by the associated sub-content ID. Note that a plurality of different sub-content IDs can be associated with the same main content ID.

[0049] The "synchronization start timing" field stores the synchronization start timing information. The synchronization start timing information is information regarding the synchronization start timing corresponding to the target sub-content. Note that the synchronization start timing may be fixed at a specific playback time regardless of the sub-content. In this case, the synchronization start timing information may become unnecessary.

[0050] The "synchronization end timing" field stores the synchronization end timing information. The synchronization end timing information is information regarding the synchronization end timing corresponding to the target sub-content. After the synchronization end timing, the sub-content player 12a can omit monitoring the operating state of the main content player 12b. Note that the synchronization end timing may be fixed at a specific playback time regardless of the sub-content, or may not be defined. In these cases, the synchronization end timing information may become unnecessary.

[0051] The main content ID, synchronization start timing information, and synchronization end timing information corresponding to each sub-content may be embedded in the sub-content. In this case, the sub-content database may become unnecessary. Alternatively, this information may be notified from the server 30 to the client device 10 during playback of the sub-content. In this case, it is not necessary to create a sub-content database in the storage device 11.

[0052] (4) Information processing The information processing of this embodiment will be described.

[0053] (4-1) Sub-content playback processing The sub-content playback process of this embodiment will be described. FIG. 7 is a flowchart of the sub-content playback process of this embodiment. FIG. 8 is a flowchart of the playback process after synchronization in the sub-content playback process.

[0054] The sub-content playback process of this embodiment can be started, for example, when the client device 10 activates the sub-content player according to a user's instruction.

[0055] As shown in FIG. 7, the client device 10 executes reception of a playback start instruction (S110). Specifically, the client device 10 receives a playback start instruction for any of the available sub-contents from the user. As an example, the user gives an input device an operation of selecting a desired sub-content from a list screen of the available sub-contents displayed on the display 21, and the processor 12 analyzes the operation content. The available sub-contents may be organized and displayed for each corresponding main content or for each performer. The client device 10 identifies the instructed sub-content and acquires corresponding sub-content information from, for example, a sub-content database (FIG. 6). The client device 10 identifies the main content corresponding to the sub-content, the synchronization start timing, and the synchronization end timing based on the sub-content information.

[0056] After step S110, the client device 10 executes monitoring of the operation state of the main content player (S111). Specifically, the client device 10 acquires information (operation state information) regarding the operation state of the main content player capable of playing the main content corresponding to the sub-content instructed in step S110. The operation state information can include at least one of the following. · Information indicating whether the main content player is playing or stopped any main content · Information for identifying the main content being played by the main content player · Information indicating the playback time of the main content being played by the main content player

[0057] After step S111, the client device 10 executes pre-synchronization playback processing (S112). Specifically, the client device 10 plays the sub-content instructed in step S110. As an example, the client device 10 outputs the audio included in the sub-content from the speaker. Also, when the sub-content includes a video, the client device 10 may display the video on the display 21 in the PiP format.

[0058] The client device 10 continues the pre-synchronization playback processing (S112) until the playback time of the sub-content reaches the synchronization start timing corresponding to the sub-content, and accordingly the playback time of the sub-content is incremented. When the playback time of the sub-content reaches the synchronization start timing corresponding to the sub-content (the synchronization start timing arrives), the client device 10 determines whether the main content player is playing the main content.

[0059] Note that the sub-content may include a guide voice indicating the timing at which the user should give an instruction to start playing the main content. The guide voice is played before the synchronization start timing arrives, and the user can match the timing to start playing the main content based on the guide voice. The guide voice can include, for example, a countdown.

[0060] When it is determined that the main content is not being played after the synchronization start timing has arrived, the client device 10 executes synchronization support processing (S113). Specifically, the client device 10 prompts the user to be able to instruct the main content player to start playing the main content at an appropriate timing.

[0061] In the first example of the synchronization support process (S113), the client device 10 stops the playback of the sub-content. As a result, the user can no longer hear the audio included in the sub-content, so they can recognize that at least some problem has occurred. Furthermore, if the user has knowledge about the playback of the sub-content, they may forget the instruction to start the playback of the main content or notice that they have failed, and are prompted to restart the synchronization voluntarily.

[0062] In the second example of the synchronization support process (S113), the client device 10 outputs a notification. The notification may include, for example, a message indicating that the synchronization has failed. This allows the user to recognize that the synchronization has failed and be prompted to restart the synchronization voluntarily. Also, the notification may include a message indicating what operations are required and when to achieve the synchronization. This allows the user to recognize the correct procedure and prevent another failure.

[0063] In the third example of the synchronization support process (S113), the client device 10 jumps the sub-content to a playback time before the synchronization start timing. This allows the user to omit some of the operations for restarting the synchronization.

[0064] The fourth example of the synchronization support process (S113) is a combination of multiple of the above first to third examples.

[0065] When it is determined that the main content is being played back after the synchronization start timing has arrived, the client device 10 executes a post-synchronization playback process (S114). Specifically, the client device 10 continues the playback of the sub-content while maintaining the synchronization between the main content and the sub-content. As an example, the client device 10 performs the post-synchronization playback process shown in FIG. 8.

[0066] In the post-synchronization playback process of FIG. 8, the client device 10 basically continues to play the sub-content, and accordingly, the playback time of the sub-content is incremented. Specifically, as long as the synchronization end timing has not arrived and the playback of the main content has not stopped, the client device 10 continues to play the sub-content.

[0067] Before the synchronization end timing arrives, if the main content player detects that the playback of the main content has stopped, the client device 10 executes the stop of the sub-content (S1141). Specifically, the client device 10 stops the playback of the sub-content. Accordingly, the increment of the playback times of both the main content and the sub-content stops.

[0068] After step S1141, if the main content player detects that the playback of the main content has resumed, the client device 10 executes the resumption of the sub-content (S1142). Specifically, the client device 10 resumes the playback of the sub-content. Accordingly, the increment of the playback times of both the main content and the sub-content resumes.

[0069] On the other hand, when the client device 10 detects that the playback time of the sub-content has reached the synchronization end timing corresponding to the sub-content (the synchronization end timing has arrived), the client device 10 executes the asynchronous playback of the sub-content (S1143). Specifically, the client device 10 controls the playback of the sub-content independently of the operating state of the main content player (that is, without performing the stop of the sub-content (S1141) and the resumption of the sub-content (S1142)). As an example, the client device 10 can continue to play the sub-content unless it receives a different instruction from the user.

[0070] (5) Small parentheses As described above, the client device 10 of the present embodiment plays sub-content including audio independently of a player which is software capable of playing main content including moving images, and monitors the operating state of the player. When the sub-content is played for a period exceeding a predetermined playback time and the player is not playing the main content, the client device 10 performs synchronization support processing for promoting the synchronization between the main content and the sub-content. Thereby, even if the user fails in an operation, the user can be guided toward realizing synchronization. As described above, according to the client device 10, since the user manually synchronizes the main content with the sub-content, it is possible to easily create sub-content that can be enjoyed together with the main content without incorporating a mechanism for automatically realizing synchronization in the player for the sub-content or the main content. That is, it is possible to provide various user experiences for content including moving images.

[0071] When the sub-content is played for a period exceeding a predetermined playback time and the player is not playing the main content, the client device 10 may stop the playback of the sub-content. Thereby, since the user cannot hear the audio included in the sub-content, the user can recognize that at least some problem has occurred. If the user has knowledge about sub-content playback, the user forgets or notices that the instruction to start the playback of the main content has been missed or failed, and is prompted to restart synchronization voluntarily.

[0072] When the sub-content is played for a period exceeding a predetermined playback time and the player is not playing the main content, the client device 10 may output a notification. Thereby, the user can be made to recognize that synchronization has failed, and can be prompted to restart synchronization voluntarily.

[0073] If the player is not playing the main content even when the sub-content is played for more than a predetermined playback time, the client device 10 may jump the sub-content to a playback time before the predetermined playback time. Thereby, the user can omit some operations for restarting synchronization.

[0074] If it is detected that the player has stopped playing the main content after a predetermined playback time, the client device 10 may stop playing the sub-content. Thereby, when the user temporarily interrupts the playback of the main content, only the playback time of the sub-content is incremented, and it is possible to prevent the synchronization from being disrupted.

[0075] If it is detected that the player has restarted playing the main content after it is detected that the player has stopped playing the main content, the client device 10 may resume playing the sub-content. Thereby, when the user resumes after temporarily interrupting the playback of the main content, only the playback time of the sub-content is not incremented, and it is possible to prevent the synchronization from being disrupted.

[0076] The client device 10 may refer to a sub-content database in which information about the sub-content is stored, and specify a predetermined playback time corresponding to the sub-content. Thereby, for each sub-content, the time that can be secured before the predetermined playback time can be arbitrarily set, so the degree of freedom in creating sub-content is improved.

[0077] The sub-content may include a guide voice indicating the timing at which the user should give an instruction to start playing the main content. Thereby, it becomes easier for the user to adjust the timing for giving an instruction to start playing the main content.

[0078] The guide voice may include a countdown. Thereby, it becomes easier for the user to adjust the timing for giving an instruction to start playing the main content.

[0079] (6) Other Variants The storage device 11 may be connected to the client device 10 via the network NW. The display 21 may be integrated with the client device 10. The storage device 31 may be connected to the server 30 via the network NW.

[0080] Before the sub-content reaches the synchronization start timing, when the main content player plays the main content, the client device 10 may perform a process to promote the synchronization between the main content and the sub-content. For example, the client device 10 may stop the playback of the sub-content or output a notification. Thereby, even if the user accidentally starts the playback of the main content at an overly early timing, the user can be guided towards realizing the synchronization.

[0081] In the above description, an example was shown in which sub-content corresponding to the main content is created by recording the sound emitted by the person (performer) watching the main content during the viewing of the main content. The guide voice needs to be inserted at an appropriate position according to the recording time when the playback of the main content started during this recording. The insertion position of the guide voice may be manually determined by the creator or provider of the sub-content, or may be automatically determined by different methods. For example, the guide voice may be inserted at a position in the recording time before the detected time based on the time when a predetermined sound included in the main content played during the recording of the sound emitted by the performer is detected. The predetermined sound may be, for example, the main content or a short piece of music (e.g., jingle) for the notification of its creator or distributor. Thereby, the insertion position of the guide voice can be efficiently determined. Also, when the user watches the sub-content, the client device 10 may be configured to perform synchronization support processing when the sub-content is played beyond the synchronization start timing and no predetermined sound included in the main content is detected.

[0082] In the above description, an example in which each step is executed in a specific order in each process has been shown. However, the execution order of each step is not limited to the example described as long as there is no dependency. Each step of the above information processing can be executed by either the client device 10 or the server 30. For example, a process described as being performed by one device may be performed by another device, or a process described as being performed through the interaction of multiple devices may be performed by a single device.

[0083] As described above, the embodiments of the present invention have been described in detail. However, the scope of the present invention is not limited to the above embodiments. Also, the above embodiments can be variously improved and modified without departing from the gist of the present invention. Further, the above embodiments and modifications can be combined.

Explanation of Reference Numerals

[0084] 1: Information processing system 10: Client device 11: Storage device 12: Processor 13: Input / output interface 14: Communication interface 21: Display 30: Server 31: Storage device 32: Processor 33: Input / output interface 34: Communication interface 50: Main content server

Claims

1. A computer, means for playing sub-content including audio, independently of a player which is software capable of playing main content including moving images, means for monitoring an operating state of the player, means for performing a first process of promoting synchronization between the main content and the sub-content when the player is not playing the main content even if the sub-content is played for a period exceeding a predetermined playback time, A program for causing the computer to function as such.

2. The means for performing the first process stops playback of the sub-content when the player is not playing the main content even if the sub-content is played for a period exceeding the predetermined playback time, The program according to claim 1.

3. The means for performing the first process outputs a notification when the player is not playing the main content even if the sub-content is played for a period exceeding the predetermined playback time, The program according to claim 1.

4. The means for performing the first process jumps the sub-content to a playback time before the predetermined playback time when the player is not playing the main content even if the sub-content is played for a period exceeding the predetermined playback time, The program according to claim 1.

5. A program for causing the computer to function as means for performing a second process of promoting synchronization between the main content and the sub-content when the player plays the main content before the sub-content reaches the predetermined playback time, The program according to claim 1.

6. The means for playing the sub-content stops playback of the sub-content when it is detected that the player has stopped playing the main content after the predetermined playback time, The program according to claim 1.

7. The means for playing the sub-content resumes playback of the sub-content when it is detected that the player has resumed playing the main content after it is detected that the player has stopped playing the main content, The program according to claim 6.

8. A program for causing the computer to function as means for referring to a database storing information about the sub-content and specifying the predetermined playback time corresponding to the sub-content, The program according to claim 1.

9. The sub-content includes a first audio indicating the timing at which the user should give an instruction to start playing the main content. The program according to claim 1.

10. The first audio includes a countdown. The program according to claim 9.

11. The sub-content further includes a second audio that records the sound emitted by a person watching the main content during the viewing of the main content, and the first audio is inserted at a recording time position earlier than the time when a predetermined sound included in the main content played at the time of recording the second audio is detected. The program according to claim 9.

12. Means for playing sub-content including audio, independently of a player which is software capable of playing main content including moving images, means for monitoring an operating state of the player, and means for performing a first process for promoting synchronization between the main content and the sub-content when the player is not playing the main content even if the sub-content is played for a period exceeding a predetermined playback time. An information processing apparatus comprising the same.

13. A computer performs steps of playing sub-content including audio, independently of a player which is software capable of playing main content including moving images, monitoring an operating state of the player, and performing a first process for promoting synchronization between the main content and the sub-content when the player is not playing the main content even if the sub-content is played for a period exceeding a predetermined playback time. A method.

14. A system including a plurality of computers, comprising means for playing sub-content including audio, independently of a player which is software capable of playing main content including moving images, means for monitoring an operating state of the player, and means for performing a first process for promoting synchronization between the main content and the sub-content when the player is not playing the main content even if the sub-content is played for a period exceeding a predetermined playback time. A system comprising the same.

Images