Information processing system

Abstract

To provide an information processing system capable of appropriately grasping a viewing situation of a viewer of moving image data to be distributed.SOLUTION: An information processing system comprises: a moving image distribution part that distributes moving image data to a terminal device of each viewer; an instruction input part that receives an input of an operation instruction in regard to reproduction of the moving image data; and a moving image recording part that records real time moving image data. The instruction input part receives a first operation instruction for reproducing the recorded real time moving image data so as to be delayed from the real time moving data. In the case where the first operation instruction is received from the first terminal device, the moving distribution part distributes the recorded real time moving image data as a tracking moving image data to the first terminal device. The information processing system further comprises a situation notification part that performs notification of a viewing situation of the real time moving image data and the tracking moving image data on the basis of a content of the operation instruction received from each terminal device.SELECTED DRAWING: Figure 16

Description

Technical Field

[0001] This disclosure relates to an information processing system.

Background Art

[0002] In recent years, opportunities to hold seminars, conferences, etc. that distribute videos online using networks such as the Internet have been increasing. Japanese Patent Application Laid-Open No. 2005-244522 (Patent Document 1) discloses a network conference system in which a conference terminal connects to a recording server and can receive distribution of past conference data in a real-time conference that is played back at high speed, low speed, or at a constant speed from the recording server.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When the organizer of a seminar (or conference, etc.) has a situation where people watching the distributed video in real time and people watching the video late are mixed, the organizer tries to adjust the progress of the seminar as much as possible (for example, adjusting the end time, etc.). However, there is a problem that the organizer cannot appropriately grasp the viewing situation of each viewer, so the adjustment cannot be appropriately made.

[0005] In the network conference system according to Patent Document 1, while considering that those who are late can grasp the past conference content without hindering the progress of the real-time conference, it does not teach or suggest any solution to the above problems.

[0006] One objective of this disclosure is to provide an information processing system that can appropriately grasp the viewing status of viewers of distributed video data. [Means for solving the problem]

[0007] An information processing system according to one embodiment includes a video distribution unit that distributes video data to each viewer's terminal device, an instruction input unit that receives input of operation instructions regarding the playback of video data from each terminal device, and a video recording unit that records real-time video data showing the video data distributed in real time by the video distribution unit. The instruction input unit receives a first operation instruction to play the recorded real-time video data with a delay from the real-time video data. When the first operation instruction is received from the first terminal device, the video distribution unit distributes the recorded real-time video data to the first terminal device as catch-up video data that is played back with a delay from the real-time video data. The information processing system further includes a status notification unit that notifies the viewing status of the real-time video data and catch-up video data based on the content of the operation instructions received from each terminal device.

[0008] Preferably, the viewing status includes the number of first viewers watching real-time video data and the number of second viewers watching catch-up video data.

[0009] Preferably, the viewing status includes the time delay between the real-time video data and the catch-up video data being viewed by each second viewer.

[0010] Preferably, the information processing system further includes an extraction unit for extracting time points from video data. Based on a first operation instruction, the extraction unit extracts a first time point from the tracking video data distributed to a first terminal device.

[0011] Preferably, the extraction unit further extracts a second time point from the real-time video data. If the first time point is delayed by a predetermined amount of time or more compared to the second time point, the status notification unit does not notify the user of the first terminal device of the status of watching the catch-up video data.

[0012] The video recording unit stops or starts recording real-time video data according to instructions from the video data distributor.

[0013] Preferably, the video data includes presentation slides. The first operation instruction includes an instruction to play the catch-up video data by specifying the start time of playback after pausing or rewinding. The information processing system further includes an acquisition unit that acquires the page number of the slide material being played at the start of playback. The viewing status includes the page number.

[0014] Preferably, after receiving the first operation instruction, the instruction input unit receives a second operation instruction from the first terminal device to switch from playback of tracking video data to playback of real-time video data.

[0015] Preferably, the extraction unit further extracts a second time point from the real-time video data. Based on the first and second time points, the status notification unit calculates the time it takes for the first time point to catch up to the second time point when the catch-up video data distributed to the first terminal device is played at a predetermined speed. The viewing status includes information indicating the calculated time. [Effects of the Invention]

[0016] According to this disclosure, it will be possible to understand the viewing status of viewers of the distributed video data. [Brief explanation of the drawing]

[0017] [Figure 1] This is a diagram illustrating the overall structure of an information processing system. [Figure 2] This is a diagram showing an example of a terminal device hardware configuration. [Figure 3]It is a block diagram showing an example of the hardware configuration of an information processing apparatus. [Figure 4] It is a diagram for explaining a specific example of a problem. [Figure 5] It is a diagram for explaining a specific example of a countermeasure. [Figure 6] It is a diagram showing an example of a table indicating viewing status. [Figure 7] It is a flowchart showing an example of the main processing flow of an information processing apparatus. [Figure 8] It is a flowchart showing an example of the page number acquisition process. [Figure 9] It is a diagram showing an example of a table in which page numbers are stored. [Figure 10] It is a diagram showing another example of a table indicating viewing status. [Figure 11] It is a diagram showing an example of a display screen indicating viewing status. [Figure 12] It is a diagram showing another example of a display screen indicating viewing status. [Figure 13] It is a flowchart showing an example of the processing procedure regarding recording and distribution of an information processing apparatus. [Figure 14] It is a diagram showing an example of the processing procedure of a terminal device. [Figure 15] It is a diagram showing an example of the display screen of a terminal device. [Figure 16] It is a block diagram showing an example of the functional configuration of an information processing apparatus.

Mode for Carrying Out the Invention

[0018] Hereinafter, embodiments of the present invention will be described while referring to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

[0019] <System Configuration> Figure 1 is a diagram illustrating the overall configuration of the information processing system 1000. Referring to Figure 1, the information processing system 1000 is a system for understanding the viewing status of viewers of distributed video data (video content). Specifically, the information processing system 1000 includes multiple terminal devices 10A to 10C (hereinafter also collectively referred to as "terminal devices 10") and an information processing device 20.

[0020] Terminal device 10 is a device owned by a user who views video data distributed from the information processing device 20. Terminal devices 10A to 10C are terminal devices belonging to users A to C, respectively. Each user views the video data using their own terminal device 10. Terminal device 10 is typically a laptop personal computer, but is not limited to this; for example, it may be a tablet device, a smartphone, or the like.

[0021] The information processing device 20 is a device (e.g., a server) for distributing video data, and is typically used by organizers of seminars, conferences, etc. The information processing device 20 performs tasks such as creating (or acquiring) video data, real-time distribution of video data to each terminal device 10, recording (storing) the real-time distributed video data, receiving operation instructions from each terminal device 10 regarding the playback of video data, distributing recorded video data in accordance with said operation instructions, and displaying the viewing status of each viewer.

[0022] The information processing device 20 has a structure that conforms to general-purpose computer architecture, and the processor executes pre-installed programs to perform various processes described later. The information processing device 20 is typically a personal computer, but is not limited to that, and may be, for example, a tablet terminal device.

[0023] <Hardware Configuration> Figure 2 is a block diagram showing an example of the hardware configuration of terminal device 10. Referring to Figure 2, terminal device 10 includes a processor 102, an input interface (IF) 104, a communication interface 106, a display 108, and a storage device 110. Each of these components is connected to the others in a data communication manner.

[0024] The processor 102 is typically an arithmetic processing unit such as a CPU (Central Processing Unit) or MPU (Multi-Processing Unit). The processor 102 controls the operation of each part of the terminal device 10 by reading and executing a program stored in the storage device 110. By executing the program, the processor 102 realizes each function of the terminal device 10.

[0025] The input interface 104 receives operational input for the terminal device 10. The input interface 104 can be implemented, for example, by a keyboard, buttons, a touch panel, or the like.

[0026] The communication interface 106 mediates data transmission between the processor 102 and the information processing device 20, etc. Communication via the communication interface 106 is carried out using the Internet, a wide area network (WAN), a local area network (LAN), an Ethernet® network, a wired network, a wireless network, etc., or a combination thereof.

[0027] Display 108 is, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc.

[0028] The storage device 110 is implemented using RAM (Random Access Memory), ROM (Read-Only Memory), a hard disk, etc. The storage device 110 stores programs and the like that executed by the processor 102.

[0029] Figure 3 is a block diagram showing an example of the hardware configuration of the information processing device 20. Referring to Figure 3, the information processing device 20 includes a processor 202, an input interface 204, a communication interface 206, a display 208, and a storage device 210. Each of these components is connected to the others in a data communication manner.

[0030] The processor 202 controls the operation of each part of the information processing device 20 by reading and executing a program stored in the storage device 210. By executing the program, the processor 202 realizes each function of the information processing device 20.

[0031] The input interface 204 receives operational input for the information processing device 20. The input interface 204 can be implemented, for example, by a keyboard, buttons, or a mouse.

[0032] The communication interface 206 mediates data transmission between the processor 202 and the terminal device 10, etc. The display 208 is, for example, a liquid crystal display, an organic EL display, etc.

[0033] The storage device 210 is implemented by RAM, ROM, hard disk, etc. In addition to programs executed by the processor 202, the storage device 210 stores video data 310 and viewing status data 320. The video data 310 includes real-time video data and catch-up video data, which will be described later. The viewing status data 320 includes various tables, which will be described later.

[0034] <Specific examples of problems> Figure 4 illustrates a specific example of the problem. In the example in Figure 4, multiple viewers are participating in an online seminar, and each viewer is watching a video streamed by the seminar organizer using their own device. It is also assumed that there are viewers watching the video data streamed in real time (hereinafter also referred to as "real-time video data") and viewers watching delayed video data that plays after the real-time video data. The delayed video data is a recording of the real-time video data.

[0035] Referring to Figure 4, the seminar begins at 10:00, and video data is delivered to the viewers' terminal devices. Viewer X1, who joined at 10:00, will view the real-time video data.

[0036] Meanwhile, viewer X2, who joined the seminar 30 minutes late, watches the catch-up video data. When the seminar ends at 12:10, the video data distribution also stops. As a result, viewer X2 is unable to watch the video data to the end, and also does not have time to participate in the Q&A session.

[0037] Figure 5 is a diagram illustrating a specific example of a countermeasure. Referring to Figure 5, similar to the example in Figure 4, viewer X1 watches real-time video data, and viewer X2, who joined the seminar 30 minutes later, watches catch-up video data. In this embodiment, the information processing device 20, which is the organizer's device, displays information indicating the viewing status as shown in Figure 6.

[0038] Figure 6 shows an example of a table showing viewing status. Referring to Figure 6, Table 410 includes the number of viewers of real-time video data (hereinafter also referred to as "real-time viewers"), the number of viewers of catch-up videos (hereinafter also referred to as "catch-up viewers"), the total number of viewers, and the percentage of each viewer number relative to the total number of viewers.

[0039] In the example shown in Figure 6, there are 60 real-time viewers and 40 catch-up viewers, for a total of 100 viewers. Additionally, there are 23 catch-up viewers with a delay of more than 0 minutes but less than 10 minutes, 15 catch-up viewers with a delay of 10 minutes or more but less than 20 minutes, and 2 catch-up viewers with a delay of 20 minutes or more but less than 30 minutes. Furthermore, the ratio of real-time viewers to the total number of viewers is 60%, and the ratio of catch-up viewers to the total number of viewers is 40%. For example, the organizer can grasp this information by checking the table 410 displayed on the display 208 of the information processing device 20.

[0040] Referring again to Figure 5, the organizer checks Table 410 and determines that there are viewers watching the seminar with a delay of up to 30 minutes. Therefore, the organizer pauses the recording of the real-time video data during the break from 10:50 to 11:00. As a result, the catch-up video data does not include the data from 10:50 to 11:00 during the break, thus reducing the difference between the seminar progress of real-time viewers and the seminar progress of catch-up viewers by 10 minutes.

[0041] Furthermore, the organizers will provide a 20-minute break before the Q&A session following the end of the seminar lecture. In addition, to ensure sufficient time for the Q&A, the organizers will change the seminar end time from 12:10 to 12:30. This will ensure that the seminar progress for real-time viewers and on-demand viewers will be the same at 12:10 when the Q&A session begins. Therefore, all viewers will be able to participate in the Q&A session simultaneously from 12:10.

[0042] In this way, organizers can take measures to adjust the pace of seminars and meetings by understanding the viewing status of each viewer of the video data.

[0043] <Processing Procedure> Figure 7 is a flowchart illustrating an example of the main processing flow of the information processing device 20. Each step in Figure 7 is executed by the processor 202 of the information processing device 20. In this example, the seminar organizer uses the information processing device 20 to distribute video data including presentation slides (where the slides are displayed).

[0044] Referring to Figure 7, the information processing device 20 (processor 202) distributes real-time video data (step S10). The information processing device 20 may be configured to create the distributed real-time video data within its own device, or it may be configured to acquire (receive) real-time video data created by an external device.

[0045] The information processing device 20 records (stores) the real-time video data being distributed (step S12). Specifically, the information processing device 20 records the real-time video data for real-time distribution and also records the real-time video data as video data for catch-up viewing. The information processing device 20 distributes the recorded real-time video data as catch-up video data (step S14).

[0046] The information processing device 20 determines whether or not it has received an operation instruction from the viewer's terminal device 10 regarding the playback of video data (step S16). If it has not received such an operation instruction (NO in step S16), the information processing device 20 repeats step S16. If it has received such an operation instruction (YES in step S16), the information processing device 20 executes one of steps S18 to S26.

[0047] When the information processing device 20 receives a playback instruction for real-time video data (step S18) or a playback instruction for time-lapse video data (step S20), it extracts the time in the video data to be played (the time on the time axis of the video data) (step S28).

[0048] A real-time video playback instruction is an instruction to play real-time video data. A catch-up video playback instruction is, for example, an instruction to play the video data from the beginning, an instruction to start playback after pausing, an instruction to start playback after rewinding, etc. Time information is embedded in the video data, and when real-time video data is played, the time in the video data is the same as the current time. When catch-up video data is played, the time in the video data is a time earlier than the current time.

[0049] When the information processing device 20 receives a stop (termination) instruction for the video data being distributed (real-time video data or tracking video data) (step S26), the information processing device 20 terminates processing.

[0050] When the information processing device 20 receives a pause instruction for the distributed video data (real-time video data or time-lapse video data) (step S22) or a rewind instruction (step S24), it extracts the time in the video data (step S30). Specifically, when the information processing device 20 receives a pause instruction, it extracts the time at the pause point in the video data, and when it receives a rewind instruction, it extracts the time at the rewind point (the time after rewinding) in the video data. Subsequently, the information processing device 20 executes a process to obtain the page number of the slide material displayed in the video data at the pause point or the rewind point (step S32).

[0051] Figure 8 is a flowchart illustrating an example of the page number acquisition process. Referring to Figure 8, the information processing device 20 acquires an image of the video data at the pause point (or rewind point) (step S102). The information processing device 20 also acquires an image of each page of a separately prepared slide material (step S104).

[0052] The information processing device 20 compares the images in the video data with the images on each page of the slide materials (step S106). The information processing device 20 identifies the image on each page of the slide materials that matches the image in the video data (step S108). The information processing device 20 stores the page number of the identified image (step S110).

[0053] The method for obtaining page numbers is not limited to the process shown in the flowchart above; it may also involve embedding the page number data of the slide presentation into the video data and then extracting the page number.

[0054] Figure 9 shows an example of a table in which page numbers are stored. Referring to Figure 9, Table 420 shows the page numbers of the slides displayed on the screen in the video data at the time of pause or rewind.

[0055] In the example in Figure 9, it is shown that a total of 5 viewers instructed the video to pause when page number "5" was displayed, and 5 viewers instructed the video to rewind to the page displaying page number "5". Of these 5 viewers, 3 were watching the catch-up video data less than 10 minutes behind the current time at the time they instructed the video, and 2 were watching the catch-up video data more than 10 minutes but less than 20 minutes behind at the time they instructed the video. The same applies to page number "10".

[0056] By checking Table 420, the organizer can infer which page numbers in the slide presentation the audience wants to focus on. In the example in Figure 9, the organizer infers that the audience wants detailed explanations of page numbers "5" and "10". Therefore, during the Q&A session, the organizer can tailor the seminar by prioritizing supplementary explanations or prompting questions about these page numbers.

[0057] Referring again to Figure 7, the information processing device 20 calculates the time it will take for the time in the video data to catch up to the current time when the video data is played at N times the speed (for example, 2 times the speed), based on the difference between the current time and the time in the video data (step S34). Subsequently, the information processing device 20 displays the viewing status of each viewer on the display 208 based on the content of the operation instructions received from each viewer (step S36).

[0058] Figure 10 shows another example of a table showing viewing status. Referring to Figure 10, Table 430 includes the managed audience, the number of real-time viewers, the number of catch-up viewers (from the beginning, paused or rewound, etc.), the total number of viewers, and the percentage of each viewer number relative to the total. Table 430 in Figure 10 shows more detailed viewing status than Table 410 in Figure 6.

[0059] In the example in Figure 10, there are 60 real-time viewers and 40 catch-up viewers, for a total of 100 viewers. Of the catch-up viewers, 20 are watching the catch-up video data from the beginning ("Catch-up viewing (from the beginning)" in the figure), 15 are watching the catch-up video data after pausing or rewinding ("Catch-up viewing (paused or rewound)" in the figure), and 5 are watching the catch-up video data for other reasons (e.g., communication network problems) ("Catch-up viewing (other)" in the figure).

[0060] Furthermore, if a viewer who joins the seminar late starts watching from the beginning and pauses at any point, that viewer will be counted as part of the number of people watching the seminar (pausing or rewinding).

[0061] Furthermore, for example, regarding catch-up viewers (from the beginning), there are 10 people corresponding to a delay of more than 0 minutes but less than 10 minutes, 15 people corresponding to a delay of 10 minutes or more but less than 20 minutes, and 2 people corresponding to a delay of 20 minutes or more but less than 30 minutes. Also, the ratio of real-time viewers to the total number of people is 60%, and the ratio of catch-up viewers (from the beginning) to the total number of people is 20%. For example, the organizer can grasp this information by checking the table 430 displayed on the display 208 of the information processing device 20.

[0062] The "Managed" option indicates whether or not the viewing status of viewers who are watching the video data with a delay is included in the management. In the example in Figure 10, it is shown that the viewing status of viewers with a delay of less than 30 minutes is included in the management (corresponding to "Yes" in the figure), but the viewing status of viewers with a delay of 30 minutes or more is not included in the management (corresponding to "No" in the figure).

[0063] In this case, the viewing status of viewers who are more than 30 minutes late will not be displayed. This is because viewers who are watching more than 30 minutes late are significantly behind compared to other viewers, and considering the meeting end time, facility reservation time, etc., it would be difficult to adjust the seminar's pace to accommodate these viewers. Therefore, by not displaying the viewing status of such viewers, the organizers can easily grasp the viewing status of viewers who should be managed.

[0064] Figure 11 shows an example of a display screen showing viewing status. Referring to Figure 11, the display screen 510 includes areas 512 and 514, and buttons 516, 518, and 520. Area 512 displays the current time, the scheduled end time of the seminar, the end time of the facility reservation, and the number of viewers watching at each delay time. Area 514 displays the number of viewers watching at each delay time using a histogram.

[0065] Button 516 is for displaying the number of viewers tracking the video in a histogram format, as shown in area 514. Button 518 is for displaying the screen shown in Figure 12, which will be described later. Button 520 is for receiving instructions to pause / resume recording of real-time video data.

[0066] Figure 12 shows another example of a display screen showing viewing status. Referring to Figure 12, display screen 520 includes areas 512, 522, and 524, and buttons 516, 518, and 520. Area 512 and buttons 516-520 are the same as in Figure 11. Area 522 displays the number of real-time viewers and catch-up viewers (see Figure 10), the number of viewers who have paused (or rewound), and the page number corresponding to the pause (or rewind) point (see Figure 9), etc. Area 524 displays the number of viewers watching catch-up at N times the normal speed.

[0067] Referring again to Figure 7, the information processing device 20 determines whether the video data (real-time video data or tracking video data) has finished (step S38). If the video data has not finished (NO in step S38), the information processing device 20 returns to the process in step S16. Thus, the information processing device 20 continuously repeats the processes in steps S16 to S38 until the video data has finished. On the other hand, if the video data has finished (YES in step S38), the information processing device 20 terminates its processing.

[0068] Figure 13 is a flowchart showing an example of the processing procedure for recording and distribution by the information processing device 20. Referring to Figure 13, the information processing device 20 determines whether or not it has received an operation instruction from a user (e.g., the organizer) (step S50). If the operation instruction has not been received (NO in step S50), the information processing device 20 terminates processing.

[0069] On the other hand, if the operation instruction is received (YES in step S50), the information processing device 20 executes one of steps S52, S56, or S60.

[0070] When the information processing device 20 receives an instruction to distribute real-time video data and start recording (step S52), it distributes the real-time video data and starts recording the real-time video data (step S54). For example, the information processing device 20 receives a recording start instruction by receiving a selection input from the button 520 shown in Figures 11 and 12.

[0071] When the information processing device 20 receives a request to pause recording of real-time video data (step S56), it temporarily stops the distribution and recording of real-time video data (step S58). For example, the information processing device 20 receives a request to pause recording by receiving a selection input from the button 520 in Figures 11 and 12. For example, as explained in Figure 5, the organizer pauses the recording during breaks to adjust the progress of the seminar.

[0072] When the information processing device 20 receives an instruction to end the distribution of real-time video data (step S60), it terminates the distribution of real-time video data (step S62). In this case, the recording of real-time video data also terminates.

[0073] (Terminal device 10) Figure 14 shows an example of the processing procedure of the terminal device 10. The processing of each step in Figure 14 is typically performed by the processor 102 of the terminal device 10.

[0074] Referring to Figure 14, the terminal device 10 performs processing to prepare for viewing the distributed video data (step S202). For example, the terminal device 10 prepares for viewing the video data by launching a predetermined viewing application, accessing a predetermined site, logging in, etc.

[0075] The terminal device 10 receives operation instructions from the user (viewer) regarding the playback of video data (step S204). For example, the terminal device 10 receives instructions to play, pause, rewind, fast forward, and end the video data (real-time video data and time-lapse video data). The terminal device 10 transmits information indicating the operation instructions to the information processing device 20.

[0076] The terminal device 10 calculates the time it takes for the time in the video data to catch up to the current time when the video data is played at N times the speed (for example, 2 times the speed) based on the difference between the current time and the time in the video data (step S206). The terminal device 10 can determine the time in the video data by extracting the time information embedded in the video data. Subsequently, the information processing device 20 displays the distributed video data on the display 108 (step S208).

[0077] Figure 15 shows an example of the display screen of the terminal device 10. Referring to Figure 15, the display screen 530 includes a video display area 532, a button 534, a notification area 536, and an operation button 538.

[0078] The video display area 532 displays video data distributed from the seminar (for example, presentation slides). Button 534 is for viewing real-time video data. By selecting button 534, viewers can switch the video data displayed in the video display area 532 to real-time video data. The notification area 536 notifies viewers of the time delay relative to the current time (for example, 10 minutes), the time it will take for the time in the video data to catch up to the current time when viewed at N times speed (for example, 2 times speed) (for example, 5 minutes), etc. By selecting the operation button 538, viewers can perform operations such as stopping, pausing, fast-forwarding, and rewinding the video data.

[0079] <Functional Configuration> Figure 16 is a block diagram showing an example of the functional configuration of the information processing device 20. Referring to Figure 16, the information processing device 20 includes, as its main functional configuration, an instruction input unit 250, a video distribution unit 252, a video recording unit 254, an extraction unit 256, an acquisition unit 258, and a status notification unit 260. These functional configurations are typically realized by the processor 202 of the information processing device 20 executing a program stored in the storage device 210.

[0080] The instruction input unit 250 receives operation instructions from each terminal device 10 regarding the playback of video data. In certain situations, the instruction input unit 250 receives a first operation instruction to play recorded real-time video data (i.e., chase video data) at a delay compared to the real-time video data. The first operation instruction includes instructions to play the chase video data by specifying the playback start point after pausing or rewinding (i.e., the pause point or rewind point), instructions to play the chase video data from the beginning, and so on.

[0081] In other situations, the instruction input unit 250 receives a second operation instruction from the terminal device 10 to switch from playback of tracking video data to playback of real-time video data. For example, the second operation instruction is an instruction to select button 534 in Figure 15 on the terminal device 10.

[0082] The video distribution unit 252 distributes video data to each viewer's terminal device 10. Specifically, the video distribution unit 252 distributes real-time video data and timed video data. The real-time video data may be acquired from an external device or created within the information processing device 20.

[0083] In certain situations, when a first operation instruction is received from the terminal device 10, the video distribution unit 252 distributes the recorded real-time video data to the terminal device 10 as delayed video data that is played back later than the real-time video data.

[0084] The video recording unit 254 records real-time video data distributed in real time by the video distribution unit 252. Specifically, the video recording unit 254 stores the real-time video data as recorded data in the storage device 210. Typically, this recorded data is used as tracking video data. The video distribution unit 252 distributes the tracking video data stored in the storage device 210.

[0085] In certain situations, the video recording unit 254 stops or resumes recording real-time video data in accordance with instructions from the video data distributor (e.g., the organizer). Such instructions include, for example, selecting the button 520 shown in Figures 11 and 12.

[0086] The extraction unit 256 extracts timestamps from the video data. In one scenario, the extraction unit 256 extracts a first timestamp from the tracking video data distributed to the terminal device 10 based on a first operation instruction. In other scenarios, the extraction unit 256 further extracts a second timestamp from the real-time video data.

[0087] The acquisition unit 258 acquires the page number of the slide material being played at the start of playback of the catch-up video data after pausing or rewinding. Specifically, the acquisition unit 258 compares the image at the start of playback of the catch-up video data after pausing or rewinding with the images of each page of the slide material to identify the image from each page of the slide material that matches the image at the start of playback, and acquires the page number of the identified image.

[0088] The status notification unit 260 notifies the viewing status of real-time video data and catch-up video data based on the content of the operation instructions (various instructions shown in steps S18 to S26 in Figure 7) received from each terminal device 10. Specifically, the status notification unit 260 displays the viewing status shown in table 410 in Figure 6, table 420 in Figure 9, table 430 in Figure 10, display screen 510 in Figure 11, and display screen 520 in Figure 12, etc., on the display 208.

[0089] The viewing status includes the number of first-party viewers watching real-time video data and the number of second-party viewers watching catch-up video data (see, for example, Table 410 in Figure 6). The viewing status also includes the delay in the catch-up video data being watched by each second-party viewer relative to the real-time video data (for example, "Delay Time" in Table 410 in Figure 6). Furthermore, the viewing status includes the page number of the slide material acquired by the acquisition unit 258 (for example, "Delayed Page Number" in Table 420 in Figure 9).

[0090] In certain situations, if the first time zone is delayed by a predetermined amount of time (e.g., 30 minutes) or more compared to the second time zone, the status notification unit 260 will not notify the user (viewer) of the terminal device 10 of their viewing status of the catch-up video data. For example, as shown in the table 430 of Figure 10, viewers with a delay of 30 minutes or more are excluded from management. In this case, the status notification unit 260 will not display the viewing status of such viewers on the display 208.

[0091] In other scenarios, the status notification unit 260 calculates the time it takes for the first time to catch up to the second time when the tracking video data distributed to the terminal device 10 is played at a predetermined speed, based on the first and second time points. The viewing status includes information indicating the calculated time. The terminal device 10 may also calculate the time it takes for the first time to catch up to the second time point and display information indicating the calculated time (for example, the notification area 536 in Figure 15) on the display 108.

[0092] <Other embodiments> (1) In the above-described embodiment, the functions of the information processing device 20 may be implemented using multiple devices. For example, the functions of the information processing device 20 may be implemented using an information terminal device used by the organizer and an information processing server. In this case, for example, the status notification unit 260 may be implemented in the information terminal device, and the instruction input unit 250, video distribution unit 252, video recording unit 254, extraction unit 256, and acquisition unit 258 may be implemented in the information processing server.

[0093] (2) In the embodiments described above, a program can also be provided that causes the computer to function and execute the control described in the flowchart above. Such a program can be recorded on a computer-readable recording medium that is not temporary, such as a flexible disk, CD-ROM (Compact Disk Read Only Memory), secondary storage device, main memory, and memory card attached to the computer, and provided as a program product. Alternatively, the program can be recorded on a recording medium such as a hard disk built into the computer and provided. Furthermore, the program can also be provided by downloading it over a network.

[0094] (3) The configurations illustrated above as embodiments are examples of the configuration of the present invention, and can be combined with other known technologies, and can be modified, such as by omitting parts, without departing from the spirit of the present invention. Furthermore, in the embodiments described above, processes and configurations described in other embodiments may be appropriately adopted and implemented.

[0095] <Note> As described above, this embodiment includes the following disclosures.

[0096] (Composition 1) An information processing system comprising: a video distribution unit that distributes video data to each viewer's terminal device; an instruction input unit that receives input of operation instructions for playback of the video data from each terminal device; and a video recording unit that records real-time video data showing the video data distributed in real time by the video distribution unit, wherein the instruction input unit receives a first operation instruction to play the recorded real-time video data at a delay from the real-time video data, and when the first operation instruction is received from the first terminal device, the video distribution unit distributes the recorded real-time video data to the first terminal device as catch-up video data that is played at a delay from the real-time video data, and further comprises a status notification unit that notifies the viewing status of the real-time video data and the catch-up video data based on the content of the operation instructions received from each terminal device.

[0097] (Configuration 2) The information processing system according to Configuration 1, wherein the viewing status includes the number of first viewers viewing the real-time video data and the number of second viewers viewing the catch-up video data.

[0098] (Composition 3) The information processing system according to Configuration 2, wherein the viewing status includes the time during which the catch-up video data being viewed by each second viewer is delayed relative to the real-time video data.

[0099] (Composition 4) The information processing system according to any one of configurations 1 to 3, further comprising an extraction unit for extracting time from the video data, wherein the extraction unit extracts a first time from the tracking video data distributed to the first terminal device based on the first operation instruction.

[0100] (Composition 5) The information processing system according to configuration 4, wherein the extraction unit further extracts a second time from the real-time video data, and if the first time is delayed by a predetermined amount of time or more compared to the second time, the status notification unit does not notify the user of the first terminal device of the status of watching the catch-up video data.

[0101] (Composition 6) The video recording unit is an information processing system according to any one of configurations 1 to 5, which stops or starts recording the real-time video data in accordance with instructions from the video data distributor.

[0102] (Composition 7) The video data includes presentation slides, the first operation instruction includes an instruction to play the catch-up video data by specifying the start time of playback after pausing or rewinding, and the information processing system according to any one of configurations 1 to 6 further comprises an acquisition unit that acquires the page number of the slides being played at the start time of playback, and the viewing status includes the page number.

[0103] (Composition 8) The information processing system according to any one of configurations 1 to 7, wherein the instruction input unit receives a second operation instruction from the first terminal device to switch from playback of the tracking video data to playback of the real-time video data after the first operation instruction has been received.

[0104] (Composition 9) The information processing system according to configuration 4, wherein the extraction unit further extracts a second time from the real-time video data, the status notification unit calculates the time it takes for the first time to catch up to the second time when the tracking video data distributed to the first terminal device is played at a predetermined speed, based on the first time and the second time, and the viewing status includes information indicating the calculated time.

[0105] The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims rather than by the foregoing description, and all modifications within the meaning and scope equivalent to the claims are intended to be included. [Explanation of Symbols]

[0106] 10,10A~10C Terminal device, 20 Information processing device, 102,202 Processor, 104,204 Input interface, 106,206 Communication interface, 108,208 Display, 110,210 Storage device, 250 Instruction input unit, 252 Video distribution unit, 254 Video recording unit, 256 Extraction unit, 258 Acquisition unit, 260 Status notification unit, 1000 Information processing system.

Claims

1. A video distribution unit that distributes video data to each viewer's terminal device, An instruction input unit that receives input of operation instructions related to the playback of the video data from each of the aforementioned terminal devices, The system includes a video recording unit that records real-time video data showing the video data distributed in real time by the video distribution unit, The instruction input unit receives a first operation instruction to play back the recorded real-time video data at a delay compared to the real-time video data. When the first operation instruction is received from the first terminal device, the video distribution unit distributes the recorded real-time video data to the first terminal device as delayed video data that is played back later than the real-time video data. An information processing system further comprising a status notification unit that notifies the viewing status of the real-time video data and the tracking video data based on the content of the operation instructions received from each of the terminal devices.

2. The information processing system according to claim 1, wherein the viewing status includes the number of first viewers viewing the real-time video data and the number of second viewers viewing the catch-up video data.

3. The information processing system according to claim 2, wherein the viewing status includes the time during which the catch-up video data being viewed by each second viewer is delayed relative to the real-time video data.

4. The system further comprises an extraction unit for extracting timestamps from the aforementioned video data, The information processing system according to any one of claims 1 to 3, wherein the extraction unit extracts a first time from the tracking video data distributed to the first terminal device based on the first operation instruction.

5. The extraction unit further extracts a second time point from the real-time video data, The information processing system according to claim 4, wherein if the first time is delayed by a predetermined amount of time or more compared to the second time, the status notification unit does not notify the user of the first terminal device of the status of viewing the catch-up video data.

6. The information processing system according to any one of claims 1 to 3, wherein the video recording unit stops or starts recording the real-time video data in accordance with instructions from the video data distributor.

7. The aforementioned video data includes presentation slides, The first operation instruction includes an instruction to play the chase video data by specifying the start time of playback after pausing or rewinding, The system further includes an acquisition unit that acquires the page number of the slide material to be played at the start of playback. The information processing system according to any one of claims 1 to 3, wherein the viewing status includes the page number.

8. The information processing system according to any one of claims 1 to 3, wherein the instruction input unit receives a second operation instruction from the first terminal device to switch from playback of the tracking video data to playback of the real-time video data after the first operation instruction has been received.

9. The extraction unit further extracts a second time point from the real-time video data, The status notification unit calculates, based on the first time and the second time, the time it takes for the first time to catch up to the second time when the tracking video data distributed to the first terminal device is played back at a predetermined speed. The information processing system according to claim 4, wherein the viewing status includes information indicating the calculated time.

Images