Information processing device, information processing method, and program

Abstract

This reduces the burden on users to manage multiple videos. [Solution] The user terminal 1 includes an acquisition unit 151 that acquires multiple videos, a display control unit 152 that displays multiple videos on a display unit, a reception unit 153 that receives operations to control the main playback program, a synchronization control unit 155 that inputs the same control signal as the control signal input to the main playback program to the sub-playback program in synchronization with the control signal input to the main playback program, thereby causing the main playback program and the sub-playback program to execute the control based on the operation received by the reception unit 153 in synchronization, and a determination unit 157 that determines whether the main playback program and the sub-playback program are synchronized. If the determination unit 157 determines that the main playback program and the sub-playback program are not synchronized, the synchronization control unit 155 inputs a control signal to the sub-playback program to synchronize the sub-playback program with the main playback program.

Description

Technical Field

[0002] , , , , , ,

[0004] , ,

[0006] , , , , , , ,

[0005] , , ,

[0003] , , , , , ,

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, services for distributing videos have been known. Patent Document 1 discloses a technique for distributing videos.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Controlling video playback and the like on a terminal side such as a smartphone imposes a certain processing load. However, recent terminals have become more powerful and can operate smoothly even when playing multiple videos. However, when playing multiple videos on a terminal, the user has to perform operations such as playing the video for each video, which is a burden for the user.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to reduce the burden on the user for operating multiple videos.

Means for Solving the Problems

[0006] An information processing device according to a first aspect of the present invention includes: an acquisition unit that acquires a plurality of videos; a display control unit that displays the plurality of videos, each played by a plurality of playback programs that control the playback of a predetermined video, on a display unit; a reception unit that receives an operation to control a main playback program, which is one of the plurality of playback programs; a synchronization control unit that causes the main playback program and the sub-playback program to execute control based on the operation received by the reception unit in synchronization with the main playback program and the sub-playback program by inputting the same control signal as the control signal input to the main playback program by the operation to control the main playback program in synchronization with the control signal said to be input to the sub-playback program, which is another of the plurality of playback programs that is different from the main playback program; and a determination unit that determines whether the main playback program and the sub-playback program are synchronized after the synchronization control unit has input the same control signal as the control signal input to the main playback program by the operation to control the main playback program. If the determination unit determines that the main playback program and the sub-playback program are not synchronized, the synchronization control unit inputs a control signal to the sub-playback program to synchronize the sub-playback program with the main playback program.

[0007] The acquisition unit may acquire, as the plurality of videos, a first video and a second video which is synchronized with the first video and is generated by cutting out an object region from the video region of the first video that includes at least a portion of the objects contained in the first video.

[0008] The reception unit may receive operations to control the main playback program by receiving operations on the operation object, which is displayed in the user interface of the main playback program together with the video played by the main playback program and is intended to receive operations to control the main playback program.

[0009] The display control unit may cause the operation object to be hidden in the user interface of the sub-playback program where the video and the operation object are displayed.

[0010] The acquisition unit may further acquire assignment information for assigning the plurality of videos to be displayed in a plurality of divided regions obtained by dividing the display area of ​​the display unit; the display control unit may, based on the assignment information, assign and display a user interface corresponding to the playback program that plays the video for each video in the divided region; and the reception unit may accept an operation to control the main playback program, with the playback program assigned to the largest of the plurality of divided regions being the main playback program.

[0011] The plurality of divided regions may include a main region which is the largest divided region and a sub-region which is a smaller divided region than the main region; the receiving unit may receive an operation to swap the regions on which the first video, which is the video displayed in the main region, and the second video, which is the video displayed in the sub-region, are displayed; the display control unit may, when the receiving unit receives an operation to swap the first video and the second video, assign and display a user interface corresponding to the playback program that plays the second video in the main region, and assign and display a user interface corresponding to the playback program that plays the first video in the sub-region; and the receiving unit may, after the display control unit has swapped the regions on which the first video and the second video are displayed, receive an operation to control the main playback program, treating the playback program assigned to the main region as the main playback program.

[0012] The information processing device may further include a setting unit that sets the sub-playback program selected by the user from among a plurality of sub-playback programs as a target sub-playback program, which is the sub-playback program that will be subject to control based on the operation received by the reception unit in synchronization with the main playback program. Alternatively, the synchronization control unit may cause the main playback program and the target sub-playback program to execute the control based on the operation received by the reception unit in synchronization, and may not cause other sub-playback programs among the plurality of sub-playback programs that are different from the target sub-playback program to execute the control based on the operation received by the reception unit.

[0013] The display area of ​​the display unit may have a predetermined number of videos to be displayed, and the synchronization control unit may cause the main playback program and the sub-playback program that plays the videos displayed in the display area of ​​the display unit to execute control based on the operation received by the reception unit in synchronization with the main playback program, and the sub-playback program that plays videos not displayed in the display area of ​​the display unit may not execute control based on the operation received by the reception unit.

[0014] The information processing device may further include a determination unit that determines whether or not the playback program is running, and the synchronization control unit may, if the determination unit determines that the main playback program is running, cause the main playback program and the sub-playback program to execute control based on the operation received by the reception unit in synchronization, and if the determination unit determines that the main playback program is not running, the synchronization control unit may not cause the sub-playback program to execute control based on the operation received by the reception unit.

[0015] A second aspect of the present invention relates to an information processing method which includes the steps of: acquiring a plurality of videos executed by a computer; displaying the plurality of videos, each played by a plurality of playback programs that control the playback of a predetermined video, on a display unit; receiving an operation to control a main playback program, which is one of the plurality of playback programs; inputting the same control signal as the control signal input to the main playback program by the operation to control the main playback program to a sub-playback program, which is another playback program among the plurality of playback programs that is different from the main playback program, in synchronization with the control signal input to the main playback program by the operation to control the main playback program, thereby causing the main playback program and the sub-playback program to execute the control based on the received operation in synchronization with the main playback program; determining whether the main playback program and the sub-playback program are synchronized after inputting the same control signal as the control signal input to the sub-playback program in synchronization with the control signal input to the main playback program by the operation to control the main playback program; and, if it is determined that the main playback program and the sub-playback program are not synchronized, inputting a control signal to the sub-playback program to synchronize the sub-playback program with the main playback program.

[0016] A program according to a third aspect of the present invention causes a computer to function as: an acquisition unit that acquires a plurality of videos; a display control unit that displays the plurality of videos, each played by a plurality of playback programs that control the playback of a predetermined video, on a display unit; a reception unit that receives an operation to control a main playback program, which is one of the plurality of playback programs; a synchronization control unit that causes the main playback program and the sub-playback program to execute control based on the operation received by the reception unit in synchronization with the main playback program and the sub-playback program by inputting the same control signal as the control signal input to the main playback program by the operation to control the main playback program in synchronization with the control signal said to be input to the sub-playback program, which is another of the plurality of playback programs that is different from the main playback program; and a determination unit that determines whether the main playback program and the sub-playback program are synchronized after the synchronization control unit has input the same control signal as the control signal input to the main playback program by the operation to control the main playback program, and if the determination unit determines that the main playback program and the sub-playback program are not synchronized, the synchronization control unit inputs a control signal to the sub-playback program to synchronize the sub-playback program with the main playback program.

[0017]

[0018] [Effects of the Invention]

[0019] According to the present invention, the burden on the user to operate multiple videos can be reduced. [Brief explanation of the drawing]

[0020] [Figure 1] This is a diagram illustrating the overview of the information processing system. [Figure 2] This diagram schematically represents an example of the display screen of the dedicated application. [Figure 3]This is a diagram schematically showing the functional configuration of a user terminal. [Figure 4] This is a diagram schematically showing an example of the display screen of a dedicated application. [Figure 5] This is a diagram schematically showing an example of the display screen of a dedicated application. [Figure 6] This is a diagram schematically showing an example of the display screen of a dedicated application. [Figure 7] This is a flowchart showing the processing flow of a user terminal.

Embodiments for Carrying Out the Invention

[0021] [Overview of Information Processing System S] FIG. 1 is a diagram for explaining the overview of information processing system S. Information processing system S is a service used to provide an information processing service. The information processing service is a service that provides video works. The video works provided by the information processing service may be real-time video works or archive video works. Information processing system S has a user terminal 1 and a management device 2.

[0022] User terminal 1 is an information processing device used by a user, for example, a smartphone, a tablet terminal, a personal computer, etc. The user is a viewer who watches the video of a video work. A dedicated application program (hereinafter referred to as "dedicated app") for the user to use the information processing service and a playback application program (hereinafter referred to as "playback app") for controlling the playback of a predetermined video are installed in user terminal 1. The playback app may be an application program bundled with the dedicated app or an application program installed from the initial state of user terminal 1.

[0023] Management device 2 is a device that manages information processing services, such as a server. In the information processing service, multiple videos are provided as video content. The multiple videos are related videos, for example, a first video containing an object, and a second video that zooms in on at least a part of the object contained in the first video. The object is a dynamic object that the user can focus on, such as a person, an animal, or an avatar, but is not limited to this and may be a static object.

[0024] Note that the multiple videos may be videos showing each of the multiple participants (e.g., musicians, performers, etc.) participating in the video work. The management device 2 stores multiple videos, for example, associated with a work ID used to identify the video work. The following describes the processes performed by the information processing system S.

[0025] First, when a user selects a video they wish to watch from a list of video works using a dedicated application on user terminal 1, user terminal 1 sends a request to management device 2 to transmit the video of the selected video (Figure 1, (1)). The transmission request includes, for example, the work ID corresponding to the video selected by the user.

[0026] The management device 2 sends multiple videos associated with the work ID included in the transmission request to the user terminal 1 (Figure 1, (2)). The user terminal 1 then displays multiple videos on the dedicated application's display screen by playing each of the multiple videos obtained from the management device 2 using different playback applications (Figure 1, (3)).

[0027] Figure 2 is a schematic representation of an example of the display screen of the dedicated application. Screen D1, which is the display screen of the dedicated application, shows video V1, which is a first video showing one person, and video V2, which is a second video showing a close-up of the face of the person in video V1.

[0028] In this case, when a user performs an operation to control the playback application that plays video V1, user terminal 1 causes the playback application corresponding to video V1 and the playback application corresponding to video V2 to execute the control based on the user's operation in a synchronized manner. Operations to control the playback applications include, for example, play, stop, advance frame by frame, rewind frame by frame, and change the playback time in the video. For example, when each playback application is playing each video, if the user performs an operation to stop video V1 on the playback application corresponding to video V1, user terminal 1 causes the playback application corresponding to video V1 and the playback application corresponding to video V2 to execute the video stop in a synchronized manner.

[0029] In this way, the information processing system S can reduce the burden on the user in operating multiple videos. The configuration of user terminal 1 is described below.

[0030] [Functional configuration of user terminal 1] Figure 3 is a schematic diagram showing the functional configuration of user terminal 1. User terminal 1 comprises a display unit 11, an operation unit 12, a communication unit 13, a storage unit 14, and a control unit 15. In Figure 3, the arrows indicate the main data flow, and there may be other data flows not shown in Figure 3.

[0031] The display unit 11 is a display that shows information. The operation unit 12 is an interface that accepts user operations, and is, for example, a touch panel superimposed on the display, or a controller provided in earphones connected to the user terminal 1.

[0032] The communication unit 13 is a communication interface for connecting to a network and has a communication controller for receiving data from external devices.

[0033] The memory unit 14 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that makes up the user terminal 1, a RAM (Random Access Memory) that serves as the working area of ​​the user terminal 1, and an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information that is referenced when the application programs are executed.

[0034] The control unit 15 is a processor such as the CPU (Central Processing Unit), GPU (Graphics Processing Unit), or NPU (Neural Network Processing Unit) of the user terminal 1, and by executing the program stored in the storage unit 14, it functions as the acquisition unit 151, display control unit 152, reception unit 153, transmission unit 154, synchronization control unit 155, setting unit 156, and determination unit 157.

[0035] The acquisition unit 151 acquires multiple videos from the management device 2. For example, first, when a user launches a dedicated application on the user terminal 1, the display control unit 152 displays a list of video works provided by the information processing service on the display screen of the dedicated application. When the user selects one video work from the list of video works on the display screen of the dedicated application, the reception unit 153 accepts the user's selection of the video work. The transmission unit 154 sends a transmission request to the management device 2 to request the transmission of the video work selected by the user. The transmission request includes, for example, the work ID corresponding to the video work selected by the user. Then, the acquisition unit 151 acquires the multiple videos transmitted by the management device 2 in response to receiving the transmission request.

[0036] Multiple videos are, for example, multiple videos associated with the work ID included in the transmission request. Specifically, the acquisition unit 151 acquires, as multiple videos, a first video and a second video which is synchronized with the first video and is generated by cropping an object area from the video area of ​​the first video that includes at least a portion of the objects contained in the first video. The acquisition unit 151 may also acquire multiple videos in which each of the multiple participants participating in the video work is displayed.

[0037] The display control unit 152 displays multiple videos played by multiple playback applications, each controlling the playback of a predetermined video, on the display screen of the dedicated application. For example, first, the display control unit 152 displays the user interfaces of multiple playback applications, each of which plays the multiple videos acquired by the acquisition unit 151, on the display screen of the dedicated application. Then, the display control unit 152 synchronizes the timing of video playback for the multiple playback applications and plays the multiple videos.

[0038] The reception unit 153 accepts operations to control the main playback application. Multiple playback applications include a main playback application and sub-playback applications. The main playback application is one of the multiple playback applications, for example, the playback application assigned to the main area, which is the largest of the multiple division areas obtained by dividing the display area of ​​the dedicated application's display screen. A sub-playback application is another playback application among the multiple playback applications that is different from the main playback application, for example, the playback application assigned to a sub-area, which is a division area smaller than the main area among the multiple division areas.

[0039] The reception unit 153 accepts, for example, an operation to control a playback application that has been assigned to the main area of ​​one of the multiple divided areas, designating that main playback application as the main playback application. Specifically, first, the acquisition unit 151 further acquires assignment information from the management device 2. The assignment information is information for assigning multiple videos to be displayed in the multiple divided areas. Based on the assignment information acquired by the acquisition unit 151, the display control unit 152 assigns and displays a user interface corresponding to the playback application that plays each video in the divided area.

[0040] The reception unit 153 then accepts the operation to control the main playback application, which is assigned to the main area among the multiple divided areas, as the main playback application. In this way, the user terminal 1 makes it easier for the user to control the video.

[0041] User terminal 1 may swap the video displayed in the main area and the video displayed in the sub-area in response to user operations. In this case, user terminal 1 may accept user operations after the displayed videos have been swapped as operations to control the main playback application.

[0042] Specifically, the reception unit 153 first receives an operation to swap the display areas of the first video, which is displayed in the main area, and the second video, which is displayed in the sub-area. Operations to swap the display areas of the first and second videos include, for example, tapping the second video, dragging and dropping the first video from the main area to the sub-area, or dragging and dropping the second video from the sub-area to the main area.

[0043] When the reception unit 153 receives an operation to swap the first video and the second video, the display control unit 152 assigns and displays a user interface corresponding to the playback application that plays the second video in the main area, and assigns and displays a user interface corresponding to the playback application that plays the first video in the sub-area. After the display control unit 152 swaps the areas in which the first video and the second video are displayed, the reception unit 153 accepts an operation to control the main playback application, designating the playback application assigned to the main area as the main playback application.

[0044] Figure 4 is a schematic representation of an example of the display screen of a dedicated application. In the example shown in Figure 4(a), screen D2, which is the display screen of the dedicated application, displays a first video played by a playback application assigned to the main area R1, and a second video played by a playback application assigned to the sub-area R2. In this case, when the user performs an operation to swap the first video and the second video on screen D2, the display control unit 152 displays screen D2' as shown in Figure 4(b).

[0045] Screen D2' displays the second video played by the playback application assigned to area R1' and the first video played by the playback application assigned to area R2'. Subsequently, when the user performs an operation to control the second video on screen D2', the playback application assigned to area R1' becomes the main playback application, and the system accepts an operation to control the main playback application. In this way, user terminal 1 makes it easier for the user to control the videos.

[0046] The reception unit 153 receives, for example, operations on the user interface of the main playback application. Specifically, the reception unit 153 receives operations to control the main playback application by receiving operations on operation objects displayed on the user interface of the main playback application along with the video being played by the main playback application. Operation objects are objects for receiving operations to control the playback application, and include, for example, a play button, a stop button, a frame-forward button, a frame-back button, a seek bar, a volume control bar, etc.

[0047] For example, in the user interface of a playback application, the operation object is initially displayed. In this case, the display control unit 152 first displays the video and the operation object without controlling the display of the operation object in the user interface of the main playback application.

[0048] Furthermore, the display control unit 152 controls the display of operation objects in the user interface of the sub-playback application. Specifically, the display control unit 152 hides the operation objects in the user interface of the sub-playback application where both the video and operation objects are displayed. The reception unit 153 then receives user input on operation objects displayed only in the user interface of the main playback application.

[0049] Figure 5 is a schematic representation of an example of the display screen of the dedicated application. Screen D3, which is the display screen of the dedicated application, shows video V3 played by the main playback application and video V4 played by the sub-playback application. The main playback application displays video V3 along with the operation object. The sub-playback application displays video V4, but does not display the operation object.

[0050] In this case, the reception unit 153 accepts user operations on operation objects displayed only on the user interface of the main playback application. By doing so, the user terminal 1 can prevent the video being played by the sub-playback application from becoming difficult to view by displaying the operation objects on the sub-playback application.

[0051] The synchronization control unit 155 causes the main playback application and the sub-playback application, which is a different playback application from the main playback application among multiple playback applications, to execute the control based on the operation received by the reception unit 153 in a synchronized manner. Specifically, the synchronization control unit 155 inputs the same control signal to the sub-playback application in synchronization with the control signal input to the main playback application by an operation that controls the main playback application, thereby causing the control based on the operation received by the reception unit 153 to be executed in a synchronized manner between the main playback application and the sub-playback application.

[0052] For example, if the operation received by the reception unit 153 for the main playback application is to stop the video, the synchronization control unit 155 synchronizes the control signal corresponding to stopping the video input to the main playback application with the control signal corresponding to stopping the video input to the sub-playback application, thereby causing the video to be stopped in a synchronized manner by both the main playback application and the sub-playback application.

[0053] The synchronization control unit 155 may, when multiple sub-playback applications are running on the display screen of the dedicated application, cause the reception unit 153 to execute control based on the operation received by the reception unit 153 in a synchronized manner between the main playback application and some of the sub-playback applications among the multiple sub-playback applications. Specifically, the user terminal 1 causes the reception unit 153 to execute control based on the operation received by the reception unit 153 in a synchronized manner between the main playback application and some of the sub-playback applications among the multiple sub-playback applications by performing the following two steps.

[0054] As the first step, the setting unit 156 sets the sub-playback application selected by the user from among multiple sub-playback applications as the target sub-playback application, which is the sub-playback application that will execute control based on the operation received by the reception unit 153 in synchronization with the main playback application.

[0055] For example, the display screen of the dedicated app has a selection item (e.g., a checkbox) for each video displayed in the sub-area, allowing the user to select which video should be controlled in sync with the control of the video displayed in the main area. In this case, when the user first selects a video from among the multiple selection items provided for each of the multiple videos displayed in the sub-area that they wish to control in sync with the control of the video displayed in the main area, the reception unit 153 receives information indicating the sub-playback app that will play the video selected by the user (e.g., an app ID to identify the sub-playback app). The setting unit 156 then sets the sub-playback app indicated by the app ID received by the reception unit 153 as the target sub-playback app.

[0056] In the second step, the synchronization control unit 155 causes the reception unit 153 to execute control based on the operation received by the reception unit 153 after the setting unit 156 has set the target sub-playback application, in synchronization with the main playback application and the target sub-playback application. On the other hand, the synchronization control unit 155 does not allow the reception unit 153 to execute control based on the operation received by the reception unit 153 after the setting unit 156 has set the target sub-playback application for other sub-playback applications that are different from the target sub-playback application. In this way, the user terminal 1 can have control based on user operations executed in synchronization with the main playback application only for the sub-playback applications desired by the user.

[0057] The synchronization control unit 155 may, as some of the sub-playback applications among the multiple sub-playback applications, cause a sub-playback application whose user interface is displayed on the display screen of a dedicated application among the multiple sub-playback applications to execute control based on the operation received by the reception unit 153, in synchronization with the main playback application. For example, the number of videos to be displayed is predetermined in the display area of ​​the display screen of the dedicated application.

[0058] In this case, the synchronization control unit 155 causes the main playback application and the sub-playback application, which plays videos displayed in the display area of ​​the dedicated application's display screen, to execute the control based on the operation received by the reception unit 153 in a synchronized manner. On the other hand, the synchronization control unit 155 does not cause the sub-playback application, which plays videos not displayed in the display area of ​​the dedicated application's display screen, to execute the control based on the operation received by the reception unit 153.

[0059] Figure 6 is a schematic representation of an example of the display screen of the dedicated application. In the example shown in Figure 6, the first video, video V5, and the second videos, videos V6, V7, V8, and V9, are being played. Also, on screen D4, which is the display screen of the dedicated application, the number of videos to be displayed in the sub-area is set to three, and videos V6, V7, and V8 of the four second videos are displayed. The user can display video V9 by scrolling the sub-area.

[0060] In this case, when the user manipulates the operation object of video V5, the synchronization control unit 155 causes the main playback application that plays video V5 and the three sub-playback applications that play video V6, video V7, and video V8 respectively to execute control based on the user's operation in a synchronized manner, but does not cause the sub-playback application that plays video V9 to execute control. In this way, the user terminal 1 can reduce the load on the control unit 15 that would otherwise be caused by having the playback applications execute control based on the user's operation. If video V9 is displayed by the user scrolling through the sub-area, the synchronization control unit 155 may execute control on the sub-playback application that plays video V9 to bring it to the same state as the main playback application.

[0061] In this case, if multiple playback applications are running on the user terminal 1, the load on the control unit 15 may increase, causing some playback applications to become unstable. In this case, even if the user terminal 1 attempts to synchronously control each playback application, it may not be able to control some of the unstable playback applications, making it impossible to synchronously control each playback application. Therefore, the user terminal 1 may synchronously control each playback application according to the state of each playback application.

[0062] User terminal 1, for example, synchronizes the control of the main playback application and the sub-playback application depending on the state of the main playback application. Specifically, first, the determination unit 157 determines whether or not the playback application is running. The determination unit 157 determines whether or not the playback application is running based on, for example, whether or not the playback application is responding, the playback application's logs, the playback application's process state, etc. The determination unit 157 may determine whether or not the playback application is running at predetermined intervals (for example, every second, every minute, etc.), or it may determine whether or not the playback application is running when the reception unit 153 receives an operation from the user.

[0063] Then, if the determination unit 157 determines that the main playback application is running, the synchronization control unit 155 causes the main playback application and the sub-playback application to execute the control based on the operation received by the reception unit 153 in a synchronized manner. On the other hand, if the determination unit 157 determines that the main playback application is not running, the synchronization control unit 155 does not cause the sub-playback application to execute the control based on the operation received by the reception unit 153. In this way, the user terminal 1 can prevent the operation of the main playback application, which is in an unstable state, from becoming out of sync with that of the sub-playback application.

[0064] Furthermore, if the determination unit 157 determines that both the main playback application and the sub-playback application are running, the synchronization control unit 155 may cause the main playback application and the sub-playback application to execute the control based on the operation received by the reception unit 153 in a synchronous manner. On the other hand, if the determination unit 157 determines that either the main playback application or the sub-playback application is not running, the synchronization control unit 155 does not have the sub-playback application execute the control based on the operation received by the reception unit 153.

[0065] If the sub-playback application is not synchronized with the main playback application, the user terminal 1 may synchronize the sub-playback application with the main playback application and run it again. Specifically, first, the determination unit 157 determines whether the main playback application and the sub-playback application are synchronized. For example, the determination unit 157 determines whether the main playback application and the sub-playback application are synchronized after the synchronization control unit 155 inputs the same control signal to the sub-playback application in synchronization with the control signal input to the main playback application by an operation that controls the main playback application.

[0066] Then, if the determination unit 157 determines that the main playback application and the sub-playback application are not synchronized, the synchronization control unit 155 synchronizes the main playback application and the sub-playback application. For example, if the determination unit 157 determines that the main playback application and the sub-playback application are not synchronized, the synchronization control unit 155 inputs a control signal to the sub-playback application to bring it to the same state as the main playback application. In this way, even if the main playback application and the sub-playback application become unsynchronized due to a temporary instability in the operation of either the main playback application or the sub-playback application, the user terminal 1 can restore the main playback application and the sub-playback application to a synchronized state.

[0067] [Processing of User Terminal 1] Next, we will explain the processing flow of user terminal 1. Figure 7 is a flowchart showing the processing flow of user terminal 1. This flowchart starts when the acquisition unit 151 acquires multiple videos and the assignment information for each video from the management device 2 (S1).

[0068] The display control unit 152 displays multiple videos by assigning a user interface corresponding to the playback application that plays each video to a divided area based on the assignment information (S2). The reception unit 153 receives an operation to control the main playback application (S3). The synchronization control unit 155 then causes the main playback application and the sub-playback application to execute the control based on the operation received by the reception unit 153 in synchronization (S4).

[0069] [Effects of this embodiment] As explained above, first, user terminal 1 retrieves multiple videos from management device 2 and displays the multiple videos, each played by a different playback application. Then, when user terminal 1 receives an operation to control the main playback application, it synchronously executes the control based on the received operation in both the main and sub-playback applications. In this way, user terminal 1 can reduce the burden on the user in operating multiple videos.

[0070] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations-led Sustainable Development Goals (SDGs), "Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation."

[0071] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments. [Explanation of Symbols]

[0072] 1 User terminal 11 Display section 12 Control section 13 Communications Department 14 Storage section 15 Control Unit 151 Acquisition Department 152 Display Control Unit 153 Reception Department 154 Transmitter 155 Synchronization Control Unit 156 Settings Section 157 Judgment section 2 Management device S Information Processing System

Claims

1. The acquisition unit acquires multiple videos, A display control unit that displays the plurality of videos, each played by a plurality of playback programs that control the playback of a predetermined video, on a display unit, A receiving unit that receives an operation to control the main playback program, which is one of the playback programs among the plurality of playback programs, A synchronization control unit causes the reception unit to execute control based on the operation it receives in synchronization with the main playback program and the sub-playback program by inputting the same control signal as the control signal input to the main playback program in synchronization with The synchronization control unit includes a determination unit that determines whether the control states of the main playback program and the sub-playback program are synchronized after the synchronization control unit has input the same control signal to the sub-playback program in synchronization with the control signal input to the main playback program by an operation to control the main playback program, It has, If the determination unit determines that the main playback program and the sub-playback program are not synchronized, the synchronization control unit inputs a control signal to the sub-playback program to synchronize the control state of the sub-playback program with the control state of the main playback program. The display area of ​​the aforementioned display unit has a predetermined number of videos to be displayed. The synchronization control unit causes the main playback program and the sub-playback program, which plays the video displayed in the display area of ​​the display unit, to execute the control based on the operation received by the reception unit in a synchronized manner, but does not cause the sub-playback program, which plays the video not displayed in the display area of ​​the display unit, to execute the control based on the operation received by the reception unit. Information processing device.

2. The acquisition unit acquires, as the plurality of videos, a first video and a second video which is synchronized with the first video and is generated by cutting out an object region from the video region of the first video that includes at least a portion of the objects contained in the first video. The information processing apparatus according to claim 1.

3. The reception unit receives an operation to control the main playback program by receiving an operation of an operation object that is displayed in the user interface of the main playback program together with the video played by the main playback program, and which is used to receive an operation to control the main playback program. The information processing apparatus according to claim 1.

4. The display control unit causes the operation object to be hidden in the user interface of the sub-playback program where the video and the operation object are displayed. The information processing apparatus according to claim 3.

5. The acquisition unit further acquires allocation information for assigning the plurality of videos to be displayed in a plurality of divided regions obtained by dividing the display area of ​​the display unit, The display control unit, based on the assignment information, assigns and displays a user interface corresponding to the playback program for playing each video in the divided area. The receiving unit accepts an operation to control the main playback program, with the playback program assigned to the largest of the multiple divided regions being the main playback program. The information processing apparatus according to claim 1.

6. The plurality of division regions include a main region which is the largest division region and a sub-region which is a division region smaller than the main region. The reception unit receives an operation to swap the areas in which the first video, which is the video displayed in the main area, and the second video, which is the video displayed in the sub-area, are displayed. When the reception unit receives an operation to swap the first video and the second video, the display control unit assigns and displays a user interface corresponding to the playback program for playing the second video in the main area, and assigns and displays a user interface corresponding to the playback program for playing the first video in the sub-area. The reception unit, after the display control unit has swapped the areas in which the first video and the second video are displayed, accepts an operation to control the main playback program, with the playback program assigned to the main area being the main playback program. The information processing apparatus according to claim 5.

7. The information processing device further includes a setting unit that sets the sub-playback program selected by the user from among a plurality of sub-playback programs as the target sub-playback program, which is the sub-playback program that will be controlled by the receiving unit in sync with the main playback program based on the operation received by the receiving unit. The synchronization control unit causes the main playback program and the target sub-playback program to execute the control based on the operation received by the reception unit in a synchronized manner, and prevents the control based on the operation received by the reception unit from being executed by any of the sub-playback programs other than the target sub-playback program. The information processing apparatus according to claim 1.

8. The information processing device further includes a determination unit that determines whether or not the playback program is in a state to respond, If the determination unit determines that the main playback program is in a responsive state, the synchronization control unit causes the main playback program and the sub-playback program to execute control based on the operation received by the reception unit in synchronization; if the determination unit determines that the main playback program is not in a responsive state, the synchronization control unit does not cause the sub-playback program to execute control based on the operation received by the reception unit. The information processing apparatus according to claim 1.

9. When a video that is not displayed in the display area of ​​the display unit is displayed in the display area of ​​the display unit as a result of a user operation received by the reception unit, the synchronization control unit executes control to the sub-playback program that plays the video to put it into the same control state as the main playback program. The information processing apparatus according to claim 1.

10. A computer executes Steps to acquire multiple videos, The steps include: displaying the plurality of videos, each played by a plurality of playback programs that control the playback of a predetermined video, on a display unit; The steps include receiving an operation to control the main playback program, which is one of the multiple playback programs, The steps include: inputting the same control signal as the control signal input to the main playback program by an operation to control the main playback program, in synchronization with the control signal input to the main playback program, to a sub-playback program which is a different playback program from the main playback program among the plurality of playback programs, thereby causing the control based on the received operation to be executed in synchronization between the main playback program and the sub-playback program; The step of determining whether the control states of the main playback program and the sub-playback program are synchronized after inputting the same control signal to the sub-playback program in synchronization with the control signal input to the main playback program by an operation to control the main playback program, If it is determined that the main playback program and the sub-playback program are not synchronized, the step of inputting a control signal to the sub-playback program to synchronize the control state of the sub-playback program with the control state of the main playback program, It has, The display area of ​​the aforementioned display unit has a predetermined number of videos to be displayed. In the step of synchronously executing control based on received operations, the control based on received operations is executed synchronously by the main playback program and the sub-playback program that plays the video displayed in the display area of ​​the display unit, but the control based on received operations is not executed by the sub-playback program that plays the video not displayed in the display area of ​​the display unit. Information processing methods.

11. Computers, Acquisition unit that acquires multiple videos, A display control unit that displays the plurality of videos, each played by a plurality of playback programs that control the playback of a predetermined video, on a display unit. A receiving unit that receives an operation to control the main playback program, which is one of the multiple playback programs, A synchronization control unit that, by inputting the same control signal as the control signal input to the main playback program in synchronization with the control signal input to the main playback program in the operation that controls the main playback program, and by inputting the same control signal as the control signal input to the sub-playback program, which is one of the plurality of playback programs that is different from the main playback program, in synchronization with the control signal input to the main playback program in the operation that controls the main playback program, and A determination unit determines whether the control states of the main playback program and the sub-playback program are synchronized after the synchronization control unit inputs the same control signal to the sub-playback program in synchronization with the control signal input to the main playback program by an operation to control the main playback program. To make it function as, If the determination unit determines that the main playback program and the sub-playback program are not synchronized, the synchronization control unit inputs a control signal to the sub-playback program to synchronize the control state of the sub-playback program with the control state of the main playback program. The display area of ​​the aforementioned display unit has a predetermined number of videos to be displayed. The synchronization control unit causes the main playback program and the sub-playback program, which plays the video displayed in the display area of ​​the display unit, to execute the control based on the operation received by the reception unit in a synchronized manner, but does not cause the sub-playback program, which plays the video not displayed in the display area of ​​the display unit, to execute the control based on the operation received by the reception unit. program.

Images