Information processing system, information processing method, and information processing program

Abstract

To provide an information processing device, an information processing method, and an information processing program that can reduce the production cost of telop data.SOLUTION: An information processing device acquires material data from a first terminal, generates telop data based on the acquired material data, and provides image data including at least the generated telop data to the first terminal. The first terminal uses a web conference system to display the provided image data. A second terminal communicates with a first application via the web conference system, acquires the image data displayed on a first display device, and displays the image data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and an information processing program.

Background Art

[0002] Conventionally, there is a system for generating a telop image to be superimposed on video data captured by a camera or the like. For example, Patent Document 1 describes a telop display system that generates telop image data for displaying a telop image within a predetermined display area of a preset video monitor. The generated telop image data is superimposed on the video data captured by the camera and broadcast on television.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, a telop production company needs to introduce a device for producing telops for each device that uses telop data, and the cost for using telop data may increase with the introduction of the device. Also, when the generated telop data is transmitted and received via a communication line, the cost for using telop data may increase with the introduction of a device for constructing a dedicated system used for the transmission and reception of telop data.

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to provide an information processing system, an information processing method, and an information processing program capable of reducing the usage cost of telop data.

Means for Solving the Problems

[0006] (1) To solve the above problems, an information processing system includes a first terminal that is a client terminal in a Web conferencing system, a second terminal that is another client terminal in the Web conferencing system and is connected to the first terminal via the Web conferencing system, and an information processing device communicably connected to the first terminal. The information processing device includes an acquisition unit that acquires material data from the first terminal, a generation unit that generates caption data based on the material data acquired by the acquisition unit, and a provision unit that provides the first terminal with image data including at least the caption data generated by the generation unit. The first terminal includes a first application for using the Web conferencing system and a first display device that displays the image data provided by the provision unit. The second terminal includes a second display device that displays the image data displayed on the first display device acquired via the Web conferencing system.

[0007] (2) Further, in the information processing system according to the embodiment, the first display device may include a main monitor that displays the setting of the caption data and a second monitor that displays the image data, and the second terminal may acquire the image data displayed on the second monitor shared via the Web conferencing system.

[0008] (3) Further, in the information processing system according to the embodiment, the first application may include plug-in software having at least one of a caption data setting function that enables setting of caption data by displaying the setting of the caption data on the main monitor or an image data display function that displays the image data provided by the provision unit.

[0009] (4) Further, in the information processing system according to the embodiment, the second terminal may further include a capture unit that captures the display screen of the image data displayed on the second display device and an output unit that outputs the display screen captured by the capture unit to a third display device.

[0010] (5) Also, in the information processing system of the embodiment, the second terminal may provide input data input by the user of the second terminal to the first application, and the first application may provide the input data acquired from the second terminal to the information processing device as material data.

[0011] (6) Also, in the information processing system of the embodiment, the second terminal may provide text data input by the user of the second terminal to the first application as input data.

[0012] (7) Also, in the information processing system of the embodiment, the second terminal may provide voice data input by the user of the second terminal to the first application as input data.

[0013] (8) Also, in the information processing system of the embodiment, the second terminal may determine a display area for displaying image data corresponding to the second display device.

[0014] (9) To solve the above problems, an information processing method is an information processing method executed in an information processing system including a first terminal that is a client terminal in a Web conferencing system, a second terminal that is another client terminal in the Web conferencing system and is connected to the first terminal via the Web conferencing system, and an information processing apparatus communicably connected to the first terminal. The information processing method includes, executed in the information processing apparatus, an acquisition step of acquiring material data from the first terminal, a generation step of generating caption data based on the material data acquired in the acquisition step, and a provision step of providing the first terminal with image data including at least the caption data generated in the generation step. The information processing method further includes, executed in the first terminal, a startup step of starting a first application for using the Web conferencing system, and a first display step of displaying the image data provided in the provision step. The information processing method also includes, executed in the second terminal, a second display step of displaying the image data displayed in the first display step acquired via the Web conferencing system.

[0015] (10) To solve the above problems, an information processing program is an information processing program executed in an information processing system including a first terminal that is a client terminal in a Web conferencing system, a second terminal that is another client terminal in the Web conferencing system and is connected to the first terminal via the Web conferencing system, and an information processing apparatus communicably connected to the first terminal. In the information processing apparatus, an acquisition function of acquiring material data from the first terminal, a generation function of generating caption data based on the material data acquired in the acquisition function, and a provision function of providing the first terminal with image data including at least the caption data generated in the generation function are realized. In the first terminal, a first application function for using the Web conferencing system and a first display function of displaying the image data provided in the provision function are realized. In the second terminal, a second display function of displaying the image data displayed in the first display function acquired via the Web conferencing system is realized.

Advantages of the Invention

[0016] According to one embodiment of the present invention, an information processing apparatus acquires material data from a first terminal, generates telop data based on the acquired material data, provides image data including at least the generated telop data to the first terminal, the first terminal uses a web conferencing system to display the provided image data, and a second terminal communicates with a first application via the web conferencing system to acquire the image data displayed on a first display device, and by displaying the image data, the usage cost of the telop data can be reduced.

Brief Description of Drawings

[0017]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Mode for Carrying Out the Invention

[0018] Hereinafter, an information processing system, an information processing method, and an information processing program in an embodiment of the present invention will be described in detail with reference to the drawings.

[0019] First, the configuration of the information processing system will be described with reference to FIG. 1. FIG. 1 is a block diagram showing an example of the system configuration of the information processing system in the embodiment.

[0020] In FIG. 1, the information processing system 100 has an information processing apparatus 1, a Web conference server 2, a first terminal 3, and a second terminal 4. The information processing apparatus 1, the Web conference server 2, the first terminal 3, and the second terminal 4 are communicably connected via a network 9. FIG. 1 illustrates the configuration and connection method of the information processing system 100, and does not limit the configuration and connection method of the information processing system 100.

[0021] The information processing apparatus 1 has functional units such as a communication control unit 11, an authentication unit 12, a storage unit 13, an acquisition unit 14, a UI providing unit 15, a determination unit 16, a generation unit 17, and a providing unit 18. Each of the above functional units of the information processing apparatus 1 in the present embodiment will be described as a functional module realized by the information processing program (software) in the present embodiment.

[0022] The communication control unit 11 controls communication with the first terminal 3 connected via the network 9.

[0023] The authentication unit 12 authenticates the user of the first terminal 3 using the communication control unit 11. The user of the first terminal 3 is a person who has the right to use the functions provided by the information processing apparatus 1 that is communicably connected to the first terminal 3. The user of the first terminal 3 is, for example, an operator who operates the first terminal 3. The authentication unit 12 authenticates a user who has user authority, for example, by using a login ID and a password assigned to each user. Note that the user in the present embodiment does not have to be a specific individual. For example, when a single login ID is sequentially used by a plurality of people, the user can be the person currently using the user ID. Note that the authentication unit 12 may use an authentication method other than authentication using a login ID and a password (for example, biometric authentication, magnetic card authentication, etc.).

[0024] The storage unit 13 stores user information. The user information is, for example, authentication information including a login ID and a password, setting information for generating telop data set for each user, or material data (described later) stored for each user.

[0025] The acquisition unit 14 acquires material data. The material data is the data that is the basis for generating telop data described later. The telop data is generated based on part or all of the material data. That is, the material data may include a portion that is not made into telop data. The material data is represented by, for example, text data including a character string, audio data including audio information, graphic data represented by vector data, etc., or image data including image information, or a combination thereof. The acquisition unit 14 acquires the material data from inside the information processing apparatus 1 (for example, the storage unit 13) or from the first terminal 3. In FIG. 1, a case where the acquisition unit 14 acquires the material data from the first terminal 3 is illustrated. Note that the first terminal 3 may acquire the material data from the second terminal 4 and provide the acquired material data to the acquisition unit 14.

[0026] In addition, when referring to "acquisition" of data in this embodiment, it may be pull-type data acquisition such as downloading, or push-type data acquisition of receiving data transmitted from other devices. For example, the acquisition unit 14 may provide a UI (User Interface) for inputting or selecting material data to be provided to the first terminal 3, and the user of the first terminal 3 may operate the displayed UI to acquire the material data.

[0027] Text data is, for example, data manually input by the user of the first terminal 3 or the user of the second terminal 4 from a keyboard (not shown). The data manually input by the user of the second terminal 4 from the keyboard is acquired by the first terminal 3 and provided to the acquisition unit 14. Further, the text data may include time information, weather information, traffic information, news flash, or subtitles.

[0028] Audio data is, for example, data obtained by the first terminal 3 acquiring the audio input by the user of the second terminal 4 from a microphone (not shown) and provided to the acquisition unit 14. Note that the audio data may include character information generated by speech recognition.

[0029] Image data is, for example, data obtained by the first terminal 3 acquiring the image selected or input by the user of the second terminal 4 and provided to the acquisition unit 14. Note that the image data may include character information generated by image recognition.

[0030] The UI providing unit 15 provides a UI for setting caption data. The setting of caption data is a setting for determining the generated caption data, for example, selection of material data, display range of the caption, size of the caption characters, setting of font or color, decoration for the caption, or display shape of the caption, etc. The UI providing unit 15 may provide a UI for, for example, the first application of the first terminal 3, and enable the setting of caption data via the first application. Also, the UI providing unit 15 may be a web server that provides a web page to the first terminal 3. The first terminal 3 can set caption data by displaying the UI provided by the UI providing unit 15 on a web browser or the plugin software 311 described later. The storage unit 13 may store the setting content set by the UI provided in the UI providing unit 15.

[0031] The UI providing unit 15 may provide a preview screen of the caption data generated in the generation unit 17 described later to the first terminal 3.

[0032] The determination unit 16 determines the type of the material data (text data, audio data, or image data) acquired in the acquisition unit 14 and recognizes the content of the material data. For example, when the material data is text data, the determination unit 16 determines the number of characters or the type of characters (for example, Chinese characters or hiragana), etc. Also, when the material data is audio data, the determination unit 16 may recognize the content of the audio and generate text data. Also, when the material data is image data, the determination unit 16 may recognize the number of pixels of the image, etc.

[0033] The generation unit 17 generates caption data based on the determination in the determination unit 16 and the setting content set in the UI. For example, when the material data is text data, the generation unit 17 determines the character size of the caption data, the display speed (the number of display characters flowing per second), etc. based on the size of the display area of the caption and the number of characters displayed based on the text data, and generates the caption data. Also, when the material data is audio data, the generation unit 17 may determine the character size of the text data generated in speech recognition, the display speed, etc., and generate the caption data. Further, when the material data is image data, the generation unit 17 may generate caption data with the pixel number of the image changed based on the pixel number of the recognized image and the pixel number of the display area of the caption. Note that the UI may specify the part of the material data to be made into caption data. For example, it may specify the first 10 characters in the text data, or a specific part in the image data. The generation unit 17 generates the specified part of the material data as caption data.

[0034] Note that the caption in this embodiment is information of character information, symbol information, graphic information, audio information, or image information, or a combination thereof (hereinafter sometimes referred to as "character information, etc.") that is superimposed, inserted, or synthesized (hereinafter sometimes referred to as "superimposed, etc.") on the original image such as a moving image or a still image. The caption data is data used for displaying the caption, and may be, for example, vector data before rasterization or raster data after rasterization. Also, the caption data generated by the generation unit 17 may be image data including at least the caption data.

[0035] The original image on which the telop data is superimposed or the like is a display screen shared in the web conferencing system described later. Note that the original image may be a television video used for television broadcasting, a video used for a video distribution service, a display image displayed on a large display device, or the like. In the present embodiment, the data used for the telop superimposed on the original image is telop data. Note that the telop may be called, for example, a caption, a subtitle, a ticker, an alert, or a super-impose depending on the region, content, or format used, and is included in the telop of the present embodiment.

[0036] The providing unit 18 provides the image data including at least the telop data generated in the generating unit 17 to the first terminal 3 connected via the network 9. The image data provided from the providing unit 18 to the first terminal 3 is used in the first terminal 3. For example, the first terminal 3 displays the image data including at least the telop data provided from the providing unit 18 on the first display device 32. Further, the first terminal 3 may use the provided image data for a television broadcast, a video used for a video distribution service, or a display image displayed on a large display device. The provided data provided by the providing unit 18 is, for example, communication data encoded according to a communication protocol via the network 9, or may be encrypted data encrypted by a predetermined encryption method.

[0037] The providing unit 18 may provide the telop data in a data format corresponding to the input of a transmission device that transmits the telop data to another terminal (not shown) as image data. For example, the providing unit 18 may provide a signal compliant with the video electrical installation standard of a serial digital interface (SDI) or data including the signal. The providing unit 18 may transmit the telop data in accordance with the transmission timing of the transmission device. Further, the providing unit 18 may transmit the telop data in response to a request from the transmission device.

[0038] The Web conferencing server 2, the first terminal 3, and the second terminal 4 can constitute the Web conferencing system in the present embodiment. A Web conference is a communication means for clients connected to the network 9 to exchange or share data such as video, audio, or text in real time. A Web conferencing system is a system for conducting a Web conference. The Web conferencing system in the present embodiment may be a server-client system or a peer-to-peer system. The Web conferencing server 2 is a service terminal that provides Web conferencing services, and the first terminal 3 and the second terminal 4 are client terminals that receive (participate in) the Web conferencing services. In FIG. 1, the case where two terminals, the first terminal 3 and the second terminal 4, participate in the Web conference is illustrated, but the number of terminals participating in the Web conference may be three or more.

[0039] For example, in the server-client system, the Web conferencing server 2 provides Web conferencing services as a server to the first terminal 3 and the second terminal 4, which are client terminals. The first terminal 3 and the second terminal 4 may each log in to the Web conferencing server 2 and use the Web conferencing services by exchanging data such as video via the Web conferencing server 2. Note that the Web conferencing server 2 may be a cloud server constructed on the cloud of the Internet.

[0040] Also, in the peer-to-peer system, the Web conferencing server 2 may provide connection destination information such as the URL (Uniform Resource Locator) or IP (Internet Protocol) address of the communication destination to the first terminal 3 and the second terminal 4, or establish communication between the first terminal 3 and the second terminal 4 using the provided connection destination information. After the communication between the first terminal 3 and the second terminal 4 is established, the first terminal 3 and the second terminal 4 may directly exchange data such as video without going through the Web conferencing server 2.

[0041] The first terminal 3 and the second terminal 4 are client terminals participating in a web conference. The first terminal 3 and the second terminal 4 may be general-purpose devices such as a desktop PC, a notebook PC, a tablet PC, or a smartphone, or may be devices dedicated to web conferences. Among the client terminals of a web conference, a terminal that provides and shares data such as video is called a host terminal, and a terminal that is provided with and shares data such as video from the host terminal is called a guest terminal. In FIG. 1, the first terminal 3 exemplifies a host terminal that provides data such as video to the second terminal 4 using a web conference system. The second terminal 4 exemplifies a guest terminal that is provided with data such as video from the first terminal 3 using a web conference system. For example, in a web conference, the terminal that holds the conference (starts the web conference) can be set as the host terminal. The host terminal and the guest terminal in a web conference system can be set for each web conference. Also, the host terminal and the guest terminal may be able to be alternated during the web conference. Also, a plurality of guest terminals can participate in the web conference, and guest terminals other than the second terminal 4 may be able to participate.

[0042] The first terminal 3 has a first application 31 and a first display device 32. The first application 31 has plug-in software 311. Also, the first display device 32 has a main monitor 321 and a second monitor 322. The second terminal 4 has a second application 41, a second display device 42, a capture unit 43, an output unit 44, and a third display device 45. The second application 41 has plug-in software 411. Also, the second display device 42 has a main monitor 421 and a second monitor 422.

[0043] The first application 31 and the second application 41 are application software for using a web conferencing system. For example, the first application 31 logs in to the web conferencing server 2 and starts a web conference so that the first terminal 3 becomes the host terminal. The second application 41 logs in to the web conferencing server 2 and participates in the web conference so that the second terminal 4 becomes the guest terminal. The first application 31 provides data such as video to the second terminal 4, which is a guest terminal that has participated in the started web conference. The first application 31 and the second application 41 are application software for using a web conferencing system. Note that the first application 31 or the second application 41 can be implemented as dedicated application software executed on, for example, a PC or a smartphone. Also, the first application 31 or the second application 41 may be implemented by a web browser.

[0044] The plugin software 311 is software for adding functions for using the information processing apparatus 1 to the first application 31. The plugin software 311 has at least one of a telop data setting function that enables setting of telop data by displaying it on the first display device 32, or an image data display function that displays the image data acquired from the providing unit 18 of the information processing apparatus 1. The plugin software 311 may have other functions. The plugin software 311 is activated, for example, when the user operates a toolbar or a ribbon on the display screen of the first application 31 displayed on the first display device 32. When the first application 31 is implemented by a web browser, the plugin software 311 may be implemented as a plugin of the web browser.

[0045] The first display device 32 has at least a main monitor 321 and a second monitor 322. The second display device 42 has at least a main monitor 421 and a second monitor 422. The first application 31 and the second application 41 can share the display screens of the first display device 32 and the second display device 42 via the web conferencing system. For example, the first application 31 and the second application 41 can share the display screen displayed on the main monitor 321 of the first terminal 3 by displaying it on the main monitor 421 of the second terminal 4. Also, the first application 31 and the second application 41 can share the display screen displayed on the second monitor 322 of the first terminal 3 by displaying it on the second monitor 422 of the second terminal 4.

[0046] The main monitor 321 and the second monitor 322 in the present embodiment are respectively display areas in the first display device 32. Similarly, the main monitor 421 and the second monitor 422 are respectively display areas in the second display device 42. The main monitor 321 and the second monitor 322 may be displayed on individual display devices (e.g., liquid crystal monitors, etc.), or may be such that their respective areas are displayed on one display device. Similarly, the main monitor 421 and the second monitor 422 may be displayed on individual display devices, or may be such that their respective areas are displayed on one display device.

[0047] The main monitor 321 in the present embodiment is a display area for displaying the UI of the telop data setting function. The UI of the telop data setting function is provided, for example, by the UI providing unit 15. The second monitor 322 is a display area for displaying the image data acquired from the providing unit 18. The image data displayed on the second monitor 322 includes the telop data generated by the generating unit 17. By displaying the display screen displayed on the second monitor 322 on the second monitor 422, it becomes possible to share the display screen for displaying the image data including the telop data.

[0048] The display areas of the main monitor 321 and the second monitor 322 can be set by the user of the first terminal 3. For example, when the first terminal 3 has one or more display devices, the user may set a part of the display area of the display device as the main monitor 321 and set another part of the display area of the display device as the second monitor 322. Further, when the first terminal 3 has two or more display devices, the user may set any one of the display devices as the main monitor 321 and set the other one as the second monitor 322. Note that there may be three or more display areas. For example, there may be a display area such as a third monitor (not shown).

[0049] Similarly, the display areas of the main monitor 421 and the second monitor 422 can be set by the user of the second terminal 4. For example, when the second terminal 4 has one or more display devices, the user may set a part of the display area of the display device as the main monitor 421 and set another part of the display area of the display device as the second monitor 422. Further, when the second terminal 4 has two or more display devices, the user may set any one of the display devices as the main monitor 421 and set the other one as the second monitor 422.

[0050] <Subtitle data setting function> The subtitle data setting function is a function for setting the subtitle data generated by the above-described generation unit 17. The setting of the subtitle data is, for example, selection of material data used for the subtitle data, setting of the display range of the subtitle, or setting of the size, font, or color of the subtitle characters. The plugin software 311 displays a UI for setting subtitle data on the main monitor 321 so that the user can use the subtitle data setting function.

[0051] For example, in the selection of material data used for telop data, the user of the first terminal 3, which is the host terminal of the web conference, can select the input data entered by the user of the second terminal 4, which is the guest terminal, as the material data. The input data entered by the user of the second terminal 4 is, for example, text data, voice data, or image data. The text data is input, for example, when the user operates the keyboard (not shown) of the second terminal 4. The voice data is input, for example, by collecting the user's voice from the microphone (not shown) of the second terminal 4. Also, the image data is input, for example, when the user selects an image (such as an emoji) stored in the second terminal 4. The input data can be input, for example, by using the chat function of the web conference system. The chat function is a function that provides and shares input data such as text data entered by the participants of the web conference (users of the host terminal or users of the guest terminal) in real time to the terminals of other participants. There are various types of chats, such as text chat, voice chat, or video chat. By selecting the input data entered by the user of the second terminal 4 as the material data, it becomes possible to easily convert the input data such as text data provided by the participants of the web conference (users of the guest terminal) into telop data. Note that the input data entered in the second terminal 4 may be telops with different display correspondences. For example, each second terminal 4 can be recognized, and the display color of the telop data can be made different according to the terminal.

[0052] Also, in the selection of material data used for telop data, the user of the host terminal may select the information to be notified to the participants of the web conference (users of the guest terminal) as the material data. The information to be notified to the participants of the web conference is, for example, an advertisement or notice of a product or service, etc. The information to be notified to the participants of the web conference may include the lyrics of a song or the text data of a character broadcast, or the video data of sign language, etc. Thereby, the user of the host terminal can easily convert the information to be notified to the participants of the web conference into telop data.

[0053] In addition, when selecting material data to be used for telop data, the user of the host terminal may select, as the material data, the information to be displayed on the third display device 45 described later. The information to be displayed on the third display device 45 is, for example, game information indicating the progress of a game of a sport such as baseball, soccer, volleyball, or basketball. The game information is the information displayed on the large monitor at the game venue. By selecting the game information as the material data, for example, in a multi-purpose venue where games of a plurality of types of sports can be held, it becomes possible to easily generate telops suitable for each sport.

[0054] <Image data display function> The image data display function is a function of displaying the image data provided from the providing unit 18. The plugin software 311 displays the image data provided from the providing unit 18 on the second monitor 322. For example, the plugin software 311 acquires the image data provided from the providing unit 18, converts it to the number of pixels suitable for the display of the second monitor 322, and displays the image data. The user of the first terminal 3 can check the telop data generated from the image data displayed on the second monitor 322. The image data displayed on the second monitor 322 is displayed and shared on the second monitor 422 of the second terminal 4 which is a guest terminal of the web conference. Thereby, the second terminal 4 can easily acquire the image data including the telop data generated in the information processing apparatus 1.

[0055] The capture unit 43 captures the display screen of the image data displayed on the second monitor 422 of the second display device 42. The capture of the display screen means recording, in a memory (not shown) or the like, part or all of the still image or moving image displayed on the second monitor 422 in a readable manner. The capture of the display screen is performed, for example, by the operation of the user of the second terminal 4.

[0056] The output unit 44 outputs the video data of the display screen captured by the capture unit 43 to the third display device 45. The third display device 45 is, for example, a large screen or digital signage installed in public facilities, sports arenas, commercial facilities, streets, etc. By outputting the display screen of the image data captured by the capture unit 43 to the third display device 45, it becomes possible to easily use the image data including the telop data on the third display device 45.

[0057] The network 9 is, for example, the Internet. The network 9 may include, for example, a base station of a mobile phone, an access point of a wireless LAN, etc.

[0058] In the information processing system 100, the communication control unit 11, authentication unit 12, storage unit 13, acquisition unit 14, UI providing unit 15, determination unit 16, generation unit 17 and providing unit 18 of the information processing apparatus 1, the first application 31 and the first display device 32 of the first terminal 3, and the second application 41, second display device 42, capture unit 43, output unit 44 and third display device 45 of the second terminal 4 are examples of the functional units of the information processing system 100, and do not limit the functions of the information processing system 100. For example, the information processing system 100 does not necessarily have all of the above functional units, and may have some of the functional units. Also, the information processing system 100 may have other functions other than the above. For example, the information processing system 100 may have an input function for inputting information and an output function for notifying the operating state of the device by an LED lamp or the like.

[0059] Also, as described above, each of the functional units of the information processing system 100 has been described as being realized by software. However, at least one or more of the functional units of the information processing system 100 may be realized by hardware.

[0060] In addition, any of the functional units included in the information processing system 100 may be implemented by dividing one functional unit into a plurality of functional units. Also, any two or more of the functional units included in the information processing system 100 may be integrated into one functional unit for implementation. That is, FIG. 1 represents the functions of the information processing system 100 in terms of functional blocks, and does not indicate, for example, that each functional unit is constituted by a separate program file or the like.

[0061] Further, the information processing apparatus 1 may be a device realized by one housing, or may be a system realized by a plurality of devices connected via a network or the like. For example, the information processing apparatus 1 may have some or all of its functions realized by another virtual device such as a cloud service provided by a cloud computing system. That is, the information processing apparatus 1 may cause at least one or more of the above functional units to be realized by another device. Also, the information processing apparatus 1 may be a general-purpose computer such as a desktop PC, or may be a dedicated device with limited functions.

[0062] Next, with reference to FIGS. 2 to 8, the display screens displayed in the information processing system will be described. In FIGS. 2 to 7, the first display device 32 includes a main monitor 321 and a second monitor 322, and the second display device 42 includes a main monitor 421 and a second monitor 422. Also, the third display device 45 is displaying a captured image of the second monitor 422. The main monitor 321 and the second monitor 322 exemplify an inputter screen that can be visually recognized by an inputter who inputs subtitles, and the main monitor 421 and the second monitor 422 exemplify a local shared screen that is shared at the location where the third display device 45 is installed.

[0063] FIG. 2 is a diagram showing a first display example of a display device used in the information processing system 100 in the embodiment. In FIG. 2, the third display device 45 is a large display device installed in a baseball stadium. The third display device 45 displays a display screen showing baseball game information. The main monitor 321 displays a UI for telop setting for generating image data used for the display screen of the third display device 45. The second monitor 322 displays image data including telop data generated by settings based on the UI displayed on the main monitor 321. In the present embodiment, a case where the display screen (entire screen) displayed on the second monitor 322 is displayed as a telop is exemplified. On the second monitor 322, game information such as the progress of runs scored in baseball and player names is displayed as a telop in a predetermined format. The display screens of the main monitor 321 and the second monitor 322 are shared with the main monitor 421 and the second monitor 422 via a web conferencing system. The display screen of the second monitor 422 is captured and displayed on the third display device 45. Thereby, it becomes possible to reduce the cost of creating telop data at the site where the third display device 45 is installed. In FIGS. 2 to 7, a case where the display screen of the main monitor 321 is also shared with the main monitor 421 is exemplified, but the display screen of the main monitor 321 may not be shared.

[0064] FIG. 3 is a diagram showing a second display example of a display device used in the information processing system 100 in the embodiment. In FIG. 3, similar to FIG. 2, the third display device 45 is a large display device installed in a baseball stadium. The third display device 45 displays a display screen when a home run is hit. The second monitor 322 displays image data including telop data of text data of "home run" generated by settings based on the UI displayed on the main monitor 321. Note that the text data of "home run" may be provided by the user of the second terminal 4.

[0065] FIG. 4 is a diagram showing a third display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 4, the third display device 45 is a large display device installed in a soccer field. The third display device 45 displays soccer game information. The second monitor 322 displays image data including telop data of the game information generated by settings based on the UI displayed on the main monitor 321. The game information includes text data of team names, image data of team marks, and text data indicating the score situation.

[0066] FIG. 5 is a diagram showing a fourth display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 5, similar to FIG. 4, the third display device 45 is a large display device installed in a soccer field. The third display device 45 displays a display screen indicating additional time. The second monitor 322 displays image data including telop data of the text data of the additional time generated by settings based on the UI displayed on the main monitor 321. Note that the text data indicating the numerical value of the additional time may be provided by the user of the second terminal 4.

[0067] FIG. 6 is a diagram showing a fifth display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 5, the third display device 45 is a large display device installed in a gymnasium that is a volleyball game venue. The third display device 45 displays volleyball game information. In the present embodiment, it is possible to easily display a display screen suitable for each sport even in a place where various sports games are held, such as a gymnasium.

[0068] FIG. 7 is a diagram showing a sixth display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 6, similar to FIG. 5, the third display device 45 is a large display device installed in the gymnasium that is the venue for the volleyball game. The third display device 45 displays volleyball game information different from that in FIG. 5. In the present embodiment, various game information can be easily displayed.

[0069] FIG. 8 is a diagram showing a seventh display example of the display device used in the information processing system 100 according to the embodiment. In FIG. 8, the second display device 42 is displaying a display screen on the client terminal of a Web conference in which a plurality of (eight in the figure) participants are participating. On the upper right of the display screen, a shared screen shared by the host terminal of the Web conference is displayed. On the shared screen, telops 1001, 1002, 1003, and 1004 are superimposed on the live video of the concert venue. Also, a comment input field 1011 is displayed on the display screen of the second display device 42. Telops 1001 and 1003 are telop data obtained by superimposing telop data having text data or image data such as advertisements to be notified to the guest terminals, input from the host terminal, on the live video. Telop 1002 is telop data obtained by superimposing telop data having comments input from the comment input fields 1011 of the respective guest terminals on the live video. Also, telop 1004 is telop data obtained by converting the audio of the music being played into text data and superimposing it on the live video. The host terminal of the Web conference can reduce the cost related to the distribution of telop data by sharing the image data including the telop data generated in the information processing device 1 with the client terminals in the Web conference. Note that different telop data may be distributed to each participant on the display screen of the second display device 42.

[0070] Next, the hardware configuration of the information processing device 1 will be described with reference to FIG. 9. FIG. 9 is a block diagram showing an example of the hardware configuration of the information processing device 1 according to the embodiment.

[0071] The information processing apparatus 1 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, an I / O device 104, and a communication I / F (Interface) 105. The information processing apparatus 1 is a device that executes the information processing program described in FIG. 1.

[0072] The CPU 101 controls the user terminal by executing an information processing program stored in the RAM 102 or the ROM 103. The information processing program is obtained, for example, from a recording medium storing the program or a program distribution server via a network, installed in the ROM 103, read out by the CPU 101, and executed.

[0073] The I / O device 104 has an operation input function and a display function (operation display function). The I / O device 104 is, for example, a touch panel. The touch panel enables operation input by the user of the information processing apparatus 1 using a fingertip, a touch pen, or the like. In the present embodiment, the case where the I / O device 104 uses a touch panel having an operation display function will be described. However, the I / O device 104 may separately include a display device having a display function and an operation input device having an operation input function. In that case, the display screen of the touch panel can be the display screen of the display device, and the operation of the touch panel can be implemented as the operation of the operation input device. Note that the I / O device 104 may be realized in various forms such as a head-mounted type, a glasses type, or a wristwatch type display.

[0074] The communication I / F 105 is an I / F for communication. The communication I / F 105 executes, for example, short-range wireless communication such as wireless LAN, wired LAN, or infrared. Although the figure shows only the communication I / F 105 as the I / F for communication, the information processing apparatus 1 may have respective I / Fs for communication in a plurality of communication systems.

[0075] Next, the operation of the information processing apparatus 1 will be described with reference to FIG. 10. FIG. 10 is a flowchart showing an example of the operation of the information processing apparatus 1 in the embodiment. Although the execution subject of the operations in the flowchart shown below is described as the information processing apparatus 1, each operation can be executed in each functional unit of the information processing apparatus 1 described above.

[0076] In FIG. 10, the information processing apparatus 1 provides a UI including a login screen for a user who becomes a host terminal to log in and a telop data setting screen (step S11). The provision of the UI can be executed, for example, by providing a web page to the first terminal 3 that has accessed a predetermined network address of the information processing apparatus 1.

[0077] After executing the process of step S11, the information processing apparatus 1 determines whether or not the login of the user of the first terminal 3 has been successful (step S12). Whether or not the login has been successful can be determined by whether or not the authentication has been successful in the authentication unit 12. If it is determined that the login has not been successful (step S12: NO), the information processing apparatus 1 repeats the process of step S12 and waits for the login to be successful.

[0078] On the other hand, if it is determined that the login has been successful (step S12: YES), the information processing apparatus 1 determines whether or not material data to be used for telop data has been acquired (step S13). Whether or not the material data has been acquired can be determined, for example, by whether or not the acquisition unit 14 has acquired the material data. If it is determined that the material data has not been acquired (step S13: NO), the information processing apparatus 1 repeats the process of step S13 and waits for the material data to be acquired.

[0079] On the other hand, when it is determined that material data has been acquired (step S13: YES), the information processing apparatus 1 determines the type of the material data (text data, voice data, or image data) and recognizes the content of each material data (step S14). For example, when the material data is text data, the information processing apparatus 1 recognizes the number of characters of the text data and the type of text (e.g., Chinese characters, hiragana, alphanumeric characters, etc.). Also, when the material data is voice data, the information processing apparatus 1 recognizes the number of characters of the text data generated in voice recognition. Further, when the material data is image data, the information processing apparatus 1 recognizes the number of pixels of the recognized image.

[0080] After executing the process of step S14, the information processing apparatus 1 generates telop data based on the acquired material data and the display area of the telop, etc. (step S15). The generation of the telop data can be executed by the function of the generation unit 17 described above. After executing the process of step S15, the information processing apparatus 1 provides the first terminal 3 with image data including at least the telop data generated in step S15 (step S16). After executing the process of step S16, the information processing apparatus 1 ends the operations shown in the flowchart.

[0081] Note that the illustrated flowchart shows an example of the operations of the information processing apparatus 1 and does not limit the operations in the information processing apparatus 1.

[0082] Next, the operations of the first terminal 3 will be described with reference to FIG. 11. FIG. 11 is a flowchart showing an example of the operations of the first terminal 3 in the embodiment. Although the execution subject of the operations in the following flowchart is described as the first terminal 3, each operation can be executed in each functional unit of the first terminal 3 described above.

[0083] In FIG. 11, the first terminal 3 starts a Web conferencing system (step S21). Starting the Web conferencing system is executed, for example, by starting the first application 31 and accessing the Web conferencing server 2.

[0084] After executing the process of step S21, the first terminal 3 determines whether the user of the first terminal 3 has successfully logged in (step S22). Whether the login is successful can be determined by receiving a notification from the information processing apparatus 1 in the authentication unit 12 as to whether the authentication is successful. If it is determined that the login has not been successful (step S22: NO), the first terminal 3 repeats the process of step S12 and waits for the login to succeed.

[0085] On the other hand, if it is determined that the login is successful (step S22: YES), the first terminal 3 determines whether it has acquired material data to be used for the telop data from the second terminal 4 (step S23). The material data acquired from the second terminal 4 is, for example, chat data provided from the second terminal 4 in a web conference. If it is determined that the material data has not been acquired (step S23: NO), the first terminal 3 repeats the process of step S23 and waits for the material data to be acquired. Although FIG. 11 illustrates the case of acquiring the material data from the second terminal 4, the material data may be acquired from the first terminal 3 or another device.

[0086] On the other hand, if it is determined that the material data has been acquired (step S23: YES), the first terminal 3 provides the acquired material data to the information processing apparatus 1 (step S24). After executing the process of step S24, the first terminal 3 determines whether it has acquired image data including the telop data generated in the information processing apparatus 1 (step S25). If it is determined that the image data has not been acquired (step S25: NO), the first terminal 3 repeats the process of step S25 and waits for the acquisition of the image data.

[0087] On the other hand, when it is determined that the image data has been acquired (step S25: YES), the first terminal 3 shares the display screen of the acquired image data with the second terminal 4 which is the client terminal of the web conference (step S26). The sharing of the display screen can be executed in the display of the image data on the first display device 32, the display of the image data on the first display device 32, and the display of the display screen provided to the second terminal 4 in the web conference. After executing the process of step S26, the first terminal 3 ends the operations shown in the flowchart.

[0088] Note that the illustrated flowchart shows an example of the operations of the first terminal 3 and does not limit the operations in the first terminal 3.

[0089] Next, the operations of the second terminal 4 will be described with reference to FIG. 12. FIG. 12 is a flowchart showing an example of the operations of the second terminal 4 in the embodiment. Although the execution subject of the operations in the following flowchart is described as the second terminal 4, each operation can be executed in each functional unit of the second terminal 4 described above.

[0090] In FIG. 12, the second terminal 4 starts the web conference system (step S31). Starting the web conference system is executed, for example, by starting the second application 41 and accessing the web conference server 2. The access to the web conference server 2 is executed, for example, by inputting the conference room number of the web conference started by the first terminal 3 which is the host terminal. That is, it is assumed that the second terminal 4 in FIG. 12 can participate in the web conference as a client terminal only by inputting the conference room number.

[0091] After executing the process of step S31, the second terminal 4 provides material data to the first terminal 3 (step S32). The provision of the material data is executed, for example, by providing chat data through the chat function of the web conference.

[0092] After executing the process of step S31, the second terminal 4 shares the display screen of the first terminal 3, which is the host terminal of the web conference, as a client terminal (step S33). The sharing of the display screen can be executed in the display of the image data on the first display device 32, the display of the image data on the first display device 32, and the display of the display screen provided to the second terminal 4 in the web conference. After executing the process of step S33, the second terminal 4 ends the operations shown in the flowchart.

[0093] Note that the illustrated flowchart shows an example of the operations of the second terminal 4 and does not limit the operations in the second terminal 4. For example, the second terminal 4 may capture the display screen shared in step S33 and display it on the third display device 45.

[0094] Note that a program for realizing the functions constituting the devices described in this embodiment may be recorded on a computer-readable recording medium, the program recorded on the recording medium may be read into a computer system, and various processes described above in this embodiment may be performed by execution. Here, the "computer system" may include hardware such as an OS and peripheral devices. Further, the "computer system" shall also include a homepage providing environment (or a display environment) if it uses a WWW system. Further, the "computer-readable recording medium" refers to a writable non-volatile memory such as a flexible disk, a magneto-optical disk, a ROM, a flash memory, a portable medium such as a CD-ROM, and a storage device such as a hard disk built into a computer system.

[0095] Furthermore, the "computer-readable recording medium" includes those that hold a program for a certain period of time, such as volatile memory (e.g., DRAM (Dynamic Random Access Memory)) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Also, the above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication wire) such as a telephone line. Also, the above program may be for realizing a part of the aforementioned functions. Furthermore, it may be a so-called difference file (difference program) that realizes the aforementioned functions in combination with a program already recorded in a computer system.

[0096] As described above, the embodiments of the present invention have been described with reference to the drawings. However, the specific configuration is not limited to this embodiment, and various modifications within the scope not departing from the spirit of the present invention are also included.

[0097] For example, in the present embodiment, as a method for the second terminal to acquire the image data displayed on the first display device obtained via the web conferencing system, the case where the second terminal 4 has the second application 41 and the second application 41 acquires the image data is illustrated. Here, the second application 41 may be implemented as a dedicated application or plug-in software of a web browser as described above, or may be implemented as a function of a web browser that does not require plug-in software. However, the second terminal 4 may not have the second application 41. For example, the second terminal 4 may be a display system that passively receives the image data displayed on the first display device 32. The second terminal 4 may receive the screen data shared by the host terminal by the screen sharing function of the web conferencing system and display it on the second display device 42.

Explanation of Signs

[0098] 100 Information Processing System 1 Information Processing Apparatus 11 Communication Control Unit 12 Authentication Unit 13 Storage Unit 14 Acquisition Unit 15 UI Provision Unit 16 Judgment Unit 17 Generation Unit 18 Provision Unit 2 Web Conference Server 3 First Terminal 31 First Application 311 Plug-in Software 32 First Display Device 321 Main Monitor 322 Second Monitor 4 Second Terminal 41 Second Application 411 Plug-in Software 42 Second Display Device 421 Main Monitor 422 Second Monitor 43 Capture Unit 44 Output unit 45 Third display device 9 Network 101 CPU 102 RAM 103 ROM 104 I / O device 105 Communication I / F 1001, 1002, 1003, 1004 Subtitles 1011 Comment input field

Claims

1. A first terminal which is a client terminal in a web conferencing system, Another client terminal in the web conferencing system, a second terminal connected to the first terminal via the web conferencing system, An information processing system comprising an information processing apparatus communicably connected to the first terminal, The information processing apparatus, An acquisition unit that acquires material data from the first terminal, A generation unit that generates caption data based on the material data acquired by the acquisition unit, A provision unit that provides the first terminal with image data including at least the caption data generated by the generation unit, The first terminal, A first application for using the web conferencing system, A first display device that displays the image data provided by the provision unit, The second terminal, Has a second display device that displays the image data displayed on the first display device acquired from the first terminal via the web conferencing system, The first display device includes a main monitor that displays the setting of the caption data and a second monitor that displays the image data, The second terminal acquires the image data displayed on the second monitor shared via the web conferencing system, Information processing system.

2. The first application includes plug-in software having at least one of a caption data setting function that enables setting of the caption data by displaying the setting of the caption data on the main monitor or an image data display function that displays the image data provided by the provision unit. The information processing system according to claim 1.

3. The second terminal, A capture unit that captures a display screen of the image data displayed on the second display device, An output unit that outputs the display screen captured by the capture unit to a third display device, The information processing system according to claim 1 or 2, further comprising:

4. The second terminal provides input data input by a user of the second terminal to the first application, The first application provides the input data acquired from the second terminal to the information processing apparatus as the material data. The information processing system according to any one of claims 1 to 3.

5. The second terminal provides text data input by a user of the second terminal to the first application as the input data. The information processing system according to claim 4.

6. The second terminal provides voice data input by a user of the second terminal to the first application as the input data. The information processing system according to claim 4 or 5.

7. The second terminal, The information processing system according to any one of claims 1 to 6, which determines a display area for displaying the image data corresponding to the second display device.

8. An information processing method executed in an information processing system including a first terminal that is a client terminal in a Web conference system, a second terminal that is another client terminal in the Web conference system and is connected to the first terminal via the Web conference system, and an information processing apparatus that is communicably connected to the first terminal, Executed in the information processing apparatus, An acquisition step of acquiring material data from the first terminal, A generation step of generating telop data based on the material data acquired in the acquisition step, A providing step of providing the first terminal with image data including at least the telop data generated in the generation step, executed on the first terminal, a starting step of starting a first application for using the web conferencing system, a first display step of displaying the image data provided in the providing step, executed on the second terminal, a second display step of displaying the image data displayed in the first display step obtained from the first terminal via the web conferencing system including, The first terminal includes a main monitor for displaying the setting of the telop data and a second monitor for displaying the image data. The second terminal acquires the image data displayed on the second monitor shared via the web conferencing system. An information processing method.

9. An information processing program executed in an information processing system including a first terminal which is a client terminal in a web conferencing system, a second terminal which is another client terminal in the web conferencing system and is connected to the first terminal, and an information processing apparatus communicably connected to the first terminal, In the information processing apparatus, an acquisition function of acquiring material data from the first terminal, a generation function of generating telop data based on the material data acquired in the acquisition function, a providing function of providing the first terminal with image data including at least the telop data generated in the generation function, On the first terminal, a first application function for using the web conferencing system, a first display function of displaying the image data provided in the providing function, In the second terminal, A second display function for displaying the image data displayed in the first display function obtained from the first terminal via a web conferencing system is realized, The first terminal includes a main monitor for displaying the setting of the telop data and a second monitor for displaying the image data. The second terminal acquires the image data displayed on the second monitor shared via the web conferencing system. Information processing program.

Images