Reaction control device and program

Abstract

To reflect the reaction of viewers in a shooting studio.SOLUTION: A reaction management device can communicate with an operation terminal used by a viewer who views video and a presentation device installed in a shooting studio where the video is recorded. The reaction management device includes a reaction receiving unit that receives reaction information representing a reaction by the viewer from the operation terminal, and a presentation control unit that transmits a control signal for presenting the reaction to the presentation device based on the reaction information.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a reaction management device and a program.

Background Art

[0002] Conventionally, public program recording has been carried out by admitting viewers into a filming studio and recording a video program. In recent years, a program production method has also been used in which viewers view a program from a remote location using an online meeting tool.

[0003] On the other hand, there is a program production method in which viewers participate in a program by means of a two-way broadcast technology using a television connected to the Internet. For example, Patent Document 1 discloses a two-way broadcast viewing system that realizes an audience-participation type program rich in a sense of presence by aggregating voting information input by viewers on a viewer terminal via the Internet and reflecting the aggregation result in a broadcast video.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when viewers view a program from a remote location, the filming studio cannot grasp the reactions of the viewers in real time. As a result, the performances of the performers may not be fully elicited, and the video program may lack excitement.

[0006] One aspect of the present invention aims to reflect the reactions of viewers in a filming studio in view of the above technical problems.

Means for Solving the Problems

[0007] To solve the above problems, a reaction management device according to one aspect of the present invention is a reaction management device that can communicate with an operating terminal used by a viewer of a video and a presentation device installed in a filming studio for recording a video, and comprises a reaction receiving unit that receives reaction information representing the viewer's reaction from the operating terminal, and a presentation control unit that transmits a control signal to the presentation device for presenting a reaction based on the reaction information. [Effects of the Invention]

[0008] According to one aspect of the present invention, viewer reactions can be reflected in the filming studio. [Brief explanation of the drawing]

[0009] [Figure 1] This is a block diagram showing an example of the overall structure of a program production system. [Figure 2] A block diagram showing an example of a computer hardware configuration. [Figure 3] This is a block diagram showing an example of the functional configuration of a program production system. [Figure 4] This flowchart shows an example of the processing procedure for program production methods. [Figure 5] This is a conceptual diagram showing an example of an operation screen. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0011] [overview] Traditionally, in the production of television programs broadcast via television waves or video content distributed via communication networks (hereinafter collectively referred to as "video programs"), public recordings were conducted in the filming studio with a large audience present. In public recordings, the audience's reactions serve as a barometer for predicting the audience's reaction in advance. Furthermore, the audience's reactions can boost the morale of the performers, leading to better performances and creating a more lively atmosphere throughout the filming studio.

[0012] However, changes in social conditions, such as the spread of infectious diseases, can sometimes make it difficult to film programs in front of an audience. Programs produced without an audience in the filming studio often lack the sense of the viewers' presence and tend to be less exciting than before. For this reason, program production methods that allow viewers to virtually watch the program remotely using online conferencing tools are being employed. For example, the technology disclosed in Reference 1 is a well-known example of an online conferencing tool.

[0013] [Reference 1] Zoom Video Communications Inc., "Video conferencing, cloud phone, webinars, chat, virtual events | Zoom", [online], [Retrieved May 11, 2022], Internet<URL: https: / / zoom.us / >

[0014] The program production method that allows viewers to watch the program remotely has the advantage of making it possible for viewers who find it difficult to watch the program at the filming studio for various reasons to participate in the viewing. These various reasons include, for example, serious illness or injury, or living far away.

[0015] In addition, a questionnaire-based program participation method using a predetermined button (e.g., "d button", etc.) provided on a remote controller of a television receiver or hybrid cast is widely used as an audience participation type program (see, for example, Reference 2). Also, the buttons of the remote controller, hybrid cast, etc. are also utilized for questionnaires to improve the quality of video programs (see, for example, Reference 3). These methods have become effective means for program producers to grasp the opinions of viewers macroscopically.

[0016] 〔Reference 2〕Japanese Patent Laid-Open No. 2003-009127 〔Reference 3〕Japanese Patent Laid-Open No. 2014-217024

[0017] In the viewing method using an online meeting tool, viewers need to constantly show their faces from the camera of the terminal during recording or broadcasting for a long time. For example, when viewers participate from home or the like, they will watch while dealing with various events occurring in the home. Therefore, it is difficult for viewers to concentrate on watching the program, and it may cause stress. Due to such circumstances, there are not a few viewers who are negative about the viewing method using an online meeting tool.

[0018] On the other hand, in the questionnaire-based program participation method, many viewers feel that the sense of participation is low because they can realize that their opinions are just one of many. Also, when uploading input information by viewers' button operations, etc. to studio equipment via the Internet, for example, transmission delay is inevitable. Therefore, it is difficult to reflect the reactions of viewers to studio equipment in accordance with the timing of program progress.

[0019] One embodiment of the present invention receives the reaction of a viewer from an operation terminal used by the viewer who watches video, and presents the reaction of the viewer from a presentation device installed in a shooting studio. Therefore, according to one embodiment of the present invention, the reaction of the viewer can be reflected in the shooting studio. Thereby, producers and performers of video programs can grasp the reactions of viewers who are far away and utilize them for program production.

[0020] [Embodiment] One embodiment of the present invention is a program production system that presents the reaction of viewers who watch a video program in a shooting studio that records the video program. The program production system in this embodiment transmits a video program from a program production facility where the shooting studio is installed to a viewing facility where viewers are present via the Internet or the like. In the viewing facility, viewers watch the video program and obtain the reaction of the viewers. In the program production facility, based on the reaction information obtained in the viewing facility, the reaction of the viewers is presented using a presentation device installed in the shooting studio.

[0021] Since the program production system in this embodiment transmits reaction information via a communication network such as the Internet, a delay may occur. Therefore, in the case of an effect where a deviation due to a delay is not allowed, the program production system in this embodiment collects reaction information in advance by means of a rehearsal or the like, and stores it in association with the progress of the rehearsal. After that, in the live broadcast, based on the reaction information collected in advance, the reaction of the viewers is presented using the presentation device while synchronizing with the progress of the program.

[0022] <Overall Configuration of the Program Production System> First, the overall configuration of the program production system in this embodiment will be described while referring to FIG. 1. FIG. 1 is a block diagram showing an example of the overall configuration of the program production system in this embodiment.

[0023] As shown in FIG. 1, the program production system 1 in this embodiment includes a reaction management device 10, a presentation device 11, a program production device 12, a video transmission device 13, an operation terminal 21, and a receiver 22. The reaction management device 10, the presentation device 11, the program production device 12, the video transmission device 13, the operation terminal 21, and the receiver 22 are connected so as to be able to perform data communication via a communication network N1 such as a LAN (Local Area Network) or the Internet.

[0024] The response management device 10, the presentation device 11, the program production device 12, and the video transmission device 13 are installed in the program production facility E1. The program production facility E1 is a facility equipped for producing video programs that are distributed or broadcast via a communication network N1 or broadcast radio waves N2. The program production facility E1 is, for example, a television station.

[0025] Filming studio E2 will be installed in program production facility E1. Filming studio E2 will have at least a floor. The floor will be equipped with sets, including large and small props, according to the content of the video program. Performers of the video program will perform various acts on the floor.

[0026] Studio E2 may have seating for spectators. The seating area should be positioned to provide a view of the entire floor. For example, during a public recording of a program, spectators would watch the video program being recorded on the floor from their seats.

[0027] The program production facility E1 contains two cameras, C1 and C2. Camera C1 is used to capture video footage for program production. Camera C1 may be located outside the program production facility E1, as long as it can communicate with the equipment inside the facility via wired or wireless communication lines.

[0028] Camera C2 is a camera used to photograph the inside of the shooting studio E2. Camera C2 is installed in a predetermined position within the shooting studio E2 so that at least the display device 11 is within its field of view.

[0029] Hereafter, footage captured by camera C1 will be referred to as "studio footage," and footage captured by camera C2 will be referred to as "overhead footage."

[0030] If camera C1 is fixed in place so that the display device 11 is within its field of view, camera C2 may not be necessary. In this case, the image captured by camera C1 is used as both a studio image and an overhead view.

[0031] The operating terminal 21 and the receiver 22 are installed in the viewing facility E3. The viewing facility E3 is a facility equipped with facilities for viewing video programs. The viewing facility E3 is, for example, the viewer's residence.

[0032] The reaction management device 10 is an information processing device such as a personal computer, workstation, or server that manages reaction information representing the reactions of viewers. The reaction management device 10 receives reaction information from the operation terminal 21 and transmits control signals to the presentation device 11 to present the reactions of viewers.

[0033] The presentation device 11 is an electronic device that displays the viewer's response. The presentation device 11 receives a control signal from the response management device 10 and performs actions corresponding to the viewer's response according to the control signal.

[0034] The actions corresponding to the response vary depending on the configuration of the presentation device 11. These actions are performed in a manner that can be perceived by persons present in the filming studio E2 through sight, hearing, touch, etc. Persons present in the filming studio E2 include, for example, performers performing on the floor, or producers engaged in various tasks in program production.

[0035] An example of the display device 11 is a lighting fixture that can be operated via a wired or wireless communication line. This lighting fixture has a light source that can emit light in multiple colors, for example, by using a light-emitting diode (LED). Lighting fixtures that can be operated via a communication network are disclosed, for example, in Reference 4 below.

[0036] [Reference 4] Signify Japan LLC, "Smart Lights Change Your Life | Philips Hue", [online], [Retrieved May 11, 2022], Internet<URL: https: / / www.philips-hue.com / ja-jp>

[0037] The display device 11 consists of multiple lighting fixtures that correspond one-to-one with each viewer. The display device 11, in accordance with control signals based on response information received from the operation terminal 21, causes the lighting fixtures corresponding to the viewer using the operation terminal 21 to emit light in a color, brightness, or flashing pattern corresponding to the viewer's response.

[0038] Other examples of the presentation device 11 include large displays, speaker arrays, movable studio sets, and wearable devices worn by performers or producers. A presentation device 11 using a large display, for example, displays a screen having multiple areas corresponding to each viewer, and displays each area in a display mode that responds to the viewer's reaction.

[0039] A presentation device 11 using a speaker array, for example, consists of multiple speakers corresponding to each viewer and outputs an acoustic signal with sound and volume that corresponds to the viewer's response. A presentation device 11 using a studio set, for example, consists of multiple sets corresponding to each viewer and changes form in response to the viewer's response (for example, a character raises their hand, claps, etc.). A presentation device 11 using a wearable device, for example, vibrates in a pattern and magnitude that corresponds to the viewer's response.

[0040] The display device 11 is installed on the floor or in the audience seating area within the filming studio E2. However, the installation location of the display device 11 is not limited to the floor or audience seating area; it can be installed in any location that is perceptible to performers on the floor and can be filmed by camera C2.

[0041] The program production device 12 is equipment for producing video programs using studio footage. The program production device 12 is electrically connected to camera C1 via a wired or wireless communication path and is configured to acquire studio footage. The program production device 12 may consist of multiple devices equipped with various functions used in program production. The program production device 12 may also include equipment for broadcasting the produced video program to a viewing facility E3 via broadcast radio waves N2.

[0042] The video transmission device 13 is an information processing device such as a personal computer, workstation, or server that transmits video programs and overhead images. The video transmission device 13 is electrically connected to camera C2 via a wired or wireless communication path and is configured to acquire overhead images. The video transmission device 13 transmits the video program acquired from the program production device 12 and the overhead images acquired from camera C2 to the viewing facility E3 via the communication network N1.

[0043] The operating terminal 21 is an information processing terminal such as a personal computer, tablet, or smartphone operated by the viewer. The operating terminal 21 receives video programs and overhead images from the video transmission device 13 and displays them to the viewer.

[0044] The receiver 22 is an electronic device such as a television receiver, set-top box, or personal computer used by viewers to watch video programs. The receiver 22 receives video programs from the program production device 12 via broadcast waves N2 and displays them to viewers.

[0045] The overall configuration of the program production system 1 shown in Figure 1 is just one example, and various system configurations are possible depending on the application and purpose. For example, the reaction management device 10 may be implemented using multiple computers, or it may be implemented as a cloud computing service. Alternatively, for example, the program production system 1 may be implemented using a standalone information processing device that combines the functions that the reaction management device 10, program production device 12, and video transmission device 13 should each have.

[0046] <Hardware configuration of the program production system> Next, the hardware configuration of the program production system 1 in this embodiment will be described with reference to Figure 2.

[0047] Computer Hardware Configuration In this embodiment, the reaction management device 10, program production device 12, video transmission device 13, and operation terminal 21 are implemented by, for example, a computer. Figure 2 is a block diagram showing an example of the computer hardware configuration in this embodiment.

[0048] As shown in Figure 2, the computer 500 in this embodiment includes a CPU (Central Processing Unit) 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, HDD (Hard Disk Drive) 504, input device 505, display device 506, communication interface 507, and external interface 508. The CPU 501, ROM 502, and RAM 503 form a so-called computer. Each piece of hardware in the computer 500 is interconnected via a bus line 509. The input device 505 and display device 506 may also be used by connecting them to the external interface 508.

[0049] The CPU 501 is a processing unit that controls and implements the overall functions of the computer 500 by reading programs and data from storage devices such as the ROM 502 or HDD 504 onto the RAM 503 and executing processing.

[0050] ROM502 is an example of non-volatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. ROM502 functions as the main memory, storing various programs and data necessary for the CPU501 to execute the programs installed on HDD504. Specifically, ROM502 stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface) that are executed when the computer 500 starts up, as well as OS (Operating System) settings, network settings, and other data.

[0051] RAM503 is an example of volatile semiconductor memory (storage device) whose programs and data are erased when the power is turned off. RAM503 includes, for example, DRAM (Dynamic Random Access Memory) and SRAM (Static Random Access Memory). RAM503 provides a working area that is expanded when various programs installed on HDD504 are executed by CPU501.

[0052] HDD504 is an example of a non-volatile storage device that stores programs and data. The programs and data stored in HDD504 include the operating system (OS), which is the basic software that controls the entire computer 500, and applications that provide various functions on the OS. Note that computer 500 may use a storage device that uses flash memory as its storage medium (e.g., SSD: Solid State Drive) instead of HDD504.

[0053] The input device 505 includes a touch panel used by the user to input various signals, operation keys and buttons, a keyboard and mouse, and a microphone for inputting sound data such as voice.

[0054] The display device 506 consists of a display such as a liquid crystal or organic EL (Electro-Luminescence) that displays a screen, and a speaker that outputs sound data such as audio.

[0055] Communication I / F 507 is an interface that connects to a communication network and allows computer 500 to perform data communication.

[0056] External I / F 508 is an interface for external devices. Examples of external devices include the drive device 510.

[0057] The drive device 510 is a device for setting the recording medium 511. The recording medium 511 here includes media that record information optically, electrically, or magnetically, such as CD-ROMs, flexible disks, and magneto-optical disks. The recording medium 511 may also include semiconductor memory that records information electrically, such as ROMs and flash memory. This allows the computer 500 to read and / or write to the recording medium 511 via the external I / F 508.

[0058] The various programs to be installed on the HDD 504 are installed, for example, when the distributed recording medium 511 is set in a drive device 510 connected to an external I / F 508, and the various programs recorded on the recording medium 511 are read by the drive device 510. Alternatively, the various programs to be installed on the HDD 504 may be downloaded via the communication I / F 507 from a network other than the communication network and installed that way.

[0059] <Functional Configuration of the Program Production System> Next, the functional configuration of the program production system in this embodiment will be described with reference to Figure 3. Figure 3 is a block diagram showing an example of the functional configuration of the program production system 1 in this embodiment.

[0060] ≪Functional Configuration of Program Production Equipment≫ As shown in Figure 3, the program production apparatus 12 in this embodiment includes a video acquisition unit 121, a program editing unit 122, and a program transmission unit 123.

[0061] The video acquisition unit 121, the program editing unit 122, and the program transmission unit 123 are implemented, for example, by a process in which a program loaded from the HDD 504 shown in Figure 2 onto the RAM 503 is executed by the CPU 501.

[0062] The video acquisition unit 121 acquires studio video from camera C1.

[0063] The program editing unit 122 generates a video program based on the studio video acquired by the video acquisition unit 121, in response to instructions from producers and other personnel. The program editing unit 122 edits the studio video by combining it with other video materials, inserting subtitles, sound effects, and background music, thereby generating the video program.

[0064] The program transmission unit 123 transmits the video program generated by the program editing unit 122 to the video transmission device 13. The program transmission unit 123 also broadcasts the video program generated by the program editing unit 122 via broadcast radio waves N2.

[0065] ≪Functional Configuration of Video Transmission Device≫ As shown in Figure 3, the video transmission device 13 in this embodiment includes a video acquisition unit 131 and a video transmission unit 132.

[0066] The video acquisition unit 131 and the video transmission unit 132 are implemented, for example, by a process in which a program loaded from the HDD 504 shown in Figure 2 onto the RAM 503 is executed by the CPU 501.

[0067] The video acquisition unit 131 receives video programs from the program production device 12. The video acquisition unit 131 also acquires overhead images from camera C2.

[0068] The video transmission unit 132 transmits the video program and overhead view acquired by the video acquisition unit 131, along with mode information representing the recording mode of the video program, to the operation terminal 21 via the communication network N1. The recording mode of the video program is one of the following: live broadcast mode, rehearsal mode, or playback mode. The mode information is pre-set by the producer or other relevant party.

[0069] Mode information can be included, for example, in the MTE (Media Timed Event) of a video signal representing a video program. MTE is a trigger signal that can be included in MPEG-DASH (Dynamic Adaptive Streaming over HTTP) video.

[0070] ≪Operating Terminal Functional Configuration≫ As shown in Figure 3, the operating terminal 21 in this embodiment includes a video receiving unit 211, a video display unit 212, a response input unit 213, a mode determination unit 214, and a response transmission unit 215.

[0071] The video receiving unit 211, the mode determination unit 214, and the response transmission unit 215 are implemented, for example, by a program loaded onto RAM 503 from HDD 504 shown in Figure 2, which is then executed by CPU 501. The video display unit 212 is implemented, for example, by display device 506 shown in Figure 2. The response input unit 213 is implemented, for example, by input device 505 shown in Figure 2.

[0072] The video receiving unit 211 receives video programs, overhead images, and mode information from the video transmitting device 13. Based on the received video programs, the video receiving unit 211 stores a reference time. The reference time is a time that indicates the progress of the video program. An example of a reference time is the start time of the video program. Another example of a reference time is the start time of a segment or feature that makes up the video program. Another example of a reference time is the start time of an act in a music program or entertainment program.

[0073] The video display unit 212 displays the video program and overhead view received by the video receiving unit 211 on an operation screen displayed on the display device 506 or the like.

[0074] The response input unit 213 receives operations from viewers on the operation screen. Based on the received operations, the response input unit 213 generates response information representing the viewer's response. The response information includes identification information that identifies the viewer (hereinafter also referred to as the "viewer ID") and response content information that indicates the content of the viewer's response.

[0075] The response input unit 213 may generate response information without being based on operations by the viewer. For example, the response input unit 213 may generate response information based on biometric information acquired using a wearable device or the like worn by the viewer. The biometric information may be, for example, electroencephalogram, pulse rate, respiratory rate, or gaze. Alternatively, for example, the response input unit 213 may generate response information based on emotion recognition results using the viewer's facial image or speech recognition results using the viewer's speech.

[0076] The mode determination unit 214 determines the recording mode of the video program based on the mode information received by the video reception unit 211. If the recording mode is rehearsal mode, the mode determination unit 214 calculates the reaction time. The reaction time is the elapsed time from the reference time stored by the video reception unit 211 to the time when the reaction input unit 213 generates the reaction information.

[0077] The reaction transmission unit 215 transmits the reaction information generated by the reaction input unit 213 to the reaction management device 10. If the recording mode is rehearsal mode, the reaction transmission unit 215 includes information representing the reaction time in the reaction information and transmits it to the reaction management device 10.

[0078] ≪Functional Configuration of the Receiver≫ As shown in Figure 3, the receiver 22 in this embodiment includes a program receiving unit 221 and a program display unit 222.

[0079] The program receiving unit 221 receives video programs via broadcast radio waves N2.

[0080] The program display unit 222 displays the video program received by the program receiving unit 221 on a display device such as a liquid crystal display.

[0081] ≪Functional Configuration of the Reaction Control System≫ As shown in Figure 3, the reaction management device 10 in this embodiment comprises a reaction receiving unit 101, a memory control unit 102, a reaction storage unit 103, and a presentation control unit 104.

[0082] The response receiving unit 101, the memory control unit 102, and the presentation control unit 104 are implemented, for example, by a process in which a program loaded onto the RAM 503 from the HDD 504 shown in Figure 2 is executed by the CPU 501. The response memory unit 103 is implemented, for example, using the HDD 504 shown in Figure 2.

[0083] The response receiving unit 101 receives response information from the operation terminal 21 that represents the viewer's response.

[0084] When the reaction information received by the reaction receiving unit 101 includes information representing the reaction time, the memory control unit 102 stores the reaction information in the reaction storage unit 103.

[0085] The reaction memory unit 103 stores a reaction list in which reaction information is arranged chronologically.

[0086] The presentation control unit 104 transmits a control signal to the presentation device 11 for presenting a response based on the response information. The control signal includes the viewer ID and control content information. The viewer ID is the viewer ID included in the response information. The control content information is generated based on the response content information included in the response information.

[0087] The control content information represents the content of the action that the presentation device 11 will perform in response to the viewer's reaction. The content of the action may include, for example, information specifying the color, brightness, or flashing pattern of the lighting fixture.

[0088] When a reaction list is stored in the reaction storage unit 103, the presentation control unit 104 transmits a control signal to the presentation device 11 based on the reaction information contained in the reaction list so that the program progress and the reaction time are synchronized. On the other hand, when no reaction list is stored in the reaction storage unit 103, the presentation control unit 104 immediately transmits a control signal to the presentation device 11 based on the reaction information received by the reaction receiving unit 101.

[0089] As mentioned above, the reaction list is stored when the video program is in rehearsal mode. Therefore, the reaction list is stored in the reaction memory unit 103 when the actual broadcast is taking place after the rehearsal.

[0090] ≪Functional Configuration of the Display Device≫ As shown in Figure 3, the presentation device 11 in this embodiment comprises a signal receiving unit 111 and one or more response presentation units 112. The number of response presentation units 112 is configured to be at least the same as the number of viewers. Each response presentation unit 112 is assigned a viewer ID and is associated one-to-one with each viewer.

[0091] The signal receiving unit 111 receives a control signal from the reaction management device 10. The signal receiving unit 111 sends control content information included in the control signal to the reaction presentation unit 112, to which the viewer ID included in the control signal has been assigned.

[0092] The response display unit 112 performs actions to display the viewer's response according to the control content information received from the signal receiving unit 111. The actions to display the response include, for example, illuminating the lighting fixture with the color, brightness, or flashing pattern specified in the control content information.

[0093] <Program production system processing procedure> Next, the processing procedure for the program production method executed by the program production system 1 in this embodiment will be described with reference to Figure 4. Figure 4 is a flowchart showing an example of the processing procedure for the program production method in this embodiment.

[0094] In step S1, the video acquisition unit 121 of the program production device 12 acquires studio video from camera C1. Next, the video acquisition unit 121 sends the acquired studio video to the program editing unit 122.

[0095] The program editing unit 122 receives studio video from the video acquisition unit 121. Next, the program editing unit 122 edits the studio video according to the instructions of the producers, etc., and generates a video program. Subsequently, the program editing unit 122 sends the generated video program to the program transmission unit 123.

[0096] The program transmission unit 123 receives the video program from the program editing unit 122. Subsequently, the program transmission unit 123 transmits the received video program to the video transmission device 13.

[0097] In the video transmission device 13, the video acquisition unit 131 receives the video program from the program production device 12. Next, the video acquisition unit 131 acquires an overhead view from camera C2. Subsequently, the video acquisition unit 131 sends the acquired video program and overhead view to the video transmission unit 132.

[0098] The video transmission unit 132 receives the video program and overhead view from the video acquisition unit 131. Next, the video transmission unit 132 transmits the video program, overhead view, and pre-set mode information to the operation terminal 21 via the communication network N1.

[0099] In step S2, the video receiving unit 211 of the operating terminal 21 receives the video program, overhead view, and mode information from the video transmitting device 13. Next, the video receiving unit 211 stores a reference time based on the received video program. Subsequently, the video receiving unit 211 sends the video program and overhead view to the video display unit 212. The video receiving unit 211 also sends the mode information to the mode determination unit 214.

[0100] The video display unit 212 receives the video program and overhead view from the video receiving unit 211. Next, the video display unit 212 displays the received video program and overhead view on the operation screen displayed on the display device 506 or the like.

[0101] In step S3, the response input unit 213 of the operation terminal 21 receives an operation from the viewer on the operation screen. Next, the response input unit 213 generates response information based on the received operation. Subsequently, the response input unit 213 sends the response information to the response transmission unit 215.

[0102] ≪Operation screen≫ Here, the operation screen in this embodiment will be described with reference to Figure 5. Figure 5 is a conceptual diagram showing an example of the operation screen in this embodiment.

[0103] As shown in Figure 5, the operation screen 1000 in this embodiment has a video program display area 1010, an overhead view display area 1020, and an operation area 1030.

[0104] The video program display area 1010 displays the video program. The overhead view display area 1020 displays the overhead view. The operation area 1030 displays input fields for viewers to input their reactions.

[0105] The operation area 1030 includes a lighting state selection field 1031, a color display field 1032, and a color selection field 1033. The lighting state selection field 1031 displays the current lighting state (on or off) of the lighting fixture associated with the viewer. The color display field 1032 displays the current emitted color of the lighting fixture associated with the viewer. The color selection field 1033 displays the colors that the lighting fixture can emit.

[0106] By operating the lighting state selection field 1031, an operation to switch the lighting state of the lighting fixture is accepted. By selecting a desired color in the color selection field 1033, an operation to change the light color of the lighting fixture is accepted.

[0107] The operation screen 1000 shown in Figure 5 is an example, and the video program and overhead view can be displayed in any manner. For example, the video program and the overhead view may be displayed in separate windows, and the viewer may switch between the displayed videos. Also, the input items displayed in the operation area 1030 will differ depending on the configuration of the display device 11. The operation area 1030 may have any input items as long as the display device 11 can operate on those items.

[0108] Let's return to Figure 4 for explanation. In step S4, the mode determination unit 214 of the operating terminal 21 receives mode information from the video receiving unit 211. Next, the mode determination unit 214 determines the recording mode of the video program based on the received mode information. If the recording mode is live broadcast mode, the mode determination unit 214 proceeds to step S5. If the recording mode is rehearsal mode, the mode determination unit 214 proceeds to step S8. If the recording mode is playback mode, the mode determination unit 214 proceeds to step S13.

[0109] ≪When the recording mode is set to live broadcast mode≫ In step S5, the reaction transmission unit 215 of the operating terminal 21 receives reaction information from the reaction input unit 213. Next, the reaction transmission unit 215 transmits the received reaction information to the reaction management device 10.

[0110] In the reaction management device 10, the reaction receiving unit 101 receives reaction information from the operation terminal 21. Next, the reaction receiving unit 101 sends the received reaction information to the presentation control unit 104.

[0111] In step S6, the presentation control unit 104 of the reaction management device 10 receives reaction information from the reaction receiving unit 101. Next, the presentation control unit 104 generates a control signal based on the received reaction information. Subsequently, the presentation control unit 104 transmits the generated control signal to the presentation device 11.

[0112] In the presentation device 11, the signal receiving unit 111 receives a control signal from the response management device 10. Next, the signal receiving unit 111 sends the control content information contained in the control signal to the response presentation unit 112, which corresponds to the viewer ID contained in the control signal.

[0113] The response display unit 112 receives control content information from the signal receiving unit 111. Next, the response display unit 112 performs an action to display the viewer's response based on the received control content information.

[0114] In step S7, the presentation control unit 104 of the response management device 10 determines whether the live broadcast video program has ended and whether the operation terminal 21 has shut down. If the video program has ended or the operation terminal 21 has shut down, the presentation control unit 104 terminates processing. If the video program has not ended and the operation terminal 21 has not shut down, the presentation control unit 104 returns processing to step S3.

[0115] ≪When the recording mode is set to rehearsal mode≫ In step S8, the mode determination unit 214 of the operating terminal 21 calculates the elapsed time from the reference time stored by the video receiving unit 211 as the reaction time. Next, the mode determination unit 214 sends the calculated reaction time to the reaction transmission unit 215.

[0116] In step S9, the reaction transmission unit 215 of the operating terminal 21 receives reaction information from the reaction input unit 213. Next, the reaction transmission unit 215 receives the reaction time from the mode determination unit 214. Subsequently, the reaction transmission unit 215 transmits the reaction information, including information representing the reaction time, to the reaction management device 10.

[0117] In the reaction management device 10, the reaction receiving unit 101 receives reaction information from the operation terminal 21. Next, the reaction receiving unit 101 sends the reaction information to the memory control unit 102.

[0118] In step S10, the memory control unit 102 of the reaction management device 10 receives reaction information from the reaction receiving unit 101. Next, the memory control unit 102 stores the received reaction information at the end of the reaction list stored in the reaction storage unit 103. Subsequently, the memory control unit 102 sends the reaction information to the presentation control unit 104.

[0119] In step S11, the presentation control unit 104 of the reaction management device 10 receives reaction information from the memory control unit 102. Next, the presentation control unit 104 generates a control signal based on the received reaction information. Subsequently, the presentation control unit 104 transmits the generated control signal to the presentation device 11.

[0120] In the presentation device 11, the signal receiving unit 111 receives a control signal from the response management device 10. Next, the signal receiving unit 111 sends the control content information contained in the control signal to the response presentation unit 112, which corresponds to the viewer ID contained in the control signal.

[0121] The response display unit 112 receives control content information from the signal receiving unit 111. Next, the response display unit 112 performs an action to display the viewer's response based on the received control content information.

[0122] In step S12, the presentation control unit 104 of the reaction management device 10 determines whether the video program due to rehearsal has ended and whether the operation terminal 21 has shut down. If the video program has ended or the operation terminal 21 has shut down, the presentation control unit 104 proceeds to step S13. If the video program has not ended and the operation terminal 21 has not shut down, the presentation control unit 104 returns to step S3.

[0123] ≪When the recording mode is set to playback mode≫ In step S13, the program transmission unit 123 of the program production device 12 starts the live broadcast in response to an operation by the producer or other person. Specifically, the program transmission unit 123 broadcasts the video program generated by the program editing unit 122 via the broadcast radio waves N2.

[0124] In the viewing facility E3, the program receiving unit 221 of the receiver 22 receives the video program via the broadcast radio waves N2. Next, the program receiving unit 221 sends the video program to the program display unit 222.

[0125] The program display unit 222 receives a video program from the program receiving unit 221. Next, the program display unit 222 displays the received video program on a display device such as a liquid crystal display.

[0126] In step S14, the presentation control unit 104 of the reaction management device 10 reads the reaction list from the reaction storage unit 103. Next, the presentation control unit 104 generates a control signal based on the reaction information contained in the reaction list. Subsequently, the presentation control unit 104 transmits the control signal to the presentation device 11 so that the program progress and the reaction time are synchronized.

[0127] In the presentation device 11, the signal receiving unit 111 receives a control signal from the response management device 10. Next, the signal receiving unit 111 sends the control content information contained in the control signal to the response presentation unit 112, which corresponds to the viewer ID contained in the control signal.

[0128] The response display unit 112 receives control content information from the signal receiving unit 111. Next, the response display unit 112 performs an action to display the viewer's response based on the received control content information.

[0129] <Effects of the Embodiment> The program production system in this embodiment receives reaction information representing viewer responses from an operating terminal used by viewers watching a video program, and displays the viewer responses from a display device installed in the filming studio. Therefore, according to the program production system in this embodiment, viewer responses can be reflected in the filming studio.

[0130] In particular, the program production system in this embodiment records reaction information representing the reactions of viewers watching the rehearsal in a reaction list, associated with the reaction time, and then, in the actual broadcast that follows, presents the reactions of the viewers from the presentation device based on the reaction information recorded in the reaction list. Therefore, according to the program production system in this embodiment, it is possible to present the reactions of the viewers in synchronization with the progress of the program, without being affected by the transmission delay when receiving the reactions of the viewers.

[0131] Furthermore, the program production system in this embodiment presents each viewer's response from a presentation device that corresponds one-to-one with each viewer. In addition, the program production system in this embodiment displays an overhead view of the filming studio from which the presentation device was filmed to the viewer.Therefore, the program production system in this embodiment allows viewers to recognize that their own responses are reflected in the program production, thereby improving their sense of participation.

[0132] For example, the program production system in this embodiment uses lighting fixtures capable of emitting light in multiple colors, and causes the lighting fixtures to emit light in a color, brightness, or flashing pattern that responds to the viewer's reaction. Therefore, according to the program production system in this embodiment, the viewer's reaction can be intuitively grasped through visual means.

[0133] [Differentiation] In the above embodiment, the recording mode is one of live broadcast mode, rehearsal mode, or playback mode, and an example was described in which the processing for presenting reaction information is switched according to the recording mode. Here, the processing may also be switched according to the direction even within the same program.

[0134] For example, in scenes where delay is unacceptable, the recording mode may be set to rehearsal mode, and the system may be configured to present viewer reactions in sync with the program's progress using reaction information collected in advance. On the other hand, in scenes where delay is acceptable, the recording mode may be set to live broadcast mode, and the system may be configured to present viewer reactions immediately using reaction information received from the control terminal.

[0135] Examples of situations where delays are unacceptable include musical performances in music programs and performances in entertainment programs. Examples of situations where delays are acceptable include sports broadcasts and talk shows.

[0136] In this way, by appropriately using both reaction information collected in advance and reaction information received from the control terminal, according to the nature of the production, it becomes possible to balance and improve the excitement in the filming studio with the sense of participation of the viewers.

[0137] [supplement] Each of the embodiments described above can be implemented by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules designed to execute each of the functions described above.

[0138] Although embodiments of the present invention have been described in detail above, the present invention is not limited to these embodiments, and various modifications or changes are possible within the scope of the gist of the present invention as described in the claims. [Explanation of Symbols]

[0139] 1. Program Production System 10. Reaction control device 101 Reaction receiving unit 102 Memory Control Unit 103 Reaction memory unit 104 Display Control Unit 11 Presentation device 111 Signal receiving unit 112 Reaction presentation section 12 Program production equipment 121 Video Acquisition Unit 122 Program Editorial Department 123 Program Transmission Unit 13. Video transmission device 131 Video Acquisition Unit 132 Video transmission unit 21 Operating terminal 211 Video Receiver 212 Video display unit 213 Reaction Input Section 214 Mode determination unit 215 Reaction Transmission Unit 22 Receiver 221 Program Receiving Unit 222 Program display section

Claims

1. A response management device that can communicate with an operating terminal used by viewers to view the video and a display device installed in the filming studio where the video is recorded, A reaction receiving unit that receives reaction information representing the viewer's reaction from the operating terminal, A storage control unit stores the elapsed time from a reference time in the aforementioned video in association with the reaction information in the storage unit, A presentation control unit that transmits a control signal to the presentation device for presenting the response based on the response information, Equipped with, The presentation control unit, When the reaction information is stored in the memory unit, the control signal is transmitted based on the reaction information stored in the memory unit. When the response information is not stored in the memory unit, the response receiving unit transmits the control signal based on the response information it has received. Reaction control device.

2. A reaction control apparatus according to claim 1, The aforementioned video includes video footage of the display device, Reaction control device.

3. A reaction control apparatus according to claim 1, The presentation device presents the response in a way that is perceptible to a person present in the filming studio through sight, hearing, or touch. Reaction control device.

4. A reaction control apparatus according to claim 3, The aforementioned display device is a lighting fixture capable of emitting light in multiple colors, The display control unit causes the lighting fixture to emit light in a color, brightness, or flashing pattern corresponding to the reaction. Reaction control device.

5. A reaction control apparatus according to claim 4, The display device includes a plurality of lighting fixtures that are associated one-to-one with the viewer. Reaction control device.

6. A program for causing a computer to function as a reaction control device according to any one of claims 1 to 5.

Images